2024-05-20T21:42:36.160 INFO:root:teuthology version: 0.0.1.dev287+gb9e3da8 2024-05-20T21:42:36.160 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/adking-2024-05-20_20:47:35-orch:cephadm-squid-release-distro-default-smithi/7716645 --description orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} --owner scheduled_adking@teuthology --name adking-2024-05-20_20:47:35-orch:cephadm-squid-release-distro-default-smithi --verbose -- /home/teuthworker/archive/adking-2024-05-20_20:47:35-orch:cephadm-squid-release-distro-default-smithi/7716645/orig.config.yaml 2024-05-20T21:42:36.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-20T21:42:36.268 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/adking-2024-05-20_20:47:35-orch:cephadm-squid-release-distro-default-smithi/7716645 branch: squid-release description: orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} email: adking@redhat.com first_in_suite: false job_id: '7716645' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: adking-2024-05-20_20:47:35-orch:cephadm-squid-release-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid-release ceph: conf: client: debug ms: 1 global: mon election default strategy: 3 ms bind msgr2: false ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug ms: 1 debug osd: 20 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) log-only-match: - CEPHADM_ mon_bind_msgr2: false sha1: 4ea7251640d7dc85322163e97efba46b50b07648 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} cephadm: cephadm_mode: root image: quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 install: ceph: flavor: default sha1: 4ea7251640d7dc85322163e97efba46b50b07648 workunit: branch: squid-release sha1: 200b27799814c89893ec6700f852fc40163e03d5 owner: scheduled_adking@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a seed: 4887 sha1: 4ea7251640d7dc85322163e97efba46b50b07648 sleep_before_teardown: 0 subset: 1/18 suite: orch:cephadm suite_branch: squid-release suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_200b27799814c89893ec6700f852fc40163e03d5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 200b27799814c89893ec6700f852fc40163e03d5 targets: smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHF+xNM1BuF4pdGMGZRgb5v2KvuLki5U/H/ppfk220r3O2TcDsVR4uSIvogRg6lYBWc71jAqaWmPppbLtYeuHBc= smithi145.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKYOG3VrMi9Jki2cBoNNp5V81HFyWgJoQP1twzE2QAvQ6vQSgndT5SjagEkI3ofuwLR2cxWRWgHnUmDM+Wb/LP8= tasks: - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b9e3da87b1ec7920937cb4902b7e3fd9eda86b4a timestamp: 2024-05-20_20:47:35 tube: smithi user: adking verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-05-20T21:42:36.269 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_200b27799814c89893ec6700f852fc40163e03d5/qa; will attempt to use it 2024-05-20T21:42:36.269 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_200b27799814c89893ec6700f852fc40163e03d5/qa/tasks 2024-05-20T21:42:36.269 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-20T21:42:36.271 INFO:teuthology.task.internal:Checking packages... 2024-05-20T21:42:36.290 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '4ea7251640d7dc85322163e97efba46b50b07648' 2024-05-20T21:42:36.290 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-20T21:42:36.290 INFO:teuthology.packaging:ref: None 2024-05-20T21:42:36.290 INFO:teuthology.packaging:tag: None 2024-05-20T21:42:36.291 INFO:teuthology.packaging:branch: squid-release 2024-05-20T21:42:36.291 INFO:teuthology.packaging:sha1: 4ea7251640d7dc85322163e97efba46b50b07648 2024-05-20T21:42:36.291 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid-release 2024-05-20T21:42:36.507 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2536-g200b2779-1jammy 2024-05-20T21:42:36.509 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-20T21:42:36.516 INFO:teuthology.task.internal:no buildpackages task found 2024-05-20T21:42:36.516 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-20T21:42:36.522 INFO:teuthology.task.internal:Saving configuration 2024-05-20T21:42:36.534 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-20T21:42:36.541 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-20T21:42:36.563 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2024-05-20_20:47:35-orch:cephadm-squid-release-distro-default-smithi/7716645', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-20 21:37:02.141574', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM7/YaqahmrUGrNPs0Uj+SCtMYRa4buzPZ2KYxx7Qik3'} 2024-05-20T21:42:36.579 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2024-05-20_20:47:35-orch:cephadm-squid-release-distro-default-smithi/7716645', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-20 21:37:02.140329', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAII2II3Js35a35pxy02L8sL1EVxEHHwGhR4nHjleraP+m'} 2024-05-20T21:42:36.579 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-20T21:42:36.585 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2024-05-20T21:42:36.586 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2024-05-20T21:42:36.586 INFO:teuthology.run_tasks:Running task console_log... 2024-05-20T21:42:36.643 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7899bffac0>, signals=[15]) 2024-05-20T21:42:36.643 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-20T21:42:36.649 INFO:teuthology.task.internal:Opening connections... 2024-05-20T21:42:36.650 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2024-05-20T21:42:36.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T21:42:36.732 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi145.front.sepia.ceph.com 2024-05-20T21:42:36.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T21:42:36.810 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-20T21:42:36.817 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2024-05-20T21:42:36.821 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2024-05-20T21:42:36.822 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-05-20T21:42:36.866 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-20T21:42:36.867 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Ubuntu" 2024-05-20T21:42:36.867 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="22.04" 2024-05-20T21:42:36.867 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-20T21:42:36.867 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_CODENAME=jammy 2024-05-20T21:42:36.867 INFO:teuthology.orchestra.run.smithi050.stdout:ID=ubuntu 2024-05-20T21:42:36.867 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE=debian 2024-05-20T21:42:36.867 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-20T21:42:36.867 INFO:teuthology.orchestra.run.smithi050.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-20T21:42:36.867 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-20T21:42:36.867 INFO:teuthology.orchestra.run.smithi050.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-20T21:42:36.867 INFO:teuthology.orchestra.run.smithi050.stdout:UBUNTU_CODENAME=jammy 2024-05-20T21:42:36.868 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-05-20T21:42:36.889 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2024-05-20T21:42:36.893 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2024-05-20T21:42:36.894 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-05-20T21:42:36.938 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-20T21:42:36.938 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Ubuntu" 2024-05-20T21:42:36.938 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="22.04" 2024-05-20T21:42:36.938 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-20T21:42:36.938 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_CODENAME=jammy 2024-05-20T21:42:36.939 INFO:teuthology.orchestra.run.smithi145.stdout:ID=ubuntu 2024-05-20T21:42:36.939 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE=debian 2024-05-20T21:42:36.939 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-20T21:42:36.939 INFO:teuthology.orchestra.run.smithi145.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-20T21:42:36.939 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-20T21:42:36.939 INFO:teuthology.orchestra.run.smithi145.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-20T21:42:36.939 INFO:teuthology.orchestra.run.smithi145.stdout:UBUNTU_CODENAME=jammy 2024-05-20T21:42:36.939 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-05-20T21:42:36.964 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-20T21:42:36.972 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-20T21:42:36.978 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-20T21:42:36.979 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2024-05-20T21:42:36.981 DEBUG:teuthology.orchestra.run.smithi145:> test '!' -e /home/ubuntu/cephtest 2024-05-20T21:42:36.986 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-20T21:42:36.992 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-20T21:42:36.992 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2024-05-20T21:42:37.028 DEBUG:teuthology.orchestra.run.smithi145:> test -z $(ls -A /var/lib/ceph) 2024-05-20T21:42:37.045 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-20T21:42:37.102 INFO:teuthology.run_tasks:Running task kernel... 2024-05-20T21:42:37.116 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-20T21:42:37.116 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-20T21:42:37.117 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-20T21:42:37.117 DEBUG:teuthology.orchestra.run.smithi145:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-20T21:42:37.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T21:42:37.122 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-05-20T21:42:37.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T21:42:37.123 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-05-20T21:42:37.167 INFO:teuthology.orchestra.run.smithi050.stdout:5.15.0-56-generic 2024-05-20T21:42:37.167 INFO:teuthology.task.kernel:Running kernel on smithi050: 5.15.0-56-generic 2024-05-20T21:42:37.167 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get clean 2024-05-20T21:42:37.171 INFO:teuthology.orchestra.run.smithi145.stdout:5.15.0-56-generic 2024-05-20T21:42:37.171 INFO:teuthology.task.kernel:Running kernel on smithi145: 5.15.0-56-generic 2024-05-20T21:42:37.171 DEBUG:teuthology.orchestra.run.smithi145:> sudo apt-get clean 2024-05-20T21:42:37.292 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2024-05-20T21:42:37.305 DEBUG:teuthology.orchestra.run.smithi145:> sudo apt-get update 2024-05-20T21:42:37.439 INFO:teuthology.orchestra.run.smithi145.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-20T21:42:37.448 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-20T21:42:37.531 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-20T21:42:37.540 INFO:teuthology.orchestra.run.smithi145.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-20T21:42:37.612 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-20T21:42:37.624 INFO:teuthology.orchestra.run.smithi145.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-20T21:42:37.644 INFO:teuthology.orchestra.run.smithi145.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,468 kB] 2024-05-20T21:42:37.658 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [470 kB] 2024-05-20T21:42:37.756 INFO:teuthology.orchestra.run.smithi145.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [470 kB] 2024-05-20T21:42:37.760 INFO:teuthology.orchestra.run.smithi145.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [253 kB] 2024-05-20T21:42:37.761 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,468 kB] 2024-05-20T21:42:37.763 INFO:teuthology.orchestra.run.smithi145.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-20T21:42:37.763 INFO:teuthology.orchestra.run.smithi145.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-20T21:42:37.764 INFO:teuthology.orchestra.run.smithi145.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,871 kB] 2024-05-20T21:42:37.788 INFO:teuthology.orchestra.run.smithi145.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [317 kB] 2024-05-20T21:42:37.792 INFO:teuthology.orchestra.run.smithi145.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-20T21:42:37.792 INFO:teuthology.orchestra.run.smithi145.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-05-20T21:42:37.803 INFO:teuthology.orchestra.run.smithi145.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [603 kB] 2024-05-20T21:42:37.814 INFO:teuthology.orchestra.run.smithi145.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [164 kB] 2024-05-20T21:42:37.816 INFO:teuthology.orchestra.run.smithi145.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-20T21:42:37.817 INFO:teuthology.orchestra.run.smithi145.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-20T21:42:37.818 INFO:teuthology.orchestra.run.smithi145.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-20T21:42:37.818 INFO:teuthology.orchestra.run.smithi145.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-20T21:42:37.821 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [253 kB] 2024-05-20T21:42:37.825 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-20T21:42:37.825 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,871 kB] 2024-05-20T21:42:37.852 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-20T21:42:37.853 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [317 kB] 2024-05-20T21:42:37.855 INFO:teuthology.orchestra.run.smithi145.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-20T21:42:37.857 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-20T21:42:37.858 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [603 kB] 2024-05-20T21:42:37.864 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-05-20T21:42:37.872 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [164 kB] 2024-05-20T21:42:37.874 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-20T21:42:37.874 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-20T21:42:37.874 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-20T21:42:37.885 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-20T21:42:37.886 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-20T21:42:37.981 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-20T21:42:37.984 INFO:teuthology.orchestra.run.smithi145.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-20T21:42:38.122 INFO:teuthology.orchestra.run.smithi145.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,681 kB] 2024-05-20T21:42:38.150 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [631 kB] 2024-05-20T21:42:38.372 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,681 kB] 2024-05-20T21:42:38.437 INFO:teuthology.orchestra.run.smithi145.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [631 kB] 2024-05-20T21:42:38.477 INFO:teuthology.orchestra.run.smithi145.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [311 kB] 2024-05-20T21:42:38.491 INFO:teuthology.orchestra.run.smithi145.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-20T21:42:38.492 INFO:teuthology.orchestra.run.smithi145.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,928 kB] 2024-05-20T21:42:38.512 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [311 kB] 2024-05-20T21:42:38.525 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-20T21:42:38.525 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,928 kB] 2024-05-20T21:42:38.555 INFO:teuthology.orchestra.run.smithi145.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-20T21:42:38.556 INFO:teuthology.orchestra.run.smithi145.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [327 kB] 2024-05-20T21:42:38.563 INFO:teuthology.orchestra.run.smithi145.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-20T21:42:38.592 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-20T21:42:38.593 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [327 kB] 2024-05-20T21:42:38.600 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-20T21:42:38.728 INFO:teuthology.orchestra.run.smithi145.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-20T21:42:38.765 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-20T21:42:39.310 INFO:teuthology.orchestra.run.smithi145.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-05-20T21:42:39.343 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-05-20T21:42:39.421 INFO:teuthology.orchestra.run.smithi145.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [246 kB] 2024-05-20T21:42:39.441 INFO:teuthology.orchestra.run.smithi145.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-20T21:42:39.443 INFO:teuthology.orchestra.run.smithi145.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-20T21:42:39.446 INFO:teuthology.orchestra.run.smithi145.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-20T21:42:39.446 INFO:teuthology.orchestra.run.smithi145.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-20T21:42:39.447 INFO:teuthology.orchestra.run.smithi145.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-20T21:42:39.448 INFO:teuthology.orchestra.run.smithi145.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-20T21:42:39.451 INFO:teuthology.orchestra.run.smithi145.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-20T21:42:39.456 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [246 kB] 2024-05-20T21:42:39.456 INFO:teuthology.orchestra.run.smithi145.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-20T21:42:39.476 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-20T21:42:39.477 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-20T21:42:39.478 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-20T21:42:39.482 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-20T21:42:39.483 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-20T21:42:39.483 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-20T21:42:39.490 INFO:teuthology.orchestra.run.smithi050.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-20T21:42:39.495 INFO:teuthology.orchestra.run.smithi050.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-20T21:42:39.621 INFO:teuthology.orchestra.run.smithi145.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-20T21:42:39.665 INFO:teuthology.orchestra.run.smithi050.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-20T21:42:39.703 INFO:teuthology.orchestra.run.smithi145.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-20T21:42:39.749 INFO:teuthology.orchestra.run.smithi050.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-20T21:42:39.785 INFO:teuthology.orchestra.run.smithi145.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-20T21:42:39.860 INFO:teuthology.orchestra.run.smithi050.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-20T21:42:39.866 INFO:teuthology.orchestra.run.smithi145.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-20T21:42:39.896 INFO:teuthology.orchestra.run.smithi145.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-20T21:42:39.912 INFO:teuthology.orchestra.run.smithi050.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-20T21:42:39.944 INFO:teuthology.orchestra.run.smithi050.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-20T21:42:44.064 INFO:teuthology.orchestra.run.smithi145.stdout:Fetched 13.7 MB in 3s (5,395 kB/s) 2024-05-20T21:42:44.592 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 13.7 MB in 3s (5,265 kB/s) 2024-05-20T21:42:45.393 INFO:teuthology.orchestra.run.smithi145.stdout:Reading package lists... 2024-05-20T21:42:45.410 DEBUG:teuthology.orchestra.run.smithi145:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-20T21:42:45.462 INFO:teuthology.orchestra.run.smithi145.stdout:Reading package lists... 2024-05-20T21:42:45.640 INFO:teuthology.orchestra.run.smithi145.stdout:Building dependency tree... 2024-05-20T21:42:45.640 INFO:teuthology.orchestra.run.smithi145.stdout:Reading state information... 2024-05-20T21:42:45.798 INFO:teuthology.orchestra.run.smithi145.stdout:The following packages were automatically installed and are no longer required: 2024-05-20T21:42:45.798 INFO:teuthology.orchestra.run.smithi145.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-20T21:42:45.798 INFO:teuthology.orchestra.run.smithi145.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-20T21:42:45.798 INFO:teuthology.orchestra.run.smithi145.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-20T21:42:45.799 INFO:teuthology.orchestra.run.smithi145.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-20T21:42:45.799 INFO:teuthology.orchestra.run.smithi145.stdout: python2.7-minimal 2024-05-20T21:42:45.799 INFO:teuthology.orchestra.run.smithi145.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-20T21:42:45.799 INFO:teuthology.orchestra.run.smithi145.stdout:The following additional packages will be installed: 2024-05-20T21:42:45.800 INFO:teuthology.orchestra.run.smithi145.stdout: linux-generic linux-headers-5.15.0-107 linux-headers-5.15.0-107-generic 2024-05-20T21:42:45.800 INFO:teuthology.orchestra.run.smithi145.stdout: linux-headers-generic linux-image-5.15.0-107-generic 2024-05-20T21:42:45.800 INFO:teuthology.orchestra.run.smithi145.stdout: linux-modules-5.15.0-107-generic linux-modules-extra-5.15.0-107-generic 2024-05-20T21:42:45.801 INFO:teuthology.orchestra.run.smithi145.stdout:Suggested packages: 2024-05-20T21:42:45.801 INFO:teuthology.orchestra.run.smithi145.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-20T21:42:45.802 INFO:teuthology.orchestra.run.smithi145.stdout:Recommended packages: 2024-05-20T21:42:45.802 INFO:teuthology.orchestra.run.smithi145.stdout: thermald 2024-05-20T21:42:45.853 INFO:teuthology.orchestra.run.smithi145.stdout:The following NEW packages will be installed: 2024-05-20T21:42:45.853 INFO:teuthology.orchestra.run.smithi145.stdout: linux-headers-5.15.0-107 linux-headers-5.15.0-107-generic 2024-05-20T21:42:45.853 INFO:teuthology.orchestra.run.smithi145.stdout: linux-image-5.15.0-107-generic linux-modules-5.15.0-107-generic 2024-05-20T21:42:45.854 INFO:teuthology.orchestra.run.smithi145.stdout: linux-modules-extra-5.15.0-107-generic 2024-05-20T21:42:45.855 INFO:teuthology.orchestra.run.smithi145.stdout:The following packages will be upgraded: 2024-05-20T21:42:45.855 INFO:teuthology.orchestra.run.smithi145.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-20T21:42:45.992 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-05-20T21:42:46.011 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-20T21:42:46.035 INFO:teuthology.orchestra.run.smithi145.stdout:3 upgraded, 5 newly installed, 0 to remove and 320 not upgraded. 2024-05-20T21:42:46.035 INFO:teuthology.orchestra.run.smithi145.stdout:Need to get 113 MB of archives. 2024-05-20T21:42:46.035 INFO:teuthology.orchestra.run.smithi145.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-20T21:42:46.035 INFO:teuthology.orchestra.run.smithi145.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-107-generic amd64 5.15.0-107.117 [22.7 MB] 2024-05-20T21:42:46.070 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-05-20T21:42:46.275 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2024-05-20T21:42:46.275 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2024-05-20T21:42:46.461 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2024-05-20T21:42:46.461 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-20T21:42:46.461 INFO:teuthology.orchestra.run.smithi050.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-20T21:42:46.462 INFO:teuthology.orchestra.run.smithi050.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-20T21:42:46.462 INFO:teuthology.orchestra.run.smithi050.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-20T21:42:46.462 INFO:teuthology.orchestra.run.smithi050.stdout: python2.7-minimal 2024-05-20T21:42:46.462 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-20T21:42:46.463 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2024-05-20T21:42:46.463 INFO:teuthology.orchestra.run.smithi050.stdout: linux-generic linux-headers-5.15.0-107 linux-headers-5.15.0-107-generic 2024-05-20T21:42:46.463 INFO:teuthology.orchestra.run.smithi050.stdout: linux-headers-generic linux-image-5.15.0-107-generic 2024-05-20T21:42:46.464 INFO:teuthology.orchestra.run.smithi050.stdout: linux-modules-5.15.0-107-generic linux-modules-extra-5.15.0-107-generic 2024-05-20T21:42:46.465 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2024-05-20T21:42:46.465 INFO:teuthology.orchestra.run.smithi050.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-20T21:42:46.465 INFO:teuthology.orchestra.run.smithi050.stdout:Recommended packages: 2024-05-20T21:42:46.465 INFO:teuthology.orchestra.run.smithi050.stdout: thermald 2024-05-20T21:42:46.515 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2024-05-20T21:42:46.515 INFO:teuthology.orchestra.run.smithi050.stdout: linux-headers-5.15.0-107 linux-headers-5.15.0-107-generic 2024-05-20T21:42:46.515 INFO:teuthology.orchestra.run.smithi050.stdout: linux-image-5.15.0-107-generic linux-modules-5.15.0-107-generic 2024-05-20T21:42:46.516 INFO:teuthology.orchestra.run.smithi050.stdout: linux-modules-extra-5.15.0-107-generic 2024-05-20T21:42:46.517 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages will be upgraded: 2024-05-20T21:42:46.518 INFO:teuthology.orchestra.run.smithi050.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-20T21:42:46.579 INFO:teuthology.orchestra.run.smithi050.stdout:3 upgraded, 5 newly installed, 0 to remove and 320 not upgraded. 2024-05-20T21:42:46.579 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 113 MB of archives. 2024-05-20T21:42:46.579 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-20T21:42:46.579 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-107-generic amd64 5.15.0-107.117 [22.7 MB] 2024-05-20T21:42:47.186 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-107-generic amd64 5.15.0-107.117 [11.5 MB] 2024-05-20T21:42:47.317 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-107-generic amd64 5.15.0-107.117 [63.9 MB] 2024-05-20T21:42:47.526 INFO:teuthology.orchestra.run.smithi145.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-107-generic amd64 5.15.0-107.117 [11.5 MB] 2024-05-20T21:42:47.883 INFO:teuthology.orchestra.run.smithi145.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-107-generic amd64 5.15.0-107.117 [63.9 MB] 2024-05-20T21:42:48.297 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.107.107 [1,694 B] 2024-05-20T21:42:48.297 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.107.107 [2,496 B] 2024-05-20T21:42:48.297 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-107 all 5.15.0-107.117 [12.3 MB] 2024-05-20T21:42:48.431 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-107-generic amd64 5.15.0-107.117 [2,887 kB] 2024-05-20T21:42:48.454 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.107.107 [2,354 B] 2024-05-20T21:42:48.848 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 113 MB in 2s (58.8 MB/s) 2024-05-20T21:42:49.016 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-modules-5.15.0-107-generic. 2024-05-20T21:42:50.086 INFO:teuthology.orchestra.run.smithi145.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.107.107 [1,694 B] 2024-05-20T21:42:50.087 INFO:teuthology.orchestra.run.smithi145.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.107.107 [2,496 B] 2024-05-20T21:42:50.087 INFO:teuthology.orchestra.run.smithi145.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-107 all 5.15.0-107.117 [12.3 MB] 2024-05-20T21:42:50.881 INFO:teuthology.orchestra.run.smithi145.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-107-generic amd64 5.15.0-107.117 [2,887 kB] 2024-05-20T21:42:51.005 INFO:teuthology.orchestra.run.smithi145.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.107.107 [2,354 B] 2024-05-20T21:42:51.060 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-20T21:42:51.064 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../0-linux-modules-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-20T21:42:51.141 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-modules-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-20T21:42:51.400 INFO:teuthology.orchestra.run.smithi145.stdout:Fetched 113 MB in 5s (22.0 MB/s) 2024-05-20T21:42:51.559 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package linux-modules-5.15.0-107-generic. 2024-05-20T21:42:53.250 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-image-5.15.0-107-generic. 2024-05-20T21:42:53.272 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../1-linux-image-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-20T21:42:53.371 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-image-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-20T21:42:53.704 INFO:teuthology.orchestra.run.smithi145.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-20T21:42:53.710 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../0-linux-modules-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-20T21:42:53.798 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking linux-modules-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-20T21:42:53.845 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-107-generic. 2024-05-20T21:42:53.866 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-20T21:42:53.903 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-modules-extra-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-20T21:42:56.166 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package linux-image-5.15.0-107-generic. 2024-05-20T21:42:56.187 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../1-linux-image-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-20T21:42:56.279 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking linux-image-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-20T21:42:56.711 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-107-generic. 2024-05-20T21:42:56.721 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-20T21:42:56.752 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking linux-modules-extra-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-20T21:43:00.820 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../3-linux-generic_5.15.0.107.107_amd64.deb ... 2024-05-20T21:43:00.947 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-generic (5.15.0.107.107) over (5.15.0.56.54) ... 2024-05-20T21:43:01.265 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.107.107_amd64.deb ... 2024-05-20T21:43:01.367 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-image-generic (5.15.0.107.107) over (5.15.0.56.54) ... 2024-05-20T21:43:01.678 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-headers-5.15.0-107. 2024-05-20T21:43:01.701 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../5-linux-headers-5.15.0-107_5.15.0-107.117_all.deb ... 2024-05-20T21:43:01.744 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-5.15.0-107 (5.15.0-107.117) ... 2024-05-20T21:43:02.647 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../3-linux-generic_5.15.0.107.107_amd64.deb ... 2024-05-20T21:43:02.749 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking linux-generic (5.15.0.107.107) over (5.15.0.56.54) ... 2024-05-20T21:43:03.107 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.107.107_amd64.deb ... 2024-05-20T21:43:03.228 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking linux-image-generic (5.15.0.107.107) over (5.15.0.56.54) ... 2024-05-20T21:43:03.514 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package linux-headers-5.15.0-107. 2024-05-20T21:43:03.537 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../5-linux-headers-5.15.0-107_5.15.0-107.117_all.deb ... 2024-05-20T21:43:03.581 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking linux-headers-5.15.0-107 (5.15.0-107.117) ... 2024-05-20T21:43:07.669 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-headers-5.15.0-107-generic. 2024-05-20T21:43:07.706 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../6-linux-headers-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-20T21:43:07.735 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-20T21:43:09.253 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package linux-headers-5.15.0-107-generic. 2024-05-20T21:43:09.290 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../6-linux-headers-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-20T21:43:09.328 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking linux-headers-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-20T21:43:10.365 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.107.107_amd64.deb ... 2024-05-20T21:43:10.479 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-generic (5.15.0.107.107) over (5.15.0.56.54) ... 2024-05-20T21:43:10.814 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-5.15.0-107 (5.15.0-107.117) ... 2024-05-20T21:43:10.934 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-20T21:43:11.061 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-generic (5.15.0.107.107) ... 2024-05-20T21:43:11.190 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-image-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-20T21:43:11.911 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.107.107_amd64.deb ... 2024-05-20T21:43:12.034 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking linux-headers-generic (5.15.0.107.107) over (5.15.0.56.54) ... 2024-05-20T21:43:12.358 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up linux-headers-5.15.0-107 (5.15.0-107.117) ... 2024-05-20T21:43:12.480 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up linux-headers-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-20T21:43:12.532 INFO:teuthology.orchestra.run.smithi050.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-20T21:43:12.532 INFO:teuthology.orchestra.run.smithi050.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-20T21:43:12.532 INFO:teuthology.orchestra.run.smithi050.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-107-generic 2024-05-20T21:43:12.532 INFO:teuthology.orchestra.run.smithi050.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-107-generic 2024-05-20T21:43:12.606 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up linux-headers-generic (5.15.0.107.107) ... 2024-05-20T21:43:12.683 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-modules-extra-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-20T21:43:12.728 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up linux-image-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-20T21:43:14.066 INFO:teuthology.orchestra.run.smithi145.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-20T21:43:14.067 INFO:teuthology.orchestra.run.smithi145.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-20T21:43:14.067 INFO:teuthology.orchestra.run.smithi145.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-107-generic 2024-05-20T21:43:14.067 INFO:teuthology.orchestra.run.smithi145.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-107-generic 2024-05-20T21:43:14.156 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-modules-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-20T21:43:14.247 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up linux-modules-extra-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-20T21:43:15.569 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-image-generic (5.15.0.107.107) ... 2024-05-20T21:43:15.664 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up linux-modules-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-20T21:43:15.695 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-generic (5.15.0.107.107) ... 2024-05-20T21:43:15.821 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for linux-image-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-20T21:43:15.882 INFO:teuthology.orchestra.run.smithi050.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-20T21:43:15.882 INFO:teuthology.orchestra.run.smithi050.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-107-generic 2024-05-20T21:43:17.048 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up linux-image-generic (5.15.0.107.107) ... 2024-05-20T21:43:17.174 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up linux-generic (5.15.0.107.107) ... 2024-05-20T21:43:17.276 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for linux-image-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-20T21:43:17.339 INFO:teuthology.orchestra.run.smithi145.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-20T21:43:17.340 INFO:teuthology.orchestra.run.smithi145.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-107-generic 2024-05-20T21:43:30.431 INFO:teuthology.orchestra.run.smithi050.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-20T21:43:30.431 INFO:teuthology.orchestra.run.smithi050.stdout:Sourcing file `/etc/default/grub' 2024-05-20T21:43:30.452 INFO:teuthology.orchestra.run.smithi050.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-20T21:43:30.474 INFO:teuthology.orchestra.run.smithi050.stdout:Generating grub configuration file ... 2024-05-20T21:43:30.801 INFO:teuthology.orchestra.run.smithi050.stdout:Found linux image: /boot/vmlinuz-5.15.0-107-generic 2024-05-20T21:43:30.815 INFO:teuthology.orchestra.run.smithi050.stdout:Found initrd image: /boot/initrd.img-5.15.0-107-generic 2024-05-20T21:43:31.214 INFO:teuthology.orchestra.run.smithi050.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-20T21:43:31.219 INFO:teuthology.orchestra.run.smithi050.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-20T21:43:31.302 INFO:teuthology.orchestra.run.smithi050.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-20T21:43:31.308 INFO:teuthology.orchestra.run.smithi050.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-20T21:43:31.323 INFO:teuthology.orchestra.run.smithi145.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-20T21:43:31.324 INFO:teuthology.orchestra.run.smithi145.stdout:Sourcing file `/etc/default/grub' 2024-05-20T21:43:31.343 INFO:teuthology.orchestra.run.smithi145.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-20T21:43:31.356 INFO:teuthology.orchestra.run.smithi145.stdout:Generating grub configuration file ... 2024-05-20T21:43:31.462 INFO:teuthology.orchestra.run.smithi050.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-20T21:43:31.462 INFO:teuthology.orchestra.run.smithi050.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-20T21:43:31.462 INFO:teuthology.orchestra.run.smithi050.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-20T21:43:31.506 INFO:teuthology.orchestra.run.smithi050.stdout:done 2024-05-20T21:43:31.626 INFO:teuthology.orchestra.run.smithi145.stdout:Found linux image: /boot/vmlinuz-5.15.0-107-generic 2024-05-20T21:43:31.641 INFO:teuthology.orchestra.run.smithi145.stdout:Found initrd image: /boot/initrd.img-5.15.0-107-generic 2024-05-20T21:43:31.921 INFO:teuthology.orchestra.run.smithi145.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-20T21:43:31.926 INFO:teuthology.orchestra.run.smithi145.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-20T21:43:31.978 DEBUG:teuthology.orchestra.run.smithi050:> dpkg -s linux-image-generic 2024-05-20T21:43:31.994 INFO:teuthology.orchestra.run.smithi050.stdout:Package: linux-image-generic 2024-05-20T21:43:31.994 INFO:teuthology.orchestra.run.smithi050.stdout:Status: install ok installed 2024-05-20T21:43:31.994 INFO:teuthology.orchestra.run.smithi050.stdout:Priority: optional 2024-05-20T21:43:31.995 INFO:teuthology.orchestra.run.smithi050.stdout:Section: kernel 2024-05-20T21:43:31.995 INFO:teuthology.orchestra.run.smithi050.stdout:Installed-Size: 21 2024-05-20T21:43:31.995 INFO:teuthology.orchestra.run.smithi050.stdout:Maintainer: Ubuntu Kernel Team 2024-05-20T21:43:31.995 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: amd64 2024-05-20T21:43:31.995 INFO:teuthology.orchestra.run.smithi050.stdout:Source: linux-meta 2024-05-20T21:43:31.995 INFO:teuthology.orchestra.run.smithi050.stdout:Version: 5.15.0.107.107 2024-05-20T21:43:31.995 INFO:teuthology.orchestra.run.smithi050.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-107), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-20T21:43:31.995 INFO:teuthology.orchestra.run.smithi050.stdout:Depends: linux-image-5.15.0-107-generic, linux-modules-extra-5.15.0-107-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-20T21:43:31.995 INFO:teuthology.orchestra.run.smithi050.stdout:Recommends: thermald 2024-05-20T21:43:31.995 INFO:teuthology.orchestra.run.smithi050.stdout:Description: Generic Linux kernel image 2024-05-20T21:43:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: This package will always depend on the latest generic kernel image 2024-05-20T21:43:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: available. 2024-05-20T21:43:31.996 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-107-generic 2024-05-20T21:43:31.996 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-20T21:43:31.996 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-20T21:43:31.996 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-20T21:43:31.996 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=None, version=distro) 2024-05-20T21:43:31.996 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get clean 2024-05-20T21:43:31.999 INFO:teuthology.orchestra.run.smithi145.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-20T21:43:32.005 INFO:teuthology.orchestra.run.smithi145.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-20T21:43:32.153 INFO:teuthology.orchestra.run.smithi145.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-20T21:43:32.153 INFO:teuthology.orchestra.run.smithi145.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-20T21:43:32.153 INFO:teuthology.orchestra.run.smithi145.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-20T21:43:32.205 INFO:teuthology.orchestra.run.smithi145.stdout:done 2024-05-20T21:43:32.207 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2024-05-20T21:43:32.324 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-20T21:43:32.328 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-20T21:43:32.348 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-20T21:43:32.369 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-20T21:43:32.690 DEBUG:teuthology.orchestra.run.smithi145:> dpkg -s linux-image-generic 2024-05-20T21:43:32.706 INFO:teuthology.orchestra.run.smithi145.stdout:Package: linux-image-generic 2024-05-20T21:43:32.706 INFO:teuthology.orchestra.run.smithi145.stdout:Status: install ok installed 2024-05-20T21:43:32.707 INFO:teuthology.orchestra.run.smithi145.stdout:Priority: optional 2024-05-20T21:43:32.707 INFO:teuthology.orchestra.run.smithi145.stdout:Section: kernel 2024-05-20T21:43:32.707 INFO:teuthology.orchestra.run.smithi145.stdout:Installed-Size: 21 2024-05-20T21:43:32.707 INFO:teuthology.orchestra.run.smithi145.stdout:Maintainer: Ubuntu Kernel Team 2024-05-20T21:43:32.707 INFO:teuthology.orchestra.run.smithi145.stdout:Architecture: amd64 2024-05-20T21:43:32.707 INFO:teuthology.orchestra.run.smithi145.stdout:Source: linux-meta 2024-05-20T21:43:32.707 INFO:teuthology.orchestra.run.smithi145.stdout:Version: 5.15.0.107.107 2024-05-20T21:43:32.707 INFO:teuthology.orchestra.run.smithi145.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-107), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-20T21:43:32.707 INFO:teuthology.orchestra.run.smithi145.stdout:Depends: linux-image-5.15.0-107-generic, linux-modules-extra-5.15.0-107-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-20T21:43:32.707 INFO:teuthology.orchestra.run.smithi145.stdout:Recommends: thermald 2024-05-20T21:43:32.707 INFO:teuthology.orchestra.run.smithi145.stdout:Description: Generic Linux kernel image 2024-05-20T21:43:32.707 INFO:teuthology.orchestra.run.smithi145.stdout: This package will always depend on the latest generic kernel image 2024-05-20T21:43:32.707 INFO:teuthology.orchestra.run.smithi145.stdout: available. 2024-05-20T21:43:32.708 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-107-generic 2024-05-20T21:43:32.708 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-20T21:43:32.708 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-20T21:43:32.708 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-20T21:43:32.708 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi145.front.sepia.ceph.com, path=None, version=distro) 2024-05-20T21:43:32.708 DEBUG:teuthology.orchestra.run.smithi145:> sudo apt-get clean 2024-05-20T21:43:32.868 DEBUG:teuthology.orchestra.run.smithi145:> sudo apt-get update 2024-05-20T21:43:33.000 INFO:teuthology.orchestra.run.smithi145.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-20T21:43:33.009 INFO:teuthology.orchestra.run.smithi145.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-20T21:43:33.030 INFO:teuthology.orchestra.run.smithi145.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-20T21:43:33.111 INFO:teuthology.orchestra.run.smithi145.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-20T21:43:33.743 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-05-20T21:43:33.761 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-20T21:43:33.825 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-05-20T21:43:34.029 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2024-05-20T21:43:34.030 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2024-05-20T21:43:34.208 INFO:teuthology.orchestra.run.smithi050.stdout:linux-image-generic is already the newest version (5.15.0.107.107). 2024-05-20T21:43:34.208 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2024-05-20T21:43:34.208 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-20T21:43:34.208 INFO:teuthology.orchestra.run.smithi050.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-20T21:43:34.208 INFO:teuthology.orchestra.run.smithi050.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-20T21:43:34.209 INFO:teuthology.orchestra.run.smithi050.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-20T21:43:34.209 INFO:teuthology.orchestra.run.smithi050.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-20T21:43:34.209 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-20T21:43:34.246 INFO:teuthology.orchestra.run.smithi050.stdout:0 upgraded, 0 newly installed, 0 to remove and 320 not upgraded. 2024-05-20T21:43:34.248 DEBUG:teuthology.orchestra.run.smithi050:> dpkg -s linux-image-generic 2024-05-20T21:43:34.264 INFO:teuthology.orchestra.run.smithi050.stdout:Package: linux-image-generic 2024-05-20T21:43:34.264 INFO:teuthology.orchestra.run.smithi050.stdout:Status: install ok installed 2024-05-20T21:43:34.265 INFO:teuthology.orchestra.run.smithi050.stdout:Priority: optional 2024-05-20T21:43:34.265 INFO:teuthology.orchestra.run.smithi050.stdout:Section: kernel 2024-05-20T21:43:34.265 INFO:teuthology.orchestra.run.smithi050.stdout:Installed-Size: 21 2024-05-20T21:43:34.265 INFO:teuthology.orchestra.run.smithi050.stdout:Maintainer: Ubuntu Kernel Team 2024-05-20T21:43:34.265 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: amd64 2024-05-20T21:43:34.265 INFO:teuthology.orchestra.run.smithi050.stdout:Source: linux-meta 2024-05-20T21:43:34.265 INFO:teuthology.orchestra.run.smithi050.stdout:Version: 5.15.0.107.107 2024-05-20T21:43:34.265 INFO:teuthology.orchestra.run.smithi050.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-107), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-20T21:43:34.265 INFO:teuthology.orchestra.run.smithi050.stdout:Depends: linux-image-5.15.0-107-generic, linux-modules-extra-5.15.0-107-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-20T21:43:34.265 INFO:teuthology.orchestra.run.smithi050.stdout:Recommends: thermald 2024-05-20T21:43:34.265 INFO:teuthology.orchestra.run.smithi050.stdout:Description: Generic Linux kernel image 2024-05-20T21:43:34.265 INFO:teuthology.orchestra.run.smithi050.stdout: This package will always depend on the latest generic kernel image 2024-05-20T21:43:34.265 INFO:teuthology.orchestra.run.smithi050.stdout: available. 2024-05-20T21:43:34.266 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-05-20T21:43:34.310 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.DThrRk6iWt 2024-05-20T21:43:34.310 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub/grub.cfg /tmp/tmp.DThrRk6iWt 2024-05-20T21:43:34.373 INFO:teuthology.orchestra.run.smithi145.stdout:Reading package lists... 2024-05-20T21:43:34.384 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.DThrRk6iWt 2024-05-20T21:43:34.392 DEBUG:teuthology.orchestra.run.smithi145:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-20T21:43:34.453 INFO:teuthology.orchestra.run.smithi145.stdout:Reading package lists... 2024-05-20T21:43:34.503 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.DThrRk6iWt is 10KB 2024-05-20T21:43:34.515 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.DThrRk6iWt 2024-05-20T21:43:34.520 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-20T21:43:34.573 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-20T21:43:34.574 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-20T21:43:34.574 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-20T21:43:34.640 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-107-generic 2024-05-20T21:43:34.640 DEBUG:teuthology.orchestra.run.smithi050:> sudo update-grub 2024-05-20T21:43:34.666 INFO:teuthology.orchestra.run.smithi145.stdout:Building dependency tree... 2024-05-20T21:43:34.667 INFO:teuthology.orchestra.run.smithi145.stdout:Reading state information... 2024-05-20T21:43:34.846 INFO:teuthology.orchestra.run.smithi145.stdout:linux-image-generic is already the newest version (5.15.0.107.107). 2024-05-20T21:43:34.846 INFO:teuthology.orchestra.run.smithi145.stdout:The following packages were automatically installed and are no longer required: 2024-05-20T21:43:34.846 INFO:teuthology.orchestra.run.smithi145.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-20T21:43:34.846 INFO:teuthology.orchestra.run.smithi145.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-20T21:43:34.846 INFO:teuthology.orchestra.run.smithi145.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-20T21:43:34.847 INFO:teuthology.orchestra.run.smithi145.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-20T21:43:34.847 INFO:teuthology.orchestra.run.smithi145.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-20T21:43:34.847 INFO:teuthology.orchestra.run.smithi145.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-20T21:43:34.887 INFO:teuthology.orchestra.run.smithi145.stdout:0 upgraded, 0 newly installed, 0 to remove and 320 not upgraded. 2024-05-20T21:43:34.889 DEBUG:teuthology.orchestra.run.smithi145:> dpkg -s linux-image-generic 2024-05-20T21:43:34.905 INFO:teuthology.orchestra.run.smithi145.stdout:Package: linux-image-generic 2024-05-20T21:43:34.905 INFO:teuthology.orchestra.run.smithi145.stdout:Status: install ok installed 2024-05-20T21:43:34.905 INFO:teuthology.orchestra.run.smithi145.stdout:Priority: optional 2024-05-20T21:43:34.905 INFO:teuthology.orchestra.run.smithi145.stdout:Section: kernel 2024-05-20T21:43:34.905 INFO:teuthology.orchestra.run.smithi145.stdout:Installed-Size: 21 2024-05-20T21:43:34.905 INFO:teuthology.orchestra.run.smithi145.stdout:Maintainer: Ubuntu Kernel Team 2024-05-20T21:43:34.905 INFO:teuthology.orchestra.run.smithi145.stdout:Architecture: amd64 2024-05-20T21:43:34.905 INFO:teuthology.orchestra.run.smithi145.stdout:Source: linux-meta 2024-05-20T21:43:34.905 INFO:teuthology.orchestra.run.smithi145.stdout:Version: 5.15.0.107.107 2024-05-20T21:43:34.905 INFO:teuthology.orchestra.run.smithi145.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-107), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-20T21:43:34.906 INFO:teuthology.orchestra.run.smithi145.stdout:Depends: linux-image-5.15.0-107-generic, linux-modules-extra-5.15.0-107-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-20T21:43:34.906 INFO:teuthology.orchestra.run.smithi145.stdout:Recommends: thermald 2024-05-20T21:43:34.906 INFO:teuthology.orchestra.run.smithi145.stdout:Description: Generic Linux kernel image 2024-05-20T21:43:34.906 INFO:teuthology.orchestra.run.smithi145.stdout: This package will always depend on the latest generic kernel image 2024-05-20T21:43:34.906 INFO:teuthology.orchestra.run.smithi145.stdout: available. 2024-05-20T21:43:34.906 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2024-05-20T21:43:34.950 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.QdOzREIq9Y 2024-05-20T21:43:34.950 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /boot/grub/grub.cfg /tmp/tmp.QdOzREIq9Y 2024-05-20T21:43:35.006 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.QdOzREIq9Y 2024-05-20T21:43:35.118 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.QdOzREIq9Y is 10KB 2024-05-20T21:43:35.129 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.QdOzREIq9Y 2024-05-20T21:43:35.136 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-20T21:43:35.190 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-05-20T21:43:35.190 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-20T21:43:35.190 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-20T21:43:35.256 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-107-generic 2024-05-20T21:43:35.256 DEBUG:teuthology.orchestra.run.smithi145:> sudo update-grub 2024-05-20T21:43:35.885 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub' 2024-05-20T21:43:35.886 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-20T21:43:35.888 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2024-05-20T21:43:36.041 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.15.0-107-generic 2024-05-20T21:43:36.047 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.15.0-107-generic 2024-05-20T21:43:36.318 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-20T21:43:36.324 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-20T21:43:36.367 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-20T21:43:36.372 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-20T21:43:36.393 INFO:teuthology.orchestra.run.smithi145.stderr:Sourcing file `/etc/default/grub' 2024-05-20T21:43:36.395 INFO:teuthology.orchestra.run.smithi145.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-20T21:43:36.397 INFO:teuthology.orchestra.run.smithi145.stderr:Generating grub configuration file ... 2024-05-20T21:43:36.515 INFO:teuthology.orchestra.run.smithi050.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-20T21:43:36.516 INFO:teuthology.orchestra.run.smithi050.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-20T21:43:36.516 INFO:teuthology.orchestra.run.smithi050.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-20T21:43:36.529 INFO:teuthology.orchestra.run.smithi050.stderr:done 2024-05-20T21:43:36.538 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2024-05-20T21:43:36.581 INFO:teuthology.orchestra.run.smithi145.stderr:Found linux image: /boot/vmlinuz-5.15.0-107-generic 2024-05-20T21:43:36.587 INFO:teuthology.orchestra.run.smithi145.stderr:Found initrd image: /boot/initrd.img-5.15.0-107-generic 2024-05-20T21:43:36.813 INFO:teuthology.orchestra.run.smithi145.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-20T21:43:36.819 INFO:teuthology.orchestra.run.smithi145.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-20T21:43:36.861 INFO:teuthology.orchestra.run.smithi145.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-20T21:43:36.866 INFO:teuthology.orchestra.run.smithi145.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-20T21:43:36.987 INFO:teuthology.orchestra.run.smithi145.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-20T21:43:36.987 INFO:teuthology.orchestra.run.smithi145.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-20T21:43:36.987 INFO:teuthology.orchestra.run.smithi145.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-20T21:43:37.005 INFO:teuthology.orchestra.run.smithi145.stderr:done 2024-05-20T21:43:37.007 DEBUG:teuthology.orchestra.run.smithi145:> sudo shutdown -r now 2024-05-20T21:44:06.558 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-20T21:44:06.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-05-20T21:44:06.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T21:44:07.010 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-20T21:44:07.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-05-20T21:44:07.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T21:44:25.119 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-05-20T21:44:25.374 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-05-20T21:44:34.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-05-20T21:44:34.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T21:44:34.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-05-20T21:44:34.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T21:44:37.438 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-05-20T21:44:49.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-05-20T21:44:49.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T21:45:21.225 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-05-20T21:45:21.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-05-20T21:45:21.727 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-107-generic"... 2024-05-20T21:45:21.727 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-05-20T21:45:21.773 INFO:teuthology.orchestra.run.smithi145.stdout:5.15.0-107-generic 2024-05-20T21:45:21.774 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-107-generic vs 5.15.0-107-generic 2024-05-20T21:45:21.774 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-20T21:45:21.774 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-20T21:45:22.775 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-20T21:45:22.775 DEBUG:teuthology.orchestra.run.smithi145:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-20T21:45:22.846 INFO:teuthology.orchestra.run.smithi145.stdout:ttyS1 2024-05-20T21:45:22.875 DEBUG:teuthology.parallel:result is None 2024-05-20T21:45:34.130 DEBUG:teuthology.orchestra.remote:timed out 2024-05-20T21:45:46.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-05-20T21:45:46.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T21:45:46.359 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-05-20T21:45:46.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-05-20T21:45:46.975 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-107-generic"... 2024-05-20T21:45:46.976 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-05-20T21:45:47.021 INFO:teuthology.orchestra.run.smithi050.stdout:5.15.0-107-generic 2024-05-20T21:45:47.021 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-107-generic vs 5.15.0-107-generic 2024-05-20T21:45:47.021 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-20T21:45:47.021 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-20T21:45:48.022 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-20T21:45:48.022 DEBUG:teuthology.orchestra.run.smithi050:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-20T21:45:48.102 INFO:teuthology.orchestra.run.smithi050.stdout:ttyS1 2024-05-20T21:45:48.135 DEBUG:teuthology.parallel:result is None 2024-05-20T21:45:48.135 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-20T21:45:48.145 INFO:teuthology.task.internal:Creating test directory... 2024-05-20T21:45:48.145 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-20T21:45:48.147 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-20T21:45:48.153 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-20T21:45:48.164 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-20T21:45:48.178 INFO:teuthology.task.internal:Creating archive directory... 2024-05-20T21:45:48.178 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-20T21:45:48.194 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-20T21:45:48.223 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-20T21:45:48.234 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-20T21:45:48.234 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-20T21:45:48.246 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-20T21:45:48.277 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-20T21:45:48.284 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-20T21:45:48.285 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-20T21:45:48.294 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-20T21:45:48.296 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-20T21:45:48.314 INFO:teuthology.task.internal:Configuring sudo... 2024-05-20T21:45:48.314 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-20T21:45:48.338 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-20T21:45:48.354 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-20T21:45:48.373 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-20T21:45:48.373 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-20T21:45:48.402 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-20T21:45:48.408 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-20T21:45:48.454 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-20T21:45:48.502 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-20T21:45:48.502 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-20T21:45:48.562 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-20T21:45:48.568 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-20T21:45:48.613 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-05-20T21:45:48.613 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-20T21:45:48.674 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2024-05-20T21:45:48.676 DEBUG:teuthology.orchestra.run.smithi145:> sudo service rsyslog restart 2024-05-20T21:45:48.755 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-20T21:45:48.766 INFO:teuthology.task.internal:Starting timer... 2024-05-20T21:45:48.767 INFO:teuthology.run_tasks:Running task pcp... 2024-05-20T21:45:48.797 INFO:teuthology.run_tasks:Running task selinux... 2024-05-20T21:45:48.811 DEBUG:teuthology.task.selinux:Excluding smithi050: OS 'ubuntu' does not support SELinux 2024-05-20T21:45:48.811 DEBUG:teuthology.task.selinux:Excluding smithi145: OS 'ubuntu' does not support SELinux 2024-05-20T21:45:48.811 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-20T21:45:48.811 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-20T21:45:48.811 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-20T21:45:48.811 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-20T21:45:48.825 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-20T21:45:48.860 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-20T21:45:48.862 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi145.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-20T21:52:56.753 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi145.front.sepia.ceph.com')] 2024-05-20T21:52:56.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-05-20T21:52:56.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T21:52:56.840 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-05-20T21:52:56.922 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-05-20T21:52:56.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-05-20T21:52:56.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T21:52:57.011 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-05-20T21:52:57.086 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-05-20T21:52:57.087 INFO:teuthology.run_tasks:Running task clock... 2024-05-20T21:52:57.098 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-20T21:52:57.099 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-20T21:52:57.099 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-20T21:52:57.101 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-20T21:52:57.102 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-20T21:52:57.131 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:52:57 ntpd[17464]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-20T21:52:57.131 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:52:57 ntpd[17464]: Command line: ntpd -gq 2024-05-20T21:52:57.131 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:52:57 ntpd[17464]: ---------------------------------------------------- 2024-05-20T21:52:57.131 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:52:57 ntpd[17464]: ntp-4 is maintained by Network Time Foundation, 2024-05-20T21:52:57.131 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:52:57 ntpd[17464]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-20T21:52:57.131 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:52:57 ntpd[17464]: corporation. Support and training for ntp-4 are 2024-05-20T21:52:57.132 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:52:57 ntpd[17464]: available at https://www.nwtime.org/support 2024-05-20T21:52:57.132 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:52:57 ntpd[17464]: ---------------------------------------------------- 2024-05-20T21:52:57.133 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:52:57 ntpd[17464]: proto: precision = 0.069 usec (-24) 2024-05-20T21:52:57.133 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:52:57 ntpd[17464]: basedate set to 2022-02-04 2024-05-20T21:52:57.133 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:52:57 ntpd[17464]: gps base set to 2022-02-06 (week 2196) 2024-05-20T21:52:57.133 INFO:teuthology.orchestra.run.smithi050.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-20T21:52:57.133 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:52:57 ntpd[17464]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-20T21:52:57.134 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:52:57 ntpd[17464]: restrict ::: KOD does nothing without LIMITED. 2024-05-20T21:52:57.134 INFO:teuthology.orchestra.run.smithi050.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-20T21:52:57.135 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:52:57 ntpd[17464]: Listen and drop on 0 v6wildcard [::]:123 2024-05-20T21:52:57.135 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:52:57 ntpd[17464]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-20T21:52:57.135 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:52:57 ntpd[17464]: Listen normally on 2 lo 127.0.0.1:123 2024-05-20T21:52:57.135 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:52:57 ntpd[17464]: Listen normally on 3 ens1f0 172.21.15.50:123 2024-05-20T21:52:57.135 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:52:57 ntpd[17464]: Listen normally on 4 lo [::1]:123 2024-05-20T21:52:57.135 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:52:57 ntpd[17464]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1584%2]:123 2024-05-20T21:52:57.135 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:52:57 ntpd[17464]: Listening on routing socket on fd #22 for interface updates 2024-05-20T21:52:57.156 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:52:57 ntpd[17587]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-20T21:52:57.156 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:52:57 ntpd[17587]: Command line: ntpd -gq 2024-05-20T21:52:57.156 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:52:57 ntpd[17587]: ---------------------------------------------------- 2024-05-20T21:52:57.156 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:52:57 ntpd[17587]: ntp-4 is maintained by Network Time Foundation, 2024-05-20T21:52:57.156 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:52:57 ntpd[17587]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-20T21:52:57.156 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:52:57 ntpd[17587]: corporation. Support and training for ntp-4 are 2024-05-20T21:52:57.156 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:52:57 ntpd[17587]: available at https://www.nwtime.org/support 2024-05-20T21:52:57.157 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:52:57 ntpd[17587]: ---------------------------------------------------- 2024-05-20T21:52:57.157 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:52:57 ntpd[17587]: proto: precision = 0.043 usec (-24) 2024-05-20T21:52:57.158 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:52:57 ntpd[17587]: basedate set to 2022-02-04 2024-05-20T21:52:57.158 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:52:57 ntpd[17587]: gps base set to 2022-02-06 (week 2196) 2024-05-20T21:52:57.158 INFO:teuthology.orchestra.run.smithi145.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-20T21:52:57.158 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:52:57 ntpd[17587]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-20T21:52:57.158 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:52:57 ntpd[17587]: restrict ::: KOD does nothing without LIMITED. 2024-05-20T21:52:57.159 INFO:teuthology.orchestra.run.smithi145.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-20T21:52:57.160 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:52:57 ntpd[17587]: Listen and drop on 0 v6wildcard [::]:123 2024-05-20T21:52:57.160 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:52:57 ntpd[17587]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-20T21:52:57.160 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:52:57 ntpd[17587]: Listen normally on 2 lo 127.0.0.1:123 2024-05-20T21:52:57.160 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:52:57 ntpd[17587]: Listen normally on 3 enp3s0f1 172.21.15.145:123 2024-05-20T21:52:57.160 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:52:57 ntpd[17587]: Listen normally on 4 lo [::1]:123 2024-05-20T21:52:57.160 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:52:57 ntpd[17587]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7791%5]:123 2024-05-20T21:52:57.160 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:52:57 ntpd[17587]: Listening on routing socket on fd #22 for interface updates 2024-05-20T21:52:58.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:52:58 ntpd[17464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:52:58.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:52:58 ntpd[17464]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:52:58.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:52:58 ntpd[17464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:52:58.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:52:58 ntpd[17464]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:52:58.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:52:58 ntpd[17464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-20T21:52:58.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:52:58 ntpd[17464]: can't open /var/log/ntpstats/peerstats.20240520: Permission denied 2024-05-20T21:52:58.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:52:58 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:52:58.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:52:58 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:52:58.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:52:58 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:52:58.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:52:58 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:52:58.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:52:58 ntpd[17587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-20T21:52:58.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:52:58 ntpd[17587]: can't open /var/log/ntpstats/peerstats.20240520: Permission denied 2024-05-20T21:53:00.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:00 ntpd[17464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:00.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:00 ntpd[17464]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:00.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:00 ntpd[17464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:00.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:00 ntpd[17464]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:00.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:00 ntpd[17464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:00.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:00 ntpd[17464]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:00.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:00 ntpd[17464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-20T21:53:00.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:00 ntpd[17464]: can't open /var/log/ntpstats/peerstats.20240520: Permission denied 2024-05-20T21:53:00.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:00 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:00.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:00 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:00.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:00 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:00.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:00 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:00.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:00 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:00.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:00 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:00.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:00 ntpd[17587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-20T21:53:00.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:00 ntpd[17587]: can't open /var/log/ntpstats/peerstats.20240520: Permission denied 2024-05-20T21:53:01.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:01 ntpd[17464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:01.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:01 ntpd[17464]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:01.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:01 ntpd[17464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:01.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:01 ntpd[17464]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:01.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:01 ntpd[17464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-20T21:53:01.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:01 ntpd[17464]: can't open /var/log/ntpstats/peerstats.20240520: Permission denied 2024-05-20T21:53:01.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:01 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:01.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:01 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:01.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:01 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:01.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:01 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:01.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:01 ntpd[17587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-20T21:53:01.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:01 ntpd[17587]: can't open /var/log/ntpstats/peerstats.20240520: Permission denied 2024-05-20T21:53:02.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:02 ntpd[17464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:02.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:02 ntpd[17464]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:02.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:02 ntpd[17464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:02.133 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:02 ntpd[17464]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:02.133 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:02 ntpd[17464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:02.133 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:02 ntpd[17464]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:02.133 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:02 ntpd[17464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-20T21:53:02.133 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:02 ntpd[17464]: can't open /var/log/ntpstats/peerstats.20240520: Permission denied 2024-05-20T21:53:02.133 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:02 ntpd[17464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:02.133 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:02 ntpd[17464]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:02.133 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:02 ntpd[17464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-20T21:53:02.133 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:02 ntpd[17464]: can't open /var/log/ntpstats/peerstats.20240520: Permission denied 2024-05-20T21:53:02.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:02 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:02.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:02 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:02.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:02 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:02.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:02 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:02.158 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:02 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:02.158 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:02 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:02.158 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:02 ntpd[17587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-20T21:53:02.158 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:02 ntpd[17587]: can't open /var/log/ntpstats/peerstats.20240520: Permission denied 2024-05-20T21:53:02.158 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:02 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:02.158 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:02 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:02.158 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:02 ntpd[17587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-20T21:53:02.158 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:02 ntpd[17587]: can't open /var/log/ntpstats/peerstats.20240520: Permission denied 2024-05-20T21:53:03.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:03 ntpd[17464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:03.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:03 ntpd[17464]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:03.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:03 ntpd[17464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:03.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:03 ntpd[17464]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:03.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:03 ntpd[17464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-20T21:53:03.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:03 ntpd[17464]: can't open /var/log/ntpstats/peerstats.20240520: Permission denied 2024-05-20T21:53:03.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:03 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:03.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:03 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:03.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:03 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:03.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:03 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:03.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:03 ntpd[17587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-20T21:53:03.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:03 ntpd[17587]: can't open /var/log/ntpstats/peerstats.20240520: Permission denied 2024-05-20T21:53:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:04 ntpd[17464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:04 ntpd[17464]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:04 ntpd[17464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:04 ntpd[17464]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:04 ntpd[17464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:04 ntpd[17464]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:04 ntpd[17464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-20T21:53:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:04 ntpd[17464]: can't open /var/log/ntpstats/peerstats.20240520: Permission denied 2024-05-20T21:53:04.133 INFO:teuthology.orchestra.run.smithi050.stdout:20 May 21:53:04 ntpd[17464]: ntpd: time slew -0.001715 s 2024-05-20T21:53:04.133 INFO:teuthology.orchestra.run.smithi050.stdout:ntpd: time slew -0.001715s 2024-05-20T21:53:04.134 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:04 ntpd[17464]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-20T21:53:04.134 INFO:teuthology.orchestra.run.smithi050.stderr:20 May 21:53:04 ntpd[17464]: can't open /var/log/ntpstats/loopstats.20240520: Permission denied 2024-05-20T21:53:04.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:04 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:04.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:04 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:04.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:04 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:04.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:04 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:04.157 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:04 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:04.158 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:04 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:04.158 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:04 ntpd[17587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-20T21:53:04.158 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:04 ntpd[17587]: can't open /var/log/ntpstats/peerstats.20240520: Permission denied 2024-05-20T21:53:04.158 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:04 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-20T21:53:04.158 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:04 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240520: Permission denied 2024-05-20T21:53:04.158 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:04 ntpd[17587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-20T21:53:04.158 INFO:teuthology.orchestra.run.smithi145.stdout:20 May 21:53:04 ntpd[17587]: ntpd: time slew -0.001101 s 2024-05-20T21:53:04.158 INFO:teuthology.orchestra.run.smithi145.stdout:ntpd: time slew -0.001101s 2024-05-20T21:53:04.159 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:04 ntpd[17587]: can't open /var/log/ntpstats/peerstats.20240520: Permission denied 2024-05-20T21:53:04.159 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:04 ntpd[17587]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-20T21:53:04.159 INFO:teuthology.orchestra.run.smithi145.stderr:20 May 21:53:04 ntpd[17587]: can't open /var/log/ntpstats/loopstats.20240520: Permission denied 2024-05-20T21:53:04.185 INFO:teuthology.orchestra.run.smithi050.stdout: remote refid st t when poll reach delay offset jitter 2024-05-20T21:53:04.185 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================== 2024-05-20T21:53:04.185 INFO:teuthology.orchestra.run.smithi050.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-20T21:53:04.185 INFO:teuthology.orchestra.run.smithi050.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-20T21:53:04.185 INFO:teuthology.orchestra.run.smithi050.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-20T21:53:04.185 INFO:teuthology.orchestra.run.smithi050.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-20T21:53:04.210 INFO:teuthology.orchestra.run.smithi145.stdout: remote refid st t when poll reach delay offset jitter 2024-05-20T21:53:04.211 INFO:teuthology.orchestra.run.smithi145.stdout:============================================================================== 2024-05-20T21:53:04.211 INFO:teuthology.orchestra.run.smithi145.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-20T21:53:04.211 INFO:teuthology.orchestra.run.smithi145.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-20T21:53:04.211 INFO:teuthology.orchestra.run.smithi145.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-20T21:53:04.211 INFO:teuthology.orchestra.run.smithi145.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-20T21:53:04.212 INFO:teuthology.run_tasks:Running task install... 2024-05-20T21:53:04.226 DEBUG:teuthology.task.install:project ceph 2024-05-20T21:53:04.227 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4ea7251640d7dc85322163e97efba46b50b07648'}} 2024-05-20T21:53:04.227 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '4ea7251640d7dc85322163e97efba46b50b07648'} 2024-05-20T21:53:04.227 INFO:teuthology.task.install:Using flavor: default 2024-05-20T21:53:04.233 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-20T21:53:04.233 INFO:teuthology.task.install:extra packages: [] 2024-05-20T21:53:04.234 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-key list | grep Ceph 2024-05-20T21:53:04.235 DEBUG:teuthology.orchestra.run.smithi145:> sudo apt-key list | grep Ceph 2024-05-20T21:53:04.295 INFO:teuthology.orchestra.run.smithi050.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-20T21:53:04.314 INFO:teuthology.orchestra.run.smithi145.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-20T21:53:04.324 INFO:teuthology.orchestra.run.smithi050.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-20T21:53:04.324 INFO:teuthology.orchestra.run.smithi050.stdout:uid [ unknown] Ceph.com (release key) 2024-05-20T21:53:04.325 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-20T21:53:04.325 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4ea7251640d7dc85322163e97efba46b50b07648 2024-05-20T21:53:04.342 INFO:teuthology.orchestra.run.smithi145.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-20T21:53:04.342 INFO:teuthology.orchestra.run.smithi145.stdout:uid [ unknown] Ceph.com (release key) 2024-05-20T21:53:04.343 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-20T21:53:04.343 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4ea7251640d7dc85322163e97efba46b50b07648 2024-05-20T21:53:04.544 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default/ 2024-05-20T21:53:04.544 INFO:teuthology.task.install.deb:Package version is 19.0.0-2535-g4ea72516-1jammy 2024-05-20T21:53:04.567 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default/ 2024-05-20T21:53:04.568 INFO:teuthology.task.install.deb:Package version is 19.0.0-2535-g4ea72516-1jammy 2024-05-20T21:53:04.718 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-20T21:53:04.718 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-20T21:53:04.728 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-05-20T21:53:04.729 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-20T21:53:04.733 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2024-05-20T21:53:04.743 DEBUG:teuthology.orchestra.run.smithi145:> sudo apt-get update 2024-05-20T21:53:04.917 INFO:teuthology.orchestra.run.smithi145.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-20T21:53:04.917 INFO:teuthology.orchestra.run.smithi145.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-20T21:53:04.931 INFO:teuthology.orchestra.run.smithi145.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-20T21:53:04.952 INFO:teuthology.orchestra.run.smithi145.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-20T21:53:05.040 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-20T21:53:05.040 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-20T21:53:05.112 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-20T21:53:05.162 INFO:teuthology.orchestra.run.smithi050.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy InRelease 2024-05-20T21:53:05.163 INFO:teuthology.orchestra.run.smithi145.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy InRelease 2024-05-20T21:53:05.195 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-20T21:53:05.771 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-05-20T21:53:05.772 INFO:teuthology.orchestra.run.smithi145.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-05-20T21:53:05.816 INFO:teuthology.orchestra.run.smithi050.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-20T21:53:05.817 INFO:teuthology.orchestra.run.smithi145.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-20T21:53:05.861 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,408 B] 2024-05-20T21:53:05.861 INFO:teuthology.orchestra.run.smithi145.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,408 B] 2024-05-20T21:53:06.021 INFO:teuthology.orchestra.run.smithi145.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-05-20T21:53:06.021 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-05-20T21:53:06.114 INFO:teuthology.orchestra.run.smithi145.stdout:Fetched 28.3 kB in 1s (24.1 kB/s) 2024-05-20T21:53:06.123 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 28.3 kB in 1s (23.9 kB/s) 2024-05-20T21:53:07.105 INFO:teuthology.orchestra.run.smithi145.stdout:Reading package lists... 2024-05-20T21:53:07.121 DEBUG:teuthology.orchestra.run.smithi145:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2535-g4ea72516-1jammy cephadm=19.0.0-2535-g4ea72516-1jammy ceph-mds=19.0.0-2535-g4ea72516-1jammy ceph-mgr=19.0.0-2535-g4ea72516-1jammy ceph-common=19.0.0-2535-g4ea72516-1jammy ceph-fuse=19.0.0-2535-g4ea72516-1jammy ceph-test=19.0.0-2535-g4ea72516-1jammy ceph-volume=19.0.0-2535-g4ea72516-1jammy radosgw=19.0.0-2535-g4ea72516-1jammy python3-rados=19.0.0-2535-g4ea72516-1jammy python3-rgw=19.0.0-2535-g4ea72516-1jammy python3-cephfs=19.0.0-2535-g4ea72516-1jammy python3-rbd=19.0.0-2535-g4ea72516-1jammy libcephfs2=19.0.0-2535-g4ea72516-1jammy libcephfs-dev=19.0.0-2535-g4ea72516-1jammy librados2=19.0.0-2535-g4ea72516-1jammy librbd1=19.0.0-2535-g4ea72516-1jammy rbd-fuse=19.0.0-2535-g4ea72516-1jammy 2024-05-20T21:53:07.131 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-05-20T21:53:07.147 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2535-g4ea72516-1jammy cephadm=19.0.0-2535-g4ea72516-1jammy ceph-mds=19.0.0-2535-g4ea72516-1jammy ceph-mgr=19.0.0-2535-g4ea72516-1jammy ceph-common=19.0.0-2535-g4ea72516-1jammy ceph-fuse=19.0.0-2535-g4ea72516-1jammy ceph-test=19.0.0-2535-g4ea72516-1jammy ceph-volume=19.0.0-2535-g4ea72516-1jammy radosgw=19.0.0-2535-g4ea72516-1jammy python3-rados=19.0.0-2535-g4ea72516-1jammy python3-rgw=19.0.0-2535-g4ea72516-1jammy python3-cephfs=19.0.0-2535-g4ea72516-1jammy python3-rbd=19.0.0-2535-g4ea72516-1jammy libcephfs2=19.0.0-2535-g4ea72516-1jammy libcephfs-dev=19.0.0-2535-g4ea72516-1jammy librados2=19.0.0-2535-g4ea72516-1jammy librbd1=19.0.0-2535-g4ea72516-1jammy rbd-fuse=19.0.0-2535-g4ea72516-1jammy 2024-05-20T21:53:07.183 INFO:teuthology.orchestra.run.smithi145.stdout:Reading package lists... 2024-05-20T21:53:07.212 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-05-20T21:53:07.380 INFO:teuthology.orchestra.run.smithi145.stdout:Building dependency tree... 2024-05-20T21:53:07.381 INFO:teuthology.orchestra.run.smithi145.stdout:Reading state information... 2024-05-20T21:53:07.410 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2024-05-20T21:53:07.411 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2024-05-20T21:53:07.557 INFO:teuthology.orchestra.run.smithi145.stdout:The following packages were automatically installed and are no longer required: 2024-05-20T21:53:07.558 INFO:teuthology.orchestra.run.smithi145.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-20T21:53:07.558 INFO:teuthology.orchestra.run.smithi145.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-20T21:53:07.558 INFO:teuthology.orchestra.run.smithi145.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-20T21:53:07.559 INFO:teuthology.orchestra.run.smithi145.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-20T21:53:07.559 INFO:teuthology.orchestra.run.smithi145.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-20T21:53:07.559 INFO:teuthology.orchestra.run.smithi145.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-20T21:53:07.559 INFO:teuthology.orchestra.run.smithi145.stdout:The following additional packages will be installed: 2024-05-20T21:53:07.559 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-20T21:53:07.559 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-20T21:53:07.559 INFO:teuthology.orchestra.run.smithi145.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-20T21:53:07.559 INFO:teuthology.orchestra.run.smithi145.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-20T21:53:07.560 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-20T21:53:07.561 INFO:teuthology.orchestra.run.smithi145.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-20T21:53:07.561 INFO:teuthology.orchestra.run.smithi145.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-20T21:53:07.561 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-20T21:53:07.561 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-20T21:53:07.561 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-20T21:53:07.561 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-20T21:53:07.561 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-20T21:53:07.561 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-20T21:53:07.561 INFO:teuthology.orchestra.run.smithi145.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-20T21:53:07.561 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-20T21:53:07.561 INFO:teuthology.orchestra.run.smithi145.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-20T21:53:07.561 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-20T21:53:07.561 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-20T21:53:07.562 INFO:teuthology.orchestra.run.smithi145.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-20T21:53:07.562 INFO:teuthology.orchestra.run.smithi145.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-20T21:53:07.562 INFO:teuthology.orchestra.run.smithi145.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-20T21:53:07.562 INFO:teuthology.orchestra.run.smithi145.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-20T21:53:07.562 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-20T21:53:07.562 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet zip 2024-05-20T21:53:07.562 INFO:teuthology.orchestra.run.smithi145.stdout:Suggested packages: 2024-05-20T21:53:07.562 INFO:teuthology.orchestra.run.smithi145.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-20T21:53:07.563 INFO:teuthology.orchestra.run.smithi145.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-20T21:53:07.563 INFO:teuthology.orchestra.run.smithi145.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-20T21:53:07.563 INFO:teuthology.orchestra.run.smithi145.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-20T21:53:07.563 INFO:teuthology.orchestra.run.smithi145.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-20T21:53:07.563 INFO:teuthology.orchestra.run.smithi145.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-20T21:53:07.563 INFO:teuthology.orchestra.run.smithi145.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-20T21:53:07.563 INFO:teuthology.orchestra.run.smithi145.stdout:Recommended packages: 2024-05-20T21:53:07.563 INFO:teuthology.orchestra.run.smithi145.stdout: btrfs-tools 2024-05-20T21:53:07.617 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2024-05-20T21:53:07.617 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-20T21:53:07.617 INFO:teuthology.orchestra.run.smithi050.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-20T21:53:07.617 INFO:teuthology.orchestra.run.smithi050.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-20T21:53:07.618 INFO:teuthology.orchestra.run.smithi050.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-20T21:53:07.618 INFO:teuthology.orchestra.run.smithi050.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-20T21:53:07.618 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-20T21:53:07.618 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2024-05-20T21:53:07.619 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-20T21:53:07.619 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-20T21:53:07.619 INFO:teuthology.orchestra.run.smithi050.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-20T21:53:07.619 INFO:teuthology.orchestra.run.smithi050.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-20T21:53:07.620 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-20T21:53:07.621 INFO:teuthology.orchestra.run.smithi050.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-20T21:53:07.621 INFO:teuthology.orchestra.run.smithi050.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-20T21:53:07.621 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-20T21:53:07.621 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-20T21:53:07.621 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-20T21:53:07.621 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-20T21:53:07.621 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-20T21:53:07.621 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-20T21:53:07.621 INFO:teuthology.orchestra.run.smithi050.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-20T21:53:07.621 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-20T21:53:07.621 INFO:teuthology.orchestra.run.smithi050.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-20T21:53:07.621 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-20T21:53:07.622 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-20T21:53:07.622 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-20T21:53:07.622 INFO:teuthology.orchestra.run.smithi050.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-20T21:53:07.622 INFO:teuthology.orchestra.run.smithi050.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-20T21:53:07.622 INFO:teuthology.orchestra.run.smithi050.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-20T21:53:07.622 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-20T21:53:07.623 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet zip 2024-05-20T21:53:07.623 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2024-05-20T21:53:07.623 INFO:teuthology.orchestra.run.smithi050.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-20T21:53:07.623 INFO:teuthology.orchestra.run.smithi050.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-20T21:53:07.623 INFO:teuthology.orchestra.run.smithi050.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-20T21:53:07.623 INFO:teuthology.orchestra.run.smithi050.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-20T21:53:07.624 INFO:teuthology.orchestra.run.smithi050.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-20T21:53:07.624 INFO:teuthology.orchestra.run.smithi050.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-20T21:53:07.624 INFO:teuthology.orchestra.run.smithi050.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-20T21:53:07.624 INFO:teuthology.orchestra.run.smithi050.stdout:Recommended packages: 2024-05-20T21:53:07.624 INFO:teuthology.orchestra.run.smithi050.stdout: btrfs-tools 2024-05-20T21:53:07.661 INFO:teuthology.orchestra.run.smithi145.stdout:The following NEW packages will be installed: 2024-05-20T21:53:07.662 INFO:teuthology.orchestra.run.smithi145.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-20T21:53:07.663 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-20T21:53:07.663 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-20T21:53:07.663 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-20T21:53:07.663 INFO:teuthology.orchestra.run.smithi145.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-20T21:53:07.663 INFO:teuthology.orchestra.run.smithi145.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-20T21:53:07.663 INFO:teuthology.orchestra.run.smithi145.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-20T21:53:07.663 INFO:teuthology.orchestra.run.smithi145.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-20T21:53:07.663 INFO:teuthology.orchestra.run.smithi145.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-20T21:53:07.663 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-20T21:53:07.664 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-20T21:53:07.664 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-20T21:53:07.664 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-20T21:53:07.664 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-20T21:53:07.664 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-20T21:53:07.664 INFO:teuthology.orchestra.run.smithi145.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-20T21:53:07.664 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-20T21:53:07.664 INFO:teuthology.orchestra.run.smithi145.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-20T21:53:07.664 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-20T21:53:07.664 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-20T21:53:07.664 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-20T21:53:07.664 INFO:teuthology.orchestra.run.smithi145.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-20T21:53:07.664 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-20T21:53:07.664 INFO:teuthology.orchestra.run.smithi145.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-20T21:53:07.665 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-20T21:53:07.665 INFO:teuthology.orchestra.run.smithi145.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-20T21:53:07.725 INFO:teuthology.orchestra.run.smithi145.stdout:0 upgraded, 118 newly installed, 0 to remove and 307 not upgraded. 2024-05-20T21:53:07.725 INFO:teuthology.orchestra.run.smithi145.stdout:Need to get 180 MB of archives. 2024-05-20T21:53:07.725 INFO:teuthology.orchestra.run.smithi145.stdout:After this operation, 822 MB of additional disk space will be used. 2024-05-20T21:53:07.725 INFO:teuthology.orchestra.run.smithi145.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-20T21:53:07.730 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2024-05-20T21:53:07.730 INFO:teuthology.orchestra.run.smithi050.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-20T21:53:07.730 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-20T21:53:07.730 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-20T21:53:07.730 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-20T21:53:07.730 INFO:teuthology.orchestra.run.smithi050.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-20T21:53:07.731 INFO:teuthology.orchestra.run.smithi050.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-20T21:53:07.732 INFO:teuthology.orchestra.run.smithi050.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-20T21:53:07.732 INFO:teuthology.orchestra.run.smithi050.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-20T21:53:07.732 INFO:teuthology.orchestra.run.smithi050.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-20T21:53:07.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-20T21:53:07.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-20T21:53:07.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-20T21:53:07.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-20T21:53:07.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-20T21:53:07.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-20T21:53:07.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-20T21:53:07.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-20T21:53:07.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-20T21:53:07.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-20T21:53:07.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-20T21:53:07.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-20T21:53:07.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-20T21:53:07.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-20T21:53:07.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-20T21:53:07.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-20T21:53:07.733 INFO:teuthology.orchestra.run.smithi050.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-20T21:53:07.826 INFO:teuthology.orchestra.run.smithi145.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-20T21:53:07.829 INFO:teuthology.orchestra.run.smithi145.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-20T21:53:07.849 INFO:teuthology.orchestra.run.smithi145.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-20T21:53:07.902 INFO:teuthology.orchestra.run.smithi145.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2535-g4ea72516-1jammy [3,547 kB] 2024-05-20T21:53:07.914 INFO:teuthology.orchestra.run.smithi145.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-20T21:53:07.918 INFO:teuthology.orchestra.run.smithi145.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-20T21:53:07.920 INFO:teuthology.orchestra.run.smithi050.stdout:0 upgraded, 118 newly installed, 0 to remove and 307 not upgraded. 2024-05-20T21:53:07.920 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 180 MB of archives. 2024-05-20T21:53:07.920 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 822 MB of additional disk space will be used. 2024-05-20T21:53:07.920 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-20T21:53:07.930 INFO:teuthology.orchestra.run.smithi145.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-20T21:53:07.934 INFO:teuthology.orchestra.run.smithi145.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-20T21:53:07.935 INFO:teuthology.orchestra.run.smithi145.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-20T21:53:07.936 INFO:teuthology.orchestra.run.smithi145.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-20T21:53:07.941 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2535-g4ea72516-1jammy [3,547 kB] 2024-05-20T21:53:07.944 INFO:teuthology.orchestra.run.smithi145.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-20T21:53:07.946 INFO:teuthology.orchestra.run.smithi145.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-20T21:53:07.948 INFO:teuthology.orchestra.run.smithi145.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-20T21:53:07.950 INFO:teuthology.orchestra.run.smithi145.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-20T21:53:07.957 INFO:teuthology.orchestra.run.smithi145.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-20T21:53:07.959 INFO:teuthology.orchestra.run.smithi145.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-20T21:53:07.961 INFO:teuthology.orchestra.run.smithi145.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-20T21:53:07.977 INFO:teuthology.orchestra.run.smithi145.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-20T21:53:07.978 INFO:teuthology.orchestra.run.smithi145.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-20T21:53:07.978 INFO:teuthology.orchestra.run.smithi145.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-20T21:53:07.979 INFO:teuthology.orchestra.run.smithi145.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-20T21:53:07.979 INFO:teuthology.orchestra.run.smithi145.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-20T21:53:07.980 INFO:teuthology.orchestra.run.smithi145.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-20T21:53:07.980 INFO:teuthology.orchestra.run.smithi145.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-20T21:53:07.997 INFO:teuthology.orchestra.run.smithi145.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-20T21:53:07.997 INFO:teuthology.orchestra.run.smithi145.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-20T21:53:07.997 INFO:teuthology.orchestra.run.smithi145.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-20T21:53:08.016 INFO:teuthology.orchestra.run.smithi145.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-20T21:53:08.016 INFO:teuthology.orchestra.run.smithi145.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-20T21:53:08.017 INFO:teuthology.orchestra.run.smithi145.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-20T21:53:08.017 INFO:teuthology.orchestra.run.smithi145.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-20T21:53:08.018 INFO:teuthology.orchestra.run.smithi145.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-20T21:53:08.018 INFO:teuthology.orchestra.run.smithi145.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-20T21:53:08.019 INFO:teuthology.orchestra.run.smithi145.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-20T21:53:08.035 INFO:teuthology.orchestra.run.smithi145.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-20T21:53:08.036 INFO:teuthology.orchestra.run.smithi145.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-20T21:53:08.037 INFO:teuthology.orchestra.run.smithi145.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-20T21:53:08.055 INFO:teuthology.orchestra.run.smithi145.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-20T21:53:08.055 INFO:teuthology.orchestra.run.smithi145.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-20T21:53:08.056 INFO:teuthology.orchestra.run.smithi145.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-20T21:53:08.056 INFO:teuthology.orchestra.run.smithi145.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-20T21:53:08.058 INFO:teuthology.orchestra.run.smithi145.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-20T21:53:08.059 INFO:teuthology.orchestra.run.smithi145.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-20T21:53:08.060 INFO:teuthology.orchestra.run.smithi145.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-20T21:53:08.075 INFO:teuthology.orchestra.run.smithi145.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-20T21:53:08.075 INFO:teuthology.orchestra.run.smithi145.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-20T21:53:08.077 INFO:teuthology.orchestra.run.smithi145.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-20T21:53:08.094 INFO:teuthology.orchestra.run.smithi145.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-20T21:53:08.095 INFO:teuthology.orchestra.run.smithi145.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-20T21:53:08.097 INFO:teuthology.orchestra.run.smithi145.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-20T21:53:08.151 INFO:teuthology.orchestra.run.smithi145.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-20T21:53:08.152 INFO:teuthology.orchestra.run.smithi145.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-20T21:53:08.154 INFO:teuthology.orchestra.run.smithi145.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-20T21:53:08.154 INFO:teuthology.orchestra.run.smithi145.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-20T21:53:08.155 INFO:teuthology.orchestra.run.smithi145.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-20T21:53:08.177 INFO:teuthology.orchestra.run.smithi145.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-20T21:53:08.180 INFO:teuthology.orchestra.run.smithi145.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-20T21:53:08.180 INFO:teuthology.orchestra.run.smithi145.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-20T21:53:08.201 INFO:teuthology.orchestra.run.smithi145.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-20T21:53:08.201 INFO:teuthology.orchestra.run.smithi145.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-20T21:53:08.202 INFO:teuthology.orchestra.run.smithi145.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-20T21:53:08.202 INFO:teuthology.orchestra.run.smithi145.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-20T21:53:08.203 INFO:teuthology.orchestra.run.smithi145.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-20T21:53:08.203 INFO:teuthology.orchestra.run.smithi145.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-20T21:53:08.214 INFO:teuthology.orchestra.run.smithi145.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-20T21:53:08.214 INFO:teuthology.orchestra.run.smithi145.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-20T21:53:08.218 INFO:teuthology.orchestra.run.smithi145.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-20T21:53:08.233 INFO:teuthology.orchestra.run.smithi145.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-20T21:53:08.235 INFO:teuthology.orchestra.run.smithi145.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-20T21:53:08.235 INFO:teuthology.orchestra.run.smithi145.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-20T21:53:08.239 INFO:teuthology.orchestra.run.smithi145.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-20T21:53:08.241 INFO:teuthology.orchestra.run.smithi145.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-20T21:53:08.242 INFO:teuthology.orchestra.run.smithi145.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-20T21:53:08.243 INFO:teuthology.orchestra.run.smithi145.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-20T21:53:08.253 INFO:teuthology.orchestra.run.smithi145.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-20T21:53:08.253 INFO:teuthology.orchestra.run.smithi145.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-20T21:53:08.256 INFO:teuthology.orchestra.run.smithi145.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-20T21:53:08.272 INFO:teuthology.orchestra.run.smithi145.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-20T21:53:08.273 INFO:teuthology.orchestra.run.smithi145.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-20T21:53:08.273 INFO:teuthology.orchestra.run.smithi145.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-20T21:53:08.275 INFO:teuthology.orchestra.run.smithi145.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-20T21:53:08.276 INFO:teuthology.orchestra.run.smithi145.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-20T21:53:08.282 INFO:teuthology.orchestra.run.smithi145.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-20T21:53:08.282 INFO:teuthology.orchestra.run.smithi145.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-20T21:53:08.292 INFO:teuthology.orchestra.run.smithi145.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-20T21:53:08.294 INFO:teuthology.orchestra.run.smithi145.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-20T21:53:08.294 INFO:teuthology.orchestra.run.smithi145.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-20T21:53:08.341 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-20T21:53:08.354 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-20T21:53:08.435 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-20T21:53:08.670 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-20T21:53:08.698 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-20T21:53:08.711 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-20T21:53:08.720 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-20T21:53:08.721 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-20T21:53:08.764 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-20T21:53:08.909 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-20T21:53:08.934 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-20T21:53:08.960 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-20T21:53:08.983 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-20T21:53:09.004 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-20T21:53:09.030 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-20T21:53:09.055 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-20T21:53:09.073 INFO:teuthology.orchestra.run.smithi145.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2535-g4ea72516-1jammy [3,216 kB] 2024-05-20T21:53:09.080 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-20T21:53:09.102 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-20T21:53:09.124 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-20T21:53:09.147 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-20T21:53:09.169 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-20T21:53:09.190 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-20T21:53:09.212 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-20T21:53:09.234 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-20T21:53:09.259 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-20T21:53:09.293 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-20T21:53:09.331 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2535-g4ea72516-1jammy [3,216 kB] 2024-05-20T21:53:09.331 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-20T21:53:09.364 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-20T21:53:09.386 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-20T21:53:09.412 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-20T21:53:09.443 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-20T21:53:09.448 INFO:teuthology.orchestra.run.smithi145.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2535-g4ea72516-1jammy [711 kB] 2024-05-20T21:53:09.465 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-20T21:53:09.547 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-20T21:53:09.553 INFO:teuthology.orchestra.run.smithi145.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2535-g4ea72516-1jammy [356 kB] 2024-05-20T21:53:09.571 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-20T21:53:09.591 INFO:teuthology.orchestra.run.smithi145.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2535-g4ea72516-1jammy [32.8 kB] 2024-05-20T21:53:09.592 INFO:teuthology.orchestra.run.smithi145.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2535-g4ea72516-1jammy [180 kB] 2024-05-20T21:53:09.593 INFO:teuthology.orchestra.run.smithi050.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-20T21:53:09.614 INFO:teuthology.orchestra.run.smithi050.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-20T21:53:09.616 INFO:teuthology.orchestra.run.smithi145.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2535-g4ea72516-1jammy [67.1 kB] 2024-05-20T21:53:09.618 INFO:teuthology.orchestra.run.smithi145.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2535-g4ea72516-1jammy [330 kB] 2024-05-20T21:53:09.634 INFO:teuthology.orchestra.run.smithi145.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2535-g4ea72516-1jammy [6,780 kB] 2024-05-20T21:53:09.647 INFO:teuthology.orchestra.run.smithi050.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-20T21:53:09.668 INFO:teuthology.orchestra.run.smithi050.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-20T21:53:09.690 INFO:teuthology.orchestra.run.smithi050.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-20T21:53:09.713 INFO:teuthology.orchestra.run.smithi050.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-20T21:53:09.736 INFO:teuthology.orchestra.run.smithi050.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-20T21:53:09.761 INFO:teuthology.orchestra.run.smithi050.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-20T21:53:09.783 INFO:teuthology.orchestra.run.smithi050.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-20T21:53:09.807 INFO:teuthology.orchestra.run.smithi050.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-20T21:53:09.830 INFO:teuthology.orchestra.run.smithi050.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-20T21:53:09.855 INFO:teuthology.orchestra.run.smithi050.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-20T21:53:09.877 INFO:teuthology.orchestra.run.smithi050.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-20T21:53:09.900 INFO:teuthology.orchestra.run.smithi050.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-20T21:53:09.925 INFO:teuthology.orchestra.run.smithi050.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-20T21:53:10.090 INFO:teuthology.orchestra.run.smithi050.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-20T21:53:10.113 INFO:teuthology.orchestra.run.smithi050.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-20T21:53:10.136 INFO:teuthology.orchestra.run.smithi050.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-20T21:53:10.158 INFO:teuthology.orchestra.run.smithi050.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-20T21:53:10.183 INFO:teuthology.orchestra.run.smithi050.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-20T21:53:10.245 INFO:teuthology.orchestra.run.smithi145.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2535-g4ea72516-1jammy [112 kB] 2024-05-20T21:53:10.249 INFO:teuthology.orchestra.run.smithi050.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-20T21:53:10.253 INFO:teuthology.orchestra.run.smithi145.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2535-g4ea72516-1jammy [466 kB] 2024-05-20T21:53:10.274 INFO:teuthology.orchestra.run.smithi145.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2535-g4ea72516-1jammy [25.6 MB] 2024-05-20T21:53:10.275 INFO:teuthology.orchestra.run.smithi050.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-20T21:53:10.313 INFO:teuthology.orchestra.run.smithi050.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2535-g4ea72516-1jammy [711 kB] 2024-05-20T21:53:10.360 INFO:teuthology.orchestra.run.smithi050.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-20T21:53:10.414 INFO:teuthology.orchestra.run.smithi050.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2535-g4ea72516-1jammy [356 kB] 2024-05-20T21:53:10.421 INFO:teuthology.orchestra.run.smithi050.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-20T21:53:10.445 INFO:teuthology.orchestra.run.smithi050.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-20T21:53:10.467 INFO:teuthology.orchestra.run.smithi050.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-20T21:53:10.472 INFO:teuthology.orchestra.run.smithi050.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2535-g4ea72516-1jammy [32.8 kB] 2024-05-20T21:53:10.473 INFO:teuthology.orchestra.run.smithi050.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2535-g4ea72516-1jammy [180 kB] 2024-05-20T21:53:10.489 INFO:teuthology.orchestra.run.smithi050.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-20T21:53:10.495 INFO:teuthology.orchestra.run.smithi050.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2535-g4ea72516-1jammy [67.1 kB] 2024-05-20T21:53:10.497 INFO:teuthology.orchestra.run.smithi050.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2535-g4ea72516-1jammy [330 kB] 2024-05-20T21:53:10.512 INFO:teuthology.orchestra.run.smithi050.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-20T21:53:10.534 INFO:teuthology.orchestra.run.smithi050.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-20T21:53:10.555 INFO:teuthology.orchestra.run.smithi050.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2535-g4ea72516-1jammy [6,780 kB] 2024-05-20T21:53:10.557 INFO:teuthology.orchestra.run.smithi050.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-20T21:53:10.580 INFO:teuthology.orchestra.run.smithi050.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-20T21:53:10.609 INFO:teuthology.orchestra.run.smithi050.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-20T21:53:10.634 INFO:teuthology.orchestra.run.smithi050.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-20T21:53:10.658 INFO:teuthology.orchestra.run.smithi050.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-20T21:53:10.681 INFO:teuthology.orchestra.run.smithi050.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-20T21:53:10.710 INFO:teuthology.orchestra.run.smithi050.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-20T21:53:10.737 INFO:teuthology.orchestra.run.smithi050.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-20T21:53:10.760 INFO:teuthology.orchestra.run.smithi050.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-20T21:53:10.782 INFO:teuthology.orchestra.run.smithi050.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-20T21:53:10.814 INFO:teuthology.orchestra.run.smithi050.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-20T21:53:10.837 INFO:teuthology.orchestra.run.smithi050.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-20T21:53:10.865 INFO:teuthology.orchestra.run.smithi050.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-20T21:53:10.887 INFO:teuthology.orchestra.run.smithi050.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-20T21:53:10.910 INFO:teuthology.orchestra.run.smithi050.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-20T21:53:10.931 INFO:teuthology.orchestra.run.smithi050.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-20T21:53:10.956 INFO:teuthology.orchestra.run.smithi050.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-20T21:53:11.043 INFO:teuthology.orchestra.run.smithi050.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-20T21:53:11.081 INFO:teuthology.orchestra.run.smithi050.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-20T21:53:11.102 INFO:teuthology.orchestra.run.smithi050.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-20T21:53:11.124 INFO:teuthology.orchestra.run.smithi050.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-20T21:53:11.149 INFO:teuthology.orchestra.run.smithi050.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-20T21:53:11.172 INFO:teuthology.orchestra.run.smithi050.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-20T21:53:11.465 INFO:teuthology.orchestra.run.smithi050.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2535-g4ea72516-1jammy [112 kB] 2024-05-20T21:53:11.467 INFO:teuthology.orchestra.run.smithi145.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2535-g4ea72516-1jammy [5,085 kB] 2024-05-20T21:53:11.468 INFO:teuthology.orchestra.run.smithi050.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2535-g4ea72516-1jammy [466 kB] 2024-05-20T21:53:11.528 INFO:teuthology.orchestra.run.smithi050.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2535-g4ea72516-1jammy [25.6 MB] 2024-05-20T21:53:11.654 INFO:teuthology.orchestra.run.smithi145.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2535-g4ea72516-1jammy [244 kB] 2024-05-20T21:53:11.660 INFO:teuthology.orchestra.run.smithi145.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2535-g4ea72516-1jammy [124 kB] 2024-05-20T21:53:11.671 INFO:teuthology.orchestra.run.smithi145.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2535-g4ea72516-1jammy [1,526 kB] 2024-05-20T21:53:11.733 INFO:teuthology.orchestra.run.smithi145.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2535-g4ea72516-1jammy [6,246 kB] 2024-05-20T21:53:12.014 INFO:teuthology.orchestra.run.smithi145.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2535-g4ea72516-1jammy [22.7 MB] 2024-05-20T21:53:13.112 INFO:teuthology.orchestra.run.smithi145.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2535-g4ea72516-1jammy [14.1 kB] 2024-05-20T21:53:13.113 INFO:teuthology.orchestra.run.smithi145.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2535-g4ea72516-1jammy [869 kB] 2024-05-20T21:53:13.130 INFO:teuthology.orchestra.run.smithi145.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2535-g4ea72516-1jammy [2,437 kB] 2024-05-20T21:53:13.216 INFO:teuthology.orchestra.run.smithi145.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2535-g4ea72516-1jammy [791 kB] 2024-05-20T21:53:13.249 INFO:teuthology.orchestra.run.smithi145.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2535-g4ea72516-1jammy [148 kB] 2024-05-20T21:53:13.261 INFO:teuthology.orchestra.run.smithi145.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2535-g4ea72516-1jammy [2,331 kB] 2024-05-20T21:53:13.369 INFO:teuthology.orchestra.run.smithi145.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2535-g4ea72516-1jammy [8,625 kB] 2024-05-20T21:53:13.763 INFO:teuthology.orchestra.run.smithi145.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2535-g4ea72516-1jammy [14.2 kB] 2024-05-20T21:53:13.763 INFO:teuthology.orchestra.run.smithi145.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2535-g4ea72516-1jammy [50.7 MB] 2024-05-20T21:53:14.633 INFO:teuthology.orchestra.run.smithi050.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2535-g4ea72516-1jammy [5,085 kB] 2024-05-20T21:53:15.129 INFO:teuthology.orchestra.run.smithi050.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2535-g4ea72516-1jammy [244 kB] 2024-05-20T21:53:15.164 INFO:teuthology.orchestra.run.smithi050.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2535-g4ea72516-1jammy [124 kB] 2024-05-20T21:53:15.183 INFO:teuthology.orchestra.run.smithi050.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2535-g4ea72516-1jammy [1,526 kB] 2024-05-20T21:53:15.334 INFO:teuthology.orchestra.run.smithi050.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2535-g4ea72516-1jammy [6,246 kB] 2024-05-20T21:53:15.988 INFO:teuthology.orchestra.run.smithi050.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2535-g4ea72516-1jammy [22.7 MB] 2024-05-20T21:53:16.399 INFO:teuthology.orchestra.run.smithi145.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2535-g4ea72516-1jammy [121 kB] 2024-05-20T21:53:16.401 INFO:teuthology.orchestra.run.smithi145.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2535-g4ea72516-1jammy [38.9 kB] 2024-05-20T21:53:16.402 INFO:teuthology.orchestra.run.smithi145.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2535-g4ea72516-1jammy [13.4 MB] 2024-05-20T21:53:16.934 INFO:teuthology.orchestra.run.smithi145.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2535-g4ea72516-1jammy [91.2 kB] 2024-05-20T21:53:17.499 INFO:teuthology.orchestra.run.smithi145.stdout:Fetched 180 MB in 9s (19.4 MB/s) 2024-05-20T21:53:17.660 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-20T21:53:17.760 INFO:teuthology.orchestra.run.smithi145.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-20T21:53:17.766 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-20T21:53:17.781 INFO:teuthology.orchestra.run.smithi050.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2535-g4ea72516-1jammy [14.1 kB] 2024-05-20T21:53:17.781 INFO:teuthology.orchestra.run.smithi050.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2535-g4ea72516-1jammy [869 kB] 2024-05-20T21:53:17.805 INFO:teuthology.orchestra.run.smithi050.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2535-g4ea72516-1jammy [2,437 kB] 2024-05-20T21:53:17.850 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-20T21:53:17.948 INFO:teuthology.orchestra.run.smithi050.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2535-g4ea72516-1jammy [791 kB] 2024-05-20T21:53:17.990 INFO:teuthology.orchestra.run.smithi050.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2535-g4ea72516-1jammy [148 kB] 2024-05-20T21:53:17.993 INFO:teuthology.orchestra.run.smithi050.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2535-g4ea72516-1jammy [2,331 kB] 2024-05-20T21:53:18.134 INFO:teuthology.orchestra.run.smithi050.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2535-g4ea72516-1jammy [8,625 kB] 2024-05-20T21:53:18.187 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-20T21:53:18.214 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-20T21:53:18.254 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-20T21:53:18.532 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-20T21:53:18.547 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-20T21:53:18.581 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-20T21:53:18.730 INFO:teuthology.orchestra.run.smithi050.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2535-g4ea72516-1jammy [14.2 kB] 2024-05-20T21:53:18.730 INFO:teuthology.orchestra.run.smithi050.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2535-g4ea72516-1jammy [50.7 MB] 2024-05-20T21:53:19.035 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-20T21:53:19.061 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-20T21:53:19.109 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-20T21:53:19.522 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-20T21:53:19.549 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-20T21:53:19.588 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-20T21:53:19.909 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-20T21:53:19.935 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-20T21:53:19.966 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-20T21:53:20.536 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-20T21:53:20.563 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-20T21:53:20.602 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-20T21:53:20.889 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package librados2. 2024-05-20T21:53:20.905 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../007-librados2_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:20.939 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking librados2 (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:21.400 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package librbd1. 2024-05-20T21:53:21.426 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../008-librbd1_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:21.466 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking librbd1 (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:21.911 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libcephfs2. 2024-05-20T21:53:21.937 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:21.978 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libcephfs2 (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:22.177 INFO:teuthology.orchestra.run.smithi050.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2535-g4ea72516-1jammy [121 kB] 2024-05-20T21:53:22.180 INFO:teuthology.orchestra.run.smithi050.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2535-g4ea72516-1jammy [38.9 kB] 2024-05-20T21:53:22.181 INFO:teuthology.orchestra.run.smithi050.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2535-g4ea72516-1jammy [13.4 MB] 2024-05-20T21:53:22.255 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-rados. 2024-05-20T21:53:22.271 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:22.305 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-rados (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:22.600 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-20T21:53:22.627 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2535-g4ea72516-1jammy_all.deb ... 2024-05-20T21:53:22.655 INFO:teuthology.orchestra.run.smithi050.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2535-g4ea72516-1jammy [91.2 kB] 2024-05-20T21:53:22.666 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-ceph-argparse (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:22.877 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-cephfs. 2024-05-20T21:53:22.892 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:22.927 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-cephfs (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:23.247 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-20T21:53:23.247 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 180 MB in 15s (12.0 MB/s) 2024-05-20T21:53:23.274 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2535-g4ea72516-1jammy_all.deb ... 2024-05-20T21:53:23.313 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-ceph-common (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:23.441 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-20T21:53:23.546 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-20T21:53:23.552 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-20T21:53:23.632 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-20T21:53:23.650 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-20T21:53:23.677 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-20T21:53:23.716 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-20T21:53:23.918 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-20T21:53:23.946 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-20T21:53:23.977 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-20T21:53:24.028 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-prettytable. 2024-05-20T21:53:24.070 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-20T21:53:24.078 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-20T21:53:24.313 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-20T21:53:24.332 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-rbd. 2024-05-20T21:53:24.340 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-20T21:53:24.348 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:24.379 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-20T21:53:24.391 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-rbd (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:24.744 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-20T21:53:24.771 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-20T21:53:24.810 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-20T21:53:25.079 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-20T21:53:25.091 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-20T21:53:25.106 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-20T21:53:25.119 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-20T21:53:25.146 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-20T21:53:25.167 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-20T21:53:25.424 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-20T21:53:25.451 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-20T21:53:25.490 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-20T21:53:25.687 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-20T21:53:25.713 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-20T21:53:25.753 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-20T21:53:25.844 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package lua5.1. 2024-05-20T21:53:25.871 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-20T21:53:25.910 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-20T21:53:26.081 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-20T21:53:26.108 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-20T21:53:26.148 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-20T21:53:26.239 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package lua-any. 2024-05-20T21:53:26.266 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-20T21:53:26.305 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-20T21:53:26.492 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-20T21:53:26.519 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-20T21:53:26.541 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package zip. 2024-05-20T21:53:26.557 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-20T21:53:26.559 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-20T21:53:26.591 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking zip (3.0-12build2) ... 2024-05-20T21:53:26.837 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librados2. 2024-05-20T21:53:26.853 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../007-librados2_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:26.887 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librados2 (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:26.894 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package unzip. 2024-05-20T21:53:26.921 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-20T21:53:26.961 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-20T21:53:27.332 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librbd1. 2024-05-20T21:53:27.358 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../008-librbd1_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:27.390 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package luarocks. 2024-05-20T21:53:27.398 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librbd1 (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:27.417 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-20T21:53:27.456 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-20T21:53:27.822 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package librgw2. 2024-05-20T21:53:27.849 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../025-librgw2_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:27.859 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libcephfs2. 2024-05-20T21:53:27.886 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:27.897 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking librgw2 (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:27.925 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libcephfs2 (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:28.228 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rados. 2024-05-20T21:53:28.255 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:28.295 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rados (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:28.442 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-rgw. 2024-05-20T21:53:28.468 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:28.508 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-rgw (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:28.631 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-20T21:53:28.658 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2535-g4ea72516-1jammy_all.deb ... 2024-05-20T21:53:28.698 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-ceph-argparse (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:28.852 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-20T21:53:28.879 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-20T21:53:28.919 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-20T21:53:28.942 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cephfs. 2024-05-20T21:53:28.968 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:29.000 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cephfs (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:29.230 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libradosstriper1. 2024-05-20T21:53:29.257 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:29.294 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-20T21:53:29.305 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libradosstriper1 (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:29.321 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2535-g4ea72516-1jammy_all.deb ... 2024-05-20T21:53:29.361 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-ceph-common (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:29.656 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-20T21:53:29.658 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-common. 2024-05-20T21:53:29.672 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-20T21:53:29.686 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:29.706 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-20T21:53:29.717 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-common (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:29.983 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-prettytable. 2024-05-20T21:53:29.999 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-20T21:53:30.042 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-20T21:53:30.286 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rbd. 2024-05-20T21:53:30.312 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:30.353 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rbd (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:30.831 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-20T21:53:30.857 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-20T21:53:30.897 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-20T21:53:31.158 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-20T21:53:31.174 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-20T21:53:31.209 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-20T21:53:31.272 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-base. 2024-05-20T21:53:31.299 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:31.348 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-base (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:31.477 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-20T21:53:31.504 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-20T21:53:31.544 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-20T21:53:31.906 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua5.1. 2024-05-20T21:53:31.927 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-20T21:53:31.933 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-20T21:53:31.954 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-20T21:53:31.972 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-20T21:53:31.993 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-20T21:53:32.271 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-cheroot. 2024-05-20T21:53:32.283 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua-any. 2024-05-20T21:53:32.297 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-20T21:53:32.310 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-20T21:53:32.337 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-20T21:53:32.350 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-20T21:53:32.569 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package zip. 2024-05-20T21:53:32.585 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-20T21:53:32.632 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-20T21:53:32.636 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking zip (3.0-12build2) ... 2024-05-20T21:53:32.659 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-20T21:53:32.690 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-20T21:53:32.956 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package unzip. 2024-05-20T21:53:32.976 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-20T21:53:32.983 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-20T21:53:33.003 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-20T21:53:33.023 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-20T21:53:33.043 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-20T21:53:33.346 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-20T21:53:33.373 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-20T21:53:33.410 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package luarocks. 2024-05-20T21:53:33.412 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-20T21:53:33.436 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-20T21:53:33.476 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-20T21:53:33.707 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-tempora. 2024-05-20T21:53:33.734 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-20T21:53:33.773 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-20T21:53:33.851 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librgw2. 2024-05-20T21:53:33.878 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../025-librgw2_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:33.917 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librgw2 (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:34.001 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-portend. 2024-05-20T21:53:34.028 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-20T21:53:34.059 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-20T21:53:34.387 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-20T21:53:34.414 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-20T21:53:34.445 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rgw. 2024-05-20T21:53:34.454 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-20T21:53:34.471 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:34.503 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rgw (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:34.757 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-20T21:53:34.784 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-20T21:53:34.823 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-20T21:53:34.848 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-20T21:53:34.874 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-20T21:53:34.914 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-20T21:53:35.169 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-natsort. 2024-05-20T21:53:35.196 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-20T21:53:35.225 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libradosstriper1. 2024-05-20T21:53:35.235 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-20T21:53:35.252 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:35.292 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libradosstriper1 (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:35.547 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-logutils. 2024-05-20T21:53:35.573 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-20T21:53:35.613 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-20T21:53:35.904 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-common. 2024-05-20T21:53:35.916 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-20T21:53:35.931 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:35.943 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-20T21:53:35.970 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-common (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:35.983 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-20T21:53:36.261 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-mako. 2024-05-20T21:53:36.288 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-20T21:53:36.319 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-20T21:53:36.630 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-20T21:53:36.658 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-20T21:53:36.705 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-20T21:53:37.025 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-20T21:53:37.052 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-20T21:53:37.091 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-20T21:53:37.317 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-base. 2024-05-20T21:53:37.344 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:37.394 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-base (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:37.394 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-webob. 2024-05-20T21:53:37.421 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-20T21:53:37.461 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-20T21:53:37.806 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-waitress. 2024-05-20T21:53:37.832 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-20T21:53:37.876 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-20T21:53:37.980 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-20T21:53:38.007 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-20T21:53:38.046 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-20T21:53:38.217 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-tempita. 2024-05-20T21:53:38.244 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-20T21:53:38.283 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-20T21:53:38.351 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cheroot. 2024-05-20T21:53:38.376 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-20T21:53:38.416 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-20T21:53:38.628 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-paste. 2024-05-20T21:53:38.655 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-20T21:53:38.703 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-20T21:53:38.735 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-20T21:53:38.762 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-20T21:53:38.802 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-20T21:53:39.006 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-20T21:53:39.021 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-20T21:53:39.064 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-20T21:53:39.105 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-20T21:53:39.132 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-20T21:53:39.171 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-20T21:53:39.393 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-20T21:53:39.419 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-20T21:53:39.433 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-20T21:53:39.460 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-20T21:53:39.467 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-20T21:53:39.491 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-20T21:53:39.737 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-webtest. 2024-05-20T21:53:39.764 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-20T21:53:39.769 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-tempora. 2024-05-20T21:53:39.795 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-20T21:53:39.795 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-20T21:53:39.835 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-20T21:53:40.847 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-portend. 2024-05-20T21:53:40.857 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pecan. 2024-05-20T21:53:40.874 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-20T21:53:40.884 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-20T21:53:40.905 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-20T21:53:40.923 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-20T21:53:41.183 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-20T21:53:41.211 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-20T21:53:41.249 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-20T21:53:41.517 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-certifi. 2024-05-20T21:53:41.536 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-20T21:53:41.544 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-20T21:53:41.563 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-20T21:53:41.586 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-20T21:53:41.602 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-20T21:53:41.906 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-idna. 2024-05-20T21:53:41.921 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-20T21:53:41.939 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-natsort. 2024-05-20T21:53:41.956 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-20T21:53:41.967 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-20T21:53:42.006 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-20T21:53:42.242 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-urllib3. 2024-05-20T21:53:42.269 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-20T21:53:42.308 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-20T21:53:42.325 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-logutils. 2024-05-20T21:53:42.353 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-20T21:53:42.392 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-20T21:53:42.612 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-requests. 2024-05-20T21:53:42.638 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-20T21:53:42.653 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-20T21:53:42.678 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-20T21:53:42.680 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-20T21:53:42.711 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-20T21:53:42.956 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-20T21:53:42.983 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-20T21:53:43.023 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-20T21:53:43.023 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-mako. 2024-05-20T21:53:43.050 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-20T21:53:43.089 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-20T21:53:43.317 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-20T21:53:43.333 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2535-g4ea72516-1jammy_all.deb ... 2024-05-20T21:53:43.367 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:43.426 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-20T21:53:43.453 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-20T21:53:43.492 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-20T21:53:43.764 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-20T21:53:43.791 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:43.795 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-20T21:53:43.822 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-20T21:53:43.830 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:43.862 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-20T21:53:44.142 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-20T21:53:44.148 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webob. 2024-05-20T21:53:44.164 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-20T21:53:44.168 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-20T21:53:44.198 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-20T21:53:44.208 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-20T21:53:44.469 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-openssl. 2024-05-20T21:53:44.484 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-waitress. 2024-05-20T21:53:44.484 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-20T21:53:44.500 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-20T21:53:44.519 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-20T21:53:44.546 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-20T21:53:44.847 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mgr. 2024-05-20T21:53:44.853 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-tempita. 2024-05-20T21:53:44.874 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:44.881 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-20T21:53:44.913 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mgr (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:44.920 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-20T21:53:45.232 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-paste. 2024-05-20T21:53:45.258 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-20T21:53:45.298 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-20T21:53:45.376 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mon. 2024-05-20T21:53:45.402 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:45.442 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mon (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:45.626 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-20T21:53:45.642 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-20T21:53:45.676 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-20T21:53:45.937 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-20T21:53:45.964 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-20T21:53:45.995 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-osd. 2024-05-20T21:53:46.012 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-20T21:53:46.022 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:46.053 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-osd (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:46.474 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webtest. 2024-05-20T21:53:46.501 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-20T21:53:46.540 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-20T21:53:46.809 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pecan. 2024-05-20T21:53:46.826 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-20T21:53:46.859 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-20T21:53:47.065 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph. 2024-05-20T21:53:47.081 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../066-ceph_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:47.123 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:47.273 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-certifi. 2024-05-20T21:53:47.300 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-20T21:53:47.339 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-20T21:53:47.443 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-fuse. 2024-05-20T21:53:47.470 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:47.509 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-fuse (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:47.634 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-idna. 2024-05-20T21:53:47.661 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-20T21:53:47.692 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-20T21:53:47.912 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mds. 2024-05-20T21:53:47.939 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:47.979 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mds (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:47.986 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-urllib3. 2024-05-20T21:53:48.014 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-20T21:53:48.053 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-20T21:53:48.340 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package cephadm. 2024-05-20T21:53:48.365 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-requests. 2024-05-20T21:53:48.367 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../069-cephadm_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:48.392 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-20T21:53:48.398 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking cephadm (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:48.431 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-20T21:53:48.742 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-20T21:53:48.743 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-20T21:53:48.769 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-20T21:53:48.770 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-20T21:53:48.809 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-20T21:53:48.809 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-20T21:53:49.054 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-20T21:53:49.081 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2535-g4ea72516-1jammy_all.deb ... 2024-05-20T21:53:49.087 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-20T21:53:49.103 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-20T21:53:49.120 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:49.146 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-20T21:53:49.492 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-20T21:53:49.519 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:49.558 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:49.827 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-20T21:53:49.844 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-20T21:53:49.877 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-20T21:53:50.075 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-babel. 2024-05-20T21:53:50.091 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-20T21:53:50.133 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-20T21:53:50.181 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-openssl. 2024-05-20T21:53:50.208 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-20T21:53:50.247 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-20T21:53:50.403 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-jinja2. 2024-05-20T21:53:50.430 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-20T21:53:50.461 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-20T21:53:50.583 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr. 2024-05-20T21:53:50.611 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:50.650 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:50.822 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-20T21:53:50.850 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2535-g4ea72516-1jammy_all.deb ... 2024-05-20T21:53:50.898 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:51.045 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mon. 2024-05-20T21:53:51.072 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:51.111 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mon (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:51.254 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-20T21:53:51.278 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-20T21:53:51.317 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-20T21:53:51.620 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-routes. 2024-05-20T21:53:51.647 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-20T21:53:51.686 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-20T21:53:51.832 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-osd. 2024-05-20T21:53:51.859 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:51.898 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-osd (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:52.223 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-20T21:53:52.250 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2535-g4ea72516-1jammy_all.deb ... 2024-05-20T21:53:52.289 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:52.960 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph. 2024-05-20T21:53:52.976 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../066-ceph_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:53.018 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:53.370 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-fuse. 2024-05-20T21:53:53.398 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:53.437 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-fuse (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:53.569 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-20T21:53:53.585 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-20T21:53:53.628 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-20T21:53:53.749 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mds. 2024-05-20T21:53:53.776 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:53.807 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mds (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:54.115 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-joblib. 2024-05-20T21:53:54.142 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-20T21:53:54.181 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-20T21:53:54.193 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephadm. 2024-05-20T21:53:54.220 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../069-cephadm_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:53:54.259 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephadm (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:54.526 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-20T21:53:54.553 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-20T21:53:54.570 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-20T21:53:54.592 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-20T21:53:54.598 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-20T21:53:54.637 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-20T21:53:54.912 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-sklearn. 2024-05-20T21:53:54.940 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-20T21:53:54.966 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-20T21:53:54.978 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-20T21:53:54.982 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-20T21:53:55.023 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-20T21:53:55.671 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-20T21:53:55.699 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2535-g4ea72516-1jammy_all.deb ... 2024-05-20T21:53:55.844 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:56.045 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-babel. 2024-05-20T21:53:56.073 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-20T21:53:56.111 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-20T21:53:56.506 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jinja2. 2024-05-20T21:53:56.533 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-20T21:53:56.574 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-20T21:53:56.760 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-cachetools. 2024-05-20T21:53:56.778 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-20T21:53:56.818 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-20T21:53:57.067 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-20T21:53:57.094 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2535-g4ea72516-1jammy_all.deb ... 2024-05-20T21:53:57.121 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-20T21:53:57.133 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:57.149 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-20T21:53:57.187 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-20T21:53:57.412 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-20T21:53:57.428 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-20T21:53:57.470 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-20T21:53:57.483 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-20T21:53:57.510 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-20T21:53:57.549 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-20T21:53:57.773 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-routes. 2024-05-20T21:53:57.801 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-20T21:53:57.839 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-20T21:53:57.844 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-rsa. 2024-05-20T21:53:57.872 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-20T21:53:57.910 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-20T21:53:58.176 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-20T21:53:58.204 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2535-g4ea72516-1jammy_all.deb ... 2024-05-20T21:53:58.230 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-google-auth. 2024-05-20T21:53:58.242 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:53:58.258 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-20T21:53:58.297 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-20T21:53:58.618 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-20T21:53:58.641 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-20T21:53:58.683 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-20T21:53:58.961 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-websocket. 2024-05-20T21:53:58.989 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-20T21:53:59.019 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-20T21:53:59.298 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-20T21:53:59.326 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-20T21:53:59.364 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-20T21:53:59.481 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-20T21:53:59.497 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-20T21:53:59.531 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-20T21:53:59.917 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-joblib. 2024-05-20T21:53:59.933 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-20T21:53:59.967 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-20T21:53:59.978 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-20T21:54:00.006 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2535-g4ea72516-1jammy_all.deb ... 2024-05-20T21:54:00.036 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:00.287 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-20T21:54:00.315 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-20T21:54:00.353 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-20T21:54:00.356 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-20T21:54:00.384 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-20T21:54:00.422 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-20T21:54:00.658 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-sklearn. 2024-05-20T21:54:00.686 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-20T21:54:00.725 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-20T21:54:00.767 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-20T21:54:00.795 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-20T21:54:00.834 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-20T21:54:01.069 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package jq. 2024-05-20T21:54:01.086 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-20T21:54:01.119 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-20T21:54:01.330 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package socat. 2024-05-20T21:54:01.347 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-20T21:54:01.389 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-20T21:54:01.425 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-20T21:54:01.453 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2535-g4ea72516-1jammy_all.deb ... 2024-05-20T21:54:01.577 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:01.828 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package xmlstarlet. 2024-05-20T21:54:01.855 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-20T21:54:01.894 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-20T21:54:02.214 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-test. 2024-05-20T21:54:02.228 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:54:02.264 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-test (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:02.497 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cachetools. 2024-05-20T21:54:02.513 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-20T21:54:02.547 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-20T21:54:02.817 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-20T21:54:02.844 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-20T21:54:02.883 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-20T21:54:03.211 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-20T21:54:03.239 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-20T21:54:03.278 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-20T21:54:03.589 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rsa. 2024-05-20T21:54:03.617 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-20T21:54:03.655 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-20T21:54:03.951 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-google-auth. 2024-05-20T21:54:03.979 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-20T21:54:04.017 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-20T21:54:04.320 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-20T21:54:04.337 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-20T21:54:04.370 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-20T21:54:04.477 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-volume. 2024-05-20T21:54:04.505 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2535-g4ea72516-1jammy_all.deb ... 2024-05-20T21:54:04.543 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-volume (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:04.632 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-websocket. 2024-05-20T21:54:04.659 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-20T21:54:04.690 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-20T21:54:04.797 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-20T21:54:04.813 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:54:04.847 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libcephfs-dev (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:04.985 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-20T21:54:05.014 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-20T21:54:05.051 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-20T21:54:05.159 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-20T21:54:05.187 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-20T21:54:05.225 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-20T21:54:05.563 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-20T21:54:05.591 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-20T21:54:05.629 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-20T21:54:05.715 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-20T21:54:05.732 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2535-g4ea72516-1jammy_all.deb ... 2024-05-20T21:54:05.765 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:05.958 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package nvme-cli. 2024-05-20T21:54:05.986 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-20T21:54:06.016 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-20T21:54:06.068 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-20T21:54:06.096 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-20T21:54:06.134 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-20T21:54:06.372 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package pkg-config. 2024-05-20T21:54:06.388 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-20T21:54:06.421 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-20T21:54:06.471 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-20T21:54:06.499 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-20T21:54:06.537 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-20T21:54:06.691 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-20T21:54:06.707 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-20T21:54:06.741 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-20T21:54:06.798 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package jq. 2024-05-20T21:54:06.815 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-20T21:54:06.856 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-20T21:54:07.076 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package socat. 2024-05-20T21:54:07.089 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-20T21:54:07.117 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-20T21:54:07.161 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-20T21:54:07.177 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-20T21:54:07.219 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-20T21:54:07.388 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package xmlstarlet. 2024-05-20T21:54:07.415 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-20T21:54:07.454 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-20T21:54:07.747 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pastescript. 2024-05-20T21:54:07.775 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-20T21:54:07.804 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-20T21:54:07.817 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-test. 2024-05-20T21:54:07.833 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:54:07.874 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-test (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:08.075 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pluggy. 2024-05-20T21:54:08.102 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-20T21:54:08.141 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-20T21:54:08.453 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-psutil. 2024-05-20T21:54:08.481 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-20T21:54:08.519 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-20T21:54:08.865 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-py. 2024-05-20T21:54:08.892 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-20T21:54:08.930 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-20T21:54:09.267 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pygments. 2024-05-20T21:54:09.295 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-20T21:54:09.333 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-20T21:54:09.796 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-20T21:54:09.824 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-20T21:54:09.862 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-20T21:54:10.207 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-toml. 2024-05-20T21:54:10.235 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-20T21:54:10.273 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-20T21:54:10.329 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-volume. 2024-05-20T21:54:10.345 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2535-g4ea72516-1jammy_all.deb ... 2024-05-20T21:54:10.387 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-volume (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:10.576 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pytest. 2024-05-20T21:54:10.604 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-20T21:54:10.642 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-20T21:54:10.724 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-20T21:54:10.741 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:54:10.791 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libcephfs-dev (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:10.997 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-simplejson. 2024-05-20T21:54:11.024 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-20T21:54:11.061 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-20T21:54:11.062 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-20T21:54:11.088 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-20T21:54:11.127 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-20T21:54:11.332 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-20T21:54:11.360 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-20T21:54:11.398 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-20T21:54:11.456 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-20T21:54:11.484 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-20T21:54:11.539 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-20T21:54:11.868 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package nvme-cli. 2024-05-20T21:54:11.897 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-20T21:54:11.935 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-20T21:54:12.060 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package radosgw. 2024-05-20T21:54:12.086 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../116-radosgw_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:54:12.110 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking radosgw (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:12.590 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package pkg-config. 2024-05-20T21:54:12.615 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-20T21:54:12.648 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-20T21:54:12.893 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-20T21:54:12.909 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-20T21:54:12.951 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-20T21:54:13.122 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package rbd-fuse. 2024-05-20T21:54:13.138 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:54:13.171 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking rbd-fuse (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:13.372 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-20T21:54:13.399 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-20T21:54:13.429 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-20T21:54:13.459 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-20T21:54:13.710 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-20T21:54:13.715 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pastescript. 2024-05-20T21:54:13.743 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-20T21:54:13.781 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-20T21:54:13.861 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-20T21:54:14.102 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pluggy. 2024-05-20T21:54:14.123 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-20T21:54:14.130 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-20T21:54:14.168 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-20T21:54:14.463 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-psutil. 2024-05-20T21:54:14.465 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-20T21:54:14.491 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-20T21:54:14.529 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-20T21:54:14.853 INFO:teuthology.orchestra.run.smithi145.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-20T21:54:14.882 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-py. 2024-05-20T21:54:14.910 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-20T21:54:14.912 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up cephadm (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:14.948 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-20T21:54:15.227 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pygments. 2024-05-20T21:54:15.256 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-20T21:54:15.285 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-20T21:54:15.430 INFO:teuthology.orchestra.run.smithi145.stdout:Adding system user cephadm....done 2024-05-20T21:54:15.577 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-20T21:54:15.764 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-20T21:54:15.793 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-20T21:54:15.830 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-20T21:54:15.845 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-20T21:54:16.088 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-20T21:54:16.134 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-toml. 2024-05-20T21:54:16.162 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-20T21:54:16.200 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-20T21:54:16.214 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-20T21:54:16.465 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-20T21:54:16.503 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pytest. 2024-05-20T21:54:16.531 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-20T21:54:16.569 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-20T21:54:16.733 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-20T21:54:16.859 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-20T21:54:16.923 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-simplejson. 2024-05-20T21:54:16.951 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-20T21:54:16.989 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-20T21:54:17.169 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-20T21:54:17.266 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-20T21:54:17.295 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-20T21:54:17.342 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-20T21:54:17.513 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-20T21:54:17.747 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-20T21:54:18.015 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-20T21:54:18.029 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package radosgw. 2024-05-20T21:54:18.046 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../116-radosgw_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:54:18.087 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking radosgw (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:18.278 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-20T21:54:18.543 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-20T21:54:18.794 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-20T21:54:18.940 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package rbd-fuse. 2024-05-20T21:54:18.957 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2535-g4ea72516-1jammy_amd64.deb ... 2024-05-20T21:54:18.998 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking rbd-fuse (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:19.028 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-ceph-argparse (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:19.287 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-20T21:54:19.287 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-20T21:54:19.472 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-20T21:54:19.545 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-20T21:54:19.573 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-20T21:54:19.671 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-20T21:54:19.690 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-20T21:54:19.928 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-20T21:54:19.950 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-20T21:54:20.258 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-20T21:54:20.355 INFO:teuthology.orchestra.run.smithi145.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-20T21:54:20.389 INFO:teuthology.orchestra.run.smithi145.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-20T21:54:20.453 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-20T21:54:20.571 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-20T21:54:20.685 INFO:teuthology.orchestra.run.smithi050.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-20T21:54:20.807 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephadm (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:20.935 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-20T21:54:21.040 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-20T21:54:21.307 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-20T21:54:21.575 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-20T21:54:21.885 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up zip (3.0-12build2) ... 2024-05-20T21:54:21.919 INFO:teuthology.orchestra.run.smithi050.stdout:Adding system user cephadm....done 2024-05-20T21:54:22.011 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-20T21:54:22.140 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-20T21:54:22.514 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-20T21:54:22.713 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-20T21:54:22.942 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-20T21:54:22.947 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-20T21:54:23.048 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-20T21:54:23.068 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-20T21:54:23.166 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-20T21:54:23.319 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-20T21:54:23.459 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-20T21:54:23.587 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-20T21:54:23.713 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-20T21:54:23.843 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-20T21:54:24.094 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-20T21:54:24.098 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-20T21:54:24.470 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-20T21:54:24.483 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-20T21:54:24.764 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-20T21:54:24.818 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-20T21:54:25.082 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-20T21:54:25.127 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-20T21:54:25.333 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-20T21:54:25.362 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-20T21:54:25.459 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-ceph-common (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:25.621 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-20T21:54:25.785 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-idna (3.3-1) ... 2024-05-20T21:54:25.881 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-20T21:54:26.111 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-20T21:54:26.140 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-ceph-argparse (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:26.408 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-20T21:54:26.526 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-20T21:54:26.627 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-20T21:54:26.744 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-20T21:54:27.012 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-20T21:54:27.275 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-20T21:54:27.414 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-20T21:54:27.518 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-20T21:54:27.594 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-20T21:54:27.641 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-20T21:54:27.652 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-20T21:54:27.912 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-20T21:54:28.013 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-20T21:54:28.147 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-20T21:54:28.158 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-20T21:54:28.535 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-20T21:54:28.644 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-20T21:54:28.674 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-20T21:54:28.903 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-20T21:54:28.942 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-20T21:54:29.154 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-20T21:54:29.192 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-20T21:54:29.319 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-20T21:54:29.481 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up zip (3.0-12build2) ... 2024-05-20T21:54:29.607 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-20T21:54:29.611 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-20T21:54:29.846 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-20T21:54:30.089 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-20T21:54:30.309 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-20T21:54:30.340 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-20T21:54:30.568 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-20T21:54:30.608 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-20T21:54:30.680 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-20T21:54:30.778 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-20T21:54:30.868 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-20T21:54:30.993 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-20T21:54:31.063 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-20T21:54:31.269 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-20T21:54:31.370 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-20T21:54:31.464 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-20T21:54:31.638 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-20T21:54:31.715 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-20T21:54:31.931 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-20T21:54:32.117 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-20T21:54:32.182 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-20T21:54:32.316 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-20T21:54:32.418 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-20T21:54:32.442 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-20T21:54:32.532 INFO:teuthology.orchestra.run.smithi145.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-20T21:54:32.761 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-20T21:54:32.777 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-20T21:54:32.895 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-20T21:54:33.020 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-20T21:54:33.180 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-ceph-common (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:33.288 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-20T21:54:33.506 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-idna (3.3-1) ... 2024-05-20T21:54:33.531 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-20T21:54:33.657 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-20T21:54:33.841 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-20T21:54:33.925 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-20T21:54:34.050 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-20T21:54:34.377 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-20T21:54:34.686 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-20T21:54:34.929 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-20T21:54:35.038 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-20T21:54:35.055 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-20T21:54:35.306 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-20T21:54:35.315 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-20T21:54:35.449 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-20T21:54:35.574 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-20T21:54:35.725 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-20T21:54:35.851 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-20T21:54:35.927 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-20T21:54:35.977 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-20T21:54:36.270 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-20T21:54:36.303 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-20T21:54:36.538 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-20T21:54:36.588 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-20T21:54:36.781 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-20T21:54:36.882 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-20T21:54:36.941 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-20T21:54:37.067 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up librados2 (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:37.167 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-20T21:54:37.193 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:37.319 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-20T21:54:37.426 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-20T21:54:37.597 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libcephfs2 (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:37.702 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-20T21:54:37.723 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libradosstriper1 (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:37.858 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-20T21:54:37.970 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-20T21:54:38.159 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up librbd1 (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:38.237 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-20T21:54:38.285 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mgr-modules-core (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:38.436 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-fuse (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:38.514 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-20T21:54:38.615 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-20T21:54:38.646 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-20T21:54:38.647 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-20T21:54:38.882 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-20T21:54:39.000 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-20T21:54:39.121 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libcephfs-dev (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:39.247 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-rados (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:39.285 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-20T21:54:39.373 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up librgw2 (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:39.508 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-20T21:54:39.628 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-20T21:54:39.895 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-20T21:54:40.022 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-20T21:54:40.147 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-20T21:54:40.238 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-20T21:54:40.474 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-20T21:54:40.609 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-20T21:54:40.711 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-rbd (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:40.812 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up rbd-fuse (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:40.913 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-rgw (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:41.002 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-20T21:54:41.031 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-cephfs (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:41.158 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-common (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:41.286 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-20T21:54:41.413 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-20T21:54:41.672 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-20T21:54:41.674 INFO:teuthology.orchestra.run.smithi145.stdout:Adding group ceph....done 2024-05-20T21:54:41.798 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-20T21:54:42.068 INFO:teuthology.orchestra.run.smithi145.stdout:Adding system user ceph....done 2024-05-20T21:54:42.107 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-20T21:54:42.237 INFO:teuthology.orchestra.run.smithi145.stdout:Setting system user ceph properties....done 2024-05-20T21:54:42.254 INFO:teuthology.orchestra.run.smithi145.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-20T21:54:42.395 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-20T21:54:42.433 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-20T21:54:42.718 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-20T21:54:42.730 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-20T21:54:42.836 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-20T21:54:43.120 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-20T21:54:43.201 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-test (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:43.326 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up radosgw (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:43.397 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-20T21:54:43.783 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-20T21:54:43.825 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-20T21:54:43.825 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-20T21:54:44.159 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-20T21:54:44.286 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-base (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:44.436 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-20T21:54:44.646 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-20T21:54:44.780 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-20T21:54:44.906 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librados2 (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:45.032 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:45.104 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mds (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:45.158 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-20T21:54:45.327 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-20T21:54:45.327 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-20T21:54:45.478 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libcephfs2 (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:45.603 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libradosstriper1 (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:45.729 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-20T21:54:45.790 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mgr (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:46.006 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librbd1 (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:46.009 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-20T21:54:46.009 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-20T21:54:46.132 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-modules-core (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:46.258 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-fuse (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:46.477 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-20T21:54:46.477 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-20T21:54:46.491 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-osd (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:46.773 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-20T21:54:46.773 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-20T21:54:46.978 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libcephfs-dev (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:47.104 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rados (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:47.231 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librgw2 (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:47.243 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:47.356 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-20T21:54:47.369 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:47.504 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mon (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:47.711 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-20T21:54:47.711 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-20T21:54:48.146 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mgr-cephadm (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:48.281 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:48.415 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mgr-dashboard (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:48.566 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-volume (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:48.594 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rbd (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:48.720 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up rbd-fuse (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:48.846 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rgw (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:48.955 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cephfs (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:49.065 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-common (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:49.257 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-20T21:54:49.383 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-20T21:54:49.535 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-20T21:54:49.566 INFO:teuthology.orchestra.run.smithi050.stdout:Adding group ceph....done 2024-05-20T21:54:49.935 INFO:teuthology.orchestra.run.smithi050.stdout:Adding system user ceph....done 2024-05-20T21:54:50.103 INFO:teuthology.orchestra.run.smithi050.stdout:Setting system user ceph properties....done 2024-05-20T21:54:50.115 INFO:teuthology.orchestra.run.smithi050.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-20T21:54:50.265 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-20T21:54:50.572 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-20T21:54:50.611 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-20T21:54:51.058 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-test (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:51.184 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up radosgw (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:51.255 INFO:teuthology.orchestra.run.smithi145.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-20T21:54:51.261 DEBUG:teuthology.parallel:result is None 2024-05-20T21:54:51.674 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-20T21:54:51.675 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-20T21:54:52.128 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-base (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:52.502 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-20T21:54:52.980 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mds (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:53.196 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-20T21:54:53.196 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-20T21:54:53.665 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:53.892 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-20T21:54:53.892 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-20T21:54:54.391 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-osd (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:54.672 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-20T21:54:54.672 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-20T21:54:55.168 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:55.294 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:55.446 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mon (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:55.664 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-20T21:54:55.665 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-20T21:54:56.155 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-cephadm (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:56.290 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:56.415 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-dashboard (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:56.567 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-volume (19.0.0-2535-g4ea72516-1jammy) ... 2024-05-20T21:54:56.920 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-20T21:54:57.012 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-20T21:54:57.156 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-20T21:54:58.249 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-20T21:54:58.929 INFO:teuthology.orchestra.run.smithi050.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-20T21:54:58.934 DEBUG:teuthology.parallel:result is None 2024-05-20T21:54:58.935 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4ea7251640d7dc85322163e97efba46b50b07648 2024-05-20T21:54:59.086 DEBUG:teuthology.orchestra.run.smithi050:> dpkg-query -W -f '${Version}' ceph 2024-05-20T21:54:59.106 INFO:teuthology.orchestra.run.smithi050.stdout:19.0.0-2535-g4ea72516-1jammy 2024-05-20T21:54:59.106 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2535-g4ea72516-1jammy 2024-05-20T21:54:59.107 INFO:teuthology.task.install:The correct ceph version 19.0.0-2535-g4ea72516-1jammy is installed. 2024-05-20T21:54:59.109 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4ea7251640d7dc85322163e97efba46b50b07648 2024-05-20T21:54:59.252 DEBUG:teuthology.orchestra.run.smithi145:> dpkg-query -W -f '${Version}' ceph 2024-05-20T21:54:59.271 INFO:teuthology.orchestra.run.smithi145.stdout:19.0.0-2535-g4ea72516-1jammy 2024-05-20T21:54:59.271 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2535-g4ea72516-1jammy 2024-05-20T21:54:59.271 INFO:teuthology.task.install:The correct ceph version 19.0.0-2535-g4ea72516-1jammy is installed. 2024-05-20T21:54:59.273 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-20T21:54:59.274 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-20T21:54:59.274 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-20T21:54:59.289 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-05-20T21:54:59.289 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-20T21:54:59.329 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-20T21:54:59.330 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-20T21:54:59.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2024-05-20T21:54:59.344 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-20T21:54:59.400 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-05-20T21:54:59.401 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/daemon-helper 2024-05-20T21:54:59.414 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-20T21:54:59.467 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-20T21:54:59.467 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-20T21:54:59.467 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-20T21:54:59.481 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-20T21:54:59.536 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-05-20T21:54:59.537 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-20T21:54:59.549 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-20T21:54:59.603 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-20T21:54:59.603 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-20T21:54:59.603 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2024-05-20T21:54:59.618 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-20T21:54:59.674 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-05-20T21:54:59.674 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/stdin-killer 2024-05-20T21:54:59.687 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-20T21:54:59.739 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-20T21:54:59.846 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client': {'debug ms': 1}, 'global': {'mon election default strategy': 3, 'ms bind msgr2': False, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'log-only-match': ['CEPHADM_'], 'mon_bind_msgr2': False, 'sha1': '4ea7251640d7dc85322163e97efba46b50b07648', 'cephadm_mode': 'root', 'image': 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9'} 2024-05-20T21:54:59.846 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 2024-05-20T21:54:59.847 INFO:tasks.cephadm:Cluster fsid is 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:54:59.847 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-20T21:54:59.847 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '[v1:172.21.15.50:6789]', 'mon.c': '[v1:172.21.15.50:6790]', 'mon.b': '[v1:172.21.15.145:6789]'} 2024-05-20T21:54:59.847 INFO:tasks.cephadm:First mon is mon.a on smithi050 2024-05-20T21:54:59.847 INFO:tasks.cephadm:First mgr is y 2024-05-20T21:54:59.847 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-20T21:54:59.848 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname $(hostname -s) 2024-05-20T21:54:59.865 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname $(hostname -s) 2024-05-20T21:54:59.879 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-20T21:54:59.879 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4ea7251640d7dc85322163e97efba46b50b07648 2024-05-20T21:55:00.095 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '4ea7251640d7dc85322163e97efba46b50b07648', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic/79352/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-2535-g4ea72516', 'node_name': '172.21.2.17+braggi17', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-2535-g4ea72516-1jammy'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default/', 'distro_codename': 'jammy', 'modified': '2024-05-13 21:50:24.309271', 'distro_version': '22.04', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid-release', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/flavors/default/', 'archs': ['x86_64'], 'distro': 'ubuntu'}] 2024-05-20T21:55:00.313 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid-release, sha1 4ea7251640d7dc85322163e97efba46b50b07648 from https://shaman.ceph.com/api/search/?project=ceph&distros=ubuntu%2F22.04%2Fx86_64&flavor=default&sha1=4ea7251640d7dc85322163e97efba46b50b07648 2024-05-20T21:55:00.314 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/x86_64/flavors/default/cephadm 2024-05-20T21:55:00.314 DEBUG:teuthology.orchestra.run.smithi050:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-20T21:55:01.083 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-rw-r-- 1 ubuntu ubuntu 789190 May 20 21:55 /home/ubuntu/cephtest/cephadm 2024-05-20T21:55:01.084 DEBUG:teuthology.orchestra.run.smithi145:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid-release/4ea7251640d7dc85322163e97efba46b50b07648/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-20T21:55:02.109 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-rw-r-- 1 ubuntu ubuntu 789190 May 20 21:55 /home/ubuntu/cephtest/cephadm 2024-05-20T21:55:02.109 DEBUG:teuthology.orchestra.run.smithi050:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-20T21:55:02.120 DEBUG:teuthology.orchestra.run.smithi145:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-20T21:55:02.144 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 on all hosts... 2024-05-20T21:55:02.144 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 pull 2024-05-20T21:55:02.168 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 pull 2024-05-20T21:55:02.339 INFO:teuthology.orchestra.run.smithi145.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9... 2024-05-20T21:55:02.340 INFO:teuthology.orchestra.run.smithi050.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9... 2024-05-20T21:55:59.358 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-05-20T21:55:59.359 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 19.0.0-2536-g200b2779 (200b27799814c89893ec6700f852fc40163e03d5) squid (dev)", 2024-05-20T21:55:59.359 INFO:teuthology.orchestra.run.smithi050.stdout: "image_id": "6942493d5398ba1744ec8e88f25d807fc19e2b31cf4130189ef0c0c152e311c4", 2024-05-20T21:55:59.359 INFO:teuthology.orchestra.run.smithi050.stdout: "repo_digests": [ 2024-05-20T21:55:59.359 INFO:teuthology.orchestra.run.smithi050.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a5c9170c7ae3d9f617155d284e34bb385be5567892107c64d3eb2a0bbcaa9278" 2024-05-20T21:55:59.359 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-05-20T21:55:59.359 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-05-20T21:56:08.275 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-05-20T21:56:08.276 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_version": "ceph version 19.0.0-2536-g200b2779 (200b27799814c89893ec6700f852fc40163e03d5) squid (dev)", 2024-05-20T21:56:08.276 INFO:teuthology.orchestra.run.smithi145.stdout: "image_id": "6942493d5398ba1744ec8e88f25d807fc19e2b31cf4130189ef0c0c152e311c4", 2024-05-20T21:56:08.276 INFO:teuthology.orchestra.run.smithi145.stdout: "repo_digests": [ 2024-05-20T21:56:08.276 INFO:teuthology.orchestra.run.smithi145.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a5c9170c7ae3d9f617155d284e34bb385be5567892107c64d3eb2a0bbcaa9278" 2024-05-20T21:56:08.276 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-05-20T21:56:08.276 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-05-20T21:56:08.324 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph 2024-05-20T21:56:08.339 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /etc/ceph 2024-05-20T21:56:08.353 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /etc/ceph 2024-05-20T21:56:08.395 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 777 /etc/ceph 2024-05-20T21:56:08.407 INFO:tasks.cephadm:Writing seed config... 2024-05-20T21:56:08.409 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-20T21:56:08.409 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-20T21:56:08.409 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-20T21:56:08.409 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2024-05-20T21:56:08.409 INFO:tasks.cephadm: override: [global] ms bind msgr2 = False 2024-05-20T21:56:08.409 INFO:tasks.cephadm: override: [global] ms type = async 2024-05-20T21:56:08.409 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-20T21:56:08.409 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-20T21:56:08.409 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-20T21:56:08.410 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-05-20T21:56:08.410 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-20T21:56:08.410 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-20T21:56:08.410 INFO:tasks.cephadm: override: [osd] osd class default list = * 2024-05-20T21:56:08.410 INFO:tasks.cephadm: override: [osd] osd class load list = * 2024-05-20T21:56:08.410 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-20T21:56:08.411 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-20T21:56:08.411 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-20T21:56:08.444 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 9a9abba0-16f3-11ef-bc9a-c7b262605968 mon election default strategy = 3 ms bind msgr2 = False ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd class default list = * osd class load list = * [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2024-05-20T21:56:08.444 DEBUG:teuthology.orchestra.run.smithi050:mon.a> sudo journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mon.a.service 2024-05-20T21:56:08.489 DEBUG:teuthology.orchestra.run.smithi050:mgr.y> sudo journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mgr.y.service 2024-05-20T21:56:08.532 INFO:tasks.cephadm:Bootstrapping... 2024-05-20T21:56:08.532 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 -v bootstrap --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.50:6789]' --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-20T21:56:08.746 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-05-20T21:56:08.746 INFO:teuthology.orchestra.run.smithi050.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9', '-v', 'bootstrap', '--fsid', '9a9abba0-16f3-11ef-bc9a-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-addrv', '[v1:172.21.15.50:6789]', '--skip-admin-label'] 2024-05-20T21:56:08.746 INFO:teuthology.orchestra.run.smithi050.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-20T21:56:08.747 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying podman|docker is present... 2024-05-20T21:56:08.747 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying lvm2 is present... 2024-05-20T21:56:08.747 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying time synchronization is in place... 2024-05-20T21:56:08.751 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-20T21:56:08.751 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-20T21:56:08.755 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-20T21:56:08.755 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-05-20T21:56:08.759 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-05-20T21:56:08.759 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-05-20T21:56:08.763 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-05-20T21:56:08.763 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-05-20T21:56:08.767 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-05-20T21:56:08.767 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout masked 2024-05-20T21:56:08.771 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-05-20T21:56:08.771 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-05-20T21:56:08.775 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-05-20T21:56:08.775 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-05-20T21:56:08.779 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-05-20T21:56:08.779 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-05-20T21:56:08.783 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout enabled 2024-05-20T21:56:08.788 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout active 2024-05-20T21:56:08.788 INFO:teuthology.orchestra.run.smithi050.stdout:Unit ntp.service is enabled and running 2024-05-20T21:56:08.788 INFO:teuthology.orchestra.run.smithi050.stdout:Repeating the final host check... 2024-05-20T21:56:08.788 INFO:teuthology.orchestra.run.smithi050.stdout:docker (/usr/bin/docker) is present 2024-05-20T21:56:08.788 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl is present 2024-05-20T21:56:08.788 INFO:teuthology.orchestra.run.smithi050.stdout:lvcreate is present 2024-05-20T21:56:08.792 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-20T21:56:08.792 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-20T21:56:08.795 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-20T21:56:08.795 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-05-20T21:56:08.799 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-05-20T21:56:08.799 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-05-20T21:56:08.803 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-05-20T21:56:08.803 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-05-20T21:56:08.807 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-05-20T21:56:08.807 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout masked 2024-05-20T21:56:08.810 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-05-20T21:56:08.811 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-05-20T21:56:08.814 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-05-20T21:56:08.814 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-05-20T21:56:08.818 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-05-20T21:56:08.818 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-05-20T21:56:08.822 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout enabled 2024-05-20T21:56:08.826 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout active 2024-05-20T21:56:08.827 INFO:teuthology.orchestra.run.smithi050.stdout:Unit ntp.service is enabled and running 2024-05-20T21:56:08.827 INFO:teuthology.orchestra.run.smithi050.stdout:Host looks OK 2024-05-20T21:56:08.827 INFO:teuthology.orchestra.run.smithi050.stdout:Cluster fsid: 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:56:08.827 INFO:teuthology.orchestra.run.smithi050.stdout:Acquiring lock 140485253772336 on /run/cephadm/9a9abba0-16f3-11ef-bc9a-c7b262605968.lock 2024-05-20T21:56:08.827 INFO:teuthology.orchestra.run.smithi050.stdout:Lock 140485253772336 acquired on /run/cephadm/9a9abba0-16f3-11ef-bc9a-c7b262605968.lock 2024-05-20T21:56:08.827 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying IP 172.21.15.50 port 6789 ... 2024-05-20T21:56:08.827 INFO:teuthology.orchestra.run.smithi050.stdout:Base mon IP(s) is [172.21.15.50:6789], mon addrv is [v1:172.21.15.50:6789] 2024-05-20T21:56:08.829 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 2024-05-20T21:56:08.830 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/sbin/ip: stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2024-05-20T21:56:08.830 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.50 2024-05-20T21:56:08.832 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-20T21:56:08.832 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-05-20T21:56:08.832 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1787sec hoplimit 64 pref medium 2024-05-20T21:56:08.834 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-20T21:56:08.834 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-20T21:56:08.834 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-20T21:56:08.834 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/sbin/ip: stdout 2: ens1f0: mtu 1500 state UP qlen 1000 2024-05-20T21:56:08.834 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-05-20T21:56:08.834 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-20T21:56:08.835 INFO:teuthology.orchestra.run.smithi050.stdout:Mon IP `172.21.15.50` is in CIDR network `172.21.0.0/20` 2024-05-20T21:56:08.835 INFO:teuthology.orchestra.run.smithi050.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20'] 2024-05-20T21:56:08.835 INFO:teuthology.orchestra.run.smithi050.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-20T21:56:08.836 INFO:teuthology.orchestra.run.smithi050.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9... 2024-05-20T21:56:09.040 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/docker: stdout 200b27799814c89893ec6700f852fc40163e03d5-centos9: Pulling from ceph-ci/ceph 2024-05-20T21:56:09.041 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/docker: stdout Digest: sha256:a5c9170c7ae3d9f617155d284e34bb385be5567892107c64d3eb2a0bbcaa9278 2024-05-20T21:56:09.041 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/docker: stdout Status: Image is up to date for quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 2024-05-20T21:56:09.041 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/docker: stdout quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 2024-05-20T21:56:10.377 INFO:teuthology.orchestra.run.smithi050.stdout:ceph: stdout ceph version 19.0.0-2536-g200b2779 (200b27799814c89893ec6700f852fc40163e03d5) squid (dev) 2024-05-20T21:56:10.377 INFO:teuthology.orchestra.run.smithi050.stdout:Ceph version: ceph version 19.0.0-2536-g200b2779 (200b27799814c89893ec6700f852fc40163e03d5) squid (dev) 2024-05-20T21:56:10.377 INFO:teuthology.orchestra.run.smithi050.stdout:Extracting ceph user uid/gid from container image... 2024-05-20T21:56:11.539 INFO:teuthology.orchestra.run.smithi050.stdout:stat: stdout 167 167 2024-05-20T21:56:11.540 INFO:teuthology.orchestra.run.smithi050.stdout:Creating initial keys... 2024-05-20T21:56:12.694 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-authtool: stdout AQD8xktmScBIDRAARjd9bvI2Oz8g2jYt0gkyug== 2024-05-20T21:56:13.826 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-authtool: stdout AQD9xktmLFppExAAwDZ76l9ATQ0ZobYhU6DgIQ== 2024-05-20T21:56:15.022 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-authtool: stdout AQD+xktmxU0KIBAAINe+bIgHaWHNQCuDBHxJjg== 2024-05-20T21:56:15.023 INFO:teuthology.orchestra.run.smithi050.stdout:Creating initial monmap... 2024-05-20T21:56:16.211 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-20T21:56:16.211 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-05-20T21:56:16.211 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:56:16.211 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-20T21:56:16.211 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool for a [v1:172.21.15.50:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-20T21:56:16.211 INFO:teuthology.orchestra.run.smithi050.stdout:setting min_mon_release = quincy 2024-05-20T21:56:16.211 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: set fsid to 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:56:16.212 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-20T21:56:16.212 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-20T21:56:16.213 INFO:teuthology.orchestra.run.smithi050.stdout:Creating mon... 2024-05-20T21:56:17.459 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.936+0000 7fb236917b00 0 set uid:gid to 167:167 (ceph:ceph) 2024-05-20T21:56:17.459 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.936+0000 7fb236917b00 1 imported monmap: 2024-05-20T21:56:17.459 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr epoch 0 2024-05-20T21:56:17.459 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:56:17.459 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr last_changed 2024-05-20T21:56:15.715764+0000 2024-05-20T21:56:17.459 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr created 2024-05-20T21:56:15.715764+0000 2024-05-20T21:56:17.461 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr min_mon_release 17 (quincy) 2024-05-20T21:56:17.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr election_strategy: 1 2024-05-20T21:56:17.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 0: v1:172.21.15.50:6789/0 mon.a 2024-05-20T21:56:17.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 2024-05-20T21:56:17.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.936+0000 7fb236917b00 0 /usr/bin/ceph-mon: set fsid to 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:56:17.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: RocksDB version: 7.9.2 2024-05-20T21:56:17.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 2024-05-20T21:56:17.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Git sha 0 2024-05-20T21:56:17.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Compile date 2024-05-20 18:35:26 2024-05-20T21:56:17.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: DB SUMMARY 2024-05-20T21:56:17.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 2024-05-20T21:56:17.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: DB Session ID: TDOGG7UPMQMWWE5VAWMK 2024-05-20T21:56:17.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 2024-05-20T21:56:17.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-05-20T21:56:17.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 2024-05-20T21:56:17.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-05-20T21:56:17.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 2024-05-20T21:56:17.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.error_if_exists: 0 2024-05-20T21:56:17.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.create_if_missing: 1 2024-05-20T21:56:17.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.paranoid_checks: 1 2024-05-20T21:56:17.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-05-20T21:56:17.468 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-20T21:56:17.469 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-20T21:56:17.469 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.env: 0x556a65010740 2024-05-20T21:56:17.469 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.fs: PosixFileSystem 2024-05-20T21:56:17.469 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.info_log: 0x556a6724c5a0 2024-05-20T21:56:17.469 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_file_opening_threads: 16 2024-05-20T21:56:17.469 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.statistics: (nil) 2024-05-20T21:56:17.469 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.use_fsync: 0 2024-05-20T21:56:17.469 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_log_file_size: 0 2024-05-20T21:56:17.469 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-20T21:56:17.469 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.log_file_time_to_roll: 0 2024-05-20T21:56:17.469 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.keep_log_file_num: 1000 2024-05-20T21:56:17.469 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.recycle_log_file_num: 0 2024-05-20T21:56:17.470 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.allow_fallocate: 1 2024-05-20T21:56:17.470 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.allow_mmap_reads: 0 2024-05-20T21:56:17.470 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.allow_mmap_writes: 0 2024-05-20T21:56:17.470 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.use_direct_reads: 0 2024-05-20T21:56:17.470 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-20T21:56:17.470 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.create_missing_column_families: 0 2024-05-20T21:56:17.470 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.db_log_dir: 2024-05-20T21:56:17.470 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.wal_dir: 2024-05-20T21:56:17.470 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.table_cache_numshardbits: 6 2024-05-20T21:56:17.470 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-05-20T21:56:17.470 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-05-20T21:56:17.470 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-20T21:56:17.470 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-20T21:56:17.471 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-05-20T21:56:17.471 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.advise_random_on_open: 1 2024-05-20T21:56:17.471 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.db_write_buffer_size: 0 2024-05-20T21:56:17.471 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.write_buffer_manager: 0x556a672535e0 2024-05-20T21:56:17.471 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-20T21:56:17.471 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-20T21:56:17.471 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.use_adaptive_mutex: 0 2024-05-20T21:56:17.471 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.rate_limiter: (nil) 2024-05-20T21:56:17.471 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-20T21:56:17.471 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.wal_recovery_mode: 2 2024-05-20T21:56:17.471 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.enable_thread_tracking: 0 2024-05-20T21:56:17.471 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.enable_pipelined_write: 0 2024-05-20T21:56:17.471 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.unordered_write: 0 2024-05-20T21:56:17.471 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-20T21:56:17.472 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-20T21:56:17.472 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-20T21:56:17.472 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-20T21:56:17.472 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.row_cache: None 2024-05-20T21:56:17.472 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.wal_filter: None 2024-05-20T21:56:17.472 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-20T21:56:17.472 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.allow_ingest_behind: 0 2024-05-20T21:56:17.472 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.two_write_queues: 0 2024-05-20T21:56:17.472 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.manual_wal_flush: 0 2024-05-20T21:56:17.472 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.wal_compression: 0 2024-05-20T21:56:17.472 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.atomic_flush: 0 2024-05-20T21:56:17.472 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-20T21:56:17.472 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.persist_stats_to_disk: 0 2024-05-20T21:56:17.473 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-05-20T21:56:17.473 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.log_readahead_size: 0 2024-05-20T21:56:17.473 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-20T21:56:17.473 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.best_efforts_recovery: 0 2024-05-20T21:56:17.473 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-20T21:56:17.473 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-20T21:56:17.473 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.allow_data_in_errors: 0 2024-05-20T21:56:17.490 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.db_host_id: __hostname__ 2024-05-20T21:56:17.491 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.enforce_single_del_contracts: true 2024-05-20T21:56:17.491 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_background_jobs: 2 2024-05-20T21:56:17.491 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_background_compactions: -1 2024-05-20T21:56:17.491 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_subcompactions: 1 2024-05-20T21:56:17.491 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-20T21:56:17.491 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-20T21:56:17.491 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.delayed_write_rate : 16777216 2024-05-20T21:56:17.491 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_total_wal_size: 0 2024-05-20T21:56:17.491 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-20T21:56:17.491 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.stats_dump_period_sec: 600 2024-05-20T21:56:17.491 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.stats_persist_period_sec: 600 2024-05-20T21:56:17.491 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-20T21:56:17.492 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_open_files: -1 2024-05-20T21:56:17.492 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.bytes_per_sync: 0 2024-05-20T21:56:17.492 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-05-20T21:56:17.492 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-05-20T21:56:17.492 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compaction_readahead_size: 0 2024-05-20T21:56:17.492 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_background_flushes: -1 2024-05-20T21:56:17.492 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Compression algorithms supported: 2024-05-20T21:56:17.492 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: kZSTD supported: 0 2024-05-20T21:56:17.492 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: kXpressCompression supported: 0 2024-05-20T21:56:17.492 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: kBZip2Compression supported: 0 2024-05-20T21:56:17.492 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-20T21:56:17.492 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: kLZ4Compression supported: 1 2024-05-20T21:56:17.492 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: kZlibCompression supported: 1 2024-05-20T21:56:17.493 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: kLZ4HCCompression supported: 1 2024-05-20T21:56:17.493 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: kSnappyCompression supported: 1 2024-05-20T21:56:17.493 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-05-20T21:56:17.493 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-05-20T21:56:17.493 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: [db/db_impl/db_impl_open.cc:317] Creating manifest 1 2024-05-20T21:56:17.493 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 2024-05-20T21:56:17.493 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-05-20T21:56:17.493 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 2024-05-20T21:56:17.493 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-20T21:56:17.493 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 2024-05-20T21:56:17.493 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-20T21:56:17.493 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.merge_operator: 2024-05-20T21:56:17.493 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compaction_filter: None 2024-05-20T21:56:17.493 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compaction_filter_factory: None 2024-05-20T21:56:17.494 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.sst_partitioner_factory: None 2024-05-20T21:56:17.494 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-05-20T21:56:17.494 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.table_factory: BlockBasedTable 2024-05-20T21:56:17.494 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556a6724c2a0) 2024-05-20T21:56:17.494 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks: 1 2024-05-20T21:56:17.494 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks_with_high_priority: 0 2024-05-20T21:56:17.494 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-20T21:56:17.494 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr pin_top_level_index_and_filter: 1 2024-05-20T21:56:17.494 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr index_type: 0 2024-05-20T21:56:17.494 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr data_block_index_type: 0 2024-05-20T21:56:17.494 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr index_shortening: 1 2024-05-20T21:56:17.494 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr data_block_hash_table_util_ratio: 0.750000 2024-05-20T21:56:17.495 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr checksum: 4 2024-05-20T21:56:17.495 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr no_block_cache: 0 2024-05-20T21:56:17.495 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr block_cache: 0x556a6723b090 2024-05-20T21:56:17.495 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr block_cache_name: BinnedLRUCache 2024-05-20T21:56:17.495 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr block_cache_options: 2024-05-20T21:56:17.495 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr capacity : 536870912 2024-05-20T21:56:17.495 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr num_shard_bits : 4 2024-05-20T21:56:17.495 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr strict_capacity_limit : 0 2024-05-20T21:56:17.495 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr high_pri_pool_ratio: 0.000 2024-05-20T21:56:17.495 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr block_cache_compressed: (nil) 2024-05-20T21:56:17.495 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr persistent_cache: (nil) 2024-05-20T21:56:17.495 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr block_size: 4096 2024-05-20T21:56:17.495 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr block_size_deviation: 10 2024-05-20T21:56:17.495 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr block_restart_interval: 16 2024-05-20T21:56:17.496 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr index_block_restart_interval: 1 2024-05-20T21:56:17.496 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr metadata_block_size: 4096 2024-05-20T21:56:17.496 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr partition_filters: 0 2024-05-20T21:56:17.496 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr use_delta_encoding: 1 2024-05-20T21:56:17.496 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr filter_policy: bloomfilter 2024-05-20T21:56:17.496 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr whole_key_filtering: 1 2024-05-20T21:56:17.496 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr verify_compression: 0 2024-05-20T21:56:17.496 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr read_amp_bytes_per_bit: 0 2024-05-20T21:56:17.496 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr format_version: 5 2024-05-20T21:56:17.496 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr enable_index_compression: 1 2024-05-20T21:56:17.496 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr block_align: 0 2024-05-20T21:56:17.496 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr max_auto_readahead_size: 262144 2024-05-20T21:56:17.496 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr prepopulate_block_cache: 0 2024-05-20T21:56:17.496 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr initial_auto_readahead_size: 8192 2024-05-20T21:56:17.496 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr num_file_reads_for_auto_readahead: 2 2024-05-20T21:56:17.497 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 2024-05-20T21:56:17.497 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.write_buffer_size: 33554432 2024-05-20T21:56:17.497 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_write_buffer_number: 2 2024-05-20T21:56:17.497 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compression: NoCompression 2024-05-20T21:56:17.497 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.bottommost_compression: Disabled 2024-05-20T21:56:17.497 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.prefix_extractor: nullptr 2024-05-20T21:56:17.497 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-20T21:56:17.497 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.num_levels: 7 2024-05-20T21:56:17.497 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-20T21:56:17.497 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-20T21:56:17.497 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-20T21:56:17.497 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-20T21:56:17.497 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-20T21:56:17.497 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-20T21:56:17.498 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-20T21:56:17.498 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-20T21:56:17.498 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-20T21:56:17.498 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-20T21:56:17.498 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-20T21:56:17.498 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-20T21:56:17.498 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compression_opts.window_bits: -14 2024-05-20T21:56:17.498 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compression_opts.level: 32767 2024-05-20T21:56:17.498 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compression_opts.strategy: 0 2024-05-20T21:56:17.498 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-20T21:56:17.498 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-20T21:56:17.498 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-20T21:56:17.498 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-20T21:56:17.499 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compression_opts.enabled: false 2024-05-20T21:56:17.499 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-20T21:56:17.499 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-20T21:56:17.499 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-20T21:56:17.499 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-20T21:56:17.499 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.target_file_size_base: 67108864 2024-05-20T21:56:17.499 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.target_file_size_multiplier: 1 2024-05-20T21:56:17.499 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-20T21:56:17.499 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-20T21:56:17.499 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-20T21:56:17.499 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-20T21:56:17.499 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-20T21:56:17.499 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-20T21:56:17.499 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-20T21:56:17.500 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-20T21:56:17.500 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-20T21:56:17.500 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-20T21:56:17.500 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-20T21:56:17.500 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-20T21:56:17.500 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-20T21:56:17.500 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.arena_block_size: 1048576 2024-05-20T21:56:17.500 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-20T21:56:17.500 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-20T21:56:17.500 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.disable_auto_compactions: 0 2024-05-20T21:56:17.500 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-20T21:56:17.500 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-20T21:56:17.500 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-20T21:56:17.500 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-20T21:56:17.501 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-20T21:56:17.501 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-20T21:56:17.501 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-20T21:56:17.501 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-20T21:56:17.501 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-20T21:56:17.501 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-20T21:56:17.501 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.table_properties_collectors: 2024-05-20T21:56:17.501 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.inplace_update_support: 0 2024-05-20T21:56:17.501 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-05-20T21:56:17.502 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-20T21:56:17.502 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-20T21:56:17.502 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.memtable_huge_page_size: 0 2024-05-20T21:56:17.502 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.bloom_locality: 0 2024-05-20T21:56:17.502 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.max_successive_merges: 0 2024-05-20T21:56:17.502 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-05-20T21:56:17.502 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.paranoid_file_checks: 0 2024-05-20T21:56:17.502 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.force_consistency_checks: 1 2024-05-20T21:56:17.502 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.report_bg_io_stats: 0 2024-05-20T21:56:17.502 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.ttl: 2592000 2024-05-20T21:56:17.502 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-05-20T21:56:17.502 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-20T21:56:17.502 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-20T21:56:17.503 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.enable_blob_files: false 2024-05-20T21:56:17.503 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.min_blob_size: 0 2024-05-20T21:56:17.503 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.blob_file_size: 268435456 2024-05-20T21:56:17.503 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.blob_compression_type: NoCompression 2024-05-20T21:56:17.503 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-05-20T21:56:17.503 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-20T21:56:17.503 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-20T21:56:17.503 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-20T21:56:17.503 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.blob_file_starting_level: 0 2024-05-20T21:56:17.503 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-20T21:56:17.503 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-20T21:56:17.503 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 2024-05-20T21:56:17.503 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-20T21:56:17.504 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 2024-05-20T21:56:17.504 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 48c2ba9b-4e2c-44f7-acf6-8e041f8c8dcb 2024-05-20T21:56:17.504 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 2024-05-20T21:56:17.504 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.940+0000 7fb236917b00 4 rocksdb: [db/version_set.cc:5047] Creating manifest 5 2024-05-20T21:56:17.504 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 2024-05-20T21:56:17.504 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.944+0000 7fb236917b00 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556a67266e00 2024-05-20T21:56:17.504 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.944+0000 7fb236917b00 4 rocksdb: DB pointer 0x556a6733a000 2024-05-20T21:56:17.504 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.944+0000 7fb22e0a2640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-20T21:56:17.504 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.944+0000 7fb22e0a2640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-20T21:56:17.504 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr ** DB Stats ** 2024-05-20T21:56:17.504 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-05-20T21:56:17.504 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-20T21:56:17.504 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-20T21:56:17.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-20T21:56:17.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-20T21:56:17.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-20T21:56:17.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-20T21:56:17.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 2024-05-20T21:56:17.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-05-20T21:56:17.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-20T21:56:17.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-20T21:56:17.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-05-20T21:56:17.508 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-05-20T21:56:17.508 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 2024-05-20T21:56:17.508 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-05-20T21:56:17.508 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-20T21:56:17.508 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-20T21:56:17.508 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 2024-05-20T21:56:17.508 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-20T21:56:17.508 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 2024-05-20T21:56:17.508 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-05-20T21:56:17.508 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2024-05-20T21:56:17.508 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-05-20T21:56:17.508 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2024-05-20T21:56:17.509 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2024-05-20T21:56:17.509 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2024-05-20T21:56:17.509 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-20T21:56:17.509 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-20T21:56:17.509 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-20T21:56:17.509 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr Block cache BinnedLRUCache@0x556a6723b090#7 capacity: 512.00 MB usage: 0.00 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.7e-05 secs_since: 0 2024-05-20T21:56:17.509 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%) 2024-05-20T21:56:17.509 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 2024-05-20T21:56:17.509 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2024-05-20T21:56:17.509 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr 2024-05-20T21:56:17.509 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.944+0000 7fb236917b00 4 rocksdb: [db/db_impl/db_impl.cc:496] Shutdown: canceling all background work 2024-05-20T21:56:17.509 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.944+0000 7fb236917b00 4 rocksdb: [db/db_impl/db_impl.cc:704] Shutdown complete 2024-05-20T21:56:17.509 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-mon: stderr debug 2024-05-20T21:56:16.944+0000 7fb236917b00 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-05-20T21:56:17.509 INFO:teuthology.orchestra.run.smithi050.stdout:create mon.a on 2024-05-20T21:56:17.785 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-05-20T21:56:17.990 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2024-05-20T21:56:18.212 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968.target -> /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968.target. 2024-05-20T21:56:18.212 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968.target -> /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968.target. 2024-05-20T21:56:18.471 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mon.a 2024-05-20T21:56:18.471 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to reset failed state of unit ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mon.a.service: Unit ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mon.a.service not loaded. 2024-05-20T21:56:18.652 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968.target.wants/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mon.a.service -> /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service. 2024-05-20T21:56:18.661 INFO:teuthology.orchestra.run.smithi050.stdout:firewalld does not appear to be present 2024-05-20T21:56:18.661 INFO:teuthology.orchestra.run.smithi050.stdout:Not possible to enable service . firewalld.service is not available 2024-05-20T21:56:18.661 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mon to start... 2024-05-20T21:56:18.661 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mon... 2024-05-20T21:56:20.015 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:19 smithi050 bash[21382]: cluster 2024-05-20T21:56:19.796378+0000 mon.a (mon.0) 1 : cluster 1 mon.a is new leader, mons a in quorum (ranks 0) 2024-05-20T21:56:20.544 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout cluster: 2024-05-20T21:56:20.544 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout id: 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:56:20.544 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-20T21:56:20.544 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-05-20T21:56:20.544 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout services: 2024-05-20T21:56:20.544 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.208189s) 2024-05-20T21:56:20.545 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-20T21:56:20.545 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-20T21:56:20.545 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-05-20T21:56:20.545 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout data: 2024-05-20T21:56:20.546 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-20T21:56:20.546 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-20T21:56:20.546 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-20T21:56:20.546 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout pgs: 2024-05-20T21:56:20.546 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-05-20T21:56:20.546 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.872+0000 7fb0fc9bb640 1 Processor -- start 2024-05-20T21:56:20.547 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.872+0000 7fb0fc9bb640 1 -- start start 2024-05-20T21:56:20.547 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.872+0000 7fb0fc9bb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb0f8110080 con 0x7fb0f810c570 2024-05-20T21:56:20.547 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.872+0000 7fb0f659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb0f810c570 0x7fb0f810e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44674/0 (socket says 172.21.15.50:44674) 2024-05-20T21:56:20.547 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.872+0000 7fb0f659c640 1 -- 172.21.15.50:0/1427878473 learned_addr learned my addr 172.21.15.50:0/1427878473 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:20.547 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.872+0000 7fb0f559a640 1 -- 172.21.15.50:0/1427878473 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1581411165 0 0) 0x7fb0f8110080 con 0x7fb0f810c570 2024-05-20T21:56:20.547 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.872+0000 7fb0f559a640 1 -- 172.21.15.50:0/1427878473 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0e0003520 con 0x7fb0f810c570 2024-05-20T21:56:20.547 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.872+0000 7fb0f559a640 1 -- 172.21.15.50:0/1427878473 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3265133283 0 0) 0x7fb0e0003520 con 0x7fb0f810c570 2024-05-20T21:56:20.548 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.872+0000 7fb0f559a640 1 -- 172.21.15.50:0/1427878473 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f8111260 con 0x7fb0f810c570 2024-05-20T21:56:20.548 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.872+0000 7fb0f559a640 1 -- 172.21.15.50:0/1427878473 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fb0e8001580 con 0x7fb0f810c570 2024-05-20T21:56:20.548 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.872+0000 7fb0f559a640 1 -- 172.21.15.50:0/1427878473 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb0e8001920 con 0x7fb0f810c570 2024-05-20T21:56:20.548 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.872+0000 7fb0f559a640 1 -- 172.21.15.50:0/1427878473 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fb0e8001ca0 con 0x7fb0f810c570 2024-05-20T21:56:20.549 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.872+0000 7fb0fc9bb640 1 -- 172.21.15.50:0/1427878473 >> v1:172.21.15.50:6789/0 conn(0x7fb0f810c570 legacy=0x7fb0f810e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:20.549 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.872+0000 7fb0fc9bb640 1 -- 172.21.15.50:0/1427878473 shutdown_connections 2024-05-20T21:56:20.549 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.872+0000 7fb0fc9bb640 1 -- 172.21.15.50:0/1427878473 >> 172.21.15.50:0/1427878473 conn(0x7fb0f807ae20 msgr2=0x7fb0f807d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:20.549 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.872+0000 7fb0fc9bb640 1 -- 172.21.15.50:0/1427878473 shutdown_connections 2024-05-20T21:56:20.549 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.872+0000 7fb0fc9bb640 1 -- 172.21.15.50:0/1427878473 wait complete. 2024-05-20T21:56:20.549 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.876+0000 7fb0fc9bb640 1 Processor -- start 2024-05-20T21:56:20.549 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.876+0000 7fb0fc9bb640 1 -- start start 2024-05-20T21:56:20.550 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.876+0000 7fb0fc9bb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb0f819f790 con 0x7fb0f810c570 2024-05-20T21:56:20.550 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.876+0000 7fb0f659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb0f810c570 0x7fb0f819f080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44684/0 (socket says 172.21.15.50:44684) 2024-05-20T21:56:20.550 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.876+0000 7fb0f659c640 1 -- 172.21.15.50:0/242418950 learned_addr learned my addr 172.21.15.50:0/242418950 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:20.550 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.876+0000 7fb0e77fe640 1 -- 172.21.15.50:0/242418950 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 422209251 0 0) 0x7fb0f819f790 con 0x7fb0f810c570 2024-05-20T21:56:20.551 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.876+0000 7fb0e77fe640 1 -- 172.21.15.50:0/242418950 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0e0003160 con 0x7fb0f810c570 2024-05-20T21:56:20.551 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.876+0000 7fb0e77fe640 1 -- 172.21.15.50:0/242418950 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1659376260 0 0) 0x7fb0e0003160 con 0x7fb0f810c570 2024-05-20T21:56:20.551 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.876+0000 7fb0e77fe640 1 -- 172.21.15.50:0/242418950 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0f819f790 con 0x7fb0f810c570 2024-05-20T21:56:20.551 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.876+0000 7fb0e77fe640 1 -- 172.21.15.50:0/242418950 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fb0e8001480 con 0x7fb0f810c570 2024-05-20T21:56:20.551 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.876+0000 7fb0e77fe640 1 -- 172.21.15.50:0/242418950 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3304873797 0 0) 0x7fb0f819f790 con 0x7fb0f810c570 2024-05-20T21:56:20.551 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.876+0000 7fb0e77fe640 1 -- 172.21.15.50:0/242418950 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f819f960 con 0x7fb0f810c570 2024-05-20T21:56:20.552 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.876+0000 7fb0fc9bb640 1 -- 172.21.15.50:0/242418950 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f819fc70 con 0x7fb0f810c570 2024-05-20T21:56:20.552 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.876+0000 7fb0fc9bb640 1 -- 172.21.15.50:0/242418950 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb0f81a3800 con 0x7fb0f810c570 2024-05-20T21:56:20.552 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.876+0000 7fb0e77fe640 1 -- 172.21.15.50:0/242418950 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb0e8001920 con 0x7fb0f810c570 2024-05-20T21:56:20.552 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.876+0000 7fb0e77fe640 1 -- 172.21.15.50:0/242418950 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fb0e8004c40 con 0x7fb0f810c570 2024-05-20T21:56:20.553 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.876+0000 7fb0e77fe640 1 -- 172.21.15.50:0/242418950 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7fb0e8005230 con 0x7fb0f810c570 2024-05-20T21:56:20.553 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.876+0000 7fb0e77fe640 1 -- 172.21.15.50:0/242418950 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 276627905 0 0) 0x7fb0e8006ab0 con 0x7fb0f810c570 2024-05-20T21:56:20.553 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.876+0000 7fb0fc9bb640 1 -- 172.21.15.50:0/242418950 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0f8198fd0 con 0x7fb0f810c570 2024-05-20T21:56:20.553 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:19.880+0000 7fb0e77fe640 1 -- 172.21.15.50:0/242418950 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7fb0e8005700 con 0x7fb0f810c570 2024-05-20T21:56:20.553 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:20.004+0000 7fb0fc9bb640 1 -- 172.21.15.50:0/242418950 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "status"} v 0) -- 0x7fb0f8110400 con 0x7fb0f810c570 2024-05-20T21:56:20.554 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:20.004+0000 7fb0e77fe640 1 -- 172.21.15.50:0/242418950 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (unknown 1155462804 0 340092199) 0x7fb0e8005960 con 0x7fb0f810c570 2024-05-20T21:56:20.554 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:20.004+0000 7fb0fc9bb640 1 -- 172.21.15.50:0/242418950 >> v1:172.21.15.50:6789/0 conn(0x7fb0f810c570 legacy=0x7fb0f819f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:20.554 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:20.004+0000 7fb0fc9bb640 1 -- 172.21.15.50:0/242418950 shutdown_connections 2024-05-20T21:56:20.554 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:20.004+0000 7fb0fc9bb640 1 -- 172.21.15.50:0/242418950 >> 172.21.15.50:0/242418950 conn(0x7fb0f807ae20 msgr2=0x7fb0f81961a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:20.555 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:20.004+0000 7fb0fc9bb640 1 -- 172.21.15.50:0/242418950 shutdown_connections 2024-05-20T21:56:20.555 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:20.004+0000 7fb0fc9bb640 1 -- 172.21.15.50:0/242418950 wait complete. 2024-05-20T21:56:20.555 INFO:teuthology.orchestra.run.smithi050.stdout:mon is available 2024-05-20T21:56:20.555 INFO:teuthology.orchestra.run.smithi050.stdout:Assimilating anything we can from ceph.conf... 2024-05-20T21:56:20.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:20 smithi050 bash[21382]: cluster 2024-05-20T21:56:19.799990+0000 mon.a (mon.0) 2 : cluster 1 mon.a is new leader, mons a in quorum (ranks 0) 2024-05-20T21:56:20.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:20 smithi050 bash[21382]: cluster 2024-05-20T21:56:19.800146+0000 mon.a (mon.0) 3 : cluster 0 monmap epoch 1 2024-05-20T21:56:20.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:20 smithi050 bash[21382]: cluster 2024-05-20T21:56:19.800160+0000 mon.a (mon.0) 4 : cluster 0 fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:56:20.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:20 smithi050 bash[21382]: cluster 2024-05-20T21:56:19.800172+0000 mon.a (mon.0) 5 : cluster 0 last_changed 2024-05-20T21:56:15.715764+0000 2024-05-20T21:56:20.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:20 smithi050 bash[21382]: cluster 2024-05-20T21:56:19.800184+0000 mon.a (mon.0) 6 : cluster 0 created 2024-05-20T21:56:15.715764+0000 2024-05-20T21:56:20.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:20 smithi050 bash[21382]: cluster 2024-05-20T21:56:19.800194+0000 mon.a (mon.0) 7 : cluster 0 min_mon_release 19 (squid) 2024-05-20T21:56:20.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:20 smithi050 bash[21382]: cluster 2024-05-20T21:56:19.800205+0000 mon.a (mon.0) 8 : cluster 0 election_strategy: 1 2024-05-20T21:56:20.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:20 smithi050 bash[21382]: cluster 2024-05-20T21:56:19.800215+0000 mon.a (mon.0) 9 : cluster 0 0: v1:172.21.15.50:6789/0 mon.a 2024-05-20T21:56:20.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:20 smithi050 bash[21382]: cluster 2024-05-20T21:56:19.802607+0000 mon.a (mon.0) 10 : cluster 0 fsmap 2024-05-20T21:56:20.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:20 smithi050 bash[21382]: cluster 2024-05-20T21:56:19.805073+0000 mon.a (mon.0) 11 : cluster 0 osdmap e1: 0 total, 0 up, 0 in 2024-05-20T21:56:20.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:20 smithi050 bash[21382]: cluster 2024-05-20T21:56:19.805650+0000 mon.a (mon.0) 12 : cluster 0 mgrmap e1: no daemons active 2024-05-20T21:56:20.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:20 smithi050 bash[21382]: audit 2024-05-20T21:56:20.008134+0000 mon.a (mon.0) 13 : audit 0 from='client.? v1:172.21.15.50:0/242418950' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-20T21:56:21.998 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-05-20T21:56:21.998 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [global] 2024-05-20T21:56:21.998 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout fsid = 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:56:21.998 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_host = [v1:172.21.15.50:6789] 2024-05-20T21:56:21.998 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-20T21:56:21.999 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-20T21:56:21.999 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-20T21:56:21.999 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-20T21:56:21.999 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-05-20T21:56:21.999 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-20T21:56:21.999 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-20T21:56:21.999 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-05-20T21:56:22.000 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [osd] 2024-05-20T21:56:22.000 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-20T21:56:22.001 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-20T21:56:22.002 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b95be640 1 Processor -- start 2024-05-20T21:56:22.002 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b95be640 1 -- start start 2024-05-20T21:56:22.002 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b95be640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f57b4109b20 con 0x7f57b41056f0 2024-05-20T21:56:22.002 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b2ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f57b41056f0 0x7f57b4105b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44692/0 (socket says 172.21.15.50:44692) 2024-05-20T21:56:22.002 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b2ffd640 1 -- 172.21.15.50:0/2812415166 learned_addr learned my addr 172.21.15.50:0/2812415166 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:22.002 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b1ffb640 1 -- 172.21.15.50:0/2812415166 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2196211212 0 0) 0x7f57b4109b20 con 0x7f57b41056f0 2024-05-20T21:56:22.002 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b1ffb640 1 -- 172.21.15.50:0/2812415166 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f579c003520 con 0x7f57b41056f0 2024-05-20T21:56:22.002 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b1ffb640 1 -- 172.21.15.50:0/2812415166 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2904478760 0 0) 0x7f579c003520 con 0x7f57b41056f0 2024-05-20T21:56:22.002 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b1ffb640 1 -- 172.21.15.50:0/2812415166 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b410ad00 con 0x7f57b41056f0 2024-05-20T21:56:22.002 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b1ffb640 1 -- 172.21.15.50:0/2812415166 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f57a4001580 con 0x7f57b41056f0 2024-05-20T21:56:22.002 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b1ffb640 1 -- 172.21.15.50:0/2812415166 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f57a40017e0 con 0x7f57b41056f0 2024-05-20T21:56:22.002 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b1ffb640 1 -- 172.21.15.50:0/2812415166 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f57a4001b60 con 0x7f57b41056f0 2024-05-20T21:56:22.003 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b95be640 1 -- 172.21.15.50:0/2812415166 >> v1:172.21.15.50:6789/0 conn(0x7f57b41056f0 legacy=0x7f57b4105b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:22.005 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b95be640 1 -- 172.21.15.50:0/2812415166 shutdown_connections 2024-05-20T21:56:22.005 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b95be640 1 -- 172.21.15.50:0/2812415166 >> 172.21.15.50:0/2812415166 conn(0x7f57b4100cd0 msgr2=0x7f57b41030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:22.005 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b95be640 1 -- 172.21.15.50:0/2812415166 shutdown_connections 2024-05-20T21:56:22.005 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b95be640 1 -- 172.21.15.50:0/2812415166 wait complete. 2024-05-20T21:56:22.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b95be640 1 Processor -- start 2024-05-20T21:56:22.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b95be640 1 -- start start 2024-05-20T21:56:22.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b95be640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f57b419eae0 con 0x7f57b41056f0 2024-05-20T21:56:22.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b2ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f57b41056f0 0x7f57b407b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44706/0 (socket says 172.21.15.50:44706) 2024-05-20T21:56:22.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f57b2ffd640 1 -- 172.21.15.50:0/205244979 learned_addr learned my addr 172.21.15.50:0/205244979 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:22.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f579bfff640 1 -- 172.21.15.50:0/205244979 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3324103749 0 0) 0x7f57b419eae0 con 0x7f57b41056f0 2024-05-20T21:56:22.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f579bfff640 1 -- 172.21.15.50:0/205244979 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f579c003160 con 0x7f57b41056f0 2024-05-20T21:56:22.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f579bfff640 1 -- 172.21.15.50:0/205244979 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1007879410 0 0) 0x7f579c003160 con 0x7f57b41056f0 2024-05-20T21:56:22.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f579bfff640 1 -- 172.21.15.50:0/205244979 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57b419eae0 con 0x7f57b41056f0 2024-05-20T21:56:22.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.300+0000 7f579bfff640 1 -- 172.21.15.50:0/205244979 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f57a4001480 con 0x7f57b41056f0 2024-05-20T21:56:22.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.304+0000 7f579bfff640 1 -- 172.21.15.50:0/205244979 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1267559283 0 0) 0x7f57b419eae0 con 0x7f57b41056f0 2024-05-20T21:56:22.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.304+0000 7f579bfff640 1 -- 172.21.15.50:0/205244979 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b419fcc0 con 0x7f57b41056f0 2024-05-20T21:56:22.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.304+0000 7f57b95be640 1 -- 172.21.15.50:0/205244979 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f57b419ecb0 con 0x7f57b41056f0 2024-05-20T21:56:22.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.304+0000 7f57b95be640 1 -- 172.21.15.50:0/205244979 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f57b419f1f0 con 0x7f57b41056f0 2024-05-20T21:56:22.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.304+0000 7f579bfff640 1 -- 172.21.15.50:0/205244979 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f57a40017e0 con 0x7f57b41056f0 2024-05-20T21:56:22.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.304+0000 7f579bfff640 1 -- 172.21.15.50:0/205244979 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f57a4004ba0 con 0x7f57b41056f0 2024-05-20T21:56:22.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.304+0000 7f579bfff640 1 -- 172.21.15.50:0/205244979 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f57a40050d0 con 0x7f57b41056f0 2024-05-20T21:56:22.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.304+0000 7f579bfff640 1 -- 172.21.15.50:0/205244979 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 276627905 0 0) 0x7f57a4006960 con 0x7f57b41056f0 2024-05-20T21:56:22.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.304+0000 7f57b95be640 1 -- 172.21.15.50:0/205244979 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57a00050b0 con 0x7f57b41056f0 2024-05-20T21:56:22.008 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.304+0000 7f579bfff640 1 -- 172.21.15.50:0/205244979 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f57a4006b60 con 0x7f57b41056f0 2024-05-20T21:56:22.008 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.420+0000 7f57b95be640 1 -- 172.21.15.50:0/205244979 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f57a0002420 con 0x7f57b41056f0 2024-05-20T21:56:22.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.424+0000 7f579bfff640 1 -- 172.21.15.50:0/205244979 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+317 (unknown 1213389831 0 3885578323) 0x7f57a40055f0 con 0x7f57b41056f0 2024-05-20T21:56:22.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.424+0000 7f579bfff640 1 -- 172.21.15.50:0/205244979 <== mon.0 v1:172.21.15.50:6789/0 11 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7f57a4005d10 con 0x7f57b41056f0 2024-05-20T21:56:22.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.424+0000 7f57b95be640 1 -- 172.21.15.50:0/205244979 >> v1:172.21.15.50:6789/0 conn(0x7f57b41056f0 legacy=0x7f57b407b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:22.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.424+0000 7f57b95be640 1 -- 172.21.15.50:0/205244979 shutdown_connections 2024-05-20T21:56:22.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.424+0000 7f57b95be640 1 -- 172.21.15.50:0/205244979 >> 172.21.15.50:0/205244979 conn(0x7f57b4100cd0 msgr2=0x7f57b418fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:22.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.424+0000 7f57b95be640 1 -- 172.21.15.50:0/205244979 shutdown_connections 2024-05-20T21:56:22.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:21.424+0000 7f57b95be640 1 -- 172.21.15.50:0/205244979 wait complete. 2024-05-20T21:56:22.009 INFO:teuthology.orchestra.run.smithi050.stdout:Generating new minimal ceph.conf... 2024-05-20T21:56:22.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:21 smithi050 bash[21382]: audit 2024-05-20T21:56:21.424537+0000 mon.a (mon.0) 14 : audit 1 from='client.? v1:172.21.15.50:0/205244979' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-20T21:56:22.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:21 smithi050 bash[21382]: audit 2024-05-20T21:56:21.427704+0000 mon.a (mon.0) 15 : audit 1 from='client.? v1:172.21.15.50:0/205244979' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-20T21:56:23.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:23 smithi050 bash[21382]: audit 2024-05-20T21:56:22.969556+0000 mon.a (mon.0) 16 : audit 0 from='client.? v1:172.21.15.50:0/1113664791' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:56:23.523 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.836+0000 7f19efb6f640 1 Processor -- start 2024-05-20T21:56:23.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.836+0000 7f19efb6f640 1 -- start start 2024-05-20T21:56:23.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.836+0000 7f19efb6f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f19e807a290 con 0x7f19e807b6d0 2024-05-20T21:56:23.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.836+0000 7f19ed90b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f19e807b6d0 0x7f19e8079b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44720/0 (socket says 172.21.15.50:44720) 2024-05-20T21:56:23.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.836+0000 7f19ed90b640 1 -- 172.21.15.50:0/2015880703 learned_addr learned my addr 172.21.15.50:0/2015880703 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:23.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.836+0000 7f19ec909640 1 -- 172.21.15.50:0/2015880703 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1257003964 0 0) 0x7f19e807a290 con 0x7f19e807b6d0 2024-05-20T21:56:23.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.836+0000 7f19ec909640 1 -- 172.21.15.50:0/2015880703 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19d4003520 con 0x7f19e807b6d0 2024-05-20T21:56:23.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19ec909640 1 -- 172.21.15.50:0/2015880703 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1242810974 0 0) 0x7f19d4003520 con 0x7f19e807b6d0 2024-05-20T21:56:23.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19ec909640 1 -- 172.21.15.50:0/2015880703 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e807a460 con 0x7f19e807b6d0 2024-05-20T21:56:23.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19ec909640 1 -- 172.21.15.50:0/2015880703 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f19e4001580 con 0x7f19e807b6d0 2024-05-20T21:56:23.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19ec909640 1 -- 172.21.15.50:0/2015880703 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7f19e4001d30 con 0x7f19e807b6d0 2024-05-20T21:56:23.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19ec909640 1 -- 172.21.15.50:0/2015880703 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f19e40058d0 con 0x7f19e807b6d0 2024-05-20T21:56:23.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19efb6f640 1 -- 172.21.15.50:0/2015880703 >> v1:172.21.15.50:6789/0 conn(0x7f19e807b6d0 legacy=0x7f19e8079b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:23.525 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19efb6f640 1 -- 172.21.15.50:0/2015880703 shutdown_connections 2024-05-20T21:56:23.525 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19efb6f640 1 -- 172.21.15.50:0/2015880703 >> 172.21.15.50:0/2015880703 conn(0x7f19e8100d00 msgr2=0x7f19e8103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:23.525 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19efb6f640 1 -- 172.21.15.50:0/2015880703 shutdown_connections 2024-05-20T21:56:23.525 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19efb6f640 1 -- 172.21.15.50:0/2015880703 wait complete. 2024-05-20T21:56:23.525 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19efb6f640 1 Processor -- start 2024-05-20T21:56:23.525 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19efb6f640 1 -- start start 2024-05-20T21:56:23.525 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19efb6f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f19e819bbc0 con 0x7f19e807b6d0 2024-05-20T21:56:23.525 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19ed90b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f19e807b6d0 0x7f19e819b4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44736/0 (socket says 172.21.15.50:44736) 2024-05-20T21:56:23.525 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19ed90b640 1 -- 172.21.15.50:0/1113664791 learned_addr learned my addr 172.21.15.50:0/1113664791 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:23.525 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19deffd640 1 -- 172.21.15.50:0/1113664791 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 615711898 0 0) 0x7f19e819bbc0 con 0x7f19e807b6d0 2024-05-20T21:56:23.525 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19deffd640 1 -- 172.21.15.50:0/1113664791 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19d4005410 con 0x7f19e807b6d0 2024-05-20T21:56:23.525 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19deffd640 1 -- 172.21.15.50:0/1113664791 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 975130051 0 0) 0x7f19d4005410 con 0x7f19e807b6d0 2024-05-20T21:56:23.525 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19deffd640 1 -- 172.21.15.50:0/1113664791 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f19e819bbc0 con 0x7f19e807b6d0 2024-05-20T21:56:23.526 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19deffd640 1 -- 172.21.15.50:0/1113664791 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f19e4001080 con 0x7f19e807b6d0 2024-05-20T21:56:23.526 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19deffd640 1 -- 172.21.15.50:0/1113664791 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3009023227 0 0) 0x7f19e819bbc0 con 0x7f19e807b6d0 2024-05-20T21:56:23.526 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19deffd640 1 -- 172.21.15.50:0/1113664791 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e819bd90 con 0x7f19e807b6d0 2024-05-20T21:56:23.526 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19efb6f640 1 -- 172.21.15.50:0/1113664791 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f19e819c0a0 con 0x7f19e807b6d0 2024-05-20T21:56:23.526 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19efb6f640 1 -- 172.21.15.50:0/1113664791 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f19e819fc30 con 0x7f19e807b6d0 2024-05-20T21:56:23.526 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19deffd640 1 -- 172.21.15.50:0/1113664791 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7f19e4001bc0 con 0x7f19e807b6d0 2024-05-20T21:56:23.526 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19deffd640 1 -- 172.21.15.50:0/1113664791 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f19e4005ea0 con 0x7f19e807b6d0 2024-05-20T21:56:23.526 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19deffd640 1 -- 172.21.15.50:0/1113664791 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f19e4006490 con 0x7f19e807b6d0 2024-05-20T21:56:23.526 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.840+0000 7f19deffd640 1 -- 172.21.15.50:0/1113664791 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 276627905 0 0) 0x7f19e4007b90 con 0x7f19e807b6d0 2024-05-20T21:56:23.526 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.844+0000 7f19efb6f640 1 -- 172.21.15.50:0/1113664791 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19cc0050b0 con 0x7f19e807b6d0 2024-05-20T21:56:23.526 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.844+0000 7f19deffd640 1 -- 172.21.15.50:0/1113664791 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f19e4004a20 con 0x7f19e807b6d0 2024-05-20T21:56:23.526 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.964+0000 7f19efb6f640 1 -- 172.21.15.50:0/1113664791 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f19cc0053a0 con 0x7f19e807b6d0 2024-05-20T21:56:23.527 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.964+0000 7f19deffd640 1 -- 172.21.15.50:0/1113664791 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+147 (unknown 1452402520 0 2330372236) 0x7f19e4005640 con 0x7f19e807b6d0 2024-05-20T21:56:23.527 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.964+0000 7f19efb6f640 1 -- 172.21.15.50:0/1113664791 >> v1:172.21.15.50:6789/0 conn(0x7f19e807b6d0 legacy=0x7f19e819b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:23.527 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.964+0000 7f19efb6f640 1 -- 172.21.15.50:0/1113664791 shutdown_connections 2024-05-20T21:56:23.527 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.964+0000 7f19efb6f640 1 -- 172.21.15.50:0/1113664791 >> 172.21.15.50:0/1113664791 conn(0x7f19e8100d00 msgr2=0x7f19e8109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:23.527 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.964+0000 7f19efb6f640 1 -- 172.21.15.50:0/1113664791 shutdown_connections 2024-05-20T21:56:23.527 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:22.964+0000 7f19efb6f640 1 -- 172.21.15.50:0/1113664791 wait complete. 2024-05-20T21:56:23.527 INFO:teuthology.orchestra.run.smithi050.stdout:Restarting the monitor... 2024-05-20T21:56:23.823 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:23 smithi050 systemd[1]: Stopping Ceph mon.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T21:56:23.823 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:23 smithi050 bash[21382]: debug 2024-05-20T21:56:23.660+0000 7f83d72fc640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-05-20T21:56:23.823 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:23 smithi050 bash[21382]: debug 2024-05-20T21:56:23.660+0000 7f83d72fc640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-20T21:56:24.366 INFO:teuthology.orchestra.run.smithi050.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-20T21:56:24.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:24 smithi050 bash[21767]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-mon-a 2024-05-20T21:56:24.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:24 smithi050 bash[21828]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-mon-a 2024-05-20T21:56:24.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:24 smithi050 systemd[1]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-20T21:56:24.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:24 smithi050 systemd[1]: Stopped Ceph mon.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968. 2024-05-20T21:56:24.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:24 smithi050 systemd[1]: Started Ceph mon.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968. 2024-05-20T21:56:25.552 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.352+0000 7f08b637ab00 0 set uid:gid to 167:167 (ceph:ceph) 2024-05-20T21:56:25.552 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.352+0000 7f08b637ab00 0 ceph version 19.0.0-2536-g200b2779 (200b27799814c89893ec6700f852fc40163e03d5) squid (dev), process ceph-mon, pid 7 2024-05-20T21:56:25.552 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.352+0000 7f08b637ab00 0 pidfile_write: ignore empty --pid-file 2024-05-20T21:56:25.552 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.352+0000 7f08b637ab00 0 load: jerasure load: lrc 2024-05-20T21:56:25.552 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: RocksDB version: 7.9.2 2024-05-20T21:56:25.553 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Git sha 0 2024-05-20T21:56:25.553 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Compile date 2024-05-20 18:35:26 2024-05-20T21:56:25.553 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: DB SUMMARY 2024-05-20T21:56:25.553 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: DB Session ID: I9TIVOTRYIY63GZSRQ6B 2024-05-20T21:56:25.553 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: CURRENT file: CURRENT 2024-05-20T21:56:25.553 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: IDENTITY file: IDENTITY 2024-05-20T21:56:25.553 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-20T21:56:25.553 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-20T21:56:25.553 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 88911 ; 2024-05-20T21:56:25.553 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.error_if_exists: 0 2024-05-20T21:56:25.553 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.create_if_missing: 0 2024-05-20T21:56:25.553 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.paranoid_checks: 1 2024-05-20T21:56:25.553 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-05-20T21:56:25.554 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-20T21:56:25.554 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-20T21:56:25.554 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.env: 0x562627be5740 2024-05-20T21:56:25.554 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.fs: PosixFileSystem 2024-05-20T21:56:25.554 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.info_log: 0x56262866d060 2024-05-20T21:56:25.554 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_file_opening_threads: 16 2024-05-20T21:56:25.554 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.statistics: (nil) 2024-05-20T21:56:25.554 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.use_fsync: 0 2024-05-20T21:56:25.554 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_log_file_size: 0 2024-05-20T21:56:25.555 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-20T21:56:25.555 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.log_file_time_to_roll: 0 2024-05-20T21:56:25.555 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.keep_log_file_num: 1000 2024-05-20T21:56:25.555 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.recycle_log_file_num: 0 2024-05-20T21:56:25.555 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.allow_fallocate: 1 2024-05-20T21:56:25.555 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.allow_mmap_reads: 0 2024-05-20T21:56:25.555 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.allow_mmap_writes: 0 2024-05-20T21:56:25.555 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.use_direct_reads: 0 2024-05-20T21:56:25.555 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-20T21:56:25.555 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.create_missing_column_families: 0 2024-05-20T21:56:25.556 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.db_log_dir: 2024-05-20T21:56:25.556 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.wal_dir: 2024-05-20T21:56:25.556 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.table_cache_numshardbits: 6 2024-05-20T21:56:25.556 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-05-20T21:56:25.556 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-05-20T21:56:25.556 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-20T21:56:25.556 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-20T21:56:25.556 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-05-20T21:56:25.556 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.advise_random_on_open: 1 2024-05-20T21:56:25.556 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.db_write_buffer_size: 0 2024-05-20T21:56:25.556 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.write_buffer_manager: 0x56262867c1e0 2024-05-20T21:56:25.556 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-20T21:56:25.556 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-20T21:56:25.556 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.use_adaptive_mutex: 0 2024-05-20T21:56:25.557 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.rate_limiter: (nil) 2024-05-20T21:56:25.557 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-20T21:56:25.557 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.wal_recovery_mode: 2 2024-05-20T21:56:25.557 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.enable_thread_tracking: 0 2024-05-20T21:56:25.557 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.enable_pipelined_write: 0 2024-05-20T21:56:25.557 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.unordered_write: 0 2024-05-20T21:56:25.557 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-20T21:56:25.557 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-20T21:56:25.557 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-20T21:56:25.557 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-20T21:56:25.557 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.row_cache: None 2024-05-20T21:56:25.557 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.wal_filter: None 2024-05-20T21:56:25.557 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-20T21:56:25.557 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.allow_ingest_behind: 0 2024-05-20T21:56:25.558 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.two_write_queues: 0 2024-05-20T21:56:25.558 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.manual_wal_flush: 0 2024-05-20T21:56:25.558 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.wal_compression: 0 2024-05-20T21:56:25.558 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.atomic_flush: 0 2024-05-20T21:56:25.558 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-20T21:56:25.558 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.persist_stats_to_disk: 0 2024-05-20T21:56:25.558 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-05-20T21:56:25.558 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.log_readahead_size: 0 2024-05-20T21:56:25.558 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-20T21:56:25.558 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.best_efforts_recovery: 0 2024-05-20T21:56:25.558 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-20T21:56:25.558 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-20T21:56:25.558 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.allow_data_in_errors: 0 2024-05-20T21:56:25.558 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.db_host_id: __hostname__ 2024-05-20T21:56:25.559 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.enforce_single_del_contracts: true 2024-05-20T21:56:25.559 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_background_jobs: 2 2024-05-20T21:56:25.559 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_background_compactions: -1 2024-05-20T21:56:25.559 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_subcompactions: 1 2024-05-20T21:56:25.559 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-20T21:56:25.559 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-20T21:56:25.559 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.delayed_write_rate : 16777216 2024-05-20T21:56:25.559 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_total_wal_size: 0 2024-05-20T21:56:25.559 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-20T21:56:25.559 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.stats_dump_period_sec: 600 2024-05-20T21:56:25.559 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.stats_persist_period_sec: 600 2024-05-20T21:56:25.559 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-20T21:56:25.559 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_open_files: -1 2024-05-20T21:56:25.560 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.bytes_per_sync: 0 2024-05-20T21:56:25.560 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-05-20T21:56:25.560 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-05-20T21:56:25.560 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compaction_readahead_size: 0 2024-05-20T21:56:25.560 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_background_flushes: -1 2024-05-20T21:56:25.560 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Compression algorithms supported: 2024-05-20T21:56:25.560 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: kZSTD supported: 0 2024-05-20T21:56:25.560 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: kXpressCompression supported: 0 2024-05-20T21:56:25.560 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: kBZip2Compression supported: 0 2024-05-20T21:56:25.560 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-20T21:56:25.560 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: kLZ4Compression supported: 1 2024-05-20T21:56:25.560 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: kZlibCompression supported: 1 2024-05-20T21:56:25.560 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: kLZ4HCCompression supported: 1 2024-05-20T21:56:25.560 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: kSnappyCompression supported: 1 2024-05-20T21:56:25.561 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-05-20T21:56:25.561 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-05-20T21:56:25.561 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-20T21:56:25.562 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-20T21:56:25.562 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-20T21:56:25.562 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.merge_operator: 2024-05-20T21:56:25.562 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compaction_filter: None 2024-05-20T21:56:25.562 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compaction_filter_factory: None 2024-05-20T21:56:25.562 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.sst_partitioner_factory: None 2024-05-20T21:56:25.562 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-05-20T21:56:25.562 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.table_factory: BlockBasedTable 2024-05-20T21:56:25.563 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56262866cce0) 2024-05-20T21:56:25.563 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: cache_index_and_filter_blocks: 1 2024-05-20T21:56:25.563 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-20T21:56:25.563 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-20T21:56:25.563 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: pin_top_level_index_and_filter: 1 2024-05-20T21:56:25.563 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: index_type: 0 2024-05-20T21:56:25.563 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: data_block_index_type: 0 2024-05-20T21:56:25.563 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: index_shortening: 1 2024-05-20T21:56:25.563 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: data_block_hash_table_util_ratio: 0.750000 2024-05-20T21:56:25.563 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: checksum: 4 2024-05-20T21:56:25.563 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: no_block_cache: 0 2024-05-20T21:56:25.563 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: block_cache: 0x562628665090 2024-05-20T21:56:25.563 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: block_cache_name: BinnedLRUCache 2024-05-20T21:56:25.564 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: block_cache_options: 2024-05-20T21:56:25.564 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: capacity : 536870912 2024-05-20T21:56:25.564 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: num_shard_bits : 4 2024-05-20T21:56:25.564 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: strict_capacity_limit : 0 2024-05-20T21:56:25.564 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: high_pri_pool_ratio: 0.000 2024-05-20T21:56:25.564 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: block_cache_compressed: (nil) 2024-05-20T21:56:25.564 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: persistent_cache: (nil) 2024-05-20T21:56:25.564 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: block_size: 4096 2024-05-20T21:56:25.564 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: block_size_deviation: 10 2024-05-20T21:56:25.564 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: block_restart_interval: 16 2024-05-20T21:56:25.564 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: index_block_restart_interval: 1 2024-05-20T21:56:25.564 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: metadata_block_size: 4096 2024-05-20T21:56:25.564 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: partition_filters: 0 2024-05-20T21:56:25.564 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: use_delta_encoding: 1 2024-05-20T21:56:25.565 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: filter_policy: bloomfilter 2024-05-20T21:56:25.565 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: whole_key_filtering: 1 2024-05-20T21:56:25.565 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: verify_compression: 0 2024-05-20T21:56:25.565 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: read_amp_bytes_per_bit: 0 2024-05-20T21:56:25.565 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: format_version: 5 2024-05-20T21:56:25.565 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: enable_index_compression: 1 2024-05-20T21:56:25.565 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: block_align: 0 2024-05-20T21:56:25.565 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: max_auto_readahead_size: 262144 2024-05-20T21:56:25.565 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: prepopulate_block_cache: 0 2024-05-20T21:56:25.565 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: initial_auto_readahead_size: 8192 2024-05-20T21:56:25.565 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: num_file_reads_for_auto_readahead: 2 2024-05-20T21:56:25.565 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.write_buffer_size: 33554432 2024-05-20T21:56:25.565 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_write_buffer_number: 2 2024-05-20T21:56:25.565 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compression: NoCompression 2024-05-20T21:56:25.566 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.bottommost_compression: Disabled 2024-05-20T21:56:25.566 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.prefix_extractor: nullptr 2024-05-20T21:56:25.566 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-20T21:56:25.566 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.num_levels: 7 2024-05-20T21:56:25.566 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-20T21:56:25.566 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-20T21:56:25.566 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-20T21:56:25.566 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-20T21:56:25.566 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-20T21:56:25.566 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-20T21:56:25.566 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-20T21:56:25.566 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-20T21:56:25.566 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-20T21:56:25.566 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-20T21:56:25.567 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-20T21:56:25.567 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-20T21:56:25.567 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compression_opts.window_bits: -14 2024-05-20T21:56:25.567 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compression_opts.level: 32767 2024-05-20T21:56:25.567 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compression_opts.strategy: 0 2024-05-20T21:56:25.567 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-20T21:56:25.567 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-20T21:56:25.567 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-20T21:56:25.567 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-20T21:56:25.567 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compression_opts.enabled: false 2024-05-20T21:56:25.567 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-20T21:56:25.567 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-20T21:56:25.567 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-20T21:56:25.567 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-20T21:56:25.568 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.target_file_size_base: 67108864 2024-05-20T21:56:25.568 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.target_file_size_multiplier: 1 2024-05-20T21:56:25.568 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-20T21:56:25.568 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-20T21:56:25.568 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-20T21:56:25.568 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-20T21:56:25.568 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-20T21:56:25.568 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-20T21:56:25.568 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-20T21:56:25.568 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-20T21:56:25.568 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-20T21:56:25.568 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-20T21:56:25.568 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-20T21:56:25.569 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-20T21:56:25.569 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-20T21:56:25.569 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.arena_block_size: 1048576 2024-05-20T21:56:25.569 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-20T21:56:25.569 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-20T21:56:25.569 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.disable_auto_compactions: 0 2024-05-20T21:56:25.569 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-20T21:56:25.569 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-20T21:56:25.569 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-20T21:56:25.569 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-20T21:56:25.569 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-20T21:56:25.569 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-20T21:56:25.569 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-20T21:56:25.569 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-20T21:56:25.570 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-20T21:56:25.570 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-20T21:56:25.570 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.table_properties_collectors: 2024-05-20T21:56:25.570 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.inplace_update_support: 0 2024-05-20T21:56:25.570 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-05-20T21:56:25.570 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-20T21:56:25.570 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-20T21:56:25.570 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.memtable_huge_page_size: 0 2024-05-20T21:56:25.570 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.bloom_locality: 0 2024-05-20T21:56:25.570 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.max_successive_merges: 0 2024-05-20T21:56:25.570 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-05-20T21:56:25.570 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.paranoid_file_checks: 0 2024-05-20T21:56:25.570 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.force_consistency_checks: 1 2024-05-20T21:56:25.571 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.report_bg_io_stats: 0 2024-05-20T21:56:25.571 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.ttl: 2592000 2024-05-20T21:56:25.571 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-05-20T21:56:25.571 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-20T21:56:25.571 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-20T21:56:25.571 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.enable_blob_files: false 2024-05-20T21:56:25.571 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.min_blob_size: 0 2024-05-20T21:56:25.571 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.blob_file_size: 268435456 2024-05-20T21:56:25.571 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.blob_compression_type: NoCompression 2024-05-20T21:56:25.571 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-05-20T21:56:25.571 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-20T21:56:25.571 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-20T21:56:25.571 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-20T21:56:25.572 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.blob_file_starting_level: 0 2024-05-20T21:56:25.572 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-20T21:56:25.572 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-20T21:56:25.572 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-20T21:56:25.572 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 48c2ba9b-4e2c-44f7-acf6-8e041f8c8dcb 2024-05-20T21:56:25.572 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1716242185362030, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-20T21:56:25.572 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-20T21:56:25.572 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1716242185363128, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 85194, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 270, "table_properties": {"data_size": 83373, "index_size": 231, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10877, "raw_average_key_size": 47, "raw_value_size": 77272, "raw_average_value_size": 337, "num_data_blocks": 10, "num_entries": 229, "num_filter_entries": 229, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1716242185, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "48c2ba9b-4e2c-44f7-acf6-8e041f8c8dcb", "db_session_id": "I9TIVOTRYIY63GZSRQ6B", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-20T21:56:25.572 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1716242185363255, "job": 1, "event": "recovery_finished"} 2024-05-20T21:56:25.572 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.356+0000 7f08b637ab00 4 rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-20T21:56:25.572 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.360+0000 7f08b637ab00 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-20T21:56:25.572 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.360+0000 7f08b637ab00 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56262868ee00 2024-05-20T21:56:25.572 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.360+0000 7f08b637ab00 4 rocksdb: DB pointer 0x562628788000 2024-05-20T21:56:25.573 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.360+0000 7f08ac143640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-20T21:56:25.573 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.360+0000 7f08ac143640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-20T21:56:25.573 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: ** DB Stats ** 2024-05-20T21:56:25.573 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: Uptime(secs): 0.0 total, 0.0 interval 2024-05-20T21:56:25.573 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-20T21:56:25.573 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-20T21:56:25.573 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-20T21:56:25.573 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-20T21:56:25.573 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-20T21:56:25.573 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-20T21:56:25.573 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: ** Compaction Stats [default] ** 2024-05-20T21:56:25.573 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-20T21:56:25.573 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-20T21:56:25.573 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: L0 2/0 85.00 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 125.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-20T21:56:25.574 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: Sum 2/0 85.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 125.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-20T21:56:25.574 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 125.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-20T21:56:25.574 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: ** Compaction Stats [default] ** 2024-05-20T21:56:25.574 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-20T21:56:25.574 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-20T21:56:25.574 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 125.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-20T21:56:25.574 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-20T21:56:25.574 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: Uptime(secs): 0.0 total, 0.0 interval 2024-05-20T21:56:25.574 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: Flush(GB): cumulative 0.000, interval 0.000 2024-05-20T21:56:25.574 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-20T21:56:25.574 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: AddFile(Total Files): cumulative 0, interval 0 2024-05-20T21:56:25.574 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: AddFile(L0 Files): cumulative 0, interval 0 2024-05-20T21:56:25.574 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: AddFile(Keys): cumulative 0, interval 0 2024-05-20T21:56:25.575 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: Cumulative compaction: 0.00 GB write, 18.70 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-20T21:56:25.575 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: Interval compaction: 0.00 GB write, 18.70 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-20T21:56:25.575 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-20T21:56:25.575 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: Block cache BinnedLRUCache@0x562628665090#7 capacity: 512.00 MB usage: 1.19 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-05-20T21:56:25.575 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.42 KB,8.04663e-05%) Misc(1,0.00 KB,0%) 2024-05-20T21:56:25.575 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: ** File Read Latency Histogram By Level [default] ** 2024-05-20T21:56:25.575 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.360+0000 7f08b637ab00 0 starting mon.a rank 0 at public addrs v1:172.21.15.50:6789/0 at bind addrs v1:172.21.15.50:6789/0 mon_data /var/lib/ceph/mon/ceph-a fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:56:25.575 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.364+0000 7f08b637ab00 1 mon.a@-1(???) e1 preinit fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:56:25.575 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.364+0000 7f08b637ab00 0 mon.a@-1(???).mds e1 new map 2024-05-20T21:56:25.575 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.364+0000 7f08b637ab00 0 mon.a@-1(???).mds e1 print_map 2024-05-20T21:56:25.575 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: e1 2024-05-20T21:56:25.575 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: enable_multiple, ever_enabled_multiple: 1,1 2024-05-20T21:56:25.575 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-20T21:56:25.576 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: legacy client fscid: -1 2024-05-20T21:56:25.576 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: 2024-05-20T21:56:25.576 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: No filesystems configured 2024-05-20T21:56:25.576 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.364+0000 7f08b637ab00 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-20T21:56:25.576 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.364+0000 7f08b637ab00 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-20T21:56:25.576 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.364+0000 7f08b637ab00 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-20T21:56:25.576 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.364+0000 7f08b637ab00 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-20T21:56:25.576 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: debug 2024-05-20T21:56:25.364+0000 7f08b637ab00 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-20T21:56:25.576 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: cluster 2024-05-20T21:56:25.392309+0000 mon.a (mon.0) 1 : cluster 1 mon.a is new leader, mons a in quorum (ranks 0) 2024-05-20T21:56:25.576 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: cluster 2024-05-20T21:56:25.392391+0000 mon.a (mon.0) 2 : cluster 0 monmap epoch 1 2024-05-20T21:56:25.576 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: cluster 2024-05-20T21:56:25.392399+0000 mon.a (mon.0) 3 : cluster 0 fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:56:25.576 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: cluster 2024-05-20T21:56:25.392409+0000 mon.a (mon.0) 4 : cluster 0 last_changed 2024-05-20T21:56:15.715764+0000 2024-05-20T21:56:25.576 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: cluster 2024-05-20T21:56:25.392417+0000 mon.a (mon.0) 5 : cluster 0 created 2024-05-20T21:56:15.715764+0000 2024-05-20T21:56:25.576 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: cluster 2024-05-20T21:56:25.392487+0000 mon.a (mon.0) 6 : cluster 0 min_mon_release 19 (squid) 2024-05-20T21:56:25.577 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: cluster 2024-05-20T21:56:25.392499+0000 mon.a (mon.0) 7 : cluster 0 election_strategy: 1 2024-05-20T21:56:25.577 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: cluster 2024-05-20T21:56:25.392508+0000 mon.a (mon.0) 8 : cluster 0 0: v1:172.21.15.50:6789/0 mon.a 2024-05-20T21:56:25.577 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: cluster 2024-05-20T21:56:25.392924+0000 mon.a (mon.0) 9 : cluster 0 fsmap 2024-05-20T21:56:25.577 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: cluster 2024-05-20T21:56:25.392951+0000 mon.a (mon.0) 10 : cluster 0 osdmap e1: 0 total, 0 up, 0 in 2024-05-20T21:56:25.577 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:25 smithi050 bash[21866]: cluster 2024-05-20T21:56:25.393321+0000 mon.a (mon.0) 11 : cluster 0 mgrmap e1: no daemons active 2024-05-20T21:56:26.114 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.408+0000 7f8f12191640 1 Processor -- start 2024-05-20T21:56:26.114 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.408+0000 7f8f12191640 1 -- start start 2024-05-20T21:56:26.114 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.408+0000 7f8f12191640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f8f0c10bcf0 con 0x7f8f0c107910 2024-05-20T21:56:26.115 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f0b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8f0c107910 0x7f8f0c107d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44738/0 (socket says 172.21.15.50:44738) 2024-05-20T21:56:26.115 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f0b7fe640 1 -- 172.21.15.50:0/2116930938 learned_addr learned my addr 172.21.15.50:0/2116930938 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:26.115 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f0a7fc640 1 -- 172.21.15.50:0/2116930938 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2242266068 0 0) 0x7f8f0c10bcf0 con 0x7f8f0c107910 2024-05-20T21:56:26.115 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f0a7fc640 1 -- 172.21.15.50:0/2116930938 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ef4003520 con 0x7f8f0c107910 2024-05-20T21:56:26.115 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f0a7fc640 1 -- 172.21.15.50:0/2116930938 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 247423947 0 0) 0x7f8ef4003520 con 0x7f8f0c107910 2024-05-20T21:56:26.115 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f0a7fc640 1 -- 172.21.15.50:0/2116930938 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0c10ced0 con 0x7f8f0c107910 2024-05-20T21:56:26.115 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f0a7fc640 1 -- 172.21.15.50:0/2116930938 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f8f00001580 con 0x7f8f0c107910 2024-05-20T21:56:26.115 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f0a7fc640 1 -- 172.21.15.50:0/2116930938 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7f8f00001d30 con 0x7f8f0c107910 2024-05-20T21:56:26.115 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f0a7fc640 1 -- 172.21.15.50:0/2116930938 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f8f000058d0 con 0x7f8f0c107910 2024-05-20T21:56:26.115 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f12191640 1 -- 172.21.15.50:0/2116930938 >> v1:172.21.15.50:6789/0 conn(0x7f8f0c107910 legacy=0x7f8f0c107d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:26.115 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f12191640 1 -- 172.21.15.50:0/2116930938 shutdown_connections 2024-05-20T21:56:26.115 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f12191640 1 -- 172.21.15.50:0/2116930938 >> 172.21.15.50:0/2116930938 conn(0x7f8f0c07ae20 msgr2=0x7f8f0c1054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:26.115 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f12191640 1 -- 172.21.15.50:0/2116930938 shutdown_connections 2024-05-20T21:56:26.116 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f12191640 1 -- 172.21.15.50:0/2116930938 wait complete. 2024-05-20T21:56:26.118 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f12191640 1 Processor -- start 2024-05-20T21:56:26.118 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f12191640 1 -- start start 2024-05-20T21:56:26.118 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f12191640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f8f0c19bbf0 con 0x7f8f0c107910 2024-05-20T21:56:26.118 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f0b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8f0c107910 0x7f8f0c19b4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44740/0 (socket says 172.21.15.50:44740) 2024-05-20T21:56:26.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f0b7fe640 1 -- 172.21.15.50:0/1372464368 learned_addr learned my addr 172.21.15.50:0/1372464368 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:26.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f08ff9640 1 -- 172.21.15.50:0/1372464368 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4004692166 0 0) 0x7f8f0c19bbf0 con 0x7f8f0c107910 2024-05-20T21:56:26.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f08ff9640 1 -- 172.21.15.50:0/1372464368 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ef4005410 con 0x7f8f0c107910 2024-05-20T21:56:26.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f08ff9640 1 -- 172.21.15.50:0/1372464368 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 151784842 0 0) 0x7f8ef4005410 con 0x7f8f0c107910 2024-05-20T21:56:26.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f08ff9640 1 -- 172.21.15.50:0/1372464368 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8f0c19bbf0 con 0x7f8f0c107910 2024-05-20T21:56:26.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f08ff9640 1 -- 172.21.15.50:0/1372464368 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f8f000047e0 con 0x7f8f0c107910 2024-05-20T21:56:26.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f08ff9640 1 -- 172.21.15.50:0/1372464368 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1481678435 0 0) 0x7f8f0c19bbf0 con 0x7f8f0c107910 2024-05-20T21:56:26.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f08ff9640 1 -- 172.21.15.50:0/1372464368 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0c19bdc0 con 0x7f8f0c107910 2024-05-20T21:56:26.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f12191640 1 -- 172.21.15.50:0/1372464368 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8f0c19c0d0 con 0x7f8f0c107910 2024-05-20T21:56:26.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f12191640 1 -- 172.21.15.50:0/1372464368 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8f0c19fc60 con 0x7f8f0c107910 2024-05-20T21:56:26.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f08ff9640 1 -- 172.21.15.50:0/1372464368 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7f8f000049b0 con 0x7f8f0c107910 2024-05-20T21:56:26.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f08ff9640 1 -- 172.21.15.50:0/1372464368 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f8f00001d30 con 0x7f8f0c107910 2024-05-20T21:56:26.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f08ff9640 1 -- 172.21.15.50:0/1372464368 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f8f00006490 con 0x7f8f0c107910 2024-05-20T21:56:26.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.412+0000 7f8f08ff9640 1 -- 172.21.15.50:0/1372464368 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 276627905 0 0) 0x7f8f00006ac0 con 0x7f8f0c107910 2024-05-20T21:56:26.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.416+0000 7f8f12191640 1 -- 172.21.15.50:0/1372464368 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ef8005080 con 0x7f8f0c107910 2024-05-20T21:56:26.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.416+0000 7f8f08ff9640 1 -- 172.21.15.50:0/1372464368 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f8f000055d0 con 0x7f8f0c107910 2024-05-20T21:56:26.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.536+0000 7f8f12191640 1 -- 172.21.15.50:0/1372464368 --> v1:172.21.15.50:6789/0 -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f8ef8005370 con 0x7f8f0c107910 2024-05-20T21:56:26.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.540+0000 7f8f08ff9640 1 -- 172.21.15.50:0/1372464368 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (unknown 534127980 0 0) 0x7f8f00005850 con 0x7f8f0c107910 2024-05-20T21:56:26.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.540+0000 7f8f12191640 1 -- 172.21.15.50:0/1372464368 >> v1:172.21.15.50:6789/0 conn(0x7f8f0c107910 legacy=0x7f8f0c19b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:26.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.540+0000 7f8f12191640 1 -- 172.21.15.50:0/1372464368 shutdown_connections 2024-05-20T21:56:26.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.540+0000 7f8f12191640 1 -- 172.21.15.50:0/1372464368 >> 172.21.15.50:0/1372464368 conn(0x7f8f0c07ae20 msgr2=0x7f8f0c1921f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:26.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.540+0000 7f8f12191640 1 -- 172.21.15.50:0/1372464368 shutdown_connections 2024-05-20T21:56:26.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:25.540+0000 7f8f12191640 1 -- 172.21.15.50:0/1372464368 wait complete. 2024-05-20T21:56:26.120 INFO:teuthology.orchestra.run.smithi050.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-20T21:56:26.147 INFO:teuthology.orchestra.run.smithi050.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-20T21:56:26.147 INFO:teuthology.orchestra.run.smithi050.stdout:Creating mgr... 2024-05-20T21:56:26.147 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-20T21:56:26.147 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-20T21:56:26.428 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mgr.y 2024-05-20T21:56:26.428 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to reset failed state of unit ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mgr.y.service: Unit ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mgr.y.service not loaded. 2024-05-20T21:56:26.535 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:26 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T21:56:26.620 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968.target.wants/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mgr.y.service -> /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service. 2024-05-20T21:56:26.629 INFO:teuthology.orchestra.run.smithi050.stdout:firewalld does not appear to be present 2024-05-20T21:56:26.629 INFO:teuthology.orchestra.run.smithi050.stdout:Not possible to enable service . firewalld.service is not available 2024-05-20T21:56:26.629 INFO:teuthology.orchestra.run.smithi050.stdout:firewalld does not appear to be present 2024-05-20T21:56:26.629 INFO:teuthology.orchestra.run.smithi050.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-20T21:56:26.629 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mgr to start... 2024-05-20T21:56:26.629 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mgr... 2024-05-20T21:56:26.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:26 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T21:56:26.952 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:26 smithi050 bash[21866]: audit 2024-05-20T21:56:25.544039+0000 mon.a (mon.0) 12 : audit 1 from='client.? v1:172.21.15.50:0/1372464368' entity='client.admin' 2024-05-20T21:56:28.070 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:27 smithi050 bash[22118]: debug 2024-05-20T21:56:27.943+0000 7fda958e7040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T21:56:28.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:28 smithi050 bash[21866]: audit 2024-05-20T21:56:28.063008+0000 mon.a (mon.0) 13 : audit 0 from='client.? v1:172.21.15.50:0/535870153' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-20T21:56:28.606 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-05-20T21:56:28.606 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-05-20T21:56:28.606 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsid": "9a9abba0-16f3-11ef-bc9a-c7b262605968", 2024-05-20T21:56:28.606 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "health": { 2024-05-20T21:56:28.606 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-20T21:56:28.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-20T21:56:28.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-20T21:56:28.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:28.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-20T21:56:28.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-20T21:56:28.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 0 2024-05-20T21:56:28.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-05-20T21:56:28.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-20T21:56:28.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "a" 2024-05-20T21:56:28.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-05-20T21:56:28.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-05-20T21:56:28.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-20T21:56:28.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T21:56:28.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-20T21:56:28.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-20T21:56:28.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:28.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-20T21:56:28.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T21:56:28.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-20T21:56:28.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-20T21:56:28.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-20T21:56:28.609 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-20T21:56:28.609 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-20T21:56:28.609 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-20T21:56:28.609 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:28.609 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-20T21:56:28.609 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-20T21:56:28.609 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-20T21:56:28.609 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-20T21:56:28.609 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-20T21:56:28.609 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-20T21:56:28.609 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-20T21:56:28.609 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-20T21:56:28.609 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-20T21:56:28.609 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:28.610 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-20T21:56:28.610 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T21:56:28.610 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-20T21:56:28.610 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-20T21:56:28.610 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:28.610 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-20T21:56:28.610 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-20T21:56:28.610 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-20T21:56:28.610 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-20T21:56:28.610 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-20T21:56:28.610 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-20T21:56:28.610 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "restful" 2024-05-20T21:56:28.610 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-05-20T21:56:28.611 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T21:56:28.611 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:28.611 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-20T21:56:28.611 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T21:56:28.611 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modified": "2024-05-20T21:56:19.801482+0000", 2024-05-20T21:56:28.611 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T21:56:28.611 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:28.611 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-20T21:56:28.611 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-05-20T21:56:28.611 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.927+0000 7fe644f09640 1 Processor -- start 2024-05-20T21:56:28.611 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.927+0000 7fe644f09640 1 -- start start 2024-05-20T21:56:28.612 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.927+0000 7fe644f09640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe640109b20 con 0x7fe6401056f0 2024-05-20T21:56:28.612 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.927+0000 7fe63e59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe6401056f0 0x7fe640105b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36934/0 (socket says 172.21.15.50:36934) 2024-05-20T21:56:28.612 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.927+0000 7fe63e59c640 1 -- 172.21.15.50:0/3918240696 learned_addr learned my addr 172.21.15.50:0/3918240696 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:28.612 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.927+0000 7fe63d59a640 1 -- 172.21.15.50:0/3918240696 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 618024539 0 0) 0x7fe640109b20 con 0x7fe6401056f0 2024-05-20T21:56:28.612 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.927+0000 7fe63d59a640 1 -- 172.21.15.50:0/3918240696 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe62c003520 con 0x7fe6401056f0 2024-05-20T21:56:28.612 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.927+0000 7fe63d59a640 1 -- 172.21.15.50:0/3918240696 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2918941008 0 0) 0x7fe62c003520 con 0x7fe6401056f0 2024-05-20T21:56:28.612 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.927+0000 7fe63d59a640 1 -- 172.21.15.50:0/3918240696 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64010ad00 con 0x7fe6401056f0 2024-05-20T21:56:28.612 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.927+0000 7fe63d59a640 1 -- 172.21.15.50:0/3918240696 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fe628001580 con 0x7fe6401056f0 2024-05-20T21:56:28.612 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.927+0000 7fe63d59a640 1 -- 172.21.15.50:0/3918240696 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7fe628001d30 con 0x7fe6401056f0 2024-05-20T21:56:28.612 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.927+0000 7fe63d59a640 1 -- 172.21.15.50:0/3918240696 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fe6280058d0 con 0x7fe6401056f0 2024-05-20T21:56:28.613 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe644f09640 1 -- 172.21.15.50:0/3918240696 >> v1:172.21.15.50:6789/0 conn(0x7fe6401056f0 legacy=0x7fe640105b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:28.613 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe644f09640 1 -- 172.21.15.50:0/3918240696 shutdown_connections 2024-05-20T21:56:28.613 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe644f09640 1 -- 172.21.15.50:0/3918240696 >> 172.21.15.50:0/3918240696 conn(0x7fe640100cd0 msgr2=0x7fe6401030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:28.613 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe644f09640 1 -- 172.21.15.50:0/3918240696 shutdown_connections 2024-05-20T21:56:28.613 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe644f09640 1 -- 172.21.15.50:0/3918240696 wait complete. 2024-05-20T21:56:28.613 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe644f09640 1 Processor -- start 2024-05-20T21:56:28.613 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe644f09640 1 -- start start 2024-05-20T21:56:28.613 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe644f09640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe64019f320 con 0x7fe6401056f0 2024-05-20T21:56:28.613 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe63e59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe6401056f0 0x7fe64007b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36938/0 (socket says 172.21.15.50:36938) 2024-05-20T21:56:28.613 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe63e59c640 1 -- 172.21.15.50:0/535870153 learned_addr learned my addr 172.21.15.50:0/535870153 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:28.613 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe6377fe640 1 -- 172.21.15.50:0/535870153 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 263914965 0 0) 0x7fe64019f320 con 0x7fe6401056f0 2024-05-20T21:56:28.613 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe6377fe640 1 -- 172.21.15.50:0/535870153 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe62c005410 con 0x7fe6401056f0 2024-05-20T21:56:28.613 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe6377fe640 1 -- 172.21.15.50:0/535870153 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3984205701 0 0) 0x7fe62c005410 con 0x7fe6401056f0 2024-05-20T21:56:28.613 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe6377fe640 1 -- 172.21.15.50:0/535870153 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe64019f320 con 0x7fe6401056f0 2024-05-20T21:56:28.614 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe6377fe640 1 -- 172.21.15.50:0/535870153 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fe6280047e0 con 0x7fe6401056f0 2024-05-20T21:56:28.614 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe6377fe640 1 -- 172.21.15.50:0/535870153 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1118582321 0 0) 0x7fe64019f320 con 0x7fe6401056f0 2024-05-20T21:56:28.614 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe6377fe640 1 -- 172.21.15.50:0/535870153 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6401a0500 con 0x7fe6401056f0 2024-05-20T21:56:28.614 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe644f09640 1 -- 172.21.15.50:0/535870153 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe64019f4f0 con 0x7fe6401056f0 2024-05-20T21:56:28.614 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe644f09640 1 -- 172.21.15.50:0/535870153 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe64019fa30 con 0x7fe6401056f0 2024-05-20T21:56:28.614 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe6377fe640 1 -- 172.21.15.50:0/535870153 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7fe628001c00 con 0x7fe6401056f0 2024-05-20T21:56:28.614 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe6377fe640 1 -- 172.21.15.50:0/535870153 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fe628005e20 con 0x7fe6401056f0 2024-05-20T21:56:28.614 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe6377fe640 1 -- 172.21.15.50:0/535870153 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7fe6280063d0 con 0x7fe6401056f0 2024-05-20T21:56:28.614 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe6377fe640 1 -- 172.21.15.50:0/535870153 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 276627905 0 0) 0x7fe628007b90 con 0x7fe6401056f0 2024-05-20T21:56:28.614 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.931+0000 7fe644f09640 1 -- 172.21.15.50:0/535870153 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6200050b0 con 0x7fe6401056f0 2024-05-20T21:56:28.614 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:27.939+0000 7fe6377fe640 1 -- 172.21.15.50:0/535870153 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7fe6280049b0 con 0x7fe6401056f0 2024-05-20T21:56:28.614 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:28.059+0000 7fe644f09640 1 -- 172.21.15.50:0/535870153 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fe6200053a0 con 0x7fe6401056f0 2024-05-20T21:56:28.615 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:28.059+0000 7fe6377fe640 1 -- 172.21.15.50:0/535870153 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (unknown 4201413639 0 1651773465) 0x7fe628004c00 con 0x7fe6401056f0 2024-05-20T21:56:28.615 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:28.063+0000 7fe644f09640 1 -- 172.21.15.50:0/535870153 >> v1:172.21.15.50:6789/0 conn(0x7fe6401056f0 legacy=0x7fe64007b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:28.615 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:28.063+0000 7fe644f09640 1 -- 172.21.15.50:0/535870153 shutdown_connections 2024-05-20T21:56:28.615 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:28.063+0000 7fe644f09640 1 -- 172.21.15.50:0/535870153 >> 172.21.15.50:0/535870153 conn(0x7fe640100cd0 msgr2=0x7fe6401030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:28.615 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:28.063+0000 7fe644f09640 1 -- 172.21.15.50:0/535870153 shutdown_connections 2024-05-20T21:56:28.615 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:28.063+0000 7fe644f09640 1 -- 172.21.15.50:0/535870153 wait complete. 2024-05-20T21:56:28.615 INFO:teuthology.orchestra.run.smithi050.stdout:mgr not available, waiting (1/15)... 2024-05-20T21:56:29.695 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:29 smithi050 bash[22118]: debug 2024-05-20T21:56:29.223+0000 7fda958e7040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T21:56:29.695 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:29 smithi050 bash[22118]: debug 2024-05-20T21:56:29.295+0000 7fda958e7040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T21:56:29.695 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:29 smithi050 bash[22118]: debug 2024-05-20T21:56:29.455+0000 7fda958e7040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T21:56:30.446 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:30 smithi050 bash[22118]: debug 2024-05-20T21:56:30.147+0000 7fda958e7040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T21:56:30.446 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:30 smithi050 bash[22118]: debug 2024-05-20T21:56:30.223+0000 7fda958e7040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T21:56:30.446 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:30 smithi050 bash[22118]: debug 2024-05-20T21:56:30.295+0000 7fda958e7040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T21:56:30.925 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:30 smithi050 bash[22118]: debug 2024-05-20T21:56:30.495+0000 7fda958e7040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T21:56:30.925 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:30 smithi050 bash[22118]: debug 2024-05-20T21:56:30.579+0000 7fda958e7040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T21:56:30.925 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:30 smithi050 bash[22118]: debug 2024-05-20T21:56:30.651+0000 7fda958e7040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T21:56:30.925 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:30 smithi050 bash[22118]: debug 2024-05-20T21:56:30.927+0000 7fda958e7040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T21:56:31.195 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:31 smithi050 bash[22118]: debug 2024-05-20T21:56:30.999+0000 7fda958e7040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T21:56:31.570 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:31 smithi050 bash[22118]: debug 2024-05-20T21:56:31.211+0000 7fda958e7040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T21:56:31.571 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:31 smithi050 bash[22118]: debug 2024-05-20T21:56:31.295+0000 7fda958e7040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T21:56:31.826 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:31 smithi050 bash[21866]: audit 2024-05-20T21:56:31.619123+0000 mon.a (mon.0) 14 : audit 0 from='client.? v1:172.21.15.50:0/3424889635' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-20T21:56:31.826 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:31 smithi050 bash[22118]: debug 2024-05-20T21:56:31.571+0000 7fda958e7040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T21:56:31.826 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:31 smithi050 bash[22118]: debug 2024-05-20T21:56:31.767+0000 7fda958e7040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T21:56:32.196 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-05-20T21:56:32.196 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-05-20T21:56:32.196 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsid": "9a9abba0-16f3-11ef-bc9a-c7b262605968", 2024-05-20T21:56:32.196 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "health": { 2024-05-20T21:56:32.196 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-20T21:56:32.196 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-20T21:56:32.196 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-20T21:56:32.196 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:32.196 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-20T21:56:32.196 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-20T21:56:32.197 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 0 2024-05-20T21:56:32.197 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-05-20T21:56:32.197 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-20T21:56:32.197 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "a" 2024-05-20T21:56:32.197 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-05-20T21:56:32.197 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-05-20T21:56:32.197 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:31 smithi050 bash[22118]: debug 2024-05-20T21:56:31.943+0000 7fda958e7040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T21:56:32.197 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:32 smithi050 bash[22118]: debug 2024-05-20T21:56:32.027+0000 7fda958e7040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T21:56:32.199 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-20T21:56:32.199 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T21:56:32.199 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-20T21:56:32.199 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-20T21:56:32.199 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:32.199 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-20T21:56:32.199 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T21:56:32.199 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-20T21:56:32.200 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-20T21:56:32.200 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-20T21:56:32.212 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-20T21:56:32.212 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-20T21:56:32.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-20T21:56:32.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:32.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-20T21:56:32.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-20T21:56:32.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-20T21:56:32.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-20T21:56:32.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-20T21:56:32.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-20T21:56:32.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-20T21:56:32.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-20T21:56:32.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-20T21:56:32.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:32.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-20T21:56:32.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T21:56:32.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-20T21:56:32.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-20T21:56:32.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:32.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-20T21:56:32.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-20T21:56:32.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-20T21:56:32.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-20T21:56:32.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-20T21:56:32.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-20T21:56:32.215 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "restful" 2024-05-20T21:56:32.215 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-05-20T21:56:32.215 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T21:56:32.215 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:32.215 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-20T21:56:32.215 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T21:56:32.215 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modified": "2024-05-20T21:56:19.801482+0000", 2024-05-20T21:56:32.215 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T21:56:32.215 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:32.215 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-20T21:56:32.215 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-05-20T21:56:32.215 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.491+0000 7f54e1f67640 1 Processor -- start 2024-05-20T21:56:32.215 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.491+0000 7f54e1f67640 1 -- start start 2024-05-20T21:56:32.215 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.491+0000 7f54e1f67640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f54dc078ec0 con 0x7f54dc106150 2024-05-20T21:56:32.215 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.491+0000 7f54db7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f54dc106150 0x7f54dc108540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36946/0 (socket says 172.21.15.50:36946) 2024-05-20T21:56:32.216 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.491+0000 7f54db7fe640 1 -- 172.21.15.50:0/1214086296 learned_addr learned my addr 172.21.15.50:0/1214086296 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:32.216 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.491+0000 7f54da7fc640 1 -- 172.21.15.50:0/1214086296 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2867305195 0 0) 0x7f54dc078ec0 con 0x7f54dc106150 2024-05-20T21:56:32.216 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.491+0000 7f54da7fc640 1 -- 172.21.15.50:0/1214086296 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54c4003520 con 0x7f54dc106150 2024-05-20T21:56:32.216 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.491+0000 7f54da7fc640 1 -- 172.21.15.50:0/1214086296 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 980411271 0 0) 0x7f54c4003520 con 0x7f54dc106150 2024-05-20T21:56:32.216 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.491+0000 7f54da7fc640 1 -- 172.21.15.50:0/1214086296 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54dc10ac70 con 0x7f54dc106150 2024-05-20T21:56:32.216 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.491+0000 7f54da7fc640 1 -- 172.21.15.50:0/1214086296 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f54cc001580 con 0x7f54dc106150 2024-05-20T21:56:32.216 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.491+0000 7f54da7fc640 1 -- 172.21.15.50:0/1214086296 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7f54cc001d30 con 0x7f54dc106150 2024-05-20T21:56:32.216 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.491+0000 7f54da7fc640 1 -- 172.21.15.50:0/1214086296 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f54cc0058d0 con 0x7f54dc106150 2024-05-20T21:56:32.216 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.491+0000 7f54e1f67640 1 -- 172.21.15.50:0/1214086296 >> v1:172.21.15.50:6789/0 conn(0x7f54dc106150 legacy=0x7f54dc108540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:32.216 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.491+0000 7f54e1f67640 1 -- 172.21.15.50:0/1214086296 shutdown_connections 2024-05-20T21:56:32.216 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.491+0000 7f54e1f67640 1 -- 172.21.15.50:0/1214086296 >> 172.21.15.50:0/1214086296 conn(0x7f54dc0ffb60 msgr2=0x7f54dc101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:32.216 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.491+0000 7f54e1f67640 1 -- 172.21.15.50:0/1214086296 shutdown_connections 2024-05-20T21:56:32.217 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.491+0000 7f54e1f67640 1 -- 172.21.15.50:0/1214086296 wait complete. 2024-05-20T21:56:32.217 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.491+0000 7f54e1f67640 1 Processor -- start 2024-05-20T21:56:32.217 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.491+0000 7f54e1f67640 1 -- start start 2024-05-20T21:56:32.217 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.495+0000 7f54e1f67640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f54dc199a30 con 0x7f54dc106150 2024-05-20T21:56:32.217 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.495+0000 7f54db7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f54dc106150 0x7f54dc199320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36954/0 (socket says 172.21.15.50:36954) 2024-05-20T21:56:32.217 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.495+0000 7f54db7fe640 1 -- 172.21.15.50:0/3424889635 learned_addr learned my addr 172.21.15.50:0/3424889635 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:32.217 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.495+0000 7f54d8ff9640 1 -- 172.21.15.50:0/3424889635 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3052840130 0 0) 0x7f54dc199a30 con 0x7f54dc106150 2024-05-20T21:56:32.217 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.495+0000 7f54d8ff9640 1 -- 172.21.15.50:0/3424889635 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54c4005410 con 0x7f54dc106150 2024-05-20T21:56:32.217 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.495+0000 7f54d8ff9640 1 -- 172.21.15.50:0/3424889635 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3880553778 0 0) 0x7f54c4005410 con 0x7f54dc106150 2024-05-20T21:56:32.217 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.495+0000 7f54d8ff9640 1 -- 172.21.15.50:0/3424889635 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f54dc199a30 con 0x7f54dc106150 2024-05-20T21:56:32.217 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.495+0000 7f54d8ff9640 1 -- 172.21.15.50:0/3424889635 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f54cc001080 con 0x7f54dc106150 2024-05-20T21:56:32.217 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.495+0000 7f54d8ff9640 1 -- 172.21.15.50:0/3424889635 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3604068818 0 0) 0x7f54dc199a30 con 0x7f54dc106150 2024-05-20T21:56:32.218 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.495+0000 7f54d8ff9640 1 -- 172.21.15.50:0/3424889635 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54dc199c00 con 0x7f54dc106150 2024-05-20T21:56:32.218 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.495+0000 7f54e1f67640 1 -- 172.21.15.50:0/3424889635 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f54dc199f10 con 0x7f54dc106150 2024-05-20T21:56:32.218 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.495+0000 7f54e1f67640 1 -- 172.21.15.50:0/3424889635 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f54dc19daa0 con 0x7f54dc106150 2024-05-20T21:56:32.218 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.495+0000 7f54d8ff9640 1 -- 172.21.15.50:0/3424889635 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7f54cc001c80 con 0x7f54dc106150 2024-05-20T21:56:32.218 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.495+0000 7f54d8ff9640 1 -- 172.21.15.50:0/3424889635 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f54cc005f00 con 0x7f54dc106150 2024-05-20T21:56:32.218 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.495+0000 7f54d8ff9640 1 -- 172.21.15.50:0/3424889635 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f54cc006530 con 0x7f54dc106150 2024-05-20T21:56:32.218 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.495+0000 7f54d8ff9640 1 -- 172.21.15.50:0/3424889635 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 276627905 0 0) 0x7f54cc007c90 con 0x7f54dc106150 2024-05-20T21:56:32.218 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.495+0000 7f54e1f67640 1 -- 172.21.15.50:0/3424889635 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54c80050b0 con 0x7f54dc106150 2024-05-20T21:56:32.218 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.499+0000 7f54d8ff9640 1 -- 172.21.15.50:0/3424889635 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f54cc005640 con 0x7f54dc106150 2024-05-20T21:56:32.218 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.615+0000 7f54e1f67640 1 -- 172.21.15.50:0/3424889635 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f54c80053a0 con 0x7f54dc106150 2024-05-20T21:56:32.218 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.615+0000 7f54d8ff9640 1 -- 172.21.15.50:0/3424889635 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (unknown 4201413639 0 1547424794) 0x7f54cc005900 con 0x7f54dc106150 2024-05-20T21:56:32.218 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.619+0000 7f54e1f67640 1 -- 172.21.15.50:0/3424889635 >> v1:172.21.15.50:6789/0 conn(0x7f54dc106150 legacy=0x7f54dc199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:32.219 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.619+0000 7f54e1f67640 1 -- 172.21.15.50:0/3424889635 shutdown_connections 2024-05-20T21:56:32.219 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.619+0000 7f54e1f67640 1 -- 172.21.15.50:0/3424889635 >> 172.21.15.50:0/3424889635 conn(0x7f54dc0ffb60 msgr2=0x7f54dc18fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:32.219 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.619+0000 7f54e1f67640 1 -- 172.21.15.50:0/3424889635 shutdown_connections 2024-05-20T21:56:32.219 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:31.619+0000 7f54e1f67640 1 -- 172.21.15.50:0/3424889635 wait complete. 2024-05-20T21:56:32.219 INFO:teuthology.orchestra.run.smithi050.stdout:mgr not available, waiting (2/15)... 2024-05-20T21:56:32.695 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:32 smithi050 bash[22118]: debug 2024-05-20T21:56:32.223+0000 7fda958e7040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T21:56:33.398 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:33 smithi050 bash[22118]: debug 2024-05-20T21:56:33.075+0000 7fda958e7040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T21:56:33.398 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:33 smithi050 bash[22118]: debug 2024-05-20T21:56:33.155+0000 7fda958e7040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T21:56:33.695 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:33 smithi050 bash[22118]: debug 2024-05-20T21:56:33.399+0000 7fda958e7040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T21:56:33.695 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:33 smithi050 bash[22118]: debug 2024-05-20T21:56:33.479+0000 7fda958e7040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T21:56:34.195 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:33 smithi050 bash[22118]: debug 2024-05-20T21:56:33.895+0000 7fda958e7040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T21:56:34.195 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:33 smithi050 bash[22118]: debug 2024-05-20T21:56:33.979+0000 7fda958e7040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T21:56:34.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:34 smithi050 bash[21866]: cluster 2024-05-20T21:56:34.001608+0000 mon.a (mon.0) 15 : cluster 1 Activating manager daemon y 2024-05-20T21:56:34.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:34 smithi050 bash[21866]: cluster 2024-05-20T21:56:34.008951+0000 mon.a (mon.0) 16 : cluster 0 mgrmap e2: y(active, starting, since 0.00758144s) 2024-05-20T21:56:34.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:34 smithi050 bash[21866]: audit 2024-05-20T21:56:34.010890+0000 mon.a (mon.0) 17 : audit 0 from='mgr.14100 v1:172.21.15.50:0/2949377278' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-20T21:56:34.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:34 smithi050 bash[21866]: audit 2024-05-20T21:56:34.010999+0000 mon.a (mon.0) 18 : audit 0 from='mgr.14100 v1:172.21.15.50:0/2949377278' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-20T21:56:34.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:34 smithi050 bash[21866]: audit 2024-05-20T21:56:34.011092+0000 mon.a (mon.0) 19 : audit 0 from='mgr.14100 v1:172.21.15.50:0/2949377278' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-20T21:56:34.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:34 smithi050 bash[21866]: audit 2024-05-20T21:56:34.011200+0000 mon.a (mon.0) 20 : audit 0 from='mgr.14100 v1:172.21.15.50:0/2949377278' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-20T21:56:34.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:34 smithi050 bash[21866]: audit 2024-05-20T21:56:34.011303+0000 mon.a (mon.0) 21 : audit 0 from='mgr.14100 v1:172.21.15.50:0/2949377278' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-20T21:56:34.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:34 smithi050 bash[21866]: audit 2024-05-20T21:56:34.011405+0000 mon.a (mon.0) 22 : audit 0 from='mgr.14100 v1:172.21.15.50:0/2949377278' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-20T21:56:34.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:34 smithi050 bash[21866]: audit 2024-05-20T21:56:34.011506+0000 mon.a (mon.0) 23 : audit 0 from='mgr.14100 v1:172.21.15.50:0/2949377278' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T21:56:34.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:34 smithi050 bash[21866]: audit 2024-05-20T21:56:34.012449+0000 mon.a (mon.0) 24 : audit 0 from='mgr.14100 v1:172.21.15.50:0/2949377278' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-20T21:56:34.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:34 smithi050 bash[21866]: cluster 2024-05-20T21:56:34.038572+0000 mon.a (mon.0) 25 : cluster 1 Manager daemon y is now available 2024-05-20T21:56:34.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:34 smithi050 bash[21866]: audit 2024-05-20T21:56:34.052500+0000 mon.a (mon.0) 26 : audit 1 from='mgr.14100 v1:172.21.15.50:0/2949377278' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-20T21:56:35.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:35 smithi050 bash[21866]: audit 2024-05-20T21:56:34.055669+0000 mon.a (mon.0) 27 : audit 1 from='mgr.14100 v1:172.21.15.50:0/2949377278' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-20T21:56:35.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:35 smithi050 bash[21866]: audit 2024-05-20T21:56:34.057636+0000 mon.a (mon.0) 28 : audit 1 from='mgr.14100 v1:172.21.15.50:0/2949377278' entity='mgr.y' 2024-05-20T21:56:35.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:35 smithi050 bash[21866]: audit 2024-05-20T21:56:34.059255+0000 mon.a (mon.0) 29 : audit 1 from='mgr.14100 v1:172.21.15.50:0/2949377278' entity='mgr.y' 2024-05-20T21:56:35.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:35 smithi050 bash[21866]: audit 2024-05-20T21:56:34.060901+0000 mon.a (mon.0) 30 : audit 1 from='mgr.14100 v1:172.21.15.50:0/2949377278' entity='mgr.y' 2024-05-20T21:56:35.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:35 smithi050 bash[21866]: cluster 2024-05-20T21:56:35.009128+0000 mon.a (mon.0) 31 : cluster 0 mgrmap e3: y(active, since 1.00777s) 2024-05-20T21:56:36.122 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-05-20T21:56:36.122 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-05-20T21:56:36.122 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsid": "9a9abba0-16f3-11ef-bc9a-c7b262605968", 2024-05-20T21:56:36.122 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "health": { 2024-05-20T21:56:36.122 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-20T21:56:36.122 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-20T21:56:36.122 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-20T21:56:36.122 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:36.122 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-20T21:56:36.122 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-20T21:56:36.123 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 0 2024-05-20T21:56:36.123 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-05-20T21:56:36.123 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-20T21:56:36.123 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "a" 2024-05-20T21:56:36.123 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-05-20T21:56:36.123 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-05-20T21:56:36.123 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-20T21:56:36.123 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T21:56:36.123 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-20T21:56:36.124 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-20T21:56:36.124 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:36.124 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-20T21:56:36.124 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T21:56:36.124 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-20T21:56:36.124 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-20T21:56:36.124 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-20T21:56:36.132 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-20T21:56:36.132 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-20T21:56:36.132 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-20T21:56:36.132 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:36.133 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-20T21:56:36.133 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-20T21:56:36.133 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-20T21:56:36.133 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-20T21:56:36.133 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-20T21:56:36.133 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-20T21:56:36.133 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-20T21:56:36.133 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-20T21:56:36.133 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-20T21:56:36.133 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:36.133 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-20T21:56:36.133 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T21:56:36.134 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-20T21:56:36.134 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-20T21:56:36.134 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:36.134 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-20T21:56:36.134 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-20T21:56:36.134 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-20T21:56:36.134 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-20T21:56:36.134 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-20T21:56:36.134 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-20T21:56:36.134 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "restful" 2024-05-20T21:56:36.134 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-05-20T21:56:36.135 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T21:56:36.135 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:36.135 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-20T21:56:36.135 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T21:56:36.135 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modified": "2024-05-20T21:56:19.801482+0000", 2024-05-20T21:56:36.135 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T21:56:36.135 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-05-20T21:56:36.135 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-20T21:56:36.135 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-05-20T21:56:36.135 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.043+0000 7fcac60c6640 1 Processor -- start 2024-05-20T21:56:36.136 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcac60c6640 1 -- start start 2024-05-20T21:56:36.136 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcac60c6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fcac0079670 con 0x7fcac0106240 2024-05-20T21:56:36.136 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcabf7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcac0106240 0x7fcac0108630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37028/0 (socket says 172.21.15.50:37028) 2024-05-20T21:56:36.136 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcabf7fe640 1 -- 172.21.15.50:0/2521665285 learned_addr learned my addr 172.21.15.50:0/2521665285 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:36.136 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcabe7fc640 1 -- 172.21.15.50:0/2521665285 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1213075614 0 0) 0x7fcac0079670 con 0x7fcac0106240 2024-05-20T21:56:36.136 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcabe7fc640 1 -- 172.21.15.50:0/2521665285 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcaa8003520 con 0x7fcac0106240 2024-05-20T21:56:36.136 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcabe7fc640 1 -- 172.21.15.50:0/2521665285 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1115636457 0 0) 0x7fcaa8003520 con 0x7fcac0106240 2024-05-20T21:56:36.136 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcabe7fc640 1 -- 172.21.15.50:0/2521665285 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac010ad60 con 0x7fcac0106240 2024-05-20T21:56:36.136 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcabe7fc640 1 -- 172.21.15.50:0/2521665285 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fcab0001580 con 0x7fcac0106240 2024-05-20T21:56:36.136 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcabe7fc640 1 -- 172.21.15.50:0/2521665285 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7fcab0001c60 con 0x7fcac0106240 2024-05-20T21:56:36.137 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcabe7fc640 1 -- 172.21.15.50:0/2521665285 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fcab00058d0 con 0x7fcac0106240 2024-05-20T21:56:36.137 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcac60c6640 1 -- 172.21.15.50:0/2521665285 >> v1:172.21.15.50:6789/0 conn(0x7fcac0106240 legacy=0x7fcac0108630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:36.137 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcac60c6640 1 -- 172.21.15.50:0/2521665285 shutdown_connections 2024-05-20T21:56:36.137 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcac60c6640 1 -- 172.21.15.50:0/2521665285 >> 172.21.15.50:0/2521665285 conn(0x7fcac00ffbd0 msgr2=0x7fcac0101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:36.137 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcac60c6640 1 -- 172.21.15.50:0/2521665285 shutdown_connections 2024-05-20T21:56:36.137 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcac60c6640 1 -- 172.21.15.50:0/2521665285 wait complete. 2024-05-20T21:56:36.137 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcac60c6640 1 Processor -- start 2024-05-20T21:56:36.137 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcac60c6640 1 -- start start 2024-05-20T21:56:36.137 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcac60c6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fcac019f3b0 con 0x7fcac0106240 2024-05-20T21:56:36.137 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcabf7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcac0106240 0x7fcac0105ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37040/0 (socket says 172.21.15.50:37040) 2024-05-20T21:56:36.137 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcabf7fe640 1 -- 172.21.15.50:0/1254993884 learned_addr learned my addr 172.21.15.50:0/1254993884 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:36.137 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcabcff9640 1 -- 172.21.15.50:0/1254993884 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2443122299 0 0) 0x7fcac019f3b0 con 0x7fcac0106240 2024-05-20T21:56:36.138 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcabcff9640 1 -- 172.21.15.50:0/1254993884 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcaa8005460 con 0x7fcac0106240 2024-05-20T21:56:36.138 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcabcff9640 1 -- 172.21.15.50:0/1254993884 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3817006062 0 0) 0x7fcaa8005460 con 0x7fcac0106240 2024-05-20T21:56:36.138 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcabcff9640 1 -- 172.21.15.50:0/1254993884 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcac019f3b0 con 0x7fcac0106240 2024-05-20T21:56:36.138 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcabcff9640 1 -- 172.21.15.50:0/1254993884 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fcab0001080 con 0x7fcac0106240 2024-05-20T21:56:36.138 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcabcff9640 1 -- 172.21.15.50:0/1254993884 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 971706540 0 0) 0x7fcac019f3b0 con 0x7fcac0106240 2024-05-20T21:56:36.138 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcabcff9640 1 -- 172.21.15.50:0/1254993884 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac01a0590 con 0x7fcac0106240 2024-05-20T21:56:36.138 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.047+0000 7fcac60c6640 1 -- 172.21.15.50:0/1254993884 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcac019f580 con 0x7fcac0106240 2024-05-20T21:56:36.138 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.051+0000 7fcac60c6640 1 -- 172.21.15.50:0/1254993884 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcac019fac0 con 0x7fcac0106240 2024-05-20T21:56:36.138 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.051+0000 7fcabcff9640 1 -- 172.21.15.50:0/1254993884 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7fcab0001b30 con 0x7fcac0106240 2024-05-20T21:56:36.138 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.051+0000 7fcabcff9640 1 -- 172.21.15.50:0/1254993884 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fcab0005e90 con 0x7fcac0106240 2024-05-20T21:56:36.138 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.051+0000 7fcabcff9640 1 -- 172.21.15.50:0/1254993884 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 3) ==== 46135+0+0 (unknown 900346017 0 0) 0x7fcab0011470 con 0x7fcac0106240 2024-05-20T21:56:36.139 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.051+0000 7fcac60c6640 1 -- 172.21.15.50:0/1254993884 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaac005080 con 0x7fcac0106240 2024-05-20T21:56:36.139 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.051+0000 7fcabcff9640 1 -- 172.21.15.50:0/1254993884 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 276627905 0 0) 0x7fcab00474a0 con 0x7fcac0106240 2024-05-20T21:56:36.139 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.055+0000 7fcabcff9640 1 -- 172.21.15.50:0/1254993884 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7fcab0017370 con 0x7fcac0106240 2024-05-20T21:56:36.139 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.547+0000 7fcac60c6640 1 -- 172.21.15.50:0/1254993884 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fcaac005370 con 0x7fcac0106240 2024-05-20T21:56:36.139 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.547+0000 7fcabcff9640 1 -- 172.21.15.50:0/1254993884 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (unknown 4201413639 0 2120747503) 0x7fcab0016c70 con 0x7fcac0106240 2024-05-20T21:56:36.139 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.547+0000 7fcac60c6640 1 -- 172.21.15.50:0/1254993884 >> v1:172.21.15.50:6800/2047033350 conn(0x7fcaa803a2e0 legacy=0x7fcaa803c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:36.139 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.547+0000 7fcac60c6640 1 -- 172.21.15.50:0/1254993884 >> v1:172.21.15.50:6789/0 conn(0x7fcac0106240 legacy=0x7fcac0105ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:36.139 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.551+0000 7fcac60c6640 1 -- 172.21.15.50:0/1254993884 shutdown_connections 2024-05-20T21:56:36.139 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.551+0000 7fcac60c6640 1 -- 172.21.15.50:0/1254993884 >> 172.21.15.50:0/1254993884 conn(0x7fcac00ffbd0 msgr2=0x7fcac0190060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:36.139 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.551+0000 7fcac60c6640 1 -- 172.21.15.50:0/1254993884 shutdown_connections 2024-05-20T21:56:36.139 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:35.551+0000 7fcac60c6640 1 -- 172.21.15.50:0/1254993884 wait complete. 2024-05-20T21:56:36.140 INFO:teuthology.orchestra.run.smithi050.stdout:mgr is available 2024-05-20T21:56:36.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:36 smithi050 bash[21866]: audit 2024-05-20T21:56:35.549121+0000 mon.a (mon.0) 32 : audit 0 from='client.? v1:172.21.15.50:0/1254993884' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-20T21:56:37.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:37 smithi050 bash[21866]: cluster 2024-05-20T21:56:36.070205+0000 mon.a (mon.0) 33 : cluster 0 mgrmap e4: y(active, since 2s) 2024-05-20T21:56:37.928 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-05-20T21:56:37.928 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [global] 2024-05-20T21:56:37.928 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout fsid = 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:56:37.928 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-20T21:56:37.928 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-20T21:56:37.928 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-20T21:56:37.928 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-20T21:56:37.929 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-05-20T21:56:37.929 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-20T21:56:37.929 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-20T21:56:37.929 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-05-20T21:56:37.929 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [osd] 2024-05-20T21:56:37.929 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-20T21:56:37.929 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-20T21:56:37.929 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.990+0000 7fc638c73640 1 Processor -- start 2024-05-20T21:56:37.929 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.990+0000 7fc638c73640 1 -- start start 2024-05-20T21:56:37.929 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc638c73640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc63407a290 con 0x7fc63407b6d0 2024-05-20T21:56:37.929 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc63259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc63407b6d0 0x7fc634079b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37046/0 (socket says 172.21.15.50:37046) 2024-05-20T21:56:37.929 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc63259c640 1 -- 172.21.15.50:0/2357919479 learned_addr learned my addr 172.21.15.50:0/2357919479 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:37.930 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc631d9b640 1 -- 172.21.15.50:0/2357919479 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1197929385 0 0) 0x7fc63407a290 con 0x7fc63407b6d0 2024-05-20T21:56:37.930 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc631d9b640 1 -- 172.21.15.50:0/2357919479 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc620003520 con 0x7fc63407b6d0 2024-05-20T21:56:37.930 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc631d9b640 1 -- 172.21.15.50:0/2357919479 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2872694711 0 0) 0x7fc620003520 con 0x7fc63407b6d0 2024-05-20T21:56:37.930 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc631d9b640 1 -- 172.21.15.50:0/2357919479 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63407a460 con 0x7fc63407b6d0 2024-05-20T21:56:37.930 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc631d9b640 1 -- 172.21.15.50:0/2357919479 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fc624001580 con 0x7fc63407b6d0 2024-05-20T21:56:37.930 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc631d9b640 1 -- 172.21.15.50:0/2357919479 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7fc624001d30 con 0x7fc63407b6d0 2024-05-20T21:56:37.930 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc631d9b640 1 -- 172.21.15.50:0/2357919479 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fc6240058d0 con 0x7fc63407b6d0 2024-05-20T21:56:37.930 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc638c73640 1 -- 172.21.15.50:0/2357919479 >> v1:172.21.15.50:6789/0 conn(0x7fc63407b6d0 legacy=0x7fc634079b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:37.930 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc638c73640 1 -- 172.21.15.50:0/2357919479 shutdown_connections 2024-05-20T21:56:37.930 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc638c73640 1 -- 172.21.15.50:0/2357919479 >> 172.21.15.50:0/2357919479 conn(0x7fc634100c80 msgr2=0x7fc6341030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:37.930 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc638c73640 1 -- 172.21.15.50:0/2357919479 shutdown_connections 2024-05-20T21:56:37.930 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc638c73640 1 -- 172.21.15.50:0/2357919479 wait complete. 2024-05-20T21:56:37.931 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc638c73640 1 Processor -- start 2024-05-20T21:56:37.931 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc638c73640 1 -- start start 2024-05-20T21:56:37.931 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc638c73640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc63419bb70 con 0x7fc63407b6d0 2024-05-20T21:56:37.931 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc63259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc63407b6d0 0x7fc63419b460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37054/0 (socket says 172.21.15.50:37054) 2024-05-20T21:56:37.931 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc63259c640 1 -- 172.21.15.50:0/3587517319 learned_addr learned my addr 172.21.15.50:0/3587517319 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:37.931 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc62bfff640 1 -- 172.21.15.50:0/3587517319 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2772207203 0 0) 0x7fc63419bb70 con 0x7fc63407b6d0 2024-05-20T21:56:37.931 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc62bfff640 1 -- 172.21.15.50:0/3587517319 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc620005410 con 0x7fc63407b6d0 2024-05-20T21:56:37.931 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc62bfff640 1 -- 172.21.15.50:0/3587517319 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 981408538 0 0) 0x7fc620005410 con 0x7fc63407b6d0 2024-05-20T21:56:37.931 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc62bfff640 1 -- 172.21.15.50:0/3587517319 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc63419bb70 con 0x7fc63407b6d0 2024-05-20T21:56:37.932 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc62bfff640 1 -- 172.21.15.50:0/3587517319 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fc6240047e0 con 0x7fc63407b6d0 2024-05-20T21:56:37.932 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.994+0000 7fc62bfff640 1 -- 172.21.15.50:0/3587517319 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2923498511 0 0) 0x7fc63419bb70 con 0x7fc63407b6d0 2024-05-20T21:56:37.932 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.998+0000 7fc62bfff640 1 -- 172.21.15.50:0/3587517319 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63419bd40 con 0x7fc63407b6d0 2024-05-20T21:56:37.932 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.998+0000 7fc638c73640 1 -- 172.21.15.50:0/3587517319 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc63419c050 con 0x7fc63407b6d0 2024-05-20T21:56:37.932 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.998+0000 7fc638c73640 1 -- 172.21.15.50:0/3587517319 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc63419fbe0 con 0x7fc63407b6d0 2024-05-20T21:56:37.932 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.998+0000 7fc62bfff640 1 -- 172.21.15.50:0/3587517319 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7fc624001190 con 0x7fc63407b6d0 2024-05-20T21:56:37.932 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.998+0000 7fc62bfff640 1 -- 172.21.15.50:0/3587517319 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fc624005ee0 con 0x7fc63407b6d0 2024-05-20T21:56:37.932 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.998+0000 7fc62bfff640 1 -- 172.21.15.50:0/3587517319 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 4) ==== 46241+0+0 (unknown 590601736 0 0) 0x7fc624011530 con 0x7fc63407b6d0 2024-05-20T21:56:37.932 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.998+0000 7fc638c73640 1 -- 172.21.15.50:0/3587517319 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6140050b0 con 0x7fc63407b6d0 2024-05-20T21:56:37.932 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:36.998+0000 7fc62bfff640 1 -- 172.21.15.50:0/3587517319 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 276627905 0 0) 0x7fc624047720 con 0x7fc63407b6d0 2024-05-20T21:56:37.932 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:37.002+0000 7fc62bfff640 1 -- 172.21.15.50:0/3587517319 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7fc624017410 con 0x7fc63407b6d0 2024-05-20T21:56:37.932 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:37.342+0000 7fc638c73640 1 -- 172.21.15.50:0/3587517319 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fc614002420 con 0x7fc63407b6d0 2024-05-20T21:56:37.932 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:37.342+0000 7fc62bfff640 1 -- 172.21.15.50:0/3587517319 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+282 (unknown 1187553405 0 3934443767) 0x7fc624016d10 con 0x7fc63407b6d0 2024-05-20T21:56:37.933 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:37.346+0000 7fc638c73640 1 -- 172.21.15.50:0/3587517319 >> v1:172.21.15.50:6800/2047033350 conn(0x7fc62003a350 legacy=0x7fc62003c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:37.933 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:37.346+0000 7fc638c73640 1 -- 172.21.15.50:0/3587517319 >> v1:172.21.15.50:6789/0 conn(0x7fc63407b6d0 legacy=0x7fc63419b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:37.933 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:37.346+0000 7fc638c73640 1 -- 172.21.15.50:0/3587517319 shutdown_connections 2024-05-20T21:56:37.933 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:37.346+0000 7fc638c73640 1 -- 172.21.15.50:0/3587517319 >> 172.21.15.50:0/3587517319 conn(0x7fc634100c80 msgr2=0x7fc634109bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:37.933 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:37.346+0000 7fc638c73640 1 -- 172.21.15.50:0/3587517319 shutdown_connections 2024-05-20T21:56:37.933 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:37.346+0000 7fc638c73640 1 -- 172.21.15.50:0/3587517319 wait complete. 2024-05-20T21:56:37.933 INFO:teuthology.orchestra.run.smithi050.stdout:Enabling cephadm module... 2024-05-20T21:56:38.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:38 smithi050 bash[21866]: audit 2024-05-20T21:56:37.346704+0000 mon.a (mon.0) 34 : audit 1 from='client.? v1:172.21.15.50:0/3587517319' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-20T21:56:39.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:39 smithi050 bash[21866]: audit 2024-05-20T21:56:39.130618+0000 mon.a (mon.0) 35 : audit 1 from='client.? v1:172.21.15.50:0/1460257712' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-20T21:56:39.446 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:39 smithi050 bash[22118]: ignoring --setuser ceph since I am not root 2024-05-20T21:56:39.446 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:39 smithi050 bash[22118]: ignoring --setgroup ceph since I am not root 2024-05-20T21:56:39.446 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:39 smithi050 bash[22118]: debug 2024-05-20T21:56:39.342+0000 7fe92e125040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T21:56:39.805 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.674+0000 7fb9564c5640 1 Processor -- start 2024-05-20T21:56:39.805 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.674+0000 7fb9564c5640 1 -- start start 2024-05-20T21:56:39.805 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.674+0000 7fb9564c5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb950109b00 con 0x7fb9501056d0 2024-05-20T21:56:39.805 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb94ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb9501056d0 0x7fb950105af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36960/0 (socket says 172.21.15.50:36960) 2024-05-20T21:56:39.805 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb94ffff640 1 -- 172.21.15.50:0/581944329 learned_addr learned my addr 172.21.15.50:0/581944329 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:39.805 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb94effd640 1 -- 172.21.15.50:0/581944329 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1252717329 0 0) 0x7fb950109b00 con 0x7fb9501056d0 2024-05-20T21:56:39.805 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb94effd640 1 -- 172.21.15.50:0/581944329 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb938003520 con 0x7fb9501056d0 2024-05-20T21:56:39.805 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb94effd640 1 -- 172.21.15.50:0/581944329 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4038263606 0 0) 0x7fb938003520 con 0x7fb9501056d0 2024-05-20T21:56:39.805 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb94effd640 1 -- 172.21.15.50:0/581944329 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95010ace0 con 0x7fb9501056d0 2024-05-20T21:56:39.806 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb94effd640 1 -- 172.21.15.50:0/581944329 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fb940001580 con 0x7fb9501056d0 2024-05-20T21:56:39.806 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb94effd640 1 -- 172.21.15.50:0/581944329 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7fb940001c60 con 0x7fb9501056d0 2024-05-20T21:56:39.806 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb94effd640 1 -- 172.21.15.50:0/581944329 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fb9400058d0 con 0x7fb9501056d0 2024-05-20T21:56:39.806 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb9564c5640 1 -- 172.21.15.50:0/581944329 >> v1:172.21.15.50:6789/0 conn(0x7fb9501056d0 legacy=0x7fb950105af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:39.806 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb9564c5640 1 -- 172.21.15.50:0/581944329 shutdown_connections 2024-05-20T21:56:39.806 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb9564c5640 1 -- 172.21.15.50:0/581944329 >> 172.21.15.50:0/581944329 conn(0x7fb950100cb0 msgr2=0x7fb9501030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:39.806 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb9564c5640 1 -- 172.21.15.50:0/581944329 shutdown_connections 2024-05-20T21:56:39.806 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb9564c5640 1 -- 172.21.15.50:0/581944329 wait complete. 2024-05-20T21:56:39.806 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb9564c5640 1 Processor -- start 2024-05-20T21:56:39.807 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb9564c5640 1 -- start start 2024-05-20T21:56:39.807 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb9564c5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb95019bc50 con 0x7fb9501056d0 2024-05-20T21:56:39.807 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb94ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb9501056d0 0x7fb95019b540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36972/0 (socket says 172.21.15.50:36972) 2024-05-20T21:56:39.807 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb94ffff640 1 -- 172.21.15.50:0/1460257712 learned_addr learned my addr 172.21.15.50:0/1460257712 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:39.807 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb94d7fa640 1 -- 172.21.15.50:0/1460257712 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3895270660 0 0) 0x7fb95019bc50 con 0x7fb9501056d0 2024-05-20T21:56:39.807 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb94d7fa640 1 -- 172.21.15.50:0/1460257712 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb938005460 con 0x7fb9501056d0 2024-05-20T21:56:39.807 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb94d7fa640 1 -- 172.21.15.50:0/1460257712 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 681689851 0 0) 0x7fb938005460 con 0x7fb9501056d0 2024-05-20T21:56:39.809 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb94d7fa640 1 -- 172.21.15.50:0/1460257712 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb95019bc50 con 0x7fb9501056d0 2024-05-20T21:56:39.809 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb94d7fa640 1 -- 172.21.15.50:0/1460257712 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fb940001080 con 0x7fb9501056d0 2024-05-20T21:56:39.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb94d7fa640 1 -- 172.21.15.50:0/1460257712 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 711964869 0 0) 0x7fb95019bc50 con 0x7fb9501056d0 2024-05-20T21:56:39.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb94d7fa640 1 -- 172.21.15.50:0/1460257712 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95019be20 con 0x7fb9501056d0 2024-05-20T21:56:39.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb9564c5640 1 -- 172.21.15.50:0/1460257712 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb95019c130 con 0x7fb9501056d0 2024-05-20T21:56:39.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.678+0000 7fb9564c5640 1 -- 172.21.15.50:0/1460257712 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb95019fcc0 con 0x7fb9501056d0 2024-05-20T21:56:39.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.682+0000 7fb94d7fa640 1 -- 172.21.15.50:0/1460257712 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7fb940001c20 con 0x7fb9501056d0 2024-05-20T21:56:39.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.682+0000 7fb94d7fa640 1 -- 172.21.15.50:0/1460257712 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fb940005f40 con 0x7fb9501056d0 2024-05-20T21:56:39.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.682+0000 7fb94d7fa640 1 -- 172.21.15.50:0/1460257712 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 4) ==== 46241+0+0 (unknown 590601736 0 0) 0x7fb940011590 con 0x7fb9501056d0 2024-05-20T21:56:39.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.682+0000 7fb9564c5640 1 -- 172.21.15.50:0/1460257712 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb93c005080 con 0x7fb9501056d0 2024-05-20T21:56:39.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.682+0000 7fb94d7fa640 1 -- 172.21.15.50:0/1460257712 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 276627905 0 0) 0x7fb940047760 con 0x7fb9501056d0 2024-05-20T21:56:39.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:38.686+0000 7fb94d7fa640 1 -- 172.21.15.50:0/1460257712 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7fb940017450 con 0x7fb9501056d0 2024-05-20T21:56:39.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:39.126+0000 7fb9564c5640 1 -- 172.21.15.50:0/1460257712 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fb93c005370 con 0x7fb9501056d0 2024-05-20T21:56:39.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:39.178+0000 7fb94d7fa640 1 -- 172.21.15.50:0/1460257712 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (unknown 2263024820 0 0) 0x7fb940016d50 con 0x7fb9501056d0 2024-05-20T21:56:39.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:39.182+0000 7fb94d7fa640 1 -- 172.21.15.50:0/1460257712 <== mon.0 v1:172.21.15.50:6789/0 11 ==== mgrmap(e 5) ==== 46252+0+0 (unknown 4112656142 0 0) 0x7fb940013390 con 0x7fb9501056d0 2024-05-20T21:56:39.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:39.182+0000 7fb9564c5640 1 -- 172.21.15.50:0/1460257712 >> v1:172.21.15.50:6800/2047033350 conn(0x7fb93803a490 legacy=0x7fb93803c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:39.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:39.182+0000 7fb9564c5640 1 -- 172.21.15.50:0/1460257712 >> v1:172.21.15.50:6789/0 conn(0x7fb9501056d0 legacy=0x7fb95019b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:39.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:39.182+0000 7fb9564c5640 1 -- 172.21.15.50:0/1460257712 shutdown_connections 2024-05-20T21:56:39.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:39.182+0000 7fb9564c5640 1 -- 172.21.15.50:0/1460257712 >> 172.21.15.50:0/1460257712 conn(0x7fb950100cb0 msgr2=0x7fb950101090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:39.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:39.182+0000 7fb9564c5640 1 -- 172.21.15.50:0/1460257712 shutdown_connections 2024-05-20T21:56:39.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:39.182+0000 7fb9564c5640 1 -- 172.21.15.50:0/1460257712 wait complete. 2024-05-20T21:56:40.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:40 smithi050 bash[21866]: audit 2024-05-20T21:56:39.182479+0000 mon.a (mon.0) 36 : audit 1 from='client.? v1:172.21.15.50:0/1460257712' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-20T21:56:40.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:40 smithi050 bash[21866]: cluster 2024-05-20T21:56:39.188378+0000 mon.a (mon.0) 37 : cluster 0 mgrmap e5: y(active, since 5s) 2024-05-20T21:56:40.946 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:40 smithi050 bash[22118]: debug 2024-05-20T21:56:40.622+0000 7fe92e125040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T21:56:40.946 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:40 smithi050 bash[22118]: debug 2024-05-20T21:56:40.690+0000 7fe92e125040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T21:56:40.946 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:40 smithi050 bash[22118]: debug 2024-05-20T21:56:40.854+0000 7fe92e125040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T21:56:41.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:41 smithi050 bash[21866]: audit 2024-05-20T21:56:41.030553+0000 mon.a (mon.0) 38 : audit 0 from='client.? v1:172.21.15.50:0/3787950514' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-20T21:56:41.644 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-05-20T21:56:41.644 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-20T21:56:41.644 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-20T21:56:41.644 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-05-20T21:56:41.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-20T21:56:41.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-05-20T21:56:41.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.566+0000 7f8531908640 1 Processor -- start 2024-05-20T21:56:41.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.566+0000 7f8531908640 1 -- start start 2024-05-20T21:56:41.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.566+0000 7f8531908640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f852c078e80 con 0x7f852c106190 2024-05-20T21:56:41.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f852affd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f852c106190 0x7f852c108580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36980/0 (socket says 172.21.15.50:36980) 2024-05-20T21:56:41.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f852affd640 1 -- 172.21.15.50:0/1861194319 learned_addr learned my addr 172.21.15.50:0/1861194319 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:41.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f852a7fc640 1 -- 172.21.15.50:0/1861194319 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4240472273 0 0) 0x7f852c078e80 con 0x7f852c106190 2024-05-20T21:56:41.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f852a7fc640 1 -- 172.21.15.50:0/1861194319 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8518003520 con 0x7f852c106190 2024-05-20T21:56:41.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f852a7fc640 1 -- 172.21.15.50:0/1861194319 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 655471108 0 0) 0x7f8518003520 con 0x7f852c106190 2024-05-20T21:56:41.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f852a7fc640 1 -- 172.21.15.50:0/1861194319 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f852c10acb0 con 0x7f852c106190 2024-05-20T21:56:41.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f852a7fc640 1 -- 172.21.15.50:0/1861194319 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f851c001580 con 0x7f852c106190 2024-05-20T21:56:41.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f852a7fc640 1 -- 172.21.15.50:0/1861194319 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7f851c001d30 con 0x7f852c106190 2024-05-20T21:56:41.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f852a7fc640 1 -- 172.21.15.50:0/1861194319 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f851c0058d0 con 0x7f852c106190 2024-05-20T21:56:41.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f8531908640 1 -- 172.21.15.50:0/1861194319 >> v1:172.21.15.50:6789/0 conn(0x7f852c106190 legacy=0x7f852c108580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:41.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f8531908640 1 -- 172.21.15.50:0/1861194319 shutdown_connections 2024-05-20T21:56:41.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f8531908640 1 -- 172.21.15.50:0/1861194319 >> 172.21.15.50:0/1861194319 conn(0x7f852c0ffb60 msgr2=0x7f852c101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:41.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f8531908640 1 -- 172.21.15.50:0/1861194319 shutdown_connections 2024-05-20T21:56:41.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f8531908640 1 -- 172.21.15.50:0/1861194319 wait complete. 2024-05-20T21:56:41.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f8531908640 1 Processor -- start 2024-05-20T21:56:41.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f8531908640 1 -- start start 2024-05-20T21:56:41.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f8531908640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f852c199a50 con 0x7f852c106190 2024-05-20T21:56:41.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f852affd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f852c106190 0x7f852c199340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36996/0 (socket says 172.21.15.50:36996) 2024-05-20T21:56:41.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f852affd640 1 -- 172.21.15.50:0/3787950514 learned_addr learned my addr 172.21.15.50:0/3787950514 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:41.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f8530906640 1 -- 172.21.15.50:0/3787950514 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 980603975 0 0) 0x7f852c199a50 con 0x7f852c106190 2024-05-20T21:56:41.647 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f8530906640 1 -- 172.21.15.50:0/3787950514 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8518005410 con 0x7f852c106190 2024-05-20T21:56:41.647 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f8530906640 1 -- 172.21.15.50:0/3787950514 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3825619065 0 0) 0x7f8518005410 con 0x7f852c106190 2024-05-20T21:56:41.647 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f8530906640 1 -- 172.21.15.50:0/3787950514 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f852c199a50 con 0x7f852c106190 2024-05-20T21:56:41.647 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f8530906640 1 -- 172.21.15.50:0/3787950514 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f851c001080 con 0x7f852c106190 2024-05-20T21:56:41.647 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f8530906640 1 -- 172.21.15.50:0/3787950514 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3356454128 0 0) 0x7f852c199a50 con 0x7f852c106190 2024-05-20T21:56:41.647 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f8530906640 1 -- 172.21.15.50:0/3787950514 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f852c199c20 con 0x7f852c106190 2024-05-20T21:56:41.647 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f8531908640 1 -- 172.21.15.50:0/3787950514 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f852c199f30 con 0x7f852c106190 2024-05-20T21:56:41.647 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.570+0000 7f8531908640 1 -- 172.21.15.50:0/3787950514 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f852c19dac0 con 0x7f852c106190 2024-05-20T21:56:41.647 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.574+0000 7f8530906640 1 -- 172.21.15.50:0/3787950514 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7f851c001bc0 con 0x7f852c106190 2024-05-20T21:56:41.647 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.574+0000 7f8530906640 1 -- 172.21.15.50:0/3787950514 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f851c005e90 con 0x7f852c106190 2024-05-20T21:56:41.647 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.574+0000 7f8530906640 1 -- 172.21.15.50:0/3787950514 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 5) ==== 46252+0+0 (unknown 4112656142 0 0) 0x7f851c0115b0 con 0x7f852c106190 2024-05-20T21:56:41.647 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.574+0000 7f8531908640 1 -- 172.21.15.50:0/3787950514 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f850c005080 con 0x7f852c106190 2024-05-20T21:56:41.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.574+0000 7f8530906640 1 -- 172.21.15.50:0/3787950514 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 276627905 0 0) 0x7f851c048500 con 0x7f852c106190 2024-05-20T21:56:41.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.574+0000 7f8523fff640 1 -- 172.21.15.50:0/3787950514 >> v1:172.21.15.50:6800/2047033350 conn(0x7f851803a4f0 legacy=0x7f851803c9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/2047033350 2024-05-20T21:56:41.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.578+0000 7f8530906640 1 -- 172.21.15.50:0/3787950514 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f851c017400 con 0x7f852c106190 2024-05-20T21:56:41.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:40.778+0000 7f8523fff640 1 -- 172.21.15.50:0/3787950514 >> v1:172.21.15.50:6800/2047033350 conn(0x7f851803a4f0 legacy=0x7f851803c9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/2047033350 2024-05-20T21:56:41.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:41.026+0000 7f8531908640 1 -- 172.21.15.50:0/3787950514 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f850c005b80 con 0x7f852c106190 2024-05-20T21:56:41.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:41.026+0000 7f8530906640 1 -- 172.21.15.50:0/3787950514 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (unknown 3768197548 0 15966916) 0x7f851c016d00 con 0x7f852c106190 2024-05-20T21:56:41.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:41.030+0000 7f8531908640 1 -- 172.21.15.50:0/3787950514 >> v1:172.21.15.50:6800/2047033350 conn(0x7f851803a4f0 legacy=0x7f851803c9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T21:56:41.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:41.030+0000 7f8531908640 1 -- 172.21.15.50:0/3787950514 >> v1:172.21.15.50:6789/0 conn(0x7f852c106190 legacy=0x7f852c199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:41.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:41.030+0000 7f8531908640 1 -- 172.21.15.50:0/3787950514 shutdown_connections 2024-05-20T21:56:41.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:41.030+0000 7f8531908640 1 -- 172.21.15.50:0/3787950514 >> 172.21.15.50:0/3787950514 conn(0x7f852c0ffb60 msgr2=0x7f852c18ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:41.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:41.030+0000 7f8531908640 1 -- 172.21.15.50:0/3787950514 shutdown_connections 2024-05-20T21:56:41.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:41.030+0000 7f8531908640 1 -- 172.21.15.50:0/3787950514 wait complete. 2024-05-20T21:56:41.648 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for the mgr to restart... 2024-05-20T21:56:41.649 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mgr epoch 5... 2024-05-20T21:56:41.901 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:41 smithi050 bash[22118]: debug 2024-05-20T21:56:41.550+0000 7fe92e125040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T21:56:41.901 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:41 smithi050 bash[22118]: debug 2024-05-20T21:56:41.626+0000 7fe92e125040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T21:56:41.901 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:41 smithi050 bash[22118]: debug 2024-05-20T21:56:41.702+0000 7fe92e125040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T21:56:41.901 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:41 smithi050 bash[22118]: debug 2024-05-20T21:56:41.902+0000 7fe92e125040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T21:56:42.196 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:41 smithi050 bash[22118]: debug 2024-05-20T21:56:41.982+0000 7fe92e125040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T21:56:42.196 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:42 smithi050 bash[22118]: debug 2024-05-20T21:56:42.058+0000 7fe92e125040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T21:56:42.625 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:42 smithi050 bash[22118]: debug 2024-05-20T21:56:42.334+0000 7fe92e125040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T21:56:42.625 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:42 smithi050 bash[22118]: debug 2024-05-20T21:56:42.410+0000 7fe92e125040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T21:56:42.946 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:42 smithi050 bash[22118]: debug 2024-05-20T21:56:42.626+0000 7fe92e125040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T21:56:42.946 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:42 smithi050 bash[22118]: debug 2024-05-20T21:56:42.706+0000 7fe92e125040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T21:56:43.340 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:42 smithi050 bash[22118]: debug 2024-05-20T21:56:42.974+0000 7fe92e125040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T21:56:43.340 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:43 smithi050 bash[22118]: debug 2024-05-20T21:56:43.166+0000 7fe92e125040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T21:56:43.615 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:43 smithi050 bash[22118]: debug 2024-05-20T21:56:43.338+0000 7fe92e125040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T21:56:43.616 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:43 smithi050 bash[22118]: debug 2024-05-20T21:56:43.422+0000 7fe92e125040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T21:56:43.946 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:43 smithi050 bash[22118]: debug 2024-05-20T21:56:43.614+0000 7fe92e125040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T21:56:44.798 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:44 smithi050 bash[22118]: debug 2024-05-20T21:56:44.474+0000 7fe92e125040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T21:56:44.798 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:44 smithi050 bash[22118]: debug 2024-05-20T21:56:44.558+0000 7fe92e125040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T21:56:45.196 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:44 smithi050 bash[22118]: debug 2024-05-20T21:56:44.798+0000 7fe92e125040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T21:56:45.196 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:44 smithi050 bash[22118]: debug 2024-05-20T21:56:44.878+0000 7fe92e125040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T21:56:45.696 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:45 smithi050 bash[22118]: debug 2024-05-20T21:56:45.294+0000 7fe92e125040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T21:56:45.696 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:45 smithi050 bash[22118]: debug 2024-05-20T21:56:45.378+0000 7fe92e125040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T21:56:45.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:45 smithi050 bash[21866]: cluster 2024-05-20T21:56:45.401714+0000 mon.a (mon.0) 39 : cluster 1 Active manager daemon y restarted 2024-05-20T21:56:45.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:45 smithi050 bash[21866]: cluster 2024-05-20T21:56:45.402335+0000 mon.a (mon.0) 40 : cluster 1 Activating manager daemon y 2024-05-20T21:56:45.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:45 smithi050 bash[21866]: cluster 2024-05-20T21:56:45.406765+0000 mon.a (mon.0) 41 : cluster 0 osdmap e2: 0 total, 0 up, 0 in 2024-05-20T21:56:45.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:45 smithi050 bash[21866]: cluster 2024-05-20T21:56:45.406872+0000 mon.a (mon.0) 42 : cluster 0 mgrmap e6: y(active, starting, since 0.00483096s) 2024-05-20T21:56:45.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:45 smithi050 bash[21866]: audit 2024-05-20T21:56:45.409091+0000 mon.a (mon.0) 43 : audit 0 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T21:56:45.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:45 smithi050 bash[21866]: audit 2024-05-20T21:56:45.410430+0000 mon.a (mon.0) 44 : audit 0 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-20T21:56:45.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:45 smithi050 bash[21866]: audit 2024-05-20T21:56:45.411571+0000 mon.a (mon.0) 45 : audit 0 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-20T21:56:45.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:45 smithi050 bash[21866]: audit 2024-05-20T21:56:45.411768+0000 mon.a (mon.0) 46 : audit 0 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-20T21:56:45.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:45 smithi050 bash[21866]: audit 2024-05-20T21:56:45.411884+0000 mon.a (mon.0) 47 : audit 0 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-20T21:56:45.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:45 smithi050 bash[21866]: cluster 2024-05-20T21:56:45.442344+0000 mon.a (mon.0) 48 : cluster 1 Manager daemon y is now available 2024-05-20T21:56:46.461 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:46 smithi050 bash[21866]: cephadm 2024-05-20T21:56:45.462064+0000 mgr.y (mgr.14118) 1 : cephadm 1 Found migration_current of "None". Setting to last migration. 2024-05-20T21:56:46.461 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:46 smithi050 bash[21866]: audit 2024-05-20T21:56:45.464028+0000 mon.a (mon.0) 49 : audit 1 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' 2024-05-20T21:56:46.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:46 smithi050 bash[21866]: audit 2024-05-20T21:56:45.466496+0000 mon.a (mon.0) 50 : audit 1 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' 2024-05-20T21:56:46.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:46 smithi050 bash[21866]: audit 2024-05-20T21:56:45.469937+0000 mon.a (mon.0) 51 : audit 0 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:56:46.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:46 smithi050 bash[21866]: audit 2024-05-20T21:56:45.473259+0000 mon.a (mon.0) 52 : audit 0 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:56:46.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:46 smithi050 bash[21866]: audit 2024-05-20T21:56:45.484138+0000 mon.a (mon.0) 53 : audit 1 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-20T21:56:46.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:46 smithi050 bash[21866]: audit 2024-05-20T21:56:45.486156+0000 mon.a (mon.0) 54 : audit 1 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-20T21:56:46.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:46 smithi050 bash[21866]: audit 2024-05-20T21:56:46.041078+0000 mon.a (mon.0) 55 : audit 1 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' 2024-05-20T21:56:46.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:46 smithi050 bash[21866]: audit 2024-05-20T21:56:46.045750+0000 mon.a (mon.0) 56 : audit 1 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' 2024-05-20T21:56:46.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:46 smithi050 bash[21866]: cluster 2024-05-20T21:56:46.414486+0000 mon.a (mon.0) 57 : cluster 0 mgrmap e7: y(active, since 1.01243s) 2024-05-20T21:56:47.058 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-05-20T21:56:47.058 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-20T21:56:47.058 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-20T21:56:47.058 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-05-20T21:56:47.058 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.530+0000 7fcc71a29640 1 Processor -- start 2024-05-20T21:56:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.530+0000 7fcc71a29640 1 -- start start 2024-05-20T21:56:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.530+0000 7fcc71a29640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fcc6c109c50 con 0x7fcc6c1039a0 2024-05-20T21:56:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.530+0000 7fcc6affd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcc6c1039a0 0x7fcc6c103dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37008/0 (socket says 172.21.15.50:37008) 2024-05-20T21:56:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.530+0000 7fcc6affd640 1 -- 172.21.15.50:0/1693384481 learned_addr learned my addr 172.21.15.50:0/1693384481 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.530+0000 7fcc69ffb640 1 -- 172.21.15.50:0/1693384481 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4015595944 0 0) 0x7fcc6c109c50 con 0x7fcc6c1039a0 2024-05-20T21:56:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.530+0000 7fcc69ffb640 1 -- 172.21.15.50:0/1693384481 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc54003520 con 0x7fcc6c1039a0 2024-05-20T21:56:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.530+0000 7fcc69ffb640 1 -- 172.21.15.50:0/1693384481 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1605631541 0 0) 0x7fcc54003520 con 0x7fcc6c1039a0 2024-05-20T21:56:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.530+0000 7fcc69ffb640 1 -- 172.21.15.50:0/1693384481 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6c10ae30 con 0x7fcc6c1039a0 2024-05-20T21:56:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.530+0000 7fcc69ffb640 1 -- 172.21.15.50:0/1693384481 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fcc5c001580 con 0x7fcc6c1039a0 2024-05-20T21:56:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.530+0000 7fcc69ffb640 1 -- 172.21.15.50:0/1693384481 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7fcc5c001c60 con 0x7fcc6c1039a0 2024-05-20T21:56:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.530+0000 7fcc69ffb640 1 -- 172.21.15.50:0/1693384481 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fcc5c0058d0 con 0x7fcc6c1039a0 2024-05-20T21:56:47.059 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.530+0000 7fcc71a29640 1 -- 172.21.15.50:0/1693384481 >> v1:172.21.15.50:6789/0 conn(0x7fcc6c1039a0 legacy=0x7fcc6c103dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.530+0000 7fcc71a29640 1 -- 172.21.15.50:0/1693384481 shutdown_connections 2024-05-20T21:56:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.530+0000 7fcc71a29640 1 -- 172.21.15.50:0/1693384481 >> 172.21.15.50:0/1693384481 conn(0x7fcc6c0ff2e0 msgr2=0x7fcc6c101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.530+0000 7fcc71a29640 1 -- 172.21.15.50:0/1693384481 shutdown_connections 2024-05-20T21:56:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.530+0000 7fcc71a29640 1 -- 172.21.15.50:0/1693384481 wait complete. 2024-05-20T21:56:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.530+0000 7fcc71a29640 1 Processor -- start 2024-05-20T21:56:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.534+0000 7fcc71a29640 1 -- start start 2024-05-20T21:56:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.534+0000 7fcc71a29640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fcc6c19f3b0 con 0x7fcc6c1039a0 2024-05-20T21:56:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.534+0000 7fcc6affd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcc6c1039a0 0x7fcc6c1062a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37010/0 (socket says 172.21.15.50:37010) 2024-05-20T21:56:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.534+0000 7fcc6affd640 1 -- 172.21.15.50:0/1062405259 learned_addr learned my addr 172.21.15.50:0/1062405259 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.534+0000 7fcc70a27640 1 -- 172.21.15.50:0/1062405259 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2955373142 0 0) 0x7fcc6c19f3b0 con 0x7fcc6c1039a0 2024-05-20T21:56:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.534+0000 7fcc70a27640 1 -- 172.21.15.50:0/1062405259 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc54005460 con 0x7fcc6c1039a0 2024-05-20T21:56:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.534+0000 7fcc70a27640 1 -- 172.21.15.50:0/1062405259 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 473778632 0 0) 0x7fcc54005460 con 0x7fcc6c1039a0 2024-05-20T21:56:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.534+0000 7fcc70a27640 1 -- 172.21.15.50:0/1062405259 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcc6c19f3b0 con 0x7fcc6c1039a0 2024-05-20T21:56:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.534+0000 7fcc70a27640 1 -- 172.21.15.50:0/1062405259 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fcc5c001080 con 0x7fcc6c1039a0 2024-05-20T21:56:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.534+0000 7fcc70a27640 1 -- 172.21.15.50:0/1062405259 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 785053719 0 0) 0x7fcc6c19f3b0 con 0x7fcc6c1039a0 2024-05-20T21:56:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.534+0000 7fcc70a27640 1 -- 172.21.15.50:0/1062405259 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6c1a0590 con 0x7fcc6c1039a0 2024-05-20T21:56:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.534+0000 7fcc71a29640 1 -- 172.21.15.50:0/1062405259 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcc6c19f580 con 0x7fcc6c1039a0 2024-05-20T21:56:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.534+0000 7fcc71a29640 1 -- 172.21.15.50:0/1062405259 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcc6c19fac0 con 0x7fcc6c1039a0 2024-05-20T21:56:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.534+0000 7fcc70a27640 1 -- 172.21.15.50:0/1062405259 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7fcc5c001c20 con 0x7fcc6c1039a0 2024-05-20T21:56:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.534+0000 7fcc70a27640 1 -- 172.21.15.50:0/1062405259 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fcc5c005f20 con 0x7fcc6c1039a0 2024-05-20T21:56:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.534+0000 7fcc70a27640 1 -- 172.21.15.50:0/1062405259 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 5) ==== 46252+0+0 (unknown 4112656142 0 0) 0x7fcc5c011580 con 0x7fcc6c1039a0 2024-05-20T21:56:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.534+0000 7fcc70a27640 1 -- 172.21.15.50:0/1062405259 --> v1:172.21.15.50:6800/2047033350 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fcc5c001080 con 0x7fcc5403a440 2024-05-20T21:56:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.534+0000 7fcc70a27640 1 -- 172.21.15.50:0/1062405259 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 276627905 0 0) 0x7fcc5c0477c0 con 0x7fcc6c1039a0 2024-05-20T21:56:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.534+0000 7fcc6a7fc640 1 -- 172.21.15.50:0/1062405259 >> v1:172.21.15.50:6800/2047033350 conn(0x7fcc5403a440 legacy=0x7fcc5403c900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/2047033350 2024-05-20T21:56:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:42.738+0000 7fcc6a7fc640 1 -- 172.21.15.50:0/1062405259 >> v1:172.21.15.50:6800/2047033350 conn(0x7fcc5403a440 legacy=0x7fcc5403c900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/2047033350 2024-05-20T21:56:47.061 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:43.142+0000 7fcc6a7fc640 1 -- 172.21.15.50:0/1062405259 >> v1:172.21.15.50:6800/2047033350 conn(0x7fcc5403a440 legacy=0x7fcc5403c900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/2047033350 2024-05-20T21:56:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:43.946+0000 7fcc6a7fc640 1 -- 172.21.15.50:0/1062405259 >> v1:172.21.15.50:6800/2047033350 conn(0x7fcc5403a440 legacy=0x7fcc5403c900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/2047033350 2024-05-20T21:56:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:45.402+0000 7fcc70a27640 1 -- 172.21.15.50:0/1062405259 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mgrmap(e 6) ==== 46054+0+0 (unknown 1132209087 0 0) 0x7fcc5c0461b0 con 0x7fcc6c1039a0 2024-05-20T21:56:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:45.402+0000 7fcc70a27640 1 -- 172.21.15.50:0/1062405259 >> v1:172.21.15.50:6800/2047033350 conn(0x7fcc5403a440 legacy=0x7fcc5403c900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T21:56:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:46.406+0000 7fcc70a27640 1 -- 172.21.15.50:0/1062405259 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mgrmap(e 7) ==== 46146+0+0 (unknown 3385761715 0 0) 0x7fcc5c012a50 con 0x7fcc6c1039a0 2024-05-20T21:56:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:46.406+0000 7fcc70a27640 1 -- 172.21.15.50:0/1062405259 --> v1:172.21.15.50:6800/3032841639 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fcc5c001080 con 0x7fcc5403ecd0 2024-05-20T21:56:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:46.410+0000 7fcc70a27640 1 -- 172.21.15.50:0/1062405259 <== mgr.14118 v1:172.21.15.50:6800/3032841639 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (unknown 0 0 4109177037) 0x7fcc5c001080 con 0x7fcc5403ecd0 2024-05-20T21:56:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:46.418+0000 7fcc71a29640 1 -- 172.21.15.50:0/1062405259 --> v1:172.21.15.50:6800/3032841639 -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fcc580025a0 con 0x7fcc5403ecd0 2024-05-20T21:56:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:46.418+0000 7fcc70a27640 1 -- 172.21.15.50:0/1062405259 <== mgr.14118 v1:172.21.15.50:6800/3032841639 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (unknown 0 0 96372106) 0x7fcc580025a0 con 0x7fcc5403ecd0 2024-05-20T21:56:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:46.422+0000 7fcc71a29640 1 -- 172.21.15.50:0/1062405259 >> v1:172.21.15.50:6800/3032841639 conn(0x7fcc5403ecd0 legacy=0x7fcc540410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:46.422+0000 7fcc71a29640 1 -- 172.21.15.50:0/1062405259 >> v1:172.21.15.50:6789/0 conn(0x7fcc6c1039a0 legacy=0x7fcc6c1062a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:46.422+0000 7fcc71a29640 1 -- 172.21.15.50:0/1062405259 shutdown_connections 2024-05-20T21:56:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:46.422+0000 7fcc71a29640 1 -- 172.21.15.50:0/1062405259 >> 172.21.15.50:0/1062405259 conn(0x7fcc6c0ff2e0 msgr2=0x7fcc6c101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:46.422+0000 7fcc71a29640 1 -- 172.21.15.50:0/1062405259 shutdown_connections 2024-05-20T21:56:47.063 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:46.422+0000 7fcc71a29640 1 -- 172.21.15.50:0/1062405259 wait complete. 2024-05-20T21:56:47.063 INFO:teuthology.orchestra.run.smithi050.stdout:mgr epoch 5 is available 2024-05-20T21:56:47.063 INFO:teuthology.orchestra.run.smithi050.stdout:Setting orchestrator backend to cephadm... 2024-05-20T21:56:47.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:47 smithi050 bash[21866]: audit 2024-05-20T21:56:46.411655+0000 mgr.y (mgr.14118) 2 : audit 0 from='client.14122 v1:172.21.15.50:0/1062405259' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-20T21:56:47.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:47 smithi050 bash[21866]: audit 2024-05-20T21:56:46.423253+0000 mgr.y (mgr.14118) 3 : audit 0 from='client.14122 v1:172.21.15.50:0/1062405259' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-20T21:56:48.470 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:48 smithi050 bash[22118]: debug 2024-05-20T21:56:48.286+0000 7fe89b774640 -1 log_channel(cephadm) log [ERR] : [20/May/2024:21:56:48] ENGINE Error in HTTPServer.serve 2024-05-20T21:56:48.470 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:48 smithi050 bash[22118]: Traceback (most recent call last): 2024-05-20T21:56:48.470 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:48 smithi050 bash[22118]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-05-20T21:56:48.470 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:48 smithi050 bash[22118]: self._connections.run(self.expiration_interval) 2024-05-20T21:56:48.470 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:48 smithi050 bash[22118]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-05-20T21:56:48.471 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:48 smithi050 bash[22118]: self._run(expiration_interval) 2024-05-20T21:56:48.471 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:48 smithi050 bash[22118]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-05-20T21:56:48.471 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:48 smithi050 bash[22118]: new_conn = self._from_server_socket(self.server.socket) 2024-05-20T21:56:48.471 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:48 smithi050 bash[22118]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-05-20T21:56:48.471 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:48 smithi050 bash[22118]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-05-20T21:56:48.471 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:48 smithi050 bash[22118]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-05-20T21:56:48.471 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:48 smithi050 bash[22118]: s = self.context.wrap_socket( 2024-05-20T21:56:48.471 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:48 smithi050 bash[22118]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-05-20T21:56:48.471 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:48 smithi050 bash[22118]: return self.sslsocket_class._create( 2024-05-20T21:56:48.471 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:48 smithi050 bash[22118]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-05-20T21:56:48.471 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:48 smithi050 bash[22118]: self.do_handshake() 2024-05-20T21:56:48.471 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:48 smithi050 bash[22118]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-05-20T21:56:48.471 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:48 smithi050 bash[22118]: self._sslobj.do_handshake() 2024-05-20T21:56:48.472 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:48 smithi050 bash[22118]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-05-20T21:56:48.805 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.798+0000 7f1828591640 1 Processor -- start 2024-05-20T21:56:48.805 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.798+0000 7f1828591640 1 -- start start 2024-05-20T21:56:48.805 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.798+0000 7f1828591640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f182007b040 con 0x7f1820079310 2024-05-20T21:56:48.805 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f182632d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1820079310 0x7f1820079730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51622/0 (socket says 172.21.15.50:51622) 2024-05-20T21:56:48.805 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f182632d640 1 -- 172.21.15.50:0/1663649527 learned_addr learned my addr 172.21.15.50:0/1663649527 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:48.805 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f182532b640 1 -- 172.21.15.50:0/1663649527 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1056176348 0 0) 0x7f182007b040 con 0x7f1820079310 2024-05-20T21:56:48.805 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f182532b640 1 -- 172.21.15.50:0/1663649527 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f180c003520 con 0x7f1820079310 2024-05-20T21:56:48.806 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f182532b640 1 -- 172.21.15.50:0/1663649527 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 911142313 0 0) 0x7f180c003520 con 0x7f1820079310 2024-05-20T21:56:48.806 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f182532b640 1 -- 172.21.15.50:0/1663649527 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1820079e40 con 0x7f1820079310 2024-05-20T21:56:48.806 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f182532b640 1 -- 172.21.15.50:0/1663649527 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f1810001580 con 0x7f1820079310 2024-05-20T21:56:48.806 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f182532b640 1 -- 172.21.15.50:0/1663649527 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7f1810001c60 con 0x7f1820079310 2024-05-20T21:56:48.806 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f182532b640 1 -- 172.21.15.50:0/1663649527 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f18100058d0 con 0x7f1820079310 2024-05-20T21:56:48.806 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f1828591640 1 -- 172.21.15.50:0/1663649527 >> v1:172.21.15.50:6789/0 conn(0x7f1820079310 legacy=0x7f1820079730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:48.806 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f1828591640 1 -- 172.21.15.50:0/1663649527 shutdown_connections 2024-05-20T21:56:48.806 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f1828591640 1 -- 172.21.15.50:0/1663649527 >> 172.21.15.50:0/1663649527 conn(0x7f1820100c90 msgr2=0x7f18201030b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:48.806 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f1828591640 1 -- 172.21.15.50:0/1663649527 shutdown_connections 2024-05-20T21:56:48.806 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f1828591640 1 -- 172.21.15.50:0/1663649527 wait complete. 2024-05-20T21:56:48.807 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f1828591640 1 Processor -- start 2024-05-20T21:56:48.807 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f1828591640 1 -- start start 2024-05-20T21:56:48.807 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f1828591640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f182019bd20 con 0x7f1820079310 2024-05-20T21:56:48.807 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f182632d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1820079310 0x7f182019b610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51636/0 (socket says 172.21.15.50:51636) 2024-05-20T21:56:48.807 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f182632d640 1 -- 172.21.15.50:0/2914648539 learned_addr learned my addr 172.21.15.50:0/2914648539 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:48.807 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f18177fe640 1 -- 172.21.15.50:0/2914648539 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2729727408 0 0) 0x7f182019bd20 con 0x7f1820079310 2024-05-20T21:56:48.807 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f18177fe640 1 -- 172.21.15.50:0/2914648539 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f180c005460 con 0x7f1820079310 2024-05-20T21:56:48.807 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f18177fe640 1 -- 172.21.15.50:0/2914648539 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 880061548 0 0) 0x7f180c005460 con 0x7f1820079310 2024-05-20T21:56:48.807 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f18177fe640 1 -- 172.21.15.50:0/2914648539 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f182019bd20 con 0x7f1820079310 2024-05-20T21:56:48.807 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f18177fe640 1 -- 172.21.15.50:0/2914648539 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f1810001080 con 0x7f1820079310 2024-05-20T21:56:48.807 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f18177fe640 1 -- 172.21.15.50:0/2914648539 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2753817381 0 0) 0x7f182019bd20 con 0x7f1820079310 2024-05-20T21:56:48.807 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f18177fe640 1 -- 172.21.15.50:0/2914648539 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f182019bef0 con 0x7f1820079310 2024-05-20T21:56:48.808 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f1828591640 1 -- 172.21.15.50:0/2914648539 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f182019c200 con 0x7f1820079310 2024-05-20T21:56:48.808 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f1828591640 1 -- 172.21.15.50:0/2914648539 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f182019fd90 con 0x7f1820079310 2024-05-20T21:56:48.808 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f18177fe640 1 -- 172.21.15.50:0/2914648539 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7f1810001c20 con 0x7f1820079310 2024-05-20T21:56:48.808 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.802+0000 7f18177fe640 1 -- 172.21.15.50:0/2914648539 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f1810005f90 con 0x7f1820079310 2024-05-20T21:56:48.808 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.806+0000 7f18177fe640 1 -- 172.21.15.50:0/2914648539 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 8) ==== 46252+0+0 (unknown 652970133 0 0) 0x7f1810011610 con 0x7f1820079310 2024-05-20T21:56:48.808 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.806+0000 7f1828591640 1 -- 172.21.15.50:0/2914648539 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18040050b0 con 0x7f1820079310 2024-05-20T21:56:48.808 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.806+0000 7f18177fe640 1 -- 172.21.15.50:0/2914648539 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (unknown 3179596823 0 0) 0x7f1810047860 con 0x7f1820079310 2024-05-20T21:56:48.808 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:47.814+0000 7f18177fe640 1 -- 172.21.15.50:0/2914648539 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f1810017560 con 0x7f1820079310 2024-05-20T21:56:48.808 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:48.186+0000 7f1828591640 1 -- 172.21.15.50:0/2914648539 --> v1:172.21.15.50:6800/3032841639 -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f1804000bc0 con 0x7f180c03a440 2024-05-20T21:56:48.808 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:48.190+0000 7f18177fe640 1 -- 172.21.15.50:0/2914648539 <== mgr.14118 v1:172.21.15.50:6800/3032841639 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (unknown 0 0 0) 0x7f1804000bc0 con 0x7f180c03a440 2024-05-20T21:56:48.808 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:48.194+0000 7f1828591640 1 -- 172.21.15.50:0/2914648539 >> v1:172.21.15.50:6800/3032841639 conn(0x7f180c03a440 legacy=0x7f180c03c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:48.809 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:48.194+0000 7f1828591640 1 -- 172.21.15.50:0/2914648539 >> v1:172.21.15.50:6789/0 conn(0x7f1820079310 legacy=0x7f182019b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:48.809 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:48.194+0000 7f1828591640 1 -- 172.21.15.50:0/2914648539 shutdown_connections 2024-05-20T21:56:48.809 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:48.194+0000 7f1828591640 1 -- 172.21.15.50:0/2914648539 >> 172.21.15.50:0/2914648539 conn(0x7f1820100c90 msgr2=0x7f1820109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:48.809 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:48.194+0000 7f1828591640 1 -- 172.21.15.50:0/2914648539 shutdown_connections 2024-05-20T21:56:48.809 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:48.194+0000 7f1828591640 1 -- 172.21.15.50:0/2914648539 wait complete. 2024-05-20T21:56:48.827 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:48 smithi050 bash[21866]: cluster 2024-05-20T21:56:47.470552+0000 mon.a (mon.0) 58 : cluster 0 mgrmap e8: y(active, since 2s) 2024-05-20T21:56:48.827 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:48 smithi050 bash[21866]: cephadm 2024-05-20T21:56:48.162502+0000 mgr.y (mgr.14118) 4 : cephadm 1 [20/May/2024:21:56:48] ENGINE Bus STARTING 2024-05-20T21:56:48.828 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:48 smithi050 bash[21866]: audit 2024-05-20T21:56:48.190185+0000 mgr.y (mgr.14118) 5 : audit 0 from='client.14130 v1:172.21.15.50:0/2914648539' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T21:56:48.828 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:48 smithi050 bash[21866]: audit 2024-05-20T21:56:48.193666+0000 mon.a (mon.0) 59 : audit 1 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' 2024-05-20T21:56:48.828 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:48 smithi050 bash[21866]: audit 2024-05-20T21:56:48.204521+0000 mon.a (mon.0) 60 : audit 0 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:56:48.828 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:48 smithi050 bash[21866]: audit 2024-05-20T21:56:48.389284+0000 mon.a (mon.0) 61 : audit 0 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:56:49.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: cephadm 2024-05-20T21:56:48.286809+0000 mgr.y (mgr.14118) 6 : cephadm 1 [20/May/2024:21:56:48] ENGINE Serving on https://172.21.15.50:7150 2024-05-20T21:56:49.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: cephadm 2024-05-20T21:56:48.289733+0000 mgr.y (mgr.14118) 7 : cephadm 4 [20/May/2024:21:56:48] ENGINE Error in HTTPServer.serve 2024-05-20T21:56:49.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: Traceback (most recent call last): 2024-05-20T21:56:49.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-05-20T21:56:49.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: self._connections.run(self.expiration_interval) 2024-05-20T21:56:49.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-05-20T21:56:49.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: self._run(expiration_interval) 2024-05-20T21:56:49.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-05-20T21:56:49.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: new_conn = self._from_server_socket(self.server.socket) 2024-05-20T21:56:49.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-05-20T21:56:49.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-05-20T21:56:49.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-05-20T21:56:49.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: s = self.context.wrap_socket( 2024-05-20T21:56:49.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-05-20T21:56:49.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: return self.sslsocket_class._create( 2024-05-20T21:56:49.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-05-20T21:56:49.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: self.do_handshake() 2024-05-20T21:56:49.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-05-20T21:56:49.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: self._sslobj.do_handshake() 2024-05-20T21:56:49.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-05-20T21:56:49.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: cephadm 2024-05-20T21:56:48.388240+0000 mgr.y (mgr.14118) 8 : cephadm 1 [20/May/2024:21:56:48] ENGINE Serving on http://172.21.15.50:8765 2024-05-20T21:56:49.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:49 smithi050 bash[21866]: cephadm 2024-05-20T21:56:48.388358+0000 mgr.y (mgr.14118) 9 : cephadm 1 [20/May/2024:21:56:48] ENGINE Bus STARTED 2024-05-20T21:56:50.640 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-20T21:56:50.640 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.658+0000 7fa531550640 1 Processor -- start 2024-05-20T21:56:50.640 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.658+0000 7fa531550640 1 -- start start 2024-05-20T21:56:50.640 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.658+0000 7fa531550640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa52c079750 con 0x7fa52c103f80 2024-05-20T21:56:50.641 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.658+0000 7fa52affd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa52c103f80 0x7fa52c1043a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51638/0 (socket says 172.21.15.50:51638) 2024-05-20T21:56:50.642 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.658+0000 7fa52affd640 1 -- 172.21.15.50:0/195177438 learned_addr learned my addr 172.21.15.50:0/195177438 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:50.642 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.658+0000 7fa529ffb640 1 -- 172.21.15.50:0/195177438 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3474379800 0 0) 0x7fa52c079750 con 0x7fa52c103f80 2024-05-20T21:56:50.642 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.658+0000 7fa529ffb640 1 -- 172.21.15.50:0/195177438 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa518003520 con 0x7fa52c103f80 2024-05-20T21:56:50.642 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.658+0000 7fa529ffb640 1 -- 172.21.15.50:0/195177438 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3943347128 0 0) 0x7fa518003520 con 0x7fa52c103f80 2024-05-20T21:56:50.642 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.658+0000 7fa529ffb640 1 -- 172.21.15.50:0/195177438 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa52c105ac0 con 0x7fa52c103f80 2024-05-20T21:56:50.642 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.658+0000 7fa529ffb640 1 -- 172.21.15.50:0/195177438 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fa51c001900 con 0x7fa52c103f80 2024-05-20T21:56:50.642 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.658+0000 7fa529ffb640 1 -- 172.21.15.50:0/195177438 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7fa51c0020b0 con 0x7fa52c103f80 2024-05-20T21:56:50.642 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.658+0000 7fa529ffb640 1 -- 172.21.15.50:0/195177438 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fa51c005c50 con 0x7fa52c103f80 2024-05-20T21:56:50.643 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.658+0000 7fa531550640 1 -- 172.21.15.50:0/195177438 >> v1:172.21.15.50:6789/0 conn(0x7fa52c103f80 legacy=0x7fa52c1043a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:50.643 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.658+0000 7fa531550640 1 -- 172.21.15.50:0/195177438 shutdown_connections 2024-05-20T21:56:50.643 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.658+0000 7fa531550640 1 -- 172.21.15.50:0/195177438 >> 172.21.15.50:0/195177438 conn(0x7fa52c0ffb80 msgr2=0x7fa52c102000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:50.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.658+0000 7fa531550640 1 -- 172.21.15.50:0/195177438 shutdown_connections 2024-05-20T21:56:50.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.658+0000 7fa531550640 1 -- 172.21.15.50:0/195177438 wait complete. 2024-05-20T21:56:50.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.658+0000 7fa531550640 1 Processor -- start 2024-05-20T21:56:50.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.658+0000 7fa531550640 1 -- start start 2024-05-20T21:56:50.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.658+0000 7fa531550640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa52c19bc20 con 0x7fa52c103f80 2024-05-20T21:56:50.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.662+0000 7fa52affd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa52c103f80 0x7fa52c19b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51644/0 (socket says 172.21.15.50:51644) 2024-05-20T21:56:50.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.662+0000 7fa52affd640 1 -- 172.21.15.50:0/792717617 learned_addr learned my addr 172.21.15.50:0/792717617 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:50.645 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.662+0000 7fa523fff640 1 -- 172.21.15.50:0/792717617 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 347607723 0 0) 0x7fa52c19bc20 con 0x7fa52c103f80 2024-05-20T21:56:50.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.662+0000 7fa523fff640 1 -- 172.21.15.50:0/792717617 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa518005410 con 0x7fa52c103f80 2024-05-20T21:56:50.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.662+0000 7fa523fff640 1 -- 172.21.15.50:0/792717617 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3557124449 0 0) 0x7fa518005410 con 0x7fa52c103f80 2024-05-20T21:56:50.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.662+0000 7fa523fff640 1 -- 172.21.15.50:0/792717617 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa52c19bc20 con 0x7fa52c103f80 2024-05-20T21:56:50.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.662+0000 7fa523fff640 1 -- 172.21.15.50:0/792717617 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fa51c001400 con 0x7fa52c103f80 2024-05-20T21:56:50.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.662+0000 7fa523fff640 1 -- 172.21.15.50:0/792717617 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4214488840 0 0) 0x7fa52c19bc20 con 0x7fa52c103f80 2024-05-20T21:56:50.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.662+0000 7fa523fff640 1 -- 172.21.15.50:0/792717617 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa52c19bdf0 con 0x7fa52c103f80 2024-05-20T21:56:50.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.662+0000 7fa531550640 1 -- 172.21.15.50:0/792717617 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa52c19c100 con 0x7fa52c103f80 2024-05-20T21:56:50.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.662+0000 7fa531550640 1 -- 172.21.15.50:0/792717617 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa52c19fc90 con 0x7fa52c103f80 2024-05-20T21:56:50.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.662+0000 7fa523fff640 1 -- 172.21.15.50:0/792717617 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7fa51c002000 con 0x7fa52c103f80 2024-05-20T21:56:50.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.662+0000 7fa523fff640 1 -- 172.21.15.50:0/792717617 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fa51c006280 con 0x7fa52c103f80 2024-05-20T21:56:50.646 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.662+0000 7fa523fff640 1 -- 172.21.15.50:0/792717617 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 8) ==== 46252+0+0 (unknown 652970133 0 0) 0x7fa51c011900 con 0x7fa52c103f80 2024-05-20T21:56:50.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.662+0000 7fa531550640 1 -- 172.21.15.50:0/792717617 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa50c0050b0 con 0x7fa52c103f80 2024-05-20T21:56:50.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.662+0000 7fa523fff640 1 -- 172.21.15.50:0/792717617 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (unknown 3179596823 0 0) 0x7fa51c047b20 con 0x7fa52c103f80 2024-05-20T21:56:50.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:49.666+0000 7fa523fff640 1 -- 172.21.15.50:0/792717617 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7fa51c017830 con 0x7fa52c103f80 2024-05-20T21:56:50.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:50.010+0000 7fa531550640 1 -- 172.21.15.50:0/792717617 --> v1:172.21.15.50:6800/3032841639 -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fa50c000bc0 con 0x7fa51803a4a0 2024-05-20T21:56:50.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:50.010+0000 7fa523fff640 1 -- 172.21.15.50:0/792717617 <== mgr.14118 v1:172.21.15.50:6800/3032841639 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (unknown 0 0 2070689548) 0x7fa50c000bc0 con 0x7fa51803a4a0 2024-05-20T21:56:50.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:50.014+0000 7fa531550640 1 -- 172.21.15.50:0/792717617 >> v1:172.21.15.50:6800/3032841639 conn(0x7fa51803a4a0 legacy=0x7fa51803c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:50.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:50.014+0000 7fa531550640 1 -- 172.21.15.50:0/792717617 >> v1:172.21.15.50:6789/0 conn(0x7fa52c103f80 legacy=0x7fa52c19b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:50.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:50.014+0000 7fa531550640 1 -- 172.21.15.50:0/792717617 shutdown_connections 2024-05-20T21:56:50.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:50.014+0000 7fa531550640 1 -- 172.21.15.50:0/792717617 >> 172.21.15.50:0/792717617 conn(0x7fa52c0ffb80 msgr2=0x7fa52c102000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:50.648 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:50.014+0000 7fa531550640 1 -- 172.21.15.50:0/792717617 shutdown_connections 2024-05-20T21:56:50.649 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:50.014+0000 7fa531550640 1 -- 172.21.15.50:0/792717617 wait complete. 2024-05-20T21:56:50.649 INFO:teuthology.orchestra.run.smithi050.stdout:Generating ssh key... 2024-05-20T21:56:50.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:50 smithi050 bash[21866]: audit 2024-05-20T21:56:50.013554+0000 mgr.y (mgr.14118) 10 : audit 0 from='client.14132 v1:172.21.15.50:0/792717617' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T21:56:52.697 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:52 smithi050 bash[22118]: Generating public/private rsa key pair. 2024-05-20T21:56:52.697 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:52 smithi050 bash[22118]: Your identification has been saved in /tmp/tmp8p_4p7tl/key 2024-05-20T21:56:52.697 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:52 smithi050 bash[22118]: Your public key has been saved in /tmp/tmp8p_4p7tl/key.pub 2024-05-20T21:56:52.697 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:52 smithi050 bash[22118]: The key fingerprint is: 2024-05-20T21:56:52.697 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:52 smithi050 bash[22118]: SHA256:Ux1CHcH2ZKWzulL2oUyZwKQZSbeN5E5h+W57V8Fpi5o ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:56:52.697 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:52 smithi050 bash[22118]: The key's randomart image is: 2024-05-20T21:56:52.697 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:52 smithi050 bash[22118]: +---[RSA 3072]----+ 2024-05-20T21:56:52.697 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:52 smithi050 bash[22118]: | ..oB++o ..| 2024-05-20T21:56:52.697 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:52 smithi050 bash[22118]: | o=oB+.o. | 2024-05-20T21:56:52.697 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:52 smithi050 bash[22118]: | **oo++ .| 2024-05-20T21:56:52.698 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:52 smithi050 bash[22118]: | o+o . .B | 2024-05-20T21:56:52.698 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:52 smithi050 bash[22118]: | S .o o+ o| 2024-05-20T21:56:52.698 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:52 smithi050 bash[22118]: | . Oo...| 2024-05-20T21:56:52.698 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:52 smithi050 bash[22118]: | *++ ..| 2024-05-20T21:56:52.698 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:52 smithi050 bash[22118]: | .E+.o .| 2024-05-20T21:56:52.698 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:52 smithi050 bash[22118]: | ... . | 2024-05-20T21:56:52.698 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:56:52 smithi050 bash[22118]: +----[SHA256]-----+ 2024-05-20T21:56:52.774 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fddc76640 1 Processor -- start 2024-05-20T21:56:52.774 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fddc76640 1 -- start start 2024-05-20T21:56:52.774 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fddc76640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f4fd807a340 con 0x7f4fd807b740 2024-05-20T21:56:52.774 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fd77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4fd807b740 0x7f4fd8079ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51652/0 (socket says 172.21.15.50:51652) 2024-05-20T21:56:52.774 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fd77fe640 1 -- 172.21.15.50:0/2888122498 learned_addr learned my addr 172.21.15.50:0/2888122498 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:52.774 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fd67fc640 1 -- 172.21.15.50:0/2888122498 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3165864584 0 0) 0x7f4fd807a340 con 0x7f4fd807b740 2024-05-20T21:56:52.774 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fd67fc640 1 -- 172.21.15.50:0/2888122498 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fc0003520 con 0x7f4fd807b740 2024-05-20T21:56:52.775 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fd67fc640 1 -- 172.21.15.50:0/2888122498 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3608746397 0 0) 0x7f4fc0003520 con 0x7f4fd807b740 2024-05-20T21:56:52.775 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fd67fc640 1 -- 172.21.15.50:0/2888122498 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd807a510 con 0x7f4fd807b740 2024-05-20T21:56:52.775 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fd67fc640 1 -- 172.21.15.50:0/2888122498 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f4fc8001580 con 0x7f4fd807b740 2024-05-20T21:56:52.775 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fd67fc640 1 -- 172.21.15.50:0/2888122498 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7f4fc8001c60 con 0x7f4fd807b740 2024-05-20T21:56:52.775 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fd67fc640 1 -- 172.21.15.50:0/2888122498 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f4fc80058d0 con 0x7f4fd807b740 2024-05-20T21:56:52.775 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fddc76640 1 -- 172.21.15.50:0/2888122498 >> v1:172.21.15.50:6789/0 conn(0x7f4fd807b740 legacy=0x7f4fd8079ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:52.775 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fddc76640 1 -- 172.21.15.50:0/2888122498 shutdown_connections 2024-05-20T21:56:52.775 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fddc76640 1 -- 172.21.15.50:0/2888122498 >> 172.21.15.50:0/2888122498 conn(0x7f4fd8100cb0 msgr2=0x7f4fd81030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:52.775 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fddc76640 1 -- 172.21.15.50:0/2888122498 shutdown_connections 2024-05-20T21:56:52.775 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fddc76640 1 -- 172.21.15.50:0/2888122498 wait complete. 2024-05-20T21:56:52.775 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fddc76640 1 Processor -- start 2024-05-20T21:56:52.775 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fddc76640 1 -- start start 2024-05-20T21:56:52.775 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fddc76640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f4fd819bc70 con 0x7f4fd807b740 2024-05-20T21:56:52.776 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fd77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4fd807b740 0x7f4fd819b560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51666/0 (socket says 172.21.15.50:51666) 2024-05-20T21:56:52.776 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fd77fe640 1 -- 172.21.15.50:0/796265042 learned_addr learned my addr 172.21.15.50:0/796265042 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:52.776 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fd4ff9640 1 -- 172.21.15.50:0/796265042 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3192944678 0 0) 0x7f4fd819bc70 con 0x7f4fd807b740 2024-05-20T21:56:52.776 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.573+0000 7f4fd4ff9640 1 -- 172.21.15.50:0/796265042 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fc0005460 con 0x7f4fd807b740 2024-05-20T21:56:52.776 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.577+0000 7f4fd4ff9640 1 -- 172.21.15.50:0/796265042 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2045247477 0 0) 0x7f4fc0005460 con 0x7f4fd807b740 2024-05-20T21:56:52.776 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.577+0000 7f4fd4ff9640 1 -- 172.21.15.50:0/796265042 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4fd819bc70 con 0x7f4fd807b740 2024-05-20T21:56:52.776 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.577+0000 7f4fd4ff9640 1 -- 172.21.15.50:0/796265042 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f4fc8001080 con 0x7f4fd807b740 2024-05-20T21:56:52.776 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.577+0000 7f4fd4ff9640 1 -- 172.21.15.50:0/796265042 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2111070156 0 0) 0x7f4fd819bc70 con 0x7f4fd807b740 2024-05-20T21:56:52.776 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.577+0000 7f4fd4ff9640 1 -- 172.21.15.50:0/796265042 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd819be40 con 0x7f4fd807b740 2024-05-20T21:56:52.776 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.577+0000 7f4fddc76640 1 -- 172.21.15.50:0/796265042 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd819c150 con 0x7f4fd807b740 2024-05-20T21:56:52.776 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.577+0000 7f4fddc76640 1 -- 172.21.15.50:0/796265042 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4fd819fce0 con 0x7f4fd807b740 2024-05-20T21:56:52.776 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.577+0000 7f4fd4ff9640 1 -- 172.21.15.50:0/796265042 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7f4fc8001c20 con 0x7f4fd807b740 2024-05-20T21:56:52.776 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.577+0000 7f4fd4ff9640 1 -- 172.21.15.50:0/796265042 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f4fc8005f90 con 0x7f4fd807b740 2024-05-20T21:56:52.776 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.577+0000 7f4fd4ff9640 1 -- 172.21.15.50:0/796265042 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 8) ==== 46252+0+0 (unknown 652970133 0 0) 0x7f4fc80115f0 con 0x7f4fd807b740 2024-05-20T21:56:52.776 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.577+0000 7f4fddc76640 1 -- 172.21.15.50:0/796265042 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc40050b0 con 0x7f4fd807b740 2024-05-20T21:56:52.776 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.577+0000 7f4fd4ff9640 1 -- 172.21.15.50:0/796265042 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (unknown 3179596823 0 0) 0x7f4fc8047760 con 0x7f4fd807b740 2024-05-20T21:56:52.777 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.581+0000 7f4fd4ff9640 1 -- 172.21.15.50:0/796265042 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f4fc8017480 con 0x7f4fd807b740 2024-05-20T21:56:52.777 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:51.933+0000 7f4fddc76640 1 -- 172.21.15.50:0/796265042 --> v1:172.21.15.50:6800/3032841639 -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f4fc4000bc0 con 0x7f4fc003a490 2024-05-20T21:56:52.777 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:52.221+0000 7f4fd4ff9640 1 -- 172.21.15.50:0/796265042 <== mgr.14118 v1:172.21.15.50:6800/3032841639 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (unknown 0 0 0) 0x7f4fc4000bc0 con 0x7f4fc003a490 2024-05-20T21:56:52.777 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:52.225+0000 7f4fddc76640 1 -- 172.21.15.50:0/796265042 >> v1:172.21.15.50:6800/3032841639 conn(0x7f4fc003a490 legacy=0x7f4fc003c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:52.777 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:52.225+0000 7f4fddc76640 1 -- 172.21.15.50:0/796265042 >> v1:172.21.15.50:6789/0 conn(0x7f4fd807b740 legacy=0x7f4fd819b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:52.777 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:52.225+0000 7f4fddc76640 1 -- 172.21.15.50:0/796265042 shutdown_connections 2024-05-20T21:56:52.777 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:52.225+0000 7f4fddc76640 1 -- 172.21.15.50:0/796265042 >> 172.21.15.50:0/796265042 conn(0x7f4fd8100cb0 msgr2=0x7f4fd8109bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:52.777 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:52.225+0000 7f4fddc76640 1 -- 172.21.15.50:0/796265042 shutdown_connections 2024-05-20T21:56:52.777 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:52.225+0000 7f4fddc76640 1 -- 172.21.15.50:0/796265042 wait complete. 2024-05-20T21:56:53.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:53 smithi050 bash[21866]: audit 2024-05-20T21:56:51.938236+0000 mgr.y (mgr.14118) 11 : audit 0 from='client.14134 v1:172.21.15.50:0/796265042' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T21:56:53.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:53 smithi050 bash[21866]: cephadm 2024-05-20T21:56:51.938631+0000 mgr.y (mgr.14118) 12 : cephadm 1 Generating ssh key... 2024-05-20T21:56:53.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:53 smithi050 bash[21866]: audit 2024-05-20T21:56:52.222642+0000 mon.a (mon.0) 62 : audit 1 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' 2024-05-20T21:56:53.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:53 smithi050 bash[21866]: audit 2024-05-20T21:56:52.225084+0000 mon.a (mon.0) 63 : audit 1 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' 2024-05-20T21:56:54.552 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEoEXBafi2pttqogN60UbEngYlw3EUn8rkAB4V8PUTnlVLu10csMfeNdcq0ceX33D4pP7ikrd01cTZDPJTl6kKrZCiS+2uuCNN1QAToprkp9p9WdioAM4lNV7FKgCq4R52l2klyhOp3hrRAQGbLs/vYRDrLkV2CvM71i7VRHONz6dAFigJGKeAkKffweqyaIi1Bh4zhN8HwkKB596sr3CEc41jh54QTT6JTGPuAFtN74JSQj01zL2pUumM48gCwNGFe95bosCcUlXjbIDnUu8g5WXZkrzYucPu4HYBxWrhKpChgHve5nvaPcQ+JXHMhdSz1IKZ+RBsCF+Fapqp7CfMRTF+7IYSJ3v8BF7BbiU6OLqvYJXdsKPmH3sN37K92SBcBGbBBcVq7VS0e22jy/z98MjS6WH/ENU+6kZX5DwpaU0ulTOW0vuHDO6+qmlmwNiZgKg0lWvaX1nQnpdtsXuCNvbnj5/VHxml1ojQoUhFtR1fdbwkajyEMYE373zRVuM= ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:56:54.552 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.597+0000 7fa1c4f9f640 1 Processor -- start 2024-05-20T21:56:54.552 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.597+0000 7fa1c4f9f640 1 -- start start 2024-05-20T21:56:54.553 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.597+0000 7fa1c4f9f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa1c0109ae0 con 0x7fa1c0105700 2024-05-20T21:56:54.553 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.597+0000 7fa1be59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa1c0105700 0x7fa1c0105b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51668/0 (socket says 172.21.15.50:51668) 2024-05-20T21:56:54.553 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.597+0000 7fa1be59c640 1 -- 172.21.15.50:0/3228961676 learned_addr learned my addr 172.21.15.50:0/3228961676 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:54.553 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.597+0000 7fa1bd59a640 1 -- 172.21.15.50:0/3228961676 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3220066611 0 0) 0x7fa1c0109ae0 con 0x7fa1c0105700 2024-05-20T21:56:54.553 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.597+0000 7fa1bd59a640 1 -- 172.21.15.50:0/3228961676 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1a8003520 con 0x7fa1c0105700 2024-05-20T21:56:54.553 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.597+0000 7fa1bd59a640 1 -- 172.21.15.50:0/3228961676 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 38182175 0 0) 0x7fa1a8003520 con 0x7fa1c0105700 2024-05-20T21:56:54.554 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.597+0000 7fa1bd59a640 1 -- 172.21.15.50:0/3228961676 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c010acc0 con 0x7fa1c0105700 2024-05-20T21:56:54.554 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.597+0000 7fa1bd59a640 1 -- 172.21.15.50:0/3228961676 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fa1b0001580 con 0x7fa1c0105700 2024-05-20T21:56:54.554 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.597+0000 7fa1bd59a640 1 -- 172.21.15.50:0/3228961676 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7fa1b0001d30 con 0x7fa1c0105700 2024-05-20T21:56:54.554 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.597+0000 7fa1bd59a640 1 -- 172.21.15.50:0/3228961676 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fa1b00058d0 con 0x7fa1c0105700 2024-05-20T21:56:54.554 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.597+0000 7fa1c4f9f640 1 -- 172.21.15.50:0/3228961676 >> v1:172.21.15.50:6789/0 conn(0x7fa1c0105700 legacy=0x7fa1c0105b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:54.555 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.597+0000 7fa1c4f9f640 1 -- 172.21.15.50:0/3228961676 shutdown_connections 2024-05-20T21:56:54.555 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.597+0000 7fa1c4f9f640 1 -- 172.21.15.50:0/3228961676 >> 172.21.15.50:0/3228961676 conn(0x7fa1c0100c80 msgr2=0x7fa1c01030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:54.555 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.597+0000 7fa1c4f9f640 1 -- 172.21.15.50:0/3228961676 shutdown_connections 2024-05-20T21:56:54.555 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.597+0000 7fa1c4f9f640 1 -- 172.21.15.50:0/3228961676 wait complete. 2024-05-20T21:56:54.555 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.597+0000 7fa1c4f9f640 1 Processor -- start 2024-05-20T21:56:54.555 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.597+0000 7fa1c4f9f640 1 -- start start 2024-05-20T21:56:54.555 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.597+0000 7fa1c4f9f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa1c019f270 con 0x7fa1c0105700 2024-05-20T21:56:54.556 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.601+0000 7fa1be59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa1c0105700 0x7fa1c007b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51680/0 (socket says 172.21.15.50:51680) 2024-05-20T21:56:54.556 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.601+0000 7fa1be59c640 1 -- 172.21.15.50:0/987218280 learned_addr learned my addr 172.21.15.50:0/987218280 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:56:54.556 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.601+0000 7fa1af7fe640 1 -- 172.21.15.50:0/987218280 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2793693535 0 0) 0x7fa1c019f270 con 0x7fa1c0105700 2024-05-20T21:56:54.556 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.601+0000 7fa1af7fe640 1 -- 172.21.15.50:0/987218280 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1a8005410 con 0x7fa1c0105700 2024-05-20T21:56:54.556 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.601+0000 7fa1af7fe640 1 -- 172.21.15.50:0/987218280 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2660710783 0 0) 0x7fa1a8005410 con 0x7fa1c0105700 2024-05-20T21:56:54.557 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.601+0000 7fa1af7fe640 1 -- 172.21.15.50:0/987218280 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa1c019f270 con 0x7fa1c0105700 2024-05-20T21:56:54.557 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.601+0000 7fa1af7fe640 1 -- 172.21.15.50:0/987218280 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fa1b00047e0 con 0x7fa1c0105700 2024-05-20T21:56:54.557 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.601+0000 7fa1af7fe640 1 -- 172.21.15.50:0/987218280 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3619437457 0 0) 0x7fa1c019f270 con 0x7fa1c0105700 2024-05-20T21:56:54.557 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.601+0000 7fa1af7fe640 1 -- 172.21.15.50:0/987218280 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c01a0450 con 0x7fa1c0105700 2024-05-20T21:56:54.557 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.601+0000 7fa1c4f9f640 1 -- 172.21.15.50:0/987218280 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c019f440 con 0x7fa1c0105700 2024-05-20T21:56:54.557 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.601+0000 7fa1af7fe640 1 -- 172.21.15.50:0/987218280 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7fa1b00049b0 con 0x7fa1c0105700 2024-05-20T21:56:54.558 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.601+0000 7fa1af7fe640 1 -- 172.21.15.50:0/987218280 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fa1b0006200 con 0x7fa1c0105700 2024-05-20T21:56:54.558 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.601+0000 7fa1c4f9f640 1 -- 172.21.15.50:0/987218280 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa1c019f980 con 0x7fa1c0105700 2024-05-20T21:56:54.558 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.601+0000 7fa1af7fe640 1 -- 172.21.15.50:0/987218280 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 8) ==== 46252+0+0 (unknown 652970133 0 0) 0x7fa1b00063c0 con 0x7fa1c0105700 2024-05-20T21:56:54.558 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.601+0000 7fa1af7fe640 1 -- 172.21.15.50:0/987218280 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (unknown 3179596823 0 0) 0x7fa1b00478f0 con 0x7fa1c0105700 2024-05-20T21:56:54.558 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.601+0000 7fa1c4f9f640 1 -- 172.21.15.50:0/987218280 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1c0062e90 con 0x7fa1c0105700 2024-05-20T21:56:54.558 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.605+0000 7fa1af7fe640 1 -- 172.21.15.50:0/987218280 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7fa1b00174a0 con 0x7fa1c0105700 2024-05-20T21:56:54.559 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.953+0000 7fa1c4f9f640 1 -- 172.21.15.50:0/987218280 --> v1:172.21.15.50:6800/3032841639 -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fa1c01929f0 con 0x7fa1a803a300 2024-05-20T21:56:54.559 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.953+0000 7fa1af7fe640 1 -- 172.21.15.50:0/987218280 <== mgr.14118 v1:172.21.15.50:6800/3032841639 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (unknown 0 0 2913048815) 0x7fa1c01929f0 con 0x7fa1a803a300 2024-05-20T21:56:54.559 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.957+0000 7fa1c4f9f640 1 -- 172.21.15.50:0/987218280 >> v1:172.21.15.50:6800/3032841639 conn(0x7fa1a803a300 legacy=0x7fa1a803c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:54.559 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.957+0000 7fa1c4f9f640 1 -- 172.21.15.50:0/987218280 >> v1:172.21.15.50:6789/0 conn(0x7fa1c0105700 legacy=0x7fa1c007b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:56:54.559 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.957+0000 7fa1c4f9f640 1 -- 172.21.15.50:0/987218280 shutdown_connections 2024-05-20T21:56:54.560 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.957+0000 7fa1c4f9f640 1 -- 172.21.15.50:0/987218280 >> 172.21.15.50:0/987218280 conn(0x7fa1c0100c80 msgr2=0x7fa1c018ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:56:54.560 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.957+0000 7fa1c4f9f640 1 -- 172.21.15.50:0/987218280 shutdown_connections 2024-05-20T21:56:54.560 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:53.957+0000 7fa1c4f9f640 1 -- 172.21.15.50:0/987218280 wait complete. 2024-05-20T21:56:54.560 INFO:teuthology.orchestra.run.smithi050.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-20T21:56:54.561 INFO:teuthology.orchestra.run.smithi050.stdout:Adding key to root@localhost authorized_keys... 2024-05-20T21:56:54.561 INFO:teuthology.orchestra.run.smithi050.stdout:Adding host smithi050... 2024-05-20T21:56:54.567 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:54 smithi050 bash[21866]: audit 2024-05-20T21:56:53.957719+0000 mgr.y (mgr.14118) 13 : audit 0 from='client.14136 v1:172.21.15.50:0/987218280' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T21:56:56.586 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:56 smithi050 bash[21866]: audit 2024-05-20T21:56:55.803938+0000 mgr.y (mgr.14118) 14 : audit 0 from='client.14138 v1:172.21.15.50:0/562325046' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi050", "addr": "172.21.15.50", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T21:56:57.601 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:56:57 smithi050 bash[21866]: cephadm 2024-05-20T21:56:57.093836+0000 mgr.y (mgr.14118) 15 : cephadm 1 Deploying cephadm binary to smithi050 2024-05-20T21:57:01.537 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout Added host 'smithi050' with addr '172.21.15.50' 2024-05-20T21:57:01.537 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.433+0000 7f327630a640 1 Processor -- start 2024-05-20T21:57:01.537 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f327630a640 1 -- start start 2024-05-20T21:57:01.537 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f327630a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f3270109ae0 con 0x7f3270105700 2024-05-20T21:57:01.537 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f326ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3270105700 0x7f3270105b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51684/0 (socket says 172.21.15.50:51684) 2024-05-20T21:57:01.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f326ffff640 1 -- 172.21.15.50:0/392677382 learned_addr learned my addr 172.21.15.50:0/392677382 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:01.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f326effd640 1 -- 172.21.15.50:0/392677382 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2692514781 0 0) 0x7f3270109ae0 con 0x7f3270105700 2024-05-20T21:57:01.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f326effd640 1 -- 172.21.15.50:0/392677382 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3258003520 con 0x7f3270105700 2024-05-20T21:57:01.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f326effd640 1 -- 172.21.15.50:0/392677382 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2701852372 0 0) 0x7f3258003520 con 0x7f3270105700 2024-05-20T21:57:01.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f326effd640 1 -- 172.21.15.50:0/392677382 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f327010acc0 con 0x7f3270105700 2024-05-20T21:57:01.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f326effd640 1 -- 172.21.15.50:0/392677382 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f3260001900 con 0x7f3270105700 2024-05-20T21:57:01.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f326effd640 1 -- 172.21.15.50:0/392677382 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7f3260001fe0 con 0x7f3270105700 2024-05-20T21:57:01.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f326effd640 1 -- 172.21.15.50:0/392677382 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f3260005c50 con 0x7f3270105700 2024-05-20T21:57:01.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f327630a640 1 -- 172.21.15.50:0/392677382 >> v1:172.21.15.50:6789/0 conn(0x7f3270105700 legacy=0x7f3270105b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:01.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f327630a640 1 -- 172.21.15.50:0/392677382 shutdown_connections 2024-05-20T21:57:01.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f327630a640 1 -- 172.21.15.50:0/392677382 >> 172.21.15.50:0/392677382 conn(0x7f3270100c80 msgr2=0x7f32701030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:01.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f327630a640 1 -- 172.21.15.50:0/392677382 shutdown_connections 2024-05-20T21:57:01.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f327630a640 1 -- 172.21.15.50:0/392677382 wait complete. 2024-05-20T21:57:01.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f327630a640 1 Processor -- start 2024-05-20T21:57:01.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f327630a640 1 -- start start 2024-05-20T21:57:01.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f327630a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f327019f2c0 con 0x7f3270105700 2024-05-20T21:57:01.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f326ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3270105700 0x7f327007b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51692/0 (socket says 172.21.15.50:51692) 2024-05-20T21:57:01.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f326ffff640 1 -- 172.21.15.50:0/562325046 learned_addr learned my addr 172.21.15.50:0/562325046 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:01.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f326d7fa640 1 -- 172.21.15.50:0/562325046 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3046770934 0 0) 0x7f327019f2c0 con 0x7f3270105700 2024-05-20T21:57:01.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f326d7fa640 1 -- 172.21.15.50:0/562325046 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3258005460 con 0x7f3270105700 2024-05-20T21:57:01.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f326d7fa640 1 -- 172.21.15.50:0/562325046 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4223306401 0 0) 0x7f3258005460 con 0x7f3270105700 2024-05-20T21:57:01.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f326d7fa640 1 -- 172.21.15.50:0/562325046 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f327019f2c0 con 0x7f3270105700 2024-05-20T21:57:01.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.437+0000 7f326d7fa640 1 -- 172.21.15.50:0/562325046 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f3260001400 con 0x7f3270105700 2024-05-20T21:57:01.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.441+0000 7f326d7fa640 1 -- 172.21.15.50:0/562325046 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1365303986 0 0) 0x7f327019f2c0 con 0x7f3270105700 2024-05-20T21:57:01.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.441+0000 7f326d7fa640 1 -- 172.21.15.50:0/562325046 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32701a04a0 con 0x7f3270105700 2024-05-20T21:57:01.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.441+0000 7f327630a640 1 -- 172.21.15.50:0/562325046 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f327019f490 con 0x7f3270105700 2024-05-20T21:57:01.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.441+0000 7f327630a640 1 -- 172.21.15.50:0/562325046 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f327019f9d0 con 0x7f3270105700 2024-05-20T21:57:01.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.441+0000 7f326d7fa640 1 -- 172.21.15.50:0/562325046 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7f3260001fa0 con 0x7f3270105700 2024-05-20T21:57:01.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.441+0000 7f326d7fa640 1 -- 172.21.15.50:0/562325046 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f3260006250 con 0x7f3270105700 2024-05-20T21:57:01.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.441+0000 7f326d7fa640 1 -- 172.21.15.50:0/562325046 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 8) ==== 46252+0+0 (unknown 652970133 0 0) 0x7f32600118b0 con 0x7f3270105700 2024-05-20T21:57:01.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.441+0000 7f327630a640 1 -- 172.21.15.50:0/562325046 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f325c0050b0 con 0x7f3270105700 2024-05-20T21:57:01.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.441+0000 7f326d7fa640 1 -- 172.21.15.50:0/562325046 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (unknown 3179596823 0 0) 0x7f3260047ba0 con 0x7f3270105700 2024-05-20T21:57:01.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.445+0000 7f326d7fa640 1 -- 172.21.15.50:0/562325046 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f32600177a0 con 0x7f3270105700 2024-05-20T21:57:01.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:56:55.797+0000 7f327630a640 1 -- 172.21.15.50:0/562325046 --> v1:172.21.15.50:6800/3032841639 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi050", "addr": "172.21.15.50", "target": ["mon-mgr", ""]}) -- 0x7f325c000bc0 con 0x7f325803a4e0 2024-05-20T21:57:01.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:00.693+0000 7f326d7fa640 1 -- 172.21.15.50:0/562325046 <== mgr.14118 v1:172.21.15.50:6800/3032841639 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (unknown 0 0 847418828) 0x7f325c000bc0 con 0x7f325803a4e0 2024-05-20T21:57:01.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:00.697+0000 7f327630a640 1 -- 172.21.15.50:0/562325046 >> v1:172.21.15.50:6800/3032841639 conn(0x7f325803a4e0 legacy=0x7f325803c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:01.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:00.697+0000 7f327630a640 1 -- 172.21.15.50:0/562325046 >> v1:172.21.15.50:6789/0 conn(0x7f3270105700 legacy=0x7f327007b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:01.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:00.697+0000 7f327630a640 1 -- 172.21.15.50:0/562325046 shutdown_connections 2024-05-20T21:57:01.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:00.697+0000 7f327630a640 1 -- 172.21.15.50:0/562325046 >> 172.21.15.50:0/562325046 conn(0x7f3270100c80 msgr2=0x7f32701030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:01.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:00.697+0000 7f327630a640 1 -- 172.21.15.50:0/562325046 shutdown_connections 2024-05-20T21:57:01.541 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:00.697+0000 7f327630a640 1 -- 172.21.15.50:0/562325046 wait complete. 2024-05-20T21:57:01.541 INFO:teuthology.orchestra.run.smithi050.stdout:Deploying unmanaged mon service... 2024-05-20T21:57:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:01 smithi050 bash[21866]: audit 2024-05-20T21:57:00.698486+0000 mon.a (mon.0) 64 : audit 1 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' 2024-05-20T21:57:01.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:01 smithi050 bash[21866]: cephadm 2024-05-20T21:57:00.699175+0000 mgr.y (mgr.14118) 16 : cephadm 1 Added host smithi050 2024-05-20T21:57:01.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:01 smithi050 bash[21866]: audit 2024-05-20T21:57:00.699552+0000 mon.a (mon.0) 65 : audit 0 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:57:04.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-20T21:57:04.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe947439640 1 Processor -- start 2024-05-20T21:57:04.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe947439640 1 -- start start 2024-05-20T21:57:04.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe947439640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe940108a10 con 0x7fe9401045e0 2024-05-20T21:57:04.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe9451d5640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe9401045e0 0x7fe940104a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53928/0 (socket says 172.21.15.50:53928) 2024-05-20T21:57:04.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe9451d5640 1 -- 172.21.15.50:0/2345861283 learned_addr learned my addr 172.21.15.50:0/2345861283 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:04.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe93ffff640 1 -- 172.21.15.50:0/2345861283 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4163847259 0 0) 0x7fe940108a10 con 0x7fe9401045e0 2024-05-20T21:57:04.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe93ffff640 1 -- 172.21.15.50:0/2345861283 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe928003520 con 0x7fe9401045e0 2024-05-20T21:57:04.227 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe93ffff640 1 -- 172.21.15.50:0/2345861283 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4228886929 0 0) 0x7fe928003520 con 0x7fe9401045e0 2024-05-20T21:57:04.227 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe93ffff640 1 -- 172.21.15.50:0/2345861283 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe940109bf0 con 0x7fe9401045e0 2024-05-20T21:57:04.227 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe93ffff640 1 -- 172.21.15.50:0/2345861283 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fe930001900 con 0x7fe9401045e0 2024-05-20T21:57:04.227 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe93ffff640 1 -- 172.21.15.50:0/2345861283 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7fe9300020b0 con 0x7fe9401045e0 2024-05-20T21:57:04.227 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe93ffff640 1 -- 172.21.15.50:0/2345861283 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fe930005c50 con 0x7fe9401045e0 2024-05-20T21:57:04.231 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe947439640 1 -- 172.21.15.50:0/2345861283 >> v1:172.21.15.50:6789/0 conn(0x7fe9401045e0 legacy=0x7fe940104a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:04.231 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe947439640 1 -- 172.21.15.50:0/2345861283 shutdown_connections 2024-05-20T21:57:04.231 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe947439640 1 -- 172.21.15.50:0/2345861283 >> 172.21.15.50:0/2345861283 conn(0x7fe9400ffb60 msgr2=0x7fe940101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:04.231 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe947439640 1 -- 172.21.15.50:0/2345861283 shutdown_connections 2024-05-20T21:57:04.231 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe947439640 1 -- 172.21.15.50:0/2345861283 wait complete. 2024-05-20T21:57:04.231 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe947439640 1 Processor -- start 2024-05-20T21:57:04.231 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe947439640 1 -- start start 2024-05-20T21:57:04.232 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe947439640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe94019f350 con 0x7fe9401045e0 2024-05-20T21:57:04.232 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe9451d5640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe9401045e0 0x7fe940101a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53944/0 (socket says 172.21.15.50:53944) 2024-05-20T21:57:04.232 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.141+0000 7fe9451d5640 1 -- 172.21.15.50:0/3170510228 learned_addr learned my addr 172.21.15.50:0/3170510228 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:04.232 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.145+0000 7fe93e7fc640 1 -- 172.21.15.50:0/3170510228 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 8976054 0 0) 0x7fe94019f350 con 0x7fe9401045e0 2024-05-20T21:57:04.232 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.145+0000 7fe93e7fc640 1 -- 172.21.15.50:0/3170510228 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe928005410 con 0x7fe9401045e0 2024-05-20T21:57:04.232 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.145+0000 7fe93e7fc640 1 -- 172.21.15.50:0/3170510228 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3588933835 0 0) 0x7fe928005410 con 0x7fe9401045e0 2024-05-20T21:57:04.232 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.145+0000 7fe93e7fc640 1 -- 172.21.15.50:0/3170510228 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe94019f350 con 0x7fe9401045e0 2024-05-20T21:57:04.232 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.145+0000 7fe93e7fc640 1 -- 172.21.15.50:0/3170510228 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fe930004b60 con 0x7fe9401045e0 2024-05-20T21:57:04.232 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.145+0000 7fe93e7fc640 1 -- 172.21.15.50:0/3170510228 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 635191605 0 0) 0x7fe94019f350 con 0x7fe9401045e0 2024-05-20T21:57:04.232 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.145+0000 7fe93e7fc640 1 -- 172.21.15.50:0/3170510228 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9401a0530 con 0x7fe9401045e0 2024-05-20T21:57:04.232 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.145+0000 7fe947439640 1 -- 172.21.15.50:0/3170510228 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe94019f520 con 0x7fe9401045e0 2024-05-20T21:57:04.232 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.145+0000 7fe947439640 1 -- 172.21.15.50:0/3170510228 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe94019fa60 con 0x7fe9401045e0 2024-05-20T21:57:04.232 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.145+0000 7fe93e7fc640 1 -- 172.21.15.50:0/3170510228 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1045+0+0 (unknown 481289080 0 0) 0x7fe930001f80 con 0x7fe9401045e0 2024-05-20T21:57:04.232 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.145+0000 7fe93e7fc640 1 -- 172.21.15.50:0/3170510228 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fe9300061a0 con 0x7fe9401045e0 2024-05-20T21:57:04.233 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.145+0000 7fe93e7fc640 1 -- 172.21.15.50:0/3170510228 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 8) ==== 46252+0+0 (unknown 652970133 0 0) 0x7fe930011800 con 0x7fe9401045e0 2024-05-20T21:57:04.233 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.145+0000 7fe947439640 1 -- 172.21.15.50:0/3170510228 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe92c0050b0 con 0x7fe9401045e0 2024-05-20T21:57:04.233 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.145+0000 7fe93e7fc640 1 -- 172.21.15.50:0/3170510228 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (unknown 3179596823 0 0) 0x7fe930047b60 con 0x7fe9401045e0 2024-05-20T21:57:04.233 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.149+0000 7fe93e7fc640 1 -- 172.21.15.50:0/3170510228 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7fe930017710 con 0x7fe9401045e0 2024-05-20T21:57:04.233 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.517+0000 7fe947439640 1 -- 172.21.15.50:0/3170510228 --> v1:172.21.15.50:6800/3032841639 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fe92c000bc0 con 0x7fe92803a350 2024-05-20T21:57:04.233 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.525+0000 7fe93e7fc640 1 -- 172.21.15.50:0/3170510228 <== mgr.14118 v1:172.21.15.50:6800/3032841639 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (unknown 0 0 3265049985) 0x7fe92c000bc0 con 0x7fe92803a350 2024-05-20T21:57:04.233 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.529+0000 7fe947439640 1 -- 172.21.15.50:0/3170510228 >> v1:172.21.15.50:6800/3032841639 conn(0x7fe92803a350 legacy=0x7fe92803c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:04.233 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.529+0000 7fe947439640 1 -- 172.21.15.50:0/3170510228 >> v1:172.21.15.50:6789/0 conn(0x7fe9401045e0 legacy=0x7fe940101a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:04.233 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.529+0000 7fe947439640 1 -- 172.21.15.50:0/3170510228 shutdown_connections 2024-05-20T21:57:04.233 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.529+0000 7fe947439640 1 -- 172.21.15.50:0/3170510228 >> 172.21.15.50:0/3170510228 conn(0x7fe9400ffb60 msgr2=0x7fe940077fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:04.233 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.529+0000 7fe947439640 1 -- 172.21.15.50:0/3170510228 shutdown_connections 2024-05-20T21:57:04.233 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:03.529+0000 7fe947439640 1 -- 172.21.15.50:0/3170510228 wait complete. 2024-05-20T21:57:04.233 INFO:teuthology.orchestra.run.smithi050.stdout:Deploying unmanaged mgr service... 2024-05-20T21:57:04.886 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:04 smithi050 bash[21866]: audit 2024-05-20T21:57:03.521663+0000 mgr.y (mgr.14118) 17 : audit 0 from='client.14140 v1:172.21.15.50:0/3170510228' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T21:57:04.886 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:04 smithi050 bash[21866]: cephadm 2024-05-20T21:57:03.524374+0000 mgr.y (mgr.14118) 18 : cephadm 1 Saving service mon spec with placement count:5 2024-05-20T21:57:04.886 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:04 smithi050 bash[21866]: audit 2024-05-20T21:57:03.528839+0000 mon.a (mon.0) 66 : audit 1 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' 2024-05-20T21:57:04.887 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:04 smithi050 bash[21866]: audit 2024-05-20T21:57:03.918757+0000 mon.a (mon.0) 67 : audit 1 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' 2024-05-20T21:57:04.887 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:04 smithi050 bash[21866]: audit 2024-05-20T21:57:04.464614+0000 mon.a (mon.0) 68 : audit 1 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' 2024-05-20T21:57:06.066 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-20T21:57:06.066 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.057+0000 7f68adcb5640 1 Processor -- start 2024-05-20T21:57:06.066 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.057+0000 7f68adcb5640 1 -- start start 2024-05-20T21:57:06.066 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.057+0000 7f68adcb5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f68a810bce0 con 0x7f68a81078b0 2024-05-20T21:57:06.066 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.057+0000 7f68a77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f68a81078b0 0x7f68a8107cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53954/0 (socket says 172.21.15.50:53954) 2024-05-20T21:57:06.068 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.057+0000 7f68a77fe640 1 -- 172.21.15.50:0/2424340676 learned_addr learned my addr 172.21.15.50:0/2424340676 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:06.068 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.057+0000 7f68a67fc640 1 -- 172.21.15.50:0/2424340676 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2171757732 0 0) 0x7f68a810bce0 con 0x7f68a81078b0 2024-05-20T21:57:06.068 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.057+0000 7f68a67fc640 1 -- 172.21.15.50:0/2424340676 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6890003520 con 0x7f68a81078b0 2024-05-20T21:57:06.068 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.057+0000 7f68a67fc640 1 -- 172.21.15.50:0/2424340676 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3029619017 0 0) 0x7f6890003520 con 0x7f68a81078b0 2024-05-20T21:57:06.069 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.057+0000 7f68a67fc640 1 -- 172.21.15.50:0/2424340676 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a810cec0 con 0x7f68a81078b0 2024-05-20T21:57:06.069 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.057+0000 7f68a67fc640 1 -- 172.21.15.50:0/2424340676 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f6898001900 con 0x7f68a81078b0 2024-05-20T21:57:06.069 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.057+0000 7f68a67fc640 1 -- 172.21.15.50:0/2424340676 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f6898004c20 con 0x7f68a81078b0 2024-05-20T21:57:06.069 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.057+0000 7f68a67fc640 1 -- 172.21.15.50:0/2424340676 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f6898005c50 con 0x7f68a81078b0 2024-05-20T21:57:06.069 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.057+0000 7f68adcb5640 1 -- 172.21.15.50:0/2424340676 >> v1:172.21.15.50:6789/0 conn(0x7f68a81078b0 legacy=0x7f68a8107cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:06.069 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.057+0000 7f68adcb5640 1 -- 172.21.15.50:0/2424340676 shutdown_connections 2024-05-20T21:57:06.069 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.057+0000 7f68adcb5640 1 -- 172.21.15.50:0/2424340676 >> 172.21.15.50:0/2424340676 conn(0x7f68a807adf0 msgr2=0x7f68a807b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:06.069 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.057+0000 7f68adcb5640 1 -- 172.21.15.50:0/2424340676 shutdown_connections 2024-05-20T21:57:06.069 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.057+0000 7f68adcb5640 1 -- 172.21.15.50:0/2424340676 wait complete. 2024-05-20T21:57:06.069 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.057+0000 7f68adcb5640 1 Processor -- start 2024-05-20T21:57:06.069 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.057+0000 7f68adcb5640 1 -- start start 2024-05-20T21:57:06.072 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.061+0000 7f68adcb5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f68a819bba0 con 0x7f68a81078b0 2024-05-20T21:57:06.072 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.061+0000 7f68a77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f68a81078b0 0x7f68a819b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53970/0 (socket says 172.21.15.50:53970) 2024-05-20T21:57:06.072 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.061+0000 7f68a77fe640 1 -- 172.21.15.50:0/618144835 learned_addr learned my addr 172.21.15.50:0/618144835 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:06.072 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.061+0000 7f68a4ff9640 1 -- 172.21.15.50:0/618144835 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4245632071 0 0) 0x7f68a819bba0 con 0x7f68a81078b0 2024-05-20T21:57:06.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.061+0000 7f68a4ff9640 1 -- 172.21.15.50:0/618144835 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6890005410 con 0x7f68a81078b0 2024-05-20T21:57:06.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.061+0000 7f68a4ff9640 1 -- 172.21.15.50:0/618144835 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2141000392 0 0) 0x7f6890005410 con 0x7f68a81078b0 2024-05-20T21:57:06.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.061+0000 7f68a4ff9640 1 -- 172.21.15.50:0/618144835 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68a819bba0 con 0x7f68a81078b0 2024-05-20T21:57:06.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.061+0000 7f68a4ff9640 1 -- 172.21.15.50:0/618144835 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f6898001400 con 0x7f68a81078b0 2024-05-20T21:57:06.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.061+0000 7f68a4ff9640 1 -- 172.21.15.50:0/618144835 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3621201118 0 0) 0x7f68a819bba0 con 0x7f68a81078b0 2024-05-20T21:57:06.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.061+0000 7f68a4ff9640 1 -- 172.21.15.50:0/618144835 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a819bd70 con 0x7f68a81078b0 2024-05-20T21:57:06.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.061+0000 7f68adcb5640 1 -- 172.21.15.50:0/618144835 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f68a819c080 con 0x7f68a81078b0 2024-05-20T21:57:06.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.061+0000 7f68adcb5640 1 -- 172.21.15.50:0/618144835 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f68a819fc10 con 0x7f68a81078b0 2024-05-20T21:57:06.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.061+0000 7f68a4ff9640 1 -- 172.21.15.50:0/618144835 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f6898004c20 con 0x7f68a81078b0 2024-05-20T21:57:06.074 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.061+0000 7f68a4ff9640 1 -- 172.21.15.50:0/618144835 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f6898006280 con 0x7f68a81078b0 2024-05-20T21:57:06.074 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.061+0000 7f68a4ff9640 1 -- 172.21.15.50:0/618144835 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 8) ==== 46252+0+0 (unknown 652970133 0 0) 0x7f6898011900 con 0x7f68a81078b0 2024-05-20T21:57:06.074 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.061+0000 7f68adcb5640 1 -- 172.21.15.50:0/618144835 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68940050b0 con 0x7f68a81078b0 2024-05-20T21:57:06.074 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.061+0000 7f68a4ff9640 1 -- 172.21.15.50:0/618144835 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (unknown 3179596823 0 0) 0x7f6898047bf0 con 0x7f68a81078b0 2024-05-20T21:57:06.074 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.065+0000 7f68a4ff9640 1 -- 172.21.15.50:0/618144835 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f6898017830 con 0x7f68a81078b0 2024-05-20T21:57:06.074 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.425+0000 7f68adcb5640 1 -- 172.21.15.50:0/618144835 --> v1:172.21.15.50:6800/3032841639 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f6894000bc0 con 0x7f689003a540 2024-05-20T21:57:06.075 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.433+0000 7f68a4ff9640 1 -- 172.21.15.50:0/618144835 <== mgr.14118 v1:172.21.15.50:6800/3032841639 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (unknown 0 0 325935098) 0x7f6894000bc0 con 0x7f689003a540 2024-05-20T21:57:06.075 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.437+0000 7f68adcb5640 1 -- 172.21.15.50:0/618144835 >> v1:172.21.15.50:6800/3032841639 conn(0x7f689003a540 legacy=0x7f689003ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:06.075 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.437+0000 7f68adcb5640 1 -- 172.21.15.50:0/618144835 >> v1:172.21.15.50:6789/0 conn(0x7f68a81078b0 legacy=0x7f68a819b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:06.075 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.437+0000 7f68adcb5640 1 -- 172.21.15.50:0/618144835 shutdown_connections 2024-05-20T21:57:06.075 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.437+0000 7f68adcb5640 1 -- 172.21.15.50:0/618144835 >> 172.21.15.50:0/618144835 conn(0x7f68a807adf0 msgr2=0x7f68a8106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:06.075 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.437+0000 7f68adcb5640 1 -- 172.21.15.50:0/618144835 shutdown_connections 2024-05-20T21:57:06.075 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:05.437+0000 7f68adcb5640 1 -- 172.21.15.50:0/618144835 wait complete. 2024-05-20T21:57:06.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:06 smithi050 bash[21866]: cluster 2024-05-20T21:57:05.413253+0000 mgr.y (mgr.14118) 19 : cluster 0 pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:57:06.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:06 smithi050 bash[21866]: audit 2024-05-20T21:57:05.432540+0000 mgr.y (mgr.14118) 20 : audit 0 from='client.14142 v1:172.21.15.50:0/618144835' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T21:57:06.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:06 smithi050 bash[21866]: cephadm 2024-05-20T21:57:05.433986+0000 mgr.y (mgr.14118) 21 : cephadm 1 Saving service mgr spec with placement count:2 2024-05-20T21:57:06.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:06 smithi050 bash[21866]: audit 2024-05-20T21:57:05.437942+0000 mon.a (mon.0) 69 : audit 1 from='mgr.14118 v1:172.21.15.50:0/1055842795' entity='mgr.y' 2024-05-20T21:57:07.915 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.909+0000 7f6de6931640 1 Processor -- start 2024-05-20T21:57:07.915 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.909+0000 7f6de6931640 1 -- start start 2024-05-20T21:57:07.915 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.909+0000 7f6de6931640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f6de0109ae0 con 0x7f6de0105700 2024-05-20T21:57:07.916 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.909+0000 7f6ddffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6de0105700 0x7f6de0105b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53984/0 (socket says 172.21.15.50:53984) 2024-05-20T21:57:07.916 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.909+0000 7f6ddffff640 1 -- 172.21.15.50:0/1591229534 learned_addr learned my addr 172.21.15.50:0/1591229534 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:07.916 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.909+0000 7f6ddeffd640 1 -- 172.21.15.50:0/1591229534 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1799833497 0 0) 0x7f6de0109ae0 con 0x7f6de0105700 2024-05-20T21:57:07.916 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6ddeffd640 1 -- 172.21.15.50:0/1591229534 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dc8003520 con 0x7f6de0105700 2024-05-20T21:57:07.916 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6ddeffd640 1 -- 172.21.15.50:0/1591229534 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1993220725 0 0) 0x7f6dc8003520 con 0x7f6de0105700 2024-05-20T21:57:07.916 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6ddeffd640 1 -- 172.21.15.50:0/1591229534 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de010acc0 con 0x7f6de0105700 2024-05-20T21:57:07.916 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6ddeffd640 1 -- 172.21.15.50:0/1591229534 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f6dd0001580 con 0x7f6de0105700 2024-05-20T21:57:07.916 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6ddeffd640 1 -- 172.21.15.50:0/1591229534 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f6dd00048a0 con 0x7f6de0105700 2024-05-20T21:57:07.916 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6ddeffd640 1 -- 172.21.15.50:0/1591229534 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f6dd00058d0 con 0x7f6de0105700 2024-05-20T21:57:07.916 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6de6931640 1 -- 172.21.15.50:0/1591229534 >> v1:172.21.15.50:6789/0 conn(0x7f6de0105700 legacy=0x7f6de0105b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:07.916 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6de6931640 1 -- 172.21.15.50:0/1591229534 shutdown_connections 2024-05-20T21:57:07.917 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6de6931640 1 -- 172.21.15.50:0/1591229534 >> 172.21.15.50:0/1591229534 conn(0x7f6de0100d00 msgr2=0x7f6de0103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:07.917 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6de6931640 1 -- 172.21.15.50:0/1591229534 shutdown_connections 2024-05-20T21:57:07.917 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6de6931640 1 -- 172.21.15.50:0/1591229534 wait complete. 2024-05-20T21:57:07.917 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6de6931640 1 Processor -- start 2024-05-20T21:57:07.917 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6de6931640 1 -- start start 2024-05-20T21:57:07.917 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6de6931640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f6de01999e0 con 0x7f6de0105700 2024-05-20T21:57:07.917 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6ddffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6de0105700 0x7f6de01992d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53998/0 (socket says 172.21.15.50:53998) 2024-05-20T21:57:07.917 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6ddffff640 1 -- 172.21.15.50:0/1935856426 learned_addr learned my addr 172.21.15.50:0/1935856426 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:07.917 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6ddd7fa640 1 -- 172.21.15.50:0/1935856426 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 748625988 0 0) 0x7f6de01999e0 con 0x7f6de0105700 2024-05-20T21:57:07.917 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6ddd7fa640 1 -- 172.21.15.50:0/1935856426 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dc8005410 con 0x7f6de0105700 2024-05-20T21:57:07.917 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6ddd7fa640 1 -- 172.21.15.50:0/1935856426 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3999818517 0 0) 0x7f6dc8005410 con 0x7f6de0105700 2024-05-20T21:57:07.917 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6ddd7fa640 1 -- 172.21.15.50:0/1935856426 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6de01999e0 con 0x7f6de0105700 2024-05-20T21:57:07.917 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6ddd7fa640 1 -- 172.21.15.50:0/1935856426 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f6dd0001080 con 0x7f6de0105700 2024-05-20T21:57:07.917 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6ddd7fa640 1 -- 172.21.15.50:0/1935856426 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1868588045 0 0) 0x7f6de01999e0 con 0x7f6de0105700 2024-05-20T21:57:07.918 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6ddd7fa640 1 -- 172.21.15.50:0/1935856426 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de0199bb0 con 0x7f6de0105700 2024-05-20T21:57:07.918 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6de6931640 1 -- 172.21.15.50:0/1935856426 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6de0199ec0 con 0x7f6de0105700 2024-05-20T21:57:07.918 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6de6931640 1 -- 172.21.15.50:0/1935856426 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6de019da50 con 0x7f6de0105700 2024-05-20T21:57:07.918 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6ddd7fa640 1 -- 172.21.15.50:0/1935856426 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f6dd00048a0 con 0x7f6de0105700 2024-05-20T21:57:07.918 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6ddd7fa640 1 -- 172.21.15.50:0/1935856426 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f6dd0005f00 con 0x7f6de0105700 2024-05-20T21:57:07.918 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.913+0000 7f6ddd7fa640 1 -- 172.21.15.50:0/1935856426 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 8) ==== 46252+0+0 (unknown 652970133 0 0) 0x7f6dd00060a0 con 0x7f6de0105700 2024-05-20T21:57:07.918 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.917+0000 7f6ddd7fa640 1 -- 172.21.15.50:0/1935856426 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (unknown 3179596823 0 0) 0x7f6dd0048660 con 0x7f6de0105700 2024-05-20T21:57:07.918 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.917+0000 7f6de6931640 1 -- 172.21.15.50:0/1935856426 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dcc0050b0 con 0x7f6de0105700 2024-05-20T21:57:07.918 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:06.921+0000 7f6ddd7fa640 1 -- 172.21.15.50:0/1935856426 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f6dd0017450 con 0x7f6de0105700 2024-05-20T21:57:07.918 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:07.257+0000 7f6de6931640 1 -- 172.21.15.50:0/1935856426 --> v1:172.21.15.50:6789/0 -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f6dcc0053a0 con 0x7f6de0105700 2024-05-20T21:57:07.918 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:07.261+0000 7f6ddd7fa640 1 -- 172.21.15.50:0/1935856426 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (unknown 2684808024 0 0) 0x7f6dd0016d50 con 0x7f6de0105700 2024-05-20T21:57:07.918 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:07.265+0000 7f6de6931640 1 -- 172.21.15.50:0/1935856426 >> v1:172.21.15.50:6800/3032841639 conn(0x7f6dc803a530 legacy=0x7f6dc803c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:07.919 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:07.265+0000 7f6de6931640 1 -- 172.21.15.50:0/1935856426 >> v1:172.21.15.50:6789/0 conn(0x7f6de0105700 legacy=0x7f6de01992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:07.919 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:07.265+0000 7f6de6931640 1 -- 172.21.15.50:0/1935856426 shutdown_connections 2024-05-20T21:57:07.919 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:07.265+0000 7f6de6931640 1 -- 172.21.15.50:0/1935856426 >> 172.21.15.50:0/1935856426 conn(0x7f6de0100d00 msgr2=0x7f6de01030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:07.919 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:07.265+0000 7f6de6931640 1 -- 172.21.15.50:0/1935856426 shutdown_connections 2024-05-20T21:57:07.919 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:07.265+0000 7f6de6931640 1 -- 172.21.15.50:0/1935856426 wait complete. 2024-05-20T21:57:08.581 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:08 smithi050 bash[21866]: audit 2024-05-20T21:57:07.267534+0000 mon.a (mon.0) 70 : audit 1 from='client.? v1:172.21.15.50:0/1935856426' entity='client.admin' 2024-05-20T21:57:08.581 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:08 smithi050 bash[21866]: cluster 2024-05-20T21:57:07.413690+0000 mgr.y (mgr.14118) 22 : cluster 0 pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:57:09.710 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.765+0000 7f0deea48640 1 Processor -- start 2024-05-20T21:57:09.710 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.765+0000 7f0deea48640 1 -- start start 2024-05-20T21:57:09.710 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.765+0000 7f0deea48640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f0de8079750 con 0x7f0de8103f40 2024-05-20T21:57:09.710 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.765+0000 7f0de7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0de8103f40 0x7f0de8104360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53370/0 (socket says 172.21.15.50:53370) 2024-05-20T21:57:09.711 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.765+0000 7f0de7fff640 1 -- 172.21.15.50:0/1999211707 learned_addr learned my addr 172.21.15.50:0/1999211707 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:09.711 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.765+0000 7f0de6ffd640 1 -- 172.21.15.50:0/1999211707 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1855161402 0 0) 0x7f0de8079750 con 0x7f0de8103f40 2024-05-20T21:57:09.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.765+0000 7f0de6ffd640 1 -- 172.21.15.50:0/1999211707 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dd0003520 con 0x7f0de8103f40 2024-05-20T21:57:09.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.765+0000 7f0de6ffd640 1 -- 172.21.15.50:0/1999211707 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2240373378 0 0) 0x7f0dd0003520 con 0x7f0de8103f40 2024-05-20T21:57:09.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.765+0000 7f0de6ffd640 1 -- 172.21.15.50:0/1999211707 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de8105a80 con 0x7f0de8103f40 2024-05-20T21:57:09.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.765+0000 7f0de6ffd640 1 -- 172.21.15.50:0/1999211707 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f0dd8001580 con 0x7f0de8103f40 2024-05-20T21:57:09.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.765+0000 7f0de6ffd640 1 -- 172.21.15.50:0/1999211707 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f0dd8001c70 con 0x7f0de8103f40 2024-05-20T21:57:09.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.765+0000 7f0de6ffd640 1 -- 172.21.15.50:0/1999211707 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f0dd80058d0 con 0x7f0de8103f40 2024-05-20T21:57:09.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.765+0000 7f0deea48640 1 -- 172.21.15.50:0/1999211707 >> v1:172.21.15.50:6789/0 conn(0x7f0de8103f40 legacy=0x7f0de8104360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:09.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0deea48640 1 -- 172.21.15.50:0/1999211707 shutdown_connections 2024-05-20T21:57:09.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0deea48640 1 -- 172.21.15.50:0/1999211707 >> 172.21.15.50:0/1999211707 conn(0x7f0de80ffb80 msgr2=0x7f0de8101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:09.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0deea48640 1 -- 172.21.15.50:0/1999211707 shutdown_connections 2024-05-20T21:57:09.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0deea48640 1 -- 172.21.15.50:0/1999211707 wait complete. 2024-05-20T21:57:09.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0deea48640 1 Processor -- start 2024-05-20T21:57:09.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0deea48640 1 -- start start 2024-05-20T21:57:09.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0deea48640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f0de819bc00 con 0x7f0de8103f40 2024-05-20T21:57:09.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0de7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0de8103f40 0x7f0de819b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53374/0 (socket says 172.21.15.50:53374) 2024-05-20T21:57:09.715 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0de7fff640 1 -- 172.21.15.50:0/3682032754 learned_addr learned my addr 172.21.15.50:0/3682032754 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:09.715 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0de57fa640 1 -- 172.21.15.50:0/3682032754 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3203350231 0 0) 0x7f0de819bc00 con 0x7f0de8103f40 2024-05-20T21:57:09.715 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0de57fa640 1 -- 172.21.15.50:0/3682032754 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dd0005460 con 0x7f0de8103f40 2024-05-20T21:57:09.715 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0de57fa640 1 -- 172.21.15.50:0/3682032754 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1779997415 0 0) 0x7f0dd0005460 con 0x7f0de8103f40 2024-05-20T21:57:09.715 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0de57fa640 1 -- 172.21.15.50:0/3682032754 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0de819bc00 con 0x7f0de8103f40 2024-05-20T21:57:09.715 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0de57fa640 1 -- 172.21.15.50:0/3682032754 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f0dd8001080 con 0x7f0de8103f40 2024-05-20T21:57:09.715 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0de57fa640 1 -- 172.21.15.50:0/3682032754 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3921970801 0 0) 0x7f0de819bc00 con 0x7f0de8103f40 2024-05-20T21:57:09.715 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0de57fa640 1 -- 172.21.15.50:0/3682032754 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de819bdd0 con 0x7f0de8103f40 2024-05-20T21:57:09.715 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0deea48640 1 -- 172.21.15.50:0/3682032754 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0de819c0e0 con 0x7f0de8103f40 2024-05-20T21:57:09.717 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0deea48640 1 -- 172.21.15.50:0/3682032754 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0de819fc70 con 0x7f0de8103f40 2024-05-20T21:57:09.717 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0de57fa640 1 -- 172.21.15.50:0/3682032754 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f0dd8001c30 con 0x7f0de8103f40 2024-05-20T21:57:09.717 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0de57fa640 1 -- 172.21.15.50:0/3682032754 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f0dd8005fb0 con 0x7f0de8103f40 2024-05-20T21:57:09.717 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0de57fa640 1 -- 172.21.15.50:0/3682032754 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 8) ==== 46252+0+0 (unknown 652970133 0 0) 0x7f0dd8006170 con 0x7f0de8103f40 2024-05-20T21:57:09.717 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0de57fa640 1 -- 172.21.15.50:0/3682032754 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (unknown 3179596823 0 0) 0x7f0dd8047870 con 0x7f0de8103f40 2024-05-20T21:57:09.717 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.769+0000 7f0deea48640 1 -- 172.21.15.50:0/3682032754 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dd40050b0 con 0x7f0de8103f40 2024-05-20T21:57:09.718 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:08.777+0000 7f0de57fa640 1 -- 172.21.15.50:0/3682032754 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f0dd8017530 con 0x7f0de8103f40 2024-05-20T21:57:09.718 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:09.113+0000 7f0deea48640 1 -- 172.21.15.50:0/3682032754 --> v1:172.21.15.50:6789/0 -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f0dd40053a0 con 0x7f0de8103f40 2024-05-20T21:57:09.718 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:09.117+0000 7f0de57fa640 1 -- 172.21.15.50:0/3682032754 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (unknown 1496729260 0 0) 0x7f0dd8016e30 con 0x7f0de8103f40 2024-05-20T21:57:09.718 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:09.121+0000 7f0deea48640 1 -- 172.21.15.50:0/3682032754 >> v1:172.21.15.50:6800/3032841639 conn(0x7f0dd003a4e0 legacy=0x7f0dd003c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:09.718 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:09.121+0000 7f0deea48640 1 -- 172.21.15.50:0/3682032754 >> v1:172.21.15.50:6789/0 conn(0x7f0de8103f40 legacy=0x7f0de819b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:09.718 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:09.121+0000 7f0deea48640 1 -- 172.21.15.50:0/3682032754 shutdown_connections 2024-05-20T21:57:09.718 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:09.121+0000 7f0deea48640 1 -- 172.21.15.50:0/3682032754 >> 172.21.15.50:0/3682032754 conn(0x7f0de80ffb80 msgr2=0x7f0de8101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:09.718 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:09.121+0000 7f0deea48640 1 -- 172.21.15.50:0/3682032754 shutdown_connections 2024-05-20T21:57:09.718 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:09.121+0000 7f0deea48640 1 -- 172.21.15.50:0/3682032754 wait complete. 2024-05-20T21:57:09.718 INFO:teuthology.orchestra.run.smithi050.stdout:Enabling the dashboard module... 2024-05-20T21:57:10.373 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:10 smithi050 bash[21866]: audit 2024-05-20T21:57:09.122518+0000 mon.a (mon.0) 71 : audit 1 from='client.? v1:172.21.15.50:0/3682032754' entity='client.admin' 2024-05-20T21:57:11.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:11 smithi050 bash[21866]: cluster 2024-05-20T21:57:09.414108+0000 mgr.y (mgr.14118) 23 : cluster 0 pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:57:11.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:11 smithi050 bash[21866]: audit 2024-05-20T21:57:10.977127+0000 mon.a (mon.0) 72 : audit 1 from='client.? v1:172.21.15.50:0/1740039428' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-20T21:57:11.447 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:11 smithi050 bash[22118]: ignoring --setuser ceph since I am not root 2024-05-20T21:57:11.447 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:11 smithi050 bash[22118]: ignoring --setgroup ceph since I am not root 2024-05-20T21:57:11.447 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:11 smithi050 bash[22118]: debug 2024-05-20T21:57:11.289+0000 7fa51c31a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T21:57:11.737 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.517+0000 7fa689230640 1 Processor -- start 2024-05-20T21:57:11.738 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.517+0000 7fa689230640 1 -- start start 2024-05-20T21:57:11.738 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.517+0000 7fa689230640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa68410bcf0 con 0x7fa684107910 2024-05-20T21:57:11.738 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa682d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa684107910 0x7fa684107d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53388/0 (socket says 172.21.15.50:53388) 2024-05-20T21:57:11.739 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa682d9d640 1 -- 172.21.15.50:0/2177582121 learned_addr learned my addr 172.21.15.50:0/2177582121 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:11.739 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa68259c640 1 -- 172.21.15.50:0/2177582121 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1281984553 0 0) 0x7fa68410bcf0 con 0x7fa684107910 2024-05-20T21:57:11.739 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa68259c640 1 -- 172.21.15.50:0/2177582121 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa670003520 con 0x7fa684107910 2024-05-20T21:57:11.739 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa68259c640 1 -- 172.21.15.50:0/2177582121 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1713114364 0 0) 0x7fa670003520 con 0x7fa684107910 2024-05-20T21:57:11.739 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa68259c640 1 -- 172.21.15.50:0/2177582121 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68410ced0 con 0x7fa684107910 2024-05-20T21:57:11.740 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa68259c640 1 -- 172.21.15.50:0/2177582121 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fa674001580 con 0x7fa684107910 2024-05-20T21:57:11.740 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa68259c640 1 -- 172.21.15.50:0/2177582121 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7fa674001c70 con 0x7fa684107910 2024-05-20T21:57:11.740 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa68259c640 1 -- 172.21.15.50:0/2177582121 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fa6740058d0 con 0x7fa684107910 2024-05-20T21:57:11.740 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa689230640 1 -- 172.21.15.50:0/2177582121 >> v1:172.21.15.50:6789/0 conn(0x7fa684107910 legacy=0x7fa684107d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:11.740 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa689230640 1 -- 172.21.15.50:0/2177582121 shutdown_connections 2024-05-20T21:57:11.740 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa689230640 1 -- 172.21.15.50:0/2177582121 >> 172.21.15.50:0/2177582121 conn(0x7fa68407ae20 msgr2=0x7fa6841054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:11.741 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa689230640 1 -- 172.21.15.50:0/2177582121 shutdown_connections 2024-05-20T21:57:11.741 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa689230640 1 -- 172.21.15.50:0/2177582121 wait complete. 2024-05-20T21:57:11.741 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa689230640 1 Processor -- start 2024-05-20T21:57:11.741 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa689230640 1 -- start start 2024-05-20T21:57:11.741 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa689230640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa68419bc60 con 0x7fa684107910 2024-05-20T21:57:11.741 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa682d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa684107910 0x7fa68419b550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53398/0 (socket says 172.21.15.50:53398) 2024-05-20T21:57:11.742 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa682d9d640 1 -- 172.21.15.50:0/1740039428 learned_addr learned my addr 172.21.15.50:0/1740039428 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:11.742 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa680d99640 1 -- 172.21.15.50:0/1740039428 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2719952237 0 0) 0x7fa68419bc60 con 0x7fa684107910 2024-05-20T21:57:11.742 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa680d99640 1 -- 172.21.15.50:0/1740039428 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa670005460 con 0x7fa684107910 2024-05-20T21:57:11.742 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa680d99640 1 -- 172.21.15.50:0/1740039428 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2924060681 0 0) 0x7fa670005460 con 0x7fa684107910 2024-05-20T21:57:11.742 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa680d99640 1 -- 172.21.15.50:0/1740039428 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa68419bc60 con 0x7fa684107910 2024-05-20T21:57:11.742 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa680d99640 1 -- 172.21.15.50:0/1740039428 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fa674001080 con 0x7fa684107910 2024-05-20T21:57:11.743 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa680d99640 1 -- 172.21.15.50:0/1740039428 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1365185310 0 0) 0x7fa68419bc60 con 0x7fa684107910 2024-05-20T21:57:11.743 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa680d99640 1 -- 172.21.15.50:0/1740039428 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68419be30 con 0x7fa684107910 2024-05-20T21:57:11.743 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa689230640 1 -- 172.21.15.50:0/1740039428 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa68419c140 con 0x7fa684107910 2024-05-20T21:57:11.743 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa689230640 1 -- 172.21.15.50:0/1740039428 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa68419fcd0 con 0x7fa684107910 2024-05-20T21:57:11.743 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa680d99640 1 -- 172.21.15.50:0/1740039428 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7fa6740055d0 con 0x7fa684107910 2024-05-20T21:57:11.743 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.521+0000 7fa680d99640 1 -- 172.21.15.50:0/1740039428 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fa674005f40 con 0x7fa684107910 2024-05-20T21:57:11.744 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.525+0000 7fa680d99640 1 -- 172.21.15.50:0/1740039428 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 8) ==== 46252+0+0 (unknown 652970133 0 0) 0x7fa6740116c0 con 0x7fa684107910 2024-05-20T21:57:11.744 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.525+0000 7fa689230640 1 -- 172.21.15.50:0/1740039428 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa664005080 con 0x7fa684107910 2024-05-20T21:57:11.744 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.525+0000 7fa680d99640 1 -- 172.21.15.50:0/1740039428 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (unknown 3179596823 0 0) 0x7fa6740479d0 con 0x7fa684107910 2024-05-20T21:57:11.744 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.529+0000 7fa680d99640 1 -- 172.21.15.50:0/1740039428 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7fa674017610 con 0x7fa684107910 2024-05-20T21:57:11.744 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:10.973+0000 7fa689230640 1 -- 172.21.15.50:0/1740039428 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fa664005370 con 0x7fa684107910 2024-05-20T21:57:11.744 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:11.121+0000 7fa680d99640 1 -- 172.21.15.50:0/1740039428 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (unknown 1498667528 0 0) 0x7fa674016f10 con 0x7fa684107910 2024-05-20T21:57:11.745 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:11.125+0000 7fa689230640 1 -- 172.21.15.50:0/1740039428 >> v1:172.21.15.50:6800/3032841639 conn(0x7fa67003a440 legacy=0x7fa67003c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:11.745 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:11.125+0000 7fa689230640 1 -- 172.21.15.50:0/1740039428 >> v1:172.21.15.50:6789/0 conn(0x7fa684107910 legacy=0x7fa68419b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:11.745 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:11.125+0000 7fa689230640 1 -- 172.21.15.50:0/1740039428 shutdown_connections 2024-05-20T21:57:11.745 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:11.125+0000 7fa689230640 1 -- 172.21.15.50:0/1740039428 >> 172.21.15.50:0/1740039428 conn(0x7fa68407ae20 msgr2=0x7fa684192210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:11.745 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:11.125+0000 7fa689230640 1 -- 172.21.15.50:0/1740039428 shutdown_connections 2024-05-20T21:57:11.745 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:11.125+0000 7fa689230640 1 -- 172.21.15.50:0/1740039428 wait complete. 2024-05-20T21:57:12.385 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:12 smithi050 bash[21866]: audit 2024-05-20T21:57:11.126414+0000 mon.a (mon.0) 73 : audit 1 from='client.? v1:172.21.15.50:0/1740039428' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-20T21:57:12.385 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:12 smithi050 bash[21866]: cluster 2024-05-20T21:57:11.131806+0000 mon.a (mon.0) 74 : cluster 0 mgrmap e9: y(active, since 25s) 2024-05-20T21:57:12.662 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:12 smithi050 bash[22118]: debug 2024-05-20T21:57:12.589+0000 7fa51c31a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T21:57:12.946 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:12 smithi050 bash[22118]: debug 2024-05-20T21:57:12.661+0000 7fa51c31a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T21:57:12.947 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:12 smithi050 bash[22118]: debug 2024-05-20T21:57:12.821+0000 7fa51c31a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T21:57:13.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:13 smithi050 bash[21866]: audit 2024-05-20T21:57:12.985891+0000 mon.a (mon.0) 75 : audit 0 from='client.? v1:172.21.15.50:0/3276654440' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-20T21:57:13.656 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-05-20T21:57:13.657 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-20T21:57:13.657 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-20T21:57:13.657 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-05-20T21:57:13.657 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-20T21:57:13.657 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-05-20T21:57:13.657 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.525+0000 7f951dc04640 1 Processor -- start 2024-05-20T21:57:13.657 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.525+0000 7f951dc04640 1 -- start start 2024-05-20T21:57:13.657 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f951dc04640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f9518078e40 con 0x7f95181061d0 2024-05-20T21:57:13.657 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f95177fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f95181061d0 0x7f95181085c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53420/0 (socket says 172.21.15.50:53420) 2024-05-20T21:57:13.658 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f95177fe640 1 -- 172.21.15.50:0/2619592816 learned_addr learned my addr 172.21.15.50:0/2619592816 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:13.658 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f95167fc640 1 -- 172.21.15.50:0/2619592816 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2091184304 0 0) 0x7f9518078e40 con 0x7f95181061d0 2024-05-20T21:57:13.658 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f95167fc640 1 -- 172.21.15.50:0/2619592816 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9504003520 con 0x7f95181061d0 2024-05-20T21:57:13.658 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f95167fc640 1 -- 172.21.15.50:0/2619592816 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1089600368 0 0) 0x7f9504003520 con 0x7f95181061d0 2024-05-20T21:57:13.658 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f95167fc640 1 -- 172.21.15.50:0/2619592816 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951810acf0 con 0x7f95181061d0 2024-05-20T21:57:13.658 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f95167fc640 1 -- 172.21.15.50:0/2619592816 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f9508001580 con 0x7f95181061d0 2024-05-20T21:57:13.658 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f95167fc640 1 -- 172.21.15.50:0/2619592816 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f95080048a0 con 0x7f95181061d0 2024-05-20T21:57:13.658 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f95167fc640 1 -- 172.21.15.50:0/2619592816 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f95080059e0 con 0x7f95181061d0 2024-05-20T21:57:13.658 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f951dc04640 1 -- 172.21.15.50:0/2619592816 >> v1:172.21.15.50:6789/0 conn(0x7f95181061d0 legacy=0x7f95181085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:13.658 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f951dc04640 1 -- 172.21.15.50:0/2619592816 shutdown_connections 2024-05-20T21:57:13.658 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f951dc04640 1 -- 172.21.15.50:0/2619592816 >> 172.21.15.50:0/2619592816 conn(0x7f95180ffb60 msgr2=0x7f9518101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:13.658 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f951dc04640 1 -- 172.21.15.50:0/2619592816 shutdown_connections 2024-05-20T21:57:13.659 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f951dc04640 1 -- 172.21.15.50:0/2619592816 wait complete. 2024-05-20T21:57:13.659 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f951dc04640 1 Processor -- start 2024-05-20T21:57:13.659 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f951dc04640 1 -- start start 2024-05-20T21:57:13.659 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f951dc04640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f951819bc10 con 0x7f95181061d0 2024-05-20T21:57:13.659 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f95177fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f95181061d0 0x7f951819b500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53426/0 (socket says 172.21.15.50:53426) 2024-05-20T21:57:13.659 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f95177fe640 1 -- 172.21.15.50:0/3276654440 learned_addr learned my addr 172.21.15.50:0/3276654440 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:13.659 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f9514ff9640 1 -- 172.21.15.50:0/3276654440 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1355749220 0 0) 0x7f951819bc10 con 0x7f95181061d0 2024-05-20T21:57:13.659 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f9514ff9640 1 -- 172.21.15.50:0/3276654440 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9504005410 con 0x7f95181061d0 2024-05-20T21:57:13.659 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f9514ff9640 1 -- 172.21.15.50:0/3276654440 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1270194104 0 0) 0x7f9504005410 con 0x7f95181061d0 2024-05-20T21:57:13.659 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f9514ff9640 1 -- 172.21.15.50:0/3276654440 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f951819bc10 con 0x7f95181061d0 2024-05-20T21:57:13.659 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f9514ff9640 1 -- 172.21.15.50:0/3276654440 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f9508001080 con 0x7f95181061d0 2024-05-20T21:57:13.659 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f9514ff9640 1 -- 172.21.15.50:0/3276654440 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 29459664 0 0) 0x7f951819bc10 con 0x7f95181061d0 2024-05-20T21:57:13.659 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f9514ff9640 1 -- 172.21.15.50:0/3276654440 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951819bde0 con 0x7f95181061d0 2024-05-20T21:57:13.660 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.529+0000 7f951dc04640 1 -- 172.21.15.50:0/3276654440 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f951819c0f0 con 0x7f95181061d0 2024-05-20T21:57:13.660 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.533+0000 7f951dc04640 1 -- 172.21.15.50:0/3276654440 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f951819fc80 con 0x7f95181061d0 2024-05-20T21:57:13.660 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.533+0000 7f9514ff9640 1 -- 172.21.15.50:0/3276654440 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f95080048a0 con 0x7f95181061d0 2024-05-20T21:57:13.660 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.533+0000 7f9514ff9640 1 -- 172.21.15.50:0/3276654440 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f9508006030 con 0x7f95181061d0 2024-05-20T21:57:13.660 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.533+0000 7f9514ff9640 1 -- 172.21.15.50:0/3276654440 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 9) ==== 46265+0+0 (unknown 3285910310 0 0) 0x7f95080061d0 con 0x7f95181061d0 2024-05-20T21:57:13.660 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.533+0000 7f9514ff9640 1 -- 172.21.15.50:0/3276654440 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (unknown 3179596823 0 0) 0x7f9508048790 con 0x7f95181061d0 2024-05-20T21:57:13.660 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.533+0000 7f9516ffd640 1 -- 172.21.15.50:0/3276654440 >> v1:172.21.15.50:6800/3032841639 conn(0x7f950403a530 legacy=0x7f950403c9f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/3032841639 2024-05-20T21:57:13.660 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.533+0000 7f951dc04640 1 -- 172.21.15.50:0/3276654440 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94f80050b0 con 0x7f95181061d0 2024-05-20T21:57:13.660 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.537+0000 7f9514ff9640 1 -- 172.21.15.50:0/3276654440 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f95080175e0 con 0x7f95181061d0 2024-05-20T21:57:13.660 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.737+0000 7f9516ffd640 1 -- 172.21.15.50:0/3276654440 >> v1:172.21.15.50:6800/3032841639 conn(0x7f950403a530 legacy=0x7f950403c9f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/3032841639 2024-05-20T21:57:13.660 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.981+0000 7f951dc04640 1 -- 172.21.15.50:0/3276654440 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f94f8005bb0 con 0x7f95181061d0 2024-05-20T21:57:13.660 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.981+0000 7f9514ff9640 1 -- 172.21.15.50:0/3276654440 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (unknown 2005831594 0 1748205903) 0x7f9508016ee0 con 0x7f95181061d0 2024-05-20T21:57:13.660 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.985+0000 7f951dc04640 1 -- 172.21.15.50:0/3276654440 >> v1:172.21.15.50:6800/3032841639 conn(0x7f950403a530 legacy=0x7f950403c9f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T21:57:13.661 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.985+0000 7f951dc04640 1 -- 172.21.15.50:0/3276654440 >> v1:172.21.15.50:6789/0 conn(0x7f95181061d0 legacy=0x7f951819b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:13.661 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.985+0000 7f951dc04640 1 -- 172.21.15.50:0/3276654440 shutdown_connections 2024-05-20T21:57:13.661 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.985+0000 7f951dc04640 1 -- 172.21.15.50:0/3276654440 >> 172.21.15.50:0/3276654440 conn(0x7f95180ffb60 msgr2=0x7f9518103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:13.661 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.985+0000 7f951dc04640 1 -- 172.21.15.50:0/3276654440 shutdown_connections 2024-05-20T21:57:13.661 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:12.985+0000 7f951dc04640 1 -- 172.21.15.50:0/3276654440 wait complete. 2024-05-20T21:57:13.661 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for the mgr to restart... 2024-05-20T21:57:13.661 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mgr epoch 9... 2024-05-20T21:57:13.877 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:13 smithi050 bash[22118]: debug 2024-05-20T21:57:13.521+0000 7fa51c31a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T21:57:13.877 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:13 smithi050 bash[22118]: debug 2024-05-20T21:57:13.597+0000 7fa51c31a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T21:57:13.877 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:13 smithi050 bash[22118]: debug 2024-05-20T21:57:13.673+0000 7fa51c31a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T21:57:14.196 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:13 smithi050 bash[22118]: debug 2024-05-20T21:57:13.873+0000 7fa51c31a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T21:57:14.196 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:13 smithi050 bash[22118]: debug 2024-05-20T21:57:13.957+0000 7fa51c31a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T21:57:14.196 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:14 smithi050 bash[22118]: debug 2024-05-20T21:57:14.033+0000 7fa51c31a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T21:57:14.603 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:14 smithi050 bash[22118]: debug 2024-05-20T21:57:14.309+0000 7fa51c31a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T21:57:14.603 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:14 smithi050 bash[22118]: debug 2024-05-20T21:57:14.385+0000 7fa51c31a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T21:57:14.946 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:14 smithi050 bash[22118]: debug 2024-05-20T21:57:14.601+0000 7fa51c31a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T21:57:14.946 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:14 smithi050 bash[22118]: debug 2024-05-20T21:57:14.685+0000 7fa51c31a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T21:57:15.320 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:14 smithi050 bash[22118]: debug 2024-05-20T21:57:14.952+0000 7fa51c31a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T21:57:15.320 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:15 smithi050 bash[22118]: debug 2024-05-20T21:57:15.140+0000 7fa51c31a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T21:57:15.596 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:15 smithi050 bash[22118]: debug 2024-05-20T21:57:15.316+0000 7fa51c31a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T21:57:15.596 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:15 smithi050 bash[22118]: debug 2024-05-20T21:57:15.400+0000 7fa51c31a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T21:57:15.946 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:15 smithi050 bash[22118]: debug 2024-05-20T21:57:15.592+0000 7fa51c31a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T21:57:16.784 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:16 smithi050 bash[22118]: debug 2024-05-20T21:57:16.456+0000 7fa51c31a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T21:57:16.784 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:16 smithi050 bash[22118]: debug 2024-05-20T21:57:16.540+0000 7fa51c31a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T21:57:17.197 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:16 smithi050 bash[22118]: debug 2024-05-20T21:57:16.780+0000 7fa51c31a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T21:57:17.197 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:16 smithi050 bash[22118]: debug 2024-05-20T21:57:16.860+0000 7fa51c31a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T21:57:17.636 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:17 smithi050 bash[22118]: debug 2024-05-20T21:57:17.276+0000 7fa51c31a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T21:57:17.636 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:17 smithi050 bash[22118]: debug 2024-05-20T21:57:17.360+0000 7fa51c31a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T21:57:17.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:17 smithi050 bash[21866]: cluster 2024-05-20T21:57:17.389834+0000 mon.a (mon.0) 76 : cluster 1 Active manager daemon y restarted 2024-05-20T21:57:17.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:17 smithi050 bash[21866]: cluster 2024-05-20T21:57:17.390066+0000 mon.a (mon.0) 77 : cluster 1 Activating manager daemon y 2024-05-20T21:57:17.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:17 smithi050 bash[21866]: cluster 2024-05-20T21:57:17.397477+0000 mon.a (mon.0) 78 : cluster 0 osdmap e3: 0 total, 0 up, 0 in 2024-05-20T21:57:17.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:17 smithi050 bash[21866]: cluster 2024-05-20T21:57:17.397706+0000 mon.a (mon.0) 79 : cluster 0 mgrmap e10: y(active, starting, since 0.00773668s) 2024-05-20T21:57:17.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:17 smithi050 bash[21866]: audit 2024-05-20T21:57:17.399177+0000 mon.a (mon.0) 80 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T21:57:17.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:17 smithi050 bash[21866]: audit 2024-05-20T21:57:17.400984+0000 mon.a (mon.0) 81 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-20T21:57:17.637 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:17 smithi050 bash[21866]: audit 2024-05-20T21:57:17.402223+0000 mon.a (mon.0) 82 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-20T21:57:17.637 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:17 smithi050 bash[21866]: audit 2024-05-20T21:57:17.402344+0000 mon.a (mon.0) 83 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-20T21:57:17.637 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:17 smithi050 bash[21866]: audit 2024-05-20T21:57:17.402454+0000 mon.a (mon.0) 84 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-20T21:57:17.637 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:17 smithi050 bash[21866]: cluster 2024-05-20T21:57:17.429955+0000 mon.a (mon.0) 85 : cluster 1 Manager daemon y is now available 2024-05-20T21:57:18.702 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:18 smithi050 bash[21866]: audit 2024-05-20T21:57:17.449698+0000 mon.a (mon.0) 86 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:57:18.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:18 smithi050 bash[21866]: audit 2024-05-20T21:57:17.467431+0000 mon.a (mon.0) 87 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-20T21:57:18.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:18 smithi050 bash[21866]: audit 2024-05-20T21:57:17.470585+0000 mon.a (mon.0) 88 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-20T21:57:18.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:18 smithi050 bash[21866]: cluster 2024-05-20T21:57:18.402331+0000 mon.a (mon.0) 89 : cluster 0 mgrmap e11: y(active, since 1.01236s) 2024-05-20T21:57:19.072 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-05-20T21:57:19.072 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-20T21:57:19.072 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-20T21:57:19.072 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-05-20T21:57:19.072 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.549+0000 7f396feb7640 1 Processor -- start 2024-05-20T21:57:19.072 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.549+0000 7f396feb7640 1 -- start start 2024-05-20T21:57:19.072 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.549+0000 7f396feb7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f3968078e60 con 0x7f3968103fa0 2024-05-20T21:57:19.072 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.549+0000 7f396dc53640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3968103fa0 0x7f39681043c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53432/0 (socket says 172.21.15.50:53432) 2024-05-20T21:57:19.072 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.549+0000 7f396dc53640 1 -- 172.21.15.50:0/1025766597 learned_addr learned my addr 172.21.15.50:0/1025766597 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:19.072 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.549+0000 7f396cc51640 1 -- 172.21.15.50:0/1025766597 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 959635219 0 0) 0x7f3968078e60 con 0x7f3968103fa0 2024-05-20T21:57:19.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.549+0000 7f396cc51640 1 -- 172.21.15.50:0/1025766597 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3954003520 con 0x7f3968103fa0 2024-05-20T21:57:19.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.549+0000 7f396cc51640 1 -- 172.21.15.50:0/1025766597 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3362225088 0 0) 0x7f3954003520 con 0x7f3968103fa0 2024-05-20T21:57:19.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.549+0000 7f396cc51640 1 -- 172.21.15.50:0/1025766597 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3968105ae0 con 0x7f3968103fa0 2024-05-20T21:57:19.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.549+0000 7f396cc51640 1 -- 172.21.15.50:0/1025766597 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f3964001580 con 0x7f3968103fa0 2024-05-20T21:57:19.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.549+0000 7f396cc51640 1 -- 172.21.15.50:0/1025766597 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f39640048a0 con 0x7f3968103fa0 2024-05-20T21:57:19.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.549+0000 7f396cc51640 1 -- 172.21.15.50:0/1025766597 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f39640059e0 con 0x7f3968103fa0 2024-05-20T21:57:19.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f396feb7640 1 -- 172.21.15.50:0/1025766597 >> v1:172.21.15.50:6789/0 conn(0x7f3968103fa0 legacy=0x7f39681043c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:19.074 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f396feb7640 1 -- 172.21.15.50:0/1025766597 shutdown_connections 2024-05-20T21:57:19.074 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f396feb7640 1 -- 172.21.15.50:0/1025766597 >> 172.21.15.50:0/1025766597 conn(0x7f39680ffb60 msgr2=0x7f3968101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:19.074 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f396feb7640 1 -- 172.21.15.50:0/1025766597 shutdown_connections 2024-05-20T21:57:19.074 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f396feb7640 1 -- 172.21.15.50:0/1025766597 wait complete. 2024-05-20T21:57:19.074 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f396feb7640 1 Processor -- start 2024-05-20T21:57:19.074 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f396feb7640 1 -- start start 2024-05-20T21:57:19.075 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f396feb7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f396819bc20 con 0x7f3968103fa0 2024-05-20T21:57:19.075 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f396dc53640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3968103fa0 0x7f396819b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53448/0 (socket says 172.21.15.50:53448) 2024-05-20T21:57:19.075 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f396dc53640 1 -- 172.21.15.50:0/4116228981 learned_addr learned my addr 172.21.15.50:0/4116228981 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:19.075 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f395effd640 1 -- 172.21.15.50:0/4116228981 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4100170553 0 0) 0x7f396819bc20 con 0x7f3968103fa0 2024-05-20T21:57:19.075 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f395effd640 1 -- 172.21.15.50:0/4116228981 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3954005410 con 0x7f3968103fa0 2024-05-20T21:57:19.075 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f395effd640 1 -- 172.21.15.50:0/4116228981 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3368007840 0 0) 0x7f3954005410 con 0x7f3968103fa0 2024-05-20T21:57:19.076 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f395effd640 1 -- 172.21.15.50:0/4116228981 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f396819bc20 con 0x7f3968103fa0 2024-05-20T21:57:19.076 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f395effd640 1 -- 172.21.15.50:0/4116228981 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f3964001080 con 0x7f3968103fa0 2024-05-20T21:57:19.076 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f395effd640 1 -- 172.21.15.50:0/4116228981 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1492254295 0 0) 0x7f396819bc20 con 0x7f3968103fa0 2024-05-20T21:57:19.076 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f395effd640 1 -- 172.21.15.50:0/4116228981 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396819bdf0 con 0x7f3968103fa0 2024-05-20T21:57:19.076 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f396feb7640 1 -- 172.21.15.50:0/4116228981 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f396819c100 con 0x7f3968103fa0 2024-05-20T21:57:19.076 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f396feb7640 1 -- 172.21.15.50:0/4116228981 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f396819fc90 con 0x7f3968103fa0 2024-05-20T21:57:19.077 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f395effd640 1 -- 172.21.15.50:0/4116228981 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f39640048a0 con 0x7f3968103fa0 2024-05-20T21:57:19.077 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f395effd640 1 -- 172.21.15.50:0/4116228981 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f3964005fc0 con 0x7f3968103fa0 2024-05-20T21:57:19.077 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f395effd640 1 -- 172.21.15.50:0/4116228981 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 9) ==== 46265+0+0 (unknown 3285910310 0 0) 0x7f3964007210 con 0x7f3968103fa0 2024-05-20T21:57:19.077 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f395effd640 1 -- 172.21.15.50:0/4116228981 --> v1:172.21.15.50:6800/3032841639 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3964001080 con 0x7f395403a570 2024-05-20T21:57:19.077 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f395effd640 1 -- 172.21.15.50:0/4116228981 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (unknown 3179596823 0 0) 0x7f39640478b0 con 0x7f3968103fa0 2024-05-20T21:57:19.077 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.553+0000 7f396d452640 1 -- 172.21.15.50:0/4116228981 >> v1:172.21.15.50:6800/3032841639 conn(0x7f395403a570 legacy=0x7f395403ca30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/3032841639 2024-05-20T21:57:19.077 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:14.756+0000 7f396d452640 1 -- 172.21.15.50:0/4116228981 >> v1:172.21.15.50:6800/3032841639 conn(0x7f395403a570 legacy=0x7f395403ca30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/3032841639 2024-05-20T21:57:19.078 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:15.160+0000 7f396d452640 1 -- 172.21.15.50:0/4116228981 >> v1:172.21.15.50:6800/3032841639 conn(0x7f395403a570 legacy=0x7f395403ca30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/3032841639 2024-05-20T21:57:19.078 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:15.964+0000 7f396d452640 1 -- 172.21.15.50:0/4116228981 >> v1:172.21.15.50:6800/3032841639 conn(0x7f395403a570 legacy=0x7f395403ca30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/3032841639 2024-05-20T21:57:19.078 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:17.388+0000 7f395effd640 1 -- 172.21.15.50:0/4116228981 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mgrmap(e 10) ==== 46067+0+0 (unknown 3864161487 0 0) 0x7f39640461f0 con 0x7f3968103fa0 2024-05-20T21:57:19.078 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:17.392+0000 7f395effd640 1 -- 172.21.15.50:0/4116228981 >> v1:172.21.15.50:6800/3032841639 conn(0x7f395403a570 legacy=0x7f395403ca30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T21:57:19.078 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:18.392+0000 7f395effd640 1 -- 172.21.15.50:0/4116228981 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mgrmap(e 11) ==== 46159+0+0 (unknown 278098294 0 0) 0x7f396401f520 con 0x7f3968103fa0 2024-05-20T21:57:19.079 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:18.392+0000 7f395effd640 1 -- 172.21.15.50:0/4116228981 --> v1:172.21.15.50:6800/2944911247 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3964001080 con 0x7f395403ef40 2024-05-20T21:57:19.079 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:18.396+0000 7f395effd640 1 -- 172.21.15.50:0/4116228981 <== mgr.14150 v1:172.21.15.50:6800/2944911247 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (unknown 0 0 4109177037) 0x7f3964001080 con 0x7f395403ef40 2024-05-20T21:57:19.079 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:18.408+0000 7f396feb7640 1 -- 172.21.15.50:0/4116228981 --> v1:172.21.15.50:6800/2944911247 -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f394c0025a0 con 0x7f395403ef40 2024-05-20T21:57:19.079 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:18.408+0000 7f395effd640 1 -- 172.21.15.50:0/4116228981 <== mgr.14150 v1:172.21.15.50:6800/2944911247 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (unknown 0 0 3086460295) 0x7f394c0025a0 con 0x7f395403ef40 2024-05-20T21:57:19.079 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:18.408+0000 7f396feb7640 1 -- 172.21.15.50:0/4116228981 >> v1:172.21.15.50:6800/2944911247 conn(0x7f395403ef40 legacy=0x7f3954041330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:19.079 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:18.408+0000 7f396feb7640 1 -- 172.21.15.50:0/4116228981 >> v1:172.21.15.50:6789/0 conn(0x7f3968103fa0 legacy=0x7f396819b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:19.080 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:18.408+0000 7f396feb7640 1 -- 172.21.15.50:0/4116228981 shutdown_connections 2024-05-20T21:57:19.080 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:18.408+0000 7f396feb7640 1 -- 172.21.15.50:0/4116228981 >> 172.21.15.50:0/4116228981 conn(0x7f39680ffb60 msgr2=0x7f3968101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:19.080 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:18.408+0000 7f396feb7640 1 -- 172.21.15.50:0/4116228981 shutdown_connections 2024-05-20T21:57:19.080 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:18.408+0000 7f396feb7640 1 -- 172.21.15.50:0/4116228981 wait complete. 2024-05-20T21:57:19.080 INFO:teuthology.orchestra.run.smithi050.stdout:mgr epoch 9 is available 2024-05-20T21:57:19.080 INFO:teuthology.orchestra.run.smithi050.stdout:Generating a dashboard self-signed certificate... 2024-05-20T21:57:19.441 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:19 smithi050 bash[22118]: debug 2024-05-20T21:57:19.328+0000 7fa4828db640 -1 log_channel(cephadm) log [ERR] : [20/May/2024:21:57:19] ENGINE Error in HTTPServer.serve 2024-05-20T21:57:19.441 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:19 smithi050 bash[22118]: Traceback (most recent call last): 2024-05-20T21:57:19.442 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:19 smithi050 bash[22118]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-05-20T21:57:19.442 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:19 smithi050 bash[22118]: self._connections.run(self.expiration_interval) 2024-05-20T21:57:19.442 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:19 smithi050 bash[22118]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-05-20T21:57:19.442 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:19 smithi050 bash[22118]: self._run(expiration_interval) 2024-05-20T21:57:19.442 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:19 smithi050 bash[22118]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-05-20T21:57:19.442 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:19 smithi050 bash[22118]: new_conn = self._from_server_socket(self.server.socket) 2024-05-20T21:57:19.442 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:19 smithi050 bash[22118]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-05-20T21:57:19.442 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:19 smithi050 bash[22118]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-05-20T21:57:19.442 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:19 smithi050 bash[22118]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-05-20T21:57:19.442 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:19 smithi050 bash[22118]: s = self.context.wrap_socket( 2024-05-20T21:57:19.442 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:19 smithi050 bash[22118]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-05-20T21:57:19.442 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:19 smithi050 bash[22118]: return self.sslsocket_class._create( 2024-05-20T21:57:19.442 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:19 smithi050 bash[22118]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-05-20T21:57:19.443 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:19 smithi050 bash[22118]: self.do_handshake() 2024-05-20T21:57:19.443 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:19 smithi050 bash[22118]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-05-20T21:57:19.443 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:19 smithi050 bash[22118]: self._sslobj.do_handshake() 2024-05-20T21:57:19.443 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:57:19 smithi050 bash[22118]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-05-20T21:57:19.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:19 smithi050 bash[21866]: cephadm 2024-05-20T21:57:19.109483+0000 mgr.y (mgr.14150) 3 : cephadm 1 [20/May/2024:21:57:19] ENGINE Bus STARTING 2024-05-20T21:57:20.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: cephadm 2024-05-20T21:57:19.211183+0000 mgr.y (mgr.14150) 4 : cephadm 1 [20/May/2024:21:57:19] ENGINE Serving on http://172.21.15.50:8765 2024-05-20T21:57:20.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: cephadm 2024-05-20T21:57:19.332416+0000 mgr.y (mgr.14150) 5 : cephadm 1 [20/May/2024:21:57:19] ENGINE Serving on https://172.21.15.50:7150 2024-05-20T21:57:20.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: cephadm 2024-05-20T21:57:19.332525+0000 mgr.y (mgr.14150) 6 : cephadm 1 [20/May/2024:21:57:19] ENGINE Bus STARTED 2024-05-20T21:57:20.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: cephadm 2024-05-20T21:57:19.334278+0000 mgr.y (mgr.14150) 7 : cephadm 4 [20/May/2024:21:57:19] ENGINE Error in HTTPServer.serve 2024-05-20T21:57:20.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: Traceback (most recent call last): 2024-05-20T21:57:20.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-05-20T21:57:20.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: self._connections.run(self.expiration_interval) 2024-05-20T21:57:20.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-05-20T21:57:20.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: self._run(expiration_interval) 2024-05-20T21:57:20.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-05-20T21:57:20.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: new_conn = self._from_server_socket(self.server.socket) 2024-05-20T21:57:20.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-05-20T21:57:20.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-05-20T21:57:20.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-05-20T21:57:20.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: s = self.context.wrap_socket( 2024-05-20T21:57:20.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-05-20T21:57:20.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: return self.sslsocket_class._create( 2024-05-20T21:57:20.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-05-20T21:57:20.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: self.do_handshake() 2024-05-20T21:57:20.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-05-20T21:57:20.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: self._sslobj.do_handshake() 2024-05-20T21:57:20.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-05-20T21:57:20.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: cluster 2024-05-20T21:57:19.454175+0000 mon.a (mon.0) 90 : cluster 0 mgrmap e12: y(active, since 2s) 2024-05-20T21:57:20.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: audit 2024-05-20T21:57:20.359727+0000 mon.a (mon.0) 91 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:57:20.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:20 smithi050 bash[21866]: audit 2024-05-20T21:57:20.361803+0000 mon.a (mon.0) 92 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:57:20.977 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-20T21:57:20.978 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.928+0000 7f3fedc39640 1 Processor -- start 2024-05-20T21:57:20.978 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.928+0000 7f3fedc39640 1 -- start start 2024-05-20T21:57:20.978 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.928+0000 7f3fedc39640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f3fe807a380 con 0x7f3fe807b780 2024-05-20T21:57:20.978 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.928+0000 7f3fe77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3fe807b780 0x7f3fe8079be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35906/0 (socket says 172.21.15.50:35906) 2024-05-20T21:57:20.978 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.928+0000 7f3fe77fe640 1 -- 172.21.15.50:0/52895573 learned_addr learned my addr 172.21.15.50:0/52895573 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:20.978 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fe6ffd640 1 -- 172.21.15.50:0/52895573 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2756108593 0 0) 0x7f3fe807a380 con 0x7f3fe807b780 2024-05-20T21:57:20.978 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fe6ffd640 1 -- 172.21.15.50:0/52895573 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fd4003520 con 0x7f3fe807b780 2024-05-20T21:57:20.978 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fe6ffd640 1 -- 172.21.15.50:0/52895573 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2967108205 0 0) 0x7f3fd4003520 con 0x7f3fe807b780 2024-05-20T21:57:20.978 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fe6ffd640 1 -- 172.21.15.50:0/52895573 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe81090e0 con 0x7f3fe807b780 2024-05-20T21:57:20.978 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fe6ffd640 1 -- 172.21.15.50:0/52895573 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f3fd8001580 con 0x7f3fe807b780 2024-05-20T21:57:20.978 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fe6ffd640 1 -- 172.21.15.50:0/52895573 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f3fd80048a0 con 0x7f3fe807b780 2024-05-20T21:57:20.978 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fe6ffd640 1 -- 172.21.15.50:0/52895573 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f3fd80059e0 con 0x7f3fe807b780 2024-05-20T21:57:20.979 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fedc39640 1 -- 172.21.15.50:0/52895573 >> v1:172.21.15.50:6789/0 conn(0x7f3fe807b780 legacy=0x7f3fe8079be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:20.979 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fedc39640 1 -- 172.21.15.50:0/52895573 shutdown_connections 2024-05-20T21:57:20.979 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fedc39640 1 -- 172.21.15.50:0/52895573 >> 172.21.15.50:0/52895573 conn(0x7f3fe8100cd0 msgr2=0x7f3fe81030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:20.979 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fedc39640 1 -- 172.21.15.50:0/52895573 shutdown_connections 2024-05-20T21:57:20.979 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fedc39640 1 -- 172.21.15.50:0/52895573 wait complete. 2024-05-20T21:57:20.979 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fedc39640 1 Processor -- start 2024-05-20T21:57:20.979 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fedc39640 1 -- start start 2024-05-20T21:57:20.979 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fedc39640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f3fe81a0070 con 0x7f3fe807b780 2024-05-20T21:57:20.979 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fe77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3fe807b780 0x7f3fe819f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35910/0 (socket says 172.21.15.50:35910) 2024-05-20T21:57:20.979 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fe77fe640 1 -- 172.21.15.50:0/4130261054 learned_addr learned my addr 172.21.15.50:0/4130261054 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:20.979 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fe57fa640 1 -- 172.21.15.50:0/4130261054 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2993603008 0 0) 0x7f3fe81a0070 con 0x7f3fe807b780 2024-05-20T21:57:20.979 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fe57fa640 1 -- 172.21.15.50:0/4130261054 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fd4005410 con 0x7f3fe807b780 2024-05-20T21:57:20.979 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fe57fa640 1 -- 172.21.15.50:0/4130261054 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3153796713 0 0) 0x7f3fd4005410 con 0x7f3fe807b780 2024-05-20T21:57:20.980 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fe57fa640 1 -- 172.21.15.50:0/4130261054 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3fe81a0070 con 0x7f3fe807b780 2024-05-20T21:57:20.980 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fe57fa640 1 -- 172.21.15.50:0/4130261054 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f3fd8001080 con 0x7f3fe807b780 2024-05-20T21:57:20.980 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fe57fa640 1 -- 172.21.15.50:0/4130261054 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3320870865 0 0) 0x7f3fe81a0070 con 0x7f3fe807b780 2024-05-20T21:57:20.980 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fe57fa640 1 -- 172.21.15.50:0/4130261054 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe81a0240 con 0x7f3fe807b780 2024-05-20T21:57:20.980 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fedc39640 1 -- 172.21.15.50:0/4130261054 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe81a0550 con 0x7f3fe807b780 2024-05-20T21:57:20.980 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fedc39640 1 -- 172.21.15.50:0/4130261054 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3fe81a40e0 con 0x7f3fe807b780 2024-05-20T21:57:20.980 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fe57fa640 1 -- 172.21.15.50:0/4130261054 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f3fd80048a0 con 0x7f3fe807b780 2024-05-20T21:57:20.980 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.932+0000 7f3fe57fa640 1 -- 172.21.15.50:0/4130261054 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f3fd8005f50 con 0x7f3fe807b780 2024-05-20T21:57:20.980 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.936+0000 7f3fe57fa640 1 -- 172.21.15.50:0/4130261054 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 12) ==== 46265+0+0 (unknown 3939437815 0 0) 0x7f3fd80115c0 con 0x7f3fe807b780 2024-05-20T21:57:20.981 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.936+0000 7f3fedc39640 1 -- 172.21.15.50:0/4130261054 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fc80050b0 con 0x7f3fe807b780 2024-05-20T21:57:20.981 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.936+0000 7f3fe57fa640 1 -- 172.21.15.50:0/4130261054 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (unknown 3027287997 0 0) 0x7f3fd8047930 con 0x7f3fe807b780 2024-05-20T21:57:20.981 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:19.940+0000 7f3fe57fa640 1 -- 172.21.15.50:0/4130261054 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f3fd8017540 con 0x7f3fe807b780 2024-05-20T21:57:20.981 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:20.292+0000 7f3fedc39640 1 -- 172.21.15.50:0/4130261054 --> v1:172.21.15.50:6800/2944911247 -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f3fc8000bc0 con 0x7f3fd403a530 2024-05-20T21:57:20.981 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:20.356+0000 7f3fe57fa640 1 -- 172.21.15.50:0/4130261054 <== mgr.14150 v1:172.21.15.50:6800/2944911247 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (unknown 0 0 3317752739) 0x7f3fc8000bc0 con 0x7f3fd403a530 2024-05-20T21:57:20.981 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:20.360+0000 7f3fedc39640 1 -- 172.21.15.50:0/4130261054 >> v1:172.21.15.50:6800/2944911247 conn(0x7f3fd403a530 legacy=0x7f3fd403c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:20.981 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:20.360+0000 7f3fedc39640 1 -- 172.21.15.50:0/4130261054 >> v1:172.21.15.50:6789/0 conn(0x7f3fe807b780 legacy=0x7f3fe819f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:20.982 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:20.360+0000 7f3fedc39640 1 -- 172.21.15.50:0/4130261054 shutdown_connections 2024-05-20T21:57:20.982 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:20.360+0000 7f3fedc39640 1 -- 172.21.15.50:0/4130261054 >> 172.21.15.50:0/4130261054 conn(0x7f3fe8100cd0 msgr2=0x7f3fe8105530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:20.982 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:20.360+0000 7f3fedc39640 1 -- 172.21.15.50:0/4130261054 shutdown_connections 2024-05-20T21:57:20.982 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:20.360+0000 7f3fedc39640 1 -- 172.21.15.50:0/4130261054 wait complete. 2024-05-20T21:57:20.982 INFO:teuthology.orchestra.run.smithi050.stdout:Creating initial admin user... 2024-05-20T21:57:21.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:21 smithi050 bash[21866]: audit 2024-05-20T21:57:20.296818+0000 mgr.y (mgr.14150) 8 : audit 0 from='client.14162 v1:172.21.15.50:0/4130261054' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T21:57:22.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:22 smithi050 bash[21866]: audit 2024-05-20T21:57:22.180076+0000 mgr.y (mgr.14150) 9 : audit 0 from='client.14164 v1:172.21.15.50:0/2028379344' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T21:57:23.088 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$m.6GP0WlKfL3MuZo6VmzmOt1gdxuZ9CftRvB31aW0N.neSzN/GjAq", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1716242242, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-20T21:57:23.088 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.800+0000 7f3e58e44640 1 Processor -- start 2024-05-20T21:57:23.088 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.800+0000 7f3e58e44640 1 -- start start 2024-05-20T21:57:23.088 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.800+0000 7f3e58e44640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f3e5410bcf0 con 0x7f3e54107910 2024-05-20T21:57:23.088 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.800+0000 7f3e5259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3e54107910 0x7f3e54107d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35920/0 (socket says 172.21.15.50:35920) 2024-05-20T21:57:23.088 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.800+0000 7f3e5259c640 1 -- 172.21.15.50:0/1713726107 learned_addr learned my addr 172.21.15.50:0/1713726107 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:23.089 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.800+0000 7f3e5159a640 1 -- 172.21.15.50:0/1713726107 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1429323317 0 0) 0x7f3e5410bcf0 con 0x7f3e54107910 2024-05-20T21:57:23.089 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.800+0000 7f3e5159a640 1 -- 172.21.15.50:0/1713726107 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e3c003520 con 0x7f3e54107910 2024-05-20T21:57:23.092 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.800+0000 7f3e5159a640 1 -- 172.21.15.50:0/1713726107 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1011778603 0 0) 0x7f3e3c003520 con 0x7f3e54107910 2024-05-20T21:57:23.093 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.800+0000 7f3e5159a640 1 -- 172.21.15.50:0/1713726107 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5410ced0 con 0x7f3e54107910 2024-05-20T21:57:23.093 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.800+0000 7f3e5159a640 1 -- 172.21.15.50:0/1713726107 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f3e44001580 con 0x7f3e54107910 2024-05-20T21:57:23.093 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.800+0000 7f3e5159a640 1 -- 172.21.15.50:0/1713726107 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f3e44001c70 con 0x7f3e54107910 2024-05-20T21:57:23.093 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.800+0000 7f3e5159a640 1 -- 172.21.15.50:0/1713726107 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f3e440058d0 con 0x7f3e54107910 2024-05-20T21:57:23.093 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.800+0000 7f3e58e44640 1 -- 172.21.15.50:0/1713726107 >> v1:172.21.15.50:6789/0 conn(0x7f3e54107910 legacy=0x7f3e54107d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:23.093 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.800+0000 7f3e58e44640 1 -- 172.21.15.50:0/1713726107 shutdown_connections 2024-05-20T21:57:23.093 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.800+0000 7f3e58e44640 1 -- 172.21.15.50:0/1713726107 >> 172.21.15.50:0/1713726107 conn(0x7f3e5407ae20 msgr2=0x7f3e541054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:23.093 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.800+0000 7f3e58e44640 1 -- 172.21.15.50:0/1713726107 shutdown_connections 2024-05-20T21:57:23.093 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.800+0000 7f3e58e44640 1 -- 172.21.15.50:0/1713726107 wait complete. 2024-05-20T21:57:23.093 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.804+0000 7f3e58e44640 1 Processor -- start 2024-05-20T21:57:23.093 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.804+0000 7f3e58e44640 1 -- start start 2024-05-20T21:57:23.093 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.804+0000 7f3e58e44640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f3e5419bc60 con 0x7f3e54107910 2024-05-20T21:57:23.094 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.804+0000 7f3e5259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3e54107910 0x7f3e5419b550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35928/0 (socket says 172.21.15.50:35928) 2024-05-20T21:57:23.094 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.804+0000 7f3e5259c640 1 -- 172.21.15.50:0/2028379344 learned_addr learned my addr 172.21.15.50:0/2028379344 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:23.094 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.804+0000 7f3e437fe640 1 -- 172.21.15.50:0/2028379344 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2418871151 0 0) 0x7f3e5419bc60 con 0x7f3e54107910 2024-05-20T21:57:23.094 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.804+0000 7f3e437fe640 1 -- 172.21.15.50:0/2028379344 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e3c005460 con 0x7f3e54107910 2024-05-20T21:57:23.094 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.804+0000 7f3e437fe640 1 -- 172.21.15.50:0/2028379344 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3792856273 0 0) 0x7f3e3c005460 con 0x7f3e54107910 2024-05-20T21:57:23.094 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.804+0000 7f3e437fe640 1 -- 172.21.15.50:0/2028379344 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e5419bc60 con 0x7f3e54107910 2024-05-20T21:57:23.094 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.804+0000 7f3e437fe640 1 -- 172.21.15.50:0/2028379344 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f3e44001080 con 0x7f3e54107910 2024-05-20T21:57:23.094 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.804+0000 7f3e437fe640 1 -- 172.21.15.50:0/2028379344 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1646868073 0 0) 0x7f3e5419bc60 con 0x7f3e54107910 2024-05-20T21:57:23.094 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.804+0000 7f3e437fe640 1 -- 172.21.15.50:0/2028379344 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5419be30 con 0x7f3e54107910 2024-05-20T21:57:23.094 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.804+0000 7f3e58e44640 1 -- 172.21.15.50:0/2028379344 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3e5419c140 con 0x7f3e54107910 2024-05-20T21:57:23.094 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.804+0000 7f3e58e44640 1 -- 172.21.15.50:0/2028379344 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3e5419fcd0 con 0x7f3e54107910 2024-05-20T21:57:23.094 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.804+0000 7f3e437fe640 1 -- 172.21.15.50:0/2028379344 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f3e440055d0 con 0x7f3e54107910 2024-05-20T21:57:23.095 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.804+0000 7f3e437fe640 1 -- 172.21.15.50:0/2028379344 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f3e44005f40 con 0x7f3e54107910 2024-05-20T21:57:23.095 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.804+0000 7f3e437fe640 1 -- 172.21.15.50:0/2028379344 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 12) ==== 46265+0+0 (unknown 3939437815 0 0) 0x7f3e440115f0 con 0x7f3e54107910 2024-05-20T21:57:23.095 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.804+0000 7f3e437fe640 1 -- 172.21.15.50:0/2028379344 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (unknown 3027287997 0 0) 0x7f3e44047990 con 0x7f3e54107910 2024-05-20T21:57:23.095 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.804+0000 7f3e58e44640 1 -- 172.21.15.50:0/2028379344 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e34005080 con 0x7f3e54107910 2024-05-20T21:57:23.095 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:21.808+0000 7f3e437fe640 1 -- 172.21.15.50:0/2028379344 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f3e44017590 con 0x7f3e54107910 2024-05-20T21:57:23.095 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:22.172+0000 7f3e58e44640 1 -- 172.21.15.50:0/2028379344 --> v1:172.21.15.50:6800/2944911247 -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f3e340023f0 con 0x7f3e3c03a4e0 2024-05-20T21:57:23.095 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:22.464+0000 7f3e437fe640 1 -- 172.21.15.50:0/2028379344 <== mgr.14150 v1:172.21.15.50:6800/2944911247 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (unknown 0 0 1514185359) 0x7f3e340023f0 con 0x7f3e3c03a4e0 2024-05-20T21:57:23.095 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:22.464+0000 7f3e58e44640 1 -- 172.21.15.50:0/2028379344 >> v1:172.21.15.50:6800/2944911247 conn(0x7f3e3c03a4e0 legacy=0x7f3e3c03c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:23.095 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:22.464+0000 7f3e58e44640 1 -- 172.21.15.50:0/2028379344 >> v1:172.21.15.50:6789/0 conn(0x7f3e54107910 legacy=0x7f3e5419b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:23.095 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:22.464+0000 7f3e58e44640 1 -- 172.21.15.50:0/2028379344 shutdown_connections 2024-05-20T21:57:23.095 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:22.464+0000 7f3e58e44640 1 -- 172.21.15.50:0/2028379344 >> 172.21.15.50:0/2028379344 conn(0x7f3e5407ae20 msgr2=0x7f3e54192210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:23.095 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:22.464+0000 7f3e58e44640 1 -- 172.21.15.50:0/2028379344 shutdown_connections 2024-05-20T21:57:23.096 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:22.464+0000 7f3e58e44640 1 -- 172.21.15.50:0/2028379344 wait complete. 2024-05-20T21:57:23.096 INFO:teuthology.orchestra.run.smithi050.stdout:Fetching dashboard port number... 2024-05-20T21:57:23.742 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:23 smithi050 bash[21866]: audit 2024-05-20T21:57:22.467432+0000 mon.a (mon.0) 93 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:57:24.585 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:24 smithi050 bash[21866]: cluster 2024-05-20T21:57:23.476039+0000 mon.a (mon.0) 94 : cluster 0 mgrmap e13: y(active, since 6s) 2024-05-20T21:57:24.585 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:24 smithi050 bash[21866]: audit 2024-05-20T21:57:24.178746+0000 mon.a (mon.0) 95 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:57:24.585 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:24 smithi050 bash[21866]: audit 2024-05-20T21:57:24.259630+0000 mon.a (mon.0) 96 : audit 0 from='client.? v1:172.21.15.50:0/4151676721' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-20T21:57:24.813 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 8443 2024-05-20T21:57:24.813 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef9fe3640 1 Processor -- start 2024-05-20T21:57:24.813 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef9fe3640 1 -- start start 2024-05-20T21:57:24.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef9fe3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f6ef4109ae0 con 0x7f6ef4105700 2024-05-20T21:57:24.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef37fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6ef4105700 0x7f6ef4105b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35942/0 (socket says 172.21.15.50:35942) 2024-05-20T21:57:24.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef37fe640 1 -- 172.21.15.50:0/3399745555 learned_addr learned my addr 172.21.15.50:0/3399745555 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:24.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef27fc640 1 -- 172.21.15.50:0/3399745555 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1979753260 0 0) 0x7f6ef4109ae0 con 0x7f6ef4105700 2024-05-20T21:57:24.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef27fc640 1 -- 172.21.15.50:0/3399745555 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6edc003520 con 0x7f6ef4105700 2024-05-20T21:57:24.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef27fc640 1 -- 172.21.15.50:0/3399745555 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2082265618 0 0) 0x7f6edc003520 con 0x7f6ef4105700 2024-05-20T21:57:24.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef27fc640 1 -- 172.21.15.50:0/3399745555 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef410acc0 con 0x7f6ef4105700 2024-05-20T21:57:24.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef27fc640 1 -- 172.21.15.50:0/3399745555 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f6ee4001580 con 0x7f6ef4105700 2024-05-20T21:57:24.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef27fc640 1 -- 172.21.15.50:0/3399745555 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f6ee4001c70 con 0x7f6ef4105700 2024-05-20T21:57:24.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef27fc640 1 -- 172.21.15.50:0/3399745555 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f6ee40058d0 con 0x7f6ef4105700 2024-05-20T21:57:24.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef9fe3640 1 -- 172.21.15.50:0/3399745555 >> v1:172.21.15.50:6789/0 conn(0x7f6ef4105700 legacy=0x7f6ef4105b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:24.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef9fe3640 1 -- 172.21.15.50:0/3399745555 shutdown_connections 2024-05-20T21:57:24.815 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef9fe3640 1 -- 172.21.15.50:0/3399745555 >> 172.21.15.50:0/3399745555 conn(0x7f6ef4100c80 msgr2=0x7f6ef41030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:24.815 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef9fe3640 1 -- 172.21.15.50:0/3399745555 shutdown_connections 2024-05-20T21:57:24.815 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef9fe3640 1 -- 172.21.15.50:0/3399745555 wait complete. 2024-05-20T21:57:24.815 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef9fe3640 1 Processor -- start 2024-05-20T21:57:24.815 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef9fe3640 1 -- start start 2024-05-20T21:57:24.815 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef9fe3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f6ef419bbc0 con 0x7f6ef4105700 2024-05-20T21:57:24.815 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef37fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6ef4105700 0x7f6ef419b4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35946/0 (socket says 172.21.15.50:35946) 2024-05-20T21:57:24.815 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.888+0000 7f6ef37fe640 1 -- 172.21.15.50:0/4151676721 learned_addr learned my addr 172.21.15.50:0/4151676721 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:24.815 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.892+0000 7f6ef0ff9640 1 -- 172.21.15.50:0/4151676721 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3781204547 0 0) 0x7f6ef419bbc0 con 0x7f6ef4105700 2024-05-20T21:57:24.815 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.892+0000 7f6ef0ff9640 1 -- 172.21.15.50:0/4151676721 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6edc005460 con 0x7f6ef4105700 2024-05-20T21:57:24.815 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.892+0000 7f6ef0ff9640 1 -- 172.21.15.50:0/4151676721 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1560452345 0 0) 0x7f6edc005460 con 0x7f6ef4105700 2024-05-20T21:57:24.815 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.892+0000 7f6ef0ff9640 1 -- 172.21.15.50:0/4151676721 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ef419bbc0 con 0x7f6ef4105700 2024-05-20T21:57:24.815 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.892+0000 7f6ef0ff9640 1 -- 172.21.15.50:0/4151676721 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f6ee4001080 con 0x7f6ef4105700 2024-05-20T21:57:24.815 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.892+0000 7f6ef0ff9640 1 -- 172.21.15.50:0/4151676721 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1454507195 0 0) 0x7f6ef419bbc0 con 0x7f6ef4105700 2024-05-20T21:57:24.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.892+0000 7f6ef0ff9640 1 -- 172.21.15.50:0/4151676721 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef419bd90 con 0x7f6ef4105700 2024-05-20T21:57:24.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.892+0000 7f6ef9fe3640 1 -- 172.21.15.50:0/4151676721 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef419c0a0 con 0x7f6ef4105700 2024-05-20T21:57:24.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.892+0000 7f6ef9fe3640 1 -- 172.21.15.50:0/4151676721 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6ef419fc30 con 0x7f6ef4105700 2024-05-20T21:57:24.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.892+0000 7f6ef0ff9640 1 -- 172.21.15.50:0/4151676721 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f6ee4005530 con 0x7f6ef4105700 2024-05-20T21:57:24.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.892+0000 7f6ef0ff9640 1 -- 172.21.15.50:0/4151676721 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f6ee40060a0 con 0x7f6ef4105700 2024-05-20T21:57:24.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.892+0000 7f6ef0ff9640 1 -- 172.21.15.50:0/4151676721 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 13) ==== 46308+0+0 (unknown 209257320 0 0) 0x7f6ee4011730 con 0x7f6ef4105700 2024-05-20T21:57:24.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.892+0000 7f6ef9fe3640 1 -- 172.21.15.50:0/4151676721 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee0005080 con 0x7f6ef4105700 2024-05-20T21:57:24.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.892+0000 7f6ef0ff9640 1 -- 172.21.15.50:0/4151676721 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (unknown 3027287997 0 0) 0x7f6ee4047b90 con 0x7f6ef4105700 2024-05-20T21:57:24.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:23.896+0000 7f6ef0ff9640 1 -- 172.21.15.50:0/4151676721 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f6ee4004de0 con 0x7f6ef4105700 2024-05-20T21:57:24.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:24.252+0000 7f6ef9fe3640 1 -- 172.21.15.50:0/4151676721 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f6ee0005370 con 0x7f6ef4105700 2024-05-20T21:57:24.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:24.252+0000 7f6ef0ff9640 1 -- 172.21.15.50:0/4151676721 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (unknown 3713421687 0 83753974) 0x7f6ee4046430 con 0x7f6ef4105700 2024-05-20T21:57:24.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:24.256+0000 7f6ef9fe3640 1 -- 172.21.15.50:0/4151676721 >> v1:172.21.15.50:6800/2944911247 conn(0x7f6edc03a580 legacy=0x7f6edc03ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:24.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:24.256+0000 7f6ef9fe3640 1 -- 172.21.15.50:0/4151676721 >> v1:172.21.15.50:6789/0 conn(0x7f6ef4105700 legacy=0x7f6ef419b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:24.817 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:24.256+0000 7f6ef9fe3640 1 -- 172.21.15.50:0/4151676721 shutdown_connections 2024-05-20T21:57:24.817 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:24.256+0000 7f6ef9fe3640 1 -- 172.21.15.50:0/4151676721 >> 172.21.15.50:0/4151676721 conn(0x7f6ef4100c80 msgr2=0x7f6ef41030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:24.817 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:24.256+0000 7f6ef9fe3640 1 -- 172.21.15.50:0/4151676721 shutdown_connections 2024-05-20T21:57:24.817 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:24.256+0000 7f6ef9fe3640 1 -- 172.21.15.50:0/4151676721 wait complete. 2024-05-20T21:57:24.817 INFO:teuthology.orchestra.run.smithi050.stdout:firewalld does not appear to be present 2024-05-20T21:57:24.817 INFO:teuthology.orchestra.run.smithi050.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-20T21:57:24.818 INFO:teuthology.orchestra.run.smithi050.stdout:Ceph Dashboard is now available at: 2024-05-20T21:57:24.818 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-20T21:57:24.818 INFO:teuthology.orchestra.run.smithi050.stdout: URL: https://smithi050.front.sepia.ceph.com:8443/ 2024-05-20T21:57:24.818 INFO:teuthology.orchestra.run.smithi050.stdout: User: admin 2024-05-20T21:57:24.818 INFO:teuthology.orchestra.run.smithi050.stdout: Password: yd1xmhwonk 2024-05-20T21:57:24.818 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-20T21:57:24.818 INFO:teuthology.orchestra.run.smithi050.stdout:Saving cluster configuration to /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config directory 2024-05-20T21:57:24.818 INFO:teuthology.orchestra.run.smithi050.stdout:Enabling autotune for osd_memory_target 2024-05-20T21:57:26.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:26 smithi050 bash[21866]: audit 2024-05-20T21:57:25.256247+0000 mon.a (mon.0) 97 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:57:26.619 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.696+0000 7fc380d91640 1 Processor -- start 2024-05-20T21:57:26.619 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.696+0000 7fc380d91640 1 -- start start 2024-05-20T21:57:26.619 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.696+0000 7fc380d91640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc37c109b90 con 0x7fc37c106db0 2024-05-20T21:57:26.619 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.696+0000 7fc37a59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc37c106db0 0x7fc37c1071d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35962/0 (socket says 172.21.15.50:35962) 2024-05-20T21:57:26.619 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.696+0000 7fc37a59c640 1 -- 172.21.15.50:0/1590930940 learned_addr learned my addr 172.21.15.50:0/1590930940 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:26.620 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.696+0000 7fc37959a640 1 -- 172.21.15.50:0/1590930940 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1382933613 0 0) 0x7fc37c109b90 con 0x7fc37c106db0 2024-05-20T21:57:26.620 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.696+0000 7fc37959a640 1 -- 172.21.15.50:0/1590930940 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc368003520 con 0x7fc37c106db0 2024-05-20T21:57:26.620 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.696+0000 7fc37959a640 1 -- 172.21.15.50:0/1590930940 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2787164198 0 0) 0x7fc368003520 con 0x7fc37c106db0 2024-05-20T21:57:26.620 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.696+0000 7fc37959a640 1 -- 172.21.15.50:0/1590930940 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37c10ad70 con 0x7fc37c106db0 2024-05-20T21:57:26.620 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.696+0000 7fc37959a640 1 -- 172.21.15.50:0/1590930940 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fc374001900 con 0x7fc37c106db0 2024-05-20T21:57:26.620 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.696+0000 7fc37959a640 1 -- 172.21.15.50:0/1590930940 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7fc374001ff0 con 0x7fc37c106db0 2024-05-20T21:57:26.620 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.696+0000 7fc37959a640 1 -- 172.21.15.50:0/1590930940 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fc374005c50 con 0x7fc37c106db0 2024-05-20T21:57:26.620 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.696+0000 7fc380d91640 1 -- 172.21.15.50:0/1590930940 >> v1:172.21.15.50:6789/0 conn(0x7fc37c106db0 legacy=0x7fc37c1071d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:26.620 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc380d91640 1 -- 172.21.15.50:0/1590930940 shutdown_connections 2024-05-20T21:57:26.620 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc380d91640 1 -- 172.21.15.50:0/1590930940 >> 172.21.15.50:0/1590930940 conn(0x7fc37c100cc0 msgr2=0x7fc37c103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:26.620 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc380d91640 1 -- 172.21.15.50:0/1590930940 shutdown_connections 2024-05-20T21:57:26.620 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc380d91640 1 -- 172.21.15.50:0/1590930940 wait complete. 2024-05-20T21:57:26.621 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc380d91640 1 Processor -- start 2024-05-20T21:57:26.621 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc380d91640 1 -- start start 2024-05-20T21:57:26.621 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc380d91640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc37c19bda0 con 0x7fc37c106db0 2024-05-20T21:57:26.621 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc37a59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc37c106db0 0x7fc37c19b690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35964/0 (socket says 172.21.15.50:35964) 2024-05-20T21:57:26.621 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc37a59c640 1 -- 172.21.15.50:0/3480517205 learned_addr learned my addr 172.21.15.50:0/3480517205 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:26.621 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc3737fe640 1 -- 172.21.15.50:0/3480517205 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2394512137 0 0) 0x7fc37c19bda0 con 0x7fc37c106db0 2024-05-20T21:57:26.621 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc3737fe640 1 -- 172.21.15.50:0/3480517205 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc368005460 con 0x7fc37c106db0 2024-05-20T21:57:26.621 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc3737fe640 1 -- 172.21.15.50:0/3480517205 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3652211360 0 0) 0x7fc368005460 con 0x7fc37c106db0 2024-05-20T21:57:26.621 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc3737fe640 1 -- 172.21.15.50:0/3480517205 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc37c19bda0 con 0x7fc37c106db0 2024-05-20T21:57:26.621 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc3737fe640 1 -- 172.21.15.50:0/3480517205 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fc374001400 con 0x7fc37c106db0 2024-05-20T21:57:26.621 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc3737fe640 1 -- 172.21.15.50:0/3480517205 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 455206051 0 0) 0x7fc37c19bda0 con 0x7fc37c106db0 2024-05-20T21:57:26.621 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc3737fe640 1 -- 172.21.15.50:0/3480517205 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37c19bf70 con 0x7fc37c106db0 2024-05-20T21:57:26.622 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc380d91640 1 -- 172.21.15.50:0/3480517205 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc37c19c280 con 0x7fc37c106db0 2024-05-20T21:57:26.622 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc380d91640 1 -- 172.21.15.50:0/3480517205 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc37c19fe10 con 0x7fc37c106db0 2024-05-20T21:57:26.622 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc3737fe640 1 -- 172.21.15.50:0/3480517205 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7fc374001fb0 con 0x7fc37c106db0 2024-05-20T21:57:26.622 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc3737fe640 1 -- 172.21.15.50:0/3480517205 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fc3740062f0 con 0x7fc37c106db0 2024-05-20T21:57:26.622 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc3737fe640 1 -- 172.21.15.50:0/3480517205 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 13) ==== 46308+0+0 (unknown 209257320 0 0) 0x7fc374011980 con 0x7fc37c106db0 2024-05-20T21:57:26.622 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc380d91640 1 -- 172.21.15.50:0/3480517205 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc35c0050b0 con 0x7fc37c106db0 2024-05-20T21:57:26.622 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.700+0000 7fc3737fe640 1 -- 172.21.15.50:0/3480517205 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (unknown 3027287997 0 0) 0x7fc374047e10 con 0x7fc37c106db0 2024-05-20T21:57:26.622 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:25.704+0000 7fc3737fe640 1 -- 172.21.15.50:0/3480517205 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7fc374044790 con 0x7fc37c106db0 2024-05-20T21:57:26.622 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:26.044+0000 7fc380d91640 1 -- 172.21.15.50:0/3480517205 --> v1:172.21.15.50:6789/0 -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7fc35c0053a0 con 0x7fc37c106db0 2024-05-20T21:57:26.622 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:26.044+0000 7fc3737fe640 1 -- 172.21.15.50:0/3480517205 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (unknown 689008156 0 0) 0x7fc3740449b0 con 0x7fc37c106db0 2024-05-20T21:57:26.622 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:26.044+0000 7fc380d91640 1 -- 172.21.15.50:0/3480517205 >> v1:172.21.15.50:6800/2944911247 conn(0x7fc36803a580 legacy=0x7fc36803ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:26.622 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:26.044+0000 7fc380d91640 1 -- 172.21.15.50:0/3480517205 >> v1:172.21.15.50:6789/0 conn(0x7fc37c106db0 legacy=0x7fc37c19b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:26.623 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:26.044+0000 7fc380d91640 1 -- 172.21.15.50:0/3480517205 shutdown_connections 2024-05-20T21:57:26.623 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:26.044+0000 7fc380d91640 1 -- 172.21.15.50:0/3480517205 >> 172.21.15.50:0/3480517205 conn(0x7fc37c100cc0 msgr2=0x7fc37c1010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:26.623 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:26.044+0000 7fc380d91640 1 -- 172.21.15.50:0/3480517205 shutdown_connections 2024-05-20T21:57:26.623 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:26.044+0000 7fc380d91640 1 -- 172.21.15.50:0/3480517205 wait complete. 2024-05-20T21:57:28.592 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.432+0000 7f75b24fc640 1 Processor -- start 2024-05-20T21:57:28.592 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.432+0000 7f75b24fc640 1 -- start start 2024-05-20T21:57:28.592 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.432+0000 7f75b24fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f75ac10bce0 con 0x7f75ac1078b0 2024-05-20T21:57:28.592 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.432+0000 7f75abfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f75ac1078b0 0x7f75ac107cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35966/0 (socket says 172.21.15.50:35966) 2024-05-20T21:57:28.592 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.432+0000 7f75abfff640 1 -- 172.21.15.50:0/4061892082 learned_addr learned my addr 172.21.15.50:0/4061892082 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:28.592 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.432+0000 7f75aaffd640 1 -- 172.21.15.50:0/4061892082 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2633894508 0 0) 0x7f75ac10bce0 con 0x7f75ac1078b0 2024-05-20T21:57:28.592 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.432+0000 7f75aaffd640 1 -- 172.21.15.50:0/4061892082 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7594003520 con 0x7f75ac1078b0 2024-05-20T21:57:28.593 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.432+0000 7f75aaffd640 1 -- 172.21.15.50:0/4061892082 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3353507204 0 0) 0x7f7594003520 con 0x7f75ac1078b0 2024-05-20T21:57:28.593 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.432+0000 7f75aaffd640 1 -- 172.21.15.50:0/4061892082 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ac10cec0 con 0x7f75ac1078b0 2024-05-20T21:57:28.593 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.432+0000 7f75aaffd640 1 -- 172.21.15.50:0/4061892082 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f759c001580 con 0x7f75ac1078b0 2024-05-20T21:57:28.593 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.432+0000 7f75aaffd640 1 -- 172.21.15.50:0/4061892082 <== mon.0 v1:172.21.15.50:6789/0 4 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f759c001c70 con 0x7f75ac1078b0 2024-05-20T21:57:28.593 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.432+0000 7f75aaffd640 1 -- 172.21.15.50:0/4061892082 <== mon.0 v1:172.21.15.50:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f759c0058d0 con 0x7f75ac1078b0 2024-05-20T21:57:28.593 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.432+0000 7f75b24fc640 1 -- 172.21.15.50:0/4061892082 >> v1:172.21.15.50:6789/0 conn(0x7f75ac1078b0 legacy=0x7f75ac107cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:28.593 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.432+0000 7f75b24fc640 1 -- 172.21.15.50:0/4061892082 shutdown_connections 2024-05-20T21:57:28.593 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.432+0000 7f75b24fc640 1 -- 172.21.15.50:0/4061892082 >> 172.21.15.50:0/4061892082 conn(0x7f75ac07adf0 msgr2=0x7f75ac07b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:28.593 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.432+0000 7f75b24fc640 1 -- 172.21.15.50:0/4061892082 shutdown_connections 2024-05-20T21:57:28.593 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.436+0000 7f75b24fc640 1 -- 172.21.15.50:0/4061892082 wait complete. 2024-05-20T21:57:28.593 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.436+0000 7f75b24fc640 1 Processor -- start 2024-05-20T21:57:28.594 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.436+0000 7f75b24fc640 1 -- start start 2024-05-20T21:57:28.594 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.436+0000 7f75b24fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f75ac19bbd0 con 0x7f75ac1078b0 2024-05-20T21:57:28.594 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.436+0000 7f75abfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f75ac1078b0 0x7f75ac19b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35976/0 (socket says 172.21.15.50:35976) 2024-05-20T21:57:28.594 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.436+0000 7f75abfff640 1 -- 172.21.15.50:0/2000094177 learned_addr learned my addr 172.21.15.50:0/2000094177 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:28.594 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.436+0000 7f75a97fa640 1 -- 172.21.15.50:0/2000094177 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 539263855 0 0) 0x7f75ac19bbd0 con 0x7f75ac1078b0 2024-05-20T21:57:28.594 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.436+0000 7f75a97fa640 1 -- 172.21.15.50:0/2000094177 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7594005460 con 0x7f75ac1078b0 2024-05-20T21:57:28.594 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.436+0000 7f75a97fa640 1 -- 172.21.15.50:0/2000094177 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 96504181 0 0) 0x7f7594005460 con 0x7f75ac1078b0 2024-05-20T21:57:28.594 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.436+0000 7f75a97fa640 1 -- 172.21.15.50:0/2000094177 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f75ac19bbd0 con 0x7f75ac1078b0 2024-05-20T21:57:28.595 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.436+0000 7f75a97fa640 1 -- 172.21.15.50:0/2000094177 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f759c001080 con 0x7f75ac1078b0 2024-05-20T21:57:28.595 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.436+0000 7f75a97fa640 1 -- 172.21.15.50:0/2000094177 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3421510856 0 0) 0x7f75ac19bbd0 con 0x7f75ac1078b0 2024-05-20T21:57:28.595 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.436+0000 7f75a97fa640 1 -- 172.21.15.50:0/2000094177 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ac19bda0 con 0x7f75ac1078b0 2024-05-20T21:57:28.595 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.436+0000 7f75b24fc640 1 -- 172.21.15.50:0/2000094177 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f75ac19c0b0 con 0x7f75ac1078b0 2024-05-20T21:57:28.595 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.436+0000 7f75b24fc640 1 -- 172.21.15.50:0/2000094177 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f75ac19fc40 con 0x7f75ac1078b0 2024-05-20T21:57:28.595 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.436+0000 7f75a97fa640 1 -- 172.21.15.50:0/2000094177 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f759c001a50 con 0x7f75ac1078b0 2024-05-20T21:57:28.595 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.436+0000 7f75a97fa640 1 -- 172.21.15.50:0/2000094177 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f759c005fc0 con 0x7f75ac1078b0 2024-05-20T21:57:28.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.436+0000 7f75a97fa640 1 -- 172.21.15.50:0/2000094177 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 13) ==== 46308+0+0 (unknown 209257320 0 0) 0x7f759c011710 con 0x7f75ac1078b0 2024-05-20T21:57:28.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.436+0000 7f75b24fc640 1 -- 172.21.15.50:0/2000094177 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75980050b0 con 0x7f75ac1078b0 2024-05-20T21:57:28.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.436+0000 7f75a97fa640 1 -- 172.21.15.50:0/2000094177 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (unknown 3027287997 0 0) 0x7f759c047af0 con 0x7f75ac1078b0 2024-05-20T21:57:28.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.440+0000 7f75a97fa640 1 -- 172.21.15.50:0/2000094177 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f759c017730 con 0x7f75ac1078b0 2024-05-20T21:57:28.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.976+0000 7f75b24fc640 1 -- 172.21.15.50:0/2000094177 --> v1:172.21.15.50:6789/0 -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f75980053a0 con 0x7f75ac1078b0 2024-05-20T21:57:28.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.980+0000 7f75a97fa640 1 -- 172.21.15.50:0/2000094177 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v26)=0 set mgr/dashboard/cluster/status v26) ==== 153+0+0 (unknown 1951093493 0 0) 0x7f759c017030 con 0x7f75ac1078b0 2024-05-20T21:57:28.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-20T21:57:28.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.980+0000 7f75b24fc640 1 -- 172.21.15.50:0/2000094177 >> v1:172.21.15.50:6800/2944911247 conn(0x7f759403a580 legacy=0x7f759403ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:28.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.980+0000 7f75b24fc640 1 -- 172.21.15.50:0/2000094177 >> v1:172.21.15.50:6789/0 conn(0x7f75ac1078b0 legacy=0x7f75ac19b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:28.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.980+0000 7f75b24fc640 1 -- 172.21.15.50:0/2000094177 shutdown_connections 2024-05-20T21:57:28.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.980+0000 7f75b24fc640 1 -- 172.21.15.50:0/2000094177 >> 172.21.15.50:0/2000094177 conn(0x7f75ac07adf0 msgr2=0x7f75ac104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:28.597 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.980+0000 7f75b24fc640 1 -- 172.21.15.50:0/2000094177 shutdown_connections 2024-05-20T21:57:28.597 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-05-20T21:57:27.980+0000 7f75b24fc640 1 -- 172.21.15.50:0/2000094177 wait complete. 2024-05-20T21:57:28.597 INFO:teuthology.orchestra.run.smithi050.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-20T21:57:28.597 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-20T21:57:28.597 INFO:teuthology.orchestra.run.smithi050.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-20T21:57:28.597 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-20T21:57:28.597 INFO:teuthology.orchestra.run.smithi050.stdout:Or, if you are only running a single cluster on this host: 2024-05-20T21:57:28.597 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-20T21:57:28.597 INFO:teuthology.orchestra.run.smithi050.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-20T21:57:28.597 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-20T21:57:28.597 INFO:teuthology.orchestra.run.smithi050.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-20T21:57:28.597 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-20T21:57:28.598 INFO:teuthology.orchestra.run.smithi050.stdout: ceph telemetry on 2024-05-20T21:57:28.598 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-20T21:57:28.598 INFO:teuthology.orchestra.run.smithi050.stdout:For more information see: 2024-05-20T21:57:28.598 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-20T21:57:28.598 INFO:teuthology.orchestra.run.smithi050.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-20T21:57:28.598 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-20T21:57:28.598 INFO:teuthology.orchestra.run.smithi050.stdout:Bootstrap complete. 2024-05-20T21:57:28.635 INFO:tasks.cephadm:Fetching config... 2024-05-20T21:57:28.635 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-20T21:57:28.635 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-20T21:57:28.682 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-20T21:57:28.682 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-20T21:57:28.682 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-20T21:57:28.729 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-20T21:57:28.730 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-20T21:57:28.730 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-20T21:57:28.786 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-20T21:57:28.786 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-20T21:57:28.786 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-20T21:57:28.833 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-20T21:57:28.833 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEoEXBafi2pttqogN60UbEngYlw3EUn8rkAB4V8PUTnlVLu10csMfeNdcq0ceX33D4pP7ikrd01cTZDPJTl6kKrZCiS+2uuCNN1QAToprkp9p9WdioAM4lNV7FKgCq4R52l2klyhOp3hrRAQGbLs/vYRDrLkV2CvM71i7VRHONz6dAFigJGKeAkKffweqyaIi1Bh4zhN8HwkKB596sr3CEc41jh54QTT6JTGPuAFtN74JSQj01zL2pUumM48gCwNGFe95bosCcUlXjbIDnUu8g5WXZkrzYucPu4HYBxWrhKpChgHve5nvaPcQ+JXHMhdSz1IKZ+RBsCF+Fapqp7CfMRTF+7IYSJ3v8BF7BbiU6OLqvYJXdsKPmH3sN37K92SBcBGbBBcVq7VS0e22jy/z98MjS6WH/ENU+6kZX5DwpaU0ulTOW0vuHDO6+qmlmwNiZgKg0lWvaX1nQnpdtsXuCNvbnj5/VHxml1ojQoUhFtR1fdbwkajyEMYE373zRVuM= ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-20T21:57:28.897 INFO:teuthology.orchestra.run.smithi050.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEoEXBafi2pttqogN60UbEngYlw3EUn8rkAB4V8PUTnlVLu10csMfeNdcq0ceX33D4pP7ikrd01cTZDPJTl6kKrZCiS+2uuCNN1QAToprkp9p9WdioAM4lNV7FKgCq4R52l2klyhOp3hrRAQGbLs/vYRDrLkV2CvM71i7VRHONz6dAFigJGKeAkKffweqyaIi1Bh4zhN8HwkKB596sr3CEc41jh54QTT6JTGPuAFtN74JSQj01zL2pUumM48gCwNGFe95bosCcUlXjbIDnUu8g5WXZkrzYucPu4HYBxWrhKpChgHve5nvaPcQ+JXHMhdSz1IKZ+RBsCF+Fapqp7CfMRTF+7IYSJ3v8BF7BbiU6OLqvYJXdsKPmH3sN37K92SBcBGbBBcVq7VS0e22jy/z98MjS6WH/ENU+6kZX5DwpaU0ulTOW0vuHDO6+qmlmwNiZgKg0lWvaX1nQnpdtsXuCNvbnj5/VHxml1ojQoUhFtR1fdbwkajyEMYE373zRVuM= ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:57:28.907 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEoEXBafi2pttqogN60UbEngYlw3EUn8rkAB4V8PUTnlVLu10csMfeNdcq0ceX33D4pP7ikrd01cTZDPJTl6kKrZCiS+2uuCNN1QAToprkp9p9WdioAM4lNV7FKgCq4R52l2klyhOp3hrRAQGbLs/vYRDrLkV2CvM71i7VRHONz6dAFigJGKeAkKffweqyaIi1Bh4zhN8HwkKB596sr3CEc41jh54QTT6JTGPuAFtN74JSQj01zL2pUumM48gCwNGFe95bosCcUlXjbIDnUu8g5WXZkrzYucPu4HYBxWrhKpChgHve5nvaPcQ+JXHMhdSz1IKZ+RBsCF+Fapqp7CfMRTF+7IYSJ3v8BF7BbiU6OLqvYJXdsKPmH3sN37K92SBcBGbBBcVq7VS0e22jy/z98MjS6WH/ENU+6kZX5DwpaU0ulTOW0vuHDO6+qmlmwNiZgKg0lWvaX1nQnpdtsXuCNvbnj5/VHxml1ojQoUhFtR1fdbwkajyEMYE373zRVuM= ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-20T21:57:28.932 INFO:teuthology.orchestra.run.smithi145.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEoEXBafi2pttqogN60UbEngYlw3EUn8rkAB4V8PUTnlVLu10csMfeNdcq0ceX33D4pP7ikrd01cTZDPJTl6kKrZCiS+2uuCNN1QAToprkp9p9WdioAM4lNV7FKgCq4R52l2klyhOp3hrRAQGbLs/vYRDrLkV2CvM71i7VRHONz6dAFigJGKeAkKffweqyaIi1Bh4zhN8HwkKB596sr3CEc41jh54QTT6JTGPuAFtN74JSQj01zL2pUumM48gCwNGFe95bosCcUlXjbIDnUu8g5WXZkrzYucPu4HYBxWrhKpChgHve5nvaPcQ+JXHMhdSz1IKZ+RBsCF+Fapqp7CfMRTF+7IYSJ3v8BF7BbiU6OLqvYJXdsKPmH3sN37K92SBcBGbBBcVq7VS0e22jy/z98MjS6WH/ENU+6kZX5DwpaU0ulTOW0vuHDO6+qmlmwNiZgKg0lWvaX1nQnpdtsXuCNvbnj5/VHxml1ojQoUhFtR1fdbwkajyEMYE373zRVuM= ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:57:28.942 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-20T21:57:29.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:28 smithi050 bash[21866]: audit 2024-05-20T21:57:27.984339+0000 mon.a (mon.0) 98 : audit 1 from='client.? v1:172.21.15.50:0/2000094177' entity='client.admin' 2024-05-20T21:57:33.579 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T21:57:36.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.492+0000 7f56ab639640 1 -- 172.21.15.50:0/3818866170 >> v1:172.21.15.50:6789/0 conn(0x7f56a4103480 legacy=0x7f56a41038a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:36.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.492+0000 7f56ab639640 1 -- 172.21.15.50:0/3818866170 shutdown_connections 2024-05-20T21:57:36.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.492+0000 7f56ab639640 1 -- 172.21.15.50:0/3818866170 >> 172.21.15.50:0/3818866170 conn(0x7f56a40fea20 msgr2=0x7f56a4100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:36.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.492+0000 7f56ab639640 1 -- 172.21.15.50:0/3818866170 shutdown_connections 2024-05-20T21:57:36.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.492+0000 7f56ab639640 1 -- 172.21.15.50:0/3818866170 wait complete. 2024-05-20T21:57:36.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.492+0000 7f56ab639640 1 Processor -- start 2024-05-20T21:57:36.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.492+0000 7f56ab639640 1 -- start start 2024-05-20T21:57:36.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.492+0000 7f56ab639640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f56a4198590 con 0x7f56a4103480 2024-05-20T21:57:36.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.492+0000 7f56a93d5640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f56a4103480 0x7f56a4197e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43730/0 (socket says 172.21.15.50:43730) 2024-05-20T21:57:36.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.492+0000 7f56a93d5640 1 -- 172.21.15.50:0/2676858374 learned_addr learned my addr 172.21.15.50:0/2676858374 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:36.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.492+0000 7f56a27fc640 1 -- 172.21.15.50:0/2676858374 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4132677274 0 0) 0x7f56a4198590 con 0x7f56a4103480 2024-05-20T21:57:36.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.496+0000 7f56a27fc640 1 -- 172.21.15.50:0/2676858374 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f568c005410 con 0x7f56a4103480 2024-05-20T21:57:36.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.496+0000 7f56a27fc640 1 -- 172.21.15.50:0/2676858374 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 920272014 0 0) 0x7f568c005410 con 0x7f56a4103480 2024-05-20T21:57:36.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.496+0000 7f56a27fc640 1 -- 172.21.15.50:0/2676858374 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56a4198590 con 0x7f56a4103480 2024-05-20T21:57:36.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.496+0000 7f56a27fc640 1 -- 172.21.15.50:0/2676858374 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f5694001480 con 0x7f56a4103480 2024-05-20T21:57:36.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.496+0000 7f56a27fc640 1 -- 172.21.15.50:0/2676858374 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 190308774 0 0) 0x7f56a4198590 con 0x7f56a4103480 2024-05-20T21:57:36.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.496+0000 7f56a27fc640 1 -- 172.21.15.50:0/2676858374 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a4198760 con 0x7f56a4103480 2024-05-20T21:57:36.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.496+0000 7f56ab639640 1 -- 172.21.15.50:0/2676858374 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f56a4198a70 con 0x7f56a4103480 2024-05-20T21:57:36.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.496+0000 7f56ab639640 1 -- 172.21.15.50:0/2676858374 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f56a419c600 con 0x7f56a4103480 2024-05-20T21:57:36.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.496+0000 7f56a27fc640 1 -- 172.21.15.50:0/2676858374 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f5694003650 con 0x7f56a4103480 2024-05-20T21:57:36.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.496+0000 7f56a27fc640 1 -- 172.21.15.50:0/2676858374 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f5694004cd0 con 0x7f56a4103480 2024-05-20T21:57:36.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.496+0000 7f56a27fc640 1 -- 172.21.15.50:0/2676858374 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 13) ==== 46308+0+0 (unknown 209257320 0 0) 0x7f5694004e90 con 0x7f56a4103480 2024-05-20T21:57:36.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.496+0000 7f56ab639640 1 -- 172.21.15.50:0/2676858374 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56900050b0 con 0x7f56a4103480 2024-05-20T21:57:36.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.496+0000 7f56a27fc640 1 -- 172.21.15.50:0/2676858374 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (unknown 3027287997 0 0) 0x7f5694047c40 con 0x7f56a4103480 2024-05-20T21:57:36.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.500+0000 7f56a27fc640 1 -- 172.21.15.50:0/2676858374 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f5694017520 con 0x7f56a4103480 2024-05-20T21:57:36.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.696+0000 7f56ab639640 1 -- 172.21.15.50:0/2676858374 --> v1:172.21.15.50:6789/0 -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f56900053a0 con 0x7f56a4103480 2024-05-20T21:57:36.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.700+0000 7f56a27fc640 1 -- 172.21.15.50:0/2676858374 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (unknown 3028693289 0 0) 0x7f5694016e20 con 0x7f56a4103480 2024-05-20T21:57:36.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.700+0000 7f56ab639640 1 -- 172.21.15.50:0/2676858374 >> v1:172.21.15.50:6800/2944911247 conn(0x7f568c03a400 legacy=0x7f568c03c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:36.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.700+0000 7f56ab639640 1 -- 172.21.15.50:0/2676858374 >> v1:172.21.15.50:6789/0 conn(0x7f56a4103480 legacy=0x7f56a4197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:36.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.700+0000 7f56ab639640 1 -- 172.21.15.50:0/2676858374 shutdown_connections 2024-05-20T21:57:36.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.700+0000 7f56ab639640 1 -- 172.21.15.50:0/2676858374 >> 172.21.15.50:0/2676858374 conn(0x7f56a40fea20 msgr2=0x7f56a4100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:36.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.704+0000 7f56ab639640 1 -- 172.21.15.50:0/2676858374 shutdown_connections 2024-05-20T21:57:36.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:36.704+0000 7f56ab639640 1 -- 172.21.15.50:0/2676858374 wait complete. 2024-05-20T21:57:37.402 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-20T21:57:37.403 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-20T21:57:37.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:37 smithi050 bash[21866]: audit 2024-05-20T21:57:36.290495+0000 mon.a (mon.0) 99 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:57:37.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:37 smithi050 bash[21866]: audit 2024-05-20T21:57:36.294320+0000 mon.a (mon.0) 100 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:57:37.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:37 smithi050 bash[21866]: audit 2024-05-20T21:57:36.295517+0000 mon.a (mon.0) 101 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi050", "name": "osd_memory_target"}]: dispatch 2024-05-20T21:57:37.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:37 smithi050 bash[21866]: audit 2024-05-20T21:57:36.301436+0000 mon.a (mon.0) 102 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:57:37.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:37 smithi050 bash[21866]: audit 2024-05-20T21:57:36.325809+0000 mon.a (mon.0) 103 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:57:37.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:37 smithi050 bash[21866]: audit 2024-05-20T21:57:36.333280+0000 mon.a (mon.0) 104 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:57:37.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:37 smithi050 bash[21866]: audit 2024-05-20T21:57:36.704485+0000 mon.a (mon.0) 105 : audit 1 from='client.? v1:172.21.15.50:0/2676858374' entity='client.admin' 2024-05-20T21:57:37.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:37 smithi050 bash[21866]: audit 2024-05-20T21:57:36.723989+0000 mon.a (mon.0) 106 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:57:37.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:37 smithi050 bash[21866]: audit 2024-05-20T21:57:36.728618+0000 mon.a (mon.0) 107 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:57:38.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:38 smithi050 bash[21866]: cluster 2024-05-20T21:57:37.404272+0000 mgr.y (mgr.14150) 10 : cluster 0 pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:57:40.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:40 smithi050 bash[21866]: cluster 2024-05-20T21:57:39.404709+0000 mgr.y (mgr.14150) 11 : cluster 0 pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:57:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T21:57:42.909 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:42 smithi050 bash[21866]: cluster 2024-05-20T21:57:41.405137+0000 mgr.y (mgr.14150) 12 : cluster 0 pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:57:44.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd1abc73640 1 -- 172.21.15.50:0/578350273 >> v1:172.21.15.50:6789/0 conn(0x7fd1a4101260 legacy=0x7fd1a4101680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:44.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd1abc73640 1 -- 172.21.15.50:0/578350273 shutdown_connections 2024-05-20T21:57:44.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd1abc73640 1 -- 172.21.15.50:0/578350273 >> 172.21.15.50:0/578350273 conn(0x7fd1a40fc860 msgr2=0x7fd1a40fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:44.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd1abc73640 1 -- 172.21.15.50:0/578350273 shutdown_connections 2024-05-20T21:57:44.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd1abc73640 1 -- 172.21.15.50:0/578350273 wait complete. 2024-05-20T21:57:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd1abc73640 1 Processor -- start 2024-05-20T21:57:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd1abc73640 1 -- start start 2024-05-20T21:57:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd1abc73640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fd1a41963b0 con 0x7fd1a4101260 2024-05-20T21:57:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd1a9a0f640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd1a4101260 0x7fd1a4195ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36122/0 (socket says 172.21.15.50:36122) 2024-05-20T21:57:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd1a9a0f640 1 -- 172.21.15.50:0/2442224507 learned_addr learned my addr 172.21.15.50:0/2442224507 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd19affd640 1 -- 172.21.15.50:0/2442224507 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 744243646 0 0) 0x7fd1a41963b0 con 0x7fd1a4101260 2024-05-20T21:57:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd19affd640 1 -- 172.21.15.50:0/2442224507 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd190005410 con 0x7fd1a4101260 2024-05-20T21:57:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd19affd640 1 -- 172.21.15.50:0/2442224507 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 811905964 0 0) 0x7fd190005410 con 0x7fd1a4101260 2024-05-20T21:57:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd19affd640 1 -- 172.21.15.50:0/2442224507 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1a41963b0 con 0x7fd1a4101260 2024-05-20T21:57:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd19affd640 1 -- 172.21.15.50:0/2442224507 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fd1a0001800 con 0x7fd1a4101260 2024-05-20T21:57:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd19affd640 1 -- 172.21.15.50:0/2442224507 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2842919056 0 0) 0x7fd1a41963b0 con 0x7fd1a4101260 2024-05-20T21:57:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd19affd640 1 -- 172.21.15.50:0/2442224507 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a4196580 con 0x7fd1a4101260 2024-05-20T21:57:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd1abc73640 1 -- 172.21.15.50:0/2442224507 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd1a4196890 con 0x7fd1a4101260 2024-05-20T21:57:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd1abc73640 1 -- 172.21.15.50:0/2442224507 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd1a419a3d0 con 0x7fd1a4101260 2024-05-20T21:57:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd19affd640 1 -- 172.21.15.50:0/2442224507 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7fd1a00039d0 con 0x7fd1a4101260 2024-05-20T21:57:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd19affd640 1 -- 172.21.15.50:0/2442224507 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fd1a0005010 con 0x7fd1a4101260 2024-05-20T21:57:44.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd19affd640 1 -- 172.21.15.50:0/2442224507 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 13) ==== 46308+0+0 (unknown 209257320 0 0) 0x7fd1a00051d0 con 0x7fd1a4101260 2024-05-20T21:57:44.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd1abc73640 1 -- 172.21.15.50:0/2442224507 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1880050b0 con 0x7fd1a4101260 2024-05-20T21:57:44.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.595+0000 7fd19affd640 1 -- 172.21.15.50:0/2442224507 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (unknown 3027287997 0 0) 0x7fd1a0047c30 con 0x7fd1a4101260 2024-05-20T21:57:44.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.603+0000 7fd19affd640 1 -- 172.21.15.50:0/2442224507 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7fd1a00177b0 con 0x7fd1a4101260 2024-05-20T21:57:44.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:44 smithi050 bash[21866]: cluster 2024-05-20T21:57:43.405525+0000 mgr.y (mgr.14150) 13 : cluster 0 pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:57:44.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.795+0000 7fd1abc73640 1 -- 172.21.15.50:0/2442224507 --> v1:172.21.15.50:6800/2944911247 -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fd188000bc0 con 0x7fd19003a460 2024-05-20T21:57:44.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.799+0000 7fd19affd640 1 -- 172.21.15.50:0/2442224507 <== mgr.14150 v1:172.21.15.50:6800/2944911247 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (unknown 0 0 0) 0x7fd188000bc0 con 0x7fd19003a460 2024-05-20T21:57:44.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.803+0000 7fd1abc73640 1 -- 172.21.15.50:0/2442224507 >> v1:172.21.15.50:6800/2944911247 conn(0x7fd19003a460 legacy=0x7fd19003c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:44.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.803+0000 7fd1abc73640 1 -- 172.21.15.50:0/2442224507 >> v1:172.21.15.50:6789/0 conn(0x7fd1a4101260 legacy=0x7fd1a4195ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:44.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.803+0000 7fd1abc73640 1 -- 172.21.15.50:0/2442224507 shutdown_connections 2024-05-20T21:57:44.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.803+0000 7fd1abc73640 1 -- 172.21.15.50:0/2442224507 >> 172.21.15.50:0/2442224507 conn(0x7fd1a40fc860 msgr2=0x7fd1a40fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:44.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.803+0000 7fd1abc73640 1 -- 172.21.15.50:0/2442224507 shutdown_connections 2024-05-20T21:57:44.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:44.803+0000 7fd1abc73640 1 -- 172.21.15.50:0/2442224507 wait complete. 2024-05-20T21:57:45.477 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi145 2024-05-20T21:57:45.478 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-05-20T21:57:45.478 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/etc/ceph/ceph.conf 2024-05-20T21:57:45.484 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-05-20T21:57:45.484 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-20T21:57:45.532 INFO:tasks.cephadm:Adding host smithi145 to orchestrator... 2024-05-20T21:57:45.532 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph orch host add smithi145 2024-05-20T21:57:46.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:45 smithi050 bash[21866]: audit 2024-05-20T21:57:44.799010+0000 mgr.y (mgr.14150) 14 : audit 0 from='client.14174 v1:172.21.15.50:0/2442224507' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T21:57:46.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:45 smithi050 bash[21866]: audit 2024-05-20T21:57:44.802532+0000 mon.a (mon.0) 108 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:57:46.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:45 smithi050 bash[21866]: audit 2024-05-20T21:57:44.803564+0000 mon.a (mon.0) 109 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:57:46.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:45 smithi050 bash[21866]: audit 2024-05-20T21:57:44.805988+0000 mon.a (mon.0) 110 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:57:46.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:45 smithi050 bash[21866]: audit 2024-05-20T21:57:44.807088+0000 mon.a (mon.0) 111 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:57:46.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:45 smithi050 bash[21866]: cephadm 2024-05-20T21:57:44.808375+0000 mgr.y (mgr.14150) 15 : cephadm 1 Updating smithi050:/etc/ceph/ceph.conf 2024-05-20T21:57:46.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:45 smithi050 bash[21866]: cephadm 2024-05-20T21:57:44.903180+0000 mgr.y (mgr.14150) 16 : cephadm 1 Updating smithi050:/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T21:57:46.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:45 smithi050 bash[21866]: cephadm 2024-05-20T21:57:44.989042+0000 mgr.y (mgr.14150) 17 : cephadm 1 Updating smithi050:/etc/ceph/ceph.client.admin.keyring 2024-05-20T21:57:46.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:45 smithi050 bash[21866]: cephadm 2024-05-20T21:57:45.081489+0000 mgr.y (mgr.14150) 18 : cephadm 1 Updating smithi050:/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T21:57:46.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:45 smithi050 bash[21866]: audit 2024-05-20T21:57:45.181752+0000 mon.a (mon.0) 112 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:57:46.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:45 smithi050 bash[21866]: audit 2024-05-20T21:57:45.184715+0000 mon.a (mon.0) 113 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:57:46.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:45 smithi050 bash[21866]: audit 2024-05-20T21:57:45.187677+0000 mon.a (mon.0) 114 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:57:47.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:47 smithi050 bash[21866]: cluster 2024-05-20T21:57:45.406016+0000 mgr.y (mgr.14150) 19 : cluster 0 pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:57:49.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:49 smithi050 bash[21866]: cluster 2024-05-20T21:57:47.406531+0000 mgr.y (mgr.14150) 20 : cluster 0 pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:57:50.250 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T21:57:51.316 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:51 smithi050 bash[21866]: cluster 2024-05-20T21:57:49.406971+0000 mgr.y (mgr.14150) 21 : cluster 0 pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:57:52.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.594+0000 7f11edbd9640 1 -- 172.21.15.50:0/1752892766 >> v1:172.21.15.50:6789/0 conn(0x7f11e8101460 legacy=0x7f11e8101840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:52.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.594+0000 7f11edbd9640 1 -- 172.21.15.50:0/1752892766 shutdown_connections 2024-05-20T21:57:52.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.594+0000 7f11edbd9640 1 -- 172.21.15.50:0/1752892766 >> 172.21.15.50:0/1752892766 conn(0x7f11e80fcd10 msgr2=0x7f11e80ff130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:52.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.594+0000 7f11edbd9640 1 -- 172.21.15.50:0/1752892766 shutdown_connections 2024-05-20T21:57:52.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.594+0000 7f11edbd9640 1 -- 172.21.15.50:0/1752892766 wait complete. 2024-05-20T21:57:52.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.598+0000 7f11edbd9640 1 Processor -- start 2024-05-20T21:57:52.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.598+0000 7f11edbd9640 1 -- start start 2024-05-20T21:57:52.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.598+0000 7f11edbd9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f11e8196720 con 0x7f11e8101460 2024-05-20T21:57:52.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.598+0000 7f11e77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f11e8101460 0x7f11e8196010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52610/0 (socket says 172.21.15.50:52610) 2024-05-20T21:57:52.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.598+0000 7f11e77fe640 1 -- 172.21.15.50:0/4208975661 learned_addr learned my addr 172.21.15.50:0/4208975661 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:57:52.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.598+0000 7f11e4ff9640 1 -- 172.21.15.50:0/4208975661 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3715803897 0 0) 0x7f11e8196720 con 0x7f11e8101460 2024-05-20T21:57:52.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.598+0000 7f11e4ff9640 1 -- 172.21.15.50:0/4208975661 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11d4005410 con 0x7f11e8101460 2024-05-20T21:57:52.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.598+0000 7f11e4ff9640 1 -- 172.21.15.50:0/4208975661 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 76903773 0 0) 0x7f11d4005410 con 0x7f11e8101460 2024-05-20T21:57:52.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.598+0000 7f11e4ff9640 1 -- 172.21.15.50:0/4208975661 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f11e8196720 con 0x7f11e8101460 2024-05-20T21:57:52.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.598+0000 7f11e4ff9640 1 -- 172.21.15.50:0/4208975661 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f11d8001800 con 0x7f11e8101460 2024-05-20T21:57:52.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.598+0000 7f11e4ff9640 1 -- 172.21.15.50:0/4208975661 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2273298006 0 0) 0x7f11e8196720 con 0x7f11e8101460 2024-05-20T21:57:52.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.598+0000 7f11e4ff9640 1 -- 172.21.15.50:0/4208975661 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e81968f0 con 0x7f11e8101460 2024-05-20T21:57:52.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.598+0000 7f11edbd9640 1 -- 172.21.15.50:0/4208975661 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f11e8196be0 con 0x7f11e8101460 2024-05-20T21:57:52.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.598+0000 7f11edbd9640 1 -- 172.21.15.50:0/4208975661 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f11e819ed40 con 0x7f11e8101460 2024-05-20T21:57:52.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.598+0000 7f11e4ff9640 1 -- 172.21.15.50:0/4208975661 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f11d8003a30 con 0x7f11e8101460 2024-05-20T21:57:52.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.598+0000 7f11e4ff9640 1 -- 172.21.15.50:0/4208975661 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f11d8004ff0 con 0x7f11e8101460 2024-05-20T21:57:52.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.598+0000 7f11e4ff9640 1 -- 172.21.15.50:0/4208975661 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 13) ==== 46308+0+0 (unknown 209257320 0 0) 0x7f11d80051b0 con 0x7f11e8101460 2024-05-20T21:57:52.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.598+0000 7f11e4ff9640 1 -- 172.21.15.50:0/4208975661 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (unknown 3027287997 0 0) 0x7f11d80489b0 con 0x7f11e8101460 2024-05-20T21:57:52.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.598+0000 7f11edbd9640 1 -- 172.21.15.50:0/4208975661 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c8005080 con 0x7f11e8101460 2024-05-20T21:57:52.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.602+0000 7f11e4ff9640 1 -- 172.21.15.50:0/4208975661 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f11d8017700 con 0x7f11e8101460 2024-05-20T21:57:52.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:52.798+0000 7f11edbd9640 1 -- 172.21.15.50:0/4208975661 --> v1:172.21.15.50:6800/2944911247 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi145", "target": ["mon-mgr", ""]}) -- 0x7f11c8000b90 con 0x7f11d403a480 2024-05-20T21:57:53.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:53 smithi050 bash[21866]: cluster 2024-05-20T21:57:51.407375+0000 mgr.y (mgr.14150) 22 : cluster 0 pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:57:54.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:54 smithi050 bash[21866]: audit 2024-05-20T21:57:52.802643+0000 mgr.y (mgr.14150) 23 : audit 0 from='client.14176 v1:172.21.15.50:0/4208975661' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi145", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T21:57:55.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:55 smithi050 bash[21866]: cluster 2024-05-20T21:57:53.407740+0000 mgr.y (mgr.14150) 24 : cluster 0 pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:57:55.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:55 smithi050 bash[21866]: cephadm 2024-05-20T21:57:54.085002+0000 mgr.y (mgr.14150) 25 : cephadm 1 Deploying cephadm binary to smithi145 2024-05-20T21:57:56.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:56 smithi050 bash[21866]: cluster 2024-05-20T21:57:55.408079+0000 mgr.y (mgr.14150) 26 : cluster 0 pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:57:57.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:57.754+0000 7f11e4ff9640 1 -- 172.21.15.50:0/4208975661 <== mgr.14150 v1:172.21.15.50:6800/2944911247 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (unknown 0 0 3047122762) 0x7f11c8000b90 con 0x7f11d403a480 2024-05-20T21:57:57.755 INFO:teuthology.orchestra.run.smithi050.stdout:Added host 'smithi145' with addr '172.21.15.145' 2024-05-20T21:57:57.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:57.754+0000 7f11edbd9640 1 -- 172.21.15.50:0/4208975661 >> v1:172.21.15.50:6800/2944911247 conn(0x7f11d403a480 legacy=0x7f11d403c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:57.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:57.754+0000 7f11edbd9640 1 -- 172.21.15.50:0/4208975661 >> v1:172.21.15.50:6789/0 conn(0x7f11e8101460 legacy=0x7f11e8196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:57:57.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:57.758+0000 7f11edbd9640 1 -- 172.21.15.50:0/4208975661 shutdown_connections 2024-05-20T21:57:57.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:57.758+0000 7f11edbd9640 1 -- 172.21.15.50:0/4208975661 >> 172.21.15.50:0/4208975661 conn(0x7f11e80fcd10 msgr2=0x7f11e8108250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:57:57.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:57.758+0000 7f11edbd9640 1 -- 172.21.15.50:0/4208975661 shutdown_connections 2024-05-20T21:57:57.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:57:57.758+0000 7f11edbd9640 1 -- 172.21.15.50:0/4208975661 wait complete. 2024-05-20T21:57:58.438 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph orch host ls --format=json 2024-05-20T21:57:59.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:58 smithi050 bash[21866]: cluster 2024-05-20T21:57:57.408478+0000 mgr.y (mgr.14150) 27 : cluster 0 pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:57:59.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:58 smithi050 bash[21866]: audit 2024-05-20T21:57:57.753868+0000 mon.a (mon.0) 115 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:57:59.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:58 smithi050 bash[21866]: cephadm 2024-05-20T21:57:57.754683+0000 mgr.y (mgr.14150) 28 : cephadm 1 Added host smithi145 2024-05-20T21:57:59.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:58 smithi050 bash[21866]: audit 2024-05-20T21:57:57.755473+0000 mon.a (mon.0) 116 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:57:59.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:57:58 smithi050 bash[21866]: audit 2024-05-20T21:57:58.229349+0000 mon.a (mon.0) 117 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:00.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:00 smithi050 bash[21866]: cluster 2024-05-20T21:57:59.408879+0000 mgr.y (mgr.14150) 29 : cluster 0 pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:00.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:00 smithi050 bash[21866]: audit 2024-05-20T21:57:59.695774+0000 mon.a (mon.0) 118 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:02.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:01 smithi050 bash[21866]: audit 2024-05-20T21:58:00.824137+0000 mon.a (mon.0) 119 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:03.154 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T21:58:03.176 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:02 smithi050 bash[21866]: cluster 2024-05-20T21:58:01.409307+0000 mgr.y (mgr.14150) 30 : cluster 0 pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:05.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:04 smithi050 bash[21866]: cluster 2024-05-20T21:58:03.409719+0000 mgr.y (mgr.14150) 31 : cluster 0 pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:05.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.490+0000 7fe40080b640 1 -- 172.21.15.50:0/2321261286 >> v1:172.21.15.50:6789/0 conn(0x7fe3fc1094b0 legacy=0x7fe3fc109890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:05.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.490+0000 7fe40080b640 1 -- 172.21.15.50:0/2321261286 shutdown_connections 2024-05-20T21:58:05.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.490+0000 7fe40080b640 1 -- 172.21.15.50:0/2321261286 >> 172.21.15.50:0/2321261286 conn(0x7fe3fc0fef10 msgr2=0x7fe3fc101330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:58:05.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe40080b640 1 -- 172.21.15.50:0/2321261286 shutdown_connections 2024-05-20T21:58:05.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe40080b640 1 -- 172.21.15.50:0/2321261286 wait complete. 2024-05-20T21:58:05.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe40080b640 1 Processor -- start 2024-05-20T21:58:05.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe40080b640 1 -- start start 2024-05-20T21:58:05.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe40080b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe3fc198a30 con 0x7fe3fc1094b0 2024-05-20T21:58:05.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe3fa59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe3fc1094b0 0x7fe3fc198320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58172/0 (socket says 172.21.15.50:58172) 2024-05-20T21:58:05.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe3fa59c640 1 -- 172.21.15.50:0/3411288015 learned_addr learned my addr 172.21.15.50:0/3411288015 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:58:05.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe3f37fe640 1 -- 172.21.15.50:0/3411288015 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2827618973 0 0) 0x7fe3fc198a30 con 0x7fe3fc1094b0 2024-05-20T21:58:05.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe3f37fe640 1 -- 172.21.15.50:0/3411288015 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3e8005460 con 0x7fe3fc1094b0 2024-05-20T21:58:05.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe3f37fe640 1 -- 172.21.15.50:0/3411288015 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1102511982 0 0) 0x7fe3e8005460 con 0x7fe3fc1094b0 2024-05-20T21:58:05.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe3f37fe640 1 -- 172.21.15.50:0/3411288015 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3fc198a30 con 0x7fe3fc1094b0 2024-05-20T21:58:05.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe3f37fe640 1 -- 172.21.15.50:0/3411288015 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fe3ec001250 con 0x7fe3fc1094b0 2024-05-20T21:58:05.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe3f37fe640 1 -- 172.21.15.50:0/3411288015 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2718657882 0 0) 0x7fe3fc198a30 con 0x7fe3fc1094b0 2024-05-20T21:58:05.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe3f37fe640 1 -- 172.21.15.50:0/3411288015 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3fc198c00 con 0x7fe3fc1094b0 2024-05-20T21:58:05.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe40080b640 1 -- 172.21.15.50:0/3411288015 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe3fc198ef0 con 0x7fe3fc1094b0 2024-05-20T21:58:05.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe40080b640 1 -- 172.21.15.50:0/3411288015 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe3fc1a1050 con 0x7fe3fc1094b0 2024-05-20T21:58:05.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe3f37fe640 1 -- 172.21.15.50:0/3411288015 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7fe3ec0036d0 con 0x7fe3fc1094b0 2024-05-20T21:58:05.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe3f37fe640 1 -- 172.21.15.50:0/3411288015 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fe3ec004c20 con 0x7fe3fc1094b0 2024-05-20T21:58:05.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe3f37fe640 1 -- 172.21.15.50:0/3411288015 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 13) ==== 46308+0+0 (unknown 209257320 0 0) 0x7fe3ec004de0 con 0x7fe3fc1094b0 2024-05-20T21:58:05.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe40080b640 1 -- 172.21.15.50:0/3411288015 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3dc005080 con 0x7fe3fc1094b0 2024-05-20T21:58:05.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.494+0000 7fe3f37fe640 1 -- 172.21.15.50:0/3411288015 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (unknown 3027287997 0 0) 0x7fe3ec047890 con 0x7fe3fc1094b0 2024-05-20T21:58:05.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.502+0000 7fe3f37fe640 1 -- 172.21.15.50:0/3411288015 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7fe3fc10a030 con 0x7fe3fc1094b0 2024-05-20T21:58:05.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.698+0000 7fe40080b640 1 -- 172.21.15.50:0/3411288015 --> v1:172.21.15.50:6800/2944911247 -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe3dc000b90 con 0x7fe3e803a550 2024-05-20T21:58:05.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.698+0000 7fe3f37fe640 1 -- 172.21.15.50:0/3411288015 <== mgr.14150 v1:172.21.15.50:6800/2944911247 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (unknown 0 0 3853250311) 0x7fe3dc000b90 con 0x7fe3e803a550 2024-05-20T21:58:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-20T21:58:05.701 INFO:teuthology.orchestra.run.smithi050.stdout:[{"addr": "172.21.15.50", "hostname": "smithi050", "labels": [], "status": ""}, {"addr": "172.21.15.145", "hostname": "smithi145", "labels": [], "status": ""}] 2024-05-20T21:58:05.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.702+0000 7fe40080b640 1 -- 172.21.15.50:0/3411288015 >> v1:172.21.15.50:6800/2944911247 conn(0x7fe3e803a550 legacy=0x7fe3e803ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:05.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.702+0000 7fe40080b640 1 -- 172.21.15.50:0/3411288015 >> v1:172.21.15.50:6789/0 conn(0x7fe3fc1094b0 legacy=0x7fe3fc198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:05.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.702+0000 7fe40080b640 1 -- 172.21.15.50:0/3411288015 shutdown_connections 2024-05-20T21:58:05.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.702+0000 7fe40080b640 1 -- 172.21.15.50:0/3411288015 >> 172.21.15.50:0/3411288015 conn(0x7fe3fc0fef10 msgr2=0x7fe3fc0ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:58:05.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.702+0000 7fe40080b640 1 -- 172.21.15.50:0/3411288015 shutdown_connections 2024-05-20T21:58:05.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:05.702+0000 7fe40080b640 1 -- 172.21.15.50:0/3411288015 wait complete. 2024-05-20T21:58:06.400 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-20T21:58:06.401 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph osd crush tunables default 2024-05-20T21:58:07.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:06 smithi050 bash[21866]: cluster 2024-05-20T21:58:05.409971+0000 mgr.y (mgr.14150) 32 : cluster 0 pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:07.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:06 smithi050 bash[21866]: audit 2024-05-20T21:58:05.702565+0000 mgr.y (mgr.14150) 33 : audit 0 from='client.14178 v1:172.21.15.50:0/3411288015' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T21:58:07.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:06 smithi050 bash[21866]: audit 2024-05-20T21:58:05.998734+0000 mon.a (mon.0) 120 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:07.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:06 smithi050 bash[21866]: audit 2024-05-20T21:58:06.003592+0000 mon.a (mon.0) 121 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:07.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:06 smithi050 bash[21866]: audit 2024-05-20T21:58:06.009268+0000 mon.a (mon.0) 122 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:07.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:06 smithi050 bash[21866]: audit 2024-05-20T21:58:06.014308+0000 mon.a (mon.0) 123 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:07.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:06 smithi050 bash[21866]: audit 2024-05-20T21:58:06.015748+0000 mon.a (mon.0) 124 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi145", "name": "osd_memory_target"}]: dispatch 2024-05-20T21:58:07.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:06 smithi050 bash[21866]: audit 2024-05-20T21:58:06.017713+0000 mon.a (mon.0) 125 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:07.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:06 smithi050 bash[21866]: audit 2024-05-20T21:58:06.019392+0000 mon.a (mon.0) 126 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:58:07.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:06 smithi050 bash[21866]: cephadm 2024-05-20T21:58:06.021760+0000 mgr.y (mgr.14150) 34 : cephadm 1 Updating smithi145:/etc/ceph/ceph.conf 2024-05-20T21:58:07.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:06 smithi050 bash[21866]: audit 2024-05-20T21:58:06.632003+0000 mon.a (mon.0) 127 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:07.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:06 smithi050 bash[21866]: audit 2024-05-20T21:58:06.634367+0000 mon.a (mon.0) 128 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:07.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:06 smithi050 bash[21866]: audit 2024-05-20T21:58:06.636795+0000 mon.a (mon.0) 129 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:08.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:08 smithi050 bash[21866]: cephadm 2024-05-20T21:58:06.202799+0000 mgr.y (mgr.14150) 35 : cephadm 1 Updating smithi145:/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T21:58:08.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:08 smithi050 bash[21866]: cephadm 2024-05-20T21:58:06.358960+0000 mgr.y (mgr.14150) 36 : cephadm 1 Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-05-20T21:58:08.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:08 smithi050 bash[21866]: cephadm 2024-05-20T21:58:06.501604+0000 mgr.y (mgr.14150) 37 : cephadm 1 Updating smithi145:/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T21:58:09.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:09 smithi050 bash[21866]: cluster 2024-05-20T21:58:07.410359+0000 mgr.y (mgr.14150) 38 : cluster 0 pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T21:58:11.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:11 smithi050 bash[21866]: cluster 2024-05-20T21:58:09.410785+0000 mgr.y (mgr.14150) 39 : cluster 0 pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:13.382 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:13 smithi050 bash[21866]: cluster 2024-05-20T21:58:11.411214+0000 mgr.y (mgr.14150) 40 : cluster 0 pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:13.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.530+0000 7f606eccc640 1 -- 172.21.15.50:0/3157037469 >> v1:172.21.15.50:6789/0 conn(0x7f60681094b0 legacy=0x7f6068109890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.530+0000 7f606eccc640 1 -- 172.21.15.50:0/3157037469 shutdown_connections 2024-05-20T21:58:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.530+0000 7f606eccc640 1 -- 172.21.15.50:0/3157037469 >> 172.21.15.50:0/3157037469 conn(0x7f60680fef10 msgr2=0x7f6068101330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:58:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.530+0000 7f606eccc640 1 -- 172.21.15.50:0/3157037469 shutdown_connections 2024-05-20T21:58:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.530+0000 7f606eccc640 1 -- 172.21.15.50:0/3157037469 wait complete. 2024-05-20T21:58:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.530+0000 7f606eccc640 1 Processor -- start 2024-05-20T21:58:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.530+0000 7f606eccc640 1 -- start start 2024-05-20T21:58:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.530+0000 7f606eccc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f6068198aa0 con 0x7f60681094b0 2024-05-20T21:58:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.530+0000 7f606ca68640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f60681094b0 0x7f6068198390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35058/0 (socket says 172.21.15.50:35058) 2024-05-20T21:58:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.530+0000 7f606ca68640 1 -- 172.21.15.50:0/3605026454 learned_addr learned my addr 172.21.15.50:0/3605026454 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:58:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.530+0000 7f6065ffb640 1 -- 172.21.15.50:0/3605026454 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2763507788 0 0) 0x7f6068198aa0 con 0x7f60681094b0 2024-05-20T21:58:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.530+0000 7f6065ffb640 1 -- 172.21.15.50:0/3605026454 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6054005410 con 0x7f60681094b0 2024-05-20T21:58:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.530+0000 7f6065ffb640 1 -- 172.21.15.50:0/3605026454 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2100443339 0 0) 0x7f6054005410 con 0x7f60681094b0 2024-05-20T21:58:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.530+0000 7f6065ffb640 1 -- 172.21.15.50:0/3605026454 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6068198aa0 con 0x7f60681094b0 2024-05-20T21:58:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.530+0000 7f6065ffb640 1 -- 172.21.15.50:0/3605026454 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f6058004b20 con 0x7f60681094b0 2024-05-20T21:58:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.530+0000 7f6065ffb640 1 -- 172.21.15.50:0/3605026454 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3212376342 0 0) 0x7f6068198aa0 con 0x7f60681094b0 2024-05-20T21:58:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.530+0000 7f6065ffb640 1 -- 172.21.15.50:0/3605026454 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6068198c70 con 0x7f60681094b0 2024-05-20T21:58:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.530+0000 7f606eccc640 1 -- 172.21.15.50:0/3605026454 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6068198f60 con 0x7f60681094b0 2024-05-20T21:58:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.530+0000 7f606eccc640 1 -- 172.21.15.50:0/3605026454 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f60681a10c0 con 0x7f60681094b0 2024-05-20T21:58:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.534+0000 7f6065ffb640 1 -- 172.21.15.50:0/3605026454 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f6058001e00 con 0x7f60681094b0 2024-05-20T21:58:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.534+0000 7f6065ffb640 1 -- 172.21.15.50:0/3605026454 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f6058004fd0 con 0x7f60681094b0 2024-05-20T21:58:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.534+0000 7f6065ffb640 1 -- 172.21.15.50:0/3605026454 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 13) ==== 46308+0+0 (unknown 209257320 0 0) 0x7f6058005190 con 0x7f60681094b0 2024-05-20T21:58:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.534+0000 7f606eccc640 1 -- 172.21.15.50:0/3605026454 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6048005080 con 0x7f60681094b0 2024-05-20T21:58:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.534+0000 7f6065ffb640 1 -- 172.21.15.50:0/3605026454 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (unknown 3027287997 0 0) 0x7f6058047bb0 con 0x7f60681094b0 2024-05-20T21:58:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.538+0000 7f6065ffb640 1 -- 172.21.15.50:0/3605026454 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f606810a030 con 0x7f60681094b0 2024-05-20T21:58:13.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:13.730+0000 7f606eccc640 1 -- 172.21.15.50:0/3605026454 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f6048005370 con 0x7f60681094b0 2024-05-20T21:58:14.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:14.006+0000 7f6065ffb640 1 -- 172.21.15.50:0/3605026454 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (unknown 3126668360 0 0) 0x7f6058017700 con 0x7f60681094b0 2024-05-20T21:58:14.009 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2024-05-20T21:58:14.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:14.010+0000 7f606eccc640 1 -- 172.21.15.50:0/3605026454 >> v1:172.21.15.50:6800/2944911247 conn(0x7f605403a480 legacy=0x7f605403c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:14.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:14.010+0000 7f606eccc640 1 -- 172.21.15.50:0/3605026454 >> v1:172.21.15.50:6789/0 conn(0x7f60681094b0 legacy=0x7f6068198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:14.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:14.010+0000 7f606eccc640 1 -- 172.21.15.50:0/3605026454 shutdown_connections 2024-05-20T21:58:14.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:14.010+0000 7f606eccc640 1 -- 172.21.15.50:0/3605026454 >> 172.21.15.50:0/3605026454 conn(0x7f60680fef10 msgr2=0x7f60680ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:58:14.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:14.010+0000 7f606eccc640 1 -- 172.21.15.50:0/3605026454 shutdown_connections 2024-05-20T21:58:14.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:14.010+0000 7f606eccc640 1 -- 172.21.15.50:0/3605026454 wait complete. 2024-05-20T21:58:14.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:14 smithi050 bash[21866]: audit 2024-05-20T21:58:13.733875+0000 mon.a (mon.0) 130 : audit 1 from='client.? v1:172.21.15.50:0/3605026454' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-20T21:58:14.667 INFO:tasks.cephadm:Adding mon.a on smithi050 2024-05-20T21:58:14.667 INFO:tasks.cephadm:Adding mon.c on smithi050 2024-05-20T21:58:14.668 INFO:tasks.cephadm:Adding mon.b on smithi145 2024-05-20T21:58:14.668 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph orch apply mon '3;smithi050:[v1:172.21.15.50:6789]=a;smithi050:[v1:172.21.15.50:6790]=c;smithi145:[v1:172.21.15.145:6789]=b' 2024-05-20T21:58:15.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:15 smithi050 bash[21866]: cluster 2024-05-20T21:58:13.411533+0000 mgr.y (mgr.14150) 41 : cluster 0 pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:15.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:15 smithi050 bash[21866]: audit 2024-05-20T21:58:14.010039+0000 mon.a (mon.0) 131 : audit 1 from='client.? v1:172.21.15.50:0/3605026454' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-20T21:58:15.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:15 smithi050 bash[21866]: cluster 2024-05-20T21:58:14.014860+0000 mon.a (mon.0) 132 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-05-20T21:58:15.880 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T21:58:17.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:17 smithi050 bash[21866]: cluster 2024-05-20T21:58:15.411949+0000 mgr.y (mgr.14150) 42 : cluster 0 pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:17.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f5396871640 1 -- 172.21.15.145:0/2226106015 >> v1:172.21.15.50:6789/0 conn(0x7f5390100350 legacy=0x7f5390100730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:17.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f5396871640 1 -- 172.21.15.145:0/2226106015 shutdown_connections 2024-05-20T21:58:17.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f5396871640 1 -- 172.21.15.145:0/2226106015 >> 172.21.15.145:0/2226106015 conn(0x7f5390075c70 msgr2=0x7f5390076080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:58:17.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f5396871640 1 -- 172.21.15.145:0/2226106015 shutdown_connections 2024-05-20T21:58:17.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f5396871640 1 -- 172.21.15.145:0/2226106015 wait complete. 2024-05-20T21:58:17.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f5396871640 1 Processor -- start 2024-05-20T21:58:17.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f5396871640 1 -- start start 2024-05-20T21:58:17.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f5396871640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f53900ff090 con 0x7f5390100350 2024-05-20T21:58:17.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f538ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5390100350 0x7f53900fd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.145:33178/0 (socket says 172.21.15.145:33178) 2024-05-20T21:58:17.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f538ffff640 1 -- 172.21.15.145:0/318521764 learned_addr learned my addr 172.21.15.145:0/318521764 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-05-20T21:58:17.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f538d7fa640 1 -- 172.21.15.145:0/318521764 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3430644435 0 0) 0x7f53900ff090 con 0x7f5390100350 2024-05-20T21:58:17.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f538d7fa640 1 -- 172.21.15.145:0/318521764 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f537c005410 con 0x7f5390100350 2024-05-20T21:58:17.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f538d7fa640 1 -- 172.21.15.145:0/318521764 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1558938406 0 0) 0x7f537c005410 con 0x7f5390100350 2024-05-20T21:58:17.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f538d7fa640 1 -- 172.21.15.145:0/318521764 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f53900ff090 con 0x7f5390100350 2024-05-20T21:58:17.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f538d7fa640 1 -- 172.21.15.145:0/318521764 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f5378001480 con 0x7f5390100350 2024-05-20T21:58:17.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f538d7fa640 1 -- 172.21.15.145:0/318521764 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2930545465 0 0) 0x7f53900ff090 con 0x7f5390100350 2024-05-20T21:58:17.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f538d7fa640 1 -- 172.21.15.145:0/318521764 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53900fd8b0 con 0x7f5390100350 2024-05-20T21:58:17.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f5396871640 1 -- 172.21.15.145:0/318521764 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f53900fdba0 con 0x7f5390100350 2024-05-20T21:58:17.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f5396871640 1 -- 172.21.15.145:0/318521764 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f53901a11c0 con 0x7f5390100350 2024-05-20T21:58:17.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f538d7fa640 1 -- 172.21.15.145:0/318521764 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f53780036b0 con 0x7f5390100350 2024-05-20T21:58:17.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.902+0000 7f538d7fa640 1 -- 172.21.15.145:0/318521764 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7f5378004d30 con 0x7f5390100350 2024-05-20T21:58:17.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.906+0000 7f5396871640 1 -- 172.21.15.145:0/318521764 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5370005080 con 0x7f5390100350 2024-05-20T21:58:17.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.906+0000 7f538d7fa640 1 -- 172.21.15.145:0/318521764 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 13) ==== 46308+0+0 (unknown 209257320 0 0) 0x7f5378004fb0 con 0x7f5390100350 2024-05-20T21:58:17.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.906+0000 7f538d7fa640 1 -- 172.21.15.145:0/318521764 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (unknown 2781634937 0 0) 0x7f5378047710 con 0x7f5390100350 2024-05-20T21:58:17.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:17.918+0000 7f538d7fa640 1 -- 172.21.15.145:0/318521764 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f53780165a0 con 0x7f5390100350 2024-05-20T21:58:18.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:18.118+0000 7f5396871640 1 -- 172.21.15.145:0/318521764 --> v1:172.21.15.50:6800/2944911247 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi050:[v1:172.21.15.50:6789]=a;smithi050:[v1:172.21.15.50:6790]=c;smithi145:[v1:172.21.15.145:6789]=b", "target": ["mon-mgr", ""]}) -- 0x7f5370000c60 con 0x7f537c03a3e0 2024-05-20T21:58:18.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:18.130+0000 7f538d7fa640 1 -- 172.21.15.145:0/318521764 <== mgr.14150 v1:172.21.15.50:6800/2944911247 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (unknown 0 0 3265049985) 0x7f5370000c60 con 0x7f537c03a3e0 2024-05-20T21:58:18.135 INFO:teuthology.orchestra.run.smithi145.stdout:Scheduled mon update... 2024-05-20T21:58:18.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:18.134+0000 7f5396871640 1 -- 172.21.15.145:0/318521764 >> v1:172.21.15.50:6800/2944911247 conn(0x7f537c03a3e0 legacy=0x7f537c03c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:18.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:18.134+0000 7f5396871640 1 -- 172.21.15.145:0/318521764 >> v1:172.21.15.50:6789/0 conn(0x7f5390100350 legacy=0x7f53900fd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:18.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:18.134+0000 7f5396871640 1 -- 172.21.15.145:0/318521764 shutdown_connections 2024-05-20T21:58:18.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:18.134+0000 7f5396871640 1 -- 172.21.15.145:0/318521764 >> 172.21.15.145:0/318521764 conn(0x7f5390075c70 msgr2=0x7f5390069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:58:18.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:18.134+0000 7f5396871640 1 -- 172.21.15.145:0/318521764 shutdown_connections 2024-05-20T21:58:18.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:18.134+0000 7f5396871640 1 -- 172.21.15.145:0/318521764 wait complete. 2024-05-20T21:58:18.626 DEBUG:teuthology.orchestra.run.smithi050:mon.c> sudo journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mon.c.service 2024-05-20T21:58:18.629 DEBUG:teuthology.orchestra.run.smithi145:mon.b> sudo journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mon.b.service 2024-05-20T21:58:18.631 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-20T21:58:18.632 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph mon dump -f json 2024-05-20T21:58:19.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:19 smithi050 bash[21866]: cluster 2024-05-20T21:58:17.412324+0000 mgr.y (mgr.14150) 43 : cluster 0 pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:19.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:19 smithi050 bash[21866]: audit 2024-05-20T21:58:18.125164+0000 mgr.y (mgr.14150) 44 : audit 0 from='client.14182 v1:172.21.15.145:0/318521764' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi050:[v1:172.21.15.50:6789]=a;smithi050:[v1:172.21.15.50:6790]=c;smithi145:[v1:172.21.15.145:6789]=b", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T21:58:19.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:19 smithi050 bash[21866]: cephadm 2024-05-20T21:58:18.130531+0000 mgr.y (mgr.14150) 45 : cephadm 1 Saving service mon spec with placement smithi050:[v1:172.21.15.50:6789]=a;smithi050:[v1:172.21.15.50:6790]=c;smithi145:[v1:172.21.15.145:6789]=b;count:3 2024-05-20T21:58:19.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:19 smithi050 bash[21866]: audit 2024-05-20T21:58:18.135280+0000 mon.a (mon.0) 133 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:19.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:19 smithi050 bash[21866]: audit 2024-05-20T21:58:18.136859+0000 mon.a (mon.0) 134 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:58:19.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:19 smithi050 bash[21866]: audit 2024-05-20T21:58:18.140342+0000 mon.a (mon.0) 135 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:19.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:19 smithi050 bash[21866]: audit 2024-05-20T21:58:18.142013+0000 mon.a (mon.0) 136 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:58:19.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:19 smithi050 bash[21866]: audit 2024-05-20T21:58:18.149032+0000 mon.a (mon.0) 137 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:19.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:19 smithi050 bash[21866]: audit 2024-05-20T21:58:18.152752+0000 mon.a (mon.0) 138 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T21:58:19.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:19 smithi050 bash[21866]: audit 2024-05-20T21:58:18.154211+0000 mon.a (mon.0) 139 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:19.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:19 smithi050 bash[21866]: cephadm 2024-05-20T21:58:18.156107+0000 mgr.y (mgr.14150) 46 : cephadm 1 Deploying daemon mon.b on smithi145 2024-05-20T21:58:19.872 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T21:58:21.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:21 smithi050 bash[21866]: cluster 2024-05-20T21:58:19.412746+0000 mgr.y (mgr.14150) 47 : cluster 0 pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:22.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3db176640 1 -- 172.21.15.145:0/1797216809 >> v1:172.21.15.50:6789/0 conn(0x7fc3d41023b0 legacy=0x7fc3d4102790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:22.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3db176640 1 -- 172.21.15.145:0/1797216809 shutdown_connections 2024-05-20T21:58:22.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3db176640 1 -- 172.21.15.145:0/1797216809 >> 172.21.15.145:0/1797216809 conn(0x7fc3d40fbc00 msgr2=0x7fc3d40fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:58:22.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3db176640 1 -- 172.21.15.145:0/1797216809 shutdown_connections 2024-05-20T21:58:22.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3db176640 1 -- 172.21.15.145:0/1797216809 wait complete. 2024-05-20T21:58:22.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3db176640 1 Processor -- start 2024-05-20T21:58:22.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3db176640 1 -- start start 2024-05-20T21:58:22.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3db176640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc3d4196720 con 0x7fc3d41023b0 2024-05-20T21:58:22.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3d8f12640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc3d41023b0 0x7fc3d4196010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.145:33196/0 (socket says 172.21.15.145:33196) 2024-05-20T21:58:22.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3d8f12640 1 -- 172.21.15.145:0/1518519940 learned_addr learned my addr 172.21.15.145:0/1518519940 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-05-20T21:58:22.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3d1ffb640 1 -- 172.21.15.145:0/1518519940 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2574916466 0 0) 0x7fc3d4196720 con 0x7fc3d41023b0 2024-05-20T21:58:22.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3d1ffb640 1 -- 172.21.15.145:0/1518519940 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3c4005410 con 0x7fc3d41023b0 2024-05-20T21:58:22.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3d1ffb640 1 -- 172.21.15.145:0/1518519940 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1680279620 0 0) 0x7fc3c4005410 con 0x7fc3d41023b0 2024-05-20T21:58:22.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3d1ffb640 1 -- 172.21.15.145:0/1518519940 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3d4196720 con 0x7fc3d41023b0 2024-05-20T21:58:22.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3d1ffb640 1 -- 172.21.15.145:0/1518519940 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fc3c8001480 con 0x7fc3d41023b0 2024-05-20T21:58:22.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3d1ffb640 1 -- 172.21.15.145:0/1518519940 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4025328544 0 0) 0x7fc3d4196720 con 0x7fc3d41023b0 2024-05-20T21:58:22.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3d1ffb640 1 -- 172.21.15.145:0/1518519940 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d41968f0 con 0x7fc3d41023b0 2024-05-20T21:58:22.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3db176640 1 -- 172.21.15.145:0/1518519940 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d4196be0 con 0x7fc3d41023b0 2024-05-20T21:58:22.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3db176640 1 -- 172.21.15.145:0/1518519940 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc3d419ed40 con 0x7fc3d41023b0 2024-05-20T21:58:22.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3d1ffb640 1 -- 172.21.15.145:0/1518519940 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7fc3c80036b0 con 0x7fc3d41023b0 2024-05-20T21:58:22.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.698+0000 7fc3d1ffb640 1 -- 172.21.15.145:0/1518519940 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 1792418109 0 0) 0x7fc3c8004c70 con 0x7fc3d41023b0 2024-05-20T21:58:22.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.702+0000 7fc3db176640 1 -- 172.21.15.145:0/1518519940 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b8005080 con 0x7fc3d41023b0 2024-05-20T21:58:22.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.702+0000 7fc3d1ffb640 1 -- 172.21.15.145:0/1518519940 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 13) ==== 46308+0+0 (unknown 209257320 0 0) 0x7fc3c8004ef0 con 0x7fc3d41023b0 2024-05-20T21:58:22.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.702+0000 7fc3d1ffb640 1 -- 172.21.15.145:0/1518519940 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (unknown 2781634937 0 0) 0x7fc3c8047780 con 0x7fc3d41023b0 2024-05-20T21:58:22.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.714+0000 7fc3d1ffb640 1 -- 172.21.15.145:0/1518519940 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7fc3c8017440 con 0x7fc3d41023b0 2024-05-20T21:58:22.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.986+0000 7fc3db176640 1 -- 172.21.15.145:0/1518519940 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fc3b8005370 con 0x7fc3d41023b0 2024-05-20T21:58:22.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.986+0000 7fc3d1ffb640 1 -- 172.21.15.145:0/1518519940 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+694 (unknown 2237029548 0 67263652) 0x7fc3c8016d40 con 0x7fc3d41023b0 2024-05-20T21:58:22.991 INFO:teuthology.orchestra.run.smithi145.stderr:dumped monmap epoch 1 2024-05-20T21:58:22.991 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-05-20T21:58:22.991 INFO:teuthology.orchestra.run.smithi145.stdout:{"epoch":1,"fsid":"9a9abba0-16f3-11ef-bc9a-c7b262605968","modified":"2024-05-20T21:56:15.715764Z","created":"2024-05-20T21:56:15.715764Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-20T21:58:22.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.990+0000 7fc3db176640 1 -- 172.21.15.145:0/1518519940 >> v1:172.21.15.50:6800/2944911247 conn(0x7fc3c403a430 legacy=0x7fc3c403c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:22.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.990+0000 7fc3db176640 1 -- 172.21.15.145:0/1518519940 >> v1:172.21.15.50:6789/0 conn(0x7fc3d41023b0 legacy=0x7fc3d4196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:22.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.990+0000 7fc3db176640 1 -- 172.21.15.145:0/1518519940 shutdown_connections 2024-05-20T21:58:22.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.990+0000 7fc3db176640 1 -- 172.21.15.145:0/1518519940 >> 172.21.15.145:0/1518519940 conn(0x7fc3d40fbc00 msgr2=0x7fc3d41078d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:58:22.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.990+0000 7fc3db176640 1 -- 172.21.15.145:0/1518519940 shutdown_connections 2024-05-20T21:58:22.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:22.990+0000 7fc3db176640 1 -- 172.21.15.145:0/1518519940 wait complete. 2024-05-20T21:58:23.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:23 smithi050 bash[21866]: cluster 2024-05-20T21:58:21.413166+0000 mgr.y (mgr.14150) 48 : cluster 0 pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:23.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:23 smithi050 bash[21866]: audit 2024-05-20T21:58:22.992271+0000 mon.a (mon.0) 140 : audit 0 from='client.? v1:172.21.15.145:0/1518519940' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-20T21:58:24.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:24 smithi145 bash[23893]: debug 2024-05-20T21:58:24.358+0000 7f28b4cc1640 1 mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-20T21:58:24.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:24 smithi050 bash[21866]: audit 2024-05-20T21:58:23.359388+0000 mon.a (mon.0) 141 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:24.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:24 smithi050 bash[21866]: audit 2024-05-20T21:58:23.364605+0000 mon.a (mon.0) 142 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:24.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:24 smithi050 bash[21866]: audit 2024-05-20T21:58:23.370329+0000 mon.a (mon.0) 143 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:24.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:24 smithi050 bash[21866]: audit 2024-05-20T21:58:23.371594+0000 mon.a (mon.0) 144 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T21:58:24.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:24 smithi050 bash[21866]: audit 2024-05-20T21:58:23.373146+0000 mon.a (mon.0) 145 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:24.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:24 smithi050 bash[21866]: cephadm 2024-05-20T21:58:23.375093+0000 mgr.y (mgr.14150) 49 : cephadm 1 Deploying daemon mon.c on smithi050 2024-05-20T21:58:24.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:24 smithi050 bash[21866]: cluster 2024-05-20T21:58:23.413549+0000 mgr.y (mgr.14150) 50 : cluster 0 pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:25.064 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-20T21:58:25.065 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph mon dump -f json 2024-05-20T21:58:27.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:27 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T21:58:27.443 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:58:27 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T21:58:27.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:27 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T21:58:27.698 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:58:27 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T21:58:27.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:27 smithi050 systemd[1]: Started Ceph mon.c for 9a9abba0-16f3-11ef-bc9a-c7b262605968. 2024-05-20T21:58:28.765 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T21:58:28.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.537+0000 7f6fa1572b00 0 set uid:gid to 167:167 (ceph:ceph) 2024-05-20T21:58:28.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.537+0000 7f6fa1572b00 0 ceph version 19.0.0-2536-g200b2779 (200b27799814c89893ec6700f852fc40163e03d5) squid (dev), process ceph-mon, pid 7 2024-05-20T21:58:28.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.537+0000 7f6fa1572b00 0 pidfile_write: ignore empty --pid-file 2024-05-20T21:58:28.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 0 load: jerasure load: lrc 2024-05-20T21:58:28.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: RocksDB version: 7.9.2 2024-05-20T21:58:28.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Git sha 0 2024-05-20T21:58:28.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Compile date 2024-05-20 18:35:26 2024-05-20T21:58:28.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: DB SUMMARY 2024-05-20T21:58:28.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: DB Session ID: 0FB758L8JSHLXLA2LVM0 2024-05-20T21:58:28.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: CURRENT file: CURRENT 2024-05-20T21:58:28.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: IDENTITY file: IDENTITY 2024-05-20T21:58:28.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-20T21:58:28.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-05-20T21:58:28.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 476 ; 2024-05-20T21:58:28.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.error_if_exists: 0 2024-05-20T21:58:28.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.create_if_missing: 0 2024-05-20T21:58:28.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.paranoid_checks: 1 2024-05-20T21:58:28.951 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-05-20T21:58:28.951 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-20T21:58:28.951 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-20T21:58:28.951 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.env: 0x55e67a289740 2024-05-20T21:58:28.951 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.fs: PosixFileSystem 2024-05-20T21:58:28.951 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.info_log: 0x55e67b9ff000 2024-05-20T21:58:28.951 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_file_opening_threads: 16 2024-05-20T21:58:28.951 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.statistics: (nil) 2024-05-20T21:58:28.951 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.use_fsync: 0 2024-05-20T21:58:28.951 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_log_file_size: 0 2024-05-20T21:58:28.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-20T21:58:28.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.log_file_time_to_roll: 0 2024-05-20T21:58:28.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.keep_log_file_num: 1000 2024-05-20T21:58:28.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.recycle_log_file_num: 0 2024-05-20T21:58:28.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.allow_fallocate: 1 2024-05-20T21:58:28.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.allow_mmap_reads: 0 2024-05-20T21:58:28.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.allow_mmap_writes: 0 2024-05-20T21:58:28.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.use_direct_reads: 0 2024-05-20T21:58:28.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-20T21:58:28.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.create_missing_column_families: 0 2024-05-20T21:58:28.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.db_log_dir: 2024-05-20T21:58:28.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.wal_dir: 2024-05-20T21:58:28.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.table_cache_numshardbits: 6 2024-05-20T21:58:28.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-05-20T21:58:28.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-05-20T21:58:28.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-20T21:58:28.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-20T21:58:28.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-05-20T21:58:28.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.advise_random_on_open: 1 2024-05-20T21:58:28.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.db_write_buffer_size: 0 2024-05-20T21:58:28.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.write_buffer_manager: 0x55e67ba0e1e0 2024-05-20T21:58:28.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-20T21:58:28.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-20T21:58:28.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.use_adaptive_mutex: 0 2024-05-20T21:58:28.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.rate_limiter: (nil) 2024-05-20T21:58:28.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-20T21:58:28.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.wal_recovery_mode: 2 2024-05-20T21:58:28.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.enable_thread_tracking: 0 2024-05-20T21:58:28.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.enable_pipelined_write: 0 2024-05-20T21:58:28.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.unordered_write: 0 2024-05-20T21:58:28.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-20T21:58:28.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-20T21:58:28.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-20T21:58:28.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-20T21:58:28.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.row_cache: None 2024-05-20T21:58:28.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.wal_filter: None 2024-05-20T21:58:28.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-20T21:58:28.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.allow_ingest_behind: 0 2024-05-20T21:58:28.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.two_write_queues: 0 2024-05-20T21:58:28.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.manual_wal_flush: 0 2024-05-20T21:58:28.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.wal_compression: 0 2024-05-20T21:58:28.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.atomic_flush: 0 2024-05-20T21:58:28.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-20T21:58:28.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.persist_stats_to_disk: 0 2024-05-20T21:58:28.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-05-20T21:58:28.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.log_readahead_size: 0 2024-05-20T21:58:28.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-20T21:58:28.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.best_efforts_recovery: 0 2024-05-20T21:58:28.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-20T21:58:28.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-20T21:58:28.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.allow_data_in_errors: 0 2024-05-20T21:58:28.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.db_host_id: __hostname__ 2024-05-20T21:58:28.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.enforce_single_del_contracts: true 2024-05-20T21:58:28.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_background_jobs: 2 2024-05-20T21:58:28.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_background_compactions: -1 2024-05-20T21:58:28.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_subcompactions: 1 2024-05-20T21:58:28.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-20T21:58:28.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-20T21:58:28.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.delayed_write_rate : 16777216 2024-05-20T21:58:28.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_total_wal_size: 0 2024-05-20T21:58:28.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-20T21:58:28.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.stats_dump_period_sec: 600 2024-05-20T21:58:28.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.stats_persist_period_sec: 600 2024-05-20T21:58:28.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-20T21:58:28.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_open_files: -1 2024-05-20T21:58:28.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.bytes_per_sync: 0 2024-05-20T21:58:28.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-05-20T21:58:28.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-05-20T21:58:28.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compaction_readahead_size: 0 2024-05-20T21:58:28.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_background_flushes: -1 2024-05-20T21:58:28.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Compression algorithms supported: 2024-05-20T21:58:28.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: kZSTD supported: 0 2024-05-20T21:58:28.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: kXpressCompression supported: 0 2024-05-20T21:58:28.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: kBZip2Compression supported: 0 2024-05-20T21:58:28.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-20T21:58:28.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: kLZ4Compression supported: 1 2024-05-20T21:58:28.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: kZlibCompression supported: 1 2024-05-20T21:58:28.959 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: kLZ4HCCompression supported: 1 2024-05-20T21:58:28.959 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: kSnappyCompression supported: 1 2024-05-20T21:58:28.959 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-05-20T21:58:28.959 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-05-20T21:58:28.959 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-05-20T21:58:28.959 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-20T21:58:28.960 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-20T21:58:28.961 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.merge_operator: 2024-05-20T21:58:28.961 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compaction_filter: None 2024-05-20T21:58:28.961 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compaction_filter_factory: None 2024-05-20T21:58:28.961 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.sst_partitioner_factory: None 2024-05-20T21:58:28.961 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-05-20T21:58:28.961 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.table_factory: BlockBasedTable 2024-05-20T21:58:28.961 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e67b9fed00) 2024-05-20T21:58:28.961 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cache_index_and_filter_blocks: 1 2024-05-20T21:58:28.961 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-20T21:58:28.961 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-20T21:58:28.961 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: pin_top_level_index_and_filter: 1 2024-05-20T21:58:28.961 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: index_type: 0 2024-05-20T21:58:28.962 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: data_block_index_type: 0 2024-05-20T21:58:28.962 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: index_shortening: 1 2024-05-20T21:58:28.962 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: data_block_hash_table_util_ratio: 0.750000 2024-05-20T21:58:28.962 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: checksum: 4 2024-05-20T21:58:28.962 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: no_block_cache: 0 2024-05-20T21:58:28.962 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: block_cache: 0x55e67b9f7090 2024-05-20T21:58:28.962 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: block_cache_name: BinnedLRUCache 2024-05-20T21:58:28.962 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: block_cache_options: 2024-05-20T21:58:28.962 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: capacity : 536870912 2024-05-20T21:58:28.962 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: num_shard_bits : 4 2024-05-20T21:58:28.962 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: strict_capacity_limit : 0 2024-05-20T21:58:28.962 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: high_pri_pool_ratio: 0.000 2024-05-20T21:58:28.962 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: block_cache_compressed: (nil) 2024-05-20T21:58:28.963 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: persistent_cache: (nil) 2024-05-20T21:58:28.963 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: block_size: 4096 2024-05-20T21:58:28.963 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: block_size_deviation: 10 2024-05-20T21:58:28.963 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: block_restart_interval: 16 2024-05-20T21:58:28.963 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: index_block_restart_interval: 1 2024-05-20T21:58:28.963 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: metadata_block_size: 4096 2024-05-20T21:58:28.963 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: partition_filters: 0 2024-05-20T21:58:28.963 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: use_delta_encoding: 1 2024-05-20T21:58:28.963 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: filter_policy: bloomfilter 2024-05-20T21:58:28.963 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: whole_key_filtering: 1 2024-05-20T21:58:28.963 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: verify_compression: 0 2024-05-20T21:58:28.963 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: read_amp_bytes_per_bit: 0 2024-05-20T21:58:28.963 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: format_version: 5 2024-05-20T21:58:28.964 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: enable_index_compression: 1 2024-05-20T21:58:28.964 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: block_align: 0 2024-05-20T21:58:28.964 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: max_auto_readahead_size: 262144 2024-05-20T21:58:28.964 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: prepopulate_block_cache: 0 2024-05-20T21:58:28.964 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: initial_auto_readahead_size: 8192 2024-05-20T21:58:28.964 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: num_file_reads_for_auto_readahead: 2 2024-05-20T21:58:28.964 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.write_buffer_size: 33554432 2024-05-20T21:58:28.964 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_write_buffer_number: 2 2024-05-20T21:58:28.964 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compression: NoCompression 2024-05-20T21:58:28.964 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.bottommost_compression: Disabled 2024-05-20T21:58:28.964 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.prefix_extractor: nullptr 2024-05-20T21:58:28.964 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-20T21:58:28.964 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.num_levels: 7 2024-05-20T21:58:28.964 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-20T21:58:28.965 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-20T21:58:28.965 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-20T21:58:28.965 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-20T21:58:28.965 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-20T21:58:28.965 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-20T21:58:28.965 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-20T21:58:28.965 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-20T21:58:28.965 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-20T21:58:28.965 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-20T21:58:28.965 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-20T21:58:28.965 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-20T21:58:28.965 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compression_opts.window_bits: -14 2024-05-20T21:58:28.965 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compression_opts.level: 32767 2024-05-20T21:58:28.966 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compression_opts.strategy: 0 2024-05-20T21:58:28.966 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-20T21:58:28.966 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-20T21:58:28.966 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-20T21:58:28.966 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-20T21:58:28.966 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compression_opts.enabled: false 2024-05-20T21:58:28.966 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-20T21:58:28.966 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-20T21:58:28.966 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-20T21:58:28.966 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-20T21:58:28.966 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.target_file_size_base: 67108864 2024-05-20T21:58:28.966 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.target_file_size_multiplier: 1 2024-05-20T21:58:28.966 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-20T21:58:28.967 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-20T21:58:28.967 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-20T21:58:28.967 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-20T21:58:28.967 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-20T21:58:28.967 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-20T21:58:28.967 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-20T21:58:28.967 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-20T21:58:28.967 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-20T21:58:28.967 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-20T21:58:28.967 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-20T21:58:28.967 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-20T21:58:28.967 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-20T21:58:28.967 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.arena_block_size: 1048576 2024-05-20T21:58:28.967 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-20T21:58:28.968 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-20T21:58:28.968 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.disable_auto_compactions: 0 2024-05-20T21:58:28.968 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-20T21:58:28.968 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-20T21:58:28.968 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-20T21:58:28.968 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-20T21:58:28.968 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-20T21:58:28.968 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-20T21:58:28.968 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-20T21:58:28.968 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-20T21:58:28.968 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-20T21:58:28.968 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-20T21:58:28.968 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.table_properties_collectors: 2024-05-20T21:58:28.968 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.inplace_update_support: 0 2024-05-20T21:58:28.969 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-05-20T21:58:28.969 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-20T21:58:28.969 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-20T21:58:28.969 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.memtable_huge_page_size: 0 2024-05-20T21:58:28.969 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.bloom_locality: 0 2024-05-20T21:58:28.969 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.max_successive_merges: 0 2024-05-20T21:58:28.969 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-05-20T21:58:28.969 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.paranoid_file_checks: 0 2024-05-20T21:58:28.969 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.force_consistency_checks: 1 2024-05-20T21:58:28.969 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.report_bg_io_stats: 0 2024-05-20T21:58:28.969 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.ttl: 2592000 2024-05-20T21:58:28.969 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-05-20T21:58:28.969 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-20T21:58:28.969 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-20T21:58:28.970 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.enable_blob_files: false 2024-05-20T21:58:28.970 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.min_blob_size: 0 2024-05-20T21:58:28.970 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.blob_file_size: 268435456 2024-05-20T21:58:28.970 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.blob_compression_type: NoCompression 2024-05-20T21:58:28.970 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-05-20T21:58:28.970 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-20T21:58:28.970 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-20T21:58:28.970 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-20T21:58:28.970 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.blob_file_starting_level: 0 2024-05-20T21:58:28.970 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-20T21:58:28.970 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-20T21:58:28.970 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-20T21:58:28.970 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 698ba571-76fc-4e05-b4cb-53643b1c0d64 2024-05-20T21:58:28.971 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1716242308547241, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-20T21:58:28.971 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-20T21:58:28.971 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.541+0000 7f6fa1572b00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1716242308547751, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1587, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 488, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 366, "raw_average_value_size": 73, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1716242308, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "698ba571-76fc-4e05-b4cb-53643b1c0d64", "db_session_id": "0FB758L8JSHLXLA2LVM0", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-20T21:58:28.971 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.545+0000 7f6fa1572b00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1716242308547932, "job": 1, "event": "recovery_finished"} 2024-05-20T21:58:28.971 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.545+0000 7f6fa1572b00 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-20T21:58:28.971 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.545+0000 7f6fa1572b00 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-20T21:58:28.971 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.545+0000 7f6fa1572b00 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e67ba20e00 2024-05-20T21:58:28.971 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.545+0000 7f6fa1572b00 4 rocksdb: DB pointer 0x55e67bb1a000 2024-05-20T21:58:28.971 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.545+0000 7f6f9733b640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-20T21:58:28.971 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.545+0000 7f6f9733b640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-20T21:58:28.971 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: ** DB Stats ** 2024-05-20T21:58:28.971 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: Uptime(secs): 0.0 total, 0.0 interval 2024-05-20T21:58:28.971 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-20T21:58:28.971 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-20T21:58:28.971 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-20T21:58:28.972 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-20T21:58:28.972 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-20T21:58:28.972 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-20T21:58:28.972 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: ** Compaction Stats [default] ** 2024-05-20T21:58:28.972 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-20T21:58:28.972 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-20T21:58:28.972 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: L0 1/0 1.55 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-20T21:58:28.972 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: Sum 1/0 1.55 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-20T21:58:28.972 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-20T21:58:28.972 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: ** Compaction Stats [default] ** 2024-05-20T21:58:28.972 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-20T21:58:28.972 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-20T21:58:28.972 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-20T21:58:28.973 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-20T21:58:28.973 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: Uptime(secs): 0.0 total, 0.0 interval 2024-05-20T21:58:28.973 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: Flush(GB): cumulative 0.000, interval 0.000 2024-05-20T21:58:28.973 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-20T21:58:28.973 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: AddFile(Total Files): cumulative 0, interval 0 2024-05-20T21:58:28.973 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: AddFile(L0 Files): cumulative 0, interval 0 2024-05-20T21:58:28.973 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: AddFile(Keys): cumulative 0, interval 0 2024-05-20T21:58:28.973 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: Cumulative compaction: 0.00 GB write, 0.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-20T21:58:28.973 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: Interval compaction: 0.00 GB write, 0.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-20T21:58:28.973 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-20T21:58:28.973 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: Block cache BinnedLRUCache@0x55e67b9f7090#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-05-20T21:58:28.973 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-20T21:58:28.973 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: ** File Read Latency Histogram By Level [default] ** 2024-05-20T21:58:28.974 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.545+0000 7f6fa1572b00 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2024-05-20T21:58:28.974 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.545+0000 7f6fa1572b00 0 using public_addrv v1:172.21.15.50:6790/0 2024-05-20T21:58:28.974 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.545+0000 7f6fa1572b00 0 starting mon.c rank -1 at public addrs v1:172.21.15.50:6790/0 at bind addrs v1:172.21.15.50:6790/0 mon_data /var/lib/ceph/mon/ceph-c fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:58:28.974 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.545+0000 7f6fa1572b00 1 mon.c@-1(???) e0 preinit fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:58:28.974 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.561+0000 7f6f9a341640 0 mon.c@-1(synchronizing).mds e1 new map 2024-05-20T21:58:28.974 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.561+0000 7f6f9a341640 0 mon.c@-1(synchronizing).mds e1 print_map 2024-05-20T21:58:28.974 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: e1 2024-05-20T21:58:28.974 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: enable_multiple, ever_enabled_multiple: 1,1 2024-05-20T21:58:28.974 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-20T21:58:28.974 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: legacy client fscid: -1 2024-05-20T21:58:28.974 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: 2024-05-20T21:58:28.974 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: No filesystems configured 2024-05-20T21:58:28.974 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.561+0000 7f6f9a341640 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-20T21:58:28.975 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.561+0000 7f6f9a341640 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-20T21:58:28.975 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.561+0000 7f6f9a341640 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-20T21:58:28.975 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.561+0000 7f6f9a341640 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-20T21:58:28.975 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.561+0000 7f6f9a341640 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-20T21:58:28.975 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.561+0000 7f6f9a341640 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-20T21:58:28.975 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.561+0000 7f6f9a341640 0 mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-20T21:58:28.975 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.561+0000 7f6f9a341640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-20T21:58:28.975 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.561+0000 7f6f9a341640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-20T21:58:28.975 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.561+0000 7f6f9a341640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-20T21:58:28.975 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:57:45.406016+0000 mgr.y (mgr.14150) 19 : cluster 0 pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:28.975 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:57:47.406531+0000 mgr.y (mgr.14150) 20 : cluster 0 pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:28.975 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:57:49.406971+0000 mgr.y (mgr.14150) 21 : cluster 0 pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:28.975 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:57:51.407375+0000 mgr.y (mgr.14150) 22 : cluster 0 pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:28.975 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:57:52.802643+0000 mgr.y (mgr.14150) 23 : audit 0 from='client.14176 v1:172.21.15.50:0/4208975661' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi145", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T21:58:28.976 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:57:53.407740+0000 mgr.y (mgr.14150) 24 : cluster 0 pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:28.976 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cephadm 2024-05-20T21:57:54.085002+0000 mgr.y (mgr.14150) 25 : cephadm 1 Deploying cephadm binary to smithi145 2024-05-20T21:58:28.976 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:57:55.408079+0000 mgr.y (mgr.14150) 26 : cluster 0 pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:28.976 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:57:57.408478+0000 mgr.y (mgr.14150) 27 : cluster 0 pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:28.976 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:57:57.753868+0000 mon.a (mon.0) 115 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:28.976 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cephadm 2024-05-20T21:57:57.754683+0000 mgr.y (mgr.14150) 28 : cephadm 1 Added host smithi145 2024-05-20T21:58:28.976 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:57:57.755473+0000 mon.a (mon.0) 116 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:58:28.976 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:57:58.229349+0000 mon.a (mon.0) 117 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:28.976 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:57:59.408879+0000 mgr.y (mgr.14150) 29 : cluster 0 pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:28.976 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:57:59.695774+0000 mon.a (mon.0) 118 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:28.976 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:00.824137+0000 mon.a (mon.0) 119 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:28.976 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:58:01.409307+0000 mgr.y (mgr.14150) 30 : cluster 0 pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:28.976 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:58:03.409719+0000 mgr.y (mgr.14150) 31 : cluster 0 pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:28.976 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:58:05.409971+0000 mgr.y (mgr.14150) 32 : cluster 0 pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:28.977 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:05.702565+0000 mgr.y (mgr.14150) 33 : audit 0 from='client.14178 v1:172.21.15.50:0/3411288015' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T21:58:28.977 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:05.998734+0000 mon.a (mon.0) 120 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:28.977 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:06.003592+0000 mon.a (mon.0) 121 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:28.977 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:06.009268+0000 mon.a (mon.0) 122 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:28.977 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:06.014308+0000 mon.a (mon.0) 123 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:28.977 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:06.015748+0000 mon.a (mon.0) 124 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi145", "name": "osd_memory_target"}]: dispatch 2024-05-20T21:58:28.977 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:06.017713+0000 mon.a (mon.0) 125 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:28.977 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:06.019392+0000 mon.a (mon.0) 126 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:58:28.977 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cephadm 2024-05-20T21:58:06.021760+0000 mgr.y (mgr.14150) 34 : cephadm 1 Updating smithi145:/etc/ceph/ceph.conf 2024-05-20T21:58:28.977 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:06.632003+0000 mon.a (mon.0) 127 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:28.977 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:06.634367+0000 mon.a (mon.0) 128 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:28.977 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:06.636795+0000 mon.a (mon.0) 129 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:28.977 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cephadm 2024-05-20T21:58:06.202799+0000 mgr.y (mgr.14150) 35 : cephadm 1 Updating smithi145:/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T21:58:28.978 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cephadm 2024-05-20T21:58:06.358960+0000 mgr.y (mgr.14150) 36 : cephadm 1 Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-05-20T21:58:28.978 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cephadm 2024-05-20T21:58:06.501604+0000 mgr.y (mgr.14150) 37 : cephadm 1 Updating smithi145:/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T21:58:28.978 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:58:07.410359+0000 mgr.y (mgr.14150) 38 : cluster 0 pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:28.978 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:58:09.410785+0000 mgr.y (mgr.14150) 39 : cluster 0 pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:28.978 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:58:11.411214+0000 mgr.y (mgr.14150) 40 : cluster 0 pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:28.978 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:13.733875+0000 mon.a (mon.0) 130 : audit 1 from='client.? v1:172.21.15.50:0/3605026454' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-20T21:58:28.978 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:58:13.411533+0000 mgr.y (mgr.14150) 41 : cluster 0 pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:28.978 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:14.010039+0000 mon.a (mon.0) 131 : audit 1 from='client.? v1:172.21.15.50:0/3605026454' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-20T21:58:28.978 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:58:14.014860+0000 mon.a (mon.0) 132 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-05-20T21:58:28.978 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:58:15.411949+0000 mgr.y (mgr.14150) 42 : cluster 0 pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:28.978 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:58:17.412324+0000 mgr.y (mgr.14150) 43 : cluster 0 pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:28.978 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:18.125164+0000 mgr.y (mgr.14150) 44 : audit 0 from='client.14182 v1:172.21.15.145:0/318521764' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi050:[v1:172.21.15.50:6789]=a;smithi050:[v1:172.21.15.50:6790]=c;smithi145:[v1:172.21.15.145:6789]=b", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T21:58:28.978 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cephadm 2024-05-20T21:58:18.130531+0000 mgr.y (mgr.14150) 45 : cephadm 1 Saving service mon spec with placement smithi050:[v1:172.21.15.50:6789]=a;smithi050:[v1:172.21.15.50:6790]=c;smithi145:[v1:172.21.15.145:6789]=b;count:3 2024-05-20T21:58:28.979 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:18.135280+0000 mon.a (mon.0) 133 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:28.979 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:18.136859+0000 mon.a (mon.0) 134 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:58:28.979 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:18.140342+0000 mon.a (mon.0) 135 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:28.979 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:18.142013+0000 mon.a (mon.0) 136 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:58:28.979 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:18.149032+0000 mon.a (mon.0) 137 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:28.979 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:18.152752+0000 mon.a (mon.0) 138 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T21:58:28.979 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:18.154211+0000 mon.a (mon.0) 139 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:28.979 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cephadm 2024-05-20T21:58:18.156107+0000 mgr.y (mgr.14150) 46 : cephadm 1 Deploying daemon mon.b on smithi145 2024-05-20T21:58:28.979 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:58:19.412746+0000 mgr.y (mgr.14150) 47 : cluster 0 pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:28.979 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:58:21.413166+0000 mgr.y (mgr.14150) 48 : cluster 0 pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:28.979 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:22.992271+0000 mon.a (mon.0) 140 : audit 0 from='client.? v1:172.21.15.145:0/1518519940' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-20T21:58:28.979 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:23.359388+0000 mon.a (mon.0) 141 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:28.979 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:23.364605+0000 mon.a (mon.0) 142 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:28.979 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:23.370329+0000 mon.a (mon.0) 143 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:28.980 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:23.371594+0000 mon.a (mon.0) 144 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T21:58:28.980 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: audit 2024-05-20T21:58:23.373146+0000 mon.a (mon.0) 145 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:28.980 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cephadm 2024-05-20T21:58:23.375093+0000 mgr.y (mgr.14150) 49 : cephadm 1 Deploying daemon mon.c on smithi050 2024-05-20T21:58:28.980 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: cluster 2024-05-20T21:58:23.413549+0000 mgr.y (mgr.14150) 50 : cluster 0 pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:28.980 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:28 smithi050 bash[28929]: debug 2024-05-20T21:58:28.561+0000 7f6f9a341640 1 mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-20T21:58:29.697 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: audit 2024-05-20T21:58:23.359388+0000 mon.a (mon.0) 141 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:29.697 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: audit 2024-05-20T21:58:23.364605+0000 mon.a (mon.0) 142 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:29.697 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: audit 2024-05-20T21:58:23.370329+0000 mon.a (mon.0) 143 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:29.697 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: audit 2024-05-20T21:58:23.371594+0000 mon.a (mon.0) 144 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T21:58:29.697 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: audit 2024-05-20T21:58:23.373146+0000 mon.a (mon.0) 145 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:29.697 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: cephadm 2024-05-20T21:58:23.375093+0000 mgr.y (mgr.14150) 49 : cephadm 1 Deploying daemon mon.c on smithi050 2024-05-20T21:58:29.697 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: cluster 2024-05-20T21:58:23.413549+0000 mgr.y (mgr.14150) 50 : cluster 0 pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:29.698 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: audit 2024-05-20T21:58:24.375982+0000 mon.a (mon.0) 147 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T21:58:29.698 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: audit 2024-05-20T21:58:24.376307+0000 mon.a (mon.0) 148 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:29.698 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: cluster 2024-05-20T21:58:24.376504+0000 mon.a (mon.0) 149 : cluster 1 mon.a calling monitor election 2024-05-20T21:58:29.698 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: audit 2024-05-20T21:58:25.367655+0000 mon.a (mon.0) 150 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:29.698 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: cluster 2024-05-20T21:58:25.413940+0000 mgr.y (mgr.14150) 51 : cluster 0 pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:29.698 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: audit 2024-05-20T21:58:26.367327+0000 mon.a (mon.0) 151 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:29.698 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: cluster 2024-05-20T21:58:26.369136+0000 mon.b (mon.1) 1 : cluster 1 mon.b calling monitor election 2024-05-20T21:58:29.698 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: audit 2024-05-20T21:58:27.367559+0000 mon.a (mon.0) 152 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:29.698 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: cluster 2024-05-20T21:58:27.414182+0000 mgr.y (mgr.14150) 52 : cluster 0 pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:29.698 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: audit 2024-05-20T21:58:28.368004+0000 mon.a (mon.0) 153 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:29.698 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: audit 2024-05-20T21:58:28.571437+0000 mon.a (mon.0) 154 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:29.698 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: audit 2024-05-20T21:58:29.368259+0000 mon.a (mon.0) 155 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:29.698 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: cluster 2024-05-20T21:58:29.418792+0000 mon.a (mon.0) 156 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-05-20T21:58:29.699 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: cluster 2024-05-20T21:58:29.427179+0000 mon.a (mon.0) 157 : cluster 0 monmap epoch 2 2024-05-20T21:58:29.699 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: cluster 2024-05-20T21:58:29.427211+0000 mon.a (mon.0) 158 : cluster 0 fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:58:29.699 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: cluster 2024-05-20T21:58:29.427229+0000 mon.a (mon.0) 159 : cluster 0 last_changed 2024-05-20T21:58:24.371457+0000 2024-05-20T21:58:29.699 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: cluster 2024-05-20T21:58:29.427248+0000 mon.a (mon.0) 160 : cluster 0 created 2024-05-20T21:56:15.715764+0000 2024-05-20T21:58:29.699 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: cluster 2024-05-20T21:58:29.427263+0000 mon.a (mon.0) 161 : cluster 0 min_mon_release 19 (squid) 2024-05-20T21:58:29.699 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: cluster 2024-05-20T21:58:29.427279+0000 mon.a (mon.0) 162 : cluster 0 election_strategy: 1 2024-05-20T21:58:29.699 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: cluster 2024-05-20T21:58:29.427294+0000 mon.a (mon.0) 163 : cluster 0 0: v1:172.21.15.50:6789/0 mon.a 2024-05-20T21:58:29.699 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: cluster 2024-05-20T21:58:29.427310+0000 mon.a (mon.0) 164 : cluster 0 1: v1:172.21.15.145:6789/0 mon.b 2024-05-20T21:58:29.699 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: cluster 2024-05-20T21:58:29.444744+0000 mon.a (mon.0) 165 : cluster 0 fsmap 2024-05-20T21:58:29.699 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: cluster 2024-05-20T21:58:29.444795+0000 mon.a (mon.0) 166 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-05-20T21:58:29.699 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: cluster 2024-05-20T21:58:29.445050+0000 mon.a (mon.0) 167 : cluster 0 mgrmap e13: y(active, since 72s) 2024-05-20T21:58:29.699 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: cluster 2024-05-20T21:58:29.445292+0000 mon.a (mon.0) 168 : cluster 1 overall HEALTH_OK 2024-05-20T21:58:29.699 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: audit 2024-05-20T21:58:29.451476+0000 mon.a (mon.0) 169 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:29.699 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: audit 2024-05-20T21:58:29.458119+0000 mon.a (mon.0) 170 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:29.700 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: audit 2024-05-20T21:58:29.465485+0000 mon.a (mon.0) 171 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:29.700 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:29 smithi145 bash[23893]: audit 2024-05-20T21:58:29.471906+0000 mon.a (mon.0) 172 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:29.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: audit 2024-05-20T21:58:24.375982+0000 mon.a (mon.0) 147 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T21:58:29.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: audit 2024-05-20T21:58:24.376307+0000 mon.a (mon.0) 148 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:29.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: cluster 2024-05-20T21:58:24.376504+0000 mon.a (mon.0) 149 : cluster 1 mon.a calling monitor election 2024-05-20T21:58:29.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: audit 2024-05-20T21:58:25.367655+0000 mon.a (mon.0) 150 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:29.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: cluster 2024-05-20T21:58:25.413940+0000 mgr.y (mgr.14150) 51 : cluster 0 pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:29.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: audit 2024-05-20T21:58:26.367327+0000 mon.a (mon.0) 151 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:29.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: cluster 2024-05-20T21:58:26.369136+0000 mon.b (mon.1) 1 : cluster 1 mon.b calling monitor election 2024-05-20T21:58:29.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: audit 2024-05-20T21:58:27.367559+0000 mon.a (mon.0) 152 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:29.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: cluster 2024-05-20T21:58:27.414182+0000 mgr.y (mgr.14150) 52 : cluster 0 pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:29.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: audit 2024-05-20T21:58:28.368004+0000 mon.a (mon.0) 153 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:29.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: audit 2024-05-20T21:58:28.571437+0000 mon.a (mon.0) 154 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:29.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: audit 2024-05-20T21:58:29.368259+0000 mon.a (mon.0) 155 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:29.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: cluster 2024-05-20T21:58:29.418792+0000 mon.a (mon.0) 156 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-05-20T21:58:29.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: cluster 2024-05-20T21:58:29.427179+0000 mon.a (mon.0) 157 : cluster 0 monmap epoch 2 2024-05-20T21:58:29.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: cluster 2024-05-20T21:58:29.427211+0000 mon.a (mon.0) 158 : cluster 0 fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:58:29.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: cluster 2024-05-20T21:58:29.427229+0000 mon.a (mon.0) 159 : cluster 0 last_changed 2024-05-20T21:58:24.371457+0000 2024-05-20T21:58:29.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: cluster 2024-05-20T21:58:29.427248+0000 mon.a (mon.0) 160 : cluster 0 created 2024-05-20T21:56:15.715764+0000 2024-05-20T21:58:29.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: cluster 2024-05-20T21:58:29.427263+0000 mon.a (mon.0) 161 : cluster 0 min_mon_release 19 (squid) 2024-05-20T21:58:29.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: cluster 2024-05-20T21:58:29.427279+0000 mon.a (mon.0) 162 : cluster 0 election_strategy: 1 2024-05-20T21:58:29.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: cluster 2024-05-20T21:58:29.427294+0000 mon.a (mon.0) 163 : cluster 0 0: v1:172.21.15.50:6789/0 mon.a 2024-05-20T21:58:29.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: cluster 2024-05-20T21:58:29.427310+0000 mon.a (mon.0) 164 : cluster 0 1: v1:172.21.15.145:6789/0 mon.b 2024-05-20T21:58:29.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: cluster 2024-05-20T21:58:29.444744+0000 mon.a (mon.0) 165 : cluster 0 fsmap 2024-05-20T21:58:29.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: cluster 2024-05-20T21:58:29.444795+0000 mon.a (mon.0) 166 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-05-20T21:58:29.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: cluster 2024-05-20T21:58:29.445050+0000 mon.a (mon.0) 167 : cluster 0 mgrmap e13: y(active, since 72s) 2024-05-20T21:58:29.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: cluster 2024-05-20T21:58:29.445292+0000 mon.a (mon.0) 168 : cluster 1 overall HEALTH_OK 2024-05-20T21:58:29.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: audit 2024-05-20T21:58:29.451476+0000 mon.a (mon.0) 169 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:29.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: audit 2024-05-20T21:58:29.458119+0000 mon.a (mon.0) 170 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:29.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: audit 2024-05-20T21:58:29.465485+0000 mon.a (mon.0) 171 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:29.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:29 smithi050 bash[21866]: audit 2024-05-20T21:58:29.471906+0000 mon.a (mon.0) 172 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:30.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:30 smithi145 bash[23893]: cluster 2024-05-20T21:58:29.414524+0000 mgr.y (mgr.14150) 53 : cluster 0 pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:30.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:30 smithi145 bash[23893]: audit 2024-05-20T21:58:29.533502+0000 mon.a (mon.0) 173 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:58:30.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:30 smithi145 bash[23893]: audit 2024-05-20T21:58:29.571774+0000 mon.a (mon.0) 174 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:30.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:30 smithi145 bash[23893]: audit 2024-05-20T21:58:30.368296+0000 mon.a (mon.0) 175 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:30.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:30 smithi050 bash[21866]: cluster 2024-05-20T21:58:29.414524+0000 mgr.y (mgr.14150) 53 : cluster 0 pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:30.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:30 smithi050 bash[21866]: audit 2024-05-20T21:58:29.533502+0000 mon.a (mon.0) 173 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:58:30.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:30 smithi050 bash[21866]: audit 2024-05-20T21:58:29.571774+0000 mon.a (mon.0) 174 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:30.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:30 smithi050 bash[21866]: audit 2024-05-20T21:58:30.368296+0000 mon.a (mon.0) 175 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:31.698 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:58:31 smithi050 bash[22118]: debug 2024-05-20T21:58:31.365+0000 7fa4bbb0d640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-20T21:58:35.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.638+0000 7fa0c6e5e640 1 -- 172.21.15.145:0/150354901 >> v1:172.21.15.50:6789/0 conn(0x7fa0ac003560 legacy=0x7fa0ac0059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:35.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.638+0000 7fa0c6e5e640 1 -- 172.21.15.145:0/150354901 shutdown_connections 2024-05-20T21:58:35.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.638+0000 7fa0c6e5e640 1 -- 172.21.15.145:0/150354901 >> 172.21.15.145:0/150354901 conn(0x7fa0c00ff050 msgr2=0x7fa0c0101470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:58:35.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.638+0000 7fa0c6e5e640 1 -- 172.21.15.145:0/150354901 shutdown_connections 2024-05-20T21:58:35.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.638+0000 7fa0c6e5e640 1 -- 172.21.15.145:0/150354901 wait complete. 2024-05-20T21:58:35.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.638+0000 7fa0c6e5e640 1 Processor -- start 2024-05-20T21:58:35.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.638+0000 7fa0c6e5e640 1 -- start start 2024-05-20T21:58:35.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.638+0000 7fa0c6e5e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa0c01a8170 con 0x7fa0c01a44d0 2024-05-20T21:58:35.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.638+0000 7fa0c6e5e640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa0c01a9370 con 0x7fa0ac003560 2024-05-20T21:58:35.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.638+0000 7fa0c4bfa640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fa0ac003560 0x7fa0c0198240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:39306/0 (socket says 172.21.15.145:39306) 2024-05-20T21:58:35.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.638+0000 7fa0c4bfa640 1 -- 172.21.15.145:0/3941132465 learned_addr learned my addr 172.21.15.145:0/3941132465 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-05-20T21:58:35.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.642+0000 7fa0c6e5e640 1 -- 172.21.15.145:0/3941132465 --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa0c01aa5b0 con 0x7fa0c0198950 2024-05-20T21:58:35.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.642+0000 7fa0b5ffb640 1 -- 172.21.15.145:0/3941132465 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3743989542 0 0) 0x7fa0c01a8170 con 0x7fa0c01a44d0 2024-05-20T21:58:35.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.642+0000 7fa0b5ffb640 1 -- 172.21.15.145:0/3941132465 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0a8003b60 con 0x7fa0c01a44d0 2024-05-20T21:58:35.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.646+0000 7fa0b5ffb640 1 -- 172.21.15.145:0/3941132465 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3485507514 0 0) 0x7fa0a8003b60 con 0x7fa0c01a44d0 2024-05-20T21:58:35.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.646+0000 7fa0b5ffb640 1 -- 172.21.15.145:0/3941132465 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa0c01a8170 con 0x7fa0c01a44d0 2024-05-20T21:58:35.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.646+0000 7fa0b5ffb640 1 -- 172.21.15.145:0/3941132465 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fa0b8001b90 con 0x7fa0c01a44d0 2024-05-20T21:58:35.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.650+0000 7fa0b5ffb640 1 -- 172.21.15.145:0/3941132465 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2238685904 0 0) 0x7fa0c01a8170 con 0x7fa0c01a44d0 2024-05-20T21:58:35.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.650+0000 7fa0b5ffb640 1 -- 172.21.15.145:0/3941132465 >> v1:172.21.15.50:6790/0 conn(0x7fa0c0198950 legacy=0x7fa0c01a2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:35.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.650+0000 7fa0b5ffb640 1 -- 172.21.15.145:0/3941132465 >> v1:172.21.15.145:6789/0 conn(0x7fa0ac003560 legacy=0x7fa0c0198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:35.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.650+0000 7fa0b5ffb640 1 -- 172.21.15.145:0/3941132465 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c01ab7f0 con 0x7fa0c01a44d0 2024-05-20T21:58:35.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.650+0000 7fa0c6e5e640 1 -- 172.21.15.145:0/3941132465 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c01a83a0 con 0x7fa0c01a44d0 2024-05-20T21:58:35.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.650+0000 7fa0c6e5e640 1 -- 172.21.15.145:0/3941132465 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa0c01a8920 con 0x7fa0c01a44d0 2024-05-20T21:58:35.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.650+0000 7fa0c6e5e640 1 -- 172.21.15.145:0/3941132465 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c0062e90 con 0x7fa0c01a44d0 2024-05-20T21:58:35.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.654+0000 7fa0b5ffb640 1 -- 172.21.15.145:0/3941132465 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7fa0b8003ec0 con 0x7fa0c01a44d0 2024-05-20T21:58:35.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.654+0000 7fa0b5ffb640 1 -- 172.21.15.145:0/3941132465 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fa0b8004d70 con 0x7fa0c01a44d0 2024-05-20T21:58:35.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.654+0000 7fa0b5ffb640 1 -- 172.21.15.145:0/3941132465 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 13) ==== 46308+0+0 (unknown 209257320 0 0) 0x7fa0b8003a30 con 0x7fa0c01a44d0 2024-05-20T21:58:35.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.658+0000 7fa0b5ffb640 1 -- 172.21.15.145:0/3941132465 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (unknown 2781634937 0 0) 0x7fa0b8046220 con 0x7fa0c01a44d0 2024-05-20T21:58:35.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.674+0000 7fa0b5ffb640 1 -- 172.21.15.145:0/3941132465 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7fa0b801dba0 con 0x7fa0c01a44d0 2024-05-20T21:58:35.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.946+0000 7fa0c6e5e640 1 -- 172.21.15.145:0/3941132465 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa0c010c900 con 0x7fa0c01a44d0 2024-05-20T21:58:35.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.946+0000 7fa0b5ffb640 1 -- 172.21.15.145:0/3941132465 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1125 (unknown 409899127 0 1353485947) 0x7fa0b8011960 con 0x7fa0c01a44d0 2024-05-20T21:58:35.948 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-05-20T21:58:35.948 INFO:teuthology.orchestra.run.smithi145.stdout:{"epoch":3,"fsid":"9a9abba0-16f3-11ef-bc9a-c7b262605968","modified":"2024-05-20T21:58:30.572995Z","created":"2024-05-20T21:56:15.715764Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6789","nonce":0}]},"addr":"172.21.15.145:6789/0","public_addr":"172.21.15.145:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6790","nonce":0}]},"addr":"172.21.15.50:6790/0","public_addr":"172.21.15.50:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-20T21:58:35.949 INFO:teuthology.orchestra.run.smithi145.stderr:dumped monmap epoch 3 2024-05-20T21:58:35.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: audit 2024-05-20T21:58:30.577564+0000 mon.a (mon.0) 177 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T21:58:35.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:30.577798+0000 mon.b (mon.1) 2 : cluster 1 mon.b calling monitor election 2024-05-20T21:58:35.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:30.578024+0000 mon.a (mon.0) 178 : cluster 1 mon.a calling monitor election 2024-05-20T21:58:35.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: audit 2024-05-20T21:58:30.597231+0000 mon.a (mon.0) 179 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:35.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: audit 2024-05-20T21:58:30.597589+0000 mon.a (mon.0) 180 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:35.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:31.414926+0000 mgr.y (mgr.14150) 54 : cluster 0 pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:35.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: audit 2024-05-20T21:58:31.572423+0000 mon.a (mon.0) 181 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:35.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: audit 2024-05-20T21:58:32.572208+0000 mon.a (mon.0) 182 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:35.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:33.415329+0000 mgr.y (mgr.14150) 55 : cluster 0 pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:35.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: audit 2024-05-20T21:58:33.572618+0000 mon.a (mon.0) 183 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:35.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: audit 2024-05-20T21:58:34.572197+0000 mon.a (mon.0) 184 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:35.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: audit 2024-05-20T21:58:35.572976+0000 mon.a (mon.0) 185 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:35.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:35.597359+0000 mon.a (mon.0) 186 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-05-20T21:58:35.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:35.603455+0000 mon.a (mon.0) 187 : cluster 0 monmap epoch 3 2024-05-20T21:58:35.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:35.603503+0000 mon.a (mon.0) 188 : cluster 0 fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:58:35.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:35.603539+0000 mon.a (mon.0) 189 : cluster 0 last_changed 2024-05-20T21:58:30.572995+0000 2024-05-20T21:58:35.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:35.603572+0000 mon.a (mon.0) 190 : cluster 0 created 2024-05-20T21:56:15.715764+0000 2024-05-20T21:58:35.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:35.603605+0000 mon.a (mon.0) 191 : cluster 0 min_mon_release 19 (squid) 2024-05-20T21:58:35.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:35.603644+0000 mon.a (mon.0) 192 : cluster 0 election_strategy: 1 2024-05-20T21:58:35.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:35.603678+0000 mon.a (mon.0) 193 : cluster 0 0: v1:172.21.15.50:6789/0 mon.a 2024-05-20T21:58:35.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:35.603709+0000 mon.a (mon.0) 194 : cluster 0 1: v1:172.21.15.145:6789/0 mon.b 2024-05-20T21:58:35.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:35.603740+0000 mon.a (mon.0) 195 : cluster 0 2: v1:172.21.15.50:6790/0 mon.c 2024-05-20T21:58:35.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:35.624865+0000 mon.a (mon.0) 196 : cluster 0 fsmap 2024-05-20T21:58:35.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:35.624945+0000 mon.a (mon.0) 197 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-05-20T21:58:35.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:35.625272+0000 mon.a (mon.0) 198 : cluster 0 mgrmap e13: y(active, since 78s) 2024-05-20T21:58:35.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:35.625682+0000 mon.a (mon.0) 199 : cluster 3 Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-05-20T21:58:35.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:35.633911+0000 mon.a (mon.0) 200 : cluster 3 Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2024-05-20T21:58:35.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:35.633960+0000 mon.a (mon.0) 201 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-05-20T21:58:35.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: cluster 2024-05-20T21:58:35.633980+0000 mon.a (mon.0) 202 : cluster 3 mon.c (rank 2) addr v1:172.21.15.50:6790/0 is down (out of quorum) 2024-05-20T21:58:35.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: audit 2024-05-20T21:58:35.639016+0000 mon.a (mon.0) 203 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:35.952 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: audit 2024-05-20T21:58:35.644452+0000 mon.a (mon.0) 204 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:35.952 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: audit 2024-05-20T21:58:35.650557+0000 mon.a (mon.0) 205 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:35.952 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:35 smithi050 bash[21866]: audit 2024-05-20T21:58:35.656661+0000 mon.a (mon.0) 206 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:35.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.946+0000 7fa0c6e5e640 1 -- 172.21.15.145:0/3941132465 >> v1:172.21.15.50:6800/2944911247 conn(0x7fa0a803a1e0 legacy=0x7fa0a803c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:35.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.946+0000 7fa0c6e5e640 1 -- 172.21.15.145:0/3941132465 >> v1:172.21.15.50:6789/0 conn(0x7fa0c01a44d0 legacy=0x7fa0c01a68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:35.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.950+0000 7fa0c6e5e640 1 -- 172.21.15.145:0/3941132465 shutdown_connections 2024-05-20T21:58:35.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.950+0000 7fa0c6e5e640 1 -- 172.21.15.145:0/3941132465 >> 172.21.15.145:0/3941132465 conn(0x7fa0c00ff050 msgr2=0x7fa0c00ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:58:35.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.950+0000 7fa0c6e5e640 1 -- 172.21.15.145:0/3941132465 shutdown_connections 2024-05-20T21:58:35.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:35.950+0000 7fa0c6e5e640 1 -- 172.21.15.145:0/3941132465 wait complete. 2024-05-20T21:58:35.962 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: audit 2024-05-20T21:58:30.577564+0000 mon.a (mon.0) 177 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T21:58:35.962 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:30.577798+0000 mon.b (mon.1) 2 : cluster 1 mon.b calling monitor election 2024-05-20T21:58:35.962 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:30.578024+0000 mon.a (mon.0) 178 : cluster 1 mon.a calling monitor election 2024-05-20T21:58:35.963 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: audit 2024-05-20T21:58:30.597231+0000 mon.a (mon.0) 179 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:35.963 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: audit 2024-05-20T21:58:30.597589+0000 mon.a (mon.0) 180 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:35.963 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:31.414926+0000 mgr.y (mgr.14150) 54 : cluster 0 pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:35.963 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: audit 2024-05-20T21:58:31.572423+0000 mon.a (mon.0) 181 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:35.963 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: audit 2024-05-20T21:58:32.572208+0000 mon.a (mon.0) 182 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:35.963 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:33.415329+0000 mgr.y (mgr.14150) 55 : cluster 0 pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:35.963 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: audit 2024-05-20T21:58:33.572618+0000 mon.a (mon.0) 183 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:35.963 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: audit 2024-05-20T21:58:34.572197+0000 mon.a (mon.0) 184 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:35.963 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: audit 2024-05-20T21:58:35.572976+0000 mon.a (mon.0) 185 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:35.963 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:35.597359+0000 mon.a (mon.0) 186 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-05-20T21:58:35.963 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:35.603455+0000 mon.a (mon.0) 187 : cluster 0 monmap epoch 3 2024-05-20T21:58:35.963 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:35.603503+0000 mon.a (mon.0) 188 : cluster 0 fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:58:35.963 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:35.603539+0000 mon.a (mon.0) 189 : cluster 0 last_changed 2024-05-20T21:58:30.572995+0000 2024-05-20T21:58:35.963 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:35.603572+0000 mon.a (mon.0) 190 : cluster 0 created 2024-05-20T21:56:15.715764+0000 2024-05-20T21:58:35.964 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:35.603605+0000 mon.a (mon.0) 191 : cluster 0 min_mon_release 19 (squid) 2024-05-20T21:58:35.964 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:35.603644+0000 mon.a (mon.0) 192 : cluster 0 election_strategy: 1 2024-05-20T21:58:35.964 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:35.603678+0000 mon.a (mon.0) 193 : cluster 0 0: v1:172.21.15.50:6789/0 mon.a 2024-05-20T21:58:35.964 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:35.603709+0000 mon.a (mon.0) 194 : cluster 0 1: v1:172.21.15.145:6789/0 mon.b 2024-05-20T21:58:35.964 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:35.603740+0000 mon.a (mon.0) 195 : cluster 0 2: v1:172.21.15.50:6790/0 mon.c 2024-05-20T21:58:35.964 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:35.624865+0000 mon.a (mon.0) 196 : cluster 0 fsmap 2024-05-20T21:58:35.964 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:35.624945+0000 mon.a (mon.0) 197 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-05-20T21:58:35.964 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:35.625272+0000 mon.a (mon.0) 198 : cluster 0 mgrmap e13: y(active, since 78s) 2024-05-20T21:58:35.964 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:35.625682+0000 mon.a (mon.0) 199 : cluster 3 Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-05-20T21:58:35.964 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:35.633911+0000 mon.a (mon.0) 200 : cluster 3 Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2024-05-20T21:58:35.964 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:35.633960+0000 mon.a (mon.0) 201 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-05-20T21:58:35.964 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: cluster 2024-05-20T21:58:35.633980+0000 mon.a (mon.0) 202 : cluster 3 mon.c (rank 2) addr v1:172.21.15.50:6790/0 is down (out of quorum) 2024-05-20T21:58:35.964 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: audit 2024-05-20T21:58:35.639016+0000 mon.a (mon.0) 203 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:35.964 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: audit 2024-05-20T21:58:35.644452+0000 mon.a (mon.0) 204 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:35.965 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: audit 2024-05-20T21:58:35.650557+0000 mon.a (mon.0) 205 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:35.965 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:35 smithi145 bash[23893]: audit 2024-05-20T21:58:35.656661+0000 mon.a (mon.0) 206 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:36.571 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-20T21:58:36.571 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph config generate-minimal-conf 2024-05-20T21:58:36.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:36 smithi145 bash[23893]: cluster 2024-05-20T21:58:35.415822+0000 mgr.y (mgr.14150) 56 : cluster 0 pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:36.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:36 smithi145 bash[23893]: audit 2024-05-20T21:58:35.680228+0000 mon.a (mon.0) 207 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:36.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:36 smithi145 bash[23893]: audit 2024-05-20T21:58:35.949534+0000 mon.a (mon.0) 208 : audit 0 from='client.? v1:172.21.15.145:0/3941132465' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-20T21:58:36.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:36 smithi145 bash[23893]: audit 2024-05-20T21:58:36.338190+0000 mon.a (mon.0) 209 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:36.895 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:36 smithi145 bash[23893]: audit 2024-05-20T21:58:36.339813+0000 mon.a (mon.0) 210 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:58:36.895 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:36 smithi145 bash[23893]: audit 2024-05-20T21:58:36.572470+0000 mon.a (mon.0) 211 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:36.895 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:36 smithi145 bash[23893]: audit 2024-05-20T21:58:36.636454+0000 mon.a (mon.0) 212 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:36.895 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:36 smithi145 bash[23893]: audit 2024-05-20T21:58:36.642399+0000 mon.a (mon.0) 213 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:36.895 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:36 smithi145 bash[23893]: audit 2024-05-20T21:58:36.650460+0000 mon.a (mon.0) 214 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:36.895 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:36 smithi145 bash[23893]: audit 2024-05-20T21:58:36.655573+0000 mon.a (mon.0) 215 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:36.895 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:36 smithi145 bash[23893]: audit 2024-05-20T21:58:36.660997+0000 mon.a (mon.0) 216 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:36.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:36 smithi050 bash[21866]: cluster 2024-05-20T21:58:35.415822+0000 mgr.y (mgr.14150) 56 : cluster 0 pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:36.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:36 smithi050 bash[21866]: audit 2024-05-20T21:58:35.680228+0000 mon.a (mon.0) 207 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:36.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:36 smithi050 bash[21866]: audit 2024-05-20T21:58:35.949534+0000 mon.a (mon.0) 208 : audit 0 from='client.? v1:172.21.15.145:0/3941132465' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-20T21:58:36.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:36 smithi050 bash[21866]: audit 2024-05-20T21:58:36.338190+0000 mon.a (mon.0) 209 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:36.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:36 smithi050 bash[21866]: audit 2024-05-20T21:58:36.339813+0000 mon.a (mon.0) 210 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:58:36.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:36 smithi050 bash[21866]: audit 2024-05-20T21:58:36.572470+0000 mon.a (mon.0) 211 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:36.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:36 smithi050 bash[21866]: audit 2024-05-20T21:58:36.636454+0000 mon.a (mon.0) 212 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:36.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:36 smithi050 bash[21866]: audit 2024-05-20T21:58:36.642399+0000 mon.a (mon.0) 213 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:36.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:36 smithi050 bash[21866]: audit 2024-05-20T21:58:36.650460+0000 mon.a (mon.0) 214 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:36.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:36 smithi050 bash[21866]: audit 2024-05-20T21:58:36.655573+0000 mon.a (mon.0) 215 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:36.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:36 smithi050 bash[21866]: audit 2024-05-20T21:58:36.660997+0000 mon.a (mon.0) 216 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:37.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:37 smithi050 bash[21866]: cluster 2024-05-20T21:58:32.573955+0000 mon.c (mon.2) 1 : cluster 1 mon.c calling monitor election 2024-05-20T21:58:37.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:37 smithi050 bash[21866]: cluster 2024-05-20T21:58:37.608743+0000 mon.c (mon.2) 2 : cluster 1 mon.c calling monitor election 2024-05-20T21:58:37.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:37 smithi050 bash[21866]: cluster 2024-05-20T21:58:37.609209+0000 mon.b (mon.1) 3 : cluster 1 mon.b calling monitor election 2024-05-20T21:58:37.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:37 smithi050 bash[21866]: cluster 2024-05-20T21:58:37.609446+0000 mon.a (mon.0) 225 : cluster 1 mon.a calling monitor election 2024-05-20T21:58:37.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:37 smithi050 bash[21866]: cluster 2024-05-20T21:58:37.631700+0000 mon.a (mon.0) 226 : cluster 1 mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-05-20T21:58:37.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:37 smithi050 bash[21866]: cluster 2024-05-20T21:58:37.637564+0000 mon.a (mon.0) 227 : cluster 0 monmap epoch 3 2024-05-20T21:58:37.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:37 smithi050 bash[21866]: cluster 2024-05-20T21:58:37.637593+0000 mon.a (mon.0) 228 : cluster 0 fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:58:37.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:37 smithi050 bash[21866]: cluster 2024-05-20T21:58:37.637611+0000 mon.a (mon.0) 229 : cluster 0 last_changed 2024-05-20T21:58:30.572995+0000 2024-05-20T21:58:37.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:37 smithi050 bash[21866]: cluster 2024-05-20T21:58:37.637628+0000 mon.a (mon.0) 230 : cluster 0 created 2024-05-20T21:56:15.715764+0000 2024-05-20T21:58:37.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:37 smithi050 bash[21866]: cluster 2024-05-20T21:58:37.637654+0000 mon.a (mon.0) 231 : cluster 0 min_mon_release 19 (squid) 2024-05-20T21:58:37.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:37 smithi050 bash[21866]: cluster 2024-05-20T21:58:37.637673+0000 mon.a (mon.0) 232 : cluster 0 election_strategy: 1 2024-05-20T21:58:37.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:37 smithi050 bash[21866]: cluster 2024-05-20T21:58:37.637688+0000 mon.a (mon.0) 233 : cluster 0 0: v1:172.21.15.50:6789/0 mon.a 2024-05-20T21:58:37.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:37 smithi050 bash[21866]: cluster 2024-05-20T21:58:37.637714+0000 mon.a (mon.0) 234 : cluster 0 1: v1:172.21.15.145:6789/0 mon.b 2024-05-20T21:58:37.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:37 smithi050 bash[21866]: cluster 2024-05-20T21:58:37.637732+0000 mon.a (mon.0) 235 : cluster 0 2: v1:172.21.15.50:6790/0 mon.c 2024-05-20T21:58:37.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:37 smithi050 bash[21866]: cluster 2024-05-20T21:58:37.638751+0000 mon.a (mon.0) 236 : cluster 0 fsmap 2024-05-20T21:58:37.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:37 smithi050 bash[21866]: cluster 2024-05-20T21:58:37.638801+0000 mon.a (mon.0) 237 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-05-20T21:58:37.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:37 smithi050 bash[21866]: cluster 2024-05-20T21:58:37.639076+0000 mon.a (mon.0) 238 : cluster 0 mgrmap e13: y(active, since 80s) 2024-05-20T21:58:37.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:37 smithi050 bash[21866]: cluster 2024-05-20T21:58:37.639364+0000 mon.a (mon.0) 239 : cluster 1 Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-05-20T21:58:37.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:37 smithi050 bash[21866]: cluster 2024-05-20T21:58:37.639396+0000 mon.a (mon.0) 240 : cluster 1 Cluster is now healthy 2024-05-20T21:58:37.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:37 smithi050 bash[21866]: cluster 2024-05-20T21:58:37.644764+0000 mon.a (mon.0) 241 : cluster 1 overall HEALTH_OK 2024-05-20T21:58:37.951 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:24.375982+0000 mon.a (mon.0) 147 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T21:58:37.951 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:24.376307+0000 mon.a (mon.0) 148 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:37.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:24.376504+0000 mon.a (mon.0) 149 : cluster 1 mon.a calling monitor election 2024-05-20T21:58:37.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:25.367655+0000 mon.a (mon.0) 150 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:37.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:25.413940+0000 mgr.y (mgr.14150) 51 : cluster 0 pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:37.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:26.367327+0000 mon.a (mon.0) 151 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:37.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:26.369136+0000 mon.b (mon.1) 1 : cluster 1 mon.b calling monitor election 2024-05-20T21:58:37.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:27.367559+0000 mon.a (mon.0) 152 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:37.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:27.414182+0000 mgr.y (mgr.14150) 52 : cluster 0 pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:37.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:28.368004+0000 mon.a (mon.0) 153 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:37.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:28.571437+0000 mon.a (mon.0) 154 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:37.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:29.368259+0000 mon.a (mon.0) 155 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:37.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:29.418792+0000 mon.a (mon.0) 156 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-05-20T21:58:37.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:29.427179+0000 mon.a (mon.0) 157 : cluster 0 monmap epoch 2 2024-05-20T21:58:37.952 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:29.427211+0000 mon.a (mon.0) 158 : cluster 0 fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:58:37.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:29.427229+0000 mon.a (mon.0) 159 : cluster 0 last_changed 2024-05-20T21:58:24.371457+0000 2024-05-20T21:58:37.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:29.427248+0000 mon.a (mon.0) 160 : cluster 0 created 2024-05-20T21:56:15.715764+0000 2024-05-20T21:58:37.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:29.427263+0000 mon.a (mon.0) 161 : cluster 0 min_mon_release 19 (squid) 2024-05-20T21:58:37.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:29.427279+0000 mon.a (mon.0) 162 : cluster 0 election_strategy: 1 2024-05-20T21:58:37.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:29.427294+0000 mon.a (mon.0) 163 : cluster 0 0: v1:172.21.15.50:6789/0 mon.a 2024-05-20T21:58:37.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:29.427310+0000 mon.a (mon.0) 164 : cluster 0 1: v1:172.21.15.145:6789/0 mon.b 2024-05-20T21:58:37.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:29.444744+0000 mon.a (mon.0) 165 : cluster 0 fsmap 2024-05-20T21:58:37.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:29.444795+0000 mon.a (mon.0) 166 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-05-20T21:58:37.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:29.445050+0000 mon.a (mon.0) 167 : cluster 0 mgrmap e13: y(active, since 72s) 2024-05-20T21:58:37.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:29.445292+0000 mon.a (mon.0) 168 : cluster 1 overall HEALTH_OK 2024-05-20T21:58:37.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:29.451476+0000 mon.a (mon.0) 169 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:37.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:29.458119+0000 mon.a (mon.0) 170 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:37.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:29.465485+0000 mon.a (mon.0) 171 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:37.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:29.471906+0000 mon.a (mon.0) 172 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:37.953 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:29.414524+0000 mgr.y (mgr.14150) 53 : cluster 0 pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:37.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:29.533502+0000 mon.a (mon.0) 173 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:58:37.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:29.571774+0000 mon.a (mon.0) 174 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:37.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:30.368296+0000 mon.a (mon.0) 175 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:37.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:30.577564+0000 mon.a (mon.0) 177 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T21:58:37.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:30.577798+0000 mon.b (mon.1) 2 : cluster 1 mon.b calling monitor election 2024-05-20T21:58:37.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:30.578024+0000 mon.a (mon.0) 178 : cluster 1 mon.a calling monitor election 2024-05-20T21:58:37.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:30.597231+0000 mon.a (mon.0) 179 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T21:58:37.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:30.597589+0000 mon.a (mon.0) 180 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:37.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:31.414926+0000 mgr.y (mgr.14150) 54 : cluster 0 pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:37.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:31.572423+0000 mon.a (mon.0) 181 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:37.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:32.572208+0000 mon.a (mon.0) 182 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:37.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:33.415329+0000 mgr.y (mgr.14150) 55 : cluster 0 pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:37.954 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:33.572618+0000 mon.a (mon.0) 183 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:37.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:34.572197+0000 mon.a (mon.0) 184 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:37.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:35.572976+0000 mon.a (mon.0) 185 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:37.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:35.597359+0000 mon.a (mon.0) 186 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-05-20T21:58:37.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:35.603455+0000 mon.a (mon.0) 187 : cluster 0 monmap epoch 3 2024-05-20T21:58:37.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:35.603503+0000 mon.a (mon.0) 188 : cluster 0 fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:58:37.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:35.603539+0000 mon.a (mon.0) 189 : cluster 0 last_changed 2024-05-20T21:58:30.572995+0000 2024-05-20T21:58:37.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:35.603572+0000 mon.a (mon.0) 190 : cluster 0 created 2024-05-20T21:56:15.715764+0000 2024-05-20T21:58:37.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:35.603605+0000 mon.a (mon.0) 191 : cluster 0 min_mon_release 19 (squid) 2024-05-20T21:58:37.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:35.603644+0000 mon.a (mon.0) 192 : cluster 0 election_strategy: 1 2024-05-20T21:58:37.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:35.603678+0000 mon.a (mon.0) 193 : cluster 0 0: v1:172.21.15.50:6789/0 mon.a 2024-05-20T21:58:37.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:35.603709+0000 mon.a (mon.0) 194 : cluster 0 1: v1:172.21.15.145:6789/0 mon.b 2024-05-20T21:58:37.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:35.603740+0000 mon.a (mon.0) 195 : cluster 0 2: v1:172.21.15.50:6790/0 mon.c 2024-05-20T21:58:37.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:35.624865+0000 mon.a (mon.0) 196 : cluster 0 fsmap 2024-05-20T21:58:37.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:35.624945+0000 mon.a (mon.0) 197 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-05-20T21:58:37.955 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:35.625272+0000 mon.a (mon.0) 198 : cluster 0 mgrmap e13: y(active, since 78s) 2024-05-20T21:58:37.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:35.625682+0000 mon.a (mon.0) 199 : cluster 3 Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-05-20T21:58:37.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:35.633911+0000 mon.a (mon.0) 200 : cluster 3 Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2024-05-20T21:58:37.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:35.633960+0000 mon.a (mon.0) 201 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-05-20T21:58:37.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:35.633980+0000 mon.a (mon.0) 202 : cluster 3 mon.c (rank 2) addr v1:172.21.15.50:6790/0 is down (out of quorum) 2024-05-20T21:58:37.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:35.639016+0000 mon.a (mon.0) 203 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:37.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:35.644452+0000 mon.a (mon.0) 204 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:37.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:35.650557+0000 mon.a (mon.0) 205 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:37.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:35.656661+0000 mon.a (mon.0) 206 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:37.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:35.415822+0000 mgr.y (mgr.14150) 56 : cluster 0 pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:37.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:35.680228+0000 mon.a (mon.0) 207 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:37.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:35.949534+0000 mon.a (mon.0) 208 : audit 0 from='client.? v1:172.21.15.145:0/3941132465' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-20T21:58:37.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:36.338190+0000 mon.a (mon.0) 209 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:37.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:36.339813+0000 mon.a (mon.0) 210 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:58:37.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:36.572470+0000 mon.a (mon.0) 211 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:37.956 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:36.636454+0000 mon.a (mon.0) 212 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:37.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:36.642399+0000 mon.a (mon.0) 213 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:37.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:36.650460+0000 mon.a (mon.0) 214 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:37.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:36.655573+0000 mon.a (mon.0) 215 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:37.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: audit 2024-05-20T21:58:36.660997+0000 mon.a (mon.0) 216 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:37.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:32.573955+0000 mon.c (mon.2) 1 : cluster 1 mon.c calling monitor election 2024-05-20T21:58:37.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:37.608743+0000 mon.c (mon.2) 2 : cluster 1 mon.c calling monitor election 2024-05-20T21:58:37.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:37.609209+0000 mon.b (mon.1) 3 : cluster 1 mon.b calling monitor election 2024-05-20T21:58:37.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:37.609446+0000 mon.a (mon.0) 225 : cluster 1 mon.a calling monitor election 2024-05-20T21:58:37.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:37.631700+0000 mon.a (mon.0) 226 : cluster 1 mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-05-20T21:58:37.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:37.637564+0000 mon.a (mon.0) 227 : cluster 0 monmap epoch 3 2024-05-20T21:58:37.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:37.637593+0000 mon.a (mon.0) 228 : cluster 0 fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:58:37.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:37.637611+0000 mon.a (mon.0) 229 : cluster 0 last_changed 2024-05-20T21:58:30.572995+0000 2024-05-20T21:58:37.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:37.637628+0000 mon.a (mon.0) 230 : cluster 0 created 2024-05-20T21:56:15.715764+0000 2024-05-20T21:58:37.957 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:37.637654+0000 mon.a (mon.0) 231 : cluster 0 min_mon_release 19 (squid) 2024-05-20T21:58:37.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:37.637673+0000 mon.a (mon.0) 232 : cluster 0 election_strategy: 1 2024-05-20T21:58:37.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:37.637688+0000 mon.a (mon.0) 233 : cluster 0 0: v1:172.21.15.50:6789/0 mon.a 2024-05-20T21:58:37.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:37.637714+0000 mon.a (mon.0) 234 : cluster 0 1: v1:172.21.15.145:6789/0 mon.b 2024-05-20T21:58:37.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:37.637732+0000 mon.a (mon.0) 235 : cluster 0 2: v1:172.21.15.50:6790/0 mon.c 2024-05-20T21:58:37.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:37.638751+0000 mon.a (mon.0) 236 : cluster 0 fsmap 2024-05-20T21:58:37.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:37.638801+0000 mon.a (mon.0) 237 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-05-20T21:58:37.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:37.639076+0000 mon.a (mon.0) 238 : cluster 0 mgrmap e13: y(active, since 80s) 2024-05-20T21:58:37.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:37.639364+0000 mon.a (mon.0) 239 : cluster 1 Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-05-20T21:58:37.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:37.639396+0000 mon.a (mon.0) 240 : cluster 1 Cluster is now healthy 2024-05-20T21:58:37.958 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:37 smithi050 bash[28929]: cluster 2024-05-20T21:58:37.644764+0000 mon.a (mon.0) 241 : cluster 1 overall HEALTH_OK 2024-05-20T21:58:38.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:37 smithi145 bash[23893]: cluster 2024-05-20T21:58:32.573955+0000 mon.c (mon.2) 1 : cluster 1 mon.c calling monitor election 2024-05-20T21:58:38.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:37 smithi145 bash[23893]: cluster 2024-05-20T21:58:37.608743+0000 mon.c (mon.2) 2 : cluster 1 mon.c calling monitor election 2024-05-20T21:58:38.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:37 smithi145 bash[23893]: cluster 2024-05-20T21:58:37.609209+0000 mon.b (mon.1) 3 : cluster 1 mon.b calling monitor election 2024-05-20T21:58:38.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:37 smithi145 bash[23893]: cluster 2024-05-20T21:58:37.609446+0000 mon.a (mon.0) 225 : cluster 1 mon.a calling monitor election 2024-05-20T21:58:38.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:37 smithi145 bash[23893]: cluster 2024-05-20T21:58:37.631700+0000 mon.a (mon.0) 226 : cluster 1 mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-05-20T21:58:38.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:37 smithi145 bash[23893]: cluster 2024-05-20T21:58:37.637564+0000 mon.a (mon.0) 227 : cluster 0 monmap epoch 3 2024-05-20T21:58:38.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:37 smithi145 bash[23893]: cluster 2024-05-20T21:58:37.637593+0000 mon.a (mon.0) 228 : cluster 0 fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:58:38.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:37 smithi145 bash[23893]: cluster 2024-05-20T21:58:37.637611+0000 mon.a (mon.0) 229 : cluster 0 last_changed 2024-05-20T21:58:30.572995+0000 2024-05-20T21:58:38.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:37 smithi145 bash[23893]: cluster 2024-05-20T21:58:37.637628+0000 mon.a (mon.0) 230 : cluster 0 created 2024-05-20T21:56:15.715764+0000 2024-05-20T21:58:38.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:37 smithi145 bash[23893]: cluster 2024-05-20T21:58:37.637654+0000 mon.a (mon.0) 231 : cluster 0 min_mon_release 19 (squid) 2024-05-20T21:58:38.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:37 smithi145 bash[23893]: cluster 2024-05-20T21:58:37.637673+0000 mon.a (mon.0) 232 : cluster 0 election_strategy: 1 2024-05-20T21:58:38.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:37 smithi145 bash[23893]: cluster 2024-05-20T21:58:37.637688+0000 mon.a (mon.0) 233 : cluster 0 0: v1:172.21.15.50:6789/0 mon.a 2024-05-20T21:58:38.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:37 smithi145 bash[23893]: cluster 2024-05-20T21:58:37.637714+0000 mon.a (mon.0) 234 : cluster 0 1: v1:172.21.15.145:6789/0 mon.b 2024-05-20T21:58:38.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:37 smithi145 bash[23893]: cluster 2024-05-20T21:58:37.637732+0000 mon.a (mon.0) 235 : cluster 0 2: v1:172.21.15.50:6790/0 mon.c 2024-05-20T21:58:38.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:37 smithi145 bash[23893]: cluster 2024-05-20T21:58:37.638751+0000 mon.a (mon.0) 236 : cluster 0 fsmap 2024-05-20T21:58:38.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:37 smithi145 bash[23893]: cluster 2024-05-20T21:58:37.638801+0000 mon.a (mon.0) 237 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-05-20T21:58:38.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:37 smithi145 bash[23893]: cluster 2024-05-20T21:58:37.639076+0000 mon.a (mon.0) 238 : cluster 0 mgrmap e13: y(active, since 80s) 2024-05-20T21:58:38.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:37 smithi145 bash[23893]: cluster 2024-05-20T21:58:37.639364+0000 mon.a (mon.0) 239 : cluster 1 Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-05-20T21:58:38.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:37 smithi145 bash[23893]: cluster 2024-05-20T21:58:37.639396+0000 mon.a (mon.0) 240 : cluster 1 Cluster is now healthy 2024-05-20T21:58:38.146 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:37 smithi145 bash[23893]: cluster 2024-05-20T21:58:37.644764+0000 mon.a (mon.0) 241 : cluster 1 overall HEALTH_OK 2024-05-20T21:58:39.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:38 smithi145 bash[23893]: cluster 2024-05-20T21:58:37.416299+0000 mgr.y (mgr.14150) 63 : cluster 0 pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:39.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:38 smithi145 bash[23893]: audit 2024-05-20T21:58:38.573313+0000 mon.a (mon.0) 242 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:39.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:38 smithi050 bash[21866]: cluster 2024-05-20T21:58:37.416299+0000 mgr.y (mgr.14150) 63 : cluster 0 pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:39.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:38 smithi050 bash[21866]: audit 2024-05-20T21:58:38.573313+0000 mon.a (mon.0) 242 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:39.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:38 smithi050 bash[28929]: cluster 2024-05-20T21:58:37.416299+0000 mgr.y (mgr.14150) 63 : cluster 0 pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:39.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:38 smithi050 bash[28929]: audit 2024-05-20T21:58:38.573313+0000 mon.a (mon.0) 242 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T21:58:40.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:39 smithi050 bash[21866]: audit 2024-05-20T21:58:38.925760+0000 mon.a (mon.0) 243 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:40.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:39 smithi050 bash[21866]: audit 2024-05-20T21:58:38.931937+0000 mon.a (mon.0) 244 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:40.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:39 smithi050 bash[21866]: cephadm 2024-05-20T21:58:38.933138+0000 mgr.y (mgr.14150) 64 : cephadm 1 Reconfiguring mon.c (monmap changed)... 2024-05-20T21:58:40.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:39 smithi050 bash[21866]: audit 2024-05-20T21:58:38.933437+0000 mon.a (mon.0) 245 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T21:58:40.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:39 smithi050 bash[21866]: audit 2024-05-20T21:58:38.934404+0000 mon.a (mon.0) 246 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T21:58:40.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:39 smithi050 bash[21866]: audit 2024-05-20T21:58:38.935299+0000 mon.a (mon.0) 247 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:40.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:39 smithi050 bash[21866]: cephadm 2024-05-20T21:58:38.936445+0000 mgr.y (mgr.14150) 65 : cephadm 1 Reconfiguring daemon mon.c on smithi050 2024-05-20T21:58:40.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:39 smithi050 bash[28929]: audit 2024-05-20T21:58:38.925760+0000 mon.a (mon.0) 243 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:40.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:39 smithi050 bash[28929]: audit 2024-05-20T21:58:38.931937+0000 mon.a (mon.0) 244 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:40.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:39 smithi050 bash[28929]: cephadm 2024-05-20T21:58:38.933138+0000 mgr.y (mgr.14150) 64 : cephadm 1 Reconfiguring mon.c (monmap changed)... 2024-05-20T21:58:40.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:39 smithi050 bash[28929]: audit 2024-05-20T21:58:38.933437+0000 mon.a (mon.0) 245 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T21:58:40.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:39 smithi050 bash[28929]: audit 2024-05-20T21:58:38.934404+0000 mon.a (mon.0) 246 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T21:58:40.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:39 smithi050 bash[28929]: audit 2024-05-20T21:58:38.935299+0000 mon.a (mon.0) 247 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:40.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:39 smithi050 bash[28929]: cephadm 2024-05-20T21:58:38.936445+0000 mgr.y (mgr.14150) 65 : cephadm 1 Reconfiguring daemon mon.c on smithi050 2024-05-20T21:58:40.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:39 smithi145 bash[23893]: audit 2024-05-20T21:58:38.925760+0000 mon.a (mon.0) 243 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:40.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:39 smithi145 bash[23893]: audit 2024-05-20T21:58:38.931937+0000 mon.a (mon.0) 244 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:40.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:39 smithi145 bash[23893]: cephadm 2024-05-20T21:58:38.933138+0000 mgr.y (mgr.14150) 64 : cephadm 1 Reconfiguring mon.c (monmap changed)... 2024-05-20T21:58:40.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:39 smithi145 bash[23893]: audit 2024-05-20T21:58:38.933437+0000 mon.a (mon.0) 245 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T21:58:40.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:39 smithi145 bash[23893]: audit 2024-05-20T21:58:38.934404+0000 mon.a (mon.0) 246 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T21:58:40.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:39 smithi145 bash[23893]: audit 2024-05-20T21:58:38.935299+0000 mon.a (mon.0) 247 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:40.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:39 smithi145 bash[23893]: cephadm 2024-05-20T21:58:38.936445+0000 mgr.y (mgr.14150) 65 : cephadm 1 Reconfiguring daemon mon.c on smithi050 2024-05-20T21:58:41.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:40 smithi050 bash[21866]: cluster 2024-05-20T21:58:39.416688+0000 mgr.y (mgr.14150) 66 : cluster 0 pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:41.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:40 smithi050 bash[21866]: audit 2024-05-20T21:58:40.923731+0000 mon.a (mon.0) 248 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:41.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:40 smithi050 bash[21866]: audit 2024-05-20T21:58:40.930502+0000 mon.a (mon.0) 249 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:41.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:40 smithi050 bash[28929]: cluster 2024-05-20T21:58:39.416688+0000 mgr.y (mgr.14150) 66 : cluster 0 pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:41.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:40 smithi050 bash[28929]: audit 2024-05-20T21:58:40.923731+0000 mon.a (mon.0) 248 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:41.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:40 smithi050 bash[28929]: audit 2024-05-20T21:58:40.930502+0000 mon.a (mon.0) 249 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:41.376 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T21:58:41.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:40 smithi145 bash[23893]: cluster 2024-05-20T21:58:39.416688+0000 mgr.y (mgr.14150) 66 : cluster 0 pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:41.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:40 smithi145 bash[23893]: audit 2024-05-20T21:58:40.923731+0000 mon.a (mon.0) 248 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:41.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:40 smithi145 bash[23893]: audit 2024-05-20T21:58:40.930502+0000 mon.a (mon.0) 249 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:42.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:41 smithi050 bash[21866]: cephadm 2024-05-20T21:58:40.931653+0000 mgr.y (mgr.14150) 67 : cephadm 1 Reconfiguring mon.b (monmap changed)... 2024-05-20T21:58:42.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:41 smithi050 bash[21866]: audit 2024-05-20T21:58:40.932057+0000 mon.a (mon.0) 250 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T21:58:42.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:41 smithi050 bash[21866]: audit 2024-05-20T21:58:40.938204+0000 mon.a (mon.0) 251 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T21:58:42.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:41 smithi050 bash[21866]: audit 2024-05-20T21:58:40.939354+0000 mon.a (mon.0) 252 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:42.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:41 smithi050 bash[21866]: cephadm 2024-05-20T21:58:40.940691+0000 mgr.y (mgr.14150) 68 : cephadm 1 Reconfiguring daemon mon.b on smithi145 2024-05-20T21:58:42.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:41 smithi050 bash[28929]: cephadm 2024-05-20T21:58:40.931653+0000 mgr.y (mgr.14150) 67 : cephadm 1 Reconfiguring mon.b (monmap changed)... 2024-05-20T21:58:42.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:41 smithi050 bash[28929]: audit 2024-05-20T21:58:40.932057+0000 mon.a (mon.0) 250 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T21:58:42.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:41 smithi050 bash[28929]: audit 2024-05-20T21:58:40.938204+0000 mon.a (mon.0) 251 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T21:58:42.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:41 smithi050 bash[28929]: audit 2024-05-20T21:58:40.939354+0000 mon.a (mon.0) 252 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:42.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:41 smithi050 bash[28929]: cephadm 2024-05-20T21:58:40.940691+0000 mgr.y (mgr.14150) 68 : cephadm 1 Reconfiguring daemon mon.b on smithi145 2024-05-20T21:58:42.243 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:41 smithi145 bash[23893]: cephadm 2024-05-20T21:58:40.931653+0000 mgr.y (mgr.14150) 67 : cephadm 1 Reconfiguring mon.b (monmap changed)... 2024-05-20T21:58:42.244 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:41 smithi145 bash[23893]: audit 2024-05-20T21:58:40.932057+0000 mon.a (mon.0) 250 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T21:58:42.244 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:41 smithi145 bash[23893]: audit 2024-05-20T21:58:40.938204+0000 mon.a (mon.0) 251 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T21:58:42.244 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:41 smithi145 bash[23893]: audit 2024-05-20T21:58:40.939354+0000 mon.a (mon.0) 252 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:42.244 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:41 smithi145 bash[23893]: cephadm 2024-05-20T21:58:40.940691+0000 mgr.y (mgr.14150) 68 : cephadm 1 Reconfiguring daemon mon.b on smithi145 2024-05-20T21:58:43.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:42 smithi050 bash[21866]: cluster 2024-05-20T21:58:41.417058+0000 mgr.y (mgr.14150) 69 : cluster 0 pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:43.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:42 smithi050 bash[21866]: audit 2024-05-20T21:58:42.796420+0000 mon.a (mon.0) 253 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:43.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:42 smithi050 bash[21866]: audit 2024-05-20T21:58:42.803415+0000 mon.a (mon.0) 254 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:43.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:42 smithi050 bash[21866]: audit 2024-05-20T21:58:42.805854+0000 mon.a (mon.0) 255 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:58:43.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:42 smithi050 bash[21866]: audit 2024-05-20T21:58:42.809154+0000 mon.a (mon.0) 256 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:43.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:42 smithi050 bash[21866]: audit 2024-05-20T21:58:42.810745+0000 mon.a (mon.0) 257 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:58:43.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:42 smithi050 bash[21866]: audit 2024-05-20T21:58:42.819925+0000 mon.a (mon.0) 258 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:43.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:42 smithi050 bash[28929]: cluster 2024-05-20T21:58:41.417058+0000 mgr.y (mgr.14150) 69 : cluster 0 pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:43.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:42 smithi050 bash[28929]: audit 2024-05-20T21:58:42.796420+0000 mon.a (mon.0) 253 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:43.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:42 smithi050 bash[28929]: audit 2024-05-20T21:58:42.803415+0000 mon.a (mon.0) 254 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:43.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:42 smithi050 bash[28929]: audit 2024-05-20T21:58:42.805854+0000 mon.a (mon.0) 255 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:58:43.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:42 smithi050 bash[28929]: audit 2024-05-20T21:58:42.809154+0000 mon.a (mon.0) 256 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:43.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:42 smithi050 bash[28929]: audit 2024-05-20T21:58:42.810745+0000 mon.a (mon.0) 257 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:58:43.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:42 smithi050 bash[28929]: audit 2024-05-20T21:58:42.819925+0000 mon.a (mon.0) 258 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:43.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:42 smithi145 bash[23893]: cluster 2024-05-20T21:58:41.417058+0000 mgr.y (mgr.14150) 69 : cluster 0 pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:43.395 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:42 smithi145 bash[23893]: audit 2024-05-20T21:58:42.796420+0000 mon.a (mon.0) 253 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:43.395 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:42 smithi145 bash[23893]: audit 2024-05-20T21:58:42.803415+0000 mon.a (mon.0) 254 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:43.395 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:42 smithi145 bash[23893]: audit 2024-05-20T21:58:42.805854+0000 mon.a (mon.0) 255 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:58:43.395 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:42 smithi145 bash[23893]: audit 2024-05-20T21:58:42.809154+0000 mon.a (mon.0) 256 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:43.395 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:42 smithi145 bash[23893]: audit 2024-05-20T21:58:42.810745+0000 mon.a (mon.0) 257 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:58:43.395 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:42 smithi145 bash[23893]: audit 2024-05-20T21:58:42.819925+0000 mon.a (mon.0) 258 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.841+0000 7ffa36aa4640 1 -- 172.21.15.50:0/402059452 >> v1:172.21.15.50:6790/0 conn(0x7ffa3010d010 legacy=0x7ffa3010f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.841+0000 7ffa36aa4640 1 -- 172.21.15.50:0/402059452 shutdown_connections 2024-05-20T21:58:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.841+0000 7ffa36aa4640 1 -- 172.21.15.50:0/402059452 >> 172.21.15.50:0/402059452 conn(0x7ffa300fc080 msgr2=0x7ffa300fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:58:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.841+0000 7ffa36aa4640 1 -- 172.21.15.50:0/402059452 shutdown_connections 2024-05-20T21:58:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.841+0000 7ffa36aa4640 1 -- 172.21.15.50:0/402059452 wait complete. 2024-05-20T21:58:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.841+0000 7ffa36aa4640 1 Processor -- start 2024-05-20T21:58:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.841+0000 7ffa36aa4640 1 -- start start 2024-05-20T21:58:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.841+0000 7ffa36aa4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ffa301a5600 con 0x7ffa30109410 2024-05-20T21:58:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.841+0000 7ffa36aa4640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ffa301a6840 con 0x7ffa3010d010 2024-05-20T21:58:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.841+0000 7ffa36aa4640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ffa301a7a80 con 0x7ffa30106660 2024-05-20T21:58:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.841+0000 7ffa34840640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7ffa30106660 0x7ffa301059e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:58586/0 (socket says 172.21.15.50:58586) 2024-05-20T21:58:43.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.841+0000 7ffa34840640 1 -- 172.21.15.50:0/507636284 learned_addr learned my addr 172.21.15.50:0/507636284 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:58:43.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1382858550 0 0) 0x7ffa301a5600 con 0x7ffa30109410 2024-05-20T21:58:43.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa20003160 con 0x7ffa30109410 2024-05-20T21:58:43.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1644684507 0 0) 0x7ffa301a7a80 con 0x7ffa30106660 2024-05-20T21:58:43.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa301a5600 con 0x7ffa30106660 2024-05-20T21:58:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 551541964 0 0) 0x7ffa20003160 con 0x7ffa30109410 2024-05-20T21:58:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffa301a7a80 con 0x7ffa30109410 2024-05-20T21:58:43.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7ffa1c001830 con 0x7ffa30109410 2024-05-20T21:58:43.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1985016701 0 0) 0x7ffa301a5600 con 0x7ffa30106660 2024-05-20T21:58:43.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffa20003160 con 0x7ffa30106660 2024-05-20T21:58:43.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3941098468 0 0) 0x7ffa301a6840 con 0x7ffa3010d010 2024-05-20T21:58:43.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa301a5600 con 0x7ffa3010d010 2024-05-20T21:58:43.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7ffa24001890 con 0x7ffa30106660 2024-05-20T21:58:43.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 650655305 0 0) 0x7ffa301a7a80 con 0x7ffa30109410 2024-05-20T21:58:43.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 >> v1:172.21.15.50:6790/0 conn(0x7ffa30106660 legacy=0x7ffa301059e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:43.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 >> v1:172.21.15.145:6789/0 conn(0x7ffa3010d010 legacy=0x7ffa301a3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:43.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa301a8cc0 con 0x7ffa30109410 2024-05-20T21:58:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa36aa4640 1 -- 172.21.15.50:0/507636284 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffa301a7cb0 con 0x7ffa30109410 2024-05-20T21:58:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa36aa4640 1 -- 172.21.15.50:0/507636284 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ffa301a8170 con 0x7ffa30109410 2024-05-20T21:58:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7ffa1c003a80 con 0x7ffa30109410 2024-05-20T21:58:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7ffa1c004980 con 0x7ffa30109410 2024-05-20T21:58:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa36aa4640 1 -- 172.21.15.50:0/507636284 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa14005080 con 0x7ffa30109410 2024-05-20T21:58:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 13) ==== 46308+0+0 (unknown 209257320 0 0) 0x7ffa1c010140 con 0x7ffa30109410 2024-05-20T21:58:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.845+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (unknown 2781634937 0 0) 0x7ffa1c0465e0 con 0x7ffa30109410 2024-05-20T21:58:43.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:43.849+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7ffa1c0161d0 con 0x7ffa30109410 2024-05-20T21:58:44.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:44.041+0000 7ffa36aa4640 1 -- 172.21.15.50:0/507636284 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7ffa14005370 con 0x7ffa30109410 2024-05-20T21:58:44.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:44.041+0000 7ffa2dffb640 1 -- 172.21.15.50:0/507636284 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+191 (unknown 2189217731 0 2577512355) 0x7ffa1c015ad0 con 0x7ffa30109410 2024-05-20T21:58:44.046 INFO:teuthology.orchestra.run.smithi050.stdout:# minimal ceph.conf for 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:58:44.046 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2024-05-20T21:58:44.046 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T21:58:44.046 INFO:teuthology.orchestra.run.smithi050.stdout: mon_host = 172.21.15.50:6789/0 172.21.15.145:6789/0 v1:172.21.15.50:6790/0 2024-05-20T21:58:44.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:44.045+0000 7ffa36aa4640 1 -- 172.21.15.50:0/507636284 >> v1:172.21.15.50:6800/2944911247 conn(0x7ffa2003a330 legacy=0x7ffa2003c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:44.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:44.045+0000 7ffa36aa4640 1 -- 172.21.15.50:0/507636284 >> v1:172.21.15.50:6789/0 conn(0x7ffa30109410 legacy=0x7ffa301a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:44.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:44.045+0000 7ffa36aa4640 1 -- 172.21.15.50:0/507636284 shutdown_connections 2024-05-20T21:58:44.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:44.045+0000 7ffa36aa4640 1 -- 172.21.15.50:0/507636284 >> 172.21.15.50:0/507636284 conn(0x7ffa300fc080 msgr2=0x7ffa3010fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:58:44.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:44.045+0000 7ffa36aa4640 1 -- 172.21.15.50:0/507636284 shutdown_connections 2024-05-20T21:58:44.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:58:44.045+0000 7ffa36aa4640 1 -- 172.21.15.50:0/507636284 wait complete. 2024-05-20T21:58:44.788 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-20T21:58:44.788 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-20T21:58:44.788 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.conf 2024-05-20T21:58:44.803 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-20T21:58:44.803 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-20T21:58:44.863 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-05-20T21:58:44.863 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.conf 2024-05-20T21:58:44.879 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-05-20T21:58:44.879 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-20T21:58:44.940 INFO:tasks.cephadm:Adding mgr.y on smithi050 2024-05-20T21:58:44.940 INFO:tasks.cephadm:Adding mgr.x on smithi145 2024-05-20T21:58:44.941 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph orch apply mgr '2;smithi050=y;smithi145=x' 2024-05-20T21:58:45.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:44 smithi145 bash[23893]: cluster 2024-05-20T21:58:43.417492+0000 mgr.y (mgr.14150) 70 : cluster 0 pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:45.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:44 smithi145 bash[23893]: audit 2024-05-20T21:58:44.047130+0000 mon.a (mon.0) 259 : audit 0 from='client.? v1:172.21.15.50:0/507636284' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:45.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:44 smithi050 bash[21866]: cluster 2024-05-20T21:58:43.417492+0000 mgr.y (mgr.14150) 70 : cluster 0 pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:45.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:44 smithi050 bash[21866]: audit 2024-05-20T21:58:44.047130+0000 mon.a (mon.0) 259 : audit 0 from='client.? v1:172.21.15.50:0/507636284' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:45.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:44 smithi050 bash[28929]: cluster 2024-05-20T21:58:43.417492+0000 mgr.y (mgr.14150) 70 : cluster 0 pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:45.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:44 smithi050 bash[28929]: audit 2024-05-20T21:58:44.047130+0000 mon.a (mon.0) 259 : audit 0 from='client.? v1:172.21.15.50:0/507636284' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:47.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:46 smithi145 bash[23893]: cluster 2024-05-20T21:58:45.417937+0000 mgr.y (mgr.14150) 71 : cluster 0 pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:47.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:46 smithi050 bash[21866]: cluster 2024-05-20T21:58:45.417937+0000 mgr.y (mgr.14150) 71 : cluster 0 pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:47.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:46 smithi050 bash[28929]: cluster 2024-05-20T21:58:45.417937+0000 mgr.y (mgr.14150) 71 : cluster 0 pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:48.685 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T21:58:49.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:48 smithi145 bash[23893]: cluster 2024-05-20T21:58:47.418448+0000 mgr.y (mgr.14150) 72 : cluster 0 pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:49.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:48 smithi050 bash[21866]: cluster 2024-05-20T21:58:47.418448+0000 mgr.y (mgr.14150) 72 : cluster 0 pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:49.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:48 smithi050 bash[28929]: cluster 2024-05-20T21:58:47.418448+0000 mgr.y (mgr.14150) 72 : cluster 0 pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:50.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.857+0000 7f46ca68d640 1 -- 172.21.15.145:0/1751005647 >> v1:172.21.15.145:6789/0 conn(0x7f46c4074440 legacy=0x7f46c410a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:50.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.857+0000 7f46ca68d640 1 -- 172.21.15.145:0/1751005647 shutdown_connections 2024-05-20T21:58:50.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.857+0000 7f46ca68d640 1 -- 172.21.15.145:0/1751005647 >> 172.21.15.145:0/1751005647 conn(0x7f46c40fccb0 msgr2=0x7f46c40ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:58:50.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.857+0000 7f46ca68d640 1 -- 172.21.15.145:0/1751005647 shutdown_connections 2024-05-20T21:58:50.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46ca68d640 1 -- 172.21.15.145:0/1751005647 wait complete. 2024-05-20T21:58:50.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46ca68d640 1 Processor -- start 2024-05-20T21:58:50.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46ca68d640 1 -- start start 2024-05-20T21:58:50.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46ca68d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f46c4199990 con 0x7f46c4074440 2024-05-20T21:58:50.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46ca68d640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f46c41a51e0 con 0x7f46c40757e0 2024-05-20T21:58:50.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46ca68d640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f46c41a63c0 con 0x7f46c410bcb0 2024-05-20T21:58:50.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46c37fe640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f46c40757e0 0x7f46c419f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:44206/0 (socket says 172.21.15.145:44206) 2024-05-20T21:58:50.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46c37fe640 1 -- 172.21.15.145:0/1669712274 learned_addr learned my addr 172.21.15.145:0/1669712274 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-05-20T21:58:50.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46c17fa640 1 -- 172.21.15.145:0/1669712274 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1901098613 0 0) 0x7f46c41a51e0 con 0x7f46c40757e0 2024-05-20T21:58:50.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46c17fa640 1 -- 172.21.15.145:0/1669712274 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46b0003520 con 0x7f46c40757e0 2024-05-20T21:58:50.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46c17fa640 1 -- 172.21.15.145:0/1669712274 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2276240903 0 0) 0x7f46b0003520 con 0x7f46c40757e0 2024-05-20T21:58:50.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46c17fa640 1 -- 172.21.15.145:0/1669712274 --> v1:172.21.15.145:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46c41a51e0 con 0x7f46c40757e0 2024-05-20T21:58:50.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46c17fa640 1 -- 172.21.15.145:0/1669712274 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f46b4001430 con 0x7f46c40757e0 2024-05-20T21:58:50.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46c17fa640 1 -- 172.21.15.145:0/1669712274 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3695332763 0 0) 0x7f46c4199990 con 0x7f46c4074440 2024-05-20T21:58:50.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46c17fa640 1 -- 172.21.15.145:0/1669712274 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46b0003520 con 0x7f46c4074440 2024-05-20T21:58:50.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46c17fa640 1 -- 172.21.15.145:0/1669712274 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 193544477 0 0) 0x7f46c41a63c0 con 0x7f46c410bcb0 2024-05-20T21:58:50.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46c17fa640 1 -- 172.21.15.145:0/1669712274 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46c4199990 con 0x7f46c410bcb0 2024-05-20T21:58:50.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46c17fa640 1 -- 172.21.15.145:0/1669712274 <== mon.1 v1:172.21.15.145:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3375419314 0 0) 0x7f46c41a51e0 con 0x7f46c40757e0 2024-05-20T21:58:50.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46c17fa640 1 -- 172.21.15.145:0/1669712274 >> v1:172.21.15.50:6790/0 conn(0x7f46c410bcb0 legacy=0x7f46c41a2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:50.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46c17fa640 1 -- 172.21.15.145:0/1669712274 >> v1:172.21.15.50:6789/0 conn(0x7f46c4074440 legacy=0x7f46c4198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:50.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46c17fa640 1 -- 172.21.15.145:0/1669712274 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c41a75a0 con 0x7f46c40757e0 2024-05-20T21:58:50.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46ca68d640 1 -- 172.21.15.145:0/1669712274 --> v1:172.21.15.145:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f46c41a4230 con 0x7f46c40757e0 2024-05-20T21:58:50.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46ca68d640 1 -- 172.21.15.145:0/1669712274 --> v1:172.21.15.145:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f46c41a4770 con 0x7f46c40757e0 2024-05-20T21:58:50.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46c17fa640 1 -- 172.21.15.145:0/1669712274 <== mon.1 v1:172.21.15.145:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f46b4003690 con 0x7f46c40757e0 2024-05-20T21:58:50.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46c17fa640 1 -- 172.21.15.145:0/1669712274 <== mon.1 v1:172.21.15.145:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f46b4004f90 con 0x7f46c40757e0 2024-05-20T21:58:50.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46c17fa640 1 -- 172.21.15.145:0/1669712274 <== mon.1 v1:172.21.15.145:6789/0 7 ==== mgrmap(e 13) ==== 46308+0+0 (unknown 209257320 0 0) 0x7f46b40051d0 con 0x7f46c40757e0 2024-05-20T21:58:50.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46ca68d640 1 -- 172.21.15.145:0/1669712274 --> v1:172.21.15.145:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46a40050b0 con 0x7f46c40757e0 2024-05-20T21:58:50.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.861+0000 7f46c17fa640 1 -- 172.21.15.145:0/1669712274 <== mon.1 v1:172.21.15.145:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (unknown 2781634937 0 0) 0x7f46b4047ba0 con 0x7f46c40757e0 2024-05-20T21:58:50.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:50.869+0000 7f46c17fa640 1 -- 172.21.15.145:0/1669712274 <== mon.1 v1:172.21.15.145:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f46b40176f0 con 0x7f46c40757e0 2024-05-20T21:58:51.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:51.069+0000 7f46ca68d640 1 -- 172.21.15.145:0/1669712274 --> v1:172.21.15.50:6800/2944911247 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi050=y;smithi145=x", "target": ["mon-mgr", ""]}) -- 0x7f46a4000bc0 con 0x7f46b003a2f0 2024-05-20T21:58:51.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:51.081+0000 7f46c17fa640 1 -- 172.21.15.145:0/1669712274 <== mgr.14150 v1:172.21.15.50:6800/2944911247 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (unknown 0 0 325935098) 0x7f46a4000bc0 con 0x7f46b003a2f0 2024-05-20T21:58:51.087 INFO:teuthology.orchestra.run.smithi145.stdout:Scheduled mgr update... 2024-05-20T21:58:51.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:51.085+0000 7f46ca68d640 1 -- 172.21.15.145:0/1669712274 >> v1:172.21.15.50:6800/2944911247 conn(0x7f46b003a2f0 legacy=0x7f46b003c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:51.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:51.085+0000 7f46ca68d640 1 -- 172.21.15.145:0/1669712274 >> v1:172.21.15.145:6789/0 conn(0x7f46c40757e0 legacy=0x7f46c419f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:58:51.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:51.085+0000 7f46ca68d640 1 -- 172.21.15.145:0/1669712274 shutdown_connections 2024-05-20T21:58:51.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:51.085+0000 7f46ca68d640 1 -- 172.21.15.145:0/1669712274 >> 172.21.15.145:0/1669712274 conn(0x7f46c40fccb0 msgr2=0x7f46c40fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:58:51.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:51.085+0000 7f46ca68d640 1 -- 172.21.15.145:0/1669712274 shutdown_connections 2024-05-20T21:58:51.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T21:58:51.085+0000 7f46ca68d640 1 -- 172.21.15.145:0/1669712274 wait complete. 2024-05-20T21:58:51.099 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:50 smithi145 bash[23893]: cluster 2024-05-20T21:58:49.418889+0000 mgr.y (mgr.14150) 73 : cluster 0 pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:51.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:50 smithi050 bash[21866]: cluster 2024-05-20T21:58:49.418889+0000 mgr.y (mgr.14150) 73 : cluster 0 pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:51.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:50 smithi050 bash[28929]: cluster 2024-05-20T21:58:49.418889+0000 mgr.y (mgr.14150) 73 : cluster 0 pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:51.611 DEBUG:teuthology.orchestra.run.smithi145:mgr.x> sudo journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mgr.x.service 2024-05-20T21:58:51.613 INFO:tasks.cephadm:Deploying OSDs... 2024-05-20T21:58:51.613 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-20T21:58:51.613 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2024-05-20T21:58:51.620 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-20T21:58:51.620 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2024-05-20T21:58:51.667 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-20T21:58:51.667 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T21:58:51.668 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 872 Links: 1 2024-05-20T21:58:51.668 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T21:58:51.668 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-05-20 21:49:35.344583610 +0000 2024-05-20T21:58:51.668 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-05-20 21:49:35.072586026 +0000 2024-05-20T21:58:51.668 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-05-20 21:49:35.072586026 +0000 2024-05-20T21:58:51.668 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-05-20T21:58:51.668 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-20T21:58:51.722 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-05-20T21:58:51.723 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-05-20T21:58:51.723 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000256778 s, 2.0 MB/s 2024-05-20T21:58:51.724 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-20T21:58:51.773 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2024-05-20T21:58:51.819 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-20T21:58:51.819 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T21:58:51.819 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-05-20T21:58:51.819 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T21:58:51.819 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-05-20 21:49:35.816579417 +0000 2024-05-20T21:58:51.819 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-05-20 21:49:35.556581727 +0000 2024-05-20T21:58:51.820 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-05-20 21:49:35.556581727 +0000 2024-05-20T21:58:51.820 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-05-20T21:58:51.820 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-20T21:58:51.877 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-05-20T21:58:51.877 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-05-20T21:58:51.878 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000202084 s, 2.5 MB/s 2024-05-20T21:58:51.879 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-20T21:58:51.929 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2024-05-20T21:58:51.975 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-20T21:58:51.975 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T21:58:51.975 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-05-20T21:58:51.975 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T21:58:51.975 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-05-20 21:49:36.288575224 +0000 2024-05-20T21:58:51.975 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-05-20 21:49:36.044577391 +0000 2024-05-20T21:58:51.975 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-05-20 21:49:36.044577391 +0000 2024-05-20T21:58:51.975 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-05-20T21:58:51.976 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-20T21:58:52.029 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-05-20T21:58:52.029 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-05-20T21:58:52.030 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000303207 s, 1.7 MB/s 2024-05-20T21:58:52.031 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-20T21:58:52.081 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2024-05-20T21:58:52.127 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-20T21:58:52.128 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T21:58:52.128 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-05-20T21:58:52.128 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T21:58:52.128 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-05-20 21:49:36.804570639 +0000 2024-05-20T21:58:52.128 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-05-20 21:49:36.524573128 +0000 2024-05-20T21:58:52.128 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-05-20 21:49:36.524573128 +0000 2024-05-20T21:58:52.128 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-05-20T21:58:52.128 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-20T21:58:52.182 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-05-20T21:58:52.182 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-05-20T21:58:52.182 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.00031061 s, 1.6 MB/s 2024-05-20T21:58:52.183 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-20T21:58:52.233 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-05-20T21:58:52.233 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/scratch_devs of=/dev/stdout 2024-05-20T21:58:52.239 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-20T21:58:52.240 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_1 2024-05-20T21:58:52.288 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-20T21:58:52.288 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T21:58:52.289 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 873 Links: 1 2024-05-20T21:58:52.289 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T21:58:52.289 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-05-20 21:49:35.305952578 +0000 2024-05-20T21:58:52.289 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-05-20 21:49:35.057954791 +0000 2024-05-20T21:58:52.289 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-05-20 21:49:35.057954791 +0000 2024-05-20T21:58:52.289 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2024-05-20T21:58:52.289 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-20T21:58:52.342 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:52 smithi145 bash[23893]: audit 2024-05-20T21:58:51.077631+0000 mgr.y (mgr.14150) 74 : audit 0 from='client.24109 v1:172.21.15.145:0/1669712274' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi050=y;smithi145=x", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T21:58:52.342 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:52 smithi145 bash[23893]: cephadm 2024-05-20T21:58:51.080729+0000 mgr.y (mgr.14150) 75 : cephadm 1 Saving service mgr spec with placement smithi050=y;smithi145=x;count:2 2024-05-20T21:58:52.342 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:52 smithi145 bash[23893]: audit 2024-05-20T21:58:51.086835+0000 mon.a (mon.0) 260 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:52.342 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:52 smithi145 bash[23893]: audit 2024-05-20T21:58:51.088598+0000 mon.a (mon.0) 261 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:58:52.342 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:52 smithi145 bash[23893]: audit 2024-05-20T21:58:51.091879+0000 mon.a (mon.0) 262 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:52.342 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:52 smithi145 bash[23893]: audit 2024-05-20T21:58:51.093392+0000 mon.a (mon.0) 263 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:58:52.342 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:52 smithi145 bash[23893]: audit 2024-05-20T21:58:51.101840+0000 mon.a (mon.0) 264 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:52.342 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:52 smithi145 bash[23893]: audit 2024-05-20T21:58:51.104930+0000 mon.a (mon.0) 265 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T21:58:52.342 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:52 smithi145 bash[23893]: audit 2024-05-20T21:58:51.107358+0000 mon.a (mon.0) 266 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-20T21:58:52.343 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:52 smithi145 bash[23893]: audit 2024-05-20T21:58:51.112397+0000 mon.a (mon.0) 267 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T21:58:52.343 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:52 smithi145 bash[23893]: audit 2024-05-20T21:58:51.114228+0000 mon.a (mon.0) 268 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:52.343 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:52 smithi145 bash[23893]: cephadm 2024-05-20T21:58:51.116091+0000 mgr.y (mgr.14150) 76 : cephadm 1 Deploying daemon mgr.x on smithi145 2024-05-20T21:58:52.344 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-05-20T21:58:52.344 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-05-20T21:58:52.344 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000329468 s, 1.6 MB/s 2024-05-20T21:58:52.344 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-20T21:58:52.393 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_2 2024-05-20T21:58:52.443 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-20T21:58:52.443 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T21:58:52.443 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 898 Links: 1 2024-05-20T21:58:52.444 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T21:58:52.444 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-05-20 21:49:35.549950401 +0000 2024-05-20T21:58:52.444 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-05-20 21:49:35.545950437 +0000 2024-05-20T21:58:52.444 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-05-20 21:49:35.545950437 +0000 2024-05-20T21:58:52.444 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2024-05-20T21:58:52.444 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-20T21:58:52.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:52 smithi050 bash[21866]: audit 2024-05-20T21:58:51.077631+0000 mgr.y (mgr.14150) 74 : audit 0 from='client.24109 v1:172.21.15.145:0/1669712274' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi050=y;smithi145=x", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T21:58:52.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:52 smithi050 bash[21866]: cephadm 2024-05-20T21:58:51.080729+0000 mgr.y (mgr.14150) 75 : cephadm 1 Saving service mgr spec with placement smithi050=y;smithi145=x;count:2 2024-05-20T21:58:52.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:52 smithi050 bash[21866]: audit 2024-05-20T21:58:51.086835+0000 mon.a (mon.0) 260 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:52.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:52 smithi050 bash[21866]: audit 2024-05-20T21:58:51.088598+0000 mon.a (mon.0) 261 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:58:52.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:52 smithi050 bash[21866]: audit 2024-05-20T21:58:51.091879+0000 mon.a (mon.0) 262 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:52.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:52 smithi050 bash[21866]: audit 2024-05-20T21:58:51.093392+0000 mon.a (mon.0) 263 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:58:52.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:52 smithi050 bash[21866]: audit 2024-05-20T21:58:51.101840+0000 mon.a (mon.0) 264 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:52.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:52 smithi050 bash[21866]: audit 2024-05-20T21:58:51.104930+0000 mon.a (mon.0) 265 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T21:58:52.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:52 smithi050 bash[21866]: audit 2024-05-20T21:58:51.107358+0000 mon.a (mon.0) 266 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-20T21:58:52.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:52 smithi050 bash[21866]: audit 2024-05-20T21:58:51.112397+0000 mon.a (mon.0) 267 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T21:58:52.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:52 smithi050 bash[21866]: audit 2024-05-20T21:58:51.114228+0000 mon.a (mon.0) 268 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:52.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:52 smithi050 bash[21866]: cephadm 2024-05-20T21:58:51.116091+0000 mgr.y (mgr.14150) 76 : cephadm 1 Deploying daemon mgr.x on smithi145 2024-05-20T21:58:52.450 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:52 smithi050 bash[28929]: audit 2024-05-20T21:58:51.077631+0000 mgr.y (mgr.14150) 74 : audit 0 from='client.24109 v1:172.21.15.145:0/1669712274' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi050=y;smithi145=x", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T21:58:52.450 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:52 smithi050 bash[28929]: cephadm 2024-05-20T21:58:51.080729+0000 mgr.y (mgr.14150) 75 : cephadm 1 Saving service mgr spec with placement smithi050=y;smithi145=x;count:2 2024-05-20T21:58:52.450 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:52 smithi050 bash[28929]: audit 2024-05-20T21:58:51.086835+0000 mon.a (mon.0) 260 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:52.450 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:52 smithi050 bash[28929]: audit 2024-05-20T21:58:51.088598+0000 mon.a (mon.0) 261 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:58:52.450 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:52 smithi050 bash[28929]: audit 2024-05-20T21:58:51.091879+0000 mon.a (mon.0) 262 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:52.451 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:52 smithi050 bash[28929]: audit 2024-05-20T21:58:51.093392+0000 mon.a (mon.0) 263 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:58:52.451 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:52 smithi050 bash[28929]: audit 2024-05-20T21:58:51.101840+0000 mon.a (mon.0) 264 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:52.451 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:52 smithi050 bash[28929]: audit 2024-05-20T21:58:51.104930+0000 mon.a (mon.0) 265 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T21:58:52.451 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:52 smithi050 bash[28929]: audit 2024-05-20T21:58:51.107358+0000 mon.a (mon.0) 266 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-20T21:58:52.451 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:52 smithi050 bash[28929]: audit 2024-05-20T21:58:51.112397+0000 mon.a (mon.0) 267 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T21:58:52.451 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:52 smithi050 bash[28929]: audit 2024-05-20T21:58:51.114228+0000 mon.a (mon.0) 268 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:58:52.451 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:52 smithi050 bash[28929]: cephadm 2024-05-20T21:58:51.116091+0000 mgr.y (mgr.14150) 76 : cephadm 1 Deploying daemon mgr.x on smithi145 2024-05-20T21:58:52.496 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-05-20T21:58:52.496 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-05-20T21:58:52.497 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000293186 s, 1.7 MB/s 2024-05-20T21:58:52.498 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-20T21:58:52.544 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_3 2024-05-20T21:58:52.591 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-20T21:58:52.591 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T21:58:52.591 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-05-20T21:58:52.591 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T21:58:52.591 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-05-20 21:49:36.329943443 +0000 2024-05-20T21:58:52.592 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-05-20 21:49:36.041946012 +0000 2024-05-20T21:58:52.592 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-05-20 21:49:36.041946012 +0000 2024-05-20T21:58:52.592 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2024-05-20T21:58:52.592 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-20T21:58:52.644 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-05-20T21:58:52.644 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-05-20T21:58:52.644 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000277668 s, 1.8 MB/s 2024-05-20T21:58:52.645 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-20T21:58:52.693 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_4 2024-05-20T21:58:52.740 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-20T21:58:52.740 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T21:58:52.740 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-05-20T21:58:52.740 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T21:58:52.740 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-05-20 21:49:36.813939126 +0000 2024-05-20T21:58:52.740 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-05-20 21:49:36.557941408 +0000 2024-05-20T21:58:52.740 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-05-20 21:49:36.557941408 +0000 2024-05-20T21:58:52.741 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2024-05-20T21:58:52.741 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-20T21:58:52.793 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-05-20T21:58:52.794 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-05-20T21:58:52.794 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000265837 s, 1.9 MB/s 2024-05-20T21:58:52.795 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-20T21:58:52.845 INFO:tasks.cephadm:Deploying osd.0 on smithi050 with /dev/vg_nvme/lv_4... 2024-05-20T21:58:52.845 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-20T21:58:53.363 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:53 smithi145 bash[23893]: cluster 2024-05-20T21:58:51.419327+0000 mgr.y (mgr.14150) 77 : cluster 0 pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:53.363 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T21:58:53.364 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T21:58:53.364 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T21:58:53.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:53 smithi050 bash[21866]: cluster 2024-05-20T21:58:51.419327+0000 mgr.y (mgr.14150) 77 : cluster 0 pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:53.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:53 smithi050 bash[28929]: cluster 2024-05-20T21:58:51.419327+0000 mgr.y (mgr.14150) 77 : cluster 0 pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:53.634 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T21:58:53.635 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T21:58:53.635 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T21:58:53.635 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:53 smithi145 systemd[1]: Started Ceph mgr.x for 9a9abba0-16f3-11ef-bc9a-c7b262605968. 2024-05-20T21:58:54.636 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:54 smithi145 bash[24790]: debug 2024-05-20T21:58:54.497+0000 7fa9168da040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T21:58:54.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:54 smithi145 bash[23893]: cluster 2024-05-20T21:58:53.419739+0000 mgr.y (mgr.14150) 78 : cluster 0 pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:54.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:54 smithi145 bash[23893]: audit 2024-05-20T21:58:53.638222+0000 mon.a (mon.0) 269 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:54.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:54 smithi145 bash[23893]: audit 2024-05-20T21:58:53.645055+0000 mon.a (mon.0) 270 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:54.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:54 smithi145 bash[23893]: audit 2024-05-20T21:58:53.651920+0000 mon.a (mon.0) 271 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:54.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:54 smithi145 bash[23893]: audit 2024-05-20T21:58:53.658661+0000 mon.a (mon.0) 272 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:54.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:54 smithi145 bash[23893]: audit 2024-05-20T21:58:53.717441+0000 mon.a (mon.0) 273 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:58:54.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:54 smithi050 bash[21866]: cluster 2024-05-20T21:58:53.419739+0000 mgr.y (mgr.14150) 78 : cluster 0 pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:54.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:54 smithi050 bash[21866]: audit 2024-05-20T21:58:53.638222+0000 mon.a (mon.0) 269 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:54.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:54 smithi050 bash[21866]: audit 2024-05-20T21:58:53.645055+0000 mon.a (mon.0) 270 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:54.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:54 smithi050 bash[21866]: audit 2024-05-20T21:58:53.651920+0000 mon.a (mon.0) 271 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:54.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:54 smithi050 bash[21866]: audit 2024-05-20T21:58:53.658661+0000 mon.a (mon.0) 272 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:54.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:54 smithi050 bash[21866]: audit 2024-05-20T21:58:53.717441+0000 mon.a (mon.0) 273 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:58:54.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:54 smithi050 bash[28929]: cluster 2024-05-20T21:58:53.419739+0000 mgr.y (mgr.14150) 78 : cluster 0 pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:54.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:54 smithi050 bash[28929]: audit 2024-05-20T21:58:53.638222+0000 mon.a (mon.0) 269 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:54.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:54 smithi050 bash[28929]: audit 2024-05-20T21:58:53.645055+0000 mon.a (mon.0) 270 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:54.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:54 smithi050 bash[28929]: audit 2024-05-20T21:58:53.651920+0000 mon.a (mon.0) 271 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:54.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:54 smithi050 bash[28929]: audit 2024-05-20T21:58:53.658661+0000 mon.a (mon.0) 272 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:54.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:54 smithi050 bash[28929]: audit 2024-05-20T21:58:53.717441+0000 mon.a (mon.0) 273 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:58:56.144 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:55 smithi145 bash[24790]: debug 2024-05-20T21:58:55.721+0000 7fa9168da040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T21:58:56.144 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:55 smithi145 bash[24790]: debug 2024-05-20T21:58:55.785+0000 7fa9168da040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T21:58:56.144 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:55 smithi145 bash[24790]: debug 2024-05-20T21:58:55.941+0000 7fa9168da040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T21:58:56.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:56 smithi145 bash[23893]: cluster 2024-05-20T21:58:55.420155+0000 mgr.y (mgr.14150) 79 : cluster 0 pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:56.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:56 smithi145 bash[23893]: audit 2024-05-20T21:58:55.643932+0000 mon.a (mon.0) 274 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:56.894 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:56 smithi145 bash[24790]: debug 2024-05-20T21:58:56.601+0000 7fa9168da040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T21:58:56.894 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:56 smithi145 bash[24790]: debug 2024-05-20T21:58:56.677+0000 7fa9168da040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T21:58:56.895 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:56 smithi145 bash[24790]: debug 2024-05-20T21:58:56.749+0000 7fa9168da040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T21:58:56.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:56 smithi050 bash[21866]: cluster 2024-05-20T21:58:55.420155+0000 mgr.y (mgr.14150) 79 : cluster 0 pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:56.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:56 smithi050 bash[21866]: audit 2024-05-20T21:58:55.643932+0000 mon.a (mon.0) 274 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:56.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:56 smithi050 bash[28929]: cluster 2024-05-20T21:58:55.420155+0000 mgr.y (mgr.14150) 79 : cluster 0 pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:56.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:56 smithi050 bash[28929]: audit 2024-05-20T21:58:55.643932+0000 mon.a (mon.0) 274 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:58:57.351 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:56 smithi145 bash[24790]: debug 2024-05-20T21:58:56.937+0000 7fa9168da040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T21:58:57.352 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:57 smithi145 bash[24790]: debug 2024-05-20T21:58:57.017+0000 7fa9168da040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T21:58:57.352 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:57 smithi145 bash[24790]: debug 2024-05-20T21:58:57.085+0000 7fa9168da040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T21:58:57.352 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:57 smithi145 bash[24790]: debug 2024-05-20T21:58:57.345+0000 7fa9168da040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T21:58:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T21:58:57.620 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:57 smithi145 bash[24790]: debug 2024-05-20T21:58:57.417+0000 7fa9168da040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T21:58:57.894 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:57 smithi145 bash[24790]: debug 2024-05-20T21:58:57.617+0000 7fa9168da040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T21:58:57.894 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:57 smithi145 bash[24790]: debug 2024-05-20T21:58:57.697+0000 7fa9168da040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T21:58:58.305 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:57 smithi145 bash[24790]: debug 2024-05-20T21:58:57.953+0000 7fa9168da040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T21:58:58.305 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:58 smithi145 bash[24790]: debug 2024-05-20T21:58:58.133+0000 7fa9168da040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T21:58:58.569 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:58 smithi145 bash[24790]: debug 2024-05-20T21:58:58.301+0000 7fa9168da040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T21:58:58.569 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:58 smithi145 bash[24790]: debug 2024-05-20T21:58:58.381+0000 7fa9168da040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T21:58:58.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:58 smithi050 bash[21866]: cluster 2024-05-20T21:58:57.420624+0000 mgr.y (mgr.14150) 80 : cluster 0 pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:58.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:58 smithi050 bash[28929]: cluster 2024-05-20T21:58:57.420624+0000 mgr.y (mgr.14150) 80 : cluster 0 pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:58.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:58 smithi145 bash[23893]: cluster 2024-05-20T21:58:57.420624+0000 mgr.y (mgr.14150) 80 : cluster 0 pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:58:58.894 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:58 smithi145 bash[24790]: debug 2024-05-20T21:58:58.565+0000 7fa9168da040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T21:58:59.708 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:59 smithi145 bash[24790]: debug 2024-05-20T21:58:59.397+0000 7fa9168da040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T21:58:59.709 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:59 smithi145 bash[24790]: debug 2024-05-20T21:58:59.473+0000 7fa9168da040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T21:59:00.144 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:59 smithi145 bash[24790]: debug 2024-05-20T21:58:59.705+0000 7fa9168da040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T21:59:00.144 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:58:59 smithi145 bash[24790]: debug 2024-05-20T21:58:59.781+0000 7fa9168da040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T21:59:00.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:59 smithi145 bash[23893]: audit 2024-05-20T21:58:58.868747+0000 mon.a (mon.0) 275 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:00.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:59 smithi145 bash[23893]: audit 2024-05-20T21:58:58.877493+0000 mon.a (mon.0) 276 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:00.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:59 smithi145 bash[23893]: audit 2024-05-20T21:58:58.879549+0000 mon.a (mon.0) 277 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:00.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:59 smithi145 bash[23893]: audit 2024-05-20T21:58:58.881292+0000 mon.a (mon.0) 278 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:59:00.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:59 smithi145 bash[23893]: audit 2024-05-20T21:58:58.889923+0000 mon.a (mon.0) 279 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:00.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:59 smithi145 bash[23893]: cephadm 2024-05-20T21:58:58.950310+0000 mgr.y (mgr.14150) 81 : cephadm 1 Reconfiguring mgr.y (unknown last config time)... 2024-05-20T21:59:00.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:59 smithi145 bash[23893]: audit 2024-05-20T21:58:58.950856+0000 mon.a (mon.0) 280 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T21:59:00.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:59 smithi145 bash[23893]: audit 2024-05-20T21:58:58.952348+0000 mon.a (mon.0) 281 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T21:59:00.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:59 smithi145 bash[23893]: audit 2024-05-20T21:58:58.953557+0000 mon.a (mon.0) 282 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:00.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:58:59 smithi145 bash[23893]: cephadm 2024-05-20T21:58:58.955055+0000 mgr.y (mgr.14150) 82 : cephadm 1 Reconfiguring daemon mgr.y on smithi050 2024-05-20T21:59:00.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:59 smithi050 bash[21866]: audit 2024-05-20T21:58:58.868747+0000 mon.a (mon.0) 275 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:00.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:59 smithi050 bash[21866]: audit 2024-05-20T21:58:58.877493+0000 mon.a (mon.0) 276 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:00.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:59 smithi050 bash[21866]: audit 2024-05-20T21:58:58.879549+0000 mon.a (mon.0) 277 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:00.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:59 smithi050 bash[21866]: audit 2024-05-20T21:58:58.881292+0000 mon.a (mon.0) 278 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:59:00.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:59 smithi050 bash[21866]: audit 2024-05-20T21:58:58.889923+0000 mon.a (mon.0) 279 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:00.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:59 smithi050 bash[21866]: cephadm 2024-05-20T21:58:58.950310+0000 mgr.y (mgr.14150) 81 : cephadm 1 Reconfiguring mgr.y (unknown last config time)... 2024-05-20T21:59:00.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:59 smithi050 bash[21866]: audit 2024-05-20T21:58:58.950856+0000 mon.a (mon.0) 280 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T21:59:00.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:59 smithi050 bash[21866]: audit 2024-05-20T21:58:58.952348+0000 mon.a (mon.0) 281 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T21:59:00.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:59 smithi050 bash[21866]: audit 2024-05-20T21:58:58.953557+0000 mon.a (mon.0) 282 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:00.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:58:59 smithi050 bash[21866]: cephadm 2024-05-20T21:58:58.955055+0000 mgr.y (mgr.14150) 82 : cephadm 1 Reconfiguring daemon mgr.y on smithi050 2024-05-20T21:59:00.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:59 smithi050 bash[28929]: audit 2024-05-20T21:58:58.868747+0000 mon.a (mon.0) 275 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:00.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:59 smithi050 bash[28929]: audit 2024-05-20T21:58:58.877493+0000 mon.a (mon.0) 276 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:00.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:59 smithi050 bash[28929]: audit 2024-05-20T21:58:58.879549+0000 mon.a (mon.0) 277 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:00.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:59 smithi050 bash[28929]: audit 2024-05-20T21:58:58.881292+0000 mon.a (mon.0) 278 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:59:00.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:59 smithi050 bash[28929]: audit 2024-05-20T21:58:58.889923+0000 mon.a (mon.0) 279 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:00.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:59 smithi050 bash[28929]: cephadm 2024-05-20T21:58:58.950310+0000 mgr.y (mgr.14150) 81 : cephadm 1 Reconfiguring mgr.y (unknown last config time)... 2024-05-20T21:59:00.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:59 smithi050 bash[28929]: audit 2024-05-20T21:58:58.950856+0000 mon.a (mon.0) 280 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T21:59:00.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:59 smithi050 bash[28929]: audit 2024-05-20T21:58:58.952348+0000 mon.a (mon.0) 281 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T21:59:00.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:59 smithi050 bash[28929]: audit 2024-05-20T21:58:58.953557+0000 mon.a (mon.0) 282 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:00.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:58:59 smithi050 bash[28929]: cephadm 2024-05-20T21:58:58.955055+0000 mgr.y (mgr.14150) 82 : cephadm 1 Reconfiguring daemon mgr.y on smithi050 2024-05-20T21:59:00.644 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:59:00 smithi145 bash[24790]: debug 2024-05-20T21:59:00.177+0000 7fa9168da040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T21:59:00.644 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 21:59:00 smithi145 bash[24790]: debug 2024-05-20T21:59:00.257+0000 7fa9168da040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T21:59:00.650 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-20T21:59:00.831 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-20T21:59:00.843 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10+0 records in 2024-05-20T21:59:00.843 INFO:teuthology.orchestra.run.smithi050.stderr:10+0 records out 2024-05-20T21:59:00.843 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0101263 s, 1.0 GB/s 2024-05-20T21:59:00.844 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping successful for: 2024-05-20T21:59:01.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:00 smithi050 bash[21866]: cluster 2024-05-20T21:58:59.420973+0000 mgr.y (mgr.14150) 83 : cluster 0 pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:01.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:00 smithi050 bash[21866]: cluster 2024-05-20T21:59:00.284332+0000 mon.a (mon.0) 283 : cluster 0 Standby manager daemon x started 2024-05-20T21:59:01.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:00 smithi050 bash[21866]: audit 2024-05-20T21:59:00.286271+0000 mon.b (mon.1) 4 : audit 0 from='mgr.? v1:172.21.15.145:0/1743901673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-20T21:59:01.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:00 smithi050 bash[21866]: audit 2024-05-20T21:59:00.286956+0000 mon.b (mon.1) 5 : audit 0 from='mgr.? v1:172.21.15.145:0/1743901673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T21:59:01.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:00 smithi050 bash[21866]: audit 2024-05-20T21:59:00.288084+0000 mon.b (mon.1) 6 : audit 0 from='mgr.? v1:172.21.15.145:0/1743901673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-20T21:59:01.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:00 smithi050 bash[21866]: audit 2024-05-20T21:59:00.288431+0000 mon.b (mon.1) 7 : audit 0 from='mgr.? v1:172.21.15.145:0/1743901673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T21:59:01.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:00 smithi050 bash[28929]: cluster 2024-05-20T21:58:59.420973+0000 mgr.y (mgr.14150) 83 : cluster 0 pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:01.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:00 smithi050 bash[28929]: cluster 2024-05-20T21:59:00.284332+0000 mon.a (mon.0) 283 : cluster 0 Standby manager daemon x started 2024-05-20T21:59:01.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:00 smithi050 bash[28929]: audit 2024-05-20T21:59:00.286271+0000 mon.b (mon.1) 4 : audit 0 from='mgr.? v1:172.21.15.145:0/1743901673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-20T21:59:01.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:00 smithi050 bash[28929]: audit 2024-05-20T21:59:00.286956+0000 mon.b (mon.1) 5 : audit 0 from='mgr.? v1:172.21.15.145:0/1743901673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T21:59:01.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:00 smithi050 bash[28929]: audit 2024-05-20T21:59:00.288084+0000 mon.b (mon.1) 6 : audit 0 from='mgr.? v1:172.21.15.145:0/1743901673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-20T21:59:01.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:00 smithi050 bash[28929]: audit 2024-05-20T21:59:00.288431+0000 mon.b (mon.1) 7 : audit 0 from='mgr.? v1:172.21.15.145:0/1743901673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T21:59:01.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:00 smithi145 bash[23893]: cluster 2024-05-20T21:58:59.420973+0000 mgr.y (mgr.14150) 83 : cluster 0 pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:01.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:00 smithi145 bash[23893]: cluster 2024-05-20T21:59:00.284332+0000 mon.a (mon.0) 283 : cluster 0 Standby manager daemon x started 2024-05-20T21:59:01.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:00 smithi145 bash[23893]: audit 2024-05-20T21:59:00.286271+0000 mon.b (mon.1) 4 : audit 0 from='mgr.? v1:172.21.15.145:0/1743901673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-20T21:59:01.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:00 smithi145 bash[23893]: audit 2024-05-20T21:59:00.286956+0000 mon.b (mon.1) 5 : audit 0 from='mgr.? v1:172.21.15.145:0/1743901673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T21:59:01.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:00 smithi145 bash[23893]: audit 2024-05-20T21:59:00.288084+0000 mon.b (mon.1) 6 : audit 0 from='mgr.? v1:172.21.15.145:0/1743901673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-20T21:59:01.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:00 smithi145 bash[23893]: audit 2024-05-20T21:59:00.288431+0000 mon.b (mon.1) 7 : audit 0 from='mgr.? v1:172.21.15.145:0/1743901673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T21:59:01.689 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_4 2024-05-20T21:59:01.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:01 smithi050 bash[21866]: cluster 2024-05-20T21:59:00.896369+0000 mon.a (mon.0) 284 : cluster 0 mgrmap e14: y(active, since 103s), standbys: x 2024-05-20T21:59:01.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:01 smithi050 bash[21866]: audit 2024-05-20T21:59:00.896732+0000 mon.a (mon.0) 285 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-20T21:59:01.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:01 smithi050 bash[21866]: audit 2024-05-20T21:59:01.242364+0000 mon.a (mon.0) 286 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:01.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:01 smithi050 bash[21866]: audit 2024-05-20T21:59:01.247645+0000 mon.a (mon.0) 287 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:01.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:01 smithi050 bash[21866]: audit 2024-05-20T21:59:01.249839+0000 mon.a (mon.0) 288 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:59:01.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:01 smithi050 bash[21866]: audit 2024-05-20T21:59:01.866706+0000 mon.a (mon.0) 289 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:01.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:01 smithi050 bash[21866]: audit 2024-05-20T21:59:01.867453+0000 mon.a (mon.0) 290 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:59:01.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:01 smithi050 bash[21866]: audit 2024-05-20T21:59:01.871961+0000 mon.a (mon.0) 291 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:01.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:01 smithi050 bash[28929]: cluster 2024-05-20T21:59:00.896369+0000 mon.a (mon.0) 284 : cluster 0 mgrmap e14: y(active, since 103s), standbys: x 2024-05-20T21:59:01.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:01 smithi050 bash[28929]: audit 2024-05-20T21:59:00.896732+0000 mon.a (mon.0) 285 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-20T21:59:01.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:01 smithi050 bash[28929]: audit 2024-05-20T21:59:01.242364+0000 mon.a (mon.0) 286 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:01.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:01 smithi050 bash[28929]: audit 2024-05-20T21:59:01.247645+0000 mon.a (mon.0) 287 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:01.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:01 smithi050 bash[28929]: audit 2024-05-20T21:59:01.249839+0000 mon.a (mon.0) 288 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:59:01.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:01 smithi050 bash[28929]: audit 2024-05-20T21:59:01.866706+0000 mon.a (mon.0) 289 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:01.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:01 smithi050 bash[28929]: audit 2024-05-20T21:59:01.867453+0000 mon.a (mon.0) 290 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:59:01.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:01 smithi050 bash[28929]: audit 2024-05-20T21:59:01.871961+0000 mon.a (mon.0) 291 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:02.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:01 smithi145 bash[23893]: cluster 2024-05-20T21:59:00.896369+0000 mon.a (mon.0) 284 : cluster 0 mgrmap e14: y(active, since 103s), standbys: x 2024-05-20T21:59:02.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:01 smithi145 bash[23893]: audit 2024-05-20T21:59:00.896732+0000 mon.a (mon.0) 285 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-20T21:59:02.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:01 smithi145 bash[23893]: audit 2024-05-20T21:59:01.242364+0000 mon.a (mon.0) 286 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:02.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:01 smithi145 bash[23893]: audit 2024-05-20T21:59:01.247645+0000 mon.a (mon.0) 287 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:02.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:01 smithi145 bash[23893]: audit 2024-05-20T21:59:01.249839+0000 mon.a (mon.0) 288 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:59:02.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:01 smithi145 bash[23893]: audit 2024-05-20T21:59:01.866706+0000 mon.a (mon.0) 289 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:02.395 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:01 smithi145 bash[23893]: audit 2024-05-20T21:59:01.867453+0000 mon.a (mon.0) 290 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:59:02.395 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:01 smithi145 bash[23893]: audit 2024-05-20T21:59:01.871961+0000 mon.a (mon.0) 291 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:03.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:02 smithi050 bash[21866]: cluster 2024-05-20T21:59:01.421325+0000 mgr.y (mgr.14150) 84 : cluster 0 pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:03.201 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:02 smithi050 bash[28929]: cluster 2024-05-20T21:59:01.421325+0000 mgr.y (mgr.14150) 84 : cluster 0 pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:03.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:02 smithi145 bash[23893]: cluster 2024-05-20T21:59:01.421325+0000 mgr.y (mgr.14150) 84 : cluster 0 pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:05.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:04 smithi050 bash[21866]: cluster 2024-05-20T21:59:03.421680+0000 mgr.y (mgr.14150) 85 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:05.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:04 smithi050 bash[28929]: cluster 2024-05-20T21:59:03.421680+0000 mgr.y (mgr.14150) 85 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:05.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:04 smithi145 bash[23893]: cluster 2024-05-20T21:59:03.421680+0000 mgr.y (mgr.14150) 85 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:06.419 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T21:59:07.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:06 smithi050 bash[21866]: cluster 2024-05-20T21:59:05.422089+0000 mgr.y (mgr.14150) 86 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:07.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:06 smithi050 bash[28929]: cluster 2024-05-20T21:59:05.422089+0000 mgr.y (mgr.14150) 86 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:07.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:06 smithi145 bash[23893]: cluster 2024-05-20T21:59:05.422089+0000 mgr.y (mgr.14150) 86 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.892+0000 7f4a1643a640 1 -- 172.21.15.50:0/4277203418 >> v1:172.21.15.50:6789/0 conn(0x7f4a101021c0 legacy=0x7f4a101045b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:59:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.892+0000 7f4a1643a640 1 -- 172.21.15.50:0/4277203418 shutdown_connections 2024-05-20T21:59:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.892+0000 7f4a1643a640 1 -- 172.21.15.50:0/4277203418 >> 172.21.15.50:0/4277203418 conn(0x7f4a100fbbd0 msgr2=0x7f4a100fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:59:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.892+0000 7f4a1643a640 1 -- 172.21.15.50:0/4277203418 shutdown_connections 2024-05-20T21:59:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.892+0000 7f4a1643a640 1 -- 172.21.15.50:0/4277203418 wait complete. 2024-05-20T21:59:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.892+0000 7f4a1643a640 1 Processor -- start 2024-05-20T21:59:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.892+0000 7f4a1643a640 1 -- start start 2024-05-20T21:59:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a1643a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f4a101a3cf0 con 0x7f4a101021c0 2024-05-20T21:59:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a1643a640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f4a101a4f30 con 0x7f4a10109840 2024-05-20T21:59:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a1643a640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f4a101a6170 con 0x7f4a10105cd0 2024-05-20T21:59:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4a101021c0 0x7f4a10101a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49784/0 (socket says 172.21.15.50:49784) 2024-05-20T21:59:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0ffff640 1 -- 172.21.15.50:0/3188522346 learned_addr learned my addr 172.21.15.50:0/3188522346 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T21:59:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 537921758 0 0) 0x7f4a101a3cf0 con 0x7f4a101021c0 2024-05-20T21:59:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49f8003520 con 0x7f4a101021c0 2024-05-20T21:59:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1121155187 0 0) 0x7f4a101a6170 con 0x7f4a10105cd0 2024-05-20T21:59:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a101a3cf0 con 0x7f4a10105cd0 2024-05-20T21:59:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3098379342 0 0) 0x7f49f8003520 con 0x7f4a101021c0 2024-05-20T21:59:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a101a6170 con 0x7f4a101021c0 2024-05-20T21:59:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f4a08001370 con 0x7f4a101021c0 2024-05-20T21:59:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3879133527 0 0) 0x7f4a101a3cf0 con 0x7f4a10105cd0 2024-05-20T21:59:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f49f8003520 con 0x7f4a10105cd0 2024-05-20T21:59:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f4a04001bf0 con 0x7f4a10105cd0 2024-05-20T21:59:08.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 767379809 0 0) 0x7f4a101a4f30 con 0x7f4a10109840 2024-05-20T21:59:08.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a101a3cf0 con 0x7f4a10109840 2024-05-20T21:59:08.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 113020112 0 0) 0x7f4a101a6170 con 0x7f4a101021c0 2024-05-20T21:59:08.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 >> v1:172.21.15.50:6790/0 conn(0x7f4a10105cd0 legacy=0x7f4a1019eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:59:08.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 >> v1:172.21.15.145:6789/0 conn(0x7f4a10109840 legacy=0x7f4a101a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:59:08.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a101a73b0 con 0x7f4a101021c0 2024-05-20T21:59:08.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a1643a640 1 -- 172.21.15.50:0/3188522346 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4a101a63a0 con 0x7f4a101021c0 2024-05-20T21:59:08.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a1643a640 1 -- 172.21.15.50:0/3188522346 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4a101a68e0 con 0x7f4a101021c0 2024-05-20T21:59:08.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f4a08001b70 con 0x7f4a101021c0 2024-05-20T21:59:08.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f4a08004f20 con 0x7f4a101021c0 2024-05-20T21:59:08.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a1643a640 1 -- 172.21.15.50:0/3188522346 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49fc0050b0 con 0x7f4a101021c0 2024-05-20T21:59:08.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 14) ==== 92025+0+0 (unknown 890788531 0 0) 0x7f4a080037d0 con 0x7f4a101021c0 2024-05-20T21:59:08.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.896+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (unknown 2781634937 0 0) 0x7f4a08088250 con 0x7f4a101021c0 2024-05-20T21:59:08.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:08.904+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f4a08056ee0 con 0x7f4a101021c0 2024-05-20T21:59:09.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:09.104+0000 7f4a1643a640 1 -- 172.21.15.50:0/3188522346 --> v1:172.21.15.50:6800/2944911247 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f49fc000bc0 con 0x7f49f806ee60 2024-05-20T21:59:09.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:08 smithi050 bash[21866]: cluster 2024-05-20T21:59:07.422512+0000 mgr.y (mgr.14150) 87 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:09.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:08 smithi050 bash[28929]: cluster 2024-05-20T21:59:07.422512+0000 mgr.y (mgr.14150) 87 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:09.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:08 smithi145 bash[23893]: cluster 2024-05-20T21:59:07.422512+0000 mgr.y (mgr.14150) 87 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:10.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:09 smithi050 bash[21866]: audit 2024-05-20T21:59:09.109427+0000 mgr.y (mgr.14150) 88 : audit 0 from='client.14214 v1:172.21.15.50:0/3188522346' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T21:59:10.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:09 smithi050 bash[21866]: audit 2024-05-20T21:59:09.113365+0000 mon.a (mon.0) 292 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T21:59:10.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:09 smithi050 bash[21866]: audit 2024-05-20T21:59:09.118839+0000 mon.a (mon.0) 293 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T21:59:10.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:09 smithi050 bash[21866]: audit 2024-05-20T21:59:09.120053+0000 mon.a (mon.0) 294 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:10.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:09 smithi050 bash[28929]: audit 2024-05-20T21:59:09.109427+0000 mgr.y (mgr.14150) 88 : audit 0 from='client.14214 v1:172.21.15.50:0/3188522346' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T21:59:10.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:09 smithi050 bash[28929]: audit 2024-05-20T21:59:09.113365+0000 mon.a (mon.0) 292 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T21:59:10.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:09 smithi050 bash[28929]: audit 2024-05-20T21:59:09.118839+0000 mon.a (mon.0) 293 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T21:59:10.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:09 smithi050 bash[28929]: audit 2024-05-20T21:59:09.120053+0000 mon.a (mon.0) 294 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:10.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:09 smithi145 bash[23893]: audit 2024-05-20T21:59:09.109427+0000 mgr.y (mgr.14150) 88 : audit 0 from='client.14214 v1:172.21.15.50:0/3188522346' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T21:59:10.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:09 smithi145 bash[23893]: audit 2024-05-20T21:59:09.113365+0000 mon.a (mon.0) 292 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T21:59:10.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:09 smithi145 bash[23893]: audit 2024-05-20T21:59:09.118839+0000 mon.a (mon.0) 293 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T21:59:10.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:09 smithi145 bash[23893]: audit 2024-05-20T21:59:09.120053+0000 mon.a (mon.0) 294 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:11.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:10 smithi050 bash[21866]: cluster 2024-05-20T21:59:09.422916+0000 mgr.y (mgr.14150) 89 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:11.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:10 smithi050 bash[28929]: cluster 2024-05-20T21:59:09.422916+0000 mgr.y (mgr.14150) 89 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:11.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:10 smithi145 bash[23893]: cluster 2024-05-20T21:59:09.422916+0000 mgr.y (mgr.14150) 89 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:13.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:12 smithi050 bash[21866]: cluster 2024-05-20T21:59:11.423330+0000 mgr.y (mgr.14150) 90 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:13.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:12 smithi050 bash[28929]: cluster 2024-05-20T21:59:11.423330+0000 mgr.y (mgr.14150) 90 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:13.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:12 smithi145 bash[23893]: cluster 2024-05-20T21:59:11.423330+0000 mgr.y (mgr.14150) 90 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:15.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:14 smithi050 bash[21866]: cluster 2024-05-20T21:59:13.423735+0000 mgr.y (mgr.14150) 91 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:15.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:14 smithi050 bash[28929]: cluster 2024-05-20T21:59:13.423735+0000 mgr.y (mgr.14150) 91 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:15.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:14 smithi145 bash[23893]: cluster 2024-05-20T21:59:13.423735+0000 mgr.y (mgr.14150) 91 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:17.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:16 smithi050 bash[21866]: cluster 2024-05-20T21:59:15.424185+0000 mgr.y (mgr.14150) 92 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:17.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:16 smithi050 bash[28929]: cluster 2024-05-20T21:59:15.424185+0000 mgr.y (mgr.14150) 92 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:17.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:16 smithi145 bash[23893]: cluster 2024-05-20T21:59:15.424185+0000 mgr.y (mgr.14150) 92 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:18.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:17 smithi050 bash[21866]: audit 2024-05-20T21:59:17.185695+0000 mon.c (mon.2) 3 : audit 1 from='client.? v1:172.21.15.50:0/2359194013' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0e24659f-5dce-416d-83fd-beff6359fc45"}]: dispatch 2024-05-20T21:59:18.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:17 smithi050 bash[21866]: audit 2024-05-20T21:59:17.186392+0000 mon.a (mon.0) 295 : audit 1 from='client.24125 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0e24659f-5dce-416d-83fd-beff6359fc45"}]: dispatch 2024-05-20T21:59:18.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:17 smithi050 bash[21866]: audit 2024-05-20T21:59:17.188889+0000 mon.a (mon.0) 296 : audit 1 from='client.24125 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0e24659f-5dce-416d-83fd-beff6359fc45"}]': finished 2024-05-20T21:59:18.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:17 smithi050 bash[21866]: cluster 2024-05-20T21:59:17.191052+0000 mon.a (mon.0) 297 : cluster 0 osdmap e5: 1 total, 0 up, 1 in 2024-05-20T21:59:18.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:17 smithi050 bash[21866]: audit 2024-05-20T21:59:17.191224+0000 mon.a (mon.0) 298 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T21:59:18.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:17 smithi050 bash[21866]: audit 2024-05-20T21:59:17.877217+0000 mon.a (mon.0) 299 : audit 0 from='client.? v1:172.21.15.50:0/1177597581' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T21:59:18.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:17 smithi050 bash[28929]: audit 2024-05-20T21:59:17.185695+0000 mon.c (mon.2) 3 : audit 1 from='client.? v1:172.21.15.50:0/2359194013' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0e24659f-5dce-416d-83fd-beff6359fc45"}]: dispatch 2024-05-20T21:59:18.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:17 smithi050 bash[28929]: audit 2024-05-20T21:59:17.186392+0000 mon.a (mon.0) 295 : audit 1 from='client.24125 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0e24659f-5dce-416d-83fd-beff6359fc45"}]: dispatch 2024-05-20T21:59:18.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:17 smithi050 bash[28929]: audit 2024-05-20T21:59:17.188889+0000 mon.a (mon.0) 296 : audit 1 from='client.24125 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0e24659f-5dce-416d-83fd-beff6359fc45"}]': finished 2024-05-20T21:59:18.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:17 smithi050 bash[28929]: cluster 2024-05-20T21:59:17.191052+0000 mon.a (mon.0) 297 : cluster 0 osdmap e5: 1 total, 0 up, 1 in 2024-05-20T21:59:18.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:17 smithi050 bash[28929]: audit 2024-05-20T21:59:17.191224+0000 mon.a (mon.0) 298 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T21:59:18.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:17 smithi050 bash[28929]: audit 2024-05-20T21:59:17.877217+0000 mon.a (mon.0) 299 : audit 0 from='client.? v1:172.21.15.50:0/1177597581' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T21:59:18.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:17 smithi145 bash[23893]: audit 2024-05-20T21:59:17.185695+0000 mon.c (mon.2) 3 : audit 1 from='client.? v1:172.21.15.50:0/2359194013' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0e24659f-5dce-416d-83fd-beff6359fc45"}]: dispatch 2024-05-20T21:59:18.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:17 smithi145 bash[23893]: audit 2024-05-20T21:59:17.186392+0000 mon.a (mon.0) 295 : audit 1 from='client.24125 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0e24659f-5dce-416d-83fd-beff6359fc45"}]: dispatch 2024-05-20T21:59:18.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:17 smithi145 bash[23893]: audit 2024-05-20T21:59:17.188889+0000 mon.a (mon.0) 296 : audit 1 from='client.24125 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0e24659f-5dce-416d-83fd-beff6359fc45"}]': finished 2024-05-20T21:59:18.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:17 smithi145 bash[23893]: cluster 2024-05-20T21:59:17.191052+0000 mon.a (mon.0) 297 : cluster 0 osdmap e5: 1 total, 0 up, 1 in 2024-05-20T21:59:18.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:17 smithi145 bash[23893]: audit 2024-05-20T21:59:17.191224+0000 mon.a (mon.0) 298 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T21:59:18.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:17 smithi145 bash[23893]: audit 2024-05-20T21:59:17.877217+0000 mon.a (mon.0) 299 : audit 0 from='client.? v1:172.21.15.50:0/1177597581' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T21:59:19.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:19 smithi050 bash[21866]: cluster 2024-05-20T21:59:17.424602+0000 mgr.y (mgr.14150) 93 : cluster 0 pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:19.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:19 smithi050 bash[28929]: cluster 2024-05-20T21:59:17.424602+0000 mgr.y (mgr.14150) 93 : cluster 0 pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:19.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:19 smithi145 bash[23893]: cluster 2024-05-20T21:59:17.424602+0000 mgr.y (mgr.14150) 93 : cluster 0 pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:21.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:21 smithi050 bash[21866]: cluster 2024-05-20T21:59:19.425033+0000 mgr.y (mgr.14150) 94 : cluster 0 pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:21.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:21 smithi050 bash[28929]: cluster 2024-05-20T21:59:19.425033+0000 mgr.y (mgr.14150) 94 : cluster 0 pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:21.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:21 smithi145 bash[23893]: cluster 2024-05-20T21:59:19.425033+0000 mgr.y (mgr.14150) 94 : cluster 0 pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:23.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:23 smithi145 bash[23893]: cluster 2024-05-20T21:59:21.425347+0000 mgr.y (mgr.14150) 95 : cluster 0 pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:23.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:23 smithi050 bash[21866]: cluster 2024-05-20T21:59:21.425347+0000 mgr.y (mgr.14150) 95 : cluster 0 pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:23.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:23 smithi050 bash[28929]: cluster 2024-05-20T21:59:21.425347+0000 mgr.y (mgr.14150) 95 : cluster 0 pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:25.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:25 smithi145 bash[23893]: cluster 2024-05-20T21:59:23.425735+0000 mgr.y (mgr.14150) 96 : cluster 0 pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:25.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:25 smithi050 bash[21866]: cluster 2024-05-20T21:59:23.425735+0000 mgr.y (mgr.14150) 96 : cluster 0 pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:25.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:25 smithi050 bash[28929]: cluster 2024-05-20T21:59:23.425735+0000 mgr.y (mgr.14150) 96 : cluster 0 pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:27.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:27 smithi145 bash[23893]: cluster 2024-05-20T21:59:25.426162+0000 mgr.y (mgr.14150) 97 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:27.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:27 smithi050 bash[21866]: cluster 2024-05-20T21:59:25.426162+0000 mgr.y (mgr.14150) 97 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:27.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:27 smithi050 bash[28929]: cluster 2024-05-20T21:59:25.426162+0000 mgr.y (mgr.14150) 97 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:29.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:29 smithi145 bash[23893]: cluster 2024-05-20T21:59:27.426592+0000 mgr.y (mgr.14150) 98 : cluster 0 pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:29.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:29 smithi050 bash[21866]: cluster 2024-05-20T21:59:27.426592+0000 mgr.y (mgr.14150) 98 : cluster 0 pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:29.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:29 smithi050 bash[28929]: cluster 2024-05-20T21:59:27.426592+0000 mgr.y (mgr.14150) 98 : cluster 0 pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:30.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:30 smithi145 bash[23893]: audit 2024-05-20T21:59:29.466926+0000 mon.a (mon.0) 300 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-20T21:59:30.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:30 smithi145 bash[23893]: audit 2024-05-20T21:59:29.468548+0000 mon.a (mon.0) 301 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:30.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:30 smithi050 bash[21866]: audit 2024-05-20T21:59:29.466926+0000 mon.a (mon.0) 300 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-20T21:59:30.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:30 smithi050 bash[21866]: audit 2024-05-20T21:59:29.468548+0000 mon.a (mon.0) 301 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:30.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:30 smithi050 bash[28929]: audit 2024-05-20T21:59:29.466926+0000 mon.a (mon.0) 300 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-20T21:59:30.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:30 smithi050 bash[28929]: audit 2024-05-20T21:59:29.468548+0000 mon.a (mon.0) 301 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:31.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:31 smithi050 bash[21866]: cluster 2024-05-20T21:59:29.426955+0000 mgr.y (mgr.14150) 99 : cluster 0 pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:31.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:31 smithi050 bash[21866]: cephadm 2024-05-20T21:59:29.470073+0000 mgr.y (mgr.14150) 100 : cephadm 1 Deploying daemon osd.0 on smithi050 2024-05-20T21:59:31.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:31 smithi050 bash[28929]: cluster 2024-05-20T21:59:29.426955+0000 mgr.y (mgr.14150) 99 : cluster 0 pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:31.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:31 smithi050 bash[28929]: cephadm 2024-05-20T21:59:29.470073+0000 mgr.y (mgr.14150) 100 : cephadm 1 Deploying daemon osd.0 on smithi050 2024-05-20T21:59:31.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:31 smithi145 bash[23893]: cluster 2024-05-20T21:59:29.426955+0000 mgr.y (mgr.14150) 99 : cluster 0 pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:31.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:31 smithi145 bash[23893]: cephadm 2024-05-20T21:59:29.470073+0000 mgr.y (mgr.14150) 100 : cephadm 1 Deploying daemon osd.0 on smithi050 2024-05-20T21:59:32.568 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:32 smithi050 bash[28929]: cluster 2024-05-20T21:59:31.427350+0000 mgr.y (mgr.14150) 101 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:32.569 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:32 smithi050 bash[21866]: cluster 2024-05-20T21:59:31.427350+0000 mgr.y (mgr.14150) 101 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:32.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:32 smithi145 bash[23893]: cluster 2024-05-20T21:59:31.427350+0000 mgr.y (mgr.14150) 101 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:33.611 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:33 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T21:59:33.611 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:59:33 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T21:59:33.611 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:33 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T21:59:33.869 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:33 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T21:59:33.869 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 21:59:33 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T21:59:33.869 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:33 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T21:59:34.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:34 smithi145 bash[23893]: cluster 2024-05-20T21:59:33.427781+0000 mgr.y (mgr.14150) 102 : cluster 0 pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:34.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:34 smithi145 bash[23893]: audit 2024-05-20T21:59:33.861542+0000 mon.a (mon.0) 302 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:59:34.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:34 smithi145 bash[23893]: audit 2024-05-20T21:59:33.865433+0000 mon.a (mon.0) 303 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:34.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:34 smithi145 bash[23893]: audit 2024-05-20T21:59:33.872773+0000 mon.a (mon.0) 304 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:34.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:34 smithi050 bash[21866]: cluster 2024-05-20T21:59:33.427781+0000 mgr.y (mgr.14150) 102 : cluster 0 pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:34.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:34 smithi050 bash[21866]: audit 2024-05-20T21:59:33.861542+0000 mon.a (mon.0) 302 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:59:34.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:34 smithi050 bash[21866]: audit 2024-05-20T21:59:33.865433+0000 mon.a (mon.0) 303 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:34.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:34 smithi050 bash[21866]: audit 2024-05-20T21:59:33.872773+0000 mon.a (mon.0) 304 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:34.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:34 smithi050 bash[28929]: cluster 2024-05-20T21:59:33.427781+0000 mgr.y (mgr.14150) 102 : cluster 0 pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:34.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:34 smithi050 bash[28929]: audit 2024-05-20T21:59:33.861542+0000 mon.a (mon.0) 302 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:59:34.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:34 smithi050 bash[28929]: audit 2024-05-20T21:59:33.865433+0000 mon.a (mon.0) 303 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:34.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:34 smithi050 bash[28929]: audit 2024-05-20T21:59:33.872773+0000 mon.a (mon.0) 304 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:36.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:36 smithi145 bash[23893]: cluster 2024-05-20T21:59:35.428188+0000 mgr.y (mgr.14150) 103 : cluster 0 pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:36.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:36 smithi050 bash[28929]: cluster 2024-05-20T21:59:35.428188+0000 mgr.y (mgr.14150) 103 : cluster 0 pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:36.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:36 smithi050 bash[21866]: cluster 2024-05-20T21:59:35.428188+0000 mgr.y (mgr.14150) 103 : cluster 0 pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:38.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:38 smithi145 bash[23893]: cluster 2024-05-20T21:59:37.428653+0000 mgr.y (mgr.14150) 104 : cluster 0 pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:38.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:38 smithi050 bash[21866]: cluster 2024-05-20T21:59:37.428653+0000 mgr.y (mgr.14150) 104 : cluster 0 pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:38.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:38 smithi050 bash[28929]: cluster 2024-05-20T21:59:37.428653+0000 mgr.y (mgr.14150) 104 : cluster 0 pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:40.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:40 smithi050 bash[21866]: cluster 2024-05-20T21:59:39.429185+0000 mgr.y (mgr.14150) 105 : cluster 0 pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:40.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:40 smithi050 bash[21866]: audit 2024-05-20T21:59:40.099700+0000 mon.a (mon.0) 305 : audit 1 from='osd.0 v1:172.21.15.50:6801/4039291270' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-20T21:59:40.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:40 smithi050 bash[28929]: cluster 2024-05-20T21:59:39.429185+0000 mgr.y (mgr.14150) 105 : cluster 0 pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:40.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:40 smithi050 bash[28929]: audit 2024-05-20T21:59:40.099700+0000 mon.a (mon.0) 305 : audit 1 from='osd.0 v1:172.21.15.50:6801/4039291270' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-20T21:59:40.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:40 smithi145 bash[23893]: cluster 2024-05-20T21:59:39.429185+0000 mgr.y (mgr.14150) 105 : cluster 0 pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:40.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:40 smithi145 bash[23893]: audit 2024-05-20T21:59:40.099700+0000 mon.a (mon.0) 305 : audit 1 from='osd.0 v1:172.21.15.50:6801/4039291270' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-20T21:59:41.583 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:41 smithi050 bash[21866]: audit 2024-05-20T21:59:40.499592+0000 mon.a (mon.0) 306 : audit 1 from='osd.0 v1:172.21.15.50:6801/4039291270' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-20T21:59:41.583 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:41 smithi050 bash[21866]: cluster 2024-05-20T21:59:40.503813+0000 mon.a (mon.0) 307 : cluster 0 osdmap e6: 1 total, 0 up, 1 in 2024-05-20T21:59:41.583 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:41 smithi050 bash[21866]: audit 2024-05-20T21:59:40.504116+0000 mon.a (mon.0) 308 : audit 1 from='osd.0 v1:172.21.15.50:6801/4039291270' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-05-20T21:59:41.584 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:41 smithi050 bash[21866]: audit 2024-05-20T21:59:40.504424+0000 mon.a (mon.0) 309 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T21:59:41.584 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:41 smithi050 bash[21866]: audit 2024-05-20T21:59:40.629928+0000 mon.a (mon.0) 310 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:41.584 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:41 smithi050 bash[21866]: audit 2024-05-20T21:59:40.633967+0000 mon.a (mon.0) 311 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:41.584 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:41 smithi050 bash[21866]: audit 2024-05-20T21:59:41.256655+0000 mon.a (mon.0) 312 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:41.584 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:41 smithi050 bash[21866]: audit 2024-05-20T21:59:41.257875+0000 mon.a (mon.0) 313 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:59:41.584 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:41 smithi050 bash[21866]: audit 2024-05-20T21:59:41.264752+0000 mon.a (mon.0) 314 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:41.584 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:41 smithi050 bash[28929]: audit 2024-05-20T21:59:40.499592+0000 mon.a (mon.0) 306 : audit 1 from='osd.0 v1:172.21.15.50:6801/4039291270' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-20T21:59:41.584 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:41 smithi050 bash[28929]: cluster 2024-05-20T21:59:40.503813+0000 mon.a (mon.0) 307 : cluster 0 osdmap e6: 1 total, 0 up, 1 in 2024-05-20T21:59:41.584 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:41 smithi050 bash[28929]: audit 2024-05-20T21:59:40.504116+0000 mon.a (mon.0) 308 : audit 1 from='osd.0 v1:172.21.15.50:6801/4039291270' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-05-20T21:59:41.585 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:41 smithi050 bash[28929]: audit 2024-05-20T21:59:40.504424+0000 mon.a (mon.0) 309 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T21:59:41.585 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:41 smithi050 bash[28929]: audit 2024-05-20T21:59:40.629928+0000 mon.a (mon.0) 310 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:41.585 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:41 smithi050 bash[28929]: audit 2024-05-20T21:59:40.633967+0000 mon.a (mon.0) 311 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:41.585 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:41 smithi050 bash[28929]: audit 2024-05-20T21:59:41.256655+0000 mon.a (mon.0) 312 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:41.585 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:41 smithi050 bash[28929]: audit 2024-05-20T21:59:41.257875+0000 mon.a (mon.0) 313 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:59:41.585 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:41 smithi050 bash[28929]: audit 2024-05-20T21:59:41.264752+0000 mon.a (mon.0) 314 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:41.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:41 smithi145 bash[23893]: audit 2024-05-20T21:59:40.499592+0000 mon.a (mon.0) 306 : audit 1 from='osd.0 v1:172.21.15.50:6801/4039291270' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-20T21:59:41.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:41 smithi145 bash[23893]: cluster 2024-05-20T21:59:40.503813+0000 mon.a (mon.0) 307 : cluster 0 osdmap e6: 1 total, 0 up, 1 in 2024-05-20T21:59:41.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:41 smithi145 bash[23893]: audit 2024-05-20T21:59:40.504116+0000 mon.a (mon.0) 308 : audit 1 from='osd.0 v1:172.21.15.50:6801/4039291270' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-05-20T21:59:41.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:41 smithi145 bash[23893]: audit 2024-05-20T21:59:40.504424+0000 mon.a (mon.0) 309 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T21:59:41.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:41 smithi145 bash[23893]: audit 2024-05-20T21:59:40.629928+0000 mon.a (mon.0) 310 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:41.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:41 smithi145 bash[23893]: audit 2024-05-20T21:59:40.633967+0000 mon.a (mon.0) 311 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:41.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:41 smithi145 bash[23893]: audit 2024-05-20T21:59:41.256655+0000 mon.a (mon.0) 312 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:41.895 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:41 smithi145 bash[23893]: audit 2024-05-20T21:59:41.257875+0000 mon.a (mon.0) 313 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:59:41.895 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:41 smithi145 bash[23893]: audit 2024-05-20T21:59:41.264752+0000 mon.a (mon.0) 314 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:42.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:42 smithi145 bash[23893]: cluster 2024-05-20T21:59:41.429518+0000 mgr.y (mgr.14150) 106 : cluster 0 pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:42.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:42 smithi145 bash[23893]: audit 2024-05-20T21:59:41.501458+0000 mon.a (mon.0) 315 : audit 1 from='osd.0 v1:172.21.15.50:6801/4039291270' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-05-20T21:59:42.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:42 smithi145 bash[23893]: cluster 2024-05-20T21:59:41.508574+0000 mon.a (mon.0) 316 : cluster 0 osdmap e7: 1 total, 0 up, 1 in 2024-05-20T21:59:42.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:42 smithi145 bash[23893]: audit 2024-05-20T21:59:41.509881+0000 mon.a (mon.0) 317 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T21:59:42.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:42 smithi145 bash[23893]: audit 2024-05-20T21:59:41.520246+0000 mon.a (mon.0) 318 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T21:59:42.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:42 smithi145 bash[23893]: audit 2024-05-20T21:59:41.841157+0000 mon.a (mon.0) 319 : audit 1 from='osd.0 v1:172.21.15.50:6801/4039291270' entity='osd.0' 2024-05-20T21:59:42.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:42 smithi050 bash[21866]: cluster 2024-05-20T21:59:41.429518+0000 mgr.y (mgr.14150) 106 : cluster 0 pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:42.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:42 smithi050 bash[21866]: audit 2024-05-20T21:59:41.501458+0000 mon.a (mon.0) 315 : audit 1 from='osd.0 v1:172.21.15.50:6801/4039291270' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-05-20T21:59:42.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:42 smithi050 bash[21866]: cluster 2024-05-20T21:59:41.508574+0000 mon.a (mon.0) 316 : cluster 0 osdmap e7: 1 total, 0 up, 1 in 2024-05-20T21:59:42.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:42 smithi050 bash[21866]: audit 2024-05-20T21:59:41.509881+0000 mon.a (mon.0) 317 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T21:59:42.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:42 smithi050 bash[21866]: audit 2024-05-20T21:59:41.520246+0000 mon.a (mon.0) 318 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T21:59:42.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:42 smithi050 bash[21866]: audit 2024-05-20T21:59:41.841157+0000 mon.a (mon.0) 319 : audit 1 from='osd.0 v1:172.21.15.50:6801/4039291270' entity='osd.0' 2024-05-20T21:59:42.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:42 smithi050 bash[28929]: cluster 2024-05-20T21:59:41.429518+0000 mgr.y (mgr.14150) 106 : cluster 0 pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:42.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:42 smithi050 bash[28929]: audit 2024-05-20T21:59:41.501458+0000 mon.a (mon.0) 315 : audit 1 from='osd.0 v1:172.21.15.50:6801/4039291270' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-05-20T21:59:42.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:42 smithi050 bash[28929]: cluster 2024-05-20T21:59:41.508574+0000 mon.a (mon.0) 316 : cluster 0 osdmap e7: 1 total, 0 up, 1 in 2024-05-20T21:59:42.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:42 smithi050 bash[28929]: audit 2024-05-20T21:59:41.509881+0000 mon.a (mon.0) 317 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T21:59:42.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:42 smithi050 bash[28929]: audit 2024-05-20T21:59:41.520246+0000 mon.a (mon.0) 318 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T21:59:42.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:42 smithi050 bash[28929]: audit 2024-05-20T21:59:41.841157+0000 mon.a (mon.0) 319 : audit 1 from='osd.0 v1:172.21.15.50:6801/4039291270' entity='osd.0' 2024-05-20T21:59:43.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:43 smithi145 bash[23893]: cluster 2024-05-20T21:59:41.084173+0000 osd.0 (osd.0) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T21:59:43.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:43 smithi145 bash[23893]: cluster 2024-05-20T21:59:41.084268+0000 osd.0 (osd.0) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T21:59:43.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:43 smithi145 bash[23893]: audit 2024-05-20T21:59:42.521728+0000 mon.a (mon.0) 320 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T21:59:43.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:43 smithi145 bash[23893]: cluster 2024-05-20T21:59:42.841847+0000 mon.a (mon.0) 321 : cluster 1 osd.0 v1:172.21.15.50:6801/4039291270 boot 2024-05-20T21:59:43.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:43 smithi145 bash[23893]: cluster 2024-05-20T21:59:42.841894+0000 mon.a (mon.0) 322 : cluster 0 osdmap e8: 1 total, 1 up, 1 in 2024-05-20T21:59:43.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:43 smithi145 bash[23893]: audit 2024-05-20T21:59:42.842153+0000 mon.a (mon.0) 323 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T21:59:43.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:43 smithi050 bash[21866]: cluster 2024-05-20T21:59:41.084173+0000 osd.0 (osd.0) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T21:59:43.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:43 smithi050 bash[21866]: cluster 2024-05-20T21:59:41.084268+0000 osd.0 (osd.0) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T21:59:43.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:43 smithi050 bash[21866]: audit 2024-05-20T21:59:42.521728+0000 mon.a (mon.0) 320 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T21:59:43.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:43 smithi050 bash[21866]: cluster 2024-05-20T21:59:42.841847+0000 mon.a (mon.0) 321 : cluster 1 osd.0 v1:172.21.15.50:6801/4039291270 boot 2024-05-20T21:59:43.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:43 smithi050 bash[21866]: cluster 2024-05-20T21:59:42.841894+0000 mon.a (mon.0) 322 : cluster 0 osdmap e8: 1 total, 1 up, 1 in 2024-05-20T21:59:43.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:43 smithi050 bash[21866]: audit 2024-05-20T21:59:42.842153+0000 mon.a (mon.0) 323 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T21:59:43.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:43 smithi050 bash[28929]: cluster 2024-05-20T21:59:41.084173+0000 osd.0 (osd.0) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T21:59:43.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:43 smithi050 bash[28929]: cluster 2024-05-20T21:59:41.084268+0000 osd.0 (osd.0) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T21:59:43.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:43 smithi050 bash[28929]: audit 2024-05-20T21:59:42.521728+0000 mon.a (mon.0) 320 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T21:59:43.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:43 smithi050 bash[28929]: cluster 2024-05-20T21:59:42.841847+0000 mon.a (mon.0) 321 : cluster 1 osd.0 v1:172.21.15.50:6801/4039291270 boot 2024-05-20T21:59:43.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:43 smithi050 bash[28929]: cluster 2024-05-20T21:59:42.841894+0000 mon.a (mon.0) 322 : cluster 0 osdmap e8: 1 total, 1 up, 1 in 2024-05-20T21:59:43.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:43 smithi050 bash[28929]: audit 2024-05-20T21:59:42.842153+0000 mon.a (mon.0) 323 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T21:59:44.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:44.231+0000 7f4a0d7fa640 1 -- 172.21.15.50:0/3188522346 <== mgr.14150 v1:172.21.15.50:6800/2944911247 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (unknown 0 0 3136715834) 0x7f49fc000bc0 con 0x7f49f806ee60 2024-05-20T21:59:44.234 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 0 on host 'smithi050' 2024-05-20T21:59:44.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:44.235+0000 7f4a1643a640 1 -- 172.21.15.50:0/3188522346 >> v1:172.21.15.50:6800/2944911247 conn(0x7f49f806ee60 legacy=0x7f49f8071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:59:44.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:44.235+0000 7f4a1643a640 1 -- 172.21.15.50:0/3188522346 >> v1:172.21.15.50:6789/0 conn(0x7f4a101021c0 legacy=0x7f4a10101a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T21:59:44.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:44.235+0000 7f4a1643a640 1 -- 172.21.15.50:0/3188522346 shutdown_connections 2024-05-20T21:59:44.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:44.235+0000 7f4a1643a640 1 -- 172.21.15.50:0/3188522346 >> 172.21.15.50:0/3188522346 conn(0x7f4a100fbbd0 msgr2=0x7f4a100fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T21:59:44.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:44.235+0000 7f4a1643a640 1 -- 172.21.15.50:0/3188522346 shutdown_connections 2024-05-20T21:59:44.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T21:59:44.239+0000 7f4a1643a640 1 -- 172.21.15.50:0/3188522346 wait complete. 2024-05-20T21:59:44.874 DEBUG:teuthology.orchestra.run.smithi050:osd.0> sudo journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.0.service 2024-05-20T21:59:44.876 INFO:tasks.cephadm:Deploying osd.1 on smithi050 with /dev/vg_nvme/lv_3... 2024-05-20T21:59:44.877 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-20T21:59:45.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:44 smithi145 bash[23893]: cluster 2024-05-20T21:59:43.429821+0000 mgr.y (mgr.14150) 107 : cluster 0 pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:45.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:44 smithi145 bash[23893]: cluster 2024-05-20T21:59:43.851979+0000 mon.a (mon.0) 324 : cluster 0 osdmap e9: 1 total, 1 up, 1 in 2024-05-20T21:59:45.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:44 smithi145 bash[23893]: audit 2024-05-20T21:59:44.215216+0000 mon.a (mon.0) 325 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:59:45.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:44 smithi145 bash[23893]: audit 2024-05-20T21:59:44.222616+0000 mon.a (mon.0) 326 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:45.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:44 smithi145 bash[23893]: audit 2024-05-20T21:59:44.230407+0000 mon.a (mon.0) 327 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:45.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:44 smithi050 bash[28929]: cluster 2024-05-20T21:59:43.429821+0000 mgr.y (mgr.14150) 107 : cluster 0 pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:45.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:44 smithi050 bash[28929]: cluster 2024-05-20T21:59:43.851979+0000 mon.a (mon.0) 324 : cluster 0 osdmap e9: 1 total, 1 up, 1 in 2024-05-20T21:59:45.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:44 smithi050 bash[28929]: audit 2024-05-20T21:59:44.215216+0000 mon.a (mon.0) 325 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:59:45.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:44 smithi050 bash[28929]: audit 2024-05-20T21:59:44.222616+0000 mon.a (mon.0) 326 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:45.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:44 smithi050 bash[28929]: audit 2024-05-20T21:59:44.230407+0000 mon.a (mon.0) 327 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:45.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:44 smithi050 bash[21866]: cluster 2024-05-20T21:59:43.429821+0000 mgr.y (mgr.14150) 107 : cluster 0 pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T21:59:45.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:44 smithi050 bash[21866]: cluster 2024-05-20T21:59:43.851979+0000 mon.a (mon.0) 324 : cluster 0 osdmap e9: 1 total, 1 up, 1 in 2024-05-20T21:59:45.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:44 smithi050 bash[21866]: audit 2024-05-20T21:59:44.215216+0000 mon.a (mon.0) 325 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T21:59:45.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:44 smithi050 bash[21866]: audit 2024-05-20T21:59:44.222616+0000 mon.a (mon.0) 326 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:45.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:44 smithi050 bash[21866]: audit 2024-05-20T21:59:44.230407+0000 mon.a (mon.0) 327 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:47.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:46 smithi145 bash[23893]: cluster 2024-05-20T21:59:45.430284+0000 mgr.y (mgr.14150) 108 : cluster 0 pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T21:59:47.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:46 smithi050 bash[21866]: cluster 2024-05-20T21:59:45.430284+0000 mgr.y (mgr.14150) 108 : cluster 0 pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T21:59:47.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:46 smithi050 bash[28929]: cluster 2024-05-20T21:59:45.430284+0000 mgr.y (mgr.14150) 108 : cluster 0 pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T21:59:49.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:48 smithi145 bash[23893]: cluster 2024-05-20T21:59:47.430776+0000 mgr.y (mgr.14150) 109 : cluster 0 pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T21:59:49.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:48 smithi050 bash[21866]: cluster 2024-05-20T21:59:47.430776+0000 mgr.y (mgr.14150) 109 : cluster 0 pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T21:59:49.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:48 smithi050 bash[28929]: cluster 2024-05-20T21:59:47.430776+0000 mgr.y (mgr.14150) 109 : cluster 0 pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T21:59:49.208 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T21:59:51.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:50 smithi145 bash[23893]: cluster 2024-05-20T21:59:49.431285+0000 mgr.y (mgr.14150) 110 : cluster 0 pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T21:59:51.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:50 smithi050 bash[21866]: cluster 2024-05-20T21:59:49.431285+0000 mgr.y (mgr.14150) 110 : cluster 0 pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T21:59:51.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:50 smithi050 bash[28929]: cluster 2024-05-20T21:59:49.431285+0000 mgr.y (mgr.14150) 110 : cluster 0 pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T21:59:53.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:52 smithi145 bash[23893]: cluster 2024-05-20T21:59:51.431770+0000 mgr.y (mgr.14150) 111 : cluster 0 pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T21:59:53.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:52 smithi050 bash[28929]: cluster 2024-05-20T21:59:51.431770+0000 mgr.y (mgr.14150) 111 : cluster 0 pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T21:59:53.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:52 smithi050 bash[21866]: cluster 2024-05-20T21:59:51.431770+0000 mgr.y (mgr.14150) 111 : cluster 0 pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T21:59:53.206 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-20T21:59:53.338 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-20T21:59:53.354 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10+0 records in 2024-05-20T21:59:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:10+0 records out 2024-05-20T21:59:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112078 s, 936 MB/s 2024-05-20T21:59:53.354 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 2024-05-20T21:59:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping successful for: 2024-05-20T21:59:54.228 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_3 2024-05-20T21:59:55.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:54 smithi145 bash[23893]: cluster 2024-05-20T21:59:53.431988+0000 mgr.y (mgr.14150) 112 : cluster 0 pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T21:59:55.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:54 smithi145 bash[23893]: audit 2024-05-20T21:59:54.563674+0000 mon.a (mon.0) 328 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:55.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:54 smithi145 bash[23893]: audit 2024-05-20T21:59:54.571498+0000 mon.a (mon.0) 329 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:55.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:54 smithi145 bash[23893]: audit 2024-05-20T21:59:54.573385+0000 mon.a (mon.0) 330 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T21:59:55.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:54 smithi145 bash[23893]: audit 2024-05-20T21:59:54.580544+0000 mon.a (mon.0) 331 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:55.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:54 smithi145 bash[23893]: audit 2024-05-20T21:59:54.584539+0000 mon.a (mon.0) 332 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:55.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:54 smithi145 bash[23893]: audit 2024-05-20T21:59:54.586145+0000 mon.a (mon.0) 333 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:59:55.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:54 smithi145 bash[23893]: audit 2024-05-20T21:59:54.597307+0000 mon.a (mon.0) 334 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:55.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:54 smithi050 bash[21866]: cluster 2024-05-20T21:59:53.431988+0000 mgr.y (mgr.14150) 112 : cluster 0 pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T21:59:55.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:54 smithi050 bash[21866]: audit 2024-05-20T21:59:54.563674+0000 mon.a (mon.0) 328 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:55.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:54 smithi050 bash[21866]: audit 2024-05-20T21:59:54.571498+0000 mon.a (mon.0) 329 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:55.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:54 smithi050 bash[21866]: audit 2024-05-20T21:59:54.573385+0000 mon.a (mon.0) 330 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T21:59:55.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:54 smithi050 bash[21866]: audit 2024-05-20T21:59:54.580544+0000 mon.a (mon.0) 331 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:55.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:54 smithi050 bash[21866]: audit 2024-05-20T21:59:54.584539+0000 mon.a (mon.0) 332 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:55.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:54 smithi050 bash[21866]: audit 2024-05-20T21:59:54.586145+0000 mon.a (mon.0) 333 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:59:55.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:54 smithi050 bash[21866]: audit 2024-05-20T21:59:54.597307+0000 mon.a (mon.0) 334 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:55.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:54 smithi050 bash[28929]: cluster 2024-05-20T21:59:53.431988+0000 mgr.y (mgr.14150) 112 : cluster 0 pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T21:59:55.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:54 smithi050 bash[28929]: audit 2024-05-20T21:59:54.563674+0000 mon.a (mon.0) 328 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:55.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:54 smithi050 bash[28929]: audit 2024-05-20T21:59:54.571498+0000 mon.a (mon.0) 329 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:55.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:54 smithi050 bash[28929]: audit 2024-05-20T21:59:54.573385+0000 mon.a (mon.0) 330 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T21:59:55.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:54 smithi050 bash[28929]: audit 2024-05-20T21:59:54.580544+0000 mon.a (mon.0) 331 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:55.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:54 smithi050 bash[28929]: audit 2024-05-20T21:59:54.584539+0000 mon.a (mon.0) 332 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T21:59:55.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:54 smithi050 bash[28929]: audit 2024-05-20T21:59:54.586145+0000 mon.a (mon.0) 333 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T21:59:55.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:54 smithi050 bash[28929]: audit 2024-05-20T21:59:54.597307+0000 mon.a (mon.0) 334 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T21:59:56.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:55 smithi145 bash[23893]: cephadm 2024-05-20T21:59:54.556144+0000 mgr.y (mgr.14150) 113 : cephadm 1 Detected new or changed devices on smithi050 2024-05-20T21:59:56.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:55 smithi145 bash[23893]: cephadm 2024-05-20T21:59:54.574675+0000 mgr.y (mgr.14150) 114 : cephadm 1 Adjusting osd_memory_target on smithi050 to 16245M 2024-05-20T21:59:56.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:55 smithi050 bash[21866]: cephadm 2024-05-20T21:59:54.556144+0000 mgr.y (mgr.14150) 113 : cephadm 1 Detected new or changed devices on smithi050 2024-05-20T21:59:56.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:55 smithi050 bash[21866]: cephadm 2024-05-20T21:59:54.574675+0000 mgr.y (mgr.14150) 114 : cephadm 1 Adjusting osd_memory_target on smithi050 to 16245M 2024-05-20T21:59:56.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:55 smithi050 bash[28929]: cephadm 2024-05-20T21:59:54.556144+0000 mgr.y (mgr.14150) 113 : cephadm 1 Detected new or changed devices on smithi050 2024-05-20T21:59:56.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:55 smithi050 bash[28929]: cephadm 2024-05-20T21:59:54.574675+0000 mgr.y (mgr.14150) 114 : cephadm 1 Adjusting osd_memory_target on smithi050 to 16245M 2024-05-20T21:59:57.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:56 smithi145 bash[23893]: cluster 2024-05-20T21:59:55.432399+0000 mgr.y (mgr.14150) 115 : cluster 0 pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T21:59:57.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:56 smithi050 bash[21866]: cluster 2024-05-20T21:59:55.432399+0000 mgr.y (mgr.14150) 115 : cluster 0 pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T21:59:57.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:56 smithi050 bash[28929]: cluster 2024-05-20T21:59:55.432399+0000 mgr.y (mgr.14150) 115 : cluster 0 pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T21:59:58.966 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T21:59:59.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 21:59:58 smithi145 bash[23893]: cluster 2024-05-20T21:59:57.432854+0000 mgr.y (mgr.14150) 116 : cluster 0 pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T21:59:59.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 21:59:58 smithi050 bash[21866]: cluster 2024-05-20T21:59:57.432854+0000 mgr.y (mgr.14150) 116 : cluster 0 pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T21:59:59.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 21:59:58 smithi050 bash[28929]: cluster 2024-05-20T21:59:57.432854+0000 mgr.y (mgr.14150) 116 : cluster 0 pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:00.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:00 smithi050 bash[21866]: cluster 2024-05-20T21:59:59.433321+0000 mgr.y (mgr.14150) 117 : cluster 0 pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:00.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:00 smithi050 bash[21866]: cluster 2024-05-20T22:00:00.000156+0000 mon.a (mon.0) 335 : cluster 1 overall HEALTH_OK 2024-05-20T22:00:00.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:00 smithi050 bash[28929]: cluster 2024-05-20T21:59:59.433321+0000 mgr.y (mgr.14150) 117 : cluster 0 pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:00.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:00 smithi050 bash[28929]: cluster 2024-05-20T22:00:00.000156+0000 mon.a (mon.0) 335 : cluster 1 overall HEALTH_OK 2024-05-20T22:00:01.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:00 smithi145 bash[23893]: cluster 2024-05-20T21:59:59.433321+0000 mgr.y (mgr.14150) 117 : cluster 0 pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:01.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:00 smithi145 bash[23893]: cluster 2024-05-20T22:00:00.000156+0000 mon.a (mon.0) 335 : cluster 1 overall HEALTH_OK 2024-05-20T22:00:01.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe6986b640 1 -- 172.21.15.50:0/3559277486 >> v1:172.21.15.50:6790/0 conn(0x7efe64105d50 legacy=0x7efe64108140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:00:01.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe6986b640 1 -- 172.21.15.50:0/3559277486 shutdown_connections 2024-05-20T22:00:01.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe6986b640 1 -- 172.21.15.50:0/3559277486 >> 172.21.15.50:0/3559277486 conn(0x7efe640fbbb0 msgr2=0x7efe640fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:00:01.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe6986b640 1 -- 172.21.15.50:0/3559277486 shutdown_connections 2024-05-20T22:00:01.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe6986b640 1 -- 172.21.15.50:0/3559277486 wait complete. 2024-05-20T22:00:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe6986b640 1 Processor -- start 2024-05-20T22:00:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe6986b640 1 -- start start 2024-05-20T22:00:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe6986b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7efe64197570 con 0x7efe64105d50 2024-05-20T22:00:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe6986b640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7efe641a2dc0 con 0x7efe64109860 2024-05-20T22:00:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe5bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efe64105d50 0x7efe6419cf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37766/0 (socket says 172.21.15.50:37766) 2024-05-20T22:00:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe5bfff640 1 -- 172.21.15.50:0/2794564744 learned_addr learned my addr 172.21.15.50:0/2794564744 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:00:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe62ffd640 1 --1- 172.21.15.50:0/2794564744 >> v1:172.21.15.50:6790/0 conn(0x7efe64102240 0x7efe64196a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:51456/0 (socket says 172.21.15.50:51456) 2024-05-20T22:00:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe6986b640 1 -- 172.21.15.50:0/2794564744 --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7efe641a3fa0 con 0x7efe64102240 2024-05-20T22:00:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2699890388 0 0) 0x7efe641a3fa0 con 0x7efe64102240 2024-05-20T22:00:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe50005020 con 0x7efe64102240 2024-05-20T22:00:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2577758344 0 0) 0x7efe64197570 con 0x7efe64105d50 2024-05-20T22:00:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe641a3fa0 con 0x7efe64105d50 2024-05-20T22:00:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4195432706 0 0) 0x7efe641a2dc0 con 0x7efe64109860 2024-05-20T22:00:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe64197570 con 0x7efe64109860 2024-05-20T22:00:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1334382315 0 0) 0x7efe50005020 con 0x7efe64102240 2024-05-20T22:00:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe641a2dc0 con 0x7efe64102240 2024-05-20T22:00:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 362418236 0 0) 0x7efe641a3fa0 con 0x7efe64105d50 2024-05-20T22:00:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe50005020 con 0x7efe64105d50 2024-05-20T22:00:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7efe54001820 con 0x7efe64102240 2024-05-20T22:00:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.515+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7efe4c004310 con 0x7efe64105d50 2024-05-20T22:00:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.519+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 550022812 0 0) 0x7efe641a2dc0 con 0x7efe64102240 2024-05-20T22:00:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.519+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 >> v1:172.21.15.145:6789/0 conn(0x7efe64109860 legacy=0x7efe641a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:00:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.519+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 >> v1:172.21.15.50:6789/0 conn(0x7efe64105d50 legacy=0x7efe6419cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:00:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.519+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe641a5180 con 0x7efe64102240 2024-05-20T22:00:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.519+0000 7efe6986b640 1 -- 172.21.15.50:0/2794564744 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efe641a41d0 con 0x7efe64102240 2024-05-20T22:00:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.519+0000 7efe6986b640 1 -- 172.21.15.50:0/2794564744 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7efe641a4710 con 0x7efe64102240 2024-05-20T22:00:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.519+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7efe54003aa0 con 0x7efe64102240 2024-05-20T22:00:01.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.519+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7efe54005b30 con 0x7efe64102240 2024-05-20T22:00:01.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.519+0000 7efe6986b640 1 -- 172.21.15.50:0/2794564744 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe440050b0 con 0x7efe64102240 2024-05-20T22:00:01.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.519+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 14) ==== 92025+0+0 (unknown 890788531 0 0) 0x7efe54003610 con 0x7efe64102240 2024-05-20T22:00:01.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.519+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(9..9 src has 1..9) ==== 1541+0+0 (unknown 2620362462 0 0) 0x7efe540880a0 con 0x7efe64102240 2024-05-20T22:00:01.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.523+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7efe54056af0 con 0x7efe64102240 2024-05-20T22:00:01.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:01.727+0000 7efe6986b640 1 -- 172.21.15.50:0/2794564744 --> v1:172.21.15.50:6800/2944911247 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7efe44000bc0 con 0x7efe5006ecb0 2024-05-20T22:00:02.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:01 smithi145 bash[23893]: audit 2024-05-20T22:00:01.738070+0000 mon.a (mon.0) 336 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:00:02.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:01 smithi145 bash[23893]: audit 2024-05-20T22:00:01.743555+0000 mon.a (mon.0) 337 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:00:02.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:01 smithi145 bash[23893]: audit 2024-05-20T22:00:01.744865+0000 mon.a (mon.0) 338 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:00:02.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:01 smithi050 bash[21866]: audit 2024-05-20T22:00:01.738070+0000 mon.a (mon.0) 336 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:00:02.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:01 smithi050 bash[21866]: audit 2024-05-20T22:00:01.743555+0000 mon.a (mon.0) 337 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:00:02.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:01 smithi050 bash[21866]: audit 2024-05-20T22:00:01.744865+0000 mon.a (mon.0) 338 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:00:02.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:01 smithi050 bash[28929]: audit 2024-05-20T22:00:01.738070+0000 mon.a (mon.0) 336 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:00:02.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:01 smithi050 bash[28929]: audit 2024-05-20T22:00:01.743555+0000 mon.a (mon.0) 337 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:00:02.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:01 smithi050 bash[28929]: audit 2024-05-20T22:00:01.744865+0000 mon.a (mon.0) 338 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:00:03.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:02 smithi145 bash[23893]: cluster 2024-05-20T22:00:01.433659+0000 mgr.y (mgr.14150) 118 : cluster 0 pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:03.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:02 smithi145 bash[23893]: audit 2024-05-20T22:00:01.731634+0000 mgr.y (mgr.14150) 119 : audit 0 from='client.24146 v1:172.21.15.50:0/2794564744' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:00:03.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:02 smithi050 bash[21866]: cluster 2024-05-20T22:00:01.433659+0000 mgr.y (mgr.14150) 118 : cluster 0 pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:03.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:02 smithi050 bash[21866]: audit 2024-05-20T22:00:01.731634+0000 mgr.y (mgr.14150) 119 : audit 0 from='client.24146 v1:172.21.15.50:0/2794564744' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:00:03.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:02 smithi050 bash[28929]: cluster 2024-05-20T22:00:01.433659+0000 mgr.y (mgr.14150) 118 : cluster 0 pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:03.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:02 smithi050 bash[28929]: audit 2024-05-20T22:00:01.731634+0000 mgr.y (mgr.14150) 119 : audit 0 from='client.24146 v1:172.21.15.50:0/2794564744' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:00:05.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:04 smithi145 bash[23893]: cluster 2024-05-20T22:00:03.434064+0000 mgr.y (mgr.14150) 120 : cluster 0 pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:05.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:04 smithi050 bash[21866]: cluster 2024-05-20T22:00:03.434064+0000 mgr.y (mgr.14150) 120 : cluster 0 pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:05.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:04 smithi050 bash[28929]: cluster 2024-05-20T22:00:03.434064+0000 mgr.y (mgr.14150) 120 : cluster 0 pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:07.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:06 smithi050 bash[21866]: cluster 2024-05-20T22:00:05.434541+0000 mgr.y (mgr.14150) 121 : cluster 0 pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:07.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:06 smithi050 bash[28929]: cluster 2024-05-20T22:00:05.434541+0000 mgr.y (mgr.14150) 121 : cluster 0 pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:07.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:06 smithi145 bash[23893]: cluster 2024-05-20T22:00:05.434541+0000 mgr.y (mgr.14150) 121 : cluster 0 pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:09.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:08 smithi050 bash[21866]: cluster 2024-05-20T22:00:07.435049+0000 mgr.y (mgr.14150) 122 : cluster 0 pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:09.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:08 smithi050 bash[28929]: cluster 2024-05-20T22:00:07.435049+0000 mgr.y (mgr.14150) 122 : cluster 0 pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:09.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:08 smithi145 bash[23893]: cluster 2024-05-20T22:00:07.435049+0000 mgr.y (mgr.14150) 122 : cluster 0 pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:10.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:09 smithi145 bash[23893]: audit 2024-05-20T22:00:09.900273+0000 mon.c (mon.2) 4 : audit 1 from='client.? v1:172.21.15.50:0/4035462532' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "507cd562-6be9-4469-bafe-17f52cd04ea0"}]: dispatch 2024-05-20T22:00:10.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:09 smithi145 bash[23893]: audit 2024-05-20T22:00:09.900773+0000 mon.a (mon.0) 339 : audit 1 from='client.24152 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "507cd562-6be9-4469-bafe-17f52cd04ea0"}]: dispatch 2024-05-20T22:00:10.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:09 smithi145 bash[23893]: audit 2024-05-20T22:00:09.903622+0000 mon.a (mon.0) 340 : audit 1 from='client.24152 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "507cd562-6be9-4469-bafe-17f52cd04ea0"}]': finished 2024-05-20T22:00:10.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:09 smithi145 bash[23893]: cluster 2024-05-20T22:00:09.908545+0000 mon.a (mon.0) 341 : cluster 0 osdmap e10: 2 total, 1 up, 2 in 2024-05-20T22:00:10.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:09 smithi145 bash[23893]: audit 2024-05-20T22:00:09.909735+0000 mon.a (mon.0) 342 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T22:00:10.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:09 smithi050 bash[21866]: audit 2024-05-20T22:00:09.900273+0000 mon.c (mon.2) 4 : audit 1 from='client.? v1:172.21.15.50:0/4035462532' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "507cd562-6be9-4469-bafe-17f52cd04ea0"}]: dispatch 2024-05-20T22:00:10.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:09 smithi050 bash[21866]: audit 2024-05-20T22:00:09.900773+0000 mon.a (mon.0) 339 : audit 1 from='client.24152 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "507cd562-6be9-4469-bafe-17f52cd04ea0"}]: dispatch 2024-05-20T22:00:10.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:09 smithi050 bash[21866]: audit 2024-05-20T22:00:09.903622+0000 mon.a (mon.0) 340 : audit 1 from='client.24152 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "507cd562-6be9-4469-bafe-17f52cd04ea0"}]': finished 2024-05-20T22:00:10.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:09 smithi050 bash[21866]: cluster 2024-05-20T22:00:09.908545+0000 mon.a (mon.0) 341 : cluster 0 osdmap e10: 2 total, 1 up, 2 in 2024-05-20T22:00:10.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:09 smithi050 bash[21866]: audit 2024-05-20T22:00:09.909735+0000 mon.a (mon.0) 342 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T22:00:10.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:09 smithi050 bash[28929]: audit 2024-05-20T22:00:09.900273+0000 mon.c (mon.2) 4 : audit 1 from='client.? v1:172.21.15.50:0/4035462532' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "507cd562-6be9-4469-bafe-17f52cd04ea0"}]: dispatch 2024-05-20T22:00:10.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:09 smithi050 bash[28929]: audit 2024-05-20T22:00:09.900773+0000 mon.a (mon.0) 339 : audit 1 from='client.24152 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "507cd562-6be9-4469-bafe-17f52cd04ea0"}]: dispatch 2024-05-20T22:00:10.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:09 smithi050 bash[28929]: audit 2024-05-20T22:00:09.903622+0000 mon.a (mon.0) 340 : audit 1 from='client.24152 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "507cd562-6be9-4469-bafe-17f52cd04ea0"}]': finished 2024-05-20T22:00:10.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:09 smithi050 bash[28929]: cluster 2024-05-20T22:00:09.908545+0000 mon.a (mon.0) 341 : cluster 0 osdmap e10: 2 total, 1 up, 2 in 2024-05-20T22:00:10.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:09 smithi050 bash[28929]: audit 2024-05-20T22:00:09.909735+0000 mon.a (mon.0) 342 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T22:00:11.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:10 smithi145 bash[23893]: cluster 2024-05-20T22:00:09.435420+0000 mgr.y (mgr.14150) 123 : cluster 0 pgmap v85: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:11.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:10 smithi145 bash[23893]: audit 2024-05-20T22:00:10.601404+0000 mon.a (mon.0) 343 : audit 0 from='client.? v1:172.21.15.50:0/2384494624' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:00:11.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:10 smithi050 bash[21866]: cluster 2024-05-20T22:00:09.435420+0000 mgr.y (mgr.14150) 123 : cluster 0 pgmap v85: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:11.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:10 smithi050 bash[21866]: audit 2024-05-20T22:00:10.601404+0000 mon.a (mon.0) 343 : audit 0 from='client.? v1:172.21.15.50:0/2384494624' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:00:11.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:10 smithi050 bash[28929]: cluster 2024-05-20T22:00:09.435420+0000 mgr.y (mgr.14150) 123 : cluster 0 pgmap v85: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:11.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:10 smithi050 bash[28929]: audit 2024-05-20T22:00:10.601404+0000 mon.a (mon.0) 343 : audit 0 from='client.? v1:172.21.15.50:0/2384494624' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:00:13.272 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:12 smithi050 bash[28929]: cluster 2024-05-20T22:00:11.435843+0000 mgr.y (mgr.14150) 124 : cluster 0 pgmap v87: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:13.272 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:12 smithi050 bash[21866]: cluster 2024-05-20T22:00:11.435843+0000 mgr.y (mgr.14150) 124 : cluster 0 pgmap v87: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:13.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:12 smithi145 bash[23893]: cluster 2024-05-20T22:00:11.435843+0000 mgr.y (mgr.14150) 124 : cluster 0 pgmap v87: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:15.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:14 smithi145 bash[23893]: cluster 2024-05-20T22:00:13.436281+0000 mgr.y (mgr.14150) 125 : cluster 0 pgmap v88: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:15.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:14 smithi050 bash[21866]: cluster 2024-05-20T22:00:13.436281+0000 mgr.y (mgr.14150) 125 : cluster 0 pgmap v88: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:15.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:14 smithi050 bash[28929]: cluster 2024-05-20T22:00:13.436281+0000 mgr.y (mgr.14150) 125 : cluster 0 pgmap v88: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:17.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:16 smithi145 bash[23893]: cluster 2024-05-20T22:00:15.436777+0000 mgr.y (mgr.14150) 126 : cluster 0 pgmap v89: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:17.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:16 smithi050 bash[21866]: cluster 2024-05-20T22:00:15.436777+0000 mgr.y (mgr.14150) 126 : cluster 0 pgmap v89: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:17.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:16 smithi050 bash[28929]: cluster 2024-05-20T22:00:15.436777+0000 mgr.y (mgr.14150) 126 : cluster 0 pgmap v89: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:19.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:18 smithi050 bash[21866]: cluster 2024-05-20T22:00:17.437231+0000 mgr.y (mgr.14150) 127 : cluster 0 pgmap v90: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:19.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:18 smithi050 bash[28929]: cluster 2024-05-20T22:00:17.437231+0000 mgr.y (mgr.14150) 127 : cluster 0 pgmap v90: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:19.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:18 smithi145 bash[23893]: cluster 2024-05-20T22:00:17.437231+0000 mgr.y (mgr.14150) 127 : cluster 0 pgmap v90: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:21.282 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:20 smithi050 bash[21866]: cluster 2024-05-20T22:00:19.437672+0000 mgr.y (mgr.14150) 128 : cluster 0 pgmap v91: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:21.282 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:20 smithi050 bash[28929]: cluster 2024-05-20T22:00:19.437672+0000 mgr.y (mgr.14150) 128 : cluster 0 pgmap v91: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:21.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:20 smithi145 bash[23893]: cluster 2024-05-20T22:00:19.437672+0000 mgr.y (mgr.14150) 128 : cluster 0 pgmap v91: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:23.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:22 smithi050 bash[21866]: cluster 2024-05-20T22:00:21.437974+0000 mgr.y (mgr.14150) 129 : cluster 0 pgmap v92: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:23.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:22 smithi050 bash[21866]: audit 2024-05-20T22:00:22.391247+0000 mon.a (mon.0) 344 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-20T22:00:23.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:22 smithi050 bash[21866]: audit 2024-05-20T22:00:22.392627+0000 mon.a (mon.0) 345 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:00:23.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:22 smithi050 bash[28929]: cluster 2024-05-20T22:00:21.437974+0000 mgr.y (mgr.14150) 129 : cluster 0 pgmap v92: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:23.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:22 smithi050 bash[28929]: audit 2024-05-20T22:00:22.391247+0000 mon.a (mon.0) 344 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-20T22:00:23.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:22 smithi050 bash[28929]: audit 2024-05-20T22:00:22.392627+0000 mon.a (mon.0) 345 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:00:23.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:22 smithi145 bash[23893]: cluster 2024-05-20T22:00:21.437974+0000 mgr.y (mgr.14150) 129 : cluster 0 pgmap v92: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:23.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:22 smithi145 bash[23893]: audit 2024-05-20T22:00:22.391247+0000 mon.a (mon.0) 344 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-20T22:00:23.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:22 smithi145 bash[23893]: audit 2024-05-20T22:00:22.392627+0000 mon.a (mon.0) 345 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:00:24.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:23 smithi145 bash[23893]: cephadm 2024-05-20T22:00:22.393920+0000 mgr.y (mgr.14150) 130 : cephadm 1 Deploying daemon osd.1 on smithi050 2024-05-20T22:00:24.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:23 smithi050 bash[28929]: cephadm 2024-05-20T22:00:22.393920+0000 mgr.y (mgr.14150) 130 : cephadm 1 Deploying daemon osd.1 on smithi050 2024-05-20T22:00:24.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:23 smithi050 bash[21866]: cephadm 2024-05-20T22:00:22.393920+0000 mgr.y (mgr.14150) 130 : cephadm 1 Deploying daemon osd.1 on smithi050 2024-05-20T22:00:25.281 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:24 smithi050 bash[21866]: cluster 2024-05-20T22:00:23.438319+0000 mgr.y (mgr.14150) 131 : cluster 0 pgmap v93: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:25.281 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:24 smithi050 bash[28929]: cluster 2024-05-20T22:00:23.438319+0000 mgr.y (mgr.14150) 131 : cluster 0 pgmap v93: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:25.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:24 smithi145 bash[23893]: cluster 2024-05-20T22:00:23.438319+0000 mgr.y (mgr.14150) 131 : cluster 0 pgmap v93: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:26.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:26 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:00:26.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:26 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:00:26.691 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:00:26 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:00:26.691 INFO:journalctl@ceph.osd.0.smithi050.stdout:May 20 22:00:26 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:00:26.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:26 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:00:26.948 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:00:26 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:00:26.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:26 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:00:26.948 INFO:journalctl@ceph.osd.0.smithi050.stdout:May 20 22:00:26 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:00:27.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:26 smithi145 bash[23893]: cluster 2024-05-20T22:00:25.438623+0000 mgr.y (mgr.14150) 132 : cluster 0 pgmap v94: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:27.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:26 smithi145 bash[23893]: audit 2024-05-20T22:00:26.957719+0000 mon.a (mon.0) 346 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:00:27.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:26 smithi145 bash[23893]: audit 2024-05-20T22:00:26.961730+0000 mon.a (mon.0) 347 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:27.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:26 smithi145 bash[23893]: audit 2024-05-20T22:00:26.966923+0000 mon.a (mon.0) 348 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:27.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:26 smithi050 bash[21866]: cluster 2024-05-20T22:00:25.438623+0000 mgr.y (mgr.14150) 132 : cluster 0 pgmap v94: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:27.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:26 smithi050 bash[21866]: audit 2024-05-20T22:00:26.957719+0000 mon.a (mon.0) 346 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:00:27.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:26 smithi050 bash[21866]: audit 2024-05-20T22:00:26.961730+0000 mon.a (mon.0) 347 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:27.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:26 smithi050 bash[21866]: audit 2024-05-20T22:00:26.966923+0000 mon.a (mon.0) 348 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:27.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:26 smithi050 bash[28929]: cluster 2024-05-20T22:00:25.438623+0000 mgr.y (mgr.14150) 132 : cluster 0 pgmap v94: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:27.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:26 smithi050 bash[28929]: audit 2024-05-20T22:00:26.957719+0000 mon.a (mon.0) 346 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:00:27.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:26 smithi050 bash[28929]: audit 2024-05-20T22:00:26.961730+0000 mon.a (mon.0) 347 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:27.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:26 smithi050 bash[28929]: audit 2024-05-20T22:00:26.966923+0000 mon.a (mon.0) 348 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:29.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:28 smithi145 bash[23893]: cluster 2024-05-20T22:00:27.439013+0000 mgr.y (mgr.14150) 133 : cluster 0 pgmap v95: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:29.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:28 smithi050 bash[21866]: cluster 2024-05-20T22:00:27.439013+0000 mgr.y (mgr.14150) 133 : cluster 0 pgmap v95: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:29.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:28 smithi050 bash[28929]: cluster 2024-05-20T22:00:27.439013+0000 mgr.y (mgr.14150) 133 : cluster 0 pgmap v95: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:31.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:30 smithi145 bash[23893]: cluster 2024-05-20T22:00:29.439435+0000 mgr.y (mgr.14150) 134 : cluster 0 pgmap v96: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:31.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:30 smithi050 bash[21866]: cluster 2024-05-20T22:00:29.439435+0000 mgr.y (mgr.14150) 134 : cluster 0 pgmap v96: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:31.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:30 smithi050 bash[28929]: cluster 2024-05-20T22:00:29.439435+0000 mgr.y (mgr.14150) 134 : cluster 0 pgmap v96: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:33.370 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:33 smithi050 bash[21866]: cluster 2024-05-20T22:00:31.439930+0000 mgr.y (mgr.14150) 135 : cluster 0 pgmap v97: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:33.370 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:33 smithi050 bash[28929]: cluster 2024-05-20T22:00:31.439930+0000 mgr.y (mgr.14150) 135 : cluster 0 pgmap v97: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:33.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:33 smithi145 bash[23893]: cluster 2024-05-20T22:00:31.439930+0000 mgr.y (mgr.14150) 135 : cluster 0 pgmap v97: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:34.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:34 smithi145 bash[23893]: audit 2024-05-20T22:00:33.375982+0000 mon.a (mon.0) 349 : audit 1 from='osd.1 v1:172.21.15.50:6805/4214903941' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-20T22:00:34.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:34 smithi145 bash[23893]: audit 2024-05-20T22:00:33.847665+0000 mon.a (mon.0) 350 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:34.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:34 smithi145 bash[23893]: audit 2024-05-20T22:00:33.851721+0000 mon.a (mon.0) 351 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:34.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:34 smithi145 bash[23893]: audit 2024-05-20T22:00:33.852666+0000 mon.a (mon.0) 352 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:00:34.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:34 smithi145 bash[23893]: audit 2024-05-20T22:00:33.853320+0000 mon.a (mon.0) 353 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:00:34.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:34 smithi145 bash[23893]: audit 2024-05-20T22:00:33.857443+0000 mon.a (mon.0) 354 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:34.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:34 smithi050 bash[21866]: audit 2024-05-20T22:00:33.375982+0000 mon.a (mon.0) 349 : audit 1 from='osd.1 v1:172.21.15.50:6805/4214903941' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-20T22:00:34.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:34 smithi050 bash[21866]: audit 2024-05-20T22:00:33.847665+0000 mon.a (mon.0) 350 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:34.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:34 smithi050 bash[21866]: audit 2024-05-20T22:00:33.851721+0000 mon.a (mon.0) 351 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:34.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:34 smithi050 bash[21866]: audit 2024-05-20T22:00:33.852666+0000 mon.a (mon.0) 352 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:00:34.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:34 smithi050 bash[21866]: audit 2024-05-20T22:00:33.853320+0000 mon.a (mon.0) 353 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:00:34.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:34 smithi050 bash[21866]: audit 2024-05-20T22:00:33.857443+0000 mon.a (mon.0) 354 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:34.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:34 smithi050 bash[28929]: audit 2024-05-20T22:00:33.375982+0000 mon.a (mon.0) 349 : audit 1 from='osd.1 v1:172.21.15.50:6805/4214903941' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-20T22:00:34.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:34 smithi050 bash[28929]: audit 2024-05-20T22:00:33.847665+0000 mon.a (mon.0) 350 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:34.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:34 smithi050 bash[28929]: audit 2024-05-20T22:00:33.851721+0000 mon.a (mon.0) 351 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:34.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:34 smithi050 bash[28929]: audit 2024-05-20T22:00:33.852666+0000 mon.a (mon.0) 352 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:00:34.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:34 smithi050 bash[28929]: audit 2024-05-20T22:00:33.853320+0000 mon.a (mon.0) 353 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:00:34.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:34 smithi050 bash[28929]: audit 2024-05-20T22:00:33.857443+0000 mon.a (mon.0) 354 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:35.031 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:35 smithi050 bash[21866]: cluster 2024-05-20T22:00:33.440294+0000 mgr.y (mgr.14150) 136 : cluster 0 pgmap v98: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:35.031 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:35 smithi050 bash[21866]: audit 2024-05-20T22:00:34.011343+0000 mon.a (mon.0) 355 : audit 1 from='osd.1 v1:172.21.15.50:6805/4214903941' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-20T22:00:35.031 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:35 smithi050 bash[21866]: cluster 2024-05-20T22:00:34.016488+0000 mon.a (mon.0) 356 : cluster 0 osdmap e11: 2 total, 1 up, 2 in 2024-05-20T22:00:35.031 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:35 smithi050 bash[21866]: audit 2024-05-20T22:00:34.017178+0000 mon.a (mon.0) 357 : audit 1 from='osd.1 v1:172.21.15.50:6805/4214903941' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-05-20T22:00:35.031 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:35 smithi050 bash[21866]: audit 2024-05-20T22:00:34.017640+0000 mon.a (mon.0) 358 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T22:00:35.031 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:35 smithi050 bash[28929]: cluster 2024-05-20T22:00:33.440294+0000 mgr.y (mgr.14150) 136 : cluster 0 pgmap v98: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:35.032 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:35 smithi050 bash[28929]: audit 2024-05-20T22:00:34.011343+0000 mon.a (mon.0) 355 : audit 1 from='osd.1 v1:172.21.15.50:6805/4214903941' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-20T22:00:35.032 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:35 smithi050 bash[28929]: cluster 2024-05-20T22:00:34.016488+0000 mon.a (mon.0) 356 : cluster 0 osdmap e11: 2 total, 1 up, 2 in 2024-05-20T22:00:35.032 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:35 smithi050 bash[28929]: audit 2024-05-20T22:00:34.017178+0000 mon.a (mon.0) 357 : audit 1 from='osd.1 v1:172.21.15.50:6805/4214903941' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-05-20T22:00:35.032 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:35 smithi050 bash[28929]: audit 2024-05-20T22:00:34.017640+0000 mon.a (mon.0) 358 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T22:00:35.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:35 smithi145 bash[23893]: cluster 2024-05-20T22:00:33.440294+0000 mgr.y (mgr.14150) 136 : cluster 0 pgmap v98: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:35.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:35 smithi145 bash[23893]: audit 2024-05-20T22:00:34.011343+0000 mon.a (mon.0) 355 : audit 1 from='osd.1 v1:172.21.15.50:6805/4214903941' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-20T22:00:35.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:35 smithi145 bash[23893]: cluster 2024-05-20T22:00:34.016488+0000 mon.a (mon.0) 356 : cluster 0 osdmap e11: 2 total, 1 up, 2 in 2024-05-20T22:00:35.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:35 smithi145 bash[23893]: audit 2024-05-20T22:00:34.017178+0000 mon.a (mon.0) 357 : audit 1 from='osd.1 v1:172.21.15.50:6805/4214903941' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-05-20T22:00:35.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:35 smithi145 bash[23893]: audit 2024-05-20T22:00:34.017640+0000 mon.a (mon.0) 358 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T22:00:36.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:36 smithi145 bash[23893]: audit 2024-05-20T22:00:35.013511+0000 mon.a (mon.0) 359 : audit 1 from='osd.1 v1:172.21.15.50:6805/4214903941' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-05-20T22:00:36.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:36 smithi145 bash[23893]: cluster 2024-05-20T22:00:35.018561+0000 mon.a (mon.0) 360 : cluster 0 osdmap e12: 2 total, 1 up, 2 in 2024-05-20T22:00:36.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:36 smithi145 bash[23893]: audit 2024-05-20T22:00:35.020160+0000 mon.a (mon.0) 361 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T22:00:36.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:36 smithi145 bash[23893]: audit 2024-05-20T22:00:35.027206+0000 mon.a (mon.0) 362 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T22:00:36.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:36 smithi050 bash[21866]: audit 2024-05-20T22:00:35.013511+0000 mon.a (mon.0) 359 : audit 1 from='osd.1 v1:172.21.15.50:6805/4214903941' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-05-20T22:00:36.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:36 smithi050 bash[21866]: cluster 2024-05-20T22:00:35.018561+0000 mon.a (mon.0) 360 : cluster 0 osdmap e12: 2 total, 1 up, 2 in 2024-05-20T22:00:36.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:36 smithi050 bash[21866]: audit 2024-05-20T22:00:35.020160+0000 mon.a (mon.0) 361 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T22:00:36.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:36 smithi050 bash[21866]: audit 2024-05-20T22:00:35.027206+0000 mon.a (mon.0) 362 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T22:00:36.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:36 smithi050 bash[28929]: audit 2024-05-20T22:00:35.013511+0000 mon.a (mon.0) 359 : audit 1 from='osd.1 v1:172.21.15.50:6805/4214903941' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-05-20T22:00:36.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:36 smithi050 bash[28929]: cluster 2024-05-20T22:00:35.018561+0000 mon.a (mon.0) 360 : cluster 0 osdmap e12: 2 total, 1 up, 2 in 2024-05-20T22:00:36.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:36 smithi050 bash[28929]: audit 2024-05-20T22:00:35.020160+0000 mon.a (mon.0) 361 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T22:00:36.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:36 smithi050 bash[28929]: audit 2024-05-20T22:00:35.027206+0000 mon.a (mon.0) 362 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T22:00:37.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:37.254+0000 7efe68869640 1 -- 172.21.15.50:0/2794564744 <== mgr.14150 v1:172.21.15.50:6800/2944911247 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (unknown 0 0 3873673870) 0x7efe44000bc0 con 0x7efe5006ecb0 2024-05-20T22:00:37.255 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 1 on host 'smithi050' 2024-05-20T22:00:37.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:37.258+0000 7efe6986b640 1 -- 172.21.15.50:0/2794564744 >> v1:172.21.15.50:6800/2944911247 conn(0x7efe5006ecb0 legacy=0x7efe50071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:00:37.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:37.258+0000 7efe6986b640 1 -- 172.21.15.50:0/2794564744 >> v1:172.21.15.50:6790/0 conn(0x7efe64102240 legacy=0x7efe64196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:00:37.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:37.258+0000 7efe6986b640 1 -- 172.21.15.50:0/2794564744 shutdown_connections 2024-05-20T22:00:37.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:37.258+0000 7efe6986b640 1 -- 172.21.15.50:0/2794564744 >> 172.21.15.50:0/2794564744 conn(0x7efe640fbbb0 msgr2=0x7efe640fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:00:37.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:37.258+0000 7efe6986b640 1 -- 172.21.15.50:0/2794564744 shutdown_connections 2024-05-20T22:00:37.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:37.258+0000 7efe6986b640 1 -- 172.21.15.50:0/2794564744 wait complete. 2024-05-20T22:00:37.302 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:37 smithi050 bash[21866]: cluster 2024-05-20T22:00:34.329973+0000 osd.1 (osd.1) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:00:37.302 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:37 smithi050 bash[21866]: cluster 2024-05-20T22:00:34.330072+0000 osd.1 (osd.1) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:00:37.302 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:37 smithi050 bash[21866]: cluster 2024-05-20T22:00:35.440707+0000 mgr.y (mgr.14150) 137 : cluster 0 pgmap v101: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:37.303 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:37 smithi050 bash[21866]: cluster 2024-05-20T22:00:36.028641+0000 mon.a (mon.0) 363 : cluster 1 osd.1 v1:172.21.15.50:6805/4214903941 boot 2024-05-20T22:00:37.303 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:37 smithi050 bash[21866]: cluster 2024-05-20T22:00:36.028736+0000 mon.a (mon.0) 364 : cluster 0 osdmap e13: 2 total, 2 up, 2 in 2024-05-20T22:00:37.303 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:37 smithi050 bash[21866]: audit 2024-05-20T22:00:36.029417+0000 mon.a (mon.0) 365 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T22:00:37.303 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:37 smithi050 bash[28929]: cluster 2024-05-20T22:00:34.329973+0000 osd.1 (osd.1) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:00:37.303 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:37 smithi050 bash[28929]: cluster 2024-05-20T22:00:34.330072+0000 osd.1 (osd.1) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:00:37.303 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:37 smithi050 bash[28929]: cluster 2024-05-20T22:00:35.440707+0000 mgr.y (mgr.14150) 137 : cluster 0 pgmap v101: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:37.303 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:37 smithi050 bash[28929]: cluster 2024-05-20T22:00:36.028641+0000 mon.a (mon.0) 363 : cluster 1 osd.1 v1:172.21.15.50:6805/4214903941 boot 2024-05-20T22:00:37.303 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:37 smithi050 bash[28929]: cluster 2024-05-20T22:00:36.028736+0000 mon.a (mon.0) 364 : cluster 0 osdmap e13: 2 total, 2 up, 2 in 2024-05-20T22:00:37.303 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:37 smithi050 bash[28929]: audit 2024-05-20T22:00:36.029417+0000 mon.a (mon.0) 365 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T22:00:37.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:37 smithi145 bash[23893]: cluster 2024-05-20T22:00:34.329973+0000 osd.1 (osd.1) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:00:37.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:37 smithi145 bash[23893]: cluster 2024-05-20T22:00:34.330072+0000 osd.1 (osd.1) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:00:37.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:37 smithi145 bash[23893]: cluster 2024-05-20T22:00:35.440707+0000 mgr.y (mgr.14150) 137 : cluster 0 pgmap v101: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T22:00:37.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:37 smithi145 bash[23893]: cluster 2024-05-20T22:00:36.028641+0000 mon.a (mon.0) 363 : cluster 1 osd.1 v1:172.21.15.50:6805/4214903941 boot 2024-05-20T22:00:37.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:37 smithi145 bash[23893]: cluster 2024-05-20T22:00:36.028736+0000 mon.a (mon.0) 364 : cluster 0 osdmap e13: 2 total, 2 up, 2 in 2024-05-20T22:00:37.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:37 smithi145 bash[23893]: audit 2024-05-20T22:00:36.029417+0000 mon.a (mon.0) 365 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T22:00:37.952 DEBUG:teuthology.orchestra.run.smithi050:osd.1> sudo journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.1.service 2024-05-20T22:00:37.955 INFO:tasks.cephadm:Deploying osd.2 on smithi050 with /dev/vg_nvme/lv_2... 2024-05-20T22:00:37.956 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-20T22:00:38.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:38 smithi145 bash[23893]: cluster 2024-05-20T22:00:37.035422+0000 mon.a (mon.0) 366 : cluster 0 osdmap e14: 2 total, 2 up, 2 in 2024-05-20T22:00:38.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:38 smithi145 bash[23893]: audit 2024-05-20T22:00:37.238470+0000 mon.a (mon.0) 367 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:00:38.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:38 smithi145 bash[23893]: audit 2024-05-20T22:00:37.244954+0000 mon.a (mon.0) 368 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:38.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:38 smithi145 bash[23893]: audit 2024-05-20T22:00:37.252384+0000 mon.a (mon.0) 369 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:38.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:38 smithi050 bash[21866]: cluster 2024-05-20T22:00:37.035422+0000 mon.a (mon.0) 366 : cluster 0 osdmap e14: 2 total, 2 up, 2 in 2024-05-20T22:00:38.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:38 smithi050 bash[21866]: audit 2024-05-20T22:00:37.238470+0000 mon.a (mon.0) 367 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:00:38.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:38 smithi050 bash[21866]: audit 2024-05-20T22:00:37.244954+0000 mon.a (mon.0) 368 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:38.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:38 smithi050 bash[21866]: audit 2024-05-20T22:00:37.252384+0000 mon.a (mon.0) 369 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:38.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:38 smithi050 bash[28929]: cluster 2024-05-20T22:00:37.035422+0000 mon.a (mon.0) 366 : cluster 0 osdmap e14: 2 total, 2 up, 2 in 2024-05-20T22:00:38.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:38 smithi050 bash[28929]: audit 2024-05-20T22:00:37.238470+0000 mon.a (mon.0) 367 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:00:38.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:38 smithi050 bash[28929]: audit 2024-05-20T22:00:37.244954+0000 mon.a (mon.0) 368 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:38.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:38 smithi050 bash[28929]: audit 2024-05-20T22:00:37.252384+0000 mon.a (mon.0) 369 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:39.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:39 smithi145 bash[23893]: cluster 2024-05-20T22:00:37.441157+0000 mgr.y (mgr.14150) 138 : cluster 0 pgmap v104: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:39.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:39 smithi050 bash[21866]: cluster 2024-05-20T22:00:37.441157+0000 mgr.y (mgr.14150) 138 : cluster 0 pgmap v104: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:39.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:39 smithi050 bash[28929]: cluster 2024-05-20T22:00:37.441157+0000 mgr.y (mgr.14150) 138 : cluster 0 pgmap v104: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:41.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:41 smithi145 bash[23893]: cluster 2024-05-20T22:00:39.441616+0000 mgr.y (mgr.14150) 139 : cluster 0 pgmap v105: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:41.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:41 smithi050 bash[21866]: cluster 2024-05-20T22:00:39.441616+0000 mgr.y (mgr.14150) 139 : cluster 0 pgmap v105: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:41.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:41 smithi050 bash[28929]: cluster 2024-05-20T22:00:39.441616+0000 mgr.y (mgr.14150) 139 : cluster 0 pgmap v105: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:42.253 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:00:43.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:43 smithi145 bash[23893]: cluster 2024-05-20T22:00:41.442069+0000 mgr.y (mgr.14150) 140 : cluster 0 pgmap v106: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:43.427 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:43 smithi050 bash[21866]: cluster 2024-05-20T22:00:41.442069+0000 mgr.y (mgr.14150) 140 : cluster 0 pgmap v106: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:43.428 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:43 smithi050 bash[28929]: cluster 2024-05-20T22:00:41.442069+0000 mgr.y (mgr.14150) 140 : cluster 0 pgmap v106: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:45.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:45 smithi145 bash[23893]: cluster 2024-05-20T22:00:43.442546+0000 mgr.y (mgr.14150) 141 : cluster 0 pgmap v107: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:45.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:45 smithi050 bash[21866]: cluster 2024-05-20T22:00:43.442546+0000 mgr.y (mgr.14150) 141 : cluster 0 pgmap v107: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:45.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:45 smithi050 bash[28929]: cluster 2024-05-20T22:00:43.442546+0000 mgr.y (mgr.14150) 141 : cluster 0 pgmap v107: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:46.096 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-20T22:00:46.306 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-20T22:00:46.325 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10+0 records in 2024-05-20T22:00:46.325 INFO:teuthology.orchestra.run.smithi050.stderr:10+0 records out 2024-05-20T22:00:46.325 INFO:teuthology.orchestra.run.smithi050.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0169614 s, 618 MB/s 2024-05-20T22:00:46.325 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 2024-05-20T22:00:46.326 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping successful for: 2024-05-20T22:00:47.201 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_2 2024-05-20T22:00:47.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:47 smithi145 bash[23893]: cluster 2024-05-20T22:00:45.443033+0000 mgr.y (mgr.14150) 142 : cluster 0 pgmap v108: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:47.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:47 smithi050 bash[21866]: cluster 2024-05-20T22:00:45.443033+0000 mgr.y (mgr.14150) 142 : cluster 0 pgmap v108: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:47.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:47 smithi050 bash[28929]: cluster 2024-05-20T22:00:45.443033+0000 mgr.y (mgr.14150) 142 : cluster 0 pgmap v108: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:48.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:48 smithi145 bash[23893]: cluster 2024-05-20T22:00:47.443497+0000 mgr.y (mgr.14150) 143 : cluster 0 pgmap v109: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:48.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:48 smithi145 bash[23893]: cephadm 2024-05-20T22:00:47.566570+0000 mgr.y (mgr.14150) 144 : cephadm 1 Detected new or changed devices on smithi050 2024-05-20T22:00:48.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:48 smithi145 bash[23893]: audit 2024-05-20T22:00:47.574390+0000 mon.a (mon.0) 370 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:48.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:48 smithi145 bash[23893]: audit 2024-05-20T22:00:47.582022+0000 mon.a (mon.0) 371 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:48.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:48 smithi145 bash[23893]: audit 2024-05-20T22:00:47.584056+0000 mon.a (mon.0) 372 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:00:48.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:48 smithi145 bash[23893]: audit 2024-05-20T22:00:47.585910+0000 mon.a (mon.0) 373 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:00:48.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:48 smithi145 bash[23893]: cephadm 2024-05-20T22:00:47.587170+0000 mgr.y (mgr.14150) 145 : cephadm 1 Adjusting osd_memory_target on smithi050 to 8122M 2024-05-20T22:00:48.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:48 smithi145 bash[23893]: audit 2024-05-20T22:00:47.593370+0000 mon.a (mon.0) 374 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:48.895 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:48 smithi145 bash[23893]: audit 2024-05-20T22:00:47.597481+0000 mon.a (mon.0) 375 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:00:48.895 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:48 smithi145 bash[23893]: audit 2024-05-20T22:00:47.598978+0000 mon.a (mon.0) 376 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:00:48.895 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:48 smithi145 bash[23893]: audit 2024-05-20T22:00:47.608535+0000 mon.a (mon.0) 377 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:48.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:48 smithi050 bash[21866]: cluster 2024-05-20T22:00:47.443497+0000 mgr.y (mgr.14150) 143 : cluster 0 pgmap v109: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:48.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:48 smithi050 bash[21866]: cephadm 2024-05-20T22:00:47.566570+0000 mgr.y (mgr.14150) 144 : cephadm 1 Detected new or changed devices on smithi050 2024-05-20T22:00:48.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:48 smithi050 bash[21866]: audit 2024-05-20T22:00:47.574390+0000 mon.a (mon.0) 370 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:48.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:48 smithi050 bash[21866]: audit 2024-05-20T22:00:47.582022+0000 mon.a (mon.0) 371 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:48.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:48 smithi050 bash[21866]: audit 2024-05-20T22:00:47.584056+0000 mon.a (mon.0) 372 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:00:48.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:48 smithi050 bash[21866]: audit 2024-05-20T22:00:47.585910+0000 mon.a (mon.0) 373 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:00:48.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:48 smithi050 bash[21866]: cephadm 2024-05-20T22:00:47.587170+0000 mgr.y (mgr.14150) 145 : cephadm 1 Adjusting osd_memory_target on smithi050 to 8122M 2024-05-20T22:00:48.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:48 smithi050 bash[21866]: audit 2024-05-20T22:00:47.593370+0000 mon.a (mon.0) 374 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:48.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:48 smithi050 bash[21866]: audit 2024-05-20T22:00:47.597481+0000 mon.a (mon.0) 375 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:00:48.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:48 smithi050 bash[21866]: audit 2024-05-20T22:00:47.598978+0000 mon.a (mon.0) 376 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:00:48.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:48 smithi050 bash[21866]: audit 2024-05-20T22:00:47.608535+0000 mon.a (mon.0) 377 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:48.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:48 smithi050 bash[28929]: cluster 2024-05-20T22:00:47.443497+0000 mgr.y (mgr.14150) 143 : cluster 0 pgmap v109: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:48.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:48 smithi050 bash[28929]: cephadm 2024-05-20T22:00:47.566570+0000 mgr.y (mgr.14150) 144 : cephadm 1 Detected new or changed devices on smithi050 2024-05-20T22:00:48.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:48 smithi050 bash[28929]: audit 2024-05-20T22:00:47.574390+0000 mon.a (mon.0) 370 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:48.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:48 smithi050 bash[28929]: audit 2024-05-20T22:00:47.582022+0000 mon.a (mon.0) 371 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:48.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:48 smithi050 bash[28929]: audit 2024-05-20T22:00:47.584056+0000 mon.a (mon.0) 372 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:00:48.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:48 smithi050 bash[28929]: audit 2024-05-20T22:00:47.585910+0000 mon.a (mon.0) 373 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:00:48.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:48 smithi050 bash[28929]: cephadm 2024-05-20T22:00:47.587170+0000 mgr.y (mgr.14150) 145 : cephadm 1 Adjusting osd_memory_target on smithi050 to 8122M 2024-05-20T22:00:48.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:48 smithi050 bash[28929]: audit 2024-05-20T22:00:47.593370+0000 mon.a (mon.0) 374 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:48.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:48 smithi050 bash[28929]: audit 2024-05-20T22:00:47.597481+0000 mon.a (mon.0) 375 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:00:48.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:48 smithi050 bash[28929]: audit 2024-05-20T22:00:47.598978+0000 mon.a (mon.0) 376 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:00:48.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:48 smithi050 bash[28929]: audit 2024-05-20T22:00:47.608535+0000 mon.a (mon.0) 377 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:00:50.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:50 smithi145 bash[23893]: cluster 2024-05-20T22:00:49.444022+0000 mgr.y (mgr.14150) 146 : cluster 0 pgmap v110: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:50.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:50 smithi050 bash[21866]: cluster 2024-05-20T22:00:49.444022+0000 mgr.y (mgr.14150) 146 : cluster 0 pgmap v110: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:50.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:50 smithi050 bash[28929]: cluster 2024-05-20T22:00:49.444022+0000 mgr.y (mgr.14150) 146 : cluster 0 pgmap v110: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:51.951 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:00:52.835 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:52 smithi050 bash[21866]: cluster 2024-05-20T22:00:51.444493+0000 mgr.y (mgr.14150) 147 : cluster 0 pgmap v111: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:52.835 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:52 smithi050 bash[28929]: cluster 2024-05-20T22:00:51.444493+0000 mgr.y (mgr.14150) 147 : cluster 0 pgmap v111: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:52.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:52 smithi145 bash[23893]: cluster 2024-05-20T22:00:51.444493+0000 mgr.y (mgr.14150) 147 : cluster 0 pgmap v111: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:54.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f49bd404640 1 -- 172.21.15.50:0/2033523741 >> v1:172.21.15.50:6790/0 conn(0x7f49b8105b40 legacy=0x7f49b8107f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:00:54.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f49bd404640 1 -- 172.21.15.50:0/2033523741 shutdown_connections 2024-05-20T22:00:54.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f49bd404640 1 -- 172.21.15.50:0/2033523741 >> 172.21.15.50:0/2033523741 conn(0x7f49b80fccb0 msgr2=0x7f49b80ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:00:54.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f49bd404640 1 -- 172.21.15.50:0/2033523741 shutdown_connections 2024-05-20T22:00:54.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f49bd404640 1 -- 172.21.15.50:0/2033523741 wait complete. 2024-05-20T22:00:54.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f49bd404640 1 Processor -- start 2024-05-20T22:00:54.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f49bd404640 1 -- start start 2024-05-20T22:00:54.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f49bd404640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f49b810cf90 con 0x7f49b8101710 2024-05-20T22:00:54.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f49bd404640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f49b81a5030 con 0x7f49b8109880 2024-05-20T22:00:54.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f49bd404640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f49b81a6210 con 0x7f49b8105b40 2024-05-20T22:00:54.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f49b67fc640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7f49b8105b40 0x7f49b819f1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:35198/0 (socket says 172.21.15.50:35198) 2024-05-20T22:00:54.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f49b67fc640 1 -- 172.21.15.50:0/2375820870 learned_addr learned my addr 172.21.15.50:0/2375820870 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:00:54.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 410226877 0 0) 0x7f49b81a6210 con 0x7f49b8105b40 2024-05-20T22:00:54.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49a0005020 con 0x7f49b8105b40 2024-05-20T22:00:54.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3272615791 0 0) 0x7f49b810cf90 con 0x7f49b8101710 2024-05-20T22:00:54.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49b81a6210 con 0x7f49b8101710 2024-05-20T22:00:54.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 220060023 0 0) 0x7f49b81a5030 con 0x7f49b8109880 2024-05-20T22:00:54.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49b810cf90 con 0x7f49b8109880 2024-05-20T22:00:54.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3953511466 0 0) 0x7f49b81a6210 con 0x7f49b8101710 2024-05-20T22:00:54.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f49b81a5030 con 0x7f49b8101710 2024-05-20T22:00:54.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 290675262 0 0) 0x7f49a0005020 con 0x7f49b8105b40 2024-05-20T22:00:54.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f49b81a6210 con 0x7f49b8105b40 2024-05-20T22:00:54.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f49a8001000 con 0x7f49b8101710 2024-05-20T22:00:54.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f49ac004240 con 0x7f49b8105b40 2024-05-20T22:00:54.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3847422025 0 0) 0x7f49b81a5030 con 0x7f49b8101710 2024-05-20T22:00:54.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 >> v1:172.21.15.50:6790/0 conn(0x7f49b8105b40 legacy=0x7f49b819f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:00:54.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 >> v1:172.21.15.145:6789/0 conn(0x7f49b8109880 legacy=0x7f49b81a2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:00:54.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b81a73f0 con 0x7f49b8101710 2024-05-20T22:00:54.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f49bd404640 1 -- 172.21.15.50:0/2375820870 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f49b81a4080 con 0x7f49b8101710 2024-05-20T22:00:54.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f49bd404640 1 -- 172.21.15.50:0/2375820870 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f49b81a45c0 con 0x7f49b8101710 2024-05-20T22:00:54.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f49a8001660 con 0x7f49b8101710 2024-05-20T22:00:54.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f49a80047b0 con 0x7f49b8101710 2024-05-20T22:00:54.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.490+0000 7f49bd404640 1 -- 172.21.15.50:0/2375820870 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49a40050b0 con 0x7f49b8101710 2024-05-20T22:00:54.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.494+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 14) ==== 92025+0+0 (unknown 890788531 0 0) 0x7f49a80035f0 con 0x7f49b8101710 2024-05-20T22:00:54.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.494+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(14..14 src has 1..14) ==== 1833+0+0 (unknown 2843541389 0 0) 0x7f49a8086eb0 con 0x7f49b8101710 2024-05-20T22:00:54.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.498+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f49a80557e0 con 0x7f49b8101710 2024-05-20T22:00:54.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:54 smithi050 bash[21866]: cluster 2024-05-20T22:00:53.444939+0000 mgr.y (mgr.14150) 148 : cluster 0 pgmap v112: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:54.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:54 smithi050 bash[28929]: cluster 2024-05-20T22:00:53.444939+0000 mgr.y (mgr.14150) 148 : cluster 0 pgmap v112: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:54.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:00:54.698+0000 7f49bd404640 1 -- 172.21.15.50:0/2375820870 --> v1:172.21.15.50:6800/2944911247 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f49a4000bc0 con 0x7f49a006ed30 2024-05-20T22:00:54.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:54 smithi145 bash[23893]: cluster 2024-05-20T22:00:53.444939+0000 mgr.y (mgr.14150) 148 : cluster 0 pgmap v112: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:55.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:55 smithi145 bash[23893]: audit 2024-05-20T22:00:54.704298+0000 mgr.y (mgr.14150) 149 : audit 0 from='client.14268 v1:172.21.15.50:0/2375820870' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:00:55.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:55 smithi145 bash[23893]: audit 2024-05-20T22:00:54.708320+0000 mon.a (mon.0) 378 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:00:55.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:55 smithi145 bash[23893]: audit 2024-05-20T22:00:54.713588+0000 mon.a (mon.0) 379 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:00:55.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:55 smithi145 bash[23893]: audit 2024-05-20T22:00:54.714940+0000 mon.a (mon.0) 380 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:00:55.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:55 smithi050 bash[21866]: audit 2024-05-20T22:00:54.704298+0000 mgr.y (mgr.14150) 149 : audit 0 from='client.14268 v1:172.21.15.50:0/2375820870' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:00:55.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:55 smithi050 bash[21866]: audit 2024-05-20T22:00:54.708320+0000 mon.a (mon.0) 378 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:00:55.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:55 smithi050 bash[21866]: audit 2024-05-20T22:00:54.713588+0000 mon.a (mon.0) 379 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:00:55.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:55 smithi050 bash[21866]: audit 2024-05-20T22:00:54.714940+0000 mon.a (mon.0) 380 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:00:55.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:55 smithi050 bash[28929]: audit 2024-05-20T22:00:54.704298+0000 mgr.y (mgr.14150) 149 : audit 0 from='client.14268 v1:172.21.15.50:0/2375820870' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:00:55.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:55 smithi050 bash[28929]: audit 2024-05-20T22:00:54.708320+0000 mon.a (mon.0) 378 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:00:55.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:55 smithi050 bash[28929]: audit 2024-05-20T22:00:54.713588+0000 mon.a (mon.0) 379 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:00:55.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:55 smithi050 bash[28929]: audit 2024-05-20T22:00:54.714940+0000 mon.a (mon.0) 380 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:00:56.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:56 smithi145 bash[23893]: cluster 2024-05-20T22:00:55.445402+0000 mgr.y (mgr.14150) 150 : cluster 0 pgmap v113: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:56.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:56 smithi050 bash[28929]: cluster 2024-05-20T22:00:55.445402+0000 mgr.y (mgr.14150) 150 : cluster 0 pgmap v113: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:56.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:56 smithi050 bash[21866]: cluster 2024-05-20T22:00:55.445402+0000 mgr.y (mgr.14150) 150 : cluster 0 pgmap v113: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:58.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:00:58 smithi145 bash[23893]: cluster 2024-05-20T22:00:57.445874+0000 mgr.y (mgr.14150) 151 : cluster 0 pgmap v114: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:58.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:00:58 smithi050 bash[21866]: cluster 2024-05-20T22:00:57.445874+0000 mgr.y (mgr.14150) 151 : cluster 0 pgmap v114: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:00:58.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:00:58 smithi050 bash[28929]: cluster 2024-05-20T22:00:57.445874+0000 mgr.y (mgr.14150) 151 : cluster 0 pgmap v114: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:00.840 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:00 smithi050 bash[28929]: cluster 2024-05-20T22:00:59.446354+0000 mgr.y (mgr.14150) 152 : cluster 0 pgmap v115: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:00.841 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:00 smithi050 bash[21866]: cluster 2024-05-20T22:00:59.446354+0000 mgr.y (mgr.14150) 152 : cluster 0 pgmap v115: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:00.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:00 smithi145 bash[23893]: cluster 2024-05-20T22:00:59.446354+0000 mgr.y (mgr.14150) 152 : cluster 0 pgmap v115: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:02.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:02 smithi145 bash[23893]: cluster 2024-05-20T22:01:01.446801+0000 mgr.y (mgr.14150) 153 : cluster 0 pgmap v116: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:02.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:02 smithi050 bash[21866]: cluster 2024-05-20T22:01:01.446801+0000 mgr.y (mgr.14150) 153 : cluster 0 pgmap v116: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:02.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:02 smithi050 bash[28929]: cluster 2024-05-20T22:01:01.446801+0000 mgr.y (mgr.14150) 153 : cluster 0 pgmap v116: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:03.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:03 smithi145 bash[23893]: audit 2024-05-20T22:01:02.945860+0000 mon.c (mon.2) 5 : audit 1 from='client.? v1:172.21.15.50:0/3529983970' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a21d4e6b-3116-4dcd-a4fe-a224f2082926"}]: dispatch 2024-05-20T22:01:03.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:03 smithi145 bash[23893]: audit 2024-05-20T22:01:02.946436+0000 mon.a (mon.0) 381 : audit 1 from='client.24179 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a21d4e6b-3116-4dcd-a4fe-a224f2082926"}]: dispatch 2024-05-20T22:01:03.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:03 smithi145 bash[23893]: audit 2024-05-20T22:01:02.948908+0000 mon.a (mon.0) 382 : audit 1 from='client.24179 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a21d4e6b-3116-4dcd-a4fe-a224f2082926"}]': finished 2024-05-20T22:01:03.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:03 smithi145 bash[23893]: cluster 2024-05-20T22:01:02.953699+0000 mon.a (mon.0) 383 : cluster 0 osdmap e15: 3 total, 2 up, 3 in 2024-05-20T22:01:03.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:03 smithi145 bash[23893]: audit 2024-05-20T22:01:02.954002+0000 mon.a (mon.0) 384 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:01:03.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:03 smithi050 bash[28929]: audit 2024-05-20T22:01:02.945860+0000 mon.c (mon.2) 5 : audit 1 from='client.? v1:172.21.15.50:0/3529983970' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a21d4e6b-3116-4dcd-a4fe-a224f2082926"}]: dispatch 2024-05-20T22:01:03.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:03 smithi050 bash[28929]: audit 2024-05-20T22:01:02.946436+0000 mon.a (mon.0) 381 : audit 1 from='client.24179 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a21d4e6b-3116-4dcd-a4fe-a224f2082926"}]: dispatch 2024-05-20T22:01:03.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:03 smithi050 bash[28929]: audit 2024-05-20T22:01:02.948908+0000 mon.a (mon.0) 382 : audit 1 from='client.24179 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a21d4e6b-3116-4dcd-a4fe-a224f2082926"}]': finished 2024-05-20T22:01:03.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:03 smithi050 bash[28929]: cluster 2024-05-20T22:01:02.953699+0000 mon.a (mon.0) 383 : cluster 0 osdmap e15: 3 total, 2 up, 3 in 2024-05-20T22:01:03.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:03 smithi050 bash[28929]: audit 2024-05-20T22:01:02.954002+0000 mon.a (mon.0) 384 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:01:03.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:03 smithi050 bash[21866]: audit 2024-05-20T22:01:02.945860+0000 mon.c (mon.2) 5 : audit 1 from='client.? v1:172.21.15.50:0/3529983970' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a21d4e6b-3116-4dcd-a4fe-a224f2082926"}]: dispatch 2024-05-20T22:01:03.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:03 smithi050 bash[21866]: audit 2024-05-20T22:01:02.946436+0000 mon.a (mon.0) 381 : audit 1 from='client.24179 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a21d4e6b-3116-4dcd-a4fe-a224f2082926"}]: dispatch 2024-05-20T22:01:03.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:03 smithi050 bash[21866]: audit 2024-05-20T22:01:02.948908+0000 mon.a (mon.0) 382 : audit 1 from='client.24179 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a21d4e6b-3116-4dcd-a4fe-a224f2082926"}]': finished 2024-05-20T22:01:03.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:03 smithi050 bash[21866]: cluster 2024-05-20T22:01:02.953699+0000 mon.a (mon.0) 383 : cluster 0 osdmap e15: 3 total, 2 up, 3 in 2024-05-20T22:01:03.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:03 smithi050 bash[21866]: audit 2024-05-20T22:01:02.954002+0000 mon.a (mon.0) 384 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:01:04.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:04 smithi145 bash[23893]: cluster 2024-05-20T22:01:03.447228+0000 mgr.y (mgr.14150) 154 : cluster 0 pgmap v118: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:04.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:04 smithi145 bash[23893]: audit 2024-05-20T22:01:03.645849+0000 mon.a (mon.0) 385 : audit 0 from='client.? v1:172.21.15.50:0/2836219599' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:01:04.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:04 smithi050 bash[21866]: cluster 2024-05-20T22:01:03.447228+0000 mgr.y (mgr.14150) 154 : cluster 0 pgmap v118: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:04.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:04 smithi050 bash[21866]: audit 2024-05-20T22:01:03.645849+0000 mon.a (mon.0) 385 : audit 0 from='client.? v1:172.21.15.50:0/2836219599' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:01:04.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:04 smithi050 bash[28929]: cluster 2024-05-20T22:01:03.447228+0000 mgr.y (mgr.14150) 154 : cluster 0 pgmap v118: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:04.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:04 smithi050 bash[28929]: audit 2024-05-20T22:01:03.645849+0000 mon.a (mon.0) 385 : audit 0 from='client.? v1:172.21.15.50:0/2836219599' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:01:06.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:06 smithi145 bash[23893]: cluster 2024-05-20T22:01:05.447649+0000 mgr.y (mgr.14150) 155 : cluster 0 pgmap v119: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:06.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:06 smithi050 bash[21866]: cluster 2024-05-20T22:01:05.447649+0000 mgr.y (mgr.14150) 155 : cluster 0 pgmap v119: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:06.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:06 smithi050 bash[28929]: cluster 2024-05-20T22:01:05.447649+0000 mgr.y (mgr.14150) 155 : cluster 0 pgmap v119: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:08.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:08 smithi145 bash[23893]: cluster 2024-05-20T22:01:07.448133+0000 mgr.y (mgr.14150) 156 : cluster 0 pgmap v120: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:08.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:08 smithi050 bash[21866]: cluster 2024-05-20T22:01:07.448133+0000 mgr.y (mgr.14150) 156 : cluster 0 pgmap v120: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:08.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:08 smithi050 bash[28929]: cluster 2024-05-20T22:01:07.448133+0000 mgr.y (mgr.14150) 156 : cluster 0 pgmap v120: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:10.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:10 smithi145 bash[23893]: cluster 2024-05-20T22:01:09.448768+0000 mgr.y (mgr.14150) 157 : cluster 0 pgmap v121: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:10.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:10 smithi050 bash[21866]: cluster 2024-05-20T22:01:09.448768+0000 mgr.y (mgr.14150) 157 : cluster 0 pgmap v121: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:10.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:10 smithi050 bash[28929]: cluster 2024-05-20T22:01:09.448768+0000 mgr.y (mgr.14150) 157 : cluster 0 pgmap v121: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:12.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:12 smithi145 bash[23893]: cluster 2024-05-20T22:01:11.449243+0000 mgr.y (mgr.14150) 158 : cluster 0 pgmap v122: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:12.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:12 smithi050 bash[21866]: cluster 2024-05-20T22:01:11.449243+0000 mgr.y (mgr.14150) 158 : cluster 0 pgmap v122: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:12.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:12 smithi050 bash[28929]: cluster 2024-05-20T22:01:11.449243+0000 mgr.y (mgr.14150) 158 : cluster 0 pgmap v122: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:14.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:14 smithi145 bash[23893]: cluster 2024-05-20T22:01:13.449642+0000 mgr.y (mgr.14150) 159 : cluster 0 pgmap v123: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:14.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:14 smithi050 bash[21866]: cluster 2024-05-20T22:01:13.449642+0000 mgr.y (mgr.14150) 159 : cluster 0 pgmap v123: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:14.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:14 smithi050 bash[28929]: cluster 2024-05-20T22:01:13.449642+0000 mgr.y (mgr.14150) 159 : cluster 0 pgmap v123: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:15.891 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:15 smithi050 bash[21866]: audit 2024-05-20T22:01:15.439028+0000 mon.a (mon.0) 386 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-20T22:01:15.891 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:15 smithi050 bash[21866]: audit 2024-05-20T22:01:15.440553+0000 mon.a (mon.0) 387 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:01:15.891 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:15 smithi050 bash[28929]: audit 2024-05-20T22:01:15.439028+0000 mon.a (mon.0) 386 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-20T22:01:15.891 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:15 smithi050 bash[28929]: audit 2024-05-20T22:01:15.440553+0000 mon.a (mon.0) 387 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:01:15.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:15 smithi145 bash[23893]: audit 2024-05-20T22:01:15.439028+0000 mon.a (mon.0) 386 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-20T22:01:15.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:15 smithi145 bash[23893]: audit 2024-05-20T22:01:15.440553+0000 mon.a (mon.0) 387 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:01:16.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:16 smithi145 bash[23893]: cephadm 2024-05-20T22:01:15.441960+0000 mgr.y (mgr.14150) 160 : cephadm 1 Deploying daemon osd.2 on smithi050 2024-05-20T22:01:16.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:16 smithi145 bash[23893]: cluster 2024-05-20T22:01:15.450043+0000 mgr.y (mgr.14150) 161 : cluster 0 pgmap v124: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:16.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:16 smithi050 bash[21866]: cephadm 2024-05-20T22:01:15.441960+0000 mgr.y (mgr.14150) 160 : cephadm 1 Deploying daemon osd.2 on smithi050 2024-05-20T22:01:16.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:16 smithi050 bash[21866]: cluster 2024-05-20T22:01:15.450043+0000 mgr.y (mgr.14150) 161 : cluster 0 pgmap v124: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:16.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:16 smithi050 bash[28929]: cephadm 2024-05-20T22:01:15.441960+0000 mgr.y (mgr.14150) 160 : cephadm 1 Deploying daemon osd.2 on smithi050 2024-05-20T22:01:16.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:16 smithi050 bash[28929]: cluster 2024-05-20T22:01:15.450043+0000 mgr.y (mgr.14150) 161 : cluster 0 pgmap v124: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:18.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:18 smithi145 bash[23893]: cluster 2024-05-20T22:01:17.450532+0000 mgr.y (mgr.14150) 162 : cluster 0 pgmap v125: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:18.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:18 smithi050 bash[21866]: cluster 2024-05-20T22:01:17.450532+0000 mgr.y (mgr.14150) 162 : cluster 0 pgmap v125: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:18.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:18 smithi050 bash[28929]: cluster 2024-05-20T22:01:17.450532+0000 mgr.y (mgr.14150) 162 : cluster 0 pgmap v125: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:19.669 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:19 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:01:19.669 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:01:19 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:01:19.669 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:19 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:01:19.670 INFO:journalctl@ceph.osd.0.smithi050.stdout:May 20 22:01:19 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:01:19.670 INFO:journalctl@ceph.osd.1.smithi050.stdout:May 20 22:01:19 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:01:19.947 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:01:19 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:01:19.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:19 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:01:19.948 INFO:journalctl@ceph.osd.0.smithi050.stdout:May 20 22:01:19 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:01:19.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:19 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:01:19.948 INFO:journalctl@ceph.osd.1.smithi050.stdout:May 20 22:01:19 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:01:20.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:20 smithi145 bash[23893]: cluster 2024-05-20T22:01:19.450861+0000 mgr.y (mgr.14150) 163 : cluster 0 pgmap v126: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:20.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:20 smithi145 bash[23893]: audit 2024-05-20T22:01:19.810336+0000 mon.a (mon.0) 388 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:01:20.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:20 smithi145 bash[23893]: audit 2024-05-20T22:01:19.814378+0000 mon.a (mon.0) 389 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:20.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:20 smithi145 bash[23893]: audit 2024-05-20T22:01:19.819201+0000 mon.a (mon.0) 390 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:20.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:20 smithi050 bash[21866]: cluster 2024-05-20T22:01:19.450861+0000 mgr.y (mgr.14150) 163 : cluster 0 pgmap v126: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:20.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:20 smithi050 bash[21866]: audit 2024-05-20T22:01:19.810336+0000 mon.a (mon.0) 388 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:01:20.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:20 smithi050 bash[21866]: audit 2024-05-20T22:01:19.814378+0000 mon.a (mon.0) 389 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:20.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:20 smithi050 bash[21866]: audit 2024-05-20T22:01:19.819201+0000 mon.a (mon.0) 390 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:20.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:20 smithi050 bash[28929]: cluster 2024-05-20T22:01:19.450861+0000 mgr.y (mgr.14150) 163 : cluster 0 pgmap v126: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:20.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:20 smithi050 bash[28929]: audit 2024-05-20T22:01:19.810336+0000 mon.a (mon.0) 388 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:01:20.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:20 smithi050 bash[28929]: audit 2024-05-20T22:01:19.814378+0000 mon.a (mon.0) 389 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:20.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:20 smithi050 bash[28929]: audit 2024-05-20T22:01:19.819201+0000 mon.a (mon.0) 390 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:22.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:22 smithi050 bash[21866]: cluster 2024-05-20T22:01:21.451339+0000 mgr.y (mgr.14150) 164 : cluster 0 pgmap v127: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:22.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:22 smithi050 bash[28929]: cluster 2024-05-20T22:01:21.451339+0000 mgr.y (mgr.14150) 164 : cluster 0 pgmap v127: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:23.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:22 smithi145 bash[23893]: cluster 2024-05-20T22:01:21.451339+0000 mgr.y (mgr.14150) 164 : cluster 0 pgmap v127: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:24.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:24 smithi050 bash[21866]: cluster 2024-05-20T22:01:23.451780+0000 mgr.y (mgr.14150) 165 : cluster 0 pgmap v128: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:24.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:24 smithi050 bash[28929]: cluster 2024-05-20T22:01:23.451780+0000 mgr.y (mgr.14150) 165 : cluster 0 pgmap v128: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:25.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:24 smithi145 bash[23893]: cluster 2024-05-20T22:01:23.451780+0000 mgr.y (mgr.14150) 165 : cluster 0 pgmap v128: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:26.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:26 smithi050 bash[28929]: cluster 2024-05-20T22:01:25.452292+0000 mgr.y (mgr.14150) 166 : cluster 0 pgmap v129: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:26.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:26 smithi050 bash[28929]: audit 2024-05-20T22:01:26.122765+0000 mon.c (mon.2) 6 : audit 1 from='osd.2 v1:172.21.15.50:6809/3675120581' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-20T22:01:26.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:26 smithi050 bash[28929]: audit 2024-05-20T22:01:26.123095+0000 mon.a (mon.0) 391 : audit 1 from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-20T22:01:26.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:26 smithi050 bash[21866]: cluster 2024-05-20T22:01:25.452292+0000 mgr.y (mgr.14150) 166 : cluster 0 pgmap v129: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:26.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:26 smithi050 bash[21866]: audit 2024-05-20T22:01:26.122765+0000 mon.c (mon.2) 6 : audit 1 from='osd.2 v1:172.21.15.50:6809/3675120581' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-20T22:01:26.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:26 smithi050 bash[21866]: audit 2024-05-20T22:01:26.123095+0000 mon.a (mon.0) 391 : audit 1 from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-20T22:01:27.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:26 smithi145 bash[23893]: cluster 2024-05-20T22:01:25.452292+0000 mgr.y (mgr.14150) 166 : cluster 0 pgmap v129: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:27.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:26 smithi145 bash[23893]: audit 2024-05-20T22:01:26.122765+0000 mon.c (mon.2) 6 : audit 1 from='osd.2 v1:172.21.15.50:6809/3675120581' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-20T22:01:27.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:26 smithi145 bash[23893]: audit 2024-05-20T22:01:26.123095+0000 mon.a (mon.0) 391 : audit 1 from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-20T22:01:27.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:27 smithi050 bash[21866]: audit 2024-05-20T22:01:26.659259+0000 mon.a (mon.0) 392 : audit 1 from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-20T22:01:27.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:27 smithi050 bash[21866]: cluster 2024-05-20T22:01:26.661762+0000 mon.a (mon.0) 393 : cluster 0 osdmap e16: 3 total, 2 up, 3 in 2024-05-20T22:01:27.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:27 smithi050 bash[21866]: audit 2024-05-20T22:01:26.662016+0000 mon.a (mon.0) 394 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:01:27.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:27 smithi050 bash[21866]: audit 2024-05-20T22:01:26.662101+0000 mon.c (mon.2) 7 : audit 1 from='osd.2 v1:172.21.15.50:6809/3675120581' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-05-20T22:01:27.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:27 smithi050 bash[21866]: audit 2024-05-20T22:01:26.662438+0000 mon.a (mon.0) 395 : audit 1 from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-05-20T22:01:27.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:27 smithi050 bash[21866]: audit 2024-05-20T22:01:26.670045+0000 mon.a (mon.0) 396 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:27.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:27 smithi050 bash[21866]: audit 2024-05-20T22:01:26.674069+0000 mon.a (mon.0) 397 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:27.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:27 smithi050 bash[21866]: audit 2024-05-20T22:01:27.242816+0000 mon.a (mon.0) 398 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:01:27.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:27 smithi050 bash[21866]: audit 2024-05-20T22:01:27.243533+0000 mon.a (mon.0) 399 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:01:27.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:27 smithi050 bash[21866]: audit 2024-05-20T22:01:27.248293+0000 mon.a (mon.0) 400 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:27.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:27 smithi050 bash[28929]: audit 2024-05-20T22:01:26.659259+0000 mon.a (mon.0) 392 : audit 1 from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-20T22:01:27.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:27 smithi050 bash[28929]: cluster 2024-05-20T22:01:26.661762+0000 mon.a (mon.0) 393 : cluster 0 osdmap e16: 3 total, 2 up, 3 in 2024-05-20T22:01:27.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:27 smithi050 bash[28929]: audit 2024-05-20T22:01:26.662016+0000 mon.a (mon.0) 394 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:01:27.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:27 smithi050 bash[28929]: audit 2024-05-20T22:01:26.662101+0000 mon.c (mon.2) 7 : audit 1 from='osd.2 v1:172.21.15.50:6809/3675120581' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-05-20T22:01:27.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:27 smithi050 bash[28929]: audit 2024-05-20T22:01:26.662438+0000 mon.a (mon.0) 395 : audit 1 from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-05-20T22:01:27.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:27 smithi050 bash[28929]: audit 2024-05-20T22:01:26.670045+0000 mon.a (mon.0) 396 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:27.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:27 smithi050 bash[28929]: audit 2024-05-20T22:01:26.674069+0000 mon.a (mon.0) 397 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:27.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:27 smithi050 bash[28929]: audit 2024-05-20T22:01:27.242816+0000 mon.a (mon.0) 398 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:01:27.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:27 smithi050 bash[28929]: audit 2024-05-20T22:01:27.243533+0000 mon.a (mon.0) 399 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:01:27.949 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:27 smithi050 bash[28929]: audit 2024-05-20T22:01:27.248293+0000 mon.a (mon.0) 400 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:28.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:27 smithi145 bash[23893]: audit 2024-05-20T22:01:26.659259+0000 mon.a (mon.0) 392 : audit 1 from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-20T22:01:28.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:27 smithi145 bash[23893]: cluster 2024-05-20T22:01:26.661762+0000 mon.a (mon.0) 393 : cluster 0 osdmap e16: 3 total, 2 up, 3 in 2024-05-20T22:01:28.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:27 smithi145 bash[23893]: audit 2024-05-20T22:01:26.662016+0000 mon.a (mon.0) 394 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:01:28.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:27 smithi145 bash[23893]: audit 2024-05-20T22:01:26.662101+0000 mon.c (mon.2) 7 : audit 1 from='osd.2 v1:172.21.15.50:6809/3675120581' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-05-20T22:01:28.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:27 smithi145 bash[23893]: audit 2024-05-20T22:01:26.662438+0000 mon.a (mon.0) 395 : audit 1 from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-05-20T22:01:28.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:27 smithi145 bash[23893]: audit 2024-05-20T22:01:26.670045+0000 mon.a (mon.0) 396 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:28.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:27 smithi145 bash[23893]: audit 2024-05-20T22:01:26.674069+0000 mon.a (mon.0) 397 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:28.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:27 smithi145 bash[23893]: audit 2024-05-20T22:01:27.242816+0000 mon.a (mon.0) 398 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:01:28.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:27 smithi145 bash[23893]: audit 2024-05-20T22:01:27.243533+0000 mon.a (mon.0) 399 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:01:28.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:27 smithi145 bash[23893]: audit 2024-05-20T22:01:27.248293+0000 mon.a (mon.0) 400 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:28.934 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:28 smithi050 bash[21866]: cluster 2024-05-20T22:01:27.452720+0000 mgr.y (mgr.14150) 167 : cluster 0 pgmap v131: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:28.934 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:28 smithi050 bash[21866]: audit 2024-05-20T22:01:27.661722+0000 mon.a (mon.0) 401 : audit 1 from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-05-20T22:01:28.934 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:28 smithi050 bash[21866]: cluster 2024-05-20T22:01:27.667276+0000 mon.a (mon.0) 402 : cluster 0 osdmap e17: 3 total, 2 up, 3 in 2024-05-20T22:01:28.934 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:28 smithi050 bash[21866]: audit 2024-05-20T22:01:27.668134+0000 mon.a (mon.0) 403 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:01:28.934 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:28 smithi050 bash[21866]: audit 2024-05-20T22:01:27.677359+0000 mon.a (mon.0) 404 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:01:28.935 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:28 smithi050 bash[28929]: cluster 2024-05-20T22:01:27.452720+0000 mgr.y (mgr.14150) 167 : cluster 0 pgmap v131: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:28.935 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:28 smithi050 bash[28929]: audit 2024-05-20T22:01:27.661722+0000 mon.a (mon.0) 401 : audit 1 from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-05-20T22:01:28.935 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:28 smithi050 bash[28929]: cluster 2024-05-20T22:01:27.667276+0000 mon.a (mon.0) 402 : cluster 0 osdmap e17: 3 total, 2 up, 3 in 2024-05-20T22:01:28.935 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:28 smithi050 bash[28929]: audit 2024-05-20T22:01:27.668134+0000 mon.a (mon.0) 403 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:01:28.935 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:28 smithi050 bash[28929]: audit 2024-05-20T22:01:27.677359+0000 mon.a (mon.0) 404 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:01:29.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:28 smithi145 bash[23893]: cluster 2024-05-20T22:01:27.452720+0000 mgr.y (mgr.14150) 167 : cluster 0 pgmap v131: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:29.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:28 smithi145 bash[23893]: audit 2024-05-20T22:01:27.661722+0000 mon.a (mon.0) 401 : audit 1 from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-05-20T22:01:29.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:28 smithi145 bash[23893]: cluster 2024-05-20T22:01:27.667276+0000 mon.a (mon.0) 402 : cluster 0 osdmap e17: 3 total, 2 up, 3 in 2024-05-20T22:01:29.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:28 smithi145 bash[23893]: audit 2024-05-20T22:01:27.668134+0000 mon.a (mon.0) 403 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:01:29.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:28 smithi145 bash[23893]: audit 2024-05-20T22:01:27.677359+0000 mon.a (mon.0) 404 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:01:30.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:30.101+0000 7f499ffff640 1 -- 172.21.15.50:0/2375820870 <== mgr.14150 v1:172.21.15.50:6800/2944911247 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (unknown 0 0 48079186) 0x7f49a4000bc0 con 0x7f49a006ed30 2024-05-20T22:01:30.105 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 2 on host 'smithi050' 2024-05-20T22:01:30.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:30.105+0000 7f49bd404640 1 -- 172.21.15.50:0/2375820870 >> v1:172.21.15.50:6800/2944911247 conn(0x7f49a006ed30 legacy=0x7f49a00711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:01:30.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:30.105+0000 7f49bd404640 1 -- 172.21.15.50:0/2375820870 >> v1:172.21.15.50:6789/0 conn(0x7f49b8101710 legacy=0x7f49b810c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:01:30.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:30.105+0000 7f49bd404640 1 -- 172.21.15.50:0/2375820870 shutdown_connections 2024-05-20T22:01:30.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:30.105+0000 7f49bd404640 1 -- 172.21.15.50:0/2375820870 >> 172.21.15.50:0/2375820870 conn(0x7f49b80fccb0 msgr2=0x7f49b81088e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:01:30.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:30.105+0000 7f49bd404640 1 -- 172.21.15.50:0/2375820870 shutdown_connections 2024-05-20T22:01:30.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:30.105+0000 7f49bd404640 1 -- 172.21.15.50:0/2375820870 wait complete. 2024-05-20T22:01:30.329 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:30 smithi050 bash[28929]: cluster 2024-05-20T22:01:27.148815+0000 osd.2 (osd.2) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:01:30.329 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:30 smithi050 bash[28929]: cluster 2024-05-20T22:01:27.148881+0000 osd.2 (osd.2) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:01:30.329 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:30 smithi050 bash[28929]: audit 2024-05-20T22:01:28.672779+0000 mon.a (mon.0) 405 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:01:30.329 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:30 smithi050 bash[28929]: cluster 2024-05-20T22:01:28.679108+0000 mon.a (mon.0) 406 : cluster 1 osd.2 v1:172.21.15.50:6809/3675120581 boot 2024-05-20T22:01:30.329 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:30 smithi050 bash[28929]: cluster 2024-05-20T22:01:28.679173+0000 mon.a (mon.0) 407 : cluster 0 osdmap e18: 3 total, 3 up, 3 in 2024-05-20T22:01:30.329 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:30 smithi050 bash[28929]: audit 2024-05-20T22:01:28.679977+0000 mon.a (mon.0) 408 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:01:30.329 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:30 smithi050 bash[21866]: cluster 2024-05-20T22:01:27.148815+0000 osd.2 (osd.2) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:01:30.329 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:30 smithi050 bash[21866]: cluster 2024-05-20T22:01:27.148881+0000 osd.2 (osd.2) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:01:30.329 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:30 smithi050 bash[21866]: audit 2024-05-20T22:01:28.672779+0000 mon.a (mon.0) 405 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:01:30.330 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:30 smithi050 bash[21866]: cluster 2024-05-20T22:01:28.679108+0000 mon.a (mon.0) 406 : cluster 1 osd.2 v1:172.21.15.50:6809/3675120581 boot 2024-05-20T22:01:30.330 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:30 smithi050 bash[21866]: cluster 2024-05-20T22:01:28.679173+0000 mon.a (mon.0) 407 : cluster 0 osdmap e18: 3 total, 3 up, 3 in 2024-05-20T22:01:30.330 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:30 smithi050 bash[21866]: audit 2024-05-20T22:01:28.679977+0000 mon.a (mon.0) 408 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:01:30.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:30 smithi145 bash[23893]: cluster 2024-05-20T22:01:27.148815+0000 osd.2 (osd.2) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:01:30.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:30 smithi145 bash[23893]: cluster 2024-05-20T22:01:27.148881+0000 osd.2 (osd.2) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:01:30.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:30 smithi145 bash[23893]: audit 2024-05-20T22:01:28.672779+0000 mon.a (mon.0) 405 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:01:30.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:30 smithi145 bash[23893]: cluster 2024-05-20T22:01:28.679108+0000 mon.a (mon.0) 406 : cluster 1 osd.2 v1:172.21.15.50:6809/3675120581 boot 2024-05-20T22:01:30.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:30 smithi145 bash[23893]: cluster 2024-05-20T22:01:28.679173+0000 mon.a (mon.0) 407 : cluster 0 osdmap e18: 3 total, 3 up, 3 in 2024-05-20T22:01:30.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:30 smithi145 bash[23893]: audit 2024-05-20T22:01:28.679977+0000 mon.a (mon.0) 408 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:01:30.768 DEBUG:teuthology.orchestra.run.smithi050:osd.2> sudo journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.2.service 2024-05-20T22:01:30.770 INFO:tasks.cephadm:Deploying osd.3 on smithi050 with /dev/vg_nvme/lv_1... 2024-05-20T22:01:30.770 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-20T22:01:31.050 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:31 smithi050 bash[28929]: cluster 2024-05-20T22:01:29.453026+0000 mgr.y (mgr.14150) 168 : cluster 0 pgmap v134: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:31.050 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:31 smithi050 bash[28929]: audit 2024-05-20T22:01:29.580136+0000 mon.a (mon.0) 409 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:01:31.050 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:31 smithi050 bash[28929]: audit 2024-05-20T22:01:30.041272+0000 mon.a (mon.0) 410 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-20T22:01:31.050 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:31 smithi050 bash[28929]: cluster 2024-05-20T22:01:30.046738+0000 mon.a (mon.0) 411 : cluster 0 osdmap e19: 3 total, 3 up, 3 in 2024-05-20T22:01:31.050 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:31 smithi050 bash[28929]: audit 2024-05-20T22:01:30.049508+0000 mon.a (mon.0) 412 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:01:31.050 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:31 smithi050 bash[28929]: audit 2024-05-20T22:01:30.089878+0000 mon.a (mon.0) 413 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:01:31.050 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:31 smithi050 bash[28929]: audit 2024-05-20T22:01:30.094870+0000 mon.a (mon.0) 414 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:31.050 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:31 smithi050 bash[28929]: audit 2024-05-20T22:01:30.101837+0000 mon.a (mon.0) 415 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:31.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:31 smithi145 bash[23893]: cluster 2024-05-20T22:01:29.453026+0000 mgr.y (mgr.14150) 168 : cluster 0 pgmap v134: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:31.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:31 smithi145 bash[23893]: audit 2024-05-20T22:01:29.580136+0000 mon.a (mon.0) 409 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:01:31.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:31 smithi145 bash[23893]: audit 2024-05-20T22:01:30.041272+0000 mon.a (mon.0) 410 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-20T22:01:31.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:31 smithi145 bash[23893]: cluster 2024-05-20T22:01:30.046738+0000 mon.a (mon.0) 411 : cluster 0 osdmap e19: 3 total, 3 up, 3 in 2024-05-20T22:01:31.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:31 smithi145 bash[23893]: audit 2024-05-20T22:01:30.049508+0000 mon.a (mon.0) 412 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:01:31.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:31 smithi145 bash[23893]: audit 2024-05-20T22:01:30.089878+0000 mon.a (mon.0) 413 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:01:31.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:31 smithi145 bash[23893]: audit 2024-05-20T22:01:30.094870+0000 mon.a (mon.0) 414 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:31.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:31 smithi145 bash[23893]: audit 2024-05-20T22:01:30.101837+0000 mon.a (mon.0) 415 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:31.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:31 smithi050 bash[21866]: cluster 2024-05-20T22:01:29.453026+0000 mgr.y (mgr.14150) 168 : cluster 0 pgmap v134: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-20T22:01:31.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:31 smithi050 bash[21866]: audit 2024-05-20T22:01:29.580136+0000 mon.a (mon.0) 409 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:01:31.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:31 smithi050 bash[21866]: audit 2024-05-20T22:01:30.041272+0000 mon.a (mon.0) 410 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-20T22:01:31.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:31 smithi050 bash[21866]: cluster 2024-05-20T22:01:30.046738+0000 mon.a (mon.0) 411 : cluster 0 osdmap e19: 3 total, 3 up, 3 in 2024-05-20T22:01:31.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:31 smithi050 bash[21866]: audit 2024-05-20T22:01:30.049508+0000 mon.a (mon.0) 412 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:01:31.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:31 smithi050 bash[21866]: audit 2024-05-20T22:01:30.089878+0000 mon.a (mon.0) 413 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:01:31.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:31 smithi050 bash[21866]: audit 2024-05-20T22:01:30.094870+0000 mon.a (mon.0) 414 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:31.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:31 smithi050 bash[21866]: audit 2024-05-20T22:01:30.101837+0000 mon.a (mon.0) 415 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:32.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:32 smithi145 bash[23893]: audit 2024-05-20T22:01:31.043141+0000 mon.a (mon.0) 416 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-20T22:01:32.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:32 smithi145 bash[23893]: cluster 2024-05-20T22:01:31.045641+0000 mon.a (mon.0) 417 : cluster 0 osdmap e20: 3 total, 3 up, 3 in 2024-05-20T22:01:32.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:32 smithi145 bash[23893]: cluster 2024-05-20T22:01:32.048432+0000 mon.a (mon.0) 418 : cluster 0 osdmap e21: 3 total, 3 up, 3 in 2024-05-20T22:01:32.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:32 smithi050 bash[28929]: audit 2024-05-20T22:01:31.043141+0000 mon.a (mon.0) 416 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-20T22:01:32.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:32 smithi050 bash[28929]: cluster 2024-05-20T22:01:31.045641+0000 mon.a (mon.0) 417 : cluster 0 osdmap e20: 3 total, 3 up, 3 in 2024-05-20T22:01:32.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:32 smithi050 bash[28929]: cluster 2024-05-20T22:01:32.048432+0000 mon.a (mon.0) 418 : cluster 0 osdmap e21: 3 total, 3 up, 3 in 2024-05-20T22:01:32.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:32 smithi050 bash[21866]: audit 2024-05-20T22:01:31.043141+0000 mon.a (mon.0) 416 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-20T22:01:32.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:32 smithi050 bash[21866]: cluster 2024-05-20T22:01:31.045641+0000 mon.a (mon.0) 417 : cluster 0 osdmap e20: 3 total, 3 up, 3 in 2024-05-20T22:01:32.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:32 smithi050 bash[21866]: cluster 2024-05-20T22:01:32.048432+0000 mon.a (mon.0) 418 : cluster 0 osdmap e21: 3 total, 3 up, 3 in 2024-05-20T22:01:33.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:33 smithi145 bash[23893]: cluster 2024-05-20T22:01:31.453395+0000 mgr.y (mgr.14150) 169 : cluster 0 pgmap v137: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:33.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:33 smithi145 bash[23893]: cluster 2024-05-20T22:01:32.063417+0000 mon.a (mon.0) 419 : cluster 0 mgrmap e15: y(active, since 4m), standbys: x 2024-05-20T22:01:33.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:33 smithi145 bash[23893]: audit 2024-05-20T22:01:32.083310+0000 mon.a (mon.0) 420 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:33.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:33 smithi050 bash[28929]: cluster 2024-05-20T22:01:31.453395+0000 mgr.y (mgr.14150) 169 : cluster 0 pgmap v137: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:33.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:33 smithi050 bash[28929]: cluster 2024-05-20T22:01:32.063417+0000 mon.a (mon.0) 419 : cluster 0 mgrmap e15: y(active, since 4m), standbys: x 2024-05-20T22:01:33.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:33 smithi050 bash[28929]: audit 2024-05-20T22:01:32.083310+0000 mon.a (mon.0) 420 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:33.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:33 smithi050 bash[21866]: cluster 2024-05-20T22:01:31.453395+0000 mgr.y (mgr.14150) 169 : cluster 0 pgmap v137: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:33.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:33 smithi050 bash[21866]: cluster 2024-05-20T22:01:32.063417+0000 mon.a (mon.0) 419 : cluster 0 mgrmap e15: y(active, since 4m), standbys: x 2024-05-20T22:01:33.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:33 smithi050 bash[21866]: audit 2024-05-20T22:01:32.083310+0000 mon.a (mon.0) 420 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:35.068 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:01:35.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:34 smithi050 bash[21866]: audit 2024-05-20T22:01:33.958961+0000 mon.a (mon.0) 421 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T22:01:35.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:34 smithi050 bash[21866]: audit 2024-05-20T22:01:33.959293+0000 mon.a (mon.0) 422 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T22:01:35.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:34 smithi050 bash[21866]: audit 2024-05-20T22:01:33.959708+0000 mon.a (mon.0) 423 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T22:01:35.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:34 smithi050 bash[28929]: audit 2024-05-20T22:01:33.958961+0000 mon.a (mon.0) 421 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T22:01:35.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:34 smithi050 bash[28929]: audit 2024-05-20T22:01:33.959293+0000 mon.a (mon.0) 422 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T22:01:35.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:34 smithi050 bash[28929]: audit 2024-05-20T22:01:33.959708+0000 mon.a (mon.0) 423 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T22:01:35.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:34 smithi145 bash[23893]: audit 2024-05-20T22:01:33.958961+0000 mon.a (mon.0) 421 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T22:01:35.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:34 smithi145 bash[23893]: audit 2024-05-20T22:01:33.959293+0000 mon.a (mon.0) 422 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T22:01:35.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:34 smithi145 bash[23893]: audit 2024-05-20T22:01:33.959708+0000 mon.a (mon.0) 423 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T22:01:37.092 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:36 smithi050 bash[28929]: cluster 2024-05-20T22:01:33.453823+0000 mgr.y (mgr.14150) 170 : cluster 0 pgmap v139: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:37.092 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:36 smithi050 bash[28929]: audit 2024-05-20T22:01:33.959810+0000 mon.a (mon.0) 424 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T22:01:37.093 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:36 smithi050 bash[28929]: audit 2024-05-20T22:01:34.900278+0000 mon.a (mon.0) 425 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T22:01:37.093 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:36 smithi050 bash[28929]: audit 2024-05-20T22:01:34.917033+0000 mon.b (mon.1) 8 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T22:01:37.093 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:36 smithi050 bash[28929]: audit 2024-05-20T22:01:34.917079+0000 mon.a (mon.0) 426 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T22:01:37.093 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:36 smithi050 bash[28929]: audit 2024-05-20T22:01:34.917346+0000 mon.a (mon.0) 427 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T22:01:37.093 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:36 smithi050 bash[28929]: audit 2024-05-20T22:01:34.917603+0000 mon.a (mon.0) 428 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T22:01:37.093 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:36 smithi050 bash[28929]: audit 2024-05-20T22:01:35.804238+0000 mon.b (mon.1) 9 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T22:01:37.093 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:36 smithi050 bash[28929]: audit 2024-05-20T22:01:35.848572+0000 mon.a (mon.0) 429 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:37.093 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:36 smithi050 bash[28929]: audit 2024-05-20T22:01:35.850308+0000 mon.a (mon.0) 430 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T22:01:37.093 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:36 smithi050 bash[28929]: audit 2024-05-20T22:01:35.850568+0000 mon.a (mon.0) 431 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T22:01:37.093 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:36 smithi050 bash[28929]: audit 2024-05-20T22:01:35.850808+0000 mon.a (mon.0) 432 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T22:01:37.094 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:36 smithi050 bash[21866]: cluster 2024-05-20T22:01:33.453823+0000 mgr.y (mgr.14150) 170 : cluster 0 pgmap v139: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:37.094 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:36 smithi050 bash[21866]: audit 2024-05-20T22:01:33.959810+0000 mon.a (mon.0) 424 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T22:01:37.094 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:36 smithi050 bash[21866]: audit 2024-05-20T22:01:34.900278+0000 mon.a (mon.0) 425 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T22:01:37.094 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:36 smithi050 bash[21866]: audit 2024-05-20T22:01:34.917033+0000 mon.b (mon.1) 8 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T22:01:37.094 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:36 smithi050 bash[21866]: audit 2024-05-20T22:01:34.917079+0000 mon.a (mon.0) 426 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T22:01:37.094 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:36 smithi050 bash[21866]: audit 2024-05-20T22:01:34.917346+0000 mon.a (mon.0) 427 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T22:01:37.094 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:36 smithi050 bash[21866]: audit 2024-05-20T22:01:34.917603+0000 mon.a (mon.0) 428 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T22:01:37.094 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:36 smithi050 bash[21866]: audit 2024-05-20T22:01:35.804238+0000 mon.b (mon.1) 9 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T22:01:37.094 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:36 smithi050 bash[21866]: audit 2024-05-20T22:01:35.848572+0000 mon.a (mon.0) 429 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:37.094 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:36 smithi050 bash[21866]: audit 2024-05-20T22:01:35.850308+0000 mon.a (mon.0) 430 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T22:01:37.094 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:36 smithi050 bash[21866]: audit 2024-05-20T22:01:35.850568+0000 mon.a (mon.0) 431 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T22:01:37.095 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:36 smithi050 bash[21866]: audit 2024-05-20T22:01:35.850808+0000 mon.a (mon.0) 432 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T22:01:37.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:36 smithi145 bash[23893]: cluster 2024-05-20T22:01:33.453823+0000 mgr.y (mgr.14150) 170 : cluster 0 pgmap v139: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:37.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:36 smithi145 bash[23893]: audit 2024-05-20T22:01:33.959810+0000 mon.a (mon.0) 424 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T22:01:37.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:36 smithi145 bash[23893]: audit 2024-05-20T22:01:34.900278+0000 mon.a (mon.0) 425 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T22:01:37.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:36 smithi145 bash[23893]: audit 2024-05-20T22:01:34.917033+0000 mon.b (mon.1) 8 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T22:01:37.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:36 smithi145 bash[23893]: audit 2024-05-20T22:01:34.917079+0000 mon.a (mon.0) 426 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T22:01:37.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:36 smithi145 bash[23893]: audit 2024-05-20T22:01:34.917346+0000 mon.a (mon.0) 427 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T22:01:37.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:36 smithi145 bash[23893]: audit 2024-05-20T22:01:34.917603+0000 mon.a (mon.0) 428 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T22:01:37.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:36 smithi145 bash[23893]: audit 2024-05-20T22:01:35.804238+0000 mon.b (mon.1) 9 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T22:01:37.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:36 smithi145 bash[23893]: audit 2024-05-20T22:01:35.848572+0000 mon.a (mon.0) 429 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:37.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:36 smithi145 bash[23893]: audit 2024-05-20T22:01:35.850308+0000 mon.a (mon.0) 430 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T22:01:37.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:36 smithi145 bash[23893]: audit 2024-05-20T22:01:35.850568+0000 mon.a (mon.0) 431 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T22:01:37.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:36 smithi145 bash[23893]: audit 2024-05-20T22:01:35.850808+0000 mon.a (mon.0) 432 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T22:01:37.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:37 smithi050 bash[21866]: cluster 2024-05-20T22:01:35.454379+0000 mgr.y (mgr.14150) 171 : cluster 0 pgmap v140: 1 pgs: 1 active+clean; 449 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:37.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:37 smithi050 bash[21866]: audit 2024-05-20T22:01:35.850598+0000 mon.c (mon.2) 8 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T22:01:37.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:37 smithi050 bash[21866]: audit 2024-05-20T22:01:36.762993+0000 mon.c (mon.2) 9 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T22:01:37.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:37 smithi050 bash[28929]: cluster 2024-05-20T22:01:35.454379+0000 mgr.y (mgr.14150) 171 : cluster 0 pgmap v140: 1 pgs: 1 active+clean; 449 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:37.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:37 smithi050 bash[28929]: audit 2024-05-20T22:01:35.850598+0000 mon.c (mon.2) 8 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T22:01:37.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:37 smithi050 bash[28929]: audit 2024-05-20T22:01:36.762993+0000 mon.c (mon.2) 9 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T22:01:38.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:37 smithi145 bash[23893]: cluster 2024-05-20T22:01:35.454379+0000 mgr.y (mgr.14150) 171 : cluster 0 pgmap v140: 1 pgs: 1 active+clean; 449 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:38.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:37 smithi145 bash[23893]: audit 2024-05-20T22:01:35.850598+0000 mon.c (mon.2) 8 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T22:01:38.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:37 smithi145 bash[23893]: audit 2024-05-20T22:01:36.762993+0000 mon.c (mon.2) 9 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T22:01:39.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:38 smithi145 bash[23893]: cluster 2024-05-20T22:01:37.454985+0000 mgr.y (mgr.14150) 172 : cluster 0 pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 241 KiB/s wr, 16 op/s 2024-05-20T22:01:39.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:38 smithi050 bash[21866]: cluster 2024-05-20T22:01:37.454985+0000 mgr.y (mgr.14150) 172 : cluster 0 pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 241 KiB/s wr, 16 op/s 2024-05-20T22:01:39.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:38 smithi050 bash[28929]: cluster 2024-05-20T22:01:37.454985+0000 mgr.y (mgr.14150) 172 : cluster 0 pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 241 KiB/s wr, 16 op/s 2024-05-20T22:01:39.674 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-20T22:01:39.833 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-20T22:01:39.844 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10+0 records in 2024-05-20T22:01:39.844 INFO:teuthology.orchestra.run.smithi050.stderr:10+0 records out 2024-05-20T22:01:39.844 INFO:teuthology.orchestra.run.smithi050.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00992674 s, 1.1 GB/s 2024-05-20T22:01:39.844 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping successful for: 2024-05-20T22:01:40.698 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_1 2024-05-20T22:01:40.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:40 smithi050 bash[21866]: cluster 2024-05-20T22:01:39.455525+0000 mgr.y (mgr.14150) 173 : cluster 0 pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 176 KiB/s wr, 12 op/s 2024-05-20T22:01:40.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:40 smithi050 bash[28929]: cluster 2024-05-20T22:01:39.455525+0000 mgr.y (mgr.14150) 173 : cluster 0 pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 176 KiB/s wr, 12 op/s 2024-05-20T22:01:41.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:40 smithi145 bash[23893]: cluster 2024-05-20T22:01:39.455525+0000 mgr.y (mgr.14150) 173 : cluster 0 pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 176 KiB/s wr, 12 op/s 2024-05-20T22:01:42.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:42 smithi145 bash[23893]: cephadm 2024-05-20T22:01:41.093014+0000 mgr.y (mgr.14150) 174 : cephadm 1 Detected new or changed devices on smithi050 2024-05-20T22:01:42.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:42 smithi145 bash[23893]: audit 2024-05-20T22:01:41.101010+0000 mon.a (mon.0) 433 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:42.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:42 smithi145 bash[23893]: audit 2024-05-20T22:01:41.109986+0000 mon.a (mon.0) 434 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:42.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:42 smithi145 bash[23893]: audit 2024-05-20T22:01:41.111975+0000 mon.a (mon.0) 435 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:01:42.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:42 smithi145 bash[23893]: audit 2024-05-20T22:01:41.113484+0000 mon.a (mon.0) 436 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:01:42.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:42 smithi145 bash[23893]: audit 2024-05-20T22:01:41.114805+0000 mon.a (mon.0) 437 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:01:42.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:42 smithi145 bash[23893]: cephadm 2024-05-20T22:01:41.115822+0000 mgr.y (mgr.14150) 175 : cephadm 1 Adjusting osd_memory_target on smithi050 to 5415M 2024-05-20T22:01:42.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:42 smithi145 bash[23893]: audit 2024-05-20T22:01:41.122246+0000 mon.a (mon.0) 438 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:42.395 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:42 smithi145 bash[23893]: audit 2024-05-20T22:01:41.127505+0000 mon.a (mon.0) 439 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:01:42.395 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:42 smithi145 bash[23893]: audit 2024-05-20T22:01:41.128935+0000 mon.a (mon.0) 440 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:01:42.395 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:42 smithi145 bash[23893]: audit 2024-05-20T22:01:41.137262+0000 mon.a (mon.0) 441 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:42.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:42 smithi050 bash[21866]: cephadm 2024-05-20T22:01:41.093014+0000 mgr.y (mgr.14150) 174 : cephadm 1 Detected new or changed devices on smithi050 2024-05-20T22:01:42.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:42 smithi050 bash[21866]: audit 2024-05-20T22:01:41.101010+0000 mon.a (mon.0) 433 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:42.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:42 smithi050 bash[21866]: audit 2024-05-20T22:01:41.109986+0000 mon.a (mon.0) 434 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:42.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:42 smithi050 bash[21866]: audit 2024-05-20T22:01:41.111975+0000 mon.a (mon.0) 435 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:01:42.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:42 smithi050 bash[21866]: audit 2024-05-20T22:01:41.113484+0000 mon.a (mon.0) 436 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:01:42.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:42 smithi050 bash[21866]: audit 2024-05-20T22:01:41.114805+0000 mon.a (mon.0) 437 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:01:42.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:42 smithi050 bash[21866]: cephadm 2024-05-20T22:01:41.115822+0000 mgr.y (mgr.14150) 175 : cephadm 1 Adjusting osd_memory_target on smithi050 to 5415M 2024-05-20T22:01:42.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:42 smithi050 bash[21866]: audit 2024-05-20T22:01:41.122246+0000 mon.a (mon.0) 438 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:42.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:42 smithi050 bash[21866]: audit 2024-05-20T22:01:41.127505+0000 mon.a (mon.0) 439 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:01:42.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:42 smithi050 bash[21866]: audit 2024-05-20T22:01:41.128935+0000 mon.a (mon.0) 440 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:01:42.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:42 smithi050 bash[21866]: audit 2024-05-20T22:01:41.137262+0000 mon.a (mon.0) 441 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:42.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:42 smithi050 bash[28929]: cephadm 2024-05-20T22:01:41.093014+0000 mgr.y (mgr.14150) 174 : cephadm 1 Detected new or changed devices on smithi050 2024-05-20T22:01:42.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:42 smithi050 bash[28929]: audit 2024-05-20T22:01:41.101010+0000 mon.a (mon.0) 433 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:42.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:42 smithi050 bash[28929]: audit 2024-05-20T22:01:41.109986+0000 mon.a (mon.0) 434 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:42.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:42 smithi050 bash[28929]: audit 2024-05-20T22:01:41.111975+0000 mon.a (mon.0) 435 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:01:42.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:42 smithi050 bash[28929]: audit 2024-05-20T22:01:41.113484+0000 mon.a (mon.0) 436 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:01:42.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:42 smithi050 bash[28929]: audit 2024-05-20T22:01:41.114805+0000 mon.a (mon.0) 437 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:01:42.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:42 smithi050 bash[28929]: cephadm 2024-05-20T22:01:41.115822+0000 mgr.y (mgr.14150) 175 : cephadm 1 Adjusting osd_memory_target on smithi050 to 5415M 2024-05-20T22:01:42.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:42 smithi050 bash[28929]: audit 2024-05-20T22:01:41.122246+0000 mon.a (mon.0) 438 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:42.450 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:42 smithi050 bash[28929]: audit 2024-05-20T22:01:41.127505+0000 mon.a (mon.0) 439 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:01:42.450 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:42 smithi050 bash[28929]: audit 2024-05-20T22:01:41.128935+0000 mon.a (mon.0) 440 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:01:42.450 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:42 smithi050 bash[28929]: audit 2024-05-20T22:01:41.137262+0000 mon.a (mon.0) 441 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:01:43.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:43 smithi145 bash[23893]: cluster 2024-05-20T22:01:41.456204+0000 mgr.y (mgr.14150) 176 : cluster 0 pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 139 KiB/s wr, 9 op/s 2024-05-20T22:01:43.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:43 smithi050 bash[21866]: cluster 2024-05-20T22:01:41.456204+0000 mgr.y (mgr.14150) 176 : cluster 0 pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 139 KiB/s wr, 9 op/s 2024-05-20T22:01:43.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:43 smithi050 bash[28929]: cluster 2024-05-20T22:01:41.456204+0000 mgr.y (mgr.14150) 176 : cluster 0 pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 139 KiB/s wr, 9 op/s 2024-05-20T22:01:45.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:45 smithi145 bash[23893]: cluster 2024-05-20T22:01:43.456751+0000 mgr.y (mgr.14150) 177 : cluster 0 pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 114 KiB/s wr, 7 op/s 2024-05-20T22:01:45.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:45 smithi050 bash[21866]: cluster 2024-05-20T22:01:43.456751+0000 mgr.y (mgr.14150) 177 : cluster 0 pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 114 KiB/s wr, 7 op/s 2024-05-20T22:01:45.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:45 smithi050 bash[28929]: cluster 2024-05-20T22:01:43.456751+0000 mgr.y (mgr.14150) 177 : cluster 0 pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 114 KiB/s wr, 7 op/s 2024-05-20T22:01:45.462 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:01:47.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:47 smithi050 bash[21866]: cluster 2024-05-20T22:01:45.457275+0000 mgr.y (mgr.14150) 178 : cluster 0 pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-05-20T22:01:47.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:47 smithi050 bash[28929]: cluster 2024-05-20T22:01:45.457275+0000 mgr.y (mgr.14150) 178 : cluster 0 pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-05-20T22:01:47.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:47 smithi145 bash[23893]: cluster 2024-05-20T22:01:45.457275+0000 mgr.y (mgr.14150) 178 : cluster 0 pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-05-20T22:01:47.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a98c5640 1 -- 172.21.15.50:0/994983327 >> v1:172.21.15.50:6790/0 conn(0x7fe3a410feb0 legacy=0x7fe3a4112370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:01:47.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a98c5640 1 -- 172.21.15.50:0/994983327 shutdown_connections 2024-05-20T22:01:47.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a98c5640 1 -- 172.21.15.50:0/994983327 >> 172.21.15.50:0/994983327 conn(0x7fe3a4076d00 msgr2=0x7fe3a4079140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:01:47.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a98c5640 1 -- 172.21.15.50:0/994983327 shutdown_connections 2024-05-20T22:01:47.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a98c5640 1 -- 172.21.15.50:0/994983327 wait complete. 2024-05-20T22:01:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a98c5640 1 Processor -- start 2024-05-20T22:01:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a98c5640 1 -- start start 2024-05-20T22:01:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a98c5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe3a419dc00 con 0x7fe3a4107d40 2024-05-20T22:01:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a98c5640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe3a41a9450 con 0x7fe3a410feb0 2024-05-20T22:01:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a98c5640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe3a41aa630 con 0x7fe3a410c170 2024-05-20T22:01:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a2ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe3a4107d40 0x7fe3a419d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51354/0 (socket says 172.21.15.50:51354) 2024-05-20T22:01:47.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a2ffd640 1 -- 172.21.15.50:0/2859212408 learned_addr learned my addr 172.21.15.50:0/2859212408 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:01:47.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 452806248 0 0) 0x7fe3a41aa630 con 0x7fe3a410c170 2024-05-20T22:01:47.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe38c003520 con 0x7fe3a410c170 2024-05-20T22:01:47.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1489373702 0 0) 0x7fe3a419dc00 con 0x7fe3a4107d40 2024-05-20T22:01:47.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3a41aa630 con 0x7fe3a4107d40 2024-05-20T22:01:47.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1338376421 0 0) 0x7fe38c003520 con 0x7fe3a410c170 2024-05-20T22:01:47.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3a419dc00 con 0x7fe3a410c170 2024-05-20T22:01:47.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fe394001830 con 0x7fe3a410c170 2024-05-20T22:01:47.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1462008035 0 0) 0x7fe3a41aa630 con 0x7fe3a4107d40 2024-05-20T22:01:47.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe38c003520 con 0x7fe3a4107d40 2024-05-20T22:01:47.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fe398001810 con 0x7fe3a4107d40 2024-05-20T22:01:47.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1317576860 0 0) 0x7fe3a41a9450 con 0x7fe3a410feb0 2024-05-20T22:01:47.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3a41aa630 con 0x7fe3a410feb0 2024-05-20T22:01:47.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1783170130 0 0) 0x7fe3a419dc00 con 0x7fe3a410c170 2024-05-20T22:01:47.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 >> v1:172.21.15.145:6789/0 conn(0x7fe3a410feb0 legacy=0x7fe3a41a6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:01:47.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 >> v1:172.21.15.50:6789/0 conn(0x7fe3a4107d40 legacy=0x7fe3a419d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:01:47.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a41ab810 con 0x7fe3a410c170 2024-05-20T22:01:47.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a98c5640 1 -- 172.21.15.50:0/2859212408 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a41a84a0 con 0x7fe3a410c170 2024-05-20T22:01:47.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a98c5640 1 -- 172.21.15.50:0/2859212408 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe3a41a89e0 con 0x7fe3a410c170 2024-05-20T22:01:47.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7fe394003a80 con 0x7fe3a410c170 2024-05-20T22:01:47.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.933+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fe3940049d0 con 0x7fe3a410c170 2024-05-20T22:01:47.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.937+0000 7fe3a98c5640 1 -- 172.21.15.50:0/2859212408 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3900050b0 con 0x7fe3a410c170 2024-05-20T22:01:47.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.937+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 15) ==== 92081+0+0 (unknown 2274281742 0 0) 0x7fe3940035f0 con 0x7fe3a410c170 2024-05-20T22:01:47.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.937+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(21..21 src has 1..21) ==== 2511+0+0 (unknown 2960596261 0 0) 0x7fe3940874b0 con 0x7fe3a410c170 2024-05-20T22:01:47.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:47.941+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7fe394055ac0 con 0x7fe3a410c170 2024-05-20T22:01:48.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:01:48.145+0000 7fe3a98c5640 1 -- 172.21.15.50:0/2859212408 --> v1:172.21.15.50:6800/2944911247 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe390000bc0 con 0x7fe38c06ee60 2024-05-20T22:01:49.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:49 smithi050 bash[21866]: cluster 2024-05-20T22:01:47.457861+0000 mgr.y (mgr.14150) 179 : cluster 0 pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-05-20T22:01:49.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:49 smithi050 bash[21866]: audit 2024-05-20T22:01:48.151787+0000 mgr.y (mgr.14150) 180 : audit 0 from='client.24209 v1:172.21.15.50:0/2859212408' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:01:49.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:49 smithi050 bash[21866]: audit 2024-05-20T22:01:48.154431+0000 mon.a (mon.0) 442 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:01:49.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:49 smithi050 bash[21866]: audit 2024-05-20T22:01:48.159798+0000 mon.a (mon.0) 443 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:01:49.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:49 smithi050 bash[21866]: audit 2024-05-20T22:01:48.161060+0000 mon.a (mon.0) 444 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:01:49.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:49 smithi050 bash[28929]: cluster 2024-05-20T22:01:47.457861+0000 mgr.y (mgr.14150) 179 : cluster 0 pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-05-20T22:01:49.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:49 smithi050 bash[28929]: audit 2024-05-20T22:01:48.151787+0000 mgr.y (mgr.14150) 180 : audit 0 from='client.24209 v1:172.21.15.50:0/2859212408' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:01:49.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:49 smithi050 bash[28929]: audit 2024-05-20T22:01:48.154431+0000 mon.a (mon.0) 442 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:01:49.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:49 smithi050 bash[28929]: audit 2024-05-20T22:01:48.159798+0000 mon.a (mon.0) 443 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:01:49.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:49 smithi050 bash[28929]: audit 2024-05-20T22:01:48.161060+0000 mon.a (mon.0) 444 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:01:49.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:49 smithi145 bash[23893]: cluster 2024-05-20T22:01:47.457861+0000 mgr.y (mgr.14150) 179 : cluster 0 pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-05-20T22:01:49.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:49 smithi145 bash[23893]: audit 2024-05-20T22:01:48.151787+0000 mgr.y (mgr.14150) 180 : audit 0 from='client.24209 v1:172.21.15.50:0/2859212408' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:01:49.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:49 smithi145 bash[23893]: audit 2024-05-20T22:01:48.154431+0000 mon.a (mon.0) 442 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:01:49.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:49 smithi145 bash[23893]: audit 2024-05-20T22:01:48.159798+0000 mon.a (mon.0) 443 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:01:49.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:49 smithi145 bash[23893]: audit 2024-05-20T22:01:48.161060+0000 mon.a (mon.0) 444 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:01:51.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:51 smithi050 bash[21866]: cluster 2024-05-20T22:01:49.458397+0000 mgr.y (mgr.14150) 181 : cluster 0 pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:51.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:51 smithi050 bash[28929]: cluster 2024-05-20T22:01:49.458397+0000 mgr.y (mgr.14150) 181 : cluster 0 pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:51.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:51 smithi145 bash[23893]: cluster 2024-05-20T22:01:49.458397+0000 mgr.y (mgr.14150) 181 : cluster 0 pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:53.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:53 smithi050 bash[21866]: cluster 2024-05-20T22:01:51.458937+0000 mgr.y (mgr.14150) 182 : cluster 0 pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:53.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:53 smithi050 bash[28929]: cluster 2024-05-20T22:01:51.458937+0000 mgr.y (mgr.14150) 182 : cluster 0 pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:53.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:53 smithi145 bash[23893]: cluster 2024-05-20T22:01:51.458937+0000 mgr.y (mgr.14150) 182 : cluster 0 pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:55.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:55 smithi050 bash[21866]: cluster 2024-05-20T22:01:53.459551+0000 mgr.y (mgr.14150) 183 : cluster 0 pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:55.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:55 smithi050 bash[28929]: cluster 2024-05-20T22:01:53.459551+0000 mgr.y (mgr.14150) 183 : cluster 0 pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:55.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:55 smithi145 bash[23893]: cluster 2024-05-20T22:01:53.459551+0000 mgr.y (mgr.14150) 183 : cluster 0 pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:57.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:57 smithi050 bash[28929]: cluster 2024-05-20T22:01:55.460238+0000 mgr.y (mgr.14150) 184 : cluster 0 pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:57.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:57 smithi050 bash[28929]: audit 2024-05-20T22:01:56.577506+0000 mon.a (mon.0) 445 : audit 1 from='client.? v1:172.21.15.50:0/1597218321' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6e60bb64-706c-438b-8edf-49c2709374c8"}]: dispatch 2024-05-20T22:01:57.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:57 smithi050 bash[28929]: audit 2024-05-20T22:01:56.580272+0000 mon.a (mon.0) 446 : audit 1 from='client.? v1:172.21.15.50:0/1597218321' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6e60bb64-706c-438b-8edf-49c2709374c8"}]': finished 2024-05-20T22:01:57.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:57 smithi050 bash[28929]: cluster 2024-05-20T22:01:56.583973+0000 mon.a (mon.0) 447 : cluster 0 osdmap e22: 4 total, 3 up, 4 in 2024-05-20T22:01:57.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:57 smithi050 bash[28929]: audit 2024-05-20T22:01:56.584451+0000 mon.a (mon.0) 448 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:01:57.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:57 smithi050 bash[21866]: cluster 2024-05-20T22:01:55.460238+0000 mgr.y (mgr.14150) 184 : cluster 0 pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:57.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:57 smithi050 bash[21866]: audit 2024-05-20T22:01:56.577506+0000 mon.a (mon.0) 445 : audit 1 from='client.? v1:172.21.15.50:0/1597218321' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6e60bb64-706c-438b-8edf-49c2709374c8"}]: dispatch 2024-05-20T22:01:57.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:57 smithi050 bash[21866]: audit 2024-05-20T22:01:56.580272+0000 mon.a (mon.0) 446 : audit 1 from='client.? v1:172.21.15.50:0/1597218321' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6e60bb64-706c-438b-8edf-49c2709374c8"}]': finished 2024-05-20T22:01:57.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:57 smithi050 bash[21866]: cluster 2024-05-20T22:01:56.583973+0000 mon.a (mon.0) 447 : cluster 0 osdmap e22: 4 total, 3 up, 4 in 2024-05-20T22:01:57.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:57 smithi050 bash[21866]: audit 2024-05-20T22:01:56.584451+0000 mon.a (mon.0) 448 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:01:57.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:57 smithi145 bash[23893]: cluster 2024-05-20T22:01:55.460238+0000 mgr.y (mgr.14150) 184 : cluster 0 pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:57.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:57 smithi145 bash[23893]: audit 2024-05-20T22:01:56.577506+0000 mon.a (mon.0) 445 : audit 1 from='client.? v1:172.21.15.50:0/1597218321' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6e60bb64-706c-438b-8edf-49c2709374c8"}]: dispatch 2024-05-20T22:01:57.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:57 smithi145 bash[23893]: audit 2024-05-20T22:01:56.580272+0000 mon.a (mon.0) 446 : audit 1 from='client.? v1:172.21.15.50:0/1597218321' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6e60bb64-706c-438b-8edf-49c2709374c8"}]': finished 2024-05-20T22:01:57.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:57 smithi145 bash[23893]: cluster 2024-05-20T22:01:56.583973+0000 mon.a (mon.0) 447 : cluster 0 osdmap e22: 4 total, 3 up, 4 in 2024-05-20T22:01:57.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:57 smithi145 bash[23893]: audit 2024-05-20T22:01:56.584451+0000 mon.a (mon.0) 448 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:01:58.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:58 smithi050 bash[21866]: audit 2024-05-20T22:01:57.262558+0000 mon.a (mon.0) 449 : audit 0 from='client.? v1:172.21.15.50:0/3447848150' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:01:58.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:58 smithi050 bash[28929]: audit 2024-05-20T22:01:57.262558+0000 mon.a (mon.0) 449 : audit 0 from='client.? v1:172.21.15.50:0/3447848150' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:01:58.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:58 smithi145 bash[23893]: audit 2024-05-20T22:01:57.262558+0000 mon.a (mon.0) 449 : audit 0 from='client.? v1:172.21.15.50:0/3447848150' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:01:59.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:01:59 smithi050 bash[21866]: cluster 2024-05-20T22:01:57.460870+0000 mgr.y (mgr.14150) 185 : cluster 0 pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:59.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:01:59 smithi050 bash[28929]: cluster 2024-05-20T22:01:57.460870+0000 mgr.y (mgr.14150) 185 : cluster 0 pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:01:59.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:01:59 smithi145 bash[23893]: cluster 2024-05-20T22:01:57.460870+0000 mgr.y (mgr.14150) 185 : cluster 0 pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:01.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:01 smithi050 bash[21866]: cluster 2024-05-20T22:01:59.461514+0000 mgr.y (mgr.14150) 186 : cluster 0 pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:01.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:01 smithi050 bash[28929]: cluster 2024-05-20T22:01:59.461514+0000 mgr.y (mgr.14150) 186 : cluster 0 pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:01.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:01 smithi145 bash[23893]: cluster 2024-05-20T22:01:59.461514+0000 mgr.y (mgr.14150) 186 : cluster 0 pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:03.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:03 smithi050 bash[21866]: cluster 2024-05-20T22:02:01.462086+0000 mgr.y (mgr.14150) 187 : cluster 0 pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:03.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:03 smithi050 bash[28929]: cluster 2024-05-20T22:02:01.462086+0000 mgr.y (mgr.14150) 187 : cluster 0 pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:03.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:03 smithi145 bash[23893]: cluster 2024-05-20T22:02:01.462086+0000 mgr.y (mgr.14150) 187 : cluster 0 pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:05.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:05 smithi050 bash[21866]: cluster 2024-05-20T22:02:03.462486+0000 mgr.y (mgr.14150) 188 : cluster 0 pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:05.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:05 smithi050 bash[28929]: cluster 2024-05-20T22:02:03.462486+0000 mgr.y (mgr.14150) 188 : cluster 0 pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:05.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:05 smithi145 bash[23893]: cluster 2024-05-20T22:02:03.462486+0000 mgr.y (mgr.14150) 188 : cluster 0 pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:07.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:07 smithi050 bash[21866]: cluster 2024-05-20T22:02:05.462979+0000 mgr.y (mgr.14150) 189 : cluster 0 pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:07.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:07 smithi050 bash[28929]: cluster 2024-05-20T22:02:05.462979+0000 mgr.y (mgr.14150) 189 : cluster 0 pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:07.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:07 smithi145 bash[23893]: cluster 2024-05-20T22:02:05.462979+0000 mgr.y (mgr.14150) 189 : cluster 0 pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:09.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:09 smithi050 bash[21866]: cluster 2024-05-20T22:02:07.463553+0000 mgr.y (mgr.14150) 190 : cluster 0 pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:09.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:09 smithi050 bash[21866]: audit 2024-05-20T22:02:08.983448+0000 mon.a (mon.0) 450 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-20T22:02:09.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:09 smithi050 bash[21866]: audit 2024-05-20T22:02:08.985105+0000 mon.a (mon.0) 451 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:02:09.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:09 smithi050 bash[28929]: cluster 2024-05-20T22:02:07.463553+0000 mgr.y (mgr.14150) 190 : cluster 0 pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:09.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:09 smithi050 bash[28929]: audit 2024-05-20T22:02:08.983448+0000 mon.a (mon.0) 450 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-20T22:02:09.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:09 smithi050 bash[28929]: audit 2024-05-20T22:02:08.985105+0000 mon.a (mon.0) 451 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:02:09.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:09 smithi145 bash[23893]: cluster 2024-05-20T22:02:07.463553+0000 mgr.y (mgr.14150) 190 : cluster 0 pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:09.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:09 smithi145 bash[23893]: audit 2024-05-20T22:02:08.983448+0000 mon.a (mon.0) 450 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-20T22:02:09.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:09 smithi145 bash[23893]: audit 2024-05-20T22:02:08.985105+0000 mon.a (mon.0) 451 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:02:10.454 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:10 smithi050 bash[21866]: cephadm 2024-05-20T22:02:08.986444+0000 mgr.y (mgr.14150) 191 : cephadm 1 Deploying daemon osd.3 on smithi050 2024-05-20T22:02:10.455 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:10 smithi050 bash[28929]: cephadm 2024-05-20T22:02:08.986444+0000 mgr.y (mgr.14150) 191 : cephadm 1 Deploying daemon osd.3 on smithi050 2024-05-20T22:02:10.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:10 smithi145 bash[23893]: cephadm 2024-05-20T22:02:08.986444+0000 mgr.y (mgr.14150) 191 : cephadm 1 Deploying daemon osd.3 on smithi050 2024-05-20T22:02:11.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:11 smithi145 bash[23893]: cluster 2024-05-20T22:02:09.463912+0000 mgr.y (mgr.14150) 192 : cluster 0 pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:11.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:11 smithi050 bash[28929]: cluster 2024-05-20T22:02:09.463912+0000 mgr.y (mgr.14150) 192 : cluster 0 pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:11.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:11 smithi050 bash[21866]: cluster 2024-05-20T22:02:09.463912+0000 mgr.y (mgr.14150) 192 : cluster 0 pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:13.381 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:02:13 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:02:13.382 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:13 smithi050 bash[21866]: cluster 2024-05-20T22:02:11.464364+0000 mgr.y (mgr.14150) 193 : cluster 0 pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:13.382 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:13 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:02:13.382 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:13 smithi050 bash[28929]: cluster 2024-05-20T22:02:11.464364+0000 mgr.y (mgr.14150) 193 : cluster 0 pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:13.382 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:13 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:02:13.383 INFO:journalctl@ceph.osd.0.smithi050.stdout:May 20 22:02:13 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:02:13.383 INFO:journalctl@ceph.osd.1.smithi050.stdout:May 20 22:02:13 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:02:13.383 INFO:journalctl@ceph.osd.2.smithi050.stdout:May 20 22:02:13 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:02:13.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:13 smithi145 bash[23893]: cluster 2024-05-20T22:02:11.464364+0000 mgr.y (mgr.14150) 193 : cluster 0 pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:13.672 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:13 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:02:13.753 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:02:13 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:02:13.753 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:13 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:02:13.753 INFO:journalctl@ceph.osd.0.smithi050.stdout:May 20 22:02:13 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:02:13.753 INFO:journalctl@ceph.osd.1.smithi050.stdout:May 20 22:02:13 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:02:13.754 INFO:journalctl@ceph.osd.2.smithi050.stdout:May 20 22:02:13 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:02:14.493 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:14 smithi050 bash[21866]: audit 2024-05-20T22:02:13.666860+0000 mon.a (mon.0) 452 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:02:14.493 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:14 smithi050 bash[21866]: audit 2024-05-20T22:02:13.671551+0000 mon.a (mon.0) 453 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:14.493 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:14 smithi050 bash[21866]: audit 2024-05-20T22:02:13.676673+0000 mon.a (mon.0) 454 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:14.493 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:14 smithi050 bash[28929]: audit 2024-05-20T22:02:13.666860+0000 mon.a (mon.0) 452 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:02:14.494 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:14 smithi050 bash[28929]: audit 2024-05-20T22:02:13.671551+0000 mon.a (mon.0) 453 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:14.494 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:14 smithi050 bash[28929]: audit 2024-05-20T22:02:13.676673+0000 mon.a (mon.0) 454 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:14.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:14 smithi145 bash[23893]: audit 2024-05-20T22:02:13.666860+0000 mon.a (mon.0) 452 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:02:14.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:14 smithi145 bash[23893]: audit 2024-05-20T22:02:13.671551+0000 mon.a (mon.0) 453 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:14.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:14 smithi145 bash[23893]: audit 2024-05-20T22:02:13.676673+0000 mon.a (mon.0) 454 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:15.247 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:15 smithi050 bash[21866]: cluster 2024-05-20T22:02:13.464728+0000 mgr.y (mgr.14150) 194 : cluster 0 pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:15.247 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:15 smithi050 bash[28929]: cluster 2024-05-20T22:02:13.464728+0000 mgr.y (mgr.14150) 194 : cluster 0 pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:15.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:15 smithi145 bash[23893]: cluster 2024-05-20T22:02:13.464728+0000 mgr.y (mgr.14150) 194 : cluster 0 pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:17.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:17 smithi050 bash[21866]: cluster 2024-05-20T22:02:15.465244+0000 mgr.y (mgr.14150) 195 : cluster 0 pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:17.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:17 smithi050 bash[28929]: cluster 2024-05-20T22:02:15.465244+0000 mgr.y (mgr.14150) 195 : cluster 0 pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:17.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:17 smithi145 bash[23893]: cluster 2024-05-20T22:02:15.465244+0000 mgr.y (mgr.14150) 195 : cluster 0 pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:19 smithi145 bash[23893]: cluster 2024-05-20T22:02:17.465917+0000 mgr.y (mgr.14150) 196 : cluster 0 pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:19.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:19 smithi050 bash[28929]: cluster 2024-05-20T22:02:17.465917+0000 mgr.y (mgr.14150) 196 : cluster 0 pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:19.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:19 smithi050 bash[21866]: cluster 2024-05-20T22:02:17.465917+0000 mgr.y (mgr.14150) 196 : cluster 0 pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:20.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:20 smithi050 bash[21866]: audit 2024-05-20T22:02:20.023479+0000 mon.a (mon.0) 455 : audit 1 from='osd.3 v1:172.21.15.50:6813/3714877290' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-20T22:02:20.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:20 smithi050 bash[28929]: audit 2024-05-20T22:02:20.023479+0000 mon.a (mon.0) 455 : audit 1 from='osd.3 v1:172.21.15.50:6813/3714877290' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-20T22:02:20.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:20 smithi145 bash[23893]: audit 2024-05-20T22:02:20.023479+0000 mon.a (mon.0) 455 : audit 1 from='osd.3 v1:172.21.15.50:6813/3714877290' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-20T22:02:21.355 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:21 smithi050 bash[21866]: cluster 2024-05-20T22:02:19.466484+0000 mgr.y (mgr.14150) 197 : cluster 0 pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:21.355 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:21 smithi050 bash[21866]: audit 2024-05-20T22:02:20.230701+0000 mon.a (mon.0) 456 : audit 1 from='osd.3 v1:172.21.15.50:6813/3714877290' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-20T22:02:21.356 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:21 smithi050 bash[21866]: cluster 2024-05-20T22:02:20.234932+0000 mon.a (mon.0) 457 : cluster 0 osdmap e23: 4 total, 3 up, 4 in 2024-05-20T22:02:21.356 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:21 smithi050 bash[21866]: audit 2024-05-20T22:02:20.235350+0000 mon.a (mon.0) 458 : audit 1 from='osd.3 v1:172.21.15.50:6813/3714877290' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-05-20T22:02:21.356 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:21 smithi050 bash[21866]: audit 2024-05-20T22:02:20.235752+0000 mon.a (mon.0) 459 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:02:21.356 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:21 smithi050 bash[21866]: audit 2024-05-20T22:02:20.567442+0000 mon.a (mon.0) 460 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:21.356 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:21 smithi050 bash[21866]: audit 2024-05-20T22:02:20.573447+0000 mon.a (mon.0) 461 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:21.356 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:21 smithi050 bash[21866]: audit 2024-05-20T22:02:20.574351+0000 mon.a (mon.0) 462 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:02:21.356 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:21 smithi050 bash[21866]: audit 2024-05-20T22:02:20.575095+0000 mon.a (mon.0) 463 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:02:21.356 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:21 smithi050 bash[21866]: audit 2024-05-20T22:02:20.579975+0000 mon.a (mon.0) 464 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:21.356 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:21 smithi050 bash[28929]: cluster 2024-05-20T22:02:19.466484+0000 mgr.y (mgr.14150) 197 : cluster 0 pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:21.356 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:21 smithi050 bash[28929]: audit 2024-05-20T22:02:20.230701+0000 mon.a (mon.0) 456 : audit 1 from='osd.3 v1:172.21.15.50:6813/3714877290' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-20T22:02:21.356 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:21 smithi050 bash[28929]: cluster 2024-05-20T22:02:20.234932+0000 mon.a (mon.0) 457 : cluster 0 osdmap e23: 4 total, 3 up, 4 in 2024-05-20T22:02:21.357 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:21 smithi050 bash[28929]: audit 2024-05-20T22:02:20.235350+0000 mon.a (mon.0) 458 : audit 1 from='osd.3 v1:172.21.15.50:6813/3714877290' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-05-20T22:02:21.357 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:21 smithi050 bash[28929]: audit 2024-05-20T22:02:20.235752+0000 mon.a (mon.0) 459 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:02:21.357 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:21 smithi050 bash[28929]: audit 2024-05-20T22:02:20.567442+0000 mon.a (mon.0) 460 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:21.357 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:21 smithi050 bash[28929]: audit 2024-05-20T22:02:20.573447+0000 mon.a (mon.0) 461 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:21.357 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:21 smithi050 bash[28929]: audit 2024-05-20T22:02:20.574351+0000 mon.a (mon.0) 462 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:02:21.357 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:21 smithi050 bash[28929]: audit 2024-05-20T22:02:20.575095+0000 mon.a (mon.0) 463 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:02:21.357 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:21 smithi050 bash[28929]: audit 2024-05-20T22:02:20.579975+0000 mon.a (mon.0) 464 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:21.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:21 smithi145 bash[23893]: cluster 2024-05-20T22:02:19.466484+0000 mgr.y (mgr.14150) 197 : cluster 0 pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:21.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:21 smithi145 bash[23893]: audit 2024-05-20T22:02:20.230701+0000 mon.a (mon.0) 456 : audit 1 from='osd.3 v1:172.21.15.50:6813/3714877290' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-20T22:02:21.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:21 smithi145 bash[23893]: cluster 2024-05-20T22:02:20.234932+0000 mon.a (mon.0) 457 : cluster 0 osdmap e23: 4 total, 3 up, 4 in 2024-05-20T22:02:21.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:21 smithi145 bash[23893]: audit 2024-05-20T22:02:20.235350+0000 mon.a (mon.0) 458 : audit 1 from='osd.3 v1:172.21.15.50:6813/3714877290' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-05-20T22:02:21.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:21 smithi145 bash[23893]: audit 2024-05-20T22:02:20.235752+0000 mon.a (mon.0) 459 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:02:21.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:21 smithi145 bash[23893]: audit 2024-05-20T22:02:20.567442+0000 mon.a (mon.0) 460 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:21.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:21 smithi145 bash[23893]: audit 2024-05-20T22:02:20.573447+0000 mon.a (mon.0) 461 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:21.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:21 smithi145 bash[23893]: audit 2024-05-20T22:02:20.574351+0000 mon.a (mon.0) 462 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:02:21.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:21 smithi145 bash[23893]: audit 2024-05-20T22:02:20.575095+0000 mon.a (mon.0) 463 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:02:21.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:21 smithi145 bash[23893]: audit 2024-05-20T22:02:20.579975+0000 mon.a (mon.0) 464 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:22.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:22 smithi145 bash[23893]: audit 2024-05-20T22:02:21.232868+0000 mon.a (mon.0) 465 : audit 1 from='osd.3 v1:172.21.15.50:6813/3714877290' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-05-20T22:02:22.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:22 smithi145 bash[23893]: cluster 2024-05-20T22:02:21.236733+0000 mon.a (mon.0) 466 : cluster 0 osdmap e24: 4 total, 3 up, 4 in 2024-05-20T22:02:22.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:22 smithi145 bash[23893]: audit 2024-05-20T22:02:21.237863+0000 mon.a (mon.0) 467 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:02:22.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:22 smithi145 bash[23893]: audit 2024-05-20T22:02:21.251183+0000 mon.a (mon.0) 468 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:02:22.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:22 smithi145 bash[23893]: audit 2024-05-20T22:02:21.563595+0000 mon.a (mon.0) 469 : audit 1 from='osd.3 v1:172.21.15.50:6813/3714877290' entity='osd.3' 2024-05-20T22:02:22.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:22 smithi050 bash[28929]: audit 2024-05-20T22:02:21.232868+0000 mon.a (mon.0) 465 : audit 1 from='osd.3 v1:172.21.15.50:6813/3714877290' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-05-20T22:02:22.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:22 smithi050 bash[28929]: cluster 2024-05-20T22:02:21.236733+0000 mon.a (mon.0) 466 : cluster 0 osdmap e24: 4 total, 3 up, 4 in 2024-05-20T22:02:22.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:22 smithi050 bash[28929]: audit 2024-05-20T22:02:21.237863+0000 mon.a (mon.0) 467 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:02:22.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:22 smithi050 bash[28929]: audit 2024-05-20T22:02:21.251183+0000 mon.a (mon.0) 468 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:02:22.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:22 smithi050 bash[28929]: audit 2024-05-20T22:02:21.563595+0000 mon.a (mon.0) 469 : audit 1 from='osd.3 v1:172.21.15.50:6813/3714877290' entity='osd.3' 2024-05-20T22:02:22.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:22 smithi050 bash[21866]: audit 2024-05-20T22:02:21.232868+0000 mon.a (mon.0) 465 : audit 1 from='osd.3 v1:172.21.15.50:6813/3714877290' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-05-20T22:02:22.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:22 smithi050 bash[21866]: cluster 2024-05-20T22:02:21.236733+0000 mon.a (mon.0) 466 : cluster 0 osdmap e24: 4 total, 3 up, 4 in 2024-05-20T22:02:22.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:22 smithi050 bash[21866]: audit 2024-05-20T22:02:21.237863+0000 mon.a (mon.0) 467 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:02:22.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:22 smithi050 bash[21866]: audit 2024-05-20T22:02:21.251183+0000 mon.a (mon.0) 468 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:02:22.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:22 smithi050 bash[21866]: audit 2024-05-20T22:02:21.563595+0000 mon.a (mon.0) 469 : audit 1 from='osd.3 v1:172.21.15.50:6813/3714877290' entity='osd.3' 2024-05-20T22:02:23.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:23 smithi050 bash[21866]: cluster 2024-05-20T22:02:20.988194+0000 osd.3 (osd.3) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:02:23.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:23 smithi050 bash[21866]: cluster 2024-05-20T22:02:20.988315+0000 osd.3 (osd.3) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:02:23.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:23 smithi050 bash[21866]: cluster 2024-05-20T22:02:21.467059+0000 mgr.y (mgr.14150) 198 : cluster 0 pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:23.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:23 smithi050 bash[21866]: audit 2024-05-20T22:02:22.241915+0000 mon.a (mon.0) 470 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:02:23.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:23 smithi050 bash[21866]: cluster 2024-05-20T22:02:22.571032+0000 mon.a (mon.0) 471 : cluster 1 osd.3 v1:172.21.15.50:6813/3714877290 boot 2024-05-20T22:02:23.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:23 smithi050 bash[21866]: cluster 2024-05-20T22:02:22.571121+0000 mon.a (mon.0) 472 : cluster 0 osdmap e25: 4 total, 4 up, 4 in 2024-05-20T22:02:23.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:23 smithi050 bash[21866]: audit 2024-05-20T22:02:22.571913+0000 mon.a (mon.0) 473 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:02:23.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:23 smithi050 bash[28929]: cluster 2024-05-20T22:02:20.988194+0000 osd.3 (osd.3) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:02:23.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:23 smithi050 bash[28929]: cluster 2024-05-20T22:02:20.988315+0000 osd.3 (osd.3) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:02:23.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:23 smithi050 bash[28929]: cluster 2024-05-20T22:02:21.467059+0000 mgr.y (mgr.14150) 198 : cluster 0 pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:23.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:23 smithi050 bash[28929]: audit 2024-05-20T22:02:22.241915+0000 mon.a (mon.0) 470 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:02:23.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:23 smithi050 bash[28929]: cluster 2024-05-20T22:02:22.571032+0000 mon.a (mon.0) 471 : cluster 1 osd.3 v1:172.21.15.50:6813/3714877290 boot 2024-05-20T22:02:23.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:23 smithi050 bash[28929]: cluster 2024-05-20T22:02:22.571121+0000 mon.a (mon.0) 472 : cluster 0 osdmap e25: 4 total, 4 up, 4 in 2024-05-20T22:02:23.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:23 smithi050 bash[28929]: audit 2024-05-20T22:02:22.571913+0000 mon.a (mon.0) 473 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:02:23.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:23 smithi145 bash[23893]: cluster 2024-05-20T22:02:20.988194+0000 osd.3 (osd.3) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:02:23.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:23 smithi145 bash[23893]: cluster 2024-05-20T22:02:20.988315+0000 osd.3 (osd.3) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:02:23.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:23 smithi145 bash[23893]: cluster 2024-05-20T22:02:21.467059+0000 mgr.y (mgr.14150) 198 : cluster 0 pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-20T22:02:23.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:23 smithi145 bash[23893]: audit 2024-05-20T22:02:22.241915+0000 mon.a (mon.0) 470 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:02:23.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:23 smithi145 bash[23893]: cluster 2024-05-20T22:02:22.571032+0000 mon.a (mon.0) 471 : cluster 1 osd.3 v1:172.21.15.50:6813/3714877290 boot 2024-05-20T22:02:23.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:23 smithi145 bash[23893]: cluster 2024-05-20T22:02:22.571121+0000 mon.a (mon.0) 472 : cluster 0 osdmap e25: 4 total, 4 up, 4 in 2024-05-20T22:02:23.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:23 smithi145 bash[23893]: audit 2024-05-20T22:02:22.571913+0000 mon.a (mon.0) 473 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:02:23.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:02:23.932+0000 7fe3a88c3640 1 -- 172.21.15.50:0/2859212408 <== mgr.14150 v1:172.21.15.50:6800/2944911247 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (unknown 0 0 1590185958) 0x7fe390000bc0 con 0x7fe38c06ee60 2024-05-20T22:02:23.937 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 3 on host 'smithi050' 2024-05-20T22:02:23.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:02:23.936+0000 7fe3a98c5640 1 -- 172.21.15.50:0/2859212408 >> v1:172.21.15.50:6800/2944911247 conn(0x7fe38c06ee60 legacy=0x7fe38c071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:02:23.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:02:23.936+0000 7fe3a98c5640 1 -- 172.21.15.50:0/2859212408 >> v1:172.21.15.50:6790/0 conn(0x7fe3a410c170 legacy=0x7fe3a41a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:02:23.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:02:23.936+0000 7fe3a98c5640 1 -- 172.21.15.50:0/2859212408 shutdown_connections 2024-05-20T22:02:23.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:02:23.936+0000 7fe3a98c5640 1 -- 172.21.15.50:0/2859212408 >> 172.21.15.50:0/2859212408 conn(0x7fe3a4076d00 msgr2=0x7fe3a410ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:02:23.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:02:23.936+0000 7fe3a98c5640 1 -- 172.21.15.50:0/2859212408 shutdown_connections 2024-05-20T22:02:23.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:02:23.936+0000 7fe3a98c5640 1 -- 172.21.15.50:0/2859212408 wait complete. 2024-05-20T22:02:24.608 DEBUG:teuthology.orchestra.run.smithi050:osd.3> sudo journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.3.service 2024-05-20T22:02:24.610 INFO:tasks.cephadm:Deploying osd.4 on smithi145 with /dev/vg_nvme/lv_4... 2024-05-20T22:02:24.611 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-20T22:02:24.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:24 smithi145 bash[23893]: cluster 2024-05-20T22:02:23.467615+0000 mgr.y (mgr.14150) 199 : cluster 0 pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:24.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:24 smithi145 bash[23893]: cluster 2024-05-20T22:02:23.571207+0000 mon.a (mon.0) 474 : cluster 0 osdmap e26: 4 total, 4 up, 4 in 2024-05-20T22:02:24.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:24 smithi145 bash[23893]: audit 2024-05-20T22:02:23.918328+0000 mon.a (mon.0) 475 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:02:24.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:24 smithi145 bash[23893]: audit 2024-05-20T22:02:23.925499+0000 mon.a (mon.0) 476 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:24.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:24 smithi145 bash[23893]: audit 2024-05-20T22:02:23.934450+0000 mon.a (mon.0) 477 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:24.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:24 smithi050 bash[28929]: cluster 2024-05-20T22:02:23.467615+0000 mgr.y (mgr.14150) 199 : cluster 0 pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:24.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:24 smithi050 bash[28929]: cluster 2024-05-20T22:02:23.571207+0000 mon.a (mon.0) 474 : cluster 0 osdmap e26: 4 total, 4 up, 4 in 2024-05-20T22:02:24.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:24 smithi050 bash[28929]: audit 2024-05-20T22:02:23.918328+0000 mon.a (mon.0) 475 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:02:24.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:24 smithi050 bash[28929]: audit 2024-05-20T22:02:23.925499+0000 mon.a (mon.0) 476 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:24.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:24 smithi050 bash[28929]: audit 2024-05-20T22:02:23.934450+0000 mon.a (mon.0) 477 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:24.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:24 smithi050 bash[21866]: cluster 2024-05-20T22:02:23.467615+0000 mgr.y (mgr.14150) 199 : cluster 0 pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:24.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:24 smithi050 bash[21866]: cluster 2024-05-20T22:02:23.571207+0000 mon.a (mon.0) 474 : cluster 0 osdmap e26: 4 total, 4 up, 4 in 2024-05-20T22:02:24.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:24 smithi050 bash[21866]: audit 2024-05-20T22:02:23.918328+0000 mon.a (mon.0) 475 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:02:24.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:24 smithi050 bash[21866]: audit 2024-05-20T22:02:23.925499+0000 mon.a (mon.0) 476 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:24.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:24 smithi050 bash[21866]: audit 2024-05-20T22:02:23.934450+0000 mon.a (mon.0) 477 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:26.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:26 smithi145 bash[23893]: cluster 2024-05-20T22:02:25.468190+0000 mgr.y (mgr.14150) 200 : cluster 0 pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:26.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:26 smithi050 bash[21866]: cluster 2024-05-20T22:02:25.468190+0000 mgr.y (mgr.14150) 200 : cluster 0 pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:26.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:26 smithi050 bash[28929]: cluster 2024-05-20T22:02:25.468190+0000 mgr.y (mgr.14150) 200 : cluster 0 pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:28.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:28 smithi145 bash[23893]: cluster 2024-05-20T22:02:27.468860+0000 mgr.y (mgr.14150) 201 : cluster 0 pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:28.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:28 smithi050 bash[21866]: cluster 2024-05-20T22:02:27.468860+0000 mgr.y (mgr.14150) 201 : cluster 0 pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:28.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:28 smithi050 bash[28929]: cluster 2024-05-20T22:02:27.468860+0000 mgr.y (mgr.14150) 201 : cluster 0 pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:29.319 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T22:02:30.840 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:30 smithi145 bash[23893]: cluster 2024-05-20T22:02:29.469534+0000 mgr.y (mgr.14150) 202 : cluster 0 pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:30.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:30 smithi050 bash[21866]: cluster 2024-05-20T22:02:29.469534+0000 mgr.y (mgr.14150) 202 : cluster 0 pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:30.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:30 smithi050 bash[28929]: cluster 2024-05-20T22:02:29.469534+0000 mgr.y (mgr.14150) 202 : cluster 0 pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:31.861 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-20T22:02:32.048 INFO:teuthology.orchestra.run.smithi145.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-20T22:02:32.064 INFO:teuthology.orchestra.run.smithi145.stderr: stderr: 10+0 records in 2024-05-20T22:02:32.064 INFO:teuthology.orchestra.run.smithi145.stderr:10+0 records out 2024-05-20T22:02:32.064 INFO:teuthology.orchestra.run.smithi145.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0136296 s, 769 MB/s 2024-05-20T22:02:32.065 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping successful for: 2024-05-20T22:02:32.626 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi145:vg_nvme/lv_4 2024-05-20T22:02:32.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:32 smithi145 bash[23893]: cluster 2024-05-20T22:02:31.469953+0000 mgr.y (mgr.14150) 203 : cluster 0 pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:32.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:32 smithi050 bash[21866]: cluster 2024-05-20T22:02:31.469953+0000 mgr.y (mgr.14150) 203 : cluster 0 pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:32.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:32 smithi050 bash[28929]: cluster 2024-05-20T22:02:31.469953+0000 mgr.y (mgr.14150) 203 : cluster 0 pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:34.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:34 smithi145 bash[23893]: cephadm 2024-05-20T22:02:33.267429+0000 mgr.y (mgr.14150) 204 : cephadm 1 Detected new or changed devices on smithi050 2024-05-20T22:02:34.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:34 smithi145 bash[23893]: audit 2024-05-20T22:02:33.275910+0000 mon.a (mon.0) 478 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:34.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:34 smithi145 bash[23893]: audit 2024-05-20T22:02:33.284384+0000 mon.a (mon.0) 479 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:34.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:34 smithi145 bash[23893]: audit 2024-05-20T22:02:33.286220+0000 mon.a (mon.0) 480 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:02:34.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:34 smithi145 bash[23893]: audit 2024-05-20T22:02:33.287635+0000 mon.a (mon.0) 481 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:02:34.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:34 smithi145 bash[23893]: audit 2024-05-20T22:02:33.288998+0000 mon.a (mon.0) 482 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:02:34.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:34 smithi145 bash[23893]: audit 2024-05-20T22:02:33.290295+0000 mon.a (mon.0) 483 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:02:34.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:34 smithi145 bash[23893]: cephadm 2024-05-20T22:02:33.291271+0000 mgr.y (mgr.14150) 205 : cephadm 1 Adjusting osd_memory_target on smithi050 to 4061M 2024-05-20T22:02:34.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:34 smithi145 bash[23893]: audit 2024-05-20T22:02:33.297143+0000 mon.a (mon.0) 484 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:34.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:34 smithi145 bash[23893]: audit 2024-05-20T22:02:33.302571+0000 mon.a (mon.0) 485 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:02:34.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:34 smithi145 bash[23893]: audit 2024-05-20T22:02:33.304041+0000 mon.a (mon.0) 486 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:02:34.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:34 smithi145 bash[23893]: audit 2024-05-20T22:02:33.313323+0000 mon.a (mon.0) 487 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:34.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:34 smithi145 bash[23893]: cluster 2024-05-20T22:02:33.470472+0000 mgr.y (mgr.14150) 206 : cluster 0 pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:34.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:34 smithi050 bash[21866]: cephadm 2024-05-20T22:02:33.267429+0000 mgr.y (mgr.14150) 204 : cephadm 1 Detected new or changed devices on smithi050 2024-05-20T22:02:34.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:34 smithi050 bash[21866]: audit 2024-05-20T22:02:33.275910+0000 mon.a (mon.0) 478 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:34.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:34 smithi050 bash[21866]: audit 2024-05-20T22:02:33.284384+0000 mon.a (mon.0) 479 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:34.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:34 smithi050 bash[21866]: audit 2024-05-20T22:02:33.286220+0000 mon.a (mon.0) 480 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:02:34.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:34 smithi050 bash[21866]: audit 2024-05-20T22:02:33.287635+0000 mon.a (mon.0) 481 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:02:34.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:34 smithi050 bash[21866]: audit 2024-05-20T22:02:33.288998+0000 mon.a (mon.0) 482 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:02:34.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:34 smithi050 bash[21866]: audit 2024-05-20T22:02:33.290295+0000 mon.a (mon.0) 483 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:02:34.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:34 smithi050 bash[21866]: cephadm 2024-05-20T22:02:33.291271+0000 mgr.y (mgr.14150) 205 : cephadm 1 Adjusting osd_memory_target on smithi050 to 4061M 2024-05-20T22:02:34.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:34 smithi050 bash[21866]: audit 2024-05-20T22:02:33.297143+0000 mon.a (mon.0) 484 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:34.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:34 smithi050 bash[21866]: audit 2024-05-20T22:02:33.302571+0000 mon.a (mon.0) 485 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:02:34.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:34 smithi050 bash[21866]: audit 2024-05-20T22:02:33.304041+0000 mon.a (mon.0) 486 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:02:34.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:34 smithi050 bash[21866]: audit 2024-05-20T22:02:33.313323+0000 mon.a (mon.0) 487 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:34.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:34 smithi050 bash[21866]: cluster 2024-05-20T22:02:33.470472+0000 mgr.y (mgr.14150) 206 : cluster 0 pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:34.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:34 smithi050 bash[28929]: cephadm 2024-05-20T22:02:33.267429+0000 mgr.y (mgr.14150) 204 : cephadm 1 Detected new or changed devices on smithi050 2024-05-20T22:02:34.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:34 smithi050 bash[28929]: audit 2024-05-20T22:02:33.275910+0000 mon.a (mon.0) 478 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:34.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:34 smithi050 bash[28929]: audit 2024-05-20T22:02:33.284384+0000 mon.a (mon.0) 479 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:34.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:34 smithi050 bash[28929]: audit 2024-05-20T22:02:33.286220+0000 mon.a (mon.0) 480 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:02:34.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:34 smithi050 bash[28929]: audit 2024-05-20T22:02:33.287635+0000 mon.a (mon.0) 481 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:02:34.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:34 smithi050 bash[28929]: audit 2024-05-20T22:02:33.288998+0000 mon.a (mon.0) 482 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:02:34.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:34 smithi050 bash[28929]: audit 2024-05-20T22:02:33.290295+0000 mon.a (mon.0) 483 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:02:34.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:34 smithi050 bash[28929]: cephadm 2024-05-20T22:02:33.291271+0000 mgr.y (mgr.14150) 205 : cephadm 1 Adjusting osd_memory_target on smithi050 to 4061M 2024-05-20T22:02:34.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:34 smithi050 bash[28929]: audit 2024-05-20T22:02:33.297143+0000 mon.a (mon.0) 484 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:34.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:34 smithi050 bash[28929]: audit 2024-05-20T22:02:33.302571+0000 mon.a (mon.0) 485 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:02:34.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:34 smithi050 bash[28929]: audit 2024-05-20T22:02:33.304041+0000 mon.a (mon.0) 486 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:02:34.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:34 smithi050 bash[28929]: audit 2024-05-20T22:02:33.313323+0000 mon.a (mon.0) 487 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:02:34.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:34 smithi050 bash[28929]: cluster 2024-05-20T22:02:33.470472+0000 mgr.y (mgr.14150) 206 : cluster 0 pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:36.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:36 smithi145 bash[23893]: cluster 2024-05-20T22:02:35.471034+0000 mgr.y (mgr.14150) 207 : cluster 0 pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:36.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:36 smithi050 bash[21866]: cluster 2024-05-20T22:02:35.471034+0000 mgr.y (mgr.14150) 207 : cluster 0 pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:36.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:36 smithi050 bash[28929]: cluster 2024-05-20T22:02:35.471034+0000 mgr.y (mgr.14150) 207 : cluster 0 pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:37.332 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T22:02:38.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:38 smithi145 bash[23893]: cluster 2024-05-20T22:02:37.471679+0000 mgr.y (mgr.14150) 208 : cluster 0 pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:38.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:38 smithi050 bash[21866]: cluster 2024-05-20T22:02:37.471679+0000 mgr.y (mgr.14150) 208 : cluster 0 pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:38.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:38 smithi050 bash[28929]: cluster 2024-05-20T22:02:37.471679+0000 mgr.y (mgr.14150) 208 : cluster 0 pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:39.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a789ff640 1 -- 172.21.15.145:0/3378205959 >> v1:172.21.15.145:6789/0 conn(0x7f5a74104a60 legacy=0x7f5a74106eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:02:39.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a789ff640 1 -- 172.21.15.145:0/3378205959 shutdown_connections 2024-05-20T22:02:39.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a789ff640 1 -- 172.21.15.145:0/3378205959 >> 172.21.15.145:0/3378205959 conn(0x7f5a740fbbd0 msgr2=0x7f5a740fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:02:39.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a789ff640 1 -- 172.21.15.145:0/3378205959 shutdown_connections 2024-05-20T22:02:39.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a789ff640 1 -- 172.21.15.145:0/3378205959 wait complete. 2024-05-20T22:02:39.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a789ff640 1 Processor -- start 2024-05-20T22:02:39.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a789ff640 1 -- start start 2024-05-20T22:02:39.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a789ff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f5a741a2220 con 0x7f5a74197640 2024-05-20T22:02:39.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a789ff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f5a741a3440 con 0x7f5a741087a0 2024-05-20T22:02:39.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a789ff640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f5a741a4680 con 0x7f5a74100630 2024-05-20T22:02:39.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a6bfff640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f5a741087a0 0x7f5a7419d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:34140/0 (socket says 172.21.15.145:34140) 2024-05-20T22:02:39.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a6bfff640 1 -- 172.21.15.145:0/2846099149 learned_addr learned my addr 172.21.15.145:0/2846099149 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-05-20T22:02:39.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a6b7fe640 1 -- 172.21.15.145:0/2846099149 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 393494246 0 0) 0x7f5a741a3440 con 0x7f5a741087a0 2024-05-20T22:02:39.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a6b7fe640 1 -- 172.21.15.145:0/2846099149 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a60003520 con 0x7f5a741087a0 2024-05-20T22:02:39.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a6b7fe640 1 -- 172.21.15.145:0/2846099149 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2361545880 0 0) 0x7f5a60003520 con 0x7f5a741087a0 2024-05-20T22:02:39.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a6b7fe640 1 -- 172.21.15.145:0/2846099149 --> v1:172.21.15.145:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a741a3440 con 0x7f5a741087a0 2024-05-20T22:02:39.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a6b7fe640 1 -- 172.21.15.145:0/2846099149 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f5a5c001430 con 0x7f5a741087a0 2024-05-20T22:02:39.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a6b7fe640 1 -- 172.21.15.145:0/2846099149 <== mon.1 v1:172.21.15.145:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2809095442 0 0) 0x7f5a741a3440 con 0x7f5a741087a0 2024-05-20T22:02:39.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a6b7fe640 1 -- 172.21.15.145:0/2846099149 >> v1:172.21.15.50:6790/0 conn(0x7f5a74100630 legacy=0x7f5a74196e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:02:39.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a6b7fe640 1 -- 172.21.15.145:0/2846099149 >> v1:172.21.15.50:6789/0 conn(0x7f5a74197640 legacy=0x7f5a741a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:02:39.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a6b7fe640 1 -- 172.21.15.145:0/2846099149 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a741a58c0 con 0x7f5a741087a0 2024-05-20T22:02:39.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a789ff640 1 -- 172.21.15.145:0/2846099149 --> v1:172.21.15.145:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5a741a48b0 con 0x7f5a741087a0 2024-05-20T22:02:39.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a789ff640 1 -- 172.21.15.145:0/2846099149 --> v1:172.21.15.145:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5a741a4df0 con 0x7f5a741087a0 2024-05-20T22:02:39.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a6b7fe640 1 -- 172.21.15.145:0/2846099149 <== mon.1 v1:172.21.15.145:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f5a5c001690 con 0x7f5a741087a0 2024-05-20T22:02:39.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.546+0000 7f5a6b7fe640 1 -- 172.21.15.145:0/2846099149 <== mon.1 v1:172.21.15.145:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f5a5c004e00 con 0x7f5a741087a0 2024-05-20T22:02:39.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.550+0000 7f5a789ff640 1 -- 172.21.15.145:0/2846099149 --> v1:172.21.15.145:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a54005080 con 0x7f5a741087a0 2024-05-20T22:02:39.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.550+0000 7f5a6b7fe640 1 -- 172.21.15.145:0/2846099149 <== mon.1 v1:172.21.15.145:6789/0 7 ==== mgrmap(e 15) ==== 92081+0+0 (unknown 2274281742 0 0) 0x7f5a5c004620 con 0x7f5a741087a0 2024-05-20T22:02:39.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.550+0000 7f5a6b7fe640 1 -- 172.21.15.145:0/2846099149 <== mon.1 v1:172.21.15.145:6789/0 8 ==== osd_map(26..26 src has 1..26) ==== 2803+0+0 (unknown 2213749483 0 0) 0x7f5a5c088980 con 0x7f5a741087a0 2024-05-20T22:02:39.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.554+0000 7f5a6b7fe640 1 -- 172.21.15.145:0/2846099149 <== mon.1 v1:172.21.15.145:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f5a5c056e60 con 0x7f5a741087a0 2024-05-20T22:02:39.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:02:39.746+0000 7f5a789ff640 1 -- 172.21.15.145:0/2846099149 --> v1:172.21.15.50:6800/2944911247 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5a54000b90 con 0x7f5a6006eb30 2024-05-20T22:02:40.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:40 smithi145 bash[23893]: cluster 2024-05-20T22:02:39.472263+0000 mgr.y (mgr.14150) 209 : cluster 0 pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:40.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:40 smithi145 bash[23893]: audit 2024-05-20T22:02:39.753248+0000 mgr.y (mgr.14150) 210 : audit 0 from='client.24238 v1:172.21.15.145:0/2846099149' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:02:40.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:40 smithi145 bash[23893]: audit 2024-05-20T22:02:39.760247+0000 mon.a (mon.0) 488 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:02:40.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:40 smithi145 bash[23893]: audit 2024-05-20T22:02:39.766260+0000 mon.a (mon.0) 489 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:02:40.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:40 smithi145 bash[23893]: audit 2024-05-20T22:02:39.767846+0000 mon.a (mon.0) 490 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:02:40.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:40 smithi050 bash[28929]: cluster 2024-05-20T22:02:39.472263+0000 mgr.y (mgr.14150) 209 : cluster 0 pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:40.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:40 smithi050 bash[28929]: audit 2024-05-20T22:02:39.753248+0000 mgr.y (mgr.14150) 210 : audit 0 from='client.24238 v1:172.21.15.145:0/2846099149' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:02:40.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:40 smithi050 bash[28929]: audit 2024-05-20T22:02:39.760247+0000 mon.a (mon.0) 488 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:02:40.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:40 smithi050 bash[28929]: audit 2024-05-20T22:02:39.766260+0000 mon.a (mon.0) 489 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:02:40.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:40 smithi050 bash[28929]: audit 2024-05-20T22:02:39.767846+0000 mon.a (mon.0) 490 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:02:40.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:40 smithi050 bash[21866]: cluster 2024-05-20T22:02:39.472263+0000 mgr.y (mgr.14150) 209 : cluster 0 pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:40.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:40 smithi050 bash[21866]: audit 2024-05-20T22:02:39.753248+0000 mgr.y (mgr.14150) 210 : audit 0 from='client.24238 v1:172.21.15.145:0/2846099149' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:02:40.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:40 smithi050 bash[21866]: audit 2024-05-20T22:02:39.760247+0000 mon.a (mon.0) 488 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:02:40.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:40 smithi050 bash[21866]: audit 2024-05-20T22:02:39.766260+0000 mon.a (mon.0) 489 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:02:40.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:40 smithi050 bash[21866]: audit 2024-05-20T22:02:39.767846+0000 mon.a (mon.0) 490 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:02:42.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:42 smithi145 bash[23893]: cluster 2024-05-20T22:02:41.472803+0000 mgr.y (mgr.14150) 211 : cluster 0 pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:42.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:42 smithi050 bash[28929]: cluster 2024-05-20T22:02:41.472803+0000 mgr.y (mgr.14150) 211 : cluster 0 pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:42.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:42 smithi050 bash[21866]: cluster 2024-05-20T22:02:41.472803+0000 mgr.y (mgr.14150) 211 : cluster 0 pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:44.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:44 smithi145 bash[23893]: cluster 2024-05-20T22:02:43.473364+0000 mgr.y (mgr.14150) 212 : cluster 0 pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:44.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:44 smithi050 bash[28929]: cluster 2024-05-20T22:02:43.473364+0000 mgr.y (mgr.14150) 212 : cluster 0 pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:44.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:44 smithi050 bash[21866]: cluster 2024-05-20T22:02:43.473364+0000 mgr.y (mgr.14150) 212 : cluster 0 pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:46.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:46 smithi145 bash[23893]: cluster 2024-05-20T22:02:45.473896+0000 mgr.y (mgr.14150) 213 : cluster 0 pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:46.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:46 smithi050 bash[28929]: cluster 2024-05-20T22:02:45.473896+0000 mgr.y (mgr.14150) 213 : cluster 0 pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:46.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:46 smithi050 bash[21866]: cluster 2024-05-20T22:02:45.473896+0000 mgr.y (mgr.14150) 213 : cluster 0 pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:48.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:48 smithi145 bash[23893]: cluster 2024-05-20T22:02:47.474467+0000 mgr.y (mgr.14150) 214 : cluster 0 pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:48.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:48 smithi145 bash[23893]: audit 2024-05-20T22:02:47.784811+0000 mon.b (mon.1) 10 : audit 1 from='client.? v1:172.21.15.145:0/2670361954' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "369f2c71-4164-48c1-aaa5-5cd9a5644309"}]: dispatch 2024-05-20T22:02:48.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:48 smithi145 bash[23893]: audit 2024-05-20T22:02:47.786488+0000 mon.a (mon.0) 491 : audit 1 from='client.24244 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "369f2c71-4164-48c1-aaa5-5cd9a5644309"}]: dispatch 2024-05-20T22:02:48.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:48 smithi145 bash[23893]: audit 2024-05-20T22:02:47.789955+0000 mon.a (mon.0) 492 : audit 1 from='client.24244 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "369f2c71-4164-48c1-aaa5-5cd9a5644309"}]': finished 2024-05-20T22:02:48.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:48 smithi145 bash[23893]: cluster 2024-05-20T22:02:47.795852+0000 mon.a (mon.0) 493 : cluster 0 osdmap e27: 5 total, 4 up, 5 in 2024-05-20T22:02:48.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:48 smithi145 bash[23893]: audit 2024-05-20T22:02:47.796469+0000 mon.a (mon.0) 494 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T22:02:48.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:48 smithi145 bash[23893]: audit 2024-05-20T22:02:48.450467+0000 mon.b (mon.1) 11 : audit 0 from='client.? v1:172.21.15.145:0/3418880159' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:02:48.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:48 smithi050 bash[21866]: cluster 2024-05-20T22:02:47.474467+0000 mgr.y (mgr.14150) 214 : cluster 0 pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:48.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:48 smithi050 bash[21866]: audit 2024-05-20T22:02:47.784811+0000 mon.b (mon.1) 10 : audit 1 from='client.? v1:172.21.15.145:0/2670361954' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "369f2c71-4164-48c1-aaa5-5cd9a5644309"}]: dispatch 2024-05-20T22:02:48.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:48 smithi050 bash[21866]: audit 2024-05-20T22:02:47.786488+0000 mon.a (mon.0) 491 : audit 1 from='client.24244 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "369f2c71-4164-48c1-aaa5-5cd9a5644309"}]: dispatch 2024-05-20T22:02:48.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:48 smithi050 bash[21866]: audit 2024-05-20T22:02:47.789955+0000 mon.a (mon.0) 492 : audit 1 from='client.24244 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "369f2c71-4164-48c1-aaa5-5cd9a5644309"}]': finished 2024-05-20T22:02:48.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:48 smithi050 bash[21866]: cluster 2024-05-20T22:02:47.795852+0000 mon.a (mon.0) 493 : cluster 0 osdmap e27: 5 total, 4 up, 5 in 2024-05-20T22:02:48.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:48 smithi050 bash[21866]: audit 2024-05-20T22:02:47.796469+0000 mon.a (mon.0) 494 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T22:02:48.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:48 smithi050 bash[21866]: audit 2024-05-20T22:02:48.450467+0000 mon.b (mon.1) 11 : audit 0 from='client.? v1:172.21.15.145:0/3418880159' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:02:48.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:48 smithi050 bash[28929]: cluster 2024-05-20T22:02:47.474467+0000 mgr.y (mgr.14150) 214 : cluster 0 pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:48.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:48 smithi050 bash[28929]: audit 2024-05-20T22:02:47.784811+0000 mon.b (mon.1) 10 : audit 1 from='client.? v1:172.21.15.145:0/2670361954' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "369f2c71-4164-48c1-aaa5-5cd9a5644309"}]: dispatch 2024-05-20T22:02:48.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:48 smithi050 bash[28929]: audit 2024-05-20T22:02:47.786488+0000 mon.a (mon.0) 491 : audit 1 from='client.24244 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "369f2c71-4164-48c1-aaa5-5cd9a5644309"}]: dispatch 2024-05-20T22:02:48.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:48 smithi050 bash[28929]: audit 2024-05-20T22:02:47.789955+0000 mon.a (mon.0) 492 : audit 1 from='client.24244 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "369f2c71-4164-48c1-aaa5-5cd9a5644309"}]': finished 2024-05-20T22:02:48.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:48 smithi050 bash[28929]: cluster 2024-05-20T22:02:47.795852+0000 mon.a (mon.0) 493 : cluster 0 osdmap e27: 5 total, 4 up, 5 in 2024-05-20T22:02:48.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:48 smithi050 bash[28929]: audit 2024-05-20T22:02:47.796469+0000 mon.a (mon.0) 494 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T22:02:48.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:48 smithi050 bash[28929]: audit 2024-05-20T22:02:48.450467+0000 mon.b (mon.1) 11 : audit 0 from='client.? v1:172.21.15.145:0/3418880159' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:02:50.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:50 smithi145 bash[23893]: cluster 2024-05-20T22:02:49.475002+0000 mgr.y (mgr.14150) 215 : cluster 0 pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:50.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:50 smithi050 bash[21866]: cluster 2024-05-20T22:02:49.475002+0000 mgr.y (mgr.14150) 215 : cluster 0 pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:50.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:50 smithi050 bash[28929]: cluster 2024-05-20T22:02:49.475002+0000 mgr.y (mgr.14150) 215 : cluster 0 pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:52.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:52 smithi145 bash[23893]: cluster 2024-05-20T22:02:51.475641+0000 mgr.y (mgr.14150) 216 : cluster 0 pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:52.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:52 smithi050 bash[21866]: cluster 2024-05-20T22:02:51.475641+0000 mgr.y (mgr.14150) 216 : cluster 0 pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:52.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:52 smithi050 bash[28929]: cluster 2024-05-20T22:02:51.475641+0000 mgr.y (mgr.14150) 216 : cluster 0 pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:54.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:54 smithi145 bash[23893]: cluster 2024-05-20T22:02:53.476227+0000 mgr.y (mgr.14150) 217 : cluster 0 pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:54.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:54 smithi050 bash[21866]: cluster 2024-05-20T22:02:53.476227+0000 mgr.y (mgr.14150) 217 : cluster 0 pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:54.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:54 smithi050 bash[28929]: cluster 2024-05-20T22:02:53.476227+0000 mgr.y (mgr.14150) 217 : cluster 0 pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:56.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:56 smithi145 bash[23893]: cluster 2024-05-20T22:02:55.476772+0000 mgr.y (mgr.14150) 218 : cluster 0 pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:56.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:56 smithi050 bash[21866]: cluster 2024-05-20T22:02:55.476772+0000 mgr.y (mgr.14150) 218 : cluster 0 pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:56.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:56 smithi050 bash[28929]: cluster 2024-05-20T22:02:55.476772+0000 mgr.y (mgr.14150) 218 : cluster 0 pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:58.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:58 smithi145 bash[23893]: cluster 2024-05-20T22:02:57.477321+0000 mgr.y (mgr.14150) 219 : cluster 0 pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:58.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:58 smithi050 bash[21866]: cluster 2024-05-20T22:02:57.477321+0000 mgr.y (mgr.14150) 219 : cluster 0 pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:58.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:58 smithi050 bash[28929]: cluster 2024-05-20T22:02:57.477321+0000 mgr.y (mgr.14150) 219 : cluster 0 pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:02:59.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:59 smithi145 bash[23893]: audit 2024-05-20T22:02:59.553869+0000 mon.a (mon.0) 495 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-20T22:02:59.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:02:59 smithi145 bash[23893]: audit 2024-05-20T22:02:59.555458+0000 mon.a (mon.0) 496 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:02:59.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:59 smithi050 bash[21866]: audit 2024-05-20T22:02:59.553869+0000 mon.a (mon.0) 495 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-20T22:02:59.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:02:59 smithi050 bash[21866]: audit 2024-05-20T22:02:59.555458+0000 mon.a (mon.0) 496 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:02:59.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:59 smithi050 bash[28929]: audit 2024-05-20T22:02:59.553869+0000 mon.a (mon.0) 495 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-20T22:02:59.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:02:59 smithi050 bash[28929]: audit 2024-05-20T22:02:59.555458+0000 mon.a (mon.0) 496 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:03:00.831 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:00 smithi145 bash[23893]: cluster 2024-05-20T22:02:59.477886+0000 mgr.y (mgr.14150) 220 : cluster 0 pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:00.831 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:00 smithi145 bash[23893]: cephadm 2024-05-20T22:02:59.556939+0000 mgr.y (mgr.14150) 221 : cephadm 1 Deploying daemon osd.4 on smithi145 2024-05-20T22:03:00.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:00 smithi050 bash[21866]: cluster 2024-05-20T22:02:59.477886+0000 mgr.y (mgr.14150) 220 : cluster 0 pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:00.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:00 smithi050 bash[21866]: cephadm 2024-05-20T22:02:59.556939+0000 mgr.y (mgr.14150) 221 : cephadm 1 Deploying daemon osd.4 on smithi145 2024-05-20T22:03:00.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:00 smithi050 bash[28929]: cluster 2024-05-20T22:02:59.477886+0000 mgr.y (mgr.14150) 220 : cluster 0 pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:00.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:00 smithi050 bash[28929]: cephadm 2024-05-20T22:02:59.556939+0000 mgr.y (mgr.14150) 221 : cephadm 1 Deploying daemon osd.4 on smithi145 2024-05-20T22:03:02.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:02 smithi145 bash[23893]: cluster 2024-05-20T22:03:01.478511+0000 mgr.y (mgr.14150) 222 : cluster 0 pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:02.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:02 smithi050 bash[28929]: cluster 2024-05-20T22:03:01.478511+0000 mgr.y (mgr.14150) 222 : cluster 0 pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:02.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:02 smithi050 bash[21866]: cluster 2024-05-20T22:03:01.478511+0000 mgr.y (mgr.14150) 222 : cluster 0 pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:03.355 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:03:03 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:03:03.355 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:03 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:03:03.632 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:03 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:03:03.632 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:03:03 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:03:04.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:04 smithi145 bash[23893]: cluster 2024-05-20T22:03:03.479115+0000 mgr.y (mgr.14150) 223 : cluster 0 pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:04.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:04 smithi145 bash[23893]: audit 2024-05-20T22:03:03.632408+0000 mon.a (mon.0) 497 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:03:04.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:04 smithi145 bash[23893]: audit 2024-05-20T22:03:03.641406+0000 mon.a (mon.0) 498 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:04.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:04 smithi145 bash[23893]: audit 2024-05-20T22:03:03.649009+0000 mon.a (mon.0) 499 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:04.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:04 smithi050 bash[21866]: cluster 2024-05-20T22:03:03.479115+0000 mgr.y (mgr.14150) 223 : cluster 0 pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:04.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:04 smithi050 bash[21866]: audit 2024-05-20T22:03:03.632408+0000 mon.a (mon.0) 497 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:03:04.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:04 smithi050 bash[21866]: audit 2024-05-20T22:03:03.641406+0000 mon.a (mon.0) 498 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:04.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:04 smithi050 bash[21866]: audit 2024-05-20T22:03:03.649009+0000 mon.a (mon.0) 499 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:04.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:04 smithi050 bash[28929]: cluster 2024-05-20T22:03:03.479115+0000 mgr.y (mgr.14150) 223 : cluster 0 pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:04.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:04 smithi050 bash[28929]: audit 2024-05-20T22:03:03.632408+0000 mon.a (mon.0) 497 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:03:04.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:04 smithi050 bash[28929]: audit 2024-05-20T22:03:03.641406+0000 mon.a (mon.0) 498 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:04.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:04 smithi050 bash[28929]: audit 2024-05-20T22:03:03.649009+0000 mon.a (mon.0) 499 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:06.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:06 smithi145 bash[23893]: cluster 2024-05-20T22:03:05.479740+0000 mgr.y (mgr.14150) 224 : cluster 0 pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:06.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:06 smithi050 bash[28929]: cluster 2024-05-20T22:03:05.479740+0000 mgr.y (mgr.14150) 224 : cluster 0 pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:06.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:06 smithi050 bash[21866]: cluster 2024-05-20T22:03:05.479740+0000 mgr.y (mgr.14150) 224 : cluster 0 pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:08.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:08 smithi145 bash[23893]: cluster 2024-05-20T22:03:07.480272+0000 mgr.y (mgr.14150) 225 : cluster 0 pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:08.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:08 smithi050 bash[21866]: cluster 2024-05-20T22:03:07.480272+0000 mgr.y (mgr.14150) 225 : cluster 0 pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:08.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:08 smithi050 bash[28929]: cluster 2024-05-20T22:03:07.480272+0000 mgr.y (mgr.14150) 225 : cluster 0 pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:10.857 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:10 smithi145 bash[23893]: cluster 2024-05-20T22:03:09.480824+0000 mgr.y (mgr.14150) 226 : cluster 0 pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:10.857 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:10 smithi145 bash[23893]: audit 2024-05-20T22:03:09.745805+0000 mon.b (mon.1) 12 : audit 1 from='osd.4 v1:172.21.15.145:6800/2241357489' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-20T22:03:10.857 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:10 smithi145 bash[23893]: audit 2024-05-20T22:03:09.747305+0000 mon.a (mon.0) 500 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-20T22:03:10.857 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:10 smithi145 bash[23893]: audit 2024-05-20T22:03:10.300722+0000 mon.a (mon.0) 501 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:10.857 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:10 smithi145 bash[23893]: audit 2024-05-20T22:03:10.308605+0000 mon.a (mon.0) 502 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:10.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:10 smithi050 bash[21866]: cluster 2024-05-20T22:03:09.480824+0000 mgr.y (mgr.14150) 226 : cluster 0 pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:10.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:10 smithi050 bash[21866]: audit 2024-05-20T22:03:09.745805+0000 mon.b (mon.1) 12 : audit 1 from='osd.4 v1:172.21.15.145:6800/2241357489' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-20T22:03:10.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:10 smithi050 bash[21866]: audit 2024-05-20T22:03:09.747305+0000 mon.a (mon.0) 500 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-20T22:03:10.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:10 smithi050 bash[21866]: audit 2024-05-20T22:03:10.300722+0000 mon.a (mon.0) 501 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:10.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:10 smithi050 bash[21866]: audit 2024-05-20T22:03:10.308605+0000 mon.a (mon.0) 502 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:10.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:10 smithi050 bash[28929]: cluster 2024-05-20T22:03:09.480824+0000 mgr.y (mgr.14150) 226 : cluster 0 pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:10.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:10 smithi050 bash[28929]: audit 2024-05-20T22:03:09.745805+0000 mon.b (mon.1) 12 : audit 1 from='osd.4 v1:172.21.15.145:6800/2241357489' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-20T22:03:10.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:10 smithi050 bash[28929]: audit 2024-05-20T22:03:09.747305+0000 mon.a (mon.0) 500 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-20T22:03:10.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:10 smithi050 bash[28929]: audit 2024-05-20T22:03:10.300722+0000 mon.a (mon.0) 501 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:10.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:10 smithi050 bash[28929]: audit 2024-05-20T22:03:10.308605+0000 mon.a (mon.0) 502 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:11.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:11 smithi145 bash[23893]: audit 2024-05-20T22:03:10.603062+0000 mon.a (mon.0) 503 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-20T22:03:11.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:11 smithi145 bash[23893]: audit 2024-05-20T22:03:10.607161+0000 mon.b (mon.1) 13 : audit 1 from='osd.4 v1:172.21.15.145:6800/2241357489' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:03:11.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:11 smithi145 bash[23893]: cluster 2024-05-20T22:03:10.608181+0000 mon.a (mon.0) 504 : cluster 0 osdmap e28: 5 total, 4 up, 5 in 2024-05-20T22:03:11.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:11 smithi145 bash[23893]: audit 2024-05-20T22:03:10.608780+0000 mon.a (mon.0) 505 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T22:03:11.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:11 smithi145 bash[23893]: audit 2024-05-20T22:03:10.609331+0000 mon.a (mon.0) 506 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:03:11.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:11 smithi145 bash[23893]: audit 2024-05-20T22:03:10.934545+0000 mon.a (mon.0) 507 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:03:11.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:11 smithi145 bash[23893]: audit 2024-05-20T22:03:10.936231+0000 mon.a (mon.0) 508 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:03:11.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:11 smithi145 bash[23893]: audit 2024-05-20T22:03:10.945289+0000 mon.a (mon.0) 509 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:11.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:11 smithi050 bash[21866]: audit 2024-05-20T22:03:10.603062+0000 mon.a (mon.0) 503 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-20T22:03:11.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:11 smithi050 bash[21866]: audit 2024-05-20T22:03:10.607161+0000 mon.b (mon.1) 13 : audit 1 from='osd.4 v1:172.21.15.145:6800/2241357489' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:03:11.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:11 smithi050 bash[21866]: cluster 2024-05-20T22:03:10.608181+0000 mon.a (mon.0) 504 : cluster 0 osdmap e28: 5 total, 4 up, 5 in 2024-05-20T22:03:11.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:11 smithi050 bash[21866]: audit 2024-05-20T22:03:10.608780+0000 mon.a (mon.0) 505 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T22:03:11.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:11 smithi050 bash[21866]: audit 2024-05-20T22:03:10.609331+0000 mon.a (mon.0) 506 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:03:11.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:11 smithi050 bash[21866]: audit 2024-05-20T22:03:10.934545+0000 mon.a (mon.0) 507 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:03:11.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:11 smithi050 bash[21866]: audit 2024-05-20T22:03:10.936231+0000 mon.a (mon.0) 508 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:03:11.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:11 smithi050 bash[21866]: audit 2024-05-20T22:03:10.945289+0000 mon.a (mon.0) 509 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:11.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:11 smithi050 bash[28929]: audit 2024-05-20T22:03:10.603062+0000 mon.a (mon.0) 503 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-20T22:03:11.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:11 smithi050 bash[28929]: audit 2024-05-20T22:03:10.607161+0000 mon.b (mon.1) 13 : audit 1 from='osd.4 v1:172.21.15.145:6800/2241357489' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:03:11.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:11 smithi050 bash[28929]: cluster 2024-05-20T22:03:10.608181+0000 mon.a (mon.0) 504 : cluster 0 osdmap e28: 5 total, 4 up, 5 in 2024-05-20T22:03:11.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:11 smithi050 bash[28929]: audit 2024-05-20T22:03:10.608780+0000 mon.a (mon.0) 505 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T22:03:11.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:11 smithi050 bash[28929]: audit 2024-05-20T22:03:10.609331+0000 mon.a (mon.0) 506 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:03:11.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:11 smithi050 bash[28929]: audit 2024-05-20T22:03:10.934545+0000 mon.a (mon.0) 507 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:03:11.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:11 smithi050 bash[28929]: audit 2024-05-20T22:03:10.936231+0000 mon.a (mon.0) 508 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:03:11.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:11 smithi050 bash[28929]: audit 2024-05-20T22:03:10.945289+0000 mon.a (mon.0) 509 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:12.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:12 smithi145 bash[23893]: cluster 2024-05-20T22:03:11.481444+0000 mgr.y (mgr.14150) 227 : cluster 0 pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:12.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:12 smithi145 bash[23893]: audit 2024-05-20T22:03:11.605805+0000 mon.a (mon.0) 510 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-05-20T22:03:12.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:12 smithi145 bash[23893]: cluster 2024-05-20T22:03:11.613061+0000 mon.a (mon.0) 511 : cluster 0 osdmap e29: 5 total, 4 up, 5 in 2024-05-20T22:03:12.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:12 smithi145 bash[23893]: audit 2024-05-20T22:03:11.614222+0000 mon.a (mon.0) 512 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T22:03:12.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:12 smithi145 bash[23893]: audit 2024-05-20T22:03:11.622778+0000 mon.a (mon.0) 513 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T22:03:12.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:12 smithi145 bash[23893]: cluster 2024-05-20T22:03:12.614297+0000 mon.a (mon.0) 514 : cluster 1 osd.4 v1:172.21.15.145:6800/2241357489 boot 2024-05-20T22:03:12.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:12 smithi145 bash[23893]: cluster 2024-05-20T22:03:12.614406+0000 mon.a (mon.0) 515 : cluster 0 osdmap e30: 5 total, 5 up, 5 in 2024-05-20T22:03:12.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:12 smithi050 bash[21866]: cluster 2024-05-20T22:03:11.481444+0000 mgr.y (mgr.14150) 227 : cluster 0 pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:12.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:12 smithi050 bash[21866]: audit 2024-05-20T22:03:11.605805+0000 mon.a (mon.0) 510 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-05-20T22:03:12.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:12 smithi050 bash[21866]: cluster 2024-05-20T22:03:11.613061+0000 mon.a (mon.0) 511 : cluster 0 osdmap e29: 5 total, 4 up, 5 in 2024-05-20T22:03:12.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:12 smithi050 bash[21866]: audit 2024-05-20T22:03:11.614222+0000 mon.a (mon.0) 512 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T22:03:12.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:12 smithi050 bash[21866]: audit 2024-05-20T22:03:11.622778+0000 mon.a (mon.0) 513 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T22:03:12.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:12 smithi050 bash[21866]: cluster 2024-05-20T22:03:12.614297+0000 mon.a (mon.0) 514 : cluster 1 osd.4 v1:172.21.15.145:6800/2241357489 boot 2024-05-20T22:03:12.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:12 smithi050 bash[21866]: cluster 2024-05-20T22:03:12.614406+0000 mon.a (mon.0) 515 : cluster 0 osdmap e30: 5 total, 5 up, 5 in 2024-05-20T22:03:12.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:12 smithi050 bash[28929]: cluster 2024-05-20T22:03:11.481444+0000 mgr.y (mgr.14150) 227 : cluster 0 pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-20T22:03:12.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:12 smithi050 bash[28929]: audit 2024-05-20T22:03:11.605805+0000 mon.a (mon.0) 510 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-05-20T22:03:12.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:12 smithi050 bash[28929]: cluster 2024-05-20T22:03:11.613061+0000 mon.a (mon.0) 511 : cluster 0 osdmap e29: 5 total, 4 up, 5 in 2024-05-20T22:03:12.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:12 smithi050 bash[28929]: audit 2024-05-20T22:03:11.614222+0000 mon.a (mon.0) 512 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T22:03:12.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:12 smithi050 bash[28929]: audit 2024-05-20T22:03:11.622778+0000 mon.a (mon.0) 513 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T22:03:12.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:12 smithi050 bash[28929]: cluster 2024-05-20T22:03:12.614297+0000 mon.a (mon.0) 514 : cluster 1 osd.4 v1:172.21.15.145:6800/2241357489 boot 2024-05-20T22:03:12.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:12 smithi050 bash[28929]: cluster 2024-05-20T22:03:12.614406+0000 mon.a (mon.0) 515 : cluster 0 osdmap e30: 5 total, 5 up, 5 in 2024-05-20T22:03:13.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:13.141+0000 7f5a6b7fe640 1 -- 172.21.15.145:0/2846099149 <== mgr.14150 v1:172.21.15.50:6800/2944911247 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (unknown 0 0 294011755) 0x7f5a54000b90 con 0x7f5a6006eb30 2024-05-20T22:03:13.143 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 4 on host 'smithi145' 2024-05-20T22:03:13.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:13.141+0000 7f5a789ff640 1 -- 172.21.15.145:0/2846099149 >> v1:172.21.15.50:6800/2944911247 conn(0x7f5a6006eb30 legacy=0x7f5a60070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:03:13.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:13.141+0000 7f5a789ff640 1 -- 172.21.15.145:0/2846099149 >> v1:172.21.15.145:6789/0 conn(0x7f5a741087a0 legacy=0x7f5a7419d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:03:13.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:13.145+0000 7f5a789ff640 1 -- 172.21.15.145:0/2846099149 shutdown_connections 2024-05-20T22:03:13.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:13.145+0000 7f5a789ff640 1 -- 172.21.15.145:0/2846099149 >> 172.21.15.145:0/2846099149 conn(0x7f5a740fbbd0 msgr2=0x7f5a740ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:03:13.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:13.145+0000 7f5a789ff640 1 -- 172.21.15.145:0/2846099149 shutdown_connections 2024-05-20T22:03:13.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:13.145+0000 7f5a789ff640 1 -- 172.21.15.145:0/2846099149 wait complete. 2024-05-20T22:03:13.672 DEBUG:teuthology.orchestra.run.smithi145:osd.4> sudo journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.4.service 2024-05-20T22:03:13.674 INFO:tasks.cephadm:Deploying osd.5 on smithi145 with /dev/vg_nvme/lv_3... 2024-05-20T22:03:13.674 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-20T22:03:13.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:13 smithi145 bash[23893]: cluster 2024-05-20T22:03:10.755601+0000 osd.4 (osd.4) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:03:13.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:13 smithi145 bash[23893]: cluster 2024-05-20T22:03:10.755668+0000 osd.4 (osd.4) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:03:13.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:13 smithi145 bash[23893]: audit 2024-05-20T22:03:12.614726+0000 mon.a (mon.0) 516 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T22:03:13.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:13 smithi145 bash[23893]: audit 2024-05-20T22:03:13.125555+0000 mon.a (mon.0) 517 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:03:13.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:13 smithi145 bash[23893]: audit 2024-05-20T22:03:13.132953+0000 mon.a (mon.0) 518 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:13.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:13 smithi145 bash[23893]: audit 2024-05-20T22:03:13.141001+0000 mon.a (mon.0) 519 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:13.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:13 smithi145 bash[23893]: cluster 2024-05-20T22:03:13.616820+0000 mon.a (mon.0) 520 : cluster 0 osdmap e31: 5 total, 5 up, 5 in 2024-05-20T22:03:13.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:13 smithi050 bash[21866]: cluster 2024-05-20T22:03:10.755601+0000 osd.4 (osd.4) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:03:13.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:13 smithi050 bash[21866]: cluster 2024-05-20T22:03:10.755668+0000 osd.4 (osd.4) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:03:13.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:13 smithi050 bash[21866]: audit 2024-05-20T22:03:12.614726+0000 mon.a (mon.0) 516 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T22:03:13.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:13 smithi050 bash[21866]: audit 2024-05-20T22:03:13.125555+0000 mon.a (mon.0) 517 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:03:13.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:13 smithi050 bash[21866]: audit 2024-05-20T22:03:13.132953+0000 mon.a (mon.0) 518 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:13.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:13 smithi050 bash[21866]: audit 2024-05-20T22:03:13.141001+0000 mon.a (mon.0) 519 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:13.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:13 smithi050 bash[21866]: cluster 2024-05-20T22:03:13.616820+0000 mon.a (mon.0) 520 : cluster 0 osdmap e31: 5 total, 5 up, 5 in 2024-05-20T22:03:13.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:13 smithi050 bash[28929]: cluster 2024-05-20T22:03:10.755601+0000 osd.4 (osd.4) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:03:13.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:13 smithi050 bash[28929]: cluster 2024-05-20T22:03:10.755668+0000 osd.4 (osd.4) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:03:13.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:13 smithi050 bash[28929]: audit 2024-05-20T22:03:12.614726+0000 mon.a (mon.0) 516 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T22:03:13.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:13 smithi050 bash[28929]: audit 2024-05-20T22:03:13.125555+0000 mon.a (mon.0) 517 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:03:13.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:13 smithi050 bash[28929]: audit 2024-05-20T22:03:13.132953+0000 mon.a (mon.0) 518 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:13.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:13 smithi050 bash[28929]: audit 2024-05-20T22:03:13.141001+0000 mon.a (mon.0) 519 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:13.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:13 smithi050 bash[28929]: cluster 2024-05-20T22:03:13.616820+0000 mon.a (mon.0) 520 : cluster 0 osdmap e31: 5 total, 5 up, 5 in 2024-05-20T22:03:15.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:15 smithi145 bash[23893]: cluster 2024-05-20T22:03:13.481995+0000 mgr.y (mgr.14150) 228 : cluster 0 pgmap v198: 1 pgs: 1 peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:15.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:15 smithi145 bash[23893]: cluster 2024-05-20T22:03:14.617549+0000 mon.a (mon.0) 521 : cluster 0 osdmap e32: 5 total, 5 up, 5 in 2024-05-20T22:03:15.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:15 smithi050 bash[21866]: cluster 2024-05-20T22:03:13.481995+0000 mgr.y (mgr.14150) 228 : cluster 0 pgmap v198: 1 pgs: 1 peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:15.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:15 smithi050 bash[21866]: cluster 2024-05-20T22:03:14.617549+0000 mon.a (mon.0) 521 : cluster 0 osdmap e32: 5 total, 5 up, 5 in 2024-05-20T22:03:15.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:15 smithi050 bash[28929]: cluster 2024-05-20T22:03:13.481995+0000 mgr.y (mgr.14150) 228 : cluster 0 pgmap v198: 1 pgs: 1 peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:15.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:15 smithi050 bash[28929]: cluster 2024-05-20T22:03:14.617549+0000 mon.a (mon.0) 521 : cluster 0 osdmap e32: 5 total, 5 up, 5 in 2024-05-20T22:03:16.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:16 smithi145 bash[23893]: cluster 2024-05-20T22:03:15.450925+0000 mon.a (mon.0) 522 : cluster 0 osdmap e33: 5 total, 5 up, 5 in 2024-05-20T22:03:16.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:16 smithi145 bash[23893]: cluster 2024-05-20T22:03:15.482545+0000 mgr.y (mgr.14150) 229 : cluster 0 pgmap v202: 1 pgs: 1 peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:16.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:16 smithi050 bash[21866]: cluster 2024-05-20T22:03:15.450925+0000 mon.a (mon.0) 522 : cluster 0 osdmap e33: 5 total, 5 up, 5 in 2024-05-20T22:03:16.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:16 smithi050 bash[21866]: cluster 2024-05-20T22:03:15.482545+0000 mgr.y (mgr.14150) 229 : cluster 0 pgmap v202: 1 pgs: 1 peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:16.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:16 smithi050 bash[28929]: cluster 2024-05-20T22:03:15.450925+0000 mon.a (mon.0) 522 : cluster 0 osdmap e33: 5 total, 5 up, 5 in 2024-05-20T22:03:16.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:16 smithi050 bash[28929]: cluster 2024-05-20T22:03:15.482545+0000 mgr.y (mgr.14150) 229 : cluster 0 pgmap v202: 1 pgs: 1 peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:17.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:17 smithi145 bash[23893]: cluster 2024-05-20T22:03:16.460552+0000 mon.a (mon.0) 523 : cluster 0 osdmap e34: 5 total, 5 up, 5 in 2024-05-20T22:03:17.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:17 smithi050 bash[28929]: cluster 2024-05-20T22:03:16.460552+0000 mon.a (mon.0) 523 : cluster 0 osdmap e34: 5 total, 5 up, 5 in 2024-05-20T22:03:17.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:17 smithi050 bash[21866]: cluster 2024-05-20T22:03:16.460552+0000 mon.a (mon.0) 523 : cluster 0 osdmap e34: 5 total, 5 up, 5 in 2024-05-20T22:03:18.096 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T22:03:18.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:18 smithi145 bash[23893]: cluster 2024-05-20T22:03:17.483093+0000 mgr.y (mgr.14150) 230 : cluster 0 pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-20T22:03:18.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:18 smithi050 bash[21866]: cluster 2024-05-20T22:03:17.483093+0000 mgr.y (mgr.14150) 230 : cluster 0 pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-20T22:03:18.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:18 smithi050 bash[28929]: cluster 2024-05-20T22:03:17.483093+0000 mgr.y (mgr.14150) 230 : cluster 0 pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-20T22:03:20.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:20 smithi145 bash[23893]: cluster 2024-05-20T22:03:19.483669+0000 mgr.y (mgr.14150) 231 : cluster 0 pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-05-20T22:03:20.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:20 smithi050 bash[21866]: cluster 2024-05-20T22:03:19.483669+0000 mgr.y (mgr.14150) 231 : cluster 0 pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-05-20T22:03:20.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:20 smithi050 bash[28929]: cluster 2024-05-20T22:03:19.483669+0000 mgr.y (mgr.14150) 231 : cluster 0 pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-05-20T22:03:21.564 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-20T22:03:21.753 INFO:teuthology.orchestra.run.smithi145.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-20T22:03:21.771 INFO:teuthology.orchestra.run.smithi145.stderr: stderr: 10+0 records in 2024-05-20T22:03:21.771 INFO:teuthology.orchestra.run.smithi145.stderr:10+0 records out 2024-05-20T22:03:21.772 INFO:teuthology.orchestra.run.smithi145.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0153043 s, 685 MB/s 2024-05-20T22:03:21.772 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping successful for: 2024-05-20T22:03:22.569 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi145:vg_nvme/lv_3 2024-05-20T22:03:22.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:22 smithi145 bash[23893]: cluster 2024-05-20T22:03:21.484225+0000 mgr.y (mgr.14150) 232 : cluster 0 pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-05-20T22:03:22.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:22 smithi050 bash[21866]: cluster 2024-05-20T22:03:21.484225+0000 mgr.y (mgr.14150) 232 : cluster 0 pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-05-20T22:03:22.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:22 smithi050 bash[28929]: cluster 2024-05-20T22:03:21.484225+0000 mgr.y (mgr.14150) 232 : cluster 0 pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-05-20T22:03:24.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:23 smithi050 bash[21866]: cephadm 2024-05-20T22:03:22.893230+0000 mgr.y (mgr.14150) 233 : cephadm 1 Detected new or changed devices on smithi145 2024-05-20T22:03:24.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:23 smithi050 bash[21866]: audit 2024-05-20T22:03:22.901419+0000 mon.a (mon.0) 524 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:24.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:23 smithi050 bash[21866]: audit 2024-05-20T22:03:22.909144+0000 mon.a (mon.0) 525 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:24.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:23 smithi050 bash[21866]: audit 2024-05-20T22:03:22.910964+0000 mon.a (mon.0) 526 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:03:24.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:23 smithi050 bash[21866]: cephadm 2024-05-20T22:03:22.912283+0000 mgr.y (mgr.14150) 234 : cephadm 1 Adjusting osd_memory_target on smithi145 to 17265M 2024-05-20T22:03:24.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:23 smithi050 bash[21866]: audit 2024-05-20T22:03:22.918310+0000 mon.a (mon.0) 527 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:24.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:23 smithi050 bash[21866]: audit 2024-05-20T22:03:22.922863+0000 mon.a (mon.0) 528 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:03:24.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:23 smithi050 bash[21866]: audit 2024-05-20T22:03:22.924643+0000 mon.a (mon.0) 529 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:03:24.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:23 smithi050 bash[21866]: audit 2024-05-20T22:03:22.933977+0000 mon.a (mon.0) 530 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:24.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:23 smithi050 bash[28929]: cephadm 2024-05-20T22:03:22.893230+0000 mgr.y (mgr.14150) 233 : cephadm 1 Detected new or changed devices on smithi145 2024-05-20T22:03:24.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:23 smithi050 bash[28929]: audit 2024-05-20T22:03:22.901419+0000 mon.a (mon.0) 524 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:24.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:23 smithi050 bash[28929]: audit 2024-05-20T22:03:22.909144+0000 mon.a (mon.0) 525 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:24.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:23 smithi050 bash[28929]: audit 2024-05-20T22:03:22.910964+0000 mon.a (mon.0) 526 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:03:24.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:23 smithi050 bash[28929]: cephadm 2024-05-20T22:03:22.912283+0000 mgr.y (mgr.14150) 234 : cephadm 1 Adjusting osd_memory_target on smithi145 to 17265M 2024-05-20T22:03:24.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:23 smithi050 bash[28929]: audit 2024-05-20T22:03:22.918310+0000 mon.a (mon.0) 527 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:24.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:23 smithi050 bash[28929]: audit 2024-05-20T22:03:22.922863+0000 mon.a (mon.0) 528 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:03:24.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:23 smithi050 bash[28929]: audit 2024-05-20T22:03:22.924643+0000 mon.a (mon.0) 529 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:03:24.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:23 smithi050 bash[28929]: audit 2024-05-20T22:03:22.933977+0000 mon.a (mon.0) 530 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:24.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:23 smithi145 bash[23893]: cephadm 2024-05-20T22:03:22.893230+0000 mgr.y (mgr.14150) 233 : cephadm 1 Detected new or changed devices on smithi145 2024-05-20T22:03:24.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:23 smithi145 bash[23893]: audit 2024-05-20T22:03:22.901419+0000 mon.a (mon.0) 524 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:24.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:23 smithi145 bash[23893]: audit 2024-05-20T22:03:22.909144+0000 mon.a (mon.0) 525 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:24.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:23 smithi145 bash[23893]: audit 2024-05-20T22:03:22.910964+0000 mon.a (mon.0) 526 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:03:24.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:23 smithi145 bash[23893]: cephadm 2024-05-20T22:03:22.912283+0000 mgr.y (mgr.14150) 234 : cephadm 1 Adjusting osd_memory_target on smithi145 to 17265M 2024-05-20T22:03:24.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:23 smithi145 bash[23893]: audit 2024-05-20T22:03:22.918310+0000 mon.a (mon.0) 527 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:24.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:23 smithi145 bash[23893]: audit 2024-05-20T22:03:22.922863+0000 mon.a (mon.0) 528 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:03:24.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:23 smithi145 bash[23893]: audit 2024-05-20T22:03:22.924643+0000 mon.a (mon.0) 529 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:03:24.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:23 smithi145 bash[23893]: audit 2024-05-20T22:03:22.933977+0000 mon.a (mon.0) 530 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:25.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:24 smithi050 bash[21866]: cluster 2024-05-20T22:03:23.484821+0000 mgr.y (mgr.14150) 235 : cluster 0 pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-20T22:03:25.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:24 smithi050 bash[28929]: cluster 2024-05-20T22:03:23.484821+0000 mgr.y (mgr.14150) 235 : cluster 0 pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-20T22:03:25.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:24 smithi145 bash[23893]: cluster 2024-05-20T22:03:23.484821+0000 mgr.y (mgr.14150) 235 : cluster 0 pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-20T22:03:27.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:26 smithi050 bash[21866]: cluster 2024-05-20T22:03:25.485399+0000 mgr.y (mgr.14150) 236 : cluster 0 pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T22:03:27.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:26 smithi050 bash[28929]: cluster 2024-05-20T22:03:25.485399+0000 mgr.y (mgr.14150) 236 : cluster 0 pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T22:03:27.290 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T22:03:27.314 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:26 smithi145 bash[23893]: cluster 2024-05-20T22:03:25.485399+0000 mgr.y (mgr.14150) 236 : cluster 0 pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T22:03:29.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:28 smithi145 bash[23893]: cluster 2024-05-20T22:03:27.485977+0000 mgr.y (mgr.14150) 237 : cluster 0 pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-20T22:03:29.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:28 smithi050 bash[21866]: cluster 2024-05-20T22:03:27.485977+0000 mgr.y (mgr.14150) 237 : cluster 0 pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-20T22:03:29.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:28 smithi050 bash[28929]: cluster 2024-05-20T22:03:27.485977+0000 mgr.y (mgr.14150) 237 : cluster 0 pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-20T22:03:29.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d404d8640 1 -- 172.21.15.145:0/166263961 >> v1:172.21.15.145:6789/0 conn(0x7f4d38101720 legacy=0x7f4d38101b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:03:29.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d404d8640 1 -- 172.21.15.145:0/166263961 shutdown_connections 2024-05-20T22:03:29.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d404d8640 1 -- 172.21.15.145:0/166263961 >> 172.21.15.145:0/166263961 conn(0x7f4d380fcce0 msgr2=0x7f4d380ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:03:29.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d404d8640 1 -- 172.21.15.145:0/166263961 shutdown_connections 2024-05-20T22:03:29.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d404d8640 1 -- 172.21.15.145:0/166263961 wait complete. 2024-05-20T22:03:29.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d404d8640 1 Processor -- start 2024-05-20T22:03:29.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d404d8640 1 -- start start 2024-05-20T22:03:29.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d404d8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f4d381a3ea0 con 0x7f4d38101720 2024-05-20T22:03:29.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d404d8640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f4d381a50e0 con 0x7f4d38105b50 2024-05-20T22:03:29.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d404d8640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f4d381a6320 con 0x7f4d38109890 2024-05-20T22:03:29.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d3da73640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f4d38105b50 0x7f4d3819ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:48282/0 (socket says 172.21.15.145:48282) 2024-05-20T22:03:29.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d3da73640 1 -- 172.21.15.145:0/552334002 learned_addr learned my addr 172.21.15.145:0/552334002 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-05-20T22:03:29.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d377fe640 1 -- 172.21.15.145:0/552334002 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3646062966 0 0) 0x7f4d381a50e0 con 0x7f4d38105b50 2024-05-20T22:03:29.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d377fe640 1 -- 172.21.15.145:0/552334002 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d20003520 con 0x7f4d38105b50 2024-05-20T22:03:29.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d377fe640 1 -- 172.21.15.145:0/552334002 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4206875368 0 0) 0x7f4d20003520 con 0x7f4d38105b50 2024-05-20T22:03:29.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d377fe640 1 -- 172.21.15.145:0/552334002 --> v1:172.21.15.145:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d381a50e0 con 0x7f4d38105b50 2024-05-20T22:03:29.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d377fe640 1 -- 172.21.15.145:0/552334002 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f4d2c001cc0 con 0x7f4d38105b50 2024-05-20T22:03:29.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d377fe640 1 -- 172.21.15.145:0/552334002 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2806803257 0 0) 0x7f4d381a6320 con 0x7f4d38109890 2024-05-20T22:03:29.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d377fe640 1 -- 172.21.15.145:0/552334002 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d20003520 con 0x7f4d38109890 2024-05-20T22:03:29.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d377fe640 1 -- 172.21.15.145:0/552334002 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1031585791 0 0) 0x7f4d381a3ea0 con 0x7f4d38101720 2024-05-20T22:03:29.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d377fe640 1 -- 172.21.15.145:0/552334002 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d381a6320 con 0x7f4d38101720 2024-05-20T22:03:29.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d377fe640 1 -- 172.21.15.145:0/552334002 <== mon.1 v1:172.21.15.145:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2218582573 0 0) 0x7f4d381a50e0 con 0x7f4d38105b50 2024-05-20T22:03:29.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d377fe640 1 -- 172.21.15.145:0/552334002 >> v1:172.21.15.50:6790/0 conn(0x7f4d38109890 legacy=0x7f4d381a25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:03:29.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d377fe640 1 -- 172.21.15.145:0/552334002 >> v1:172.21.15.50:6789/0 conn(0x7f4d38101720 legacy=0x7f4d380754f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:03:29.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d377fe640 1 -- 172.21.15.145:0/552334002 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d381a7560 con 0x7f4d38105b50 2024-05-20T22:03:29.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d404d8640 1 -- 172.21.15.145:0/552334002 --> v1:172.21.15.145:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4d381a6550 con 0x7f4d38105b50 2024-05-20T22:03:29.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.613+0000 7f4d404d8640 1 -- 172.21.15.145:0/552334002 --> v1:172.21.15.145:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4d381a6a90 con 0x7f4d38105b50 2024-05-20T22:03:29.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.617+0000 7f4d377fe640 1 -- 172.21.15.145:0/552334002 <== mon.1 v1:172.21.15.145:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f4d2c004150 con 0x7f4d38105b50 2024-05-20T22:03:29.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.617+0000 7f4d377fe640 1 -- 172.21.15.145:0/552334002 <== mon.1 v1:172.21.15.145:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f4d2c006160 con 0x7f4d38105b50 2024-05-20T22:03:29.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.617+0000 7f4d404d8640 1 -- 172.21.15.145:0/552334002 --> v1:172.21.15.145:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d240050b0 con 0x7f4d38105b50 2024-05-20T22:03:29.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.617+0000 7f4d377fe640 1 -- 172.21.15.145:0/552334002 <== mon.1 v1:172.21.15.145:6789/0 7 ==== mgrmap(e 15) ==== 92081+0+0 (unknown 2274281742 0 0) 0x7f4d2c003cc0 con 0x7f4d38105b50 2024-05-20T22:03:29.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.617+0000 7f4d377fe640 1 -- 172.21.15.145:0/552334002 <== mon.1 v1:172.21.15.145:6789/0 8 ==== osd_map(34..34 src has 1..34) ==== 3205+0+0 (unknown 3826650031 0 0) 0x7f4d2c088dc0 con 0x7f4d38105b50 2024-05-20T22:03:29.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.621+0000 7f4d377fe640 1 -- 172.21.15.145:0/552334002 <== mon.1 v1:172.21.15.145:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f4d2c057210 con 0x7f4d38105b50 2024-05-20T22:03:29.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:03:29.809+0000 7f4d404d8640 1 -- 172.21.15.145:0/552334002 --> v1:172.21.15.50:6800/2944911247 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f4d24000bc0 con 0x7f4d2006ed70 2024-05-20T22:03:30.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:29 smithi145 bash[23893]: audit 2024-05-20T22:03:29.826071+0000 mon.a (mon.0) 531 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:03:30.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:29 smithi145 bash[23893]: audit 2024-05-20T22:03:29.832062+0000 mon.a (mon.0) 532 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:03:30.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:29 smithi145 bash[23893]: audit 2024-05-20T22:03:29.833651+0000 mon.a (mon.0) 533 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:03:30.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:29 smithi050 bash[21866]: audit 2024-05-20T22:03:29.826071+0000 mon.a (mon.0) 531 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:03:30.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:29 smithi050 bash[21866]: audit 2024-05-20T22:03:29.832062+0000 mon.a (mon.0) 532 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:03:30.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:29 smithi050 bash[21866]: audit 2024-05-20T22:03:29.833651+0000 mon.a (mon.0) 533 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:03:30.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:29 smithi050 bash[28929]: audit 2024-05-20T22:03:29.826071+0000 mon.a (mon.0) 531 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:03:30.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:29 smithi050 bash[28929]: audit 2024-05-20T22:03:29.832062+0000 mon.a (mon.0) 532 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:03:30.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:29 smithi050 bash[28929]: audit 2024-05-20T22:03:29.833651+0000 mon.a (mon.0) 533 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:03:31.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:30 smithi145 bash[23893]: cluster 2024-05-20T22:03:29.486642+0000 mgr.y (mgr.14150) 238 : cluster 0 pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:31.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:30 smithi145 bash[23893]: audit 2024-05-20T22:03:29.819451+0000 mgr.y (mgr.14150) 239 : audit 0 from='client.24265 v1:172.21.15.145:0/552334002' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:03:31.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:30 smithi050 bash[21866]: cluster 2024-05-20T22:03:29.486642+0000 mgr.y (mgr.14150) 238 : cluster 0 pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:31.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:30 smithi050 bash[21866]: audit 2024-05-20T22:03:29.819451+0000 mgr.y (mgr.14150) 239 : audit 0 from='client.24265 v1:172.21.15.145:0/552334002' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:03:31.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:30 smithi050 bash[28929]: cluster 2024-05-20T22:03:29.486642+0000 mgr.y (mgr.14150) 238 : cluster 0 pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:31.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:30 smithi050 bash[28929]: audit 2024-05-20T22:03:29.819451+0000 mgr.y (mgr.14150) 239 : audit 0 from='client.24265 v1:172.21.15.145:0/552334002' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:03:33.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:32 smithi145 bash[23893]: cluster 2024-05-20T22:03:31.487307+0000 mgr.y (mgr.14150) 240 : cluster 0 pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:33.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:32 smithi050 bash[28929]: cluster 2024-05-20T22:03:31.487307+0000 mgr.y (mgr.14150) 240 : cluster 0 pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:33.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:32 smithi050 bash[21866]: cluster 2024-05-20T22:03:31.487307+0000 mgr.y (mgr.14150) 240 : cluster 0 pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:35.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:34 smithi145 bash[23893]: cluster 2024-05-20T22:03:33.488025+0000 mgr.y (mgr.14150) 241 : cluster 0 pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:35.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:34 smithi050 bash[28929]: cluster 2024-05-20T22:03:33.488025+0000 mgr.y (mgr.14150) 241 : cluster 0 pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:35.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:34 smithi050 bash[21866]: cluster 2024-05-20T22:03:33.488025+0000 mgr.y (mgr.14150) 241 : cluster 0 pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:37.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:36 smithi145 bash[23893]: cluster 2024-05-20T22:03:35.488678+0000 mgr.y (mgr.14150) 242 : cluster 0 pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:37.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:36 smithi050 bash[21866]: cluster 2024-05-20T22:03:35.488678+0000 mgr.y (mgr.14150) 242 : cluster 0 pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:37.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:36 smithi050 bash[28929]: cluster 2024-05-20T22:03:35.488678+0000 mgr.y (mgr.14150) 242 : cluster 0 pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:38.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:37 smithi145 bash[23893]: audit 2024-05-20T22:03:37.644192+0000 mon.b (mon.1) 14 : audit 1 from='client.? v1:172.21.15.145:0/3604371368' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "706eb62f-93b9-4465-a352-cade0e490194"}]: dispatch 2024-05-20T22:03:38.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:37 smithi145 bash[23893]: audit 2024-05-20T22:03:37.645960+0000 mon.a (mon.0) 534 : audit 1 from='client.24271 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "706eb62f-93b9-4465-a352-cade0e490194"}]: dispatch 2024-05-20T22:03:38.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:37 smithi145 bash[23893]: audit 2024-05-20T22:03:37.649788+0000 mon.a (mon.0) 535 : audit 1 from='client.24271 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "706eb62f-93b9-4465-a352-cade0e490194"}]': finished 2024-05-20T22:03:38.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:37 smithi145 bash[23893]: cluster 2024-05-20T22:03:37.655348+0000 mon.a (mon.0) 536 : cluster 0 osdmap e35: 6 total, 5 up, 6 in 2024-05-20T22:03:38.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:37 smithi145 bash[23893]: audit 2024-05-20T22:03:37.656113+0000 mon.a (mon.0) 537 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T22:03:38.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:37 smithi050 bash[21866]: audit 2024-05-20T22:03:37.644192+0000 mon.b (mon.1) 14 : audit 1 from='client.? v1:172.21.15.145:0/3604371368' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "706eb62f-93b9-4465-a352-cade0e490194"}]: dispatch 2024-05-20T22:03:38.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:37 smithi050 bash[21866]: audit 2024-05-20T22:03:37.645960+0000 mon.a (mon.0) 534 : audit 1 from='client.24271 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "706eb62f-93b9-4465-a352-cade0e490194"}]: dispatch 2024-05-20T22:03:38.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:37 smithi050 bash[21866]: audit 2024-05-20T22:03:37.649788+0000 mon.a (mon.0) 535 : audit 1 from='client.24271 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "706eb62f-93b9-4465-a352-cade0e490194"}]': finished 2024-05-20T22:03:38.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:37 smithi050 bash[21866]: cluster 2024-05-20T22:03:37.655348+0000 mon.a (mon.0) 536 : cluster 0 osdmap e35: 6 total, 5 up, 6 in 2024-05-20T22:03:38.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:37 smithi050 bash[21866]: audit 2024-05-20T22:03:37.656113+0000 mon.a (mon.0) 537 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T22:03:38.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:37 smithi050 bash[28929]: audit 2024-05-20T22:03:37.644192+0000 mon.b (mon.1) 14 : audit 1 from='client.? v1:172.21.15.145:0/3604371368' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "706eb62f-93b9-4465-a352-cade0e490194"}]: dispatch 2024-05-20T22:03:38.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:37 smithi050 bash[28929]: audit 2024-05-20T22:03:37.645960+0000 mon.a (mon.0) 534 : audit 1 from='client.24271 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "706eb62f-93b9-4465-a352-cade0e490194"}]: dispatch 2024-05-20T22:03:38.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:37 smithi050 bash[28929]: audit 2024-05-20T22:03:37.649788+0000 mon.a (mon.0) 535 : audit 1 from='client.24271 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "706eb62f-93b9-4465-a352-cade0e490194"}]': finished 2024-05-20T22:03:38.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:37 smithi050 bash[28929]: cluster 2024-05-20T22:03:37.655348+0000 mon.a (mon.0) 536 : cluster 0 osdmap e35: 6 total, 5 up, 6 in 2024-05-20T22:03:38.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:37 smithi050 bash[28929]: audit 2024-05-20T22:03:37.656113+0000 mon.a (mon.0) 537 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T22:03:39.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:38 smithi145 bash[23893]: cluster 2024-05-20T22:03:37.489379+0000 mgr.y (mgr.14150) 243 : cluster 0 pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:39.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:38 smithi145 bash[23893]: audit 2024-05-20T22:03:38.297038+0000 mon.b (mon.1) 15 : audit 0 from='client.? v1:172.21.15.145:0/4005043041' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:03:39.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:38 smithi050 bash[21866]: cluster 2024-05-20T22:03:37.489379+0000 mgr.y (mgr.14150) 243 : cluster 0 pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:39.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:38 smithi050 bash[21866]: audit 2024-05-20T22:03:38.297038+0000 mon.b (mon.1) 15 : audit 0 from='client.? v1:172.21.15.145:0/4005043041' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:03:39.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:38 smithi050 bash[28929]: cluster 2024-05-20T22:03:37.489379+0000 mgr.y (mgr.14150) 243 : cluster 0 pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:39.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:38 smithi050 bash[28929]: audit 2024-05-20T22:03:38.297038+0000 mon.b (mon.1) 15 : audit 0 from='client.? v1:172.21.15.145:0/4005043041' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:03:41.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:40 smithi145 bash[23893]: cluster 2024-05-20T22:03:39.490076+0000 mgr.y (mgr.14150) 244 : cluster 0 pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:41.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:40 smithi050 bash[28929]: cluster 2024-05-20T22:03:39.490076+0000 mgr.y (mgr.14150) 244 : cluster 0 pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:41.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:40 smithi050 bash[21866]: cluster 2024-05-20T22:03:39.490076+0000 mgr.y (mgr.14150) 244 : cluster 0 pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:43.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:42 smithi145 bash[23893]: cluster 2024-05-20T22:03:41.490743+0000 mgr.y (mgr.14150) 245 : cluster 0 pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:43.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:42 smithi050 bash[28929]: cluster 2024-05-20T22:03:41.490743+0000 mgr.y (mgr.14150) 245 : cluster 0 pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:43.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:42 smithi050 bash[21866]: cluster 2024-05-20T22:03:41.490743+0000 mgr.y (mgr.14150) 245 : cluster 0 pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:45.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:44 smithi145 bash[23893]: cluster 2024-05-20T22:03:43.491444+0000 mgr.y (mgr.14150) 246 : cluster 0 pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:45.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:44 smithi050 bash[21866]: cluster 2024-05-20T22:03:43.491444+0000 mgr.y (mgr.14150) 246 : cluster 0 pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:45.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:44 smithi050 bash[28929]: cluster 2024-05-20T22:03:43.491444+0000 mgr.y (mgr.14150) 246 : cluster 0 pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:47.278 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:46 smithi145 bash[23893]: cluster 2024-05-20T22:03:45.492170+0000 mgr.y (mgr.14150) 247 : cluster 0 pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:47.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:46 smithi050 bash[28929]: cluster 2024-05-20T22:03:45.492170+0000 mgr.y (mgr.14150) 247 : cluster 0 pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:47.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:46 smithi050 bash[21866]: cluster 2024-05-20T22:03:45.492170+0000 mgr.y (mgr.14150) 247 : cluster 0 pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:49.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:48 smithi145 bash[23893]: cluster 2024-05-20T22:03:47.492866+0000 mgr.y (mgr.14150) 248 : cluster 0 pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:49.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:48 smithi050 bash[21866]: cluster 2024-05-20T22:03:47.492866+0000 mgr.y (mgr.14150) 248 : cluster 0 pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:49.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:48 smithi050 bash[28929]: cluster 2024-05-20T22:03:47.492866+0000 mgr.y (mgr.14150) 248 : cluster 0 pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:50.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:50 smithi145 bash[23893]: audit 2024-05-20T22:03:49.498073+0000 mon.a (mon.0) 538 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-20T22:03:50.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:50 smithi145 bash[23893]: audit 2024-05-20T22:03:49.499792+0000 mon.a (mon.0) 539 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:03:50.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:50 smithi050 bash[28929]: audit 2024-05-20T22:03:49.498073+0000 mon.a (mon.0) 538 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-20T22:03:50.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:50 smithi050 bash[28929]: audit 2024-05-20T22:03:49.499792+0000 mon.a (mon.0) 539 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:03:50.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:50 smithi050 bash[21866]: audit 2024-05-20T22:03:49.498073+0000 mon.a (mon.0) 538 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-20T22:03:50.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:50 smithi050 bash[21866]: audit 2024-05-20T22:03:49.499792+0000 mon.a (mon.0) 539 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:03:51.093 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:51 smithi145 bash[23893]: cluster 2024-05-20T22:03:49.493484+0000 mgr.y (mgr.14150) 249 : cluster 0 pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:51.093 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:51 smithi145 bash[23893]: cephadm 2024-05-20T22:03:49.501255+0000 mgr.y (mgr.14150) 250 : cephadm 1 Deploying daemon osd.5 on smithi145 2024-05-20T22:03:51.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:51 smithi050 bash[28929]: cluster 2024-05-20T22:03:49.493484+0000 mgr.y (mgr.14150) 249 : cluster 0 pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:51.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:51 smithi050 bash[28929]: cephadm 2024-05-20T22:03:49.501255+0000 mgr.y (mgr.14150) 250 : cephadm 1 Deploying daemon osd.5 on smithi145 2024-05-20T22:03:51.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:51 smithi050 bash[21866]: cluster 2024-05-20T22:03:49.493484+0000 mgr.y (mgr.14150) 249 : cluster 0 pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:51.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:51 smithi050 bash[21866]: cephadm 2024-05-20T22:03:49.501255+0000 mgr.y (mgr.14150) 250 : cephadm 1 Deploying daemon osd.5 on smithi145 2024-05-20T22:03:53.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:53 smithi145 bash[23893]: cluster 2024-05-20T22:03:51.493975+0000 mgr.y (mgr.14150) 251 : cluster 0 pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:53.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:53 smithi050 bash[21866]: cluster 2024-05-20T22:03:51.493975+0000 mgr.y (mgr.14150) 251 : cluster 0 pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:53.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:53 smithi050 bash[28929]: cluster 2024-05-20T22:03:51.493975+0000 mgr.y (mgr.14150) 251 : cluster 0 pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:53.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:03:53.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:03:53.597 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:03:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:03:53.597 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:03:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:03:53.598 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:03:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:03:53.598 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:03:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:03:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:54 smithi145 bash[23893]: audit 2024-05-20T22:03:53.639096+0000 mon.a (mon.0) 540 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:03:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:54 smithi145 bash[23893]: audit 2024-05-20T22:03:53.646480+0000 mon.a (mon.0) 541 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:54 smithi145 bash[23893]: audit 2024-05-20T22:03:53.654766+0000 mon.a (mon.0) 542 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:54.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:54 smithi050 bash[21866]: audit 2024-05-20T22:03:53.639096+0000 mon.a (mon.0) 540 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:03:54.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:54 smithi050 bash[21866]: audit 2024-05-20T22:03:53.646480+0000 mon.a (mon.0) 541 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:54.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:54 smithi050 bash[21866]: audit 2024-05-20T22:03:53.654766+0000 mon.a (mon.0) 542 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:54.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:54 smithi050 bash[28929]: audit 2024-05-20T22:03:53.639096+0000 mon.a (mon.0) 540 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:03:54.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:54 smithi050 bash[28929]: audit 2024-05-20T22:03:53.646480+0000 mon.a (mon.0) 541 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:54.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:54 smithi050 bash[28929]: audit 2024-05-20T22:03:53.654766+0000 mon.a (mon.0) 542 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:03:55.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:55 smithi145 bash[23893]: cluster 2024-05-20T22:03:53.494583+0000 mgr.y (mgr.14150) 252 : cluster 0 pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:55.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:55 smithi050 bash[21866]: cluster 2024-05-20T22:03:53.494583+0000 mgr.y (mgr.14150) 252 : cluster 0 pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:55.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:55 smithi050 bash[28929]: cluster 2024-05-20T22:03:53.494583+0000 mgr.y (mgr.14150) 252 : cluster 0 pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:57.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:57 smithi145 bash[23893]: cluster 2024-05-20T22:03:55.495165+0000 mgr.y (mgr.14150) 253 : cluster 0 pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:57.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:57 smithi050 bash[21866]: cluster 2024-05-20T22:03:55.495165+0000 mgr.y (mgr.14150) 253 : cluster 0 pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:57.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:57 smithi050 bash[28929]: cluster 2024-05-20T22:03:55.495165+0000 mgr.y (mgr.14150) 253 : cluster 0 pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:59.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:03:59 smithi145 bash[23893]: cluster 2024-05-20T22:03:57.495673+0000 mgr.y (mgr.14150) 254 : cluster 0 pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:59.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:03:59 smithi050 bash[28929]: cluster 2024-05-20T22:03:57.495673+0000 mgr.y (mgr.14150) 254 : cluster 0 pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:03:59.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:03:59 smithi050 bash[21866]: cluster 2024-05-20T22:03:57.495673+0000 mgr.y (mgr.14150) 254 : cluster 0 pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:04:00.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:00 smithi145 bash[23893]: audit 2024-05-20T22:03:59.706356+0000 mon.b (mon.1) 16 : audit 1 from='osd.5 v1:172.21.15.145:6804/1463480843' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-20T22:04:00.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:00 smithi145 bash[23893]: audit 2024-05-20T22:03:59.707745+0000 mon.a (mon.0) 543 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-20T22:04:00.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:00 smithi050 bash[21866]: audit 2024-05-20T22:03:59.706356+0000 mon.b (mon.1) 16 : audit 1 from='osd.5 v1:172.21.15.145:6804/1463480843' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-20T22:04:00.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:00 smithi050 bash[21866]: audit 2024-05-20T22:03:59.707745+0000 mon.a (mon.0) 543 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-20T22:04:00.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:00 smithi050 bash[28929]: audit 2024-05-20T22:03:59.706356+0000 mon.b (mon.1) 16 : audit 1 from='osd.5 v1:172.21.15.145:6804/1463480843' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-20T22:04:00.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:00 smithi050 bash[28929]: audit 2024-05-20T22:03:59.707745+0000 mon.a (mon.0) 543 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-20T22:04:01.123 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:01 smithi145 bash[23893]: cluster 2024-05-20T22:03:59.496245+0000 mgr.y (mgr.14150) 255 : cluster 0 pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:04:01.123 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:01 smithi145 bash[23893]: audit 2024-05-20T22:04:00.034681+0000 mon.a (mon.0) 544 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-20T22:04:01.123 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:01 smithi145 bash[23893]: cluster 2024-05-20T22:04:00.040382+0000 mon.a (mon.0) 545 : cluster 0 osdmap e36: 6 total, 5 up, 6 in 2024-05-20T22:04:01.123 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:01 smithi145 bash[23893]: audit 2024-05-20T22:04:00.040883+0000 mon.a (mon.0) 546 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T22:04:01.123 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:01 smithi145 bash[23893]: audit 2024-05-20T22:04:00.043677+0000 mon.b (mon.1) 17 : audit 1 from='osd.5 v1:172.21.15.145:6804/1463480843' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:04:01.123 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:01 smithi145 bash[23893]: audit 2024-05-20T22:04:00.045188+0000 mon.a (mon.0) 547 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:04:01.123 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:01 smithi145 bash[23893]: audit 2024-05-20T22:04:00.354315+0000 mon.a (mon.0) 548 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:01.124 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:01 smithi145 bash[23893]: audit 2024-05-20T22:04:00.362610+0000 mon.a (mon.0) 549 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:01.124 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:01 smithi145 bash[23893]: audit 2024-05-20T22:04:00.364474+0000 mon.a (mon.0) 550 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:04:01.124 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:01 smithi145 bash[23893]: audit 2024-05-20T22:04:00.366246+0000 mon.a (mon.0) 551 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:04:01.124 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:01 smithi145 bash[23893]: audit 2024-05-20T22:04:00.375769+0000 mon.a (mon.0) 552 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:01.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:01 smithi050 bash[21866]: cluster 2024-05-20T22:03:59.496245+0000 mgr.y (mgr.14150) 255 : cluster 0 pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:04:01.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:01 smithi050 bash[21866]: audit 2024-05-20T22:04:00.034681+0000 mon.a (mon.0) 544 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-20T22:04:01.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:01 smithi050 bash[21866]: cluster 2024-05-20T22:04:00.040382+0000 mon.a (mon.0) 545 : cluster 0 osdmap e36: 6 total, 5 up, 6 in 2024-05-20T22:04:01.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:01 smithi050 bash[21866]: audit 2024-05-20T22:04:00.040883+0000 mon.a (mon.0) 546 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T22:04:01.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:01 smithi050 bash[21866]: audit 2024-05-20T22:04:00.043677+0000 mon.b (mon.1) 17 : audit 1 from='osd.5 v1:172.21.15.145:6804/1463480843' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:04:01.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:01 smithi050 bash[21866]: audit 2024-05-20T22:04:00.045188+0000 mon.a (mon.0) 547 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:04:01.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:01 smithi050 bash[21866]: audit 2024-05-20T22:04:00.354315+0000 mon.a (mon.0) 548 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:01.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:01 smithi050 bash[21866]: audit 2024-05-20T22:04:00.362610+0000 mon.a (mon.0) 549 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:01.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:01 smithi050 bash[21866]: audit 2024-05-20T22:04:00.364474+0000 mon.a (mon.0) 550 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:04:01.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:01 smithi050 bash[21866]: audit 2024-05-20T22:04:00.366246+0000 mon.a (mon.0) 551 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:04:01.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:01 smithi050 bash[21866]: audit 2024-05-20T22:04:00.375769+0000 mon.a (mon.0) 552 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:01.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:01 smithi050 bash[28929]: cluster 2024-05-20T22:03:59.496245+0000 mgr.y (mgr.14150) 255 : cluster 0 pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:04:01.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:01 smithi050 bash[28929]: audit 2024-05-20T22:04:00.034681+0000 mon.a (mon.0) 544 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-20T22:04:01.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:01 smithi050 bash[28929]: cluster 2024-05-20T22:04:00.040382+0000 mon.a (mon.0) 545 : cluster 0 osdmap e36: 6 total, 5 up, 6 in 2024-05-20T22:04:01.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:01 smithi050 bash[28929]: audit 2024-05-20T22:04:00.040883+0000 mon.a (mon.0) 546 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T22:04:01.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:01 smithi050 bash[28929]: audit 2024-05-20T22:04:00.043677+0000 mon.b (mon.1) 17 : audit 1 from='osd.5 v1:172.21.15.145:6804/1463480843' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:04:01.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:01 smithi050 bash[28929]: audit 2024-05-20T22:04:00.045188+0000 mon.a (mon.0) 547 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:04:01.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:01 smithi050 bash[28929]: audit 2024-05-20T22:04:00.354315+0000 mon.a (mon.0) 548 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:01.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:01 smithi050 bash[28929]: audit 2024-05-20T22:04:00.362610+0000 mon.a (mon.0) 549 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:01.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:01 smithi050 bash[28929]: audit 2024-05-20T22:04:00.364474+0000 mon.a (mon.0) 550 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:04:01.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:01 smithi050 bash[28929]: audit 2024-05-20T22:04:00.366246+0000 mon.a (mon.0) 551 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:04:01.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:01 smithi050 bash[28929]: audit 2024-05-20T22:04:00.375769+0000 mon.a (mon.0) 552 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:02.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:02 smithi145 bash[23893]: audit 2024-05-20T22:04:01.037043+0000 mon.a (mon.0) 553 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-05-20T22:04:02.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:02 smithi145 bash[23893]: cluster 2024-05-20T22:04:01.042994+0000 mon.a (mon.0) 554 : cluster 0 osdmap e37: 6 total, 5 up, 6 in 2024-05-20T22:04:02.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:02 smithi145 bash[23893]: audit 2024-05-20T22:04:01.045860+0000 mon.a (mon.0) 555 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T22:04:02.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:02 smithi145 bash[23893]: cluster 2024-05-20T22:04:02.046064+0000 mon.a (mon.0) 556 : cluster 1 osd.5 v1:172.21.15.145:6804/1463480843 boot 2024-05-20T22:04:02.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:02 smithi050 bash[21866]: audit 2024-05-20T22:04:01.037043+0000 mon.a (mon.0) 553 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-05-20T22:04:02.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:02 smithi050 bash[21866]: cluster 2024-05-20T22:04:01.042994+0000 mon.a (mon.0) 554 : cluster 0 osdmap e37: 6 total, 5 up, 6 in 2024-05-20T22:04:02.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:02 smithi050 bash[21866]: audit 2024-05-20T22:04:01.045860+0000 mon.a (mon.0) 555 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T22:04:02.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:02 smithi050 bash[21866]: cluster 2024-05-20T22:04:02.046064+0000 mon.a (mon.0) 556 : cluster 1 osd.5 v1:172.21.15.145:6804/1463480843 boot 2024-05-20T22:04:02.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:02 smithi050 bash[28929]: audit 2024-05-20T22:04:01.037043+0000 mon.a (mon.0) 553 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-05-20T22:04:02.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:02 smithi050 bash[28929]: cluster 2024-05-20T22:04:01.042994+0000 mon.a (mon.0) 554 : cluster 0 osdmap e37: 6 total, 5 up, 6 in 2024-05-20T22:04:02.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:02 smithi050 bash[28929]: audit 2024-05-20T22:04:01.045860+0000 mon.a (mon.0) 555 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T22:04:02.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:02 smithi050 bash[28929]: cluster 2024-05-20T22:04:02.046064+0000 mon.a (mon.0) 556 : cluster 1 osd.5 v1:172.21.15.145:6804/1463480843 boot 2024-05-20T22:04:03.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:03.309+0000 7f4d377fe640 1 -- 172.21.15.145:0/552334002 <== mgr.14150 v1:172.21.15.50:6800/2944911247 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (unknown 0 0 1301523935) 0x7f4d24000bc0 con 0x7f4d2006ed70 2024-05-20T22:04:03.312 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 5 on host 'smithi145' 2024-05-20T22:04:03.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:03.313+0000 7f4d404d8640 1 -- 172.21.15.145:0/552334002 >> v1:172.21.15.50:6800/2944911247 conn(0x7f4d2006ed70 legacy=0x7f4d20071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:04:03.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:03.313+0000 7f4d404d8640 1 -- 172.21.15.145:0/552334002 >> v1:172.21.15.145:6789/0 conn(0x7f4d38105b50 legacy=0x7f4d3819ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:04:03.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:03.313+0000 7f4d404d8640 1 -- 172.21.15.145:0/552334002 shutdown_connections 2024-05-20T22:04:03.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:03.313+0000 7f4d404d8640 1 -- 172.21.15.145:0/552334002 >> 172.21.15.145:0/552334002 conn(0x7f4d380fcce0 msgr2=0x7f4d38107fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:04:03.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:03.313+0000 7f4d404d8640 1 -- 172.21.15.145:0/552334002 shutdown_connections 2024-05-20T22:04:03.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:03.313+0000 7f4d404d8640 1 -- 172.21.15.145:0/552334002 wait complete. 2024-05-20T22:04:03.327 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:03 smithi145 bash[23893]: cluster 2024-05-20T22:04:00.708008+0000 osd.5 (osd.5) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:04:03.327 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:03 smithi145 bash[23893]: cluster 2024-05-20T22:04:00.708152+0000 osd.5 (osd.5) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:04:03.327 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:03 smithi145 bash[23893]: cluster 2024-05-20T22:04:01.496746+0000 mgr.y (mgr.14150) 256 : cluster 0 pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:04:03.327 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:03 smithi145 bash[23893]: cluster 2024-05-20T22:04:02.046184+0000 mon.a (mon.0) 557 : cluster 0 osdmap e38: 6 total, 6 up, 6 in 2024-05-20T22:04:03.327 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:03 smithi145 bash[23893]: audit 2024-05-20T22:04:02.046505+0000 mon.a (mon.0) 558 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T22:04:03.327 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:03 smithi145 bash[23893]: cluster 2024-05-20T22:04:03.047404+0000 mon.a (mon.0) 559 : cluster 0 osdmap e39: 6 total, 6 up, 6 in 2024-05-20T22:04:03.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:03 smithi050 bash[21866]: cluster 2024-05-20T22:04:00.708008+0000 osd.5 (osd.5) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:04:03.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:03 smithi050 bash[21866]: cluster 2024-05-20T22:04:00.708152+0000 osd.5 (osd.5) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:04:03.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:03 smithi050 bash[21866]: cluster 2024-05-20T22:04:01.496746+0000 mgr.y (mgr.14150) 256 : cluster 0 pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:04:03.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:03 smithi050 bash[21866]: cluster 2024-05-20T22:04:02.046184+0000 mon.a (mon.0) 557 : cluster 0 osdmap e38: 6 total, 6 up, 6 in 2024-05-20T22:04:03.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:03 smithi050 bash[21866]: audit 2024-05-20T22:04:02.046505+0000 mon.a (mon.0) 558 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T22:04:03.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:03 smithi050 bash[21866]: cluster 2024-05-20T22:04:03.047404+0000 mon.a (mon.0) 559 : cluster 0 osdmap e39: 6 total, 6 up, 6 in 2024-05-20T22:04:03.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:03 smithi050 bash[28929]: cluster 2024-05-20T22:04:00.708008+0000 osd.5 (osd.5) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:04:03.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:03 smithi050 bash[28929]: cluster 2024-05-20T22:04:00.708152+0000 osd.5 (osd.5) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:04:03.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:03 smithi050 bash[28929]: cluster 2024-05-20T22:04:01.496746+0000 mgr.y (mgr.14150) 256 : cluster 0 pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-20T22:04:03.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:03 smithi050 bash[28929]: cluster 2024-05-20T22:04:02.046184+0000 mon.a (mon.0) 557 : cluster 0 osdmap e38: 6 total, 6 up, 6 in 2024-05-20T22:04:03.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:03 smithi050 bash[28929]: audit 2024-05-20T22:04:02.046505+0000 mon.a (mon.0) 558 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T22:04:03.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:03 smithi050 bash[28929]: cluster 2024-05-20T22:04:03.047404+0000 mon.a (mon.0) 559 : cluster 0 osdmap e39: 6 total, 6 up, 6 in 2024-05-20T22:04:03.914 DEBUG:teuthology.orchestra.run.smithi145:osd.5> sudo journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.5.service 2024-05-20T22:04:03.917 INFO:tasks.cephadm:Deploying osd.6 on smithi145 with /dev/vg_nvme/lv_2... 2024-05-20T22:04:03.917 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-20T22:04:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:04 smithi145 bash[23893]: audit 2024-05-20T22:04:03.294875+0000 mon.a (mon.0) 560 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:04:04.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:04 smithi145 bash[23893]: audit 2024-05-20T22:04:03.302521+0000 mon.a (mon.0) 561 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:04.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:04 smithi145 bash[23893]: audit 2024-05-20T22:04:03.310873+0000 mon.a (mon.0) 562 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:04.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:04 smithi145 bash[23893]: cluster 2024-05-20T22:04:04.049942+0000 mon.a (mon.0) 563 : cluster 0 osdmap e40: 6 total, 6 up, 6 in 2024-05-20T22:04:04.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:04 smithi050 bash[21866]: audit 2024-05-20T22:04:03.294875+0000 mon.a (mon.0) 560 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:04:04.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:04 smithi050 bash[21866]: audit 2024-05-20T22:04:03.302521+0000 mon.a (mon.0) 561 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:04.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:04 smithi050 bash[21866]: audit 2024-05-20T22:04:03.310873+0000 mon.a (mon.0) 562 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:04.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:04 smithi050 bash[21866]: cluster 2024-05-20T22:04:04.049942+0000 mon.a (mon.0) 563 : cluster 0 osdmap e40: 6 total, 6 up, 6 in 2024-05-20T22:04:04.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:04 smithi050 bash[28929]: audit 2024-05-20T22:04:03.294875+0000 mon.a (mon.0) 560 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:04:04.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:04 smithi050 bash[28929]: audit 2024-05-20T22:04:03.302521+0000 mon.a (mon.0) 561 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:04.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:04 smithi050 bash[28929]: audit 2024-05-20T22:04:03.310873+0000 mon.a (mon.0) 562 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:04.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:04 smithi050 bash[28929]: cluster 2024-05-20T22:04:04.049942+0000 mon.a (mon.0) 563 : cluster 0 osdmap e40: 6 total, 6 up, 6 in 2024-05-20T22:04:05.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:05 smithi145 bash[23893]: cluster 2024-05-20T22:04:03.497263+0000 mgr.y (mgr.14150) 257 : cluster 0 pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:05.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:05 smithi050 bash[21866]: cluster 2024-05-20T22:04:03.497263+0000 mgr.y (mgr.14150) 257 : cluster 0 pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:05.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:05 smithi050 bash[28929]: cluster 2024-05-20T22:04:03.497263+0000 mgr.y (mgr.14150) 257 : cluster 0 pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:06.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:06 smithi145 bash[23893]: cluster 2024-05-20T22:04:05.316967+0000 mon.a (mon.0) 564 : cluster 0 osdmap e41: 6 total, 6 up, 6 in 2024-05-20T22:04:06.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:06 smithi145 bash[23893]: cluster 2024-05-20T22:04:05.497896+0000 mgr.y (mgr.14150) 258 : cluster 0 pgmap v235: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:06.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:06 smithi050 bash[21866]: cluster 2024-05-20T22:04:05.316967+0000 mon.a (mon.0) 564 : cluster 0 osdmap e41: 6 total, 6 up, 6 in 2024-05-20T22:04:06.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:06 smithi050 bash[21866]: cluster 2024-05-20T22:04:05.497896+0000 mgr.y (mgr.14150) 258 : cluster 0 pgmap v235: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:06.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:06 smithi050 bash[28929]: cluster 2024-05-20T22:04:05.316967+0000 mon.a (mon.0) 564 : cluster 0 osdmap e41: 6 total, 6 up, 6 in 2024-05-20T22:04:06.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:06 smithi050 bash[28929]: cluster 2024-05-20T22:04:05.497896+0000 mgr.y (mgr.14150) 258 : cluster 0 pgmap v235: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:07.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:07 smithi145 bash[23893]: cluster 2024-05-20T22:04:06.311351+0000 mon.a (mon.0) 565 : cluster 3 Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-20T22:04:07.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:07 smithi145 bash[23893]: cluster 2024-05-20T22:04:06.327220+0000 mon.a (mon.0) 566 : cluster 0 osdmap e42: 6 total, 6 up, 6 in 2024-05-20T22:04:07.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:07 smithi050 bash[21866]: cluster 2024-05-20T22:04:06.311351+0000 mon.a (mon.0) 565 : cluster 3 Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-20T22:04:07.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:07 smithi050 bash[21866]: cluster 2024-05-20T22:04:06.327220+0000 mon.a (mon.0) 566 : cluster 0 osdmap e42: 6 total, 6 up, 6 in 2024-05-20T22:04:07.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:07 smithi050 bash[28929]: cluster 2024-05-20T22:04:06.311351+0000 mon.a (mon.0) 565 : cluster 3 Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-20T22:04:07.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:07 smithi050 bash[28929]: cluster 2024-05-20T22:04:06.327220+0000 mon.a (mon.0) 566 : cluster 0 osdmap e42: 6 total, 6 up, 6 in 2024-05-20T22:04:08.301 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T22:04:08.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:08 smithi145 bash[23893]: cluster 2024-05-20T22:04:07.498488+0000 mgr.y (mgr.14150) 259 : cluster 0 pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:08.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:08 smithi050 bash[21866]: cluster 2024-05-20T22:04:07.498488+0000 mgr.y (mgr.14150) 259 : cluster 0 pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:08.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:08 smithi050 bash[28929]: cluster 2024-05-20T22:04:07.498488+0000 mgr.y (mgr.14150) 259 : cluster 0 pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:09.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:09 smithi145 bash[23893]: cluster 2024-05-20T22:04:08.321675+0000 mon.a (mon.0) 567 : cluster 1 Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-20T22:04:09.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:09 smithi145 bash[23893]: cluster 2024-05-20T22:04:08.321739+0000 mon.a (mon.0) 568 : cluster 1 Cluster is now healthy 2024-05-20T22:04:09.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:09 smithi050 bash[21866]: cluster 2024-05-20T22:04:08.321675+0000 mon.a (mon.0) 567 : cluster 1 Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-20T22:04:09.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:09 smithi050 bash[21866]: cluster 2024-05-20T22:04:08.321739+0000 mon.a (mon.0) 568 : cluster 1 Cluster is now healthy 2024-05-20T22:04:09.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:09 smithi050 bash[28929]: cluster 2024-05-20T22:04:08.321675+0000 mon.a (mon.0) 567 : cluster 1 Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-20T22:04:09.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:09 smithi050 bash[28929]: cluster 2024-05-20T22:04:08.321739+0000 mon.a (mon.0) 568 : cluster 1 Cluster is now healthy 2024-05-20T22:04:10.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:10 smithi145 bash[23893]: cluster 2024-05-20T22:04:09.499129+0000 mgr.y (mgr.14150) 260 : cluster 0 pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:10.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:10 smithi050 bash[21866]: cluster 2024-05-20T22:04:09.499129+0000 mgr.y (mgr.14150) 260 : cluster 0 pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:10.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:10 smithi050 bash[28929]: cluster 2024-05-20T22:04:09.499129+0000 mgr.y (mgr.14150) 260 : cluster 0 pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:11.782 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-20T22:04:11.926 INFO:teuthology.orchestra.run.smithi145.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-20T22:04:11.946 INFO:teuthology.orchestra.run.smithi145.stderr: stderr: 10+0 records in 2024-05-20T22:04:11.946 INFO:teuthology.orchestra.run.smithi145.stderr:10+0 records out 2024-05-20T22:04:11.946 INFO:teuthology.orchestra.run.smithi145.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0138961 s, 755 MB/s 2024-05-20T22:04:11.946 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping successful for: 2024-05-20T22:04:12.471 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi145:vg_nvme/lv_2 2024-05-20T22:04:12.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:12 smithi145 bash[23893]: cluster 2024-05-20T22:04:11.499847+0000 mgr.y (mgr.14150) 261 : cluster 0 pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-05-20T22:04:12.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:12 smithi050 bash[21866]: cluster 2024-05-20T22:04:11.499847+0000 mgr.y (mgr.14150) 261 : cluster 0 pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-05-20T22:04:12.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:12 smithi050 bash[28929]: cluster 2024-05-20T22:04:11.499847+0000 mgr.y (mgr.14150) 261 : cluster 0 pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-05-20T22:04:14.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:13 smithi050 bash[28929]: cephadm 2024-05-20T22:04:12.928415+0000 mgr.y (mgr.14150) 262 : cephadm 1 Detected new or changed devices on smithi145 2024-05-20T22:04:14.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:13 smithi050 bash[28929]: audit 2024-05-20T22:04:12.937029+0000 mon.a (mon.0) 569 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:14.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:13 smithi050 bash[28929]: audit 2024-05-20T22:04:12.945400+0000 mon.a (mon.0) 570 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:14.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:13 smithi050 bash[28929]: audit 2024-05-20T22:04:12.947496+0000 mon.a (mon.0) 571 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:04:14.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:13 smithi050 bash[28929]: audit 2024-05-20T22:04:12.949119+0000 mon.a (mon.0) 572 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:04:14.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:13 smithi050 bash[28929]: cephadm 2024-05-20T22:04:12.950624+0000 mgr.y (mgr.14150) 263 : cephadm 1 Adjusting osd_memory_target on smithi145 to 8632M 2024-05-20T22:04:14.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:13 smithi050 bash[28929]: audit 2024-05-20T22:04:12.956845+0000 mon.a (mon.0) 573 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:14.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:13 smithi050 bash[28929]: audit 2024-05-20T22:04:12.961290+0000 mon.a (mon.0) 574 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:04:14.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:13 smithi050 bash[28929]: audit 2024-05-20T22:04:12.962978+0000 mon.a (mon.0) 575 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:04:14.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:13 smithi050 bash[28929]: audit 2024-05-20T22:04:12.972427+0000 mon.a (mon.0) 576 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:14.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:13 smithi050 bash[21866]: cephadm 2024-05-20T22:04:12.928415+0000 mgr.y (mgr.14150) 262 : cephadm 1 Detected new or changed devices on smithi145 2024-05-20T22:04:14.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:13 smithi050 bash[21866]: audit 2024-05-20T22:04:12.937029+0000 mon.a (mon.0) 569 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:14.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:13 smithi050 bash[21866]: audit 2024-05-20T22:04:12.945400+0000 mon.a (mon.0) 570 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:14.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:13 smithi050 bash[21866]: audit 2024-05-20T22:04:12.947496+0000 mon.a (mon.0) 571 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:04:14.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:13 smithi050 bash[21866]: audit 2024-05-20T22:04:12.949119+0000 mon.a (mon.0) 572 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:04:14.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:13 smithi050 bash[21866]: cephadm 2024-05-20T22:04:12.950624+0000 mgr.y (mgr.14150) 263 : cephadm 1 Adjusting osd_memory_target on smithi145 to 8632M 2024-05-20T22:04:14.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:13 smithi050 bash[21866]: audit 2024-05-20T22:04:12.956845+0000 mon.a (mon.0) 573 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:14.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:13 smithi050 bash[21866]: audit 2024-05-20T22:04:12.961290+0000 mon.a (mon.0) 574 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:04:14.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:13 smithi050 bash[21866]: audit 2024-05-20T22:04:12.962978+0000 mon.a (mon.0) 575 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:04:14.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:13 smithi050 bash[21866]: audit 2024-05-20T22:04:12.972427+0000 mon.a (mon.0) 576 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:14.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:13 smithi145 bash[23893]: cephadm 2024-05-20T22:04:12.928415+0000 mgr.y (mgr.14150) 262 : cephadm 1 Detected new or changed devices on smithi145 2024-05-20T22:04:14.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:13 smithi145 bash[23893]: audit 2024-05-20T22:04:12.937029+0000 mon.a (mon.0) 569 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:14.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:13 smithi145 bash[23893]: audit 2024-05-20T22:04:12.945400+0000 mon.a (mon.0) 570 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:14.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:13 smithi145 bash[23893]: audit 2024-05-20T22:04:12.947496+0000 mon.a (mon.0) 571 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:04:14.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:13 smithi145 bash[23893]: audit 2024-05-20T22:04:12.949119+0000 mon.a (mon.0) 572 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:04:14.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:13 smithi145 bash[23893]: cephadm 2024-05-20T22:04:12.950624+0000 mgr.y (mgr.14150) 263 : cephadm 1 Adjusting osd_memory_target on smithi145 to 8632M 2024-05-20T22:04:14.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:13 smithi145 bash[23893]: audit 2024-05-20T22:04:12.956845+0000 mon.a (mon.0) 573 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:14.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:13 smithi145 bash[23893]: audit 2024-05-20T22:04:12.961290+0000 mon.a (mon.0) 574 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:04:14.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:13 smithi145 bash[23893]: audit 2024-05-20T22:04:12.962978+0000 mon.a (mon.0) 575 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:04:14.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:13 smithi145 bash[23893]: audit 2024-05-20T22:04:12.972427+0000 mon.a (mon.0) 576 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:15.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:14 smithi145 bash[23893]: cluster 2024-05-20T22:04:13.500577+0000 mgr.y (mgr.14150) 264 : cluster 0 pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-05-20T22:04:15.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:14 smithi050 bash[21866]: cluster 2024-05-20T22:04:13.500577+0000 mgr.y (mgr.14150) 264 : cluster 0 pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-05-20T22:04:15.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:14 smithi050 bash[28929]: cluster 2024-05-20T22:04:13.500577+0000 mgr.y (mgr.14150) 264 : cluster 0 pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-05-20T22:04:17.184 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T22:04:17.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:16 smithi145 bash[23893]: cluster 2024-05-20T22:04:15.501187+0000 mgr.y (mgr.14150) 265 : cluster 0 pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T22:04:17.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:16 smithi050 bash[28929]: cluster 2024-05-20T22:04:15.501187+0000 mgr.y (mgr.14150) 265 : cluster 0 pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T22:04:17.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:16 smithi050 bash[21866]: cluster 2024-05-20T22:04:15.501187+0000 mgr.y (mgr.14150) 265 : cluster 0 pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T22:04:19.279 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:18 smithi145 bash[23893]: cluster 2024-05-20T22:04:17.501841+0000 mgr.y (mgr.14150) 266 : cluster 0 pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-20T22:04:19.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b18ac0640 1 -- 172.21.15.145:0/3533722498 >> v1:172.21.15.145:6789/0 conn(0x7f0b140ffdc0 legacy=0x7f0b141001e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:04:19.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b18ac0640 1 -- 172.21.15.145:0/3533722498 shutdown_connections 2024-05-20T22:04:19.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b18ac0640 1 -- 172.21.15.145:0/3533722498 >> 172.21.15.145:0/3533722498 conn(0x7f0b140fb380 msgr2=0x7f0b140fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:04:19.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b18ac0640 1 -- 172.21.15.145:0/3533722498 shutdown_connections 2024-05-20T22:04:19.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b18ac0640 1 -- 172.21.15.145:0/3533722498 wait complete. 2024-05-20T22:04:19.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b18ac0640 1 Processor -- start 2024-05-20T22:04:19.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b18ac0640 1 -- start start 2024-05-20T22:04:19.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b18ac0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f0b14197900 con 0x7f0b140ffdc0 2024-05-20T22:04:19.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b18ac0640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f0b141a3100 con 0x7f0b14107f30 2024-05-20T22:04:19.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b18ac0640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f0b141a42e0 con 0x7f0b141041f0 2024-05-20T22:04:19.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b12d9d640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f0b14107f30 0x7f0b141a09d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:37292/0 (socket says 172.21.15.145:37292) 2024-05-20T22:04:19.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b12d9d640 1 -- 172.21.15.145:0/2920342413 learned_addr learned my addr 172.21.15.145:0/2920342413 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-05-20T22:04:19.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b037fe640 1 -- 172.21.15.145:0/2920342413 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1354122638 0 0) 0x7f0b141a3100 con 0x7f0b14107f30 2024-05-20T22:04:19.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b037fe640 1 -- 172.21.15.145:0/2920342413 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0afc004630 con 0x7f0b14107f30 2024-05-20T22:04:19.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b037fe640 1 -- 172.21.15.145:0/2920342413 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4103916513 0 0) 0x7f0afc004630 con 0x7f0b14107f30 2024-05-20T22:04:19.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b037fe640 1 -- 172.21.15.145:0/2920342413 --> v1:172.21.15.145:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0b141a3100 con 0x7f0b14107f30 2024-05-20T22:04:19.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b037fe640 1 -- 172.21.15.145:0/2920342413 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f0b0c001c70 con 0x7f0b14107f30 2024-05-20T22:04:19.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b037fe640 1 -- 172.21.15.145:0/2920342413 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3559276721 0 0) 0x7f0b14197900 con 0x7f0b140ffdc0 2024-05-20T22:04:19.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b037fe640 1 -- 172.21.15.145:0/2920342413 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0afc004630 con 0x7f0b140ffdc0 2024-05-20T22:04:19.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b037fe640 1 -- 172.21.15.145:0/2920342413 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2722378440 0 0) 0x7f0b141a42e0 con 0x7f0b141041f0 2024-05-20T22:04:19.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b037fe640 1 -- 172.21.15.145:0/2920342413 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b14197900 con 0x7f0b141041f0 2024-05-20T22:04:19.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b037fe640 1 -- 172.21.15.145:0/2920342413 <== mon.1 v1:172.21.15.145:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1316028253 0 0) 0x7f0b141a3100 con 0x7f0b14107f30 2024-05-20T22:04:19.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b037fe640 1 -- 172.21.15.145:0/2920342413 >> v1:172.21.15.50:6790/0 conn(0x7f0b141041f0 legacy=0x7f0b1419d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:04:19.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b037fe640 1 -- 172.21.15.145:0/2920342413 >> v1:172.21.15.50:6789/0 conn(0x7f0b140ffdc0 legacy=0x7f0b14196e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:04:19.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b037fe640 1 -- 172.21.15.145:0/2920342413 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b141a54c0 con 0x7f0b14107f30 2024-05-20T22:04:19.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b18ac0640 1 -- 172.21.15.145:0/2920342413 --> v1:172.21.15.145:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0b141a2150 con 0x7f0b14107f30 2024-05-20T22:04:19.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b18ac0640 1 -- 172.21.15.145:0/2920342413 --> v1:172.21.15.145:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0b141a2690 con 0x7f0b14107f30 2024-05-20T22:04:19.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b037fe640 1 -- 172.21.15.145:0/2920342413 <== mon.1 v1:172.21.15.145:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f0b0c003ea0 con 0x7f0b14107f30 2024-05-20T22:04:19.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.393+0000 7f0b037fe640 1 -- 172.21.15.145:0/2920342413 <== mon.1 v1:172.21.15.145:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f0b0c005fb0 con 0x7f0b14107f30 2024-05-20T22:04:19.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.397+0000 7f0b18ac0640 1 -- 172.21.15.145:0/2920342413 --> v1:172.21.15.145:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0af4005080 con 0x7f0b14107f30 2024-05-20T22:04:19.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.397+0000 7f0b037fe640 1 -- 172.21.15.145:0/2920342413 <== mon.1 v1:172.21.15.145:6789/0 7 ==== mgrmap(e 15) ==== 92081+0+0 (unknown 2274281742 0 0) 0x7f0b0c0039d0 con 0x7f0b14107f30 2024-05-20T22:04:19.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.397+0000 7f0b037fe640 1 -- 172.21.15.145:0/2920342413 <== mon.1 v1:172.21.15.145:6789/0 8 ==== osd_map(42..42 src has 1..42) ==== 3497+0+0 (unknown 4292169875 0 0) 0x7f0b0c088dd0 con 0x7f0b14107f30 2024-05-20T22:04:19.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.401+0000 7f0b037fe640 1 -- 172.21.15.145:0/2920342413 <== mon.1 v1:172.21.15.145:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f0b0c0570e0 con 0x7f0b14107f30 2024-05-20T22:04:19.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:18 smithi050 bash[28929]: cluster 2024-05-20T22:04:17.501841+0000 mgr.y (mgr.14150) 266 : cluster 0 pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-20T22:04:19.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:18 smithi050 bash[21866]: cluster 2024-05-20T22:04:17.501841+0000 mgr.y (mgr.14150) 266 : cluster 0 pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-20T22:04:19.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:19.597+0000 7f0b18ac0640 1 -- 172.21.15.145:0/2920342413 --> v1:172.21.15.50:6800/2944911247 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f0af4000b90 con 0x7f0afc06ec40 2024-05-20T22:04:20.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:19 smithi145 bash[23893]: audit 2024-05-20T22:04:19.613583+0000 mon.a (mon.0) 577 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:04:20.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:19 smithi145 bash[23893]: audit 2024-05-20T22:04:19.619505+0000 mon.a (mon.0) 578 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:04:20.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:19 smithi145 bash[23893]: audit 2024-05-20T22:04:19.621154+0000 mon.a (mon.0) 579 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:04:20.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:19 smithi050 bash[28929]: audit 2024-05-20T22:04:19.613583+0000 mon.a (mon.0) 577 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:04:20.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:19 smithi050 bash[28929]: audit 2024-05-20T22:04:19.619505+0000 mon.a (mon.0) 578 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:04:20.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:19 smithi050 bash[28929]: audit 2024-05-20T22:04:19.621154+0000 mon.a (mon.0) 579 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:04:20.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:19 smithi050 bash[21866]: audit 2024-05-20T22:04:19.613583+0000 mon.a (mon.0) 577 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:04:20.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:19 smithi050 bash[21866]: audit 2024-05-20T22:04:19.619505+0000 mon.a (mon.0) 578 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:04:20.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:19 smithi050 bash[21866]: audit 2024-05-20T22:04:19.621154+0000 mon.a (mon.0) 579 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:04:21.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:20 smithi145 bash[23893]: cluster 2024-05-20T22:04:19.502508+0000 mgr.y (mgr.14150) 267 : cluster 0 pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:21.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:20 smithi145 bash[23893]: audit 2024-05-20T22:04:19.606957+0000 mgr.y (mgr.14150) 268 : audit 0 from='client.24292 v1:172.21.15.145:0/2920342413' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:04:21.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:20 smithi050 bash[28929]: cluster 2024-05-20T22:04:19.502508+0000 mgr.y (mgr.14150) 267 : cluster 0 pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:21.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:20 smithi050 bash[28929]: audit 2024-05-20T22:04:19.606957+0000 mgr.y (mgr.14150) 268 : audit 0 from='client.24292 v1:172.21.15.145:0/2920342413' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:04:21.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:20 smithi050 bash[21866]: cluster 2024-05-20T22:04:19.502508+0000 mgr.y (mgr.14150) 267 : cluster 0 pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:21.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:20 smithi050 bash[21866]: audit 2024-05-20T22:04:19.606957+0000 mgr.y (mgr.14150) 268 : audit 0 from='client.24292 v1:172.21.15.145:0/2920342413' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:04:23.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:22 smithi145 bash[23893]: cluster 2024-05-20T22:04:21.503061+0000 mgr.y (mgr.14150) 269 : cluster 0 pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:23.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:22 smithi050 bash[28929]: cluster 2024-05-20T22:04:21.503061+0000 mgr.y (mgr.14150) 269 : cluster 0 pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:23.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:22 smithi050 bash[21866]: cluster 2024-05-20T22:04:21.503061+0000 mgr.y (mgr.14150) 269 : cluster 0 pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:25.293 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:24 smithi145 bash[23893]: cluster 2024-05-20T22:04:23.503611+0000 mgr.y (mgr.14150) 270 : cluster 0 pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:25.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:24 smithi050 bash[28929]: cluster 2024-05-20T22:04:23.503611+0000 mgr.y (mgr.14150) 270 : cluster 0 pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:25.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:24 smithi050 bash[21866]: cluster 2024-05-20T22:04:23.503611+0000 mgr.y (mgr.14150) 270 : cluster 0 pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:27.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:27 smithi145 bash[23893]: cluster 2024-05-20T22:04:25.504184+0000 mgr.y (mgr.14150) 271 : cluster 0 pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:27.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:27 smithi050 bash[28929]: cluster 2024-05-20T22:04:25.504184+0000 mgr.y (mgr.14150) 271 : cluster 0 pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:27.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:27 smithi050 bash[21866]: cluster 2024-05-20T22:04:25.504184+0000 mgr.y (mgr.14150) 271 : cluster 0 pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:28.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:28 smithi145 bash[23893]: audit 2024-05-20T22:04:27.480080+0000 mon.b (mon.1) 18 : audit 1 from='client.? v1:172.21.15.145:0/3655372773' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb87446a-56f6-4a73-813b-ce70360ae5f4"}]: dispatch 2024-05-20T22:04:28.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:28 smithi145 bash[23893]: audit 2024-05-20T22:04:27.481667+0000 mon.a (mon.0) 580 : audit 1 from='client.24298 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb87446a-56f6-4a73-813b-ce70360ae5f4"}]: dispatch 2024-05-20T22:04:28.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:28 smithi145 bash[23893]: audit 2024-05-20T22:04:27.485223+0000 mon.a (mon.0) 581 : audit 1 from='client.24298 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb87446a-56f6-4a73-813b-ce70360ae5f4"}]': finished 2024-05-20T22:04:28.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:28 smithi145 bash[23893]: cluster 2024-05-20T22:04:27.490787+0000 mon.a (mon.0) 582 : cluster 0 osdmap e43: 7 total, 6 up, 7 in 2024-05-20T22:04:28.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:28 smithi145 bash[23893]: audit 2024-05-20T22:04:27.491236+0000 mon.a (mon.0) 583 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T22:04:28.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:28 smithi050 bash[21866]: audit 2024-05-20T22:04:27.480080+0000 mon.b (mon.1) 18 : audit 1 from='client.? v1:172.21.15.145:0/3655372773' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb87446a-56f6-4a73-813b-ce70360ae5f4"}]: dispatch 2024-05-20T22:04:28.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:28 smithi050 bash[21866]: audit 2024-05-20T22:04:27.481667+0000 mon.a (mon.0) 580 : audit 1 from='client.24298 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb87446a-56f6-4a73-813b-ce70360ae5f4"}]: dispatch 2024-05-20T22:04:28.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:28 smithi050 bash[21866]: audit 2024-05-20T22:04:27.485223+0000 mon.a (mon.0) 581 : audit 1 from='client.24298 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb87446a-56f6-4a73-813b-ce70360ae5f4"}]': finished 2024-05-20T22:04:28.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:28 smithi050 bash[21866]: cluster 2024-05-20T22:04:27.490787+0000 mon.a (mon.0) 582 : cluster 0 osdmap e43: 7 total, 6 up, 7 in 2024-05-20T22:04:28.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:28 smithi050 bash[21866]: audit 2024-05-20T22:04:27.491236+0000 mon.a (mon.0) 583 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T22:04:28.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:28 smithi050 bash[28929]: audit 2024-05-20T22:04:27.480080+0000 mon.b (mon.1) 18 : audit 1 from='client.? v1:172.21.15.145:0/3655372773' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb87446a-56f6-4a73-813b-ce70360ae5f4"}]: dispatch 2024-05-20T22:04:28.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:28 smithi050 bash[28929]: audit 2024-05-20T22:04:27.481667+0000 mon.a (mon.0) 580 : audit 1 from='client.24298 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb87446a-56f6-4a73-813b-ce70360ae5f4"}]: dispatch 2024-05-20T22:04:28.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:28 smithi050 bash[28929]: audit 2024-05-20T22:04:27.485223+0000 mon.a (mon.0) 581 : audit 1 from='client.24298 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb87446a-56f6-4a73-813b-ce70360ae5f4"}]': finished 2024-05-20T22:04:28.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:28 smithi050 bash[28929]: cluster 2024-05-20T22:04:27.490787+0000 mon.a (mon.0) 582 : cluster 0 osdmap e43: 7 total, 6 up, 7 in 2024-05-20T22:04:28.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:28 smithi050 bash[28929]: audit 2024-05-20T22:04:27.491236+0000 mon.a (mon.0) 583 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T22:04:29.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:29 smithi145 bash[23893]: cluster 2024-05-20T22:04:27.504692+0000 mgr.y (mgr.14150) 272 : cluster 0 pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:29.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:29 smithi145 bash[23893]: audit 2024-05-20T22:04:28.158148+0000 mon.b (mon.1) 19 : audit 0 from='client.? v1:172.21.15.145:0/3670261831' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:04:29.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:29 smithi050 bash[21866]: cluster 2024-05-20T22:04:27.504692+0000 mgr.y (mgr.14150) 272 : cluster 0 pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:29.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:29 smithi050 bash[21866]: audit 2024-05-20T22:04:28.158148+0000 mon.b (mon.1) 19 : audit 0 from='client.? v1:172.21.15.145:0/3670261831' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:04:29.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:29 smithi050 bash[28929]: cluster 2024-05-20T22:04:27.504692+0000 mgr.y (mgr.14150) 272 : cluster 0 pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:29.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:29 smithi050 bash[28929]: audit 2024-05-20T22:04:28.158148+0000 mon.b (mon.1) 19 : audit 0 from='client.? v1:172.21.15.145:0/3670261831' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:04:31.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:31 smithi145 bash[23893]: cluster 2024-05-20T22:04:29.505192+0000 mgr.y (mgr.14150) 273 : cluster 0 pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:31.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:31 smithi050 bash[21866]: cluster 2024-05-20T22:04:29.505192+0000 mgr.y (mgr.14150) 273 : cluster 0 pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:31.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:31 smithi050 bash[28929]: cluster 2024-05-20T22:04:29.505192+0000 mgr.y (mgr.14150) 273 : cluster 0 pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:33.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:33 smithi145 bash[23893]: cluster 2024-05-20T22:04:31.505727+0000 mgr.y (mgr.14150) 274 : cluster 0 pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:33.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:33 smithi050 bash[28929]: cluster 2024-05-20T22:04:31.505727+0000 mgr.y (mgr.14150) 274 : cluster 0 pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:33.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:33 smithi050 bash[21866]: cluster 2024-05-20T22:04:31.505727+0000 mgr.y (mgr.14150) 274 : cluster 0 pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:35.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:35 smithi145 bash[23893]: cluster 2024-05-20T22:04:33.506419+0000 mgr.y (mgr.14150) 275 : cluster 0 pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:35.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:35 smithi050 bash[28929]: cluster 2024-05-20T22:04:33.506419+0000 mgr.y (mgr.14150) 275 : cluster 0 pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:35.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:35 smithi050 bash[21866]: cluster 2024-05-20T22:04:33.506419+0000 mgr.y (mgr.14150) 275 : cluster 0 pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:37.300 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:37 smithi145 bash[23893]: cluster 2024-05-20T22:04:35.507135+0000 mgr.y (mgr.14150) 276 : cluster 0 pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:37.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:37 smithi050 bash[21866]: cluster 2024-05-20T22:04:35.507135+0000 mgr.y (mgr.14150) 276 : cluster 0 pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:37.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:37 smithi050 bash[28929]: cluster 2024-05-20T22:04:35.507135+0000 mgr.y (mgr.14150) 276 : cluster 0 pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:39.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:39 smithi145 bash[23893]: cluster 2024-05-20T22:04:37.507835+0000 mgr.y (mgr.14150) 277 : cluster 0 pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:39.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:39 smithi050 bash[21866]: cluster 2024-05-20T22:04:37.507835+0000 mgr.y (mgr.14150) 277 : cluster 0 pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:39.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:39 smithi050 bash[28929]: cluster 2024-05-20T22:04:37.507835+0000 mgr.y (mgr.14150) 277 : cluster 0 pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:40.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:40 smithi145 bash[23893]: audit 2024-05-20T22:04:39.326801+0000 mon.a (mon.0) 584 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-20T22:04:40.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:40 smithi145 bash[23893]: audit 2024-05-20T22:04:39.328494+0000 mon.a (mon.0) 585 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:04:40.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:40 smithi050 bash[21866]: audit 2024-05-20T22:04:39.326801+0000 mon.a (mon.0) 584 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-20T22:04:40.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:40 smithi050 bash[21866]: audit 2024-05-20T22:04:39.328494+0000 mon.a (mon.0) 585 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:04:40.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:40 smithi050 bash[28929]: audit 2024-05-20T22:04:39.326801+0000 mon.a (mon.0) 584 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-20T22:04:40.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:40 smithi050 bash[28929]: audit 2024-05-20T22:04:39.328494+0000 mon.a (mon.0) 585 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:04:41.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:41 smithi145 bash[23893]: cephadm 2024-05-20T22:04:39.329886+0000 mgr.y (mgr.14150) 278 : cephadm 1 Deploying daemon osd.6 on smithi145 2024-05-20T22:04:41.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:41 smithi145 bash[23893]: cluster 2024-05-20T22:04:39.508497+0000 mgr.y (mgr.14150) 279 : cluster 0 pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:41.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:41 smithi050 bash[21866]: cephadm 2024-05-20T22:04:39.329886+0000 mgr.y (mgr.14150) 278 : cephadm 1 Deploying daemon osd.6 on smithi145 2024-05-20T22:04:41.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:41 smithi050 bash[21866]: cluster 2024-05-20T22:04:39.508497+0000 mgr.y (mgr.14150) 279 : cluster 0 pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:41.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:41 smithi050 bash[28929]: cephadm 2024-05-20T22:04:39.329886+0000 mgr.y (mgr.14150) 278 : cephadm 1 Deploying daemon osd.6 on smithi145 2024-05-20T22:04:41.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:41 smithi050 bash[28929]: cluster 2024-05-20T22:04:39.508497+0000 mgr.y (mgr.14150) 279 : cluster 0 pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:43.099 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:04:43 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:04:43.100 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:04:43 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:04:43.100 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:04:43 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:04:43.100 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:43 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:04:43.100 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:43 smithi145 bash[23893]: cluster 2024-05-20T22:04:41.509102+0000 mgr.y (mgr.14150) 280 : cluster 0 pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:43.370 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:43 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:04:43.371 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:04:43 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:04:43.371 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:04:43 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:04:43.371 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:04:43 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:04:43.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:43 smithi050 bash[21866]: cluster 2024-05-20T22:04:41.509102+0000 mgr.y (mgr.14150) 280 : cluster 0 pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:43.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:43 smithi050 bash[28929]: cluster 2024-05-20T22:04:41.509102+0000 mgr.y (mgr.14150) 280 : cluster 0 pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:44.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:44 smithi145 bash[23893]: audit 2024-05-20T22:04:43.372800+0000 mon.a (mon.0) 586 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:04:44.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:44 smithi145 bash[23893]: audit 2024-05-20T22:04:43.380391+0000 mon.a (mon.0) 587 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:44.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:44 smithi145 bash[23893]: audit 2024-05-20T22:04:43.388514+0000 mon.a (mon.0) 588 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:44.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:44 smithi050 bash[21866]: audit 2024-05-20T22:04:43.372800+0000 mon.a (mon.0) 586 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:04:44.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:44 smithi050 bash[21866]: audit 2024-05-20T22:04:43.380391+0000 mon.a (mon.0) 587 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:44.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:44 smithi050 bash[21866]: audit 2024-05-20T22:04:43.388514+0000 mon.a (mon.0) 588 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:44.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:44 smithi050 bash[28929]: audit 2024-05-20T22:04:43.372800+0000 mon.a (mon.0) 586 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:04:44.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:44 smithi050 bash[28929]: audit 2024-05-20T22:04:43.380391+0000 mon.a (mon.0) 587 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:44.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:44 smithi050 bash[28929]: audit 2024-05-20T22:04:43.388514+0000 mon.a (mon.0) 588 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:45.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:45 smithi145 bash[23893]: cluster 2024-05-20T22:04:43.509634+0000 mgr.y (mgr.14150) 281 : cluster 0 pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:45.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:45 smithi050 bash[21866]: cluster 2024-05-20T22:04:43.509634+0000 mgr.y (mgr.14150) 281 : cluster 0 pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:45.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:45 smithi050 bash[28929]: cluster 2024-05-20T22:04:43.509634+0000 mgr.y (mgr.14150) 281 : cluster 0 pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:47.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:47 smithi145 bash[23893]: cluster 2024-05-20T22:04:45.510164+0000 mgr.y (mgr.14150) 282 : cluster 0 pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:47.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:47 smithi050 bash[21866]: cluster 2024-05-20T22:04:45.510164+0000 mgr.y (mgr.14150) 282 : cluster 0 pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:47.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:47 smithi050 bash[28929]: cluster 2024-05-20T22:04:45.510164+0000 mgr.y (mgr.14150) 282 : cluster 0 pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:49.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:49 smithi145 bash[23893]: cluster 2024-05-20T22:04:47.510724+0000 mgr.y (mgr.14150) 283 : cluster 0 pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:49.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:49 smithi050 bash[21866]: cluster 2024-05-20T22:04:47.510724+0000 mgr.y (mgr.14150) 283 : cluster 0 pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:49.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:49 smithi050 bash[28929]: cluster 2024-05-20T22:04:47.510724+0000 mgr.y (mgr.14150) 283 : cluster 0 pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:50.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:50 smithi145 bash[23893]: audit 2024-05-20T22:04:49.433994+0000 mon.b (mon.1) 20 : audit 1 from='osd.6 v1:172.21.15.145:6808/856530538' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-20T22:04:50.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:50 smithi145 bash[23893]: audit 2024-05-20T22:04:49.435403+0000 mon.a (mon.0) 589 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-20T22:04:50.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:50 smithi050 bash[21866]: audit 2024-05-20T22:04:49.433994+0000 mon.b (mon.1) 20 : audit 1 from='osd.6 v1:172.21.15.145:6808/856530538' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-20T22:04:50.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:50 smithi050 bash[21866]: audit 2024-05-20T22:04:49.435403+0000 mon.a (mon.0) 589 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-20T22:04:50.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:50 smithi050 bash[28929]: audit 2024-05-20T22:04:49.433994+0000 mon.b (mon.1) 20 : audit 1 from='osd.6 v1:172.21.15.145:6808/856530538' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-20T22:04:50.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:50 smithi050 bash[28929]: audit 2024-05-20T22:04:49.435403+0000 mon.a (mon.0) 589 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-20T22:04:51.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:51 smithi145 bash[23893]: cluster 2024-05-20T22:04:49.511305+0000 mgr.y (mgr.14150) 284 : cluster 0 pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:51.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:51 smithi145 bash[23893]: audit 2024-05-20T22:04:50.059475+0000 mon.a (mon.0) 590 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-20T22:04:51.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:51 smithi145 bash[23893]: audit 2024-05-20T22:04:50.061324+0000 mon.b (mon.1) 21 : audit 1 from='osd.6 v1:172.21.15.145:6808/856530538' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:04:51.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:51 smithi145 bash[23893]: cluster 2024-05-20T22:04:50.065223+0000 mon.a (mon.0) 591 : cluster 0 osdmap e44: 7 total, 6 up, 7 in 2024-05-20T22:04:51.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:51 smithi145 bash[23893]: audit 2024-05-20T22:04:50.065754+0000 mon.a (mon.0) 592 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T22:04:51.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:51 smithi145 bash[23893]: audit 2024-05-20T22:04:50.066525+0000 mon.a (mon.0) 593 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:04:51.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:51 smithi145 bash[23893]: audit 2024-05-20T22:04:50.074434+0000 mon.a (mon.0) 594 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:51.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:51 smithi145 bash[23893]: audit 2024-05-20T22:04:50.083196+0000 mon.a (mon.0) 595 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:51.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:51 smithi145 bash[23893]: audit 2024-05-20T22:04:50.726101+0000 mon.a (mon.0) 596 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:04:51.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:51 smithi145 bash[23893]: audit 2024-05-20T22:04:50.727748+0000 mon.a (mon.0) 597 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:04:51.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:51 smithi145 bash[23893]: audit 2024-05-20T22:04:50.737632+0000 mon.a (mon.0) 598 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:51.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:51 smithi050 bash[21866]: cluster 2024-05-20T22:04:49.511305+0000 mgr.y (mgr.14150) 284 : cluster 0 pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:51.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:51 smithi050 bash[21866]: audit 2024-05-20T22:04:50.059475+0000 mon.a (mon.0) 590 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-20T22:04:51.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:51 smithi050 bash[21866]: audit 2024-05-20T22:04:50.061324+0000 mon.b (mon.1) 21 : audit 1 from='osd.6 v1:172.21.15.145:6808/856530538' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:04:51.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:51 smithi050 bash[21866]: cluster 2024-05-20T22:04:50.065223+0000 mon.a (mon.0) 591 : cluster 0 osdmap e44: 7 total, 6 up, 7 in 2024-05-20T22:04:51.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:51 smithi050 bash[21866]: audit 2024-05-20T22:04:50.065754+0000 mon.a (mon.0) 592 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T22:04:51.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:51 smithi050 bash[21866]: audit 2024-05-20T22:04:50.066525+0000 mon.a (mon.0) 593 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:04:51.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:51 smithi050 bash[21866]: audit 2024-05-20T22:04:50.074434+0000 mon.a (mon.0) 594 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:51.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:51 smithi050 bash[21866]: audit 2024-05-20T22:04:50.083196+0000 mon.a (mon.0) 595 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:51.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:51 smithi050 bash[21866]: audit 2024-05-20T22:04:50.726101+0000 mon.a (mon.0) 596 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:04:51.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:51 smithi050 bash[21866]: audit 2024-05-20T22:04:50.727748+0000 mon.a (mon.0) 597 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:04:51.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:51 smithi050 bash[21866]: audit 2024-05-20T22:04:50.737632+0000 mon.a (mon.0) 598 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:51.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:51 smithi050 bash[28929]: cluster 2024-05-20T22:04:49.511305+0000 mgr.y (mgr.14150) 284 : cluster 0 pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:51.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:51 smithi050 bash[28929]: audit 2024-05-20T22:04:50.059475+0000 mon.a (mon.0) 590 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-20T22:04:51.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:51 smithi050 bash[28929]: audit 2024-05-20T22:04:50.061324+0000 mon.b (mon.1) 21 : audit 1 from='osd.6 v1:172.21.15.145:6808/856530538' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:04:51.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:51 smithi050 bash[28929]: cluster 2024-05-20T22:04:50.065223+0000 mon.a (mon.0) 591 : cluster 0 osdmap e44: 7 total, 6 up, 7 in 2024-05-20T22:04:51.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:51 smithi050 bash[28929]: audit 2024-05-20T22:04:50.065754+0000 mon.a (mon.0) 592 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T22:04:51.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:51 smithi050 bash[28929]: audit 2024-05-20T22:04:50.066525+0000 mon.a (mon.0) 593 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:04:51.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:51 smithi050 bash[28929]: audit 2024-05-20T22:04:50.074434+0000 mon.a (mon.0) 594 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:51.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:51 smithi050 bash[28929]: audit 2024-05-20T22:04:50.083196+0000 mon.a (mon.0) 595 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:51.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:51 smithi050 bash[28929]: audit 2024-05-20T22:04:50.726101+0000 mon.a (mon.0) 596 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:04:51.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:51 smithi050 bash[28929]: audit 2024-05-20T22:04:50.727748+0000 mon.a (mon.0) 597 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:04:51.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:51 smithi050 bash[28929]: audit 2024-05-20T22:04:50.737632+0000 mon.a (mon.0) 598 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:52.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:52 smithi145 bash[23893]: audit 2024-05-20T22:04:51.062135+0000 mon.a (mon.0) 599 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-05-20T22:04:52.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:52 smithi145 bash[23893]: cluster 2024-05-20T22:04:51.067738+0000 mon.a (mon.0) 600 : cluster 0 osdmap e45: 7 total, 6 up, 7 in 2024-05-20T22:04:52.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:52 smithi145 bash[23893]: audit 2024-05-20T22:04:51.070425+0000 mon.a (mon.0) 601 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T22:04:52.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:52 smithi145 bash[23893]: audit 2024-05-20T22:04:51.082531+0000 mon.a (mon.0) 602 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T22:04:52.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:52 smithi145 bash[23893]: cluster 2024-05-20T22:04:52.070428+0000 mon.a (mon.0) 603 : cluster 1 osd.6 v1:172.21.15.145:6808/856530538 boot 2024-05-20T22:04:52.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:52 smithi145 bash[23893]: cluster 2024-05-20T22:04:52.070534+0000 mon.a (mon.0) 604 : cluster 0 osdmap e46: 7 total, 7 up, 7 in 2024-05-20T22:04:52.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:52 smithi145 bash[23893]: audit 2024-05-20T22:04:52.070920+0000 mon.a (mon.0) 605 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T22:04:52.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:52 smithi050 bash[21866]: audit 2024-05-20T22:04:51.062135+0000 mon.a (mon.0) 599 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-05-20T22:04:52.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:52 smithi050 bash[21866]: cluster 2024-05-20T22:04:51.067738+0000 mon.a (mon.0) 600 : cluster 0 osdmap e45: 7 total, 6 up, 7 in 2024-05-20T22:04:52.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:52 smithi050 bash[21866]: audit 2024-05-20T22:04:51.070425+0000 mon.a (mon.0) 601 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T22:04:52.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:52 smithi050 bash[21866]: audit 2024-05-20T22:04:51.082531+0000 mon.a (mon.0) 602 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T22:04:52.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:52 smithi050 bash[21866]: cluster 2024-05-20T22:04:52.070428+0000 mon.a (mon.0) 603 : cluster 1 osd.6 v1:172.21.15.145:6808/856530538 boot 2024-05-20T22:04:52.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:52 smithi050 bash[21866]: cluster 2024-05-20T22:04:52.070534+0000 mon.a (mon.0) 604 : cluster 0 osdmap e46: 7 total, 7 up, 7 in 2024-05-20T22:04:52.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:52 smithi050 bash[21866]: audit 2024-05-20T22:04:52.070920+0000 mon.a (mon.0) 605 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T22:04:52.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:52 smithi050 bash[28929]: audit 2024-05-20T22:04:51.062135+0000 mon.a (mon.0) 599 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-05-20T22:04:52.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:52 smithi050 bash[28929]: cluster 2024-05-20T22:04:51.067738+0000 mon.a (mon.0) 600 : cluster 0 osdmap e45: 7 total, 6 up, 7 in 2024-05-20T22:04:52.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:52 smithi050 bash[28929]: audit 2024-05-20T22:04:51.070425+0000 mon.a (mon.0) 601 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T22:04:52.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:52 smithi050 bash[28929]: audit 2024-05-20T22:04:51.082531+0000 mon.a (mon.0) 602 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T22:04:52.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:52 smithi050 bash[28929]: cluster 2024-05-20T22:04:52.070428+0000 mon.a (mon.0) 603 : cluster 1 osd.6 v1:172.21.15.145:6808/856530538 boot 2024-05-20T22:04:52.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:52 smithi050 bash[28929]: cluster 2024-05-20T22:04:52.070534+0000 mon.a (mon.0) 604 : cluster 0 osdmap e46: 7 total, 7 up, 7 in 2024-05-20T22:04:52.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:52 smithi050 bash[28929]: audit 2024-05-20T22:04:52.070920+0000 mon.a (mon.0) 605 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T22:04:53.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:53.120+0000 7f0b037fe640 1 -- 172.21.15.145:0/2920342413 <== mgr.14150 v1:172.21.15.50:6800/2944911247 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (unknown 0 0 2846727683) 0x7f0af4000b90 con 0x7f0afc06ec40 2024-05-20T22:04:53.119 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 6 on host 'smithi145' 2024-05-20T22:04:53.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:53.124+0000 7f0b18ac0640 1 -- 172.21.15.145:0/2920342413 >> v1:172.21.15.50:6800/2944911247 conn(0x7f0afc06ec40 legacy=0x7f0afc071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:04:53.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:53.124+0000 7f0b18ac0640 1 -- 172.21.15.145:0/2920342413 >> v1:172.21.15.145:6789/0 conn(0x7f0b14107f30 legacy=0x7f0b141a09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:04:53.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:53.124+0000 7f0b18ac0640 1 -- 172.21.15.145:0/2920342413 shutdown_connections 2024-05-20T22:04:53.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:53.124+0000 7f0b18ac0640 1 -- 172.21.15.145:0/2920342413 >> 172.21.15.145:0/2920342413 conn(0x7f0b140fb380 msgr2=0x7f0b14106e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:04:53.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:53.124+0000 7f0b18ac0640 1 -- 172.21.15.145:0/2920342413 shutdown_connections 2024-05-20T22:04:53.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:04:53.124+0000 7f0b18ac0640 1 -- 172.21.15.145:0/2920342413 wait complete. 2024-05-20T22:04:53.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:53 smithi145 bash[23893]: cluster 2024-05-20T22:04:50.387994+0000 osd.6 (osd.6) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:04:53.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:53 smithi145 bash[23893]: cluster 2024-05-20T22:04:50.388084+0000 osd.6 (osd.6) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:04:53.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:53 smithi145 bash[23893]: cluster 2024-05-20T22:04:51.511882+0000 mgr.y (mgr.14150) 285 : cluster 0 pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:53.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:53 smithi145 bash[23893]: cluster 2024-05-20T22:04:53.072089+0000 mon.a (mon.0) 606 : cluster 0 osdmap e47: 7 total, 7 up, 7 in 2024-05-20T22:04:53.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:53 smithi050 bash[21866]: cluster 2024-05-20T22:04:50.387994+0000 osd.6 (osd.6) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:04:53.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:53 smithi050 bash[21866]: cluster 2024-05-20T22:04:50.388084+0000 osd.6 (osd.6) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:04:53.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:53 smithi050 bash[21866]: cluster 2024-05-20T22:04:51.511882+0000 mgr.y (mgr.14150) 285 : cluster 0 pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:53.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:53 smithi050 bash[21866]: cluster 2024-05-20T22:04:53.072089+0000 mon.a (mon.0) 606 : cluster 0 osdmap e47: 7 total, 7 up, 7 in 2024-05-20T22:04:53.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:53 smithi050 bash[28929]: cluster 2024-05-20T22:04:50.387994+0000 osd.6 (osd.6) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:04:53.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:53 smithi050 bash[28929]: cluster 2024-05-20T22:04:50.388084+0000 osd.6 (osd.6) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:04:53.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:53 smithi050 bash[28929]: cluster 2024-05-20T22:04:51.511882+0000 mgr.y (mgr.14150) 285 : cluster 0 pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-20T22:04:53.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:53 smithi050 bash[28929]: cluster 2024-05-20T22:04:53.072089+0000 mon.a (mon.0) 606 : cluster 0 osdmap e47: 7 total, 7 up, 7 in 2024-05-20T22:04:53.682 DEBUG:teuthology.orchestra.run.smithi145:osd.6> sudo journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.6.service 2024-05-20T22:04:53.685 INFO:tasks.cephadm:Deploying osd.7 on smithi145 with /dev/vg_nvme/lv_1... 2024-05-20T22:04:53.685 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-20T22:04:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:54 smithi145 bash[23893]: audit 2024-05-20T22:04:53.102574+0000 mon.a (mon.0) 607 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:04:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:54 smithi145 bash[23893]: audit 2024-05-20T22:04:53.110292+0000 mon.a (mon.0) 608 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:54 smithi145 bash[23893]: audit 2024-05-20T22:04:53.118487+0000 mon.a (mon.0) 609 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:54 smithi145 bash[23893]: cluster 2024-05-20T22:04:54.074697+0000 mon.a (mon.0) 610 : cluster 0 osdmap e48: 7 total, 7 up, 7 in 2024-05-20T22:04:54.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:54 smithi050 bash[21866]: audit 2024-05-20T22:04:53.102574+0000 mon.a (mon.0) 607 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:04:54.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:54 smithi050 bash[21866]: audit 2024-05-20T22:04:53.110292+0000 mon.a (mon.0) 608 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:54.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:54 smithi050 bash[21866]: audit 2024-05-20T22:04:53.118487+0000 mon.a (mon.0) 609 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:54.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:54 smithi050 bash[21866]: cluster 2024-05-20T22:04:54.074697+0000 mon.a (mon.0) 610 : cluster 0 osdmap e48: 7 total, 7 up, 7 in 2024-05-20T22:04:54.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:54 smithi050 bash[28929]: audit 2024-05-20T22:04:53.102574+0000 mon.a (mon.0) 607 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:04:54.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:54 smithi050 bash[28929]: audit 2024-05-20T22:04:53.110292+0000 mon.a (mon.0) 608 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:54.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:54 smithi050 bash[28929]: audit 2024-05-20T22:04:53.118487+0000 mon.a (mon.0) 609 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:04:54.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:54 smithi050 bash[28929]: cluster 2024-05-20T22:04:54.074697+0000 mon.a (mon.0) 610 : cluster 0 osdmap e48: 7 total, 7 up, 7 in 2024-05-20T22:04:55.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:55 smithi145 bash[23893]: cluster 2024-05-20T22:04:53.512554+0000 mgr.y (mgr.14150) 286 : cluster 0 pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:04:55.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:55 smithi050 bash[21866]: cluster 2024-05-20T22:04:53.512554+0000 mgr.y (mgr.14150) 286 : cluster 0 pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:04:55.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:55 smithi050 bash[28929]: cluster 2024-05-20T22:04:53.512554+0000 mgr.y (mgr.14150) 286 : cluster 0 pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:04:56.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:56 smithi145 bash[23893]: cluster 2024-05-20T22:04:55.131139+0000 mon.a (mon.0) 611 : cluster 0 osdmap e49: 7 total, 7 up, 7 in 2024-05-20T22:04:56.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:56 smithi050 bash[28929]: cluster 2024-05-20T22:04:55.131139+0000 mon.a (mon.0) 611 : cluster 0 osdmap e49: 7 total, 7 up, 7 in 2024-05-20T22:04:56.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:56 smithi050 bash[21866]: cluster 2024-05-20T22:04:55.131139+0000 mon.a (mon.0) 611 : cluster 0 osdmap e49: 7 total, 7 up, 7 in 2024-05-20T22:04:57.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:57 smithi145 bash[23893]: cluster 2024-05-20T22:04:55.513150+0000 mgr.y (mgr.14150) 287 : cluster 0 pgmap v268: 1 pgs: 1 remapped+peering; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:04:57.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:57 smithi145 bash[23893]: cluster 2024-05-20T22:04:56.140839+0000 mon.a (mon.0) 612 : cluster 0 osdmap e50: 7 total, 7 up, 7 in 2024-05-20T22:04:57.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:57 smithi050 bash[28929]: cluster 2024-05-20T22:04:55.513150+0000 mgr.y (mgr.14150) 287 : cluster 0 pgmap v268: 1 pgs: 1 remapped+peering; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:04:57.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:57 smithi050 bash[28929]: cluster 2024-05-20T22:04:56.140839+0000 mon.a (mon.0) 612 : cluster 0 osdmap e50: 7 total, 7 up, 7 in 2024-05-20T22:04:57.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:57 smithi050 bash[21866]: cluster 2024-05-20T22:04:55.513150+0000 mgr.y (mgr.14150) 287 : cluster 0 pgmap v268: 1 pgs: 1 remapped+peering; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:04:57.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:57 smithi050 bash[21866]: cluster 2024-05-20T22:04:56.140839+0000 mon.a (mon.0) 612 : cluster 0 osdmap e50: 7 total, 7 up, 7 in 2024-05-20T22:04:58.089 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T22:04:59.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:04:59 smithi145 bash[23893]: cluster 2024-05-20T22:04:57.513772+0000 mgr.y (mgr.14150) 288 : cluster 0 pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-05-20T22:04:59.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:04:59 smithi050 bash[21866]: cluster 2024-05-20T22:04:57.513772+0000 mgr.y (mgr.14150) 288 : cluster 0 pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-05-20T22:04:59.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:04:59 smithi050 bash[28929]: cluster 2024-05-20T22:04:57.513772+0000 mgr.y (mgr.14150) 288 : cluster 0 pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-05-20T22:05:01.321 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:01 smithi145 bash[23893]: cluster 2024-05-20T22:04:59.514378+0000 mgr.y (mgr.14150) 289 : cluster 0 pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-20T22:05:01.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:01 smithi050 bash[28929]: cluster 2024-05-20T22:04:59.514378+0000 mgr.y (mgr.14150) 289 : cluster 0 pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-20T22:05:01.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:01 smithi050 bash[21866]: cluster 2024-05-20T22:04:59.514378+0000 mgr.y (mgr.14150) 289 : cluster 0 pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-20T22:05:01.749 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-20T22:05:01.937 INFO:teuthology.orchestra.run.smithi145.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-20T22:05:01.953 INFO:teuthology.orchestra.run.smithi145.stderr: stderr: 10+0 records in 2024-05-20T22:05:01.953 INFO:teuthology.orchestra.run.smithi145.stderr:10+0 records out 2024-05-20T22:05:01.954 INFO:teuthology.orchestra.run.smithi145.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0148614 s, 706 MB/s 2024-05-20T22:05:01.954 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping successful for: 2024-05-20T22:05:02.723 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi145:vg_nvme/lv_1 2024-05-20T22:05:03.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:03 smithi050 bash[21866]: cluster 2024-05-20T22:05:01.514981+0000 mgr.y (mgr.14150) 290 : cluster 0 pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-05-20T22:05:03.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:03 smithi050 bash[21866]: audit 2024-05-20T22:05:03.023558+0000 mon.a (mon.0) 613 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:03.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:03 smithi050 bash[21866]: audit 2024-05-20T22:05:03.032297+0000 mon.a (mon.0) 614 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:03.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:03 smithi050 bash[21866]: audit 2024-05-20T22:05:03.034297+0000 mon.a (mon.0) 615 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:03.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:03 smithi050 bash[21866]: audit 2024-05-20T22:05:03.036044+0000 mon.a (mon.0) 616 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:03.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:03 smithi050 bash[21866]: audit 2024-05-20T22:05:03.037734+0000 mon.a (mon.0) 617 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:03.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:03 smithi050 bash[21866]: audit 2024-05-20T22:05:03.045385+0000 mon.a (mon.0) 618 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:03.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:03 smithi050 bash[21866]: audit 2024-05-20T22:05:03.049804+0000 mon.a (mon.0) 619 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:05:03.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:03 smithi050 bash[21866]: audit 2024-05-20T22:05:03.051458+0000 mon.a (mon.0) 620 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:05:03.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:03 smithi050 bash[21866]: audit 2024-05-20T22:05:03.061105+0000 mon.a (mon.0) 621 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:03.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:03 smithi050 bash[28929]: cluster 2024-05-20T22:05:01.514981+0000 mgr.y (mgr.14150) 290 : cluster 0 pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-05-20T22:05:03.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:03 smithi050 bash[28929]: audit 2024-05-20T22:05:03.023558+0000 mon.a (mon.0) 613 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:03.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:03 smithi050 bash[28929]: audit 2024-05-20T22:05:03.032297+0000 mon.a (mon.0) 614 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:03.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:03 smithi050 bash[28929]: audit 2024-05-20T22:05:03.034297+0000 mon.a (mon.0) 615 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:03.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:03 smithi050 bash[28929]: audit 2024-05-20T22:05:03.036044+0000 mon.a (mon.0) 616 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:03.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:03 smithi050 bash[28929]: audit 2024-05-20T22:05:03.037734+0000 mon.a (mon.0) 617 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:03.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:03 smithi050 bash[28929]: audit 2024-05-20T22:05:03.045385+0000 mon.a (mon.0) 618 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:03.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:03 smithi050 bash[28929]: audit 2024-05-20T22:05:03.049804+0000 mon.a (mon.0) 619 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:05:03.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:03 smithi050 bash[28929]: audit 2024-05-20T22:05:03.051458+0000 mon.a (mon.0) 620 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:05:03.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:03 smithi050 bash[28929]: audit 2024-05-20T22:05:03.061105+0000 mon.a (mon.0) 621 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:03.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:03 smithi145 bash[23893]: cluster 2024-05-20T22:05:01.514981+0000 mgr.y (mgr.14150) 290 : cluster 0 pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-05-20T22:05:03.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:03 smithi145 bash[23893]: audit 2024-05-20T22:05:03.023558+0000 mon.a (mon.0) 613 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:03.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:03 smithi145 bash[23893]: audit 2024-05-20T22:05:03.032297+0000 mon.a (mon.0) 614 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:03.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:03 smithi145 bash[23893]: audit 2024-05-20T22:05:03.034297+0000 mon.a (mon.0) 615 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:03.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:03 smithi145 bash[23893]: audit 2024-05-20T22:05:03.036044+0000 mon.a (mon.0) 616 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:03.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:03 smithi145 bash[23893]: audit 2024-05-20T22:05:03.037734+0000 mon.a (mon.0) 617 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:03.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:03 smithi145 bash[23893]: audit 2024-05-20T22:05:03.045385+0000 mon.a (mon.0) 618 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:03.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:03 smithi145 bash[23893]: audit 2024-05-20T22:05:03.049804+0000 mon.a (mon.0) 619 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:05:03.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:03 smithi145 bash[23893]: audit 2024-05-20T22:05:03.051458+0000 mon.a (mon.0) 620 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:05:03.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:03 smithi145 bash[23893]: audit 2024-05-20T22:05:03.061105+0000 mon.a (mon.0) 621 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:04.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:04 smithi050 bash[21866]: cephadm 2024-05-20T22:05:03.014674+0000 mgr.y (mgr.14150) 291 : cephadm 1 Detected new or changed devices on smithi145 2024-05-20T22:05:04.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:04 smithi050 bash[21866]: cephadm 2024-05-20T22:05:03.039045+0000 mgr.y (mgr.14150) 292 : cephadm 1 Adjusting osd_memory_target on smithi145 to 5755M 2024-05-20T22:05:04.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:04 smithi050 bash[28929]: cephadm 2024-05-20T22:05:03.014674+0000 mgr.y (mgr.14150) 291 : cephadm 1 Detected new or changed devices on smithi145 2024-05-20T22:05:04.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:04 smithi050 bash[28929]: cephadm 2024-05-20T22:05:03.039045+0000 mgr.y (mgr.14150) 292 : cephadm 1 Adjusting osd_memory_target on smithi145 to 5755M 2024-05-20T22:05:04.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:04 smithi145 bash[23893]: cephadm 2024-05-20T22:05:03.014674+0000 mgr.y (mgr.14150) 291 : cephadm 1 Detected new or changed devices on smithi145 2024-05-20T22:05:04.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:04 smithi145 bash[23893]: cephadm 2024-05-20T22:05:03.039045+0000 mgr.y (mgr.14150) 292 : cephadm 1 Adjusting osd_memory_target on smithi145 to 5755M 2024-05-20T22:05:05.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:05 smithi050 bash[21866]: cluster 2024-05-20T22:05:03.515600+0000 mgr.y (mgr.14150) 293 : cluster 0 pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-20T22:05:05.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:05 smithi050 bash[28929]: cluster 2024-05-20T22:05:03.515600+0000 mgr.y (mgr.14150) 293 : cluster 0 pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-20T22:05:05.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:05 smithi145 bash[23893]: cluster 2024-05-20T22:05:03.515600+0000 mgr.y (mgr.14150) 293 : cluster 0 pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-20T22:05:07.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:07 smithi050 bash[21866]: cluster 2024-05-20T22:05:05.516154+0000 mgr.y (mgr.14150) 294 : cluster 0 pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T22:05:07.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:07 smithi050 bash[28929]: cluster 2024-05-20T22:05:05.516154+0000 mgr.y (mgr.14150) 294 : cluster 0 pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T22:05:07.454 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T22:05:07.476 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:07 smithi145 bash[23893]: cluster 2024-05-20T22:05:05.516154+0000 mgr.y (mgr.14150) 294 : cluster 0 pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T22:05:09.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:09 smithi050 bash[21866]: cluster 2024-05-20T22:05:07.516784+0000 mgr.y (mgr.14150) 295 : cluster 0 pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-05-20T22:05:09.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:09 smithi050 bash[28929]: cluster 2024-05-20T22:05:07.516784+0000 mgr.y (mgr.14150) 295 : cluster 0 pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-05-20T22:05:09.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:09 smithi145 bash[23893]: cluster 2024-05-20T22:05:07.516784+0000 mgr.y (mgr.14150) 295 : cluster 0 pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-05-20T22:05:09.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.624+0000 7f7cfa29c640 1 -- 172.21.15.145:0/1032202465 >> v1:172.21.15.145:6789/0 conn(0x7f7cf4104810 legacy=0x7f7cf4104cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:05:09.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.624+0000 7f7cfa29c640 1 -- 172.21.15.145:0/1032202465 shutdown_connections 2024-05-20T22:05:09.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.624+0000 7f7cfa29c640 1 -- 172.21.15.145:0/1032202465 >> 172.21.15.145:0/1032202465 conn(0x7f7cf40fcce0 msgr2=0x7f7cf40ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:05:09.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.624+0000 7f7cfa29c640 1 -- 172.21.15.145:0/1032202465 shutdown_connections 2024-05-20T22:05:09.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.624+0000 7f7cfa29c640 1 -- 172.21.15.145:0/1032202465 wait complete. 2024-05-20T22:05:09.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.624+0000 7f7cfa29c640 1 Processor -- start 2024-05-20T22:05:09.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.624+0000 7f7cfa29c640 1 -- start start 2024-05-20T22:05:09.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.624+0000 7f7cfa29c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f7cf419dc30 con 0x7f7cf4075860 2024-05-20T22:05:09.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.624+0000 7f7cfa29c640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f7cf41a9480 con 0x7f7cf4104810 2024-05-20T22:05:09.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.624+0000 7f7cfa29c640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f7cf41aa660 con 0x7f7cf40744c0 2024-05-20T22:05:09.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.624+0000 7f7cf8839640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f7cf4104810 0x7f7cf41a6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:57072/0 (socket says 172.21.15.145:57072) 2024-05-20T22:05:09.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.624+0000 7f7cf8839640 1 -- 172.21.15.145:0/674231104 learned_addr learned my addr 172.21.15.145:0/674231104 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-05-20T22:05:09.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.624+0000 7f7cf1ffb640 1 -- 172.21.15.145:0/674231104 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 341262661 0 0) 0x7f7cf41a9480 con 0x7f7cf4104810 2024-05-20T22:05:09.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.624+0000 7f7cf1ffb640 1 -- 172.21.15.145:0/674231104 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ce0003520 con 0x7f7cf4104810 2024-05-20T22:05:09.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.628+0000 7f7cf1ffb640 1 -- 172.21.15.145:0/674231104 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 71726768 0 0) 0x7f7ce0003520 con 0x7f7cf4104810 2024-05-20T22:05:09.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.628+0000 7f7cf1ffb640 1 -- 172.21.15.145:0/674231104 --> v1:172.21.15.145:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7cf41a9480 con 0x7f7cf4104810 2024-05-20T22:05:09.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.628+0000 7f7cf1ffb640 1 -- 172.21.15.145:0/674231104 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f7cec001e60 con 0x7f7cf4104810 2024-05-20T22:05:09.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.628+0000 7f7cf1ffb640 1 -- 172.21.15.145:0/674231104 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1226861327 0 0) 0x7f7cf41aa660 con 0x7f7cf40744c0 2024-05-20T22:05:09.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.628+0000 7f7cf1ffb640 1 -- 172.21.15.145:0/674231104 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ce0003520 con 0x7f7cf40744c0 2024-05-20T22:05:09.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.628+0000 7f7cf1ffb640 1 -- 172.21.15.145:0/674231104 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1713964798 0 0) 0x7f7cf419dc30 con 0x7f7cf4075860 2024-05-20T22:05:09.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.628+0000 7f7cf1ffb640 1 -- 172.21.15.145:0/674231104 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cf41aa660 con 0x7f7cf4075860 2024-05-20T22:05:09.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.628+0000 7f7cf1ffb640 1 -- 172.21.15.145:0/674231104 <== mon.1 v1:172.21.15.145:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2729848734 0 0) 0x7f7cf41a9480 con 0x7f7cf4104810 2024-05-20T22:05:09.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.628+0000 7f7cf1ffb640 1 -- 172.21.15.145:0/674231104 >> v1:172.21.15.50:6790/0 conn(0x7f7cf40744c0 legacy=0x7f7cf419d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:05:09.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.628+0000 7f7cf1ffb640 1 -- 172.21.15.145:0/674231104 >> v1:172.21.15.50:6789/0 conn(0x7f7cf4075860 legacy=0x7f7cf41a3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:05:09.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.628+0000 7f7cf1ffb640 1 -- 172.21.15.145:0/674231104 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf41ab840 con 0x7f7cf4104810 2024-05-20T22:05:09.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.628+0000 7f7cfa29c640 1 -- 172.21.15.145:0/674231104 --> v1:172.21.15.145:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf41aa890 con 0x7f7cf4104810 2024-05-20T22:05:09.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.628+0000 7f7cfa29c640 1 -- 172.21.15.145:0/674231104 --> v1:172.21.15.145:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7cf41aadd0 con 0x7f7cf4104810 2024-05-20T22:05:09.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.628+0000 7f7cf1ffb640 1 -- 172.21.15.145:0/674231104 <== mon.1 v1:172.21.15.145:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f7cec004230 con 0x7f7cf4104810 2024-05-20T22:05:09.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.628+0000 7f7cf1ffb640 1 -- 172.21.15.145:0/674231104 <== mon.1 v1:172.21.15.145:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f7cec005610 con 0x7f7cf4104810 2024-05-20T22:05:09.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.628+0000 7f7cfa29c640 1 -- 172.21.15.145:0/674231104 --> v1:172.21.15.145:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd40050b0 con 0x7f7cf4104810 2024-05-20T22:05:09.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.628+0000 7f7cf1ffb640 1 -- 172.21.15.145:0/674231104 <== mon.1 v1:172.21.15.145:6789/0 7 ==== mgrmap(e 15) ==== 92081+0+0 (unknown 2274281742 0 0) 0x7f7cec004e60 con 0x7f7cf4104810 2024-05-20T22:05:09.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.628+0000 7f7cf1ffb640 1 -- 172.21.15.145:0/674231104 <== mon.1 v1:172.21.15.145:6789/0 8 ==== osd_map(50..50 src has 1..50) ==== 3789+0+0 (unknown 3467808272 0 0) 0x7f7cec089150 con 0x7f7cf4104810 2024-05-20T22:05:09.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.632+0000 7f7cf1ffb640 1 -- 172.21.15.145:0/674231104 <== mon.1 v1:172.21.15.145:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f7cec057340 con 0x7f7cf4104810 2024-05-20T22:05:09.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:09.832+0000 7f7cfa29c640 1 -- 172.21.15.145:0/674231104 --> v1:172.21.15.50:6800/2944911247 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f7cd4000bc0 con 0x7f7ce006ed40 2024-05-20T22:05:10.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:10 smithi050 bash[21866]: audit 2024-05-20T22:05:09.843282+0000 mon.a (mon.0) 622 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:05:10.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:10 smithi050 bash[21866]: audit 2024-05-20T22:05:09.849444+0000 mon.a (mon.0) 623 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:05:10.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:10 smithi050 bash[21866]: audit 2024-05-20T22:05:09.851140+0000 mon.a (mon.0) 624 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:05:10.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:10 smithi050 bash[28929]: audit 2024-05-20T22:05:09.843282+0000 mon.a (mon.0) 622 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:05:10.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:10 smithi050 bash[28929]: audit 2024-05-20T22:05:09.849444+0000 mon.a (mon.0) 623 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:05:10.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:10 smithi050 bash[28929]: audit 2024-05-20T22:05:09.851140+0000 mon.a (mon.0) 624 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:05:10.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:10 smithi145 bash[23893]: audit 2024-05-20T22:05:09.843282+0000 mon.a (mon.0) 622 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T22:05:10.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:10 smithi145 bash[23893]: audit 2024-05-20T22:05:09.849444+0000 mon.a (mon.0) 623 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T22:05:10.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:10 smithi145 bash[23893]: audit 2024-05-20T22:05:09.851140+0000 mon.a (mon.0) 624 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:05:11.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:11 smithi050 bash[21866]: cluster 2024-05-20T22:05:09.517480+0000 mgr.y (mgr.14150) 296 : cluster 0 pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:11.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:11 smithi050 bash[21866]: audit 2024-05-20T22:05:09.836768+0000 mgr.y (mgr.14150) 297 : audit 0 from='client.24319 v1:172.21.15.145:0/674231104' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:05:11.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:11 smithi050 bash[28929]: cluster 2024-05-20T22:05:09.517480+0000 mgr.y (mgr.14150) 296 : cluster 0 pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:11.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:11 smithi050 bash[28929]: audit 2024-05-20T22:05:09.836768+0000 mgr.y (mgr.14150) 297 : audit 0 from='client.24319 v1:172.21.15.145:0/674231104' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:05:11.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:11 smithi145 bash[23893]: cluster 2024-05-20T22:05:09.517480+0000 mgr.y (mgr.14150) 296 : cluster 0 pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:11.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:11 smithi145 bash[23893]: audit 2024-05-20T22:05:09.836768+0000 mgr.y (mgr.14150) 297 : audit 0 from='client.24319 v1:172.21.15.145:0/674231104' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:05:13.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:13 smithi050 bash[21866]: cluster 2024-05-20T22:05:11.518077+0000 mgr.y (mgr.14150) 298 : cluster 0 pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:13.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:13 smithi050 bash[28929]: cluster 2024-05-20T22:05:11.518077+0000 mgr.y (mgr.14150) 298 : cluster 0 pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:13.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:13 smithi145 bash[23893]: cluster 2024-05-20T22:05:11.518077+0000 mgr.y (mgr.14150) 298 : cluster 0 pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:15.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:15 smithi050 bash[21866]: cluster 2024-05-20T22:05:13.518651+0000 mgr.y (mgr.14150) 299 : cluster 0 pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:15.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:15 smithi050 bash[28929]: cluster 2024-05-20T22:05:13.518651+0000 mgr.y (mgr.14150) 299 : cluster 0 pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:15.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:15 smithi145 bash[23893]: cluster 2024-05-20T22:05:13.518651+0000 mgr.y (mgr.14150) 299 : cluster 0 pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:17.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:17 smithi145 bash[23893]: cluster 2024-05-20T22:05:15.519209+0000 mgr.y (mgr.14150) 300 : cluster 0 pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:17.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:17 smithi050 bash[21866]: cluster 2024-05-20T22:05:15.519209+0000 mgr.y (mgr.14150) 300 : cluster 0 pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:17.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:17 smithi050 bash[28929]: cluster 2024-05-20T22:05:15.519209+0000 mgr.y (mgr.14150) 300 : cluster 0 pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:18.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:18 smithi050 bash[21866]: audit 2024-05-20T22:05:17.805160+0000 mon.b (mon.1) 22 : audit 1 from='client.? v1:172.21.15.145:0/3406242144' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a29bd67b-c55e-423c-b251-0ba4b656544a"}]: dispatch 2024-05-20T22:05:18.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:18 smithi050 bash[21866]: audit 2024-05-20T22:05:17.806553+0000 mon.a (mon.0) 625 : audit 1 from='client.24325 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a29bd67b-c55e-423c-b251-0ba4b656544a"}]: dispatch 2024-05-20T22:05:18.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:18 smithi050 bash[21866]: audit 2024-05-20T22:05:17.810086+0000 mon.a (mon.0) 626 : audit 1 from='client.24325 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a29bd67b-c55e-423c-b251-0ba4b656544a"}]': finished 2024-05-20T22:05:18.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:18 smithi050 bash[21866]: cluster 2024-05-20T22:05:17.817661+0000 mon.a (mon.0) 627 : cluster 0 osdmap e51: 8 total, 7 up, 8 in 2024-05-20T22:05:18.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:18 smithi050 bash[21866]: audit 2024-05-20T22:05:17.818396+0000 mon.a (mon.0) 628 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T22:05:18.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:18 smithi050 bash[28929]: audit 2024-05-20T22:05:17.805160+0000 mon.b (mon.1) 22 : audit 1 from='client.? v1:172.21.15.145:0/3406242144' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a29bd67b-c55e-423c-b251-0ba4b656544a"}]: dispatch 2024-05-20T22:05:18.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:18 smithi050 bash[28929]: audit 2024-05-20T22:05:17.806553+0000 mon.a (mon.0) 625 : audit 1 from='client.24325 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a29bd67b-c55e-423c-b251-0ba4b656544a"}]: dispatch 2024-05-20T22:05:18.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:18 smithi050 bash[28929]: audit 2024-05-20T22:05:17.810086+0000 mon.a (mon.0) 626 : audit 1 from='client.24325 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a29bd67b-c55e-423c-b251-0ba4b656544a"}]': finished 2024-05-20T22:05:18.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:18 smithi050 bash[28929]: cluster 2024-05-20T22:05:17.817661+0000 mon.a (mon.0) 627 : cluster 0 osdmap e51: 8 total, 7 up, 8 in 2024-05-20T22:05:18.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:18 smithi050 bash[28929]: audit 2024-05-20T22:05:17.818396+0000 mon.a (mon.0) 628 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T22:05:18.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:18 smithi145 bash[23893]: audit 2024-05-20T22:05:17.805160+0000 mon.b (mon.1) 22 : audit 1 from='client.? v1:172.21.15.145:0/3406242144' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a29bd67b-c55e-423c-b251-0ba4b656544a"}]: dispatch 2024-05-20T22:05:18.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:18 smithi145 bash[23893]: audit 2024-05-20T22:05:17.806553+0000 mon.a (mon.0) 625 : audit 1 from='client.24325 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a29bd67b-c55e-423c-b251-0ba4b656544a"}]: dispatch 2024-05-20T22:05:18.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:18 smithi145 bash[23893]: audit 2024-05-20T22:05:17.810086+0000 mon.a (mon.0) 626 : audit 1 from='client.24325 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a29bd67b-c55e-423c-b251-0ba4b656544a"}]': finished 2024-05-20T22:05:18.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:18 smithi145 bash[23893]: cluster 2024-05-20T22:05:17.817661+0000 mon.a (mon.0) 627 : cluster 0 osdmap e51: 8 total, 7 up, 8 in 2024-05-20T22:05:18.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:18 smithi145 bash[23893]: audit 2024-05-20T22:05:17.818396+0000 mon.a (mon.0) 628 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T22:05:19.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:19 smithi050 bash[21866]: cluster 2024-05-20T22:05:17.519758+0000 mgr.y (mgr.14150) 301 : cluster 0 pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:19.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:19 smithi050 bash[21866]: audit 2024-05-20T22:05:18.482717+0000 mon.b (mon.1) 23 : audit 0 from='client.? v1:172.21.15.145:0/3454081816' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:05:19.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:19 smithi050 bash[28929]: cluster 2024-05-20T22:05:17.519758+0000 mgr.y (mgr.14150) 301 : cluster 0 pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:19.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:19 smithi050 bash[28929]: audit 2024-05-20T22:05:18.482717+0000 mon.b (mon.1) 23 : audit 0 from='client.? v1:172.21.15.145:0/3454081816' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:05:19.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:19 smithi145 bash[23893]: cluster 2024-05-20T22:05:17.519758+0000 mgr.y (mgr.14150) 301 : cluster 0 pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:19.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:19 smithi145 bash[23893]: audit 2024-05-20T22:05:18.482717+0000 mon.b (mon.1) 23 : audit 0 from='client.? v1:172.21.15.145:0/3454081816' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T22:05:21.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:21 smithi145 bash[23893]: cluster 2024-05-20T22:05:19.520340+0000 mgr.y (mgr.14150) 302 : cluster 0 pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:21.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:21 smithi050 bash[21866]: cluster 2024-05-20T22:05:19.520340+0000 mgr.y (mgr.14150) 302 : cluster 0 pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:21.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:21 smithi050 bash[28929]: cluster 2024-05-20T22:05:19.520340+0000 mgr.y (mgr.14150) 302 : cluster 0 pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:23.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:23 smithi145 bash[23893]: cluster 2024-05-20T22:05:21.520915+0000 mgr.y (mgr.14150) 303 : cluster 0 pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:23.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:23 smithi050 bash[21866]: cluster 2024-05-20T22:05:21.520915+0000 mgr.y (mgr.14150) 303 : cluster 0 pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:23.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:23 smithi050 bash[28929]: cluster 2024-05-20T22:05:21.520915+0000 mgr.y (mgr.14150) 303 : cluster 0 pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:25.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:25 smithi145 bash[23893]: cluster 2024-05-20T22:05:23.521482+0000 mgr.y (mgr.14150) 304 : cluster 0 pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:25.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:25 smithi050 bash[21866]: cluster 2024-05-20T22:05:23.521482+0000 mgr.y (mgr.14150) 304 : cluster 0 pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:25.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:25 smithi050 bash[28929]: cluster 2024-05-20T22:05:23.521482+0000 mgr.y (mgr.14150) 304 : cluster 0 pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:27.470 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:27 smithi145 bash[23893]: cluster 2024-05-20T22:05:25.522068+0000 mgr.y (mgr.14150) 305 : cluster 0 pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:27.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:27 smithi050 bash[21866]: cluster 2024-05-20T22:05:25.522068+0000 mgr.y (mgr.14150) 305 : cluster 0 pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:27.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:27 smithi050 bash[28929]: cluster 2024-05-20T22:05:25.522068+0000 mgr.y (mgr.14150) 305 : cluster 0 pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:29.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:29 smithi145 bash[23893]: cluster 2024-05-20T22:05:27.522746+0000 mgr.y (mgr.14150) 306 : cluster 0 pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:29.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:29 smithi050 bash[21866]: cluster 2024-05-20T22:05:27.522746+0000 mgr.y (mgr.14150) 306 : cluster 0 pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:29.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:29 smithi050 bash[28929]: cluster 2024-05-20T22:05:27.522746+0000 mgr.y (mgr.14150) 306 : cluster 0 pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:30.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:30 smithi145 bash[23893]: audit 2024-05-20T22:05:29.814187+0000 mon.a (mon.0) 629 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-20T22:05:30.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:30 smithi145 bash[23893]: audit 2024-05-20T22:05:29.815848+0000 mon.a (mon.0) 630 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:05:30.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:30 smithi050 bash[21866]: audit 2024-05-20T22:05:29.814187+0000 mon.a (mon.0) 629 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-20T22:05:30.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:30 smithi050 bash[21866]: audit 2024-05-20T22:05:29.815848+0000 mon.a (mon.0) 630 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:05:30.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:30 smithi050 bash[28929]: audit 2024-05-20T22:05:29.814187+0000 mon.a (mon.0) 629 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-20T22:05:30.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:30 smithi050 bash[28929]: audit 2024-05-20T22:05:29.815848+0000 mon.a (mon.0) 630 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:05:31.357 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:31 smithi145 bash[23893]: cluster 2024-05-20T22:05:29.523383+0000 mgr.y (mgr.14150) 307 : cluster 0 pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:31.357 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:31 smithi145 bash[23893]: cephadm 2024-05-20T22:05:29.817345+0000 mgr.y (mgr.14150) 308 : cephadm 1 Deploying daemon osd.7 on smithi145 2024-05-20T22:05:31.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:31 smithi050 bash[21866]: cluster 2024-05-20T22:05:29.523383+0000 mgr.y (mgr.14150) 307 : cluster 0 pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:31.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:31 smithi050 bash[21866]: cephadm 2024-05-20T22:05:29.817345+0000 mgr.y (mgr.14150) 308 : cephadm 1 Deploying daemon osd.7 on smithi145 2024-05-20T22:05:31.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:31 smithi050 bash[28929]: cluster 2024-05-20T22:05:29.523383+0000 mgr.y (mgr.14150) 307 : cluster 0 pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:31.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:31 smithi050 bash[28929]: cephadm 2024-05-20T22:05:29.817345+0000 mgr.y (mgr.14150) 308 : cephadm 1 Deploying daemon osd.7 on smithi145 2024-05-20T22:05:33.477 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:33 smithi145 bash[23893]: cluster 2024-05-20T22:05:31.524016+0000 mgr.y (mgr.14150) 309 : cluster 0 pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:33.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:33 smithi050 bash[28929]: cluster 2024-05-20T22:05:31.524016+0000 mgr.y (mgr.14150) 309 : cluster 0 pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:33.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:33 smithi050 bash[21866]: cluster 2024-05-20T22:05:31.524016+0000 mgr.y (mgr.14150) 309 : cluster 0 pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:33.755 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:33 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:05:33.755 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:05:33 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:05:33.756 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:05:33 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:05:33.756 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:05:33 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:05:33.756 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:05:33 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:05:34.028 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:33 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:05:34.029 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:05:33 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:05:34.029 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:05:33 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:05:34.030 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:05:33 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:05:34.030 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:05:33 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:05:34.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:34 smithi145 bash[23893]: audit 2024-05-20T22:05:34.027350+0000 mon.a (mon.0) 631 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:05:34.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:34 smithi145 bash[23893]: audit 2024-05-20T22:05:34.034980+0000 mon.a (mon.0) 632 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:34.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:34 smithi145 bash[23893]: audit 2024-05-20T22:05:34.043532+0000 mon.a (mon.0) 633 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:34.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:34 smithi050 bash[28929]: audit 2024-05-20T22:05:34.027350+0000 mon.a (mon.0) 631 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:05:34.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:34 smithi050 bash[28929]: audit 2024-05-20T22:05:34.034980+0000 mon.a (mon.0) 632 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:34.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:34 smithi050 bash[28929]: audit 2024-05-20T22:05:34.043532+0000 mon.a (mon.0) 633 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:34.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:34 smithi050 bash[21866]: audit 2024-05-20T22:05:34.027350+0000 mon.a (mon.0) 631 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:05:34.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:34 smithi050 bash[21866]: audit 2024-05-20T22:05:34.034980+0000 mon.a (mon.0) 632 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:34.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:34 smithi050 bash[21866]: audit 2024-05-20T22:05:34.043532+0000 mon.a (mon.0) 633 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:35.540 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:35 smithi145 bash[23893]: cluster 2024-05-20T22:05:33.524584+0000 mgr.y (mgr.14150) 310 : cluster 0 pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:35.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:35 smithi050 bash[21866]: cluster 2024-05-20T22:05:33.524584+0000 mgr.y (mgr.14150) 310 : cluster 0 pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:35.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:35 smithi050 bash[28929]: cluster 2024-05-20T22:05:33.524584+0000 mgr.y (mgr.14150) 310 : cluster 0 pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:37.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:37 smithi145 bash[23893]: cluster 2024-05-20T22:05:35.525147+0000 mgr.y (mgr.14150) 311 : cluster 0 pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:37.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:37 smithi050 bash[21866]: cluster 2024-05-20T22:05:35.525147+0000 mgr.y (mgr.14150) 311 : cluster 0 pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:37.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:37 smithi050 bash[28929]: cluster 2024-05-20T22:05:35.525147+0000 mgr.y (mgr.14150) 311 : cluster 0 pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:39.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:39 smithi145 bash[23893]: cluster 2024-05-20T22:05:37.525732+0000 mgr.y (mgr.14150) 312 : cluster 0 pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:39.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:39 smithi050 bash[28929]: cluster 2024-05-20T22:05:37.525732+0000 mgr.y (mgr.14150) 312 : cluster 0 pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:39.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:39 smithi050 bash[21866]: cluster 2024-05-20T22:05:37.525732+0000 mgr.y (mgr.14150) 312 : cluster 0 pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:40.529 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:40 smithi145 bash[23893]: audit 2024-05-20T22:05:40.195687+0000 mon.b (mon.1) 24 : audit 1 from='osd.7 v1:172.21.15.145:6812/2864002573' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-20T22:05:40.529 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:40 smithi145 bash[23893]: audit 2024-05-20T22:05:40.197289+0000 mon.a (mon.0) 634 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-20T22:05:40.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:40 smithi050 bash[21866]: audit 2024-05-20T22:05:40.195687+0000 mon.b (mon.1) 24 : audit 1 from='osd.7 v1:172.21.15.145:6812/2864002573' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-20T22:05:40.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:40 smithi050 bash[21866]: audit 2024-05-20T22:05:40.197289+0000 mon.a (mon.0) 634 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-20T22:05:40.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:40 smithi050 bash[28929]: audit 2024-05-20T22:05:40.195687+0000 mon.b (mon.1) 24 : audit 1 from='osd.7 v1:172.21.15.145:6812/2864002573' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-20T22:05:40.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:40 smithi050 bash[28929]: audit 2024-05-20T22:05:40.197289+0000 mon.a (mon.0) 634 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-20T22:05:41.556 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:41 smithi145 bash[23893]: cluster 2024-05-20T22:05:39.526315+0000 mgr.y (mgr.14150) 313 : cluster 0 pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:41.556 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:41 smithi145 bash[23893]: audit 2024-05-20T22:05:40.254682+0000 mon.a (mon.0) 635 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-20T22:05:41.556 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:41 smithi145 bash[23893]: cluster 2024-05-20T22:05:40.261315+0000 mon.a (mon.0) 636 : cluster 0 osdmap e52: 8 total, 7 up, 8 in 2024-05-20T22:05:41.556 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:41 smithi145 bash[23893]: audit 2024-05-20T22:05:40.261841+0000 mon.a (mon.0) 637 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T22:05:41.557 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:41 smithi145 bash[23893]: audit 2024-05-20T22:05:40.264047+0000 mon.b (mon.1) 25 : audit 1 from='osd.7 v1:172.21.15.145:6812/2864002573' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:05:41.557 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:41 smithi145 bash[23893]: audit 2024-05-20T22:05:40.265589+0000 mon.a (mon.0) 638 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:05:41.557 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:41 smithi145 bash[23893]: audit 2024-05-20T22:05:40.833163+0000 mon.a (mon.0) 639 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:41.557 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:41 smithi145 bash[23893]: audit 2024-05-20T22:05:40.841894+0000 mon.a (mon.0) 640 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:41.557 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:41 smithi145 bash[23893]: audit 2024-05-20T22:05:40.843789+0000 mon.a (mon.0) 641 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:05:41.557 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:41 smithi145 bash[23893]: audit 2024-05-20T22:05:40.845602+0000 mon.a (mon.0) 642 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:05:41.557 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:41 smithi145 bash[23893]: audit 2024-05-20T22:05:40.855134+0000 mon.a (mon.0) 643 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:41.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:41 smithi050 bash[28929]: cluster 2024-05-20T22:05:39.526315+0000 mgr.y (mgr.14150) 313 : cluster 0 pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:41.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:41 smithi050 bash[28929]: audit 2024-05-20T22:05:40.254682+0000 mon.a (mon.0) 635 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-20T22:05:41.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:41 smithi050 bash[28929]: cluster 2024-05-20T22:05:40.261315+0000 mon.a (mon.0) 636 : cluster 0 osdmap e52: 8 total, 7 up, 8 in 2024-05-20T22:05:41.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:41 smithi050 bash[28929]: audit 2024-05-20T22:05:40.261841+0000 mon.a (mon.0) 637 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T22:05:41.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:41 smithi050 bash[28929]: audit 2024-05-20T22:05:40.264047+0000 mon.b (mon.1) 25 : audit 1 from='osd.7 v1:172.21.15.145:6812/2864002573' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:05:41.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:41 smithi050 bash[28929]: audit 2024-05-20T22:05:40.265589+0000 mon.a (mon.0) 638 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:05:41.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:41 smithi050 bash[28929]: audit 2024-05-20T22:05:40.833163+0000 mon.a (mon.0) 639 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:41.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:41 smithi050 bash[28929]: audit 2024-05-20T22:05:40.841894+0000 mon.a (mon.0) 640 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:41.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:41 smithi050 bash[28929]: audit 2024-05-20T22:05:40.843789+0000 mon.a (mon.0) 641 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:05:41.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:41 smithi050 bash[28929]: audit 2024-05-20T22:05:40.845602+0000 mon.a (mon.0) 642 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:05:41.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:41 smithi050 bash[28929]: audit 2024-05-20T22:05:40.855134+0000 mon.a (mon.0) 643 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:41.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:41 smithi050 bash[21866]: cluster 2024-05-20T22:05:39.526315+0000 mgr.y (mgr.14150) 313 : cluster 0 pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:41.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:41 smithi050 bash[21866]: audit 2024-05-20T22:05:40.254682+0000 mon.a (mon.0) 635 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-20T22:05:41.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:41 smithi050 bash[21866]: cluster 2024-05-20T22:05:40.261315+0000 mon.a (mon.0) 636 : cluster 0 osdmap e52: 8 total, 7 up, 8 in 2024-05-20T22:05:41.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:41 smithi050 bash[21866]: audit 2024-05-20T22:05:40.261841+0000 mon.a (mon.0) 637 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T22:05:41.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:41 smithi050 bash[21866]: audit 2024-05-20T22:05:40.264047+0000 mon.b (mon.1) 25 : audit 1 from='osd.7 v1:172.21.15.145:6812/2864002573' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:05:41.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:41 smithi050 bash[21866]: audit 2024-05-20T22:05:40.265589+0000 mon.a (mon.0) 638 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-05-20T22:05:41.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:41 smithi050 bash[21866]: audit 2024-05-20T22:05:40.833163+0000 mon.a (mon.0) 639 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:41.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:41 smithi050 bash[21866]: audit 2024-05-20T22:05:40.841894+0000 mon.a (mon.0) 640 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:41.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:41 smithi050 bash[21866]: audit 2024-05-20T22:05:40.843789+0000 mon.a (mon.0) 641 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:05:41.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:41 smithi050 bash[21866]: audit 2024-05-20T22:05:40.845602+0000 mon.a (mon.0) 642 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:05:41.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:41 smithi050 bash[21866]: audit 2024-05-20T22:05:40.855134+0000 mon.a (mon.0) 643 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:42.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:42 smithi145 bash[23893]: audit 2024-05-20T22:05:41.257081+0000 mon.a (mon.0) 644 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-05-20T22:05:42.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:42 smithi145 bash[23893]: cluster 2024-05-20T22:05:41.263098+0000 mon.a (mon.0) 645 : cluster 0 osdmap e53: 8 total, 7 up, 8 in 2024-05-20T22:05:42.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:42 smithi145 bash[23893]: audit 2024-05-20T22:05:41.264384+0000 mon.a (mon.0) 646 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T22:05:42.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:42 smithi145 bash[23893]: audit 2024-05-20T22:05:41.274933+0000 mon.a (mon.0) 647 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T22:05:42.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:42 smithi050 bash[28929]: audit 2024-05-20T22:05:41.257081+0000 mon.a (mon.0) 644 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-05-20T22:05:42.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:42 smithi050 bash[28929]: cluster 2024-05-20T22:05:41.263098+0000 mon.a (mon.0) 645 : cluster 0 osdmap e53: 8 total, 7 up, 8 in 2024-05-20T22:05:42.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:42 smithi050 bash[28929]: audit 2024-05-20T22:05:41.264384+0000 mon.a (mon.0) 646 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T22:05:42.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:42 smithi050 bash[28929]: audit 2024-05-20T22:05:41.274933+0000 mon.a (mon.0) 647 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T22:05:42.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:42 smithi050 bash[21866]: audit 2024-05-20T22:05:41.257081+0000 mon.a (mon.0) 644 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-05-20T22:05:42.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:42 smithi050 bash[21866]: cluster 2024-05-20T22:05:41.263098+0000 mon.a (mon.0) 645 : cluster 0 osdmap e53: 8 total, 7 up, 8 in 2024-05-20T22:05:42.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:42 smithi050 bash[21866]: audit 2024-05-20T22:05:41.264384+0000 mon.a (mon.0) 646 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T22:05:42.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:42 smithi050 bash[21866]: audit 2024-05-20T22:05:41.274933+0000 mon.a (mon.0) 647 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T22:05:43.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:43 smithi145 bash[23893]: cluster 2024-05-20T22:05:41.164685+0000 osd.7 (osd.7) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:05:43.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:43 smithi145 bash[23893]: cluster 2024-05-20T22:05:41.164838+0000 osd.7 (osd.7) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:05:43.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:43 smithi145 bash[23893]: cluster 2024-05-20T22:05:41.526985+0000 mgr.y (mgr.14150) 314 : cluster 0 pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:43.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:43 smithi145 bash[23893]: cluster 2024-05-20T22:05:42.265811+0000 mon.a (mon.0) 648 : cluster 1 osd.7 v1:172.21.15.145:6812/2864002573 boot 2024-05-20T22:05:43.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:43 smithi145 bash[23893]: cluster 2024-05-20T22:05:42.265929+0000 mon.a (mon.0) 649 : cluster 0 osdmap e54: 8 total, 8 up, 8 in 2024-05-20T22:05:43.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:43 smithi145 bash[23893]: audit 2024-05-20T22:05:42.266226+0000 mon.a (mon.0) 650 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T22:05:43.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:43 smithi050 bash[21866]: cluster 2024-05-20T22:05:41.164685+0000 osd.7 (osd.7) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:05:43.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:43 smithi050 bash[21866]: cluster 2024-05-20T22:05:41.164838+0000 osd.7 (osd.7) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:05:43.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:43 smithi050 bash[21866]: cluster 2024-05-20T22:05:41.526985+0000 mgr.y (mgr.14150) 314 : cluster 0 pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:43.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:43 smithi050 bash[21866]: cluster 2024-05-20T22:05:42.265811+0000 mon.a (mon.0) 648 : cluster 1 osd.7 v1:172.21.15.145:6812/2864002573 boot 2024-05-20T22:05:43.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:43 smithi050 bash[21866]: cluster 2024-05-20T22:05:42.265929+0000 mon.a (mon.0) 649 : cluster 0 osdmap e54: 8 total, 8 up, 8 in 2024-05-20T22:05:43.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:43 smithi050 bash[21866]: audit 2024-05-20T22:05:42.266226+0000 mon.a (mon.0) 650 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T22:05:43.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:43 smithi050 bash[28929]: cluster 2024-05-20T22:05:41.164685+0000 osd.7 (osd.7) 1 : cluster 0 purged_snaps scrub starts 2024-05-20T22:05:43.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:43 smithi050 bash[28929]: cluster 2024-05-20T22:05:41.164838+0000 osd.7 (osd.7) 2 : cluster 0 purged_snaps scrub ok 2024-05-20T22:05:43.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:43 smithi050 bash[28929]: cluster 2024-05-20T22:05:41.526985+0000 mgr.y (mgr.14150) 314 : cluster 0 pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-20T22:05:43.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:43 smithi050 bash[28929]: cluster 2024-05-20T22:05:42.265811+0000 mon.a (mon.0) 648 : cluster 1 osd.7 v1:172.21.15.145:6812/2864002573 boot 2024-05-20T22:05:43.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:43 smithi050 bash[28929]: cluster 2024-05-20T22:05:42.265929+0000 mon.a (mon.0) 649 : cluster 0 osdmap e54: 8 total, 8 up, 8 in 2024-05-20T22:05:43.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:43 smithi050 bash[28929]: audit 2024-05-20T22:05:42.266226+0000 mon.a (mon.0) 650 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T22:05:43.890 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 7 on host 'smithi145' 2024-05-20T22:05:43.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:43.892+0000 7f7cf1ffb640 1 -- 172.21.15.145:0/674231104 <== mgr.14150 v1:172.21.15.50:6800/2944911247 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (unknown 0 0 4122505399) 0x7f7cd4000bc0 con 0x7f7ce006ed40 2024-05-20T22:05:43.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:43.896+0000 7f7cfa29c640 1 -- 172.21.15.145:0/674231104 >> v1:172.21.15.50:6800/2944911247 conn(0x7f7ce006ed40 legacy=0x7f7ce0071200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:05:43.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:43.896+0000 7f7cfa29c640 1 -- 172.21.15.145:0/674231104 >> v1:172.21.15.145:6789/0 conn(0x7f7cf4104810 legacy=0x7f7cf41a6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:05:43.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:43.896+0000 7f7cfa29c640 1 -- 172.21.15.145:0/674231104 shutdown_connections 2024-05-20T22:05:43.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:43.896+0000 7f7cfa29c640 1 -- 172.21.15.145:0/674231104 >> 172.21.15.145:0/674231104 conn(0x7f7cf40fcce0 msgr2=0x7f7cf40fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:05:43.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:43.896+0000 7f7cfa29c640 1 -- 172.21.15.145:0/674231104 shutdown_connections 2024-05-20T22:05:43.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:05:43.896+0000 7f7cfa29c640 1 -- 172.21.15.145:0/674231104 wait complete. 2024-05-20T22:05:44.466 DEBUG:teuthology.orchestra.run.smithi145:osd.7> sudo journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.7.service 2024-05-20T22:05:44.469 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-05-20T22:05:44.469 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph osd stat -f json 2024-05-20T22:05:44.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:44 smithi145 bash[23893]: cluster 2024-05-20T22:05:43.277508+0000 mon.a (mon.0) 651 : cluster 0 osdmap e55: 8 total, 8 up, 8 in 2024-05-20T22:05:44.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:44 smithi145 bash[23893]: audit 2024-05-20T22:05:43.871583+0000 mon.a (mon.0) 652 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:05:44.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:44 smithi145 bash[23893]: audit 2024-05-20T22:05:43.881355+0000 mon.a (mon.0) 653 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:44.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:44 smithi145 bash[23893]: audit 2024-05-20T22:05:43.890099+0000 mon.a (mon.0) 654 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:44.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:44 smithi145 bash[23893]: cluster 2024-05-20T22:05:44.278167+0000 mon.a (mon.0) 655 : cluster 0 osdmap e56: 8 total, 8 up, 8 in 2024-05-20T22:05:44.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:44 smithi050 bash[21866]: cluster 2024-05-20T22:05:43.277508+0000 mon.a (mon.0) 651 : cluster 0 osdmap e55: 8 total, 8 up, 8 in 2024-05-20T22:05:44.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:44 smithi050 bash[21866]: audit 2024-05-20T22:05:43.871583+0000 mon.a (mon.0) 652 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:05:44.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:44 smithi050 bash[21866]: audit 2024-05-20T22:05:43.881355+0000 mon.a (mon.0) 653 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:44.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:44 smithi050 bash[21866]: audit 2024-05-20T22:05:43.890099+0000 mon.a (mon.0) 654 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:44.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:44 smithi050 bash[21866]: cluster 2024-05-20T22:05:44.278167+0000 mon.a (mon.0) 655 : cluster 0 osdmap e56: 8 total, 8 up, 8 in 2024-05-20T22:05:44.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:44 smithi050 bash[28929]: cluster 2024-05-20T22:05:43.277508+0000 mon.a (mon.0) 651 : cluster 0 osdmap e55: 8 total, 8 up, 8 in 2024-05-20T22:05:44.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:44 smithi050 bash[28929]: audit 2024-05-20T22:05:43.871583+0000 mon.a (mon.0) 652 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:05:44.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:44 smithi050 bash[28929]: audit 2024-05-20T22:05:43.881355+0000 mon.a (mon.0) 653 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:44.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:44 smithi050 bash[28929]: audit 2024-05-20T22:05:43.890099+0000 mon.a (mon.0) 654 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:44.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:44 smithi050 bash[28929]: cluster 2024-05-20T22:05:44.278167+0000 mon.a (mon.0) 655 : cluster 0 osdmap e56: 8 total, 8 up, 8 in 2024-05-20T22:05:45.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:45 smithi145 bash[23893]: cluster 2024-05-20T22:05:43.527567+0000 mgr.y (mgr.14150) 315 : cluster 0 pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:05:45.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:45 smithi050 bash[21866]: cluster 2024-05-20T22:05:43.527567+0000 mgr.y (mgr.14150) 315 : cluster 0 pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:05:45.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:45 smithi050 bash[28929]: cluster 2024-05-20T22:05:43.527567+0000 mgr.y (mgr.14150) 315 : cluster 0 pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:05:46.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:46 smithi145 bash[23893]: cluster 2024-05-20T22:05:45.298450+0000 mon.a (mon.0) 656 : cluster 0 osdmap e57: 8 total, 8 up, 8 in 2024-05-20T22:05:46.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:46 smithi145 bash[23893]: cluster 2024-05-20T22:05:45.528186+0000 mgr.y (mgr.14150) 316 : cluster 0 pgmap v301: 1 pgs: 1 remapped+peering; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:05:46.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:46 smithi050 bash[21866]: cluster 2024-05-20T22:05:45.298450+0000 mon.a (mon.0) 656 : cluster 0 osdmap e57: 8 total, 8 up, 8 in 2024-05-20T22:05:46.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:46 smithi050 bash[21866]: cluster 2024-05-20T22:05:45.528186+0000 mgr.y (mgr.14150) 316 : cluster 0 pgmap v301: 1 pgs: 1 remapped+peering; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:05:46.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:46 smithi050 bash[28929]: cluster 2024-05-20T22:05:45.298450+0000 mon.a (mon.0) 656 : cluster 0 osdmap e57: 8 total, 8 up, 8 in 2024-05-20T22:05:46.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:46 smithi050 bash[28929]: cluster 2024-05-20T22:05:45.528186+0000 mgr.y (mgr.14150) 316 : cluster 0 pgmap v301: 1 pgs: 1 remapped+peering; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:05:47.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:47 smithi145 bash[23893]: cluster 2024-05-20T22:05:46.308310+0000 mon.a (mon.0) 657 : cluster 0 osdmap e58: 8 total, 8 up, 8 in 2024-05-20T22:05:47.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:47 smithi050 bash[21866]: cluster 2024-05-20T22:05:46.308310+0000 mon.a (mon.0) 657 : cluster 0 osdmap e58: 8 total, 8 up, 8 in 2024-05-20T22:05:47.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:47 smithi050 bash[28929]: cluster 2024-05-20T22:05:46.308310+0000 mon.a (mon.0) 657 : cluster 0 osdmap e58: 8 total, 8 up, 8 in 2024-05-20T22:05:48.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:48 smithi145 bash[23893]: cluster 2024-05-20T22:05:47.528848+0000 mgr.y (mgr.14150) 317 : cluster 0 pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-05-20T22:05:48.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:48 smithi050 bash[21866]: cluster 2024-05-20T22:05:47.528848+0000 mgr.y (mgr.14150) 317 : cluster 0 pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-05-20T22:05:48.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:48 smithi050 bash[28929]: cluster 2024-05-20T22:05:47.528848+0000 mgr.y (mgr.14150) 317 : cluster 0 pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-05-20T22:05:49.240 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:05:50.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:50 smithi145 bash[23893]: cluster 2024-05-20T22:05:49.529439+0000 mgr.y (mgr.14150) 318 : cluster 0 pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-20T22:05:50.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:50 smithi050 bash[21866]: cluster 2024-05-20T22:05:49.529439+0000 mgr.y (mgr.14150) 318 : cluster 0 pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-20T22:05:50.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:50 smithi050 bash[28929]: cluster 2024-05-20T22:05:49.529439+0000 mgr.y (mgr.14150) 318 : cluster 0 pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-20T22:05:51.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe261474640 1 -- 172.21.15.50:0/1072979020 >> v1:172.21.15.50:6789/0 conn(0x7fe25c101c20 legacy=0x7fe25c102040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:05:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe261474640 1 -- 172.21.15.50:0/1072979020 shutdown_connections 2024-05-20T22:05:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe261474640 1 -- 172.21.15.50:0/1072979020 >> 172.21.15.50:0/1072979020 conn(0x7fe25c0fb380 msgr2=0x7fe25c0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:05:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe261474640 1 -- 172.21.15.50:0/1072979020 shutdown_connections 2024-05-20T22:05:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe261474640 1 -- 172.21.15.50:0/1072979020 wait complete. 2024-05-20T22:05:51.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe261474640 1 Processor -- start 2024-05-20T22:05:51.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe261474640 1 -- start start 2024-05-20T22:05:51.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe261474640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe25c197a00 con 0x7fe25c104b10 2024-05-20T22:05:51.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe261474640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe25c1a2e40 con 0x7fe25c101c20 2024-05-20T22:05:51.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe261474640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe25c1a4020 con 0x7fe25c108770 2024-05-20T22:05:51.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe25b7fe640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7fe25c108770 0x7fe25c1a0710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:33754/0 (socket says 172.21.15.50:33754) 2024-05-20T22:05:51.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe25b7fe640 1 -- 172.21.15.50:0/474770400 learned_addr learned my addr 172.21.15.50:0/474770400 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:05:51.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 648438829 0 0) 0x7fe25c1a4020 con 0x7fe25c108770 2024-05-20T22:05:51.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2440051b0 con 0x7fe25c108770 2024-05-20T22:05:51.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3026364898 0 0) 0x7fe25c197a00 con 0x7fe25c104b10 2024-05-20T22:05:51.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe25c1a4020 con 0x7fe25c104b10 2024-05-20T22:05:51.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 677611493 0 0) 0x7fe25c1a2e40 con 0x7fe25c101c20 2024-05-20T22:05:51.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe25c197a00 con 0x7fe25c101c20 2024-05-20T22:05:51.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 187470716 0 0) 0x7fe2440051b0 con 0x7fe25c108770 2024-05-20T22:05:51.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe25c1a2e40 con 0x7fe25c108770 2024-05-20T22:05:51.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fe254001c90 con 0x7fe25c108770 2024-05-20T22:05:51.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 494711118 0 0) 0x7fe25c1a4020 con 0x7fe25c104b10 2024-05-20T22:05:51.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe2440051b0 con 0x7fe25c104b10 2024-05-20T22:05:51.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fe250001000 con 0x7fe25c104b10 2024-05-20T22:05:51.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 874345144 0 0) 0x7fe25c197a00 con 0x7fe25c101c20 2024-05-20T22:05:51.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 --> v1:172.21.15.145:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe25c1a4020 con 0x7fe25c101c20 2024-05-20T22:05:51.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fe24c0019b0 con 0x7fe25c101c20 2024-05-20T22:05:51.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 39802350 0 0) 0x7fe25c1a2e40 con 0x7fe25c108770 2024-05-20T22:05:51.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 >> v1:172.21.15.145:6789/0 conn(0x7fe25c101c20 legacy=0x7fe25c196f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:05:51.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 >> v1:172.21.15.50:6789/0 conn(0x7fe25c104b10 legacy=0x7fe25c19cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:05:51.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25c1a5200 con 0x7fe25c108770 2024-05-20T22:05:51.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe261474640 1 -- 172.21.15.50:0/474770400 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe25c1a3070 con 0x7fe25c108770 2024-05-20T22:05:51.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe261474640 1 -- 172.21.15.50:0/474770400 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe25c1a35b0 con 0x7fe25c108770 2024-05-20T22:05:51.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7fe254003e20 con 0x7fe25c108770 2024-05-20T22:05:51.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.993+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fe254005f90 con 0x7fe25c108770 2024-05-20T22:05:51.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.997+0000 7fe261474640 1 -- 172.21.15.50:0/474770400 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2480050b0 con 0x7fe25c108770 2024-05-20T22:05:51.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.997+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 15) ==== 92081+0+0 (unknown 2274281742 0 0) 0x7fe254003990 con 0x7fe25c108770 2024-05-20T22:05:51.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:51.997+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(58..58 src has 1..58) ==== 4081+0+0 (unknown 1721900872 0 0) 0x7fe254088f30 con 0x7fe25c108770 2024-05-20T22:05:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:52.001+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7fe254056eb0 con 0x7fe25c108770 2024-05-20T22:05:52.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:52.193+0000 7fe261474640 1 -- 172.21.15.50:0/474770400 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe2480053a0 con 0x7fe25c108770 2024-05-20T22:05:52.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:52.193+0000 7fe243fff640 1 -- 172.21.15.50:0/474770400 <== mon.2 v1:172.21.15.50:6790/0 10 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v58) ==== 74+0+130 (unknown 4023224526 0 3142902509) 0x7fe2540567b0 con 0x7fe25c108770 2024-05-20T22:05:52.194 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-20T22:05:52.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:52.197+0000 7fe261474640 1 -- 172.21.15.50:0/474770400 >> v1:172.21.15.50:6800/2944911247 conn(0x7fe24406ee90 legacy=0x7fe244071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:05:52.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:52.197+0000 7fe261474640 1 -- 172.21.15.50:0/474770400 >> v1:172.21.15.50:6790/0 conn(0x7fe25c108770 legacy=0x7fe25c1a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:05:52.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:52.197+0000 7fe261474640 1 -- 172.21.15.50:0/474770400 shutdown_connections 2024-05-20T22:05:52.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:52.197+0000 7fe261474640 1 -- 172.21.15.50:0/474770400 >> 172.21.15.50:0/474770400 conn(0x7fe25c0fb380 msgr2=0x7fe25c0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:05:52.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:52.197+0000 7fe261474640 1 -- 172.21.15.50:0/474770400 shutdown_connections 2024-05-20T22:05:52.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:05:52.197+0000 7fe261474640 1 -- 172.21.15.50:0/474770400 wait complete. 2024-05-20T22:05:52.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:52 smithi145 bash[23893]: cluster 2024-05-20T22:05:51.530132+0000 mgr.y (mgr.14150) 319 : cluster 0 pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-05-20T22:05:52.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:52 smithi145 bash[23893]: audit 2024-05-20T22:05:52.198283+0000 mon.c (mon.2) 10 : audit 0 from='client.? v1:172.21.15.50:0/474770400' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-20T22:05:52.907 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:52 smithi050 bash[28929]: cluster 2024-05-20T22:05:51.530132+0000 mgr.y (mgr.14150) 319 : cluster 0 pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-05-20T22:05:52.907 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:52 smithi050 bash[28929]: audit 2024-05-20T22:05:52.198283+0000 mon.c (mon.2) 10 : audit 0 from='client.? v1:172.21.15.50:0/474770400' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-20T22:05:52.907 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:52 smithi050 bash[21866]: cluster 2024-05-20T22:05:51.530132+0000 mgr.y (mgr.14150) 319 : cluster 0 pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-05-20T22:05:52.907 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:52 smithi050 bash[21866]: audit 2024-05-20T22:05:52.198283+0000 mon.c (mon.2) 10 : audit 0 from='client.? v1:172.21.15.50:0/474770400' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-20T22:05:52.908 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":58,"num_osds":8,"num_up_osds":8,"osd_up_since":1716242742,"num_in_osds":8,"osd_in_since":1716242717,"num_remapped_pgs":0} 2024-05-20T22:05:52.909 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph osd dump --format=json 2024-05-20T22:05:54.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:53 smithi145 bash[23893]: cephadm 2024-05-20T22:05:52.878162+0000 mgr.y (mgr.14150) 320 : cephadm 1 Detected new or changed devices on smithi145 2024-05-20T22:05:54.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:53 smithi145 bash[23893]: audit 2024-05-20T22:05:52.886041+0000 mon.a (mon.0) 658 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:54.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:53 smithi145 bash[23893]: audit 2024-05-20T22:05:52.894427+0000 mon.a (mon.0) 659 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:54.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:53 smithi145 bash[23893]: audit 2024-05-20T22:05:52.896702+0000 mon.a (mon.0) 660 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:54.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:53 smithi145 bash[23893]: audit 2024-05-20T22:05:52.898340+0000 mon.a (mon.0) 661 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:54.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:53 smithi145 bash[23893]: audit 2024-05-20T22:05:52.899814+0000 mon.a (mon.0) 662 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:54.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:53 smithi145 bash[23893]: audit 2024-05-20T22:05:52.901322+0000 mon.a (mon.0) 663 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:54.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:53 smithi145 bash[23893]: cephadm 2024-05-20T22:05:52.902524+0000 mgr.y (mgr.14150) 321 : cephadm 1 Adjusting osd_memory_target on smithi145 to 4316M 2024-05-20T22:05:54.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:53 smithi145 bash[23893]: audit 2024-05-20T22:05:52.908105+0000 mon.a (mon.0) 664 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:54.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:53 smithi145 bash[23893]: audit 2024-05-20T22:05:52.912803+0000 mon.a (mon.0) 665 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:05:54.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:53 smithi145 bash[23893]: audit 2024-05-20T22:05:52.914453+0000 mon.a (mon.0) 666 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:05:54.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:53 smithi145 bash[23893]: audit 2024-05-20T22:05:52.922409+0000 mon.a (mon.0) 667 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:54.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:53 smithi050 bash[21866]: cephadm 2024-05-20T22:05:52.878162+0000 mgr.y (mgr.14150) 320 : cephadm 1 Detected new or changed devices on smithi145 2024-05-20T22:05:54.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:53 smithi050 bash[21866]: audit 2024-05-20T22:05:52.886041+0000 mon.a (mon.0) 658 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:54.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:53 smithi050 bash[21866]: audit 2024-05-20T22:05:52.894427+0000 mon.a (mon.0) 659 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:54.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:53 smithi050 bash[21866]: audit 2024-05-20T22:05:52.896702+0000 mon.a (mon.0) 660 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:54.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:53 smithi050 bash[21866]: audit 2024-05-20T22:05:52.898340+0000 mon.a (mon.0) 661 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:54.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:53 smithi050 bash[21866]: audit 2024-05-20T22:05:52.899814+0000 mon.a (mon.0) 662 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:54.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:53 smithi050 bash[21866]: audit 2024-05-20T22:05:52.901322+0000 mon.a (mon.0) 663 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:54.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:53 smithi050 bash[21866]: cephadm 2024-05-20T22:05:52.902524+0000 mgr.y (mgr.14150) 321 : cephadm 1 Adjusting osd_memory_target on smithi145 to 4316M 2024-05-20T22:05:54.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:53 smithi050 bash[21866]: audit 2024-05-20T22:05:52.908105+0000 mon.a (mon.0) 664 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:54.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:53 smithi050 bash[21866]: audit 2024-05-20T22:05:52.912803+0000 mon.a (mon.0) 665 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:05:54.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:53 smithi050 bash[21866]: audit 2024-05-20T22:05:52.914453+0000 mon.a (mon.0) 666 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:05:54.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:53 smithi050 bash[21866]: audit 2024-05-20T22:05:52.922409+0000 mon.a (mon.0) 667 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:54.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:53 smithi050 bash[28929]: cephadm 2024-05-20T22:05:52.878162+0000 mgr.y (mgr.14150) 320 : cephadm 1 Detected new or changed devices on smithi145 2024-05-20T22:05:54.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:53 smithi050 bash[28929]: audit 2024-05-20T22:05:52.886041+0000 mon.a (mon.0) 658 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:54.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:53 smithi050 bash[28929]: audit 2024-05-20T22:05:52.894427+0000 mon.a (mon.0) 659 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:54.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:53 smithi050 bash[28929]: audit 2024-05-20T22:05:52.896702+0000 mon.a (mon.0) 660 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:54.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:53 smithi050 bash[28929]: audit 2024-05-20T22:05:52.898340+0000 mon.a (mon.0) 661 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:54.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:53 smithi050 bash[28929]: audit 2024-05-20T22:05:52.899814+0000 mon.a (mon.0) 662 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:54.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:53 smithi050 bash[28929]: audit 2024-05-20T22:05:52.901322+0000 mon.a (mon.0) 663 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:05:54.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:53 smithi050 bash[28929]: cephadm 2024-05-20T22:05:52.902524+0000 mgr.y (mgr.14150) 321 : cephadm 1 Adjusting osd_memory_target on smithi145 to 4316M 2024-05-20T22:05:54.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:53 smithi050 bash[28929]: audit 2024-05-20T22:05:52.908105+0000 mon.a (mon.0) 664 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:54.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:53 smithi050 bash[28929]: audit 2024-05-20T22:05:52.912803+0000 mon.a (mon.0) 665 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:05:54.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:53 smithi050 bash[28929]: audit 2024-05-20T22:05:52.914453+0000 mon.a (mon.0) 666 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:05:54.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:53 smithi050 bash[28929]: audit 2024-05-20T22:05:52.922409+0000 mon.a (mon.0) 667 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:05:55.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:54 smithi050 bash[28929]: cluster 2024-05-20T22:05:53.530792+0000 mgr.y (mgr.14150) 322 : cluster 0 pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-05-20T22:05:55.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:54 smithi050 bash[21866]: cluster 2024-05-20T22:05:53.530792+0000 mgr.y (mgr.14150) 322 : cluster 0 pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-05-20T22:05:55.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:54 smithi145 bash[23893]: cluster 2024-05-20T22:05:53.530792+0000 mgr.y (mgr.14150) 322 : cluster 0 pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-05-20T22:05:57.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:56 smithi050 bash[28929]: cluster 2024-05-20T22:05:55.531407+0000 mgr.y (mgr.14150) 323 : cluster 0 pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T22:05:57.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:56 smithi050 bash[21866]: cluster 2024-05-20T22:05:55.531407+0000 mgr.y (mgr.14150) 323 : cluster 0 pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T22:05:57.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:56 smithi145 bash[23893]: cluster 2024-05-20T22:05:55.531407+0000 mgr.y (mgr.14150) 323 : cluster 0 pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T22:05:57.675 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:05:59.043 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:05:58 smithi050 bash[21866]: cluster 2024-05-20T22:05:57.532055+0000 mgr.y (mgr.14150) 324 : cluster 0 pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-05-20T22:05:59.043 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:05:58 smithi050 bash[28929]: cluster 2024-05-20T22:05:57.532055+0000 mgr.y (mgr.14150) 324 : cluster 0 pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-05-20T22:05:59.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:05:58 smithi145 bash[23893]: cluster 2024-05-20T22:05:57.532055+0000 mgr.y (mgr.14150) 324 : cluster 0 pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-05-20T22:06:00.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a67407640 1 -- 172.21.15.50:0/3864688914 >> v1:172.21.15.50:6789/0 conn(0x7f6a6010a580 legacy=0x7f6a6010c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:00.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a67407640 1 -- 172.21.15.50:0/3864688914 shutdown_connections 2024-05-20T22:06:00.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a67407640 1 -- 172.21.15.50:0/3864688914 >> 172.21.15.50:0/3864688914 conn(0x7f6a600fd1e0 msgr2=0x7f6a600ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:06:00.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a67407640 1 -- 172.21.15.50:0/3864688914 shutdown_connections 2024-05-20T22:06:00.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a67407640 1 -- 172.21.15.50:0/3864688914 wait complete. 2024-05-20T22:06:00.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a67407640 1 Processor -- start 2024-05-20T22:06:00.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a67407640 1 -- start start 2024-05-20T22:06:00.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a67407640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f6a601a6700 con 0x7f6a6010a580 2024-05-20T22:06:00.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a67407640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f6a601a7940 con 0x7f6a6010e120 2024-05-20T22:06:00.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a67407640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f6a601a8b80 con 0x7f6a601076d0 2024-05-20T22:06:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a649a2640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6a6010a580 0x7f6a601a1590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57462/0 (socket says 172.21.15.50:57462) 2024-05-20T22:06:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a649a2640 1 -- 172.21.15.50:0/2810576834 learned_addr learned my addr 172.21.15.50:0/2810576834 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:06:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 788812180 0 0) 0x7f6a601a6700 con 0x7f6a6010a580 2024-05-20T22:06:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a4c003160 con 0x7f6a6010a580 2024-05-20T22:06:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4056550135 0 0) 0x7f6a601a8b80 con 0x7f6a601076d0 2024-05-20T22:06:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a601a6700 con 0x7f6a601076d0 2024-05-20T22:06:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 724930148 0 0) 0x7f6a4c003160 con 0x7f6a6010a580 2024-05-20T22:06:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a601a8b80 con 0x7f6a6010a580 2024-05-20T22:06:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f6a500043e0 con 0x7f6a6010a580 2024-05-20T22:06:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2613746783 0 0) 0x7f6a601a6700 con 0x7f6a601076d0 2024-05-20T22:06:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a4c003160 con 0x7f6a601076d0 2024-05-20T22:06:00.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2312995922 0 0) 0x7f6a601a7940 con 0x7f6a6010e120 2024-05-20T22:06:00.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a601a6700 con 0x7f6a6010e120 2024-05-20T22:06:00.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f6a5c001bb0 con 0x7f6a601076d0 2024-05-20T22:06:00.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 661441933 0 0) 0x7f6a601a8b80 con 0x7f6a6010a580 2024-05-20T22:06:00.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 >> v1:172.21.15.50:6790/0 conn(0x7f6a601076d0 legacy=0x7f6a6010d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:00.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 >> v1:172.21.15.145:6789/0 conn(0x7f6a6010e120 legacy=0x7f6a601a4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:00.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a601a9dc0 con 0x7f6a6010a580 2024-05-20T22:06:00.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a67407640 1 -- 172.21.15.50:0/2810576834 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6a601a6930 con 0x7f6a6010a580 2024-05-20T22:06:00.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a67407640 1 -- 172.21.15.50:0/2810576834 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6a601a6df0 con 0x7f6a6010a580 2024-05-20T22:06:00.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f6a500019e0 con 0x7f6a6010a580 2024-05-20T22:06:00.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f6a50004ce0 con 0x7f6a6010a580 2024-05-20T22:06:00.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.381+0000 7f6a67407640 1 -- 172.21.15.50:0/2810576834 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a44005080 con 0x7f6a6010a580 2024-05-20T22:06:00.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.385+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 15) ==== 92081+0+0 (unknown 2274281742 0 0) 0x7f6a50004e80 con 0x7f6a6010a580 2024-05-20T22:06:00.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.385+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(58..58 src has 1..58) ==== 4081+0+0 (unknown 1721900872 0 0) 0x7f6a50088d60 con 0x7f6a6010a580 2024-05-20T22:06:00.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.389+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f6a50056ce0 con 0x7f6a6010a580 2024-05-20T22:06:00.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.585+0000 7f6a67407640 1 -- 172.21.15.50:0/2810576834 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a44005370 con 0x7f6a6010a580 2024-05-20T22:06:00.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.585+0000 7f6a567fc640 1 -- 172.21.15.50:0/2810576834 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+11505 (unknown 2626357731 0 1518543063) 0x7f6a500565e0 con 0x7f6a6010a580 2024-05-20T22:06:00.585 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-20T22:06:00.585 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":58,"fsid":"9a9abba0-16f3-11ef-bc9a-c7b262605968","created":"2024-05-20T21:56:19.800804+0000","modified":"2024-05-20T22:05:46.293596+0000","last_up_change":"2024-05-20T22:05:42.257017+0000","last_in_change":"2024-05-20T22:05:17.807939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T22:01:30.033740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e24659f-5dce-416d-83fd-beff6359fc45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":4039291270}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":4039291270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":4039291270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":4039291270}]},"public_addr":"172.21.15.50:6801/4039291270","cluster_addr":"172.21.15.50:6802/4039291270","heartbeat_back_addr":"172.21.15.50:6804/4039291270","heartbeat_front_addr":"172.21.15.50:6803/4039291270","state":["exists","up"]},{"osd":1,"uuid":"507cd562-6be9-4469-bafe-17f52cd04ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":4214903941}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":4214903941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":4214903941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":4214903941}]},"public_addr":"172.21.15.50:6805/4214903941","cluster_addr":"172.21.15.50:6806/4214903941","heartbeat_back_addr":"172.21.15.50:6808/4214903941","heartbeat_front_addr":"172.21.15.50:6807/4214903941","state":["exists","up"]},{"osd":2,"uuid":"a21d4e6b-3116-4dcd-a4fe-a224f2082926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":3675120581}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":3675120581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":3675120581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":3675120581}]},"public_addr":"172.21.15.50:6809/3675120581","cluster_addr":"172.21.15.50:6810/3675120581","heartbeat_back_addr":"172.21.15.50:6812/3675120581","heartbeat_front_addr":"172.21.15.50:6811/3675120581","state":["exists","up"]},{"osd":3,"uuid":"6e60bb64-706c-438b-8edf-49c2709374c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":3714877290}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":3714877290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":3714877290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":3714877290}]},"public_addr":"172.21.15.50:6813/3714877290","cluster_addr":"172.21.15.50:6814/3714877290","heartbeat_back_addr":"172.21.15.50:6816/3714877290","heartbeat_front_addr":"172.21.15.50:6815/3714877290","state":["exists","up"]},{"osd":4,"uuid":"369f2c71-4164-48c1-aaa5-5cd9a5644309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6800","nonce":2241357489}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6801","nonce":2241357489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6803","nonce":2241357489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6802","nonce":2241357489}]},"public_addr":"172.21.15.145:6800/2241357489","cluster_addr":"172.21.15.145:6801/2241357489","heartbeat_back_addr":"172.21.15.145:6803/2241357489","heartbeat_front_addr":"172.21.15.145:6802/2241357489","state":["exists","up"]},{"osd":5,"uuid":"706eb62f-93b9-4465-a352-cade0e490194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6804","nonce":1463480843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6805","nonce":1463480843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6807","nonce":1463480843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6806","nonce":1463480843}]},"public_addr":"172.21.15.145:6804/1463480843","cluster_addr":"172.21.15.145:6805/1463480843","heartbeat_back_addr":"172.21.15.145:6807/1463480843","heartbeat_front_addr":"172.21.15.145:6806/1463480843","state":["exists","up"]},{"osd":6,"uuid":"cb87446a-56f6-4a73-813b-ce70360ae5f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6808","nonce":856530538}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6809","nonce":856530538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6811","nonce":856530538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6810","nonce":856530538}]},"public_addr":"172.21.15.145:6808/856530538","cluster_addr":"172.21.15.145:6809/856530538","heartbeat_back_addr":"172.21.15.145:6811/856530538","heartbeat_front_addr":"172.21.15.145:6810/856530538","state":["exists","up"]},{"osd":7,"uuid":"a29bd67b-c55e-423c-b251-0ba4b656544a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6812","nonce":2864002573}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6813","nonce":2864002573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6815","nonce":2864002573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6814","nonce":2864002573}]},"public_addr":"172.21.15.145:6812/2864002573","cluster_addr":"172.21.15.145:6813/2864002573","heartbeat_back_addr":"172.21.15.145:6815/2864002573","heartbeat_front_addr":"172.21.15.145:6814/2864002573","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T21:59:41.084272+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:00:34.330079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:01:27.148884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:02:20.988321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:03:10.755672+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:04:00.708157+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:04:50.388089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:05:41.164844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/2157528765":"2024-05-21T21:57:17.389846+0000","172.21.15.50:6800/3032841639":"2024-05-21T21:57:17.389846+0000","172.21.15.50:0/1181319036":"2024-05-21T21:57:17.389846+0000","172.21.15.50:0/3504814165":"2024-05-21T21:57:17.389846+0000","172.21.15.50:0/3248870305":"2024-05-21T21:56:45.401749+0000","172.21.15.50:0/2072209505":"2024-05-21T21:56:45.401749+0000","172.21.15.50:0/438442029":"2024-05-21T21:56:45.401749+0000","172.21.15.50:6800/2047033350":"2024-05-21T21:56:45.401749+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T22:06:00.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.589+0000 7f6a67407640 1 -- 172.21.15.50:0/2810576834 >> v1:172.21.15.50:6800/2944911247 conn(0x7f6a4c06edb0 legacy=0x7f6a4c071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:00.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.589+0000 7f6a67407640 1 -- 172.21.15.50:0/2810576834 >> v1:172.21.15.50:6789/0 conn(0x7f6a6010a580 legacy=0x7f6a601a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:00.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.589+0000 7f6a67407640 1 -- 172.21.15.50:0/2810576834 shutdown_connections 2024-05-20T22:06:00.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.589+0000 7f6a67407640 1 -- 172.21.15.50:0/2810576834 >> 172.21.15.50:0/2810576834 conn(0x7f6a600fd1e0 msgr2=0x7f6a600ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:06:00.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.589+0000 7f6a67407640 1 -- 172.21.15.50:0/2810576834 shutdown_connections 2024-05-20T22:06:00.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:00.589+0000 7f6a67407640 1 -- 172.21.15.50:0/2810576834 wait complete. 2024-05-20T22:06:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:00 smithi050 bash[28929]: cluster 2024-05-20T22:05:59.532478+0000 mgr.y (mgr.14150) 325 : cluster 0 pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:01.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:00 smithi050 bash[28929]: audit 2024-05-20T22:06:00.588915+0000 mon.a (mon.0) 668 : audit 0 from='client.? v1:172.21.15.50:0/2810576834' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T22:06:01.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:00 smithi050 bash[21866]: cluster 2024-05-20T22:05:59.532478+0000 mgr.y (mgr.14150) 325 : cluster 0 pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:01.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:00 smithi050 bash[21866]: audit 2024-05-20T22:06:00.588915+0000 mon.a (mon.0) 668 : audit 0 from='client.? v1:172.21.15.50:0/2810576834' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T22:06:01.255 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T22:01:30.033740+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T22:06:01.256 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-20T22:06:01.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:00 smithi145 bash[23893]: cluster 2024-05-20T22:05:59.532478+0000 mgr.y (mgr.14150) 325 : cluster 0 pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:01.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:00 smithi145 bash[23893]: audit 2024-05-20T22:06:00.588915+0000 mon.a (mon.0) 668 : audit 0 from='client.? v1:172.21.15.50:0/2810576834' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T22:06:03.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:02 smithi050 bash[28929]: cluster 2024-05-20T22:06:01.533003+0000 mgr.y (mgr.14150) 326 : cluster 0 pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:03.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:02 smithi050 bash[21866]: cluster 2024-05-20T22:06:01.533003+0000 mgr.y (mgr.14150) 326 : cluster 0 pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:03.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:02 smithi145 bash[23893]: cluster 2024-05-20T22:06:01.533003+0000 mgr.y (mgr.14150) 326 : cluster 0 pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:05.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:04 smithi050 bash[28929]: cluster 2024-05-20T22:06:03.533555+0000 mgr.y (mgr.14150) 327 : cluster 0 pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:05.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:04 smithi050 bash[21866]: cluster 2024-05-20T22:06:03.533555+0000 mgr.y (mgr.14150) 327 : cluster 0 pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:05.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:04 smithi145 bash[23893]: cluster 2024-05-20T22:06:03.533555+0000 mgr.y (mgr.14150) 327 : cluster 0 pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:06.021 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:06:07.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:06 smithi050 bash[21866]: cluster 2024-05-20T22:06:05.534102+0000 mgr.y (mgr.14150) 328 : cluster 0 pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:07.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:06 smithi050 bash[28929]: cluster 2024-05-20T22:06:05.534102+0000 mgr.y (mgr.14150) 328 : cluster 0 pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:07.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:06 smithi145 bash[23893]: cluster 2024-05-20T22:06:05.534102+0000 mgr.y (mgr.14150) 328 : cluster 0 pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:08.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.589+0000 7f3840742640 1 -- 172.21.15.50:0/2296244459 >> v1:172.21.15.50:6790/0 conn(0x7f3838110bf0 legacy=0x7f3838112fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:08.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.589+0000 7f3840742640 1 -- 172.21.15.50:0/2296244459 shutdown_connections 2024-05-20T22:06:08.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.589+0000 7f3840742640 1 -- 172.21.15.50:0/2296244459 >> 172.21.15.50:0/2296244459 conn(0x7f3838077400 msgr2=0x7f3838079820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:06:08.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.589+0000 7f3840742640 1 -- 172.21.15.50:0/2296244459 shutdown_connections 2024-05-20T22:06:08.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.589+0000 7f3840742640 1 -- 172.21.15.50:0/2296244459 wait complete. 2024-05-20T22:06:08.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.589+0000 7f3840742640 1 Processor -- start 2024-05-20T22:06:08.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.589+0000 7f3840742640 1 -- start start 2024-05-20T22:06:08.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.589+0000 7f3840742640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f38381acc90 con 0x7f3838110bf0 2024-05-20T22:06:08.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.589+0000 7f3840742640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f38381aded0 con 0x7f3838107f60 2024-05-20T22:06:08.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.589+0000 7f3840742640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f38381af110 con 0x7f3838114760 2024-05-20T22:06:08.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.589+0000 7f383ecdf640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7f3838114760 0x7f38381ab390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:60950/0 (socket says 172.21.15.50:60950) 2024-05-20T22:06:08.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.589+0000 7f383ecdf640 1 -- 172.21.15.50:0/411392611 learned_addr learned my addr 172.21.15.50:0/411392611 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:06:08.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 606281601 0 0) 0x7f38381af110 con 0x7f3838114760 2024-05-20T22:06:08.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3824003160 con 0x7f3838114760 2024-05-20T22:06:08.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3269555733 0 0) 0x7f38381acc90 con 0x7f3838110bf0 2024-05-20T22:06:08.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38381af110 con 0x7f3838110bf0 2024-05-20T22:06:08.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2494961216 0 0) 0x7f3824003160 con 0x7f3838114760 2024-05-20T22:06:08.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f38381acc90 con 0x7f3838114760 2024-05-20T22:06:08.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f3830001c70 con 0x7f3838114760 2024-05-20T22:06:08.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 947784796 0 0) 0x7f38381aded0 con 0x7f3838107f60 2024-05-20T22:06:08.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3824003160 con 0x7f3838107f60 2024-05-20T22:06:08.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1372082696 0 0) 0x7f38381af110 con 0x7f3838110bf0 2024-05-20T22:06:08.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f38381aded0 con 0x7f3838110bf0 2024-05-20T22:06:08.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f3828004340 con 0x7f3838110bf0 2024-05-20T22:06:08.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 349470230 0 0) 0x7f38381acc90 con 0x7f3838114760 2024-05-20T22:06:08.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 >> v1:172.21.15.145:6789/0 conn(0x7f3838107f60 legacy=0x7f383810d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:08.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 >> v1:172.21.15.50:6789/0 conn(0x7f3838110bf0 legacy=0x7f38381a7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:08.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38381b0350 con 0x7f3838114760 2024-05-20T22:06:08.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f3840742640 1 -- 172.21.15.50:0/411392611 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f38381acec0 con 0x7f3838114760 2024-05-20T22:06:08.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f3840742640 1 -- 172.21.15.50:0/411392611 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f38381ad380 con 0x7f3838114760 2024-05-20T22:06:08.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f3830003e20 con 0x7f3838114760 2024-05-20T22:06:08.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f3830005fb0 con 0x7f3838114760 2024-05-20T22:06:08.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f3840742640 1 -- 172.21.15.50:0/411392611 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f381c005080 con 0x7f3838114760 2024-05-20T22:06:08.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 15) ==== 92081+0+0 (unknown 2274281742 0 0) 0x7f3830003970 con 0x7f3838114760 2024-05-20T22:06:08.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.593+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(58..58 src has 1..58) ==== 4081+0+0 (unknown 1721900872 0 0) 0x7f3830089090 con 0x7f3838114760 2024-05-20T22:06:08.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.597+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f3830057010 con 0x7f3838114760 2024-05-20T22:06:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.781+0000 7f3840742640 1 -- 172.21.15.50:0/411392611 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f381c005b80 con 0x7f3838114760 2024-05-20T22:06:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.785+0000 7f382f7fe640 1 -- 172.21.15.50:0/411392611 <== mon.2 v1:172.21.15.50:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) ==== 93+0+10 (unknown 3844627101 0 2170607528) 0x7f3830056910 con 0x7f3838114760 2024-05-20T22:06:08.783 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-05-20T22:06:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.785+0000 7f3840742640 1 -- 172.21.15.50:0/411392611 >> v1:172.21.15.50:6800/2944911247 conn(0x7f382406edd0 legacy=0x7f3824071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.785+0000 7f3840742640 1 -- 172.21.15.50:0/411392611 >> v1:172.21.15.50:6790/0 conn(0x7f3838114760 legacy=0x7f38381ab390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.785+0000 7f3840742640 1 -- 172.21.15.50:0/411392611 shutdown_connections 2024-05-20T22:06:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.785+0000 7f3840742640 1 -- 172.21.15.50:0/411392611 >> 172.21.15.50:0/411392611 conn(0x7f3838077400 msgr2=0x7f38381178b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:06:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.785+0000 7f3840742640 1 -- 172.21.15.50:0/411392611 shutdown_connections 2024-05-20T22:06:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:06:08.785+0000 7f3840742640 1 -- 172.21.15.50:0/411392611 wait complete. 2024-05-20T22:06:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:08 smithi050 bash[21866]: cluster 2024-05-20T22:06:07.534702+0000 mgr.y (mgr.14150) 329 : cluster 0 pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:09.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:08 smithi050 bash[21866]: audit 2024-05-20T22:06:08.788084+0000 mon.c (mon.2) 11 : audit 0 from='client.? v1:172.21.15.50:0/411392611' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T22:06:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:08 smithi050 bash[28929]: cluster 2024-05-20T22:06:07.534702+0000 mgr.y (mgr.14150) 329 : cluster 0 pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:08 smithi050 bash[28929]: audit 2024-05-20T22:06:08.788084+0000 mon.c (mon.2) 11 : audit 0 from='client.? v1:172.21.15.50:0/411392611' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T22:06:09.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:08 smithi145 bash[23893]: cluster 2024-05-20T22:06:07.534702+0000 mgr.y (mgr.14150) 329 : cluster 0 pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:09.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:08 smithi145 bash[23893]: audit 2024-05-20T22:06:08.788084+0000 mon.c (mon.2) 11 : audit 0 from='client.? v1:172.21.15.50:0/411392611' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T22:06:09.486 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on smithi050 2024-05-20T22:06:09.487 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph orch apply rgw foo.a --placement '1;smithi050=foo.a' 2024-05-20T22:06:11.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:10 smithi145 bash[23893]: cluster 2024-05-20T22:06:09.535316+0000 mgr.y (mgr.14150) 330 : cluster 0 pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:11.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:10 smithi050 bash[21866]: cluster 2024-05-20T22:06:09.535316+0000 mgr.y (mgr.14150) 330 : cluster 0 pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:11.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:10 smithi050 bash[28929]: cluster 2024-05-20T22:06:09.535316+0000 mgr.y (mgr.14150) 330 : cluster 0 pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:13.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:12 smithi145 bash[23893]: cluster 2024-05-20T22:06:11.535957+0000 mgr.y (mgr.14150) 331 : cluster 0 pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:13.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:12 smithi050 bash[21866]: cluster 2024-05-20T22:06:11.535957+0000 mgr.y (mgr.14150) 331 : cluster 0 pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:13.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:12 smithi050 bash[28929]: cluster 2024-05-20T22:06:11.535957+0000 mgr.y (mgr.14150) 331 : cluster 0 pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:14.237 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T22:06:15.342 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:14 smithi145 bash[23893]: cluster 2024-05-20T22:06:13.536562+0000 mgr.y (mgr.14150) 332 : cluster 0 pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:15.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:14 smithi050 bash[21866]: cluster 2024-05-20T22:06:13.536562+0000 mgr.y (mgr.14150) 332 : cluster 0 pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:15.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:14 smithi050 bash[28929]: cluster 2024-05-20T22:06:13.536562+0000 mgr.y (mgr.14150) 332 : cluster 0 pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:16.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b1ba41640 1 -- 172.21.15.145:0/1087280195 >> v1:172.21.15.145:6789/0 conn(0x7f9b1410baa0 legacy=0x7f9b1410df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:16.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b1ba41640 1 -- 172.21.15.145:0/1087280195 shutdown_connections 2024-05-20T22:06:16.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b1ba41640 1 -- 172.21.15.145:0/1087280195 >> 172.21.15.145:0/1087280195 conn(0x7f9b140feed0 msgr2=0x7f9b14101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:06:16.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b1ba41640 1 -- 172.21.15.145:0/1087280195 shutdown_connections 2024-05-20T22:06:16.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b1ba41640 1 -- 172.21.15.145:0/1087280195 wait complete. 2024-05-20T22:06:16.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b1ba41640 1 Processor -- start 2024-05-20T22:06:16.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b1ba41640 1 -- start start 2024-05-20T22:06:16.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b1ba41640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f9b14199a60 con 0x7f9b1410baa0 2024-05-20T22:06:16.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b1ba41640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f9b141a52b0 con 0x7f9b14107d60 2024-05-20T22:06:16.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b1ba41640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f9b141a6490 con 0x7f9b14103930 2024-05-20T22:06:16.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b18fdc640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f9b14107d60 0x7f9b1419f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:38718/0 (socket says 172.21.15.145:38718) 2024-05-20T22:06:16.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b18fdc640 1 -- 172.21.15.145:0/603930271 learned_addr learned my addr 172.21.15.145:0/603930271 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-05-20T22:06:16.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b0a7fc640 1 -- 172.21.15.145:0/603930271 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1441808065 0 0) 0x7f9b141a52b0 con 0x7f9b14107d60 2024-05-20T22:06:16.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b0a7fc640 1 -- 172.21.15.145:0/603930271 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b00003520 con 0x7f9b14107d60 2024-05-20T22:06:16.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b0a7fc640 1 -- 172.21.15.145:0/603930271 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 35664998 0 0) 0x7f9b00003520 con 0x7f9b14107d60 2024-05-20T22:06:16.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b0a7fc640 1 -- 172.21.15.145:0/603930271 --> v1:172.21.15.145:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b141a52b0 con 0x7f9b14107d60 2024-05-20T22:06:16.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b0a7fc640 1 -- 172.21.15.145:0/603930271 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f9b10001870 con 0x7f9b14107d60 2024-05-20T22:06:16.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b0a7fc640 1 -- 172.21.15.145:0/603930271 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 25372876 0 0) 0x7f9b141a6490 con 0x7f9b14103930 2024-05-20T22:06:16.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b0a7fc640 1 -- 172.21.15.145:0/603930271 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b00003520 con 0x7f9b14103930 2024-05-20T22:06:16.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b0a7fc640 1 -- 172.21.15.145:0/603930271 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3253707883 0 0) 0x7f9b14199a60 con 0x7f9b1410baa0 2024-05-20T22:06:16.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b0a7fc640 1 -- 172.21.15.145:0/603930271 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b141a6490 con 0x7f9b1410baa0 2024-05-20T22:06:16.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b0a7fc640 1 -- 172.21.15.145:0/603930271 <== mon.1 v1:172.21.15.145:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1869733959 0 0) 0x7f9b141a52b0 con 0x7f9b14107d60 2024-05-20T22:06:16.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b0a7fc640 1 -- 172.21.15.145:0/603930271 >> v1:172.21.15.50:6790/0 conn(0x7f9b14103930 legacy=0x7f9b14198f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:16.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b0a7fc640 1 -- 172.21.15.145:0/603930271 >> v1:172.21.15.50:6789/0 conn(0x7f9b1410baa0 legacy=0x7f9b141a2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:16.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b0a7fc640 1 -- 172.21.15.145:0/603930271 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b141a7670 con 0x7f9b14107d60 2024-05-20T22:06:16.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b1ba41640 1 -- 172.21.15.145:0/603930271 --> v1:172.21.15.145:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9b141a66c0 con 0x7f9b14107d60 2024-05-20T22:06:16.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b1ba41640 1 -- 172.21.15.145:0/603930271 --> v1:172.21.15.145:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9b141a6c00 con 0x7f9b14107d60 2024-05-20T22:06:16.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b0a7fc640 1 -- 172.21.15.145:0/603930271 <== mon.1 v1:172.21.15.145:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f9b10001c80 con 0x7f9b14107d60 2024-05-20T22:06:16.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.531+0000 7f9b0a7fc640 1 -- 172.21.15.145:0/603930271 <== mon.1 v1:172.21.15.145:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f9b10005c80 con 0x7f9b14107d60 2024-05-20T22:06:16.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.535+0000 7f9b1ba41640 1 -- 172.21.15.145:0/603930271 --> v1:172.21.15.145:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af80050b0 con 0x7f9b14107d60 2024-05-20T22:06:16.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.535+0000 7f9b0a7fc640 1 -- 172.21.15.145:0/603930271 <== mon.1 v1:172.21.15.145:6789/0 7 ==== mgrmap(e 15) ==== 92081+0+0 (unknown 2274281742 0 0) 0x7f9b1001c5e0 con 0x7f9b14107d60 2024-05-20T22:06:16.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.535+0000 7f9b0a7fc640 1 -- 172.21.15.145:0/603930271 <== mon.1 v1:172.21.15.145:6789/0 8 ==== osd_map(58..58 src has 1..58) ==== 4081+0+0 (unknown 1721900872 0 0) 0x7f9b10088ca0 con 0x7f9b14107d60 2024-05-20T22:06:16.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.539+0000 7f9b0a7fc640 1 -- 172.21.15.145:0/603930271 <== mon.1 v1:172.21.15.145:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f9b10003940 con 0x7f9b14107d60 2024-05-20T22:06:16.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.735+0000 7f9b1ba41640 1 -- 172.21.15.145:0/603930271 --> v1:172.21.15.50:6800/2944911247 -- mgr_command(tid 0: {"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi050=foo.a", "target": ["mon-mgr", ""]}) -- 0x7f9af8000bc0 con 0x7f9b0006ee80 2024-05-20T22:06:16.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.747+0000 7f9b0a7fc640 1 -- 172.21.15.145:0/603930271 <== mgr.14150 v1:172.21.15.50:6800/2944911247 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (unknown 0 0 1123153589) 0x7f9af8000bc0 con 0x7f9b0006ee80 2024-05-20T22:06:16.746 INFO:teuthology.orchestra.run.smithi145.stdout:Scheduled rgw.foo.a update... 2024-05-20T22:06:16.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.747+0000 7f9b1ba41640 1 -- 172.21.15.145:0/603930271 >> v1:172.21.15.50:6800/2944911247 conn(0x7f9b0006ee80 legacy=0x7f9b00071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:16.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.747+0000 7f9b1ba41640 1 -- 172.21.15.145:0/603930271 >> v1:172.21.15.145:6789/0 conn(0x7f9b14107d60 legacy=0x7f9b1419f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:16.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.747+0000 7f9b1ba41640 1 -- 172.21.15.145:0/603930271 shutdown_connections 2024-05-20T22:06:16.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.747+0000 7f9b1ba41640 1 -- 172.21.15.145:0/603930271 >> 172.21.15.145:0/603930271 conn(0x7f9b140feed0 msgr2=0x7f9b1410e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:06:16.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.751+0000 7f9b1ba41640 1 -- 172.21.15.145:0/603930271 shutdown_connections 2024-05-20T22:06:16.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:16.751+0000 7f9b1ba41640 1 -- 172.21.15.145:0/603930271 wait complete. 2024-05-20T22:06:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:16 smithi145 bash[23893]: cluster 2024-05-20T22:06:15.537165+0000 mgr.y (mgr.14150) 333 : cluster 0 pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:16 smithi145 bash[23893]: audit 2024-05-20T22:06:16.750369+0000 mon.a (mon.0) 669 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:16 smithi145 bash[23893]: audit 2024-05-20T22:06:16.752143+0000 mon.a (mon.0) 670 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:06:17.353 DEBUG:teuthology.orchestra.run.smithi050:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@rgw.foo.a.service 2024-05-20T22:06:17.356 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi145 2024-05-20T22:06:17.356 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph osd pool create datapool 3 3 replicated 2024-05-20T22:06:17.362 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:16 smithi050 bash[28929]: cluster 2024-05-20T22:06:15.537165+0000 mgr.y (mgr.14150) 333 : cluster 0 pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:17.362 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:16 smithi050 bash[28929]: audit 2024-05-20T22:06:16.750369+0000 mon.a (mon.0) 669 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:17.363 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:16 smithi050 bash[28929]: audit 2024-05-20T22:06:16.752143+0000 mon.a (mon.0) 670 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:06:17.363 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:16 smithi050 bash[21866]: cluster 2024-05-20T22:06:15.537165+0000 mgr.y (mgr.14150) 333 : cluster 0 pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:17.363 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:16 smithi050 bash[21866]: audit 2024-05-20T22:06:16.750369+0000 mon.a (mon.0) 669 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:17.363 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:16 smithi050 bash[21866]: audit 2024-05-20T22:06:16.752143+0000 mon.a (mon.0) 670 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:06:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:17 smithi050 bash[28929]: audit 2024-05-20T22:06:16.739843+0000 mgr.y (mgr.14150) 334 : audit 0 from='client.24364 v1:172.21.15.145:0/603930271' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi050=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:06:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:17 smithi050 bash[28929]: cephadm 2024-05-20T22:06:16.743491+0000 mgr.y (mgr.14150) 335 : cephadm 1 Saving service rgw.foo.a spec with placement smithi050=foo.a;count:1 2024-05-20T22:06:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:17 smithi050 bash[28929]: audit 2024-05-20T22:06:17.425545+0000 mon.a (mon.0) 671 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:17 smithi050 bash[28929]: audit 2024-05-20T22:06:17.426816+0000 mon.a (mon.0) 672 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:06:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:17 smithi050 bash[28929]: audit 2024-05-20T22:06:17.437121+0000 mon.a (mon.0) 673 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:18.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:17 smithi050 bash[28929]: audit 2024-05-20T22:06:17.442277+0000 mon.a (mon.0) 674 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-20T22:06:18.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:17 smithi050 bash[28929]: audit 2024-05-20T22:06:17.444497+0000 mon.a (mon.0) 675 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-20T22:06:18.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:17 smithi050 bash[28929]: audit 2024-05-20T22:06:17.458211+0000 mon.a (mon.0) 676 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:18.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:17 smithi050 bash[28929]: audit 2024-05-20T22:06:17.463278+0000 mon.a (mon.0) 677 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:18.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:17 smithi050 bash[21866]: audit 2024-05-20T22:06:16.739843+0000 mgr.y (mgr.14150) 334 : audit 0 from='client.24364 v1:172.21.15.145:0/603930271' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi050=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:06:18.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:17 smithi050 bash[21866]: cephadm 2024-05-20T22:06:16.743491+0000 mgr.y (mgr.14150) 335 : cephadm 1 Saving service rgw.foo.a spec with placement smithi050=foo.a;count:1 2024-05-20T22:06:18.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:17 smithi050 bash[21866]: audit 2024-05-20T22:06:17.425545+0000 mon.a (mon.0) 671 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:18.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:17 smithi050 bash[21866]: audit 2024-05-20T22:06:17.426816+0000 mon.a (mon.0) 672 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:06:18.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:17 smithi050 bash[21866]: audit 2024-05-20T22:06:17.437121+0000 mon.a (mon.0) 673 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:18.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:17 smithi050 bash[21866]: audit 2024-05-20T22:06:17.442277+0000 mon.a (mon.0) 674 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-20T22:06:18.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:17 smithi050 bash[21866]: audit 2024-05-20T22:06:17.444497+0000 mon.a (mon.0) 675 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-20T22:06:18.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:17 smithi050 bash[21866]: audit 2024-05-20T22:06:17.458211+0000 mon.a (mon.0) 676 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:18.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:17 smithi050 bash[21866]: audit 2024-05-20T22:06:17.463278+0000 mon.a (mon.0) 677 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:18.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:17 smithi145 bash[23893]: audit 2024-05-20T22:06:16.739843+0000 mgr.y (mgr.14150) 334 : audit 0 from='client.24364 v1:172.21.15.145:0/603930271' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi050=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:06:18.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:17 smithi145 bash[23893]: cephadm 2024-05-20T22:06:16.743491+0000 mgr.y (mgr.14150) 335 : cephadm 1 Saving service rgw.foo.a spec with placement smithi050=foo.a;count:1 2024-05-20T22:06:18.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:17 smithi145 bash[23893]: audit 2024-05-20T22:06:17.425545+0000 mon.a (mon.0) 671 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:18.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:17 smithi145 bash[23893]: audit 2024-05-20T22:06:17.426816+0000 mon.a (mon.0) 672 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:06:18.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:17 smithi145 bash[23893]: audit 2024-05-20T22:06:17.437121+0000 mon.a (mon.0) 673 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:18.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:17 smithi145 bash[23893]: audit 2024-05-20T22:06:17.442277+0000 mon.a (mon.0) 674 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-20T22:06:18.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:17 smithi145 bash[23893]: audit 2024-05-20T22:06:17.444497+0000 mon.a (mon.0) 675 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-20T22:06:18.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:17 smithi145 bash[23893]: audit 2024-05-20T22:06:17.458211+0000 mon.a (mon.0) 676 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:18.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:17 smithi145 bash[23893]: audit 2024-05-20T22:06:17.463278+0000 mon.a (mon.0) 677 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:19.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:18 smithi050 bash[21866]: cephadm 2024-05-20T22:06:17.467962+0000 mgr.y (mgr.14150) 336 : cephadm 1 Deploying daemon rgw.foo.a on smithi050 2024-05-20T22:06:19.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:18 smithi050 bash[21866]: cluster 2024-05-20T22:06:17.537749+0000 mgr.y (mgr.14150) 337 : cluster 0 pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:19.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:18 smithi050 bash[28929]: cephadm 2024-05-20T22:06:17.467962+0000 mgr.y (mgr.14150) 336 : cephadm 1 Deploying daemon rgw.foo.a on smithi050 2024-05-20T22:06:19.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:18 smithi050 bash[28929]: cluster 2024-05-20T22:06:17.537749+0000 mgr.y (mgr.14150) 337 : cluster 0 pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:19.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:18 smithi145 bash[23893]: cephadm 2024-05-20T22:06:17.467962+0000 mgr.y (mgr.14150) 336 : cephadm 1 Deploying daemon rgw.foo.a on smithi050 2024-05-20T22:06:19.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:18 smithi145 bash[23893]: cluster 2024-05-20T22:06:17.537749+0000 mgr.y (mgr.14150) 337 : cluster 0 pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:20.035 INFO:journalctl@ceph.osd.2.smithi050.stdout:May 20 22:06:19 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:20.036 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:19 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:20.036 INFO:journalctl@ceph.osd.1.smithi050.stdout:May 20 22:06:19 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:20.036 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:06:19 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:20.037 INFO:journalctl@ceph.osd.0.smithi050.stdout:May 20 22:06:19 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:20.037 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:19 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:20.037 INFO:journalctl@ceph.osd.3.smithi050.stdout:May 20 22:06:19 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:20.038 INFO:journalctl@ceph.rgw.foo.a.smithi050.stdout:May 20 22:06:20 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:20.318 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:20 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:20.319 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:06:20 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:20.319 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:20 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:20.319 INFO:journalctl@ceph.osd.0.smithi050.stdout:May 20 22:06:20 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:20.319 INFO:journalctl@ceph.osd.1.smithi050.stdout:May 20 22:06:20 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:20.320 INFO:journalctl@ceph.osd.2.smithi050.stdout:May 20 22:06:20 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:20.320 INFO:journalctl@ceph.rgw.foo.a.smithi050.stdout:May 20 22:06:20 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:20.320 INFO:journalctl@ceph.rgw.foo.a.smithi050.stdout:May 20 22:06:20 smithi050 systemd[1]: Started Ceph rgw.foo.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968. 2024-05-20T22:06:20.320 INFO:journalctl@ceph.osd.3.smithi050.stdout:May 20 22:06:20 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:21.233 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:20 smithi050 bash[21866]: cluster 2024-05-20T22:06:19.538354+0000 mgr.y (mgr.14150) 338 : cluster 0 pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:21.233 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:20 smithi050 bash[21866]: audit 2024-05-20T22:06:20.318404+0000 mon.a (mon.0) 678 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:21.233 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:20 smithi050 bash[21866]: audit 2024-05-20T22:06:20.324351+0000 mon.a (mon.0) 679 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:21.233 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:20 smithi050 bash[21866]: audit 2024-05-20T22:06:20.328439+0000 mon.a (mon.0) 680 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:21.233 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:20 smithi050 bash[21866]: audit 2024-05-20T22:06:20.334526+0000 mon.a (mon.0) 681 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:21.233 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:20 smithi050 bash[21866]: audit 2024-05-20T22:06:20.341470+0000 mon.a (mon.0) 682 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:21.233 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:20 smithi050 bash[21866]: audit 2024-05-20T22:06:20.371298+0000 mon.a (mon.0) 683 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:06:21.233 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:20 smithi050 bash[21866]: audit 2024-05-20T22:06:20.720006+0000 mon.a (mon.0) 684 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:21.234 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:20 smithi050 bash[28929]: cluster 2024-05-20T22:06:19.538354+0000 mgr.y (mgr.14150) 338 : cluster 0 pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:21.234 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:20 smithi050 bash[28929]: audit 2024-05-20T22:06:20.318404+0000 mon.a (mon.0) 678 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:21.234 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:20 smithi050 bash[28929]: audit 2024-05-20T22:06:20.324351+0000 mon.a (mon.0) 679 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:21.234 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:20 smithi050 bash[28929]: audit 2024-05-20T22:06:20.328439+0000 mon.a (mon.0) 680 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:21.234 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:20 smithi050 bash[28929]: audit 2024-05-20T22:06:20.334526+0000 mon.a (mon.0) 681 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:21.234 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:20 smithi050 bash[28929]: audit 2024-05-20T22:06:20.341470+0000 mon.a (mon.0) 682 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:21.234 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:20 smithi050 bash[28929]: audit 2024-05-20T22:06:20.371298+0000 mon.a (mon.0) 683 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:06:21.234 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:20 smithi050 bash[28929]: audit 2024-05-20T22:06:20.720006+0000 mon.a (mon.0) 684 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:20 smithi145 bash[23893]: cluster 2024-05-20T22:06:19.538354+0000 mgr.y (mgr.14150) 338 : cluster 0 pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:20 smithi145 bash[23893]: audit 2024-05-20T22:06:20.318404+0000 mon.a (mon.0) 678 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:20 smithi145 bash[23893]: audit 2024-05-20T22:06:20.324351+0000 mon.a (mon.0) 679 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:20 smithi145 bash[23893]: audit 2024-05-20T22:06:20.328439+0000 mon.a (mon.0) 680 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:20 smithi145 bash[23893]: audit 2024-05-20T22:06:20.334526+0000 mon.a (mon.0) 681 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:20 smithi145 bash[23893]: audit 2024-05-20T22:06:20.341470+0000 mon.a (mon.0) 682 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:20 smithi145 bash[23893]: audit 2024-05-20T22:06:20.371298+0000 mon.a (mon.0) 683 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:06:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:20 smithi145 bash[23893]: audit 2024-05-20T22:06:20.720006+0000 mon.a (mon.0) 684 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:22.095 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T22:06:22.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:21 smithi145 bash[23893]: cephadm 2024-05-20T22:06:20.329078+0000 mgr.y (mgr.14150) 339 : cephadm 1 Saving service rgw.foo.a spec with placement smithi050=foo.a;count:1 2024-05-20T22:06:22.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:21 smithi050 bash[21866]: cephadm 2024-05-20T22:06:20.329078+0000 mgr.y (mgr.14150) 339 : cephadm 1 Saving service rgw.foo.a spec with placement smithi050=foo.a;count:1 2024-05-20T22:06:22.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:21 smithi050 bash[28929]: cephadm 2024-05-20T22:06:20.329078+0000 mgr.y (mgr.14150) 339 : cephadm 1 Saving service rgw.foo.a spec with placement smithi050=foo.a;count:1 2024-05-20T22:06:23.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:23 smithi145 bash[23893]: cluster 2024-05-20T22:06:21.538873+0000 mgr.y (mgr.14150) 340 : cluster 0 pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:23.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:23 smithi145 bash[23893]: cluster 2024-05-20T22:06:21.989172+0000 mon.a (mon.0) 685 : cluster 0 osdmap e59: 8 total, 8 up, 8 in 2024-05-20T22:06:23.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:23 smithi145 bash[23893]: audit 2024-05-20T22:06:21.992214+0000 mon.c (mon.2) 12 : audit 1 from='client.? v1:172.21.15.50:0/3716037753' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-05-20T22:06:23.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:23 smithi145 bash[23893]: audit 2024-05-20T22:06:21.992919+0000 mon.a (mon.0) 686 : audit 1 from='client.24359 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-05-20T22:06:23.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:23 smithi050 bash[28929]: cluster 2024-05-20T22:06:21.538873+0000 mgr.y (mgr.14150) 340 : cluster 0 pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:23.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:23 smithi050 bash[28929]: cluster 2024-05-20T22:06:21.989172+0000 mon.a (mon.0) 685 : cluster 0 osdmap e59: 8 total, 8 up, 8 in 2024-05-20T22:06:23.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:23 smithi050 bash[28929]: audit 2024-05-20T22:06:21.992214+0000 mon.c (mon.2) 12 : audit 1 from='client.? v1:172.21.15.50:0/3716037753' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-05-20T22:06:23.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:23 smithi050 bash[28929]: audit 2024-05-20T22:06:21.992919+0000 mon.a (mon.0) 686 : audit 1 from='client.24359 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-05-20T22:06:23.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:23 smithi050 bash[21866]: cluster 2024-05-20T22:06:21.538873+0000 mgr.y (mgr.14150) 340 : cluster 0 pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:23.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:23 smithi050 bash[21866]: cluster 2024-05-20T22:06:21.989172+0000 mon.a (mon.0) 685 : cluster 0 osdmap e59: 8 total, 8 up, 8 in 2024-05-20T22:06:23.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:23 smithi050 bash[21866]: audit 2024-05-20T22:06:21.992214+0000 mon.c (mon.2) 12 : audit 1 from='client.? v1:172.21.15.50:0/3716037753' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-05-20T22:06:23.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:23 smithi050 bash[21866]: audit 2024-05-20T22:06:21.992919+0000 mon.a (mon.0) 686 : audit 1 from='client.24359 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-05-20T22:06:24.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.375+0000 7facb4024640 1 -- 172.21.15.145:0/4071222386 >> v1:172.21.15.145:6789/0 conn(0x7facac109880 legacy=0x7facac10bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:24.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.375+0000 7facb4024640 1 -- 172.21.15.145:0/4071222386 shutdown_connections 2024-05-20T22:06:24.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.375+0000 7facb4024640 1 -- 172.21.15.145:0/4071222386 >> 172.21.15.145:0/4071222386 conn(0x7facac0fccb0 msgr2=0x7facac0ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:06:24.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.375+0000 7facb4024640 1 -- 172.21.15.145:0/4071222386 shutdown_connections 2024-05-20T22:06:24.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.375+0000 7facb4024640 1 -- 172.21.15.145:0/4071222386 wait complete. 2024-05-20T22:06:24.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.375+0000 7facb4024640 1 Processor -- start 2024-05-20T22:06:24.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.375+0000 7facb4024640 1 -- start start 2024-05-20T22:06:24.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.375+0000 7facb4024640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7facac0ff280 con 0x7facac101710 2024-05-20T22:06:24.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.375+0000 7facb4024640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7facac1a52e0 con 0x7facac109880 2024-05-20T22:06:24.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.375+0000 7facb4024640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7facac1a64c0 con 0x7facac105b40 2024-05-20T22:06:24.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.375+0000 7facb25c1640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7facac109880 0x7facac1a2bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:48174/0 (socket says 172.21.15.145:48174) 2024-05-20T22:06:24.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.375+0000 7facb25c1640 1 -- 172.21.15.145:0/3460620039 learned_addr learned my addr 172.21.15.145:0/3460620039 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-05-20T22:06:24.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.375+0000 7faca2ffd640 1 -- 172.21.15.145:0/3460620039 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1420689297 0 0) 0x7facac1a52e0 con 0x7facac109880 2024-05-20T22:06:24.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.375+0000 7faca2ffd640 1 -- 172.21.15.145:0/3460620039 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac98003520 con 0x7facac109880 2024-05-20T22:06:24.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.375+0000 7faca2ffd640 1 -- 172.21.15.145:0/3460620039 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4104512376 0 0) 0x7fac98003520 con 0x7facac109880 2024-05-20T22:06:24.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.375+0000 7faca2ffd640 1 -- 172.21.15.145:0/3460620039 --> v1:172.21.15.145:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7facac1a52e0 con 0x7facac109880 2024-05-20T22:06:24.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.375+0000 7faca2ffd640 1 -- 172.21.15.145:0/3460620039 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7faca4001950 con 0x7facac109880 2024-05-20T22:06:24.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.379+0000 7faca2ffd640 1 -- 172.21.15.145:0/3460620039 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1621157495 0 0) 0x7facac0ff280 con 0x7facac101710 2024-05-20T22:06:24.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.379+0000 7faca2ffd640 1 -- 172.21.15.145:0/3460620039 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac98003520 con 0x7facac101710 2024-05-20T22:06:24.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.379+0000 7faca2ffd640 1 -- 172.21.15.145:0/3460620039 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2536976752 0 0) 0x7facac1a64c0 con 0x7facac105b40 2024-05-20T22:06:24.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.379+0000 7faca2ffd640 1 -- 172.21.15.145:0/3460620039 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facac0ff280 con 0x7facac105b40 2024-05-20T22:06:24.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.379+0000 7faca2ffd640 1 -- 172.21.15.145:0/3460620039 <== mon.1 v1:172.21.15.145:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1193563099 0 0) 0x7facac1a52e0 con 0x7facac109880 2024-05-20T22:06:24.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.379+0000 7faca2ffd640 1 -- 172.21.15.145:0/3460620039 >> v1:172.21.15.50:6790/0 conn(0x7facac105b40 legacy=0x7facac19f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:24.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.379+0000 7faca2ffd640 1 -- 172.21.15.145:0/3460620039 >> v1:172.21.15.50:6789/0 conn(0x7facac101710 legacy=0x7facac0fe7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:24.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.379+0000 7faca2ffd640 1 -- 172.21.15.145:0/3460620039 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facac1a76a0 con 0x7facac109880 2024-05-20T22:06:24.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.379+0000 7facb4024640 1 -- 172.21.15.145:0/3460620039 --> v1:172.21.15.145:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7facac1a4330 con 0x7facac109880 2024-05-20T22:06:24.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.379+0000 7facb4024640 1 -- 172.21.15.145:0/3460620039 --> v1:172.21.15.145:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7facac1a4870 con 0x7facac109880 2024-05-20T22:06:24.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.379+0000 7faca2ffd640 1 -- 172.21.15.145:0/3460620039 <== mon.1 v1:172.21.15.145:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7faca4001ff0 con 0x7facac109880 2024-05-20T22:06:24.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.379+0000 7faca2ffd640 1 -- 172.21.15.145:0/3460620039 <== mon.1 v1:172.21.15.145:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7faca40052e0 con 0x7facac109880 2024-05-20T22:06:24.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.379+0000 7facb4024640 1 -- 172.21.15.145:0/3460620039 --> v1:172.21.15.145:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac90005080 con 0x7facac109880 2024-05-20T22:06:24.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.379+0000 7faca2ffd640 1 -- 172.21.15.145:0/3460620039 <== mon.1 v1:172.21.15.145:6789/0 7 ==== mgrmap(e 15) ==== 92081+0+0 (unknown 2274281742 0 0) 0x7faca4005520 con 0x7facac109880 2024-05-20T22:06:24.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.379+0000 7faca2ffd640 1 -- 172.21.15.145:0/3460620039 <== mon.1 v1:172.21.15.145:6789/0 8 ==== osd_map(61..61 src has 1..61) ==== 4794+0+0 (unknown 3143446890 0 0) 0x7faca4089660 con 0x7facac109880 2024-05-20T22:06:24.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.383+0000 7faca2ffd640 1 -- 172.21.15.145:0/3460620039 <== mon.1 v1:172.21.15.145:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7faca4057320 con 0x7facac109880 2024-05-20T22:06:24.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:24 smithi145 bash[23893]: audit 2024-05-20T22:06:22.983699+0000 mon.a (mon.0) 687 : audit 1 from='client.24359 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-05-20T22:06:24.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:24 smithi145 bash[23893]: cluster 2024-05-20T22:06:22.991066+0000 mon.a (mon.0) 688 : cluster 0 osdmap e60: 8 total, 8 up, 8 in 2024-05-20T22:06:24.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:24 smithi145 bash[23893]: cluster 2024-05-20T22:06:23.995945+0000 mon.a (mon.0) 689 : cluster 0 osdmap e61: 8 total, 8 up, 8 in 2024-05-20T22:06:24.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:24 smithi050 bash[21866]: audit 2024-05-20T22:06:22.983699+0000 mon.a (mon.0) 687 : audit 1 from='client.24359 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-05-20T22:06:24.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:24 smithi050 bash[21866]: cluster 2024-05-20T22:06:22.991066+0000 mon.a (mon.0) 688 : cluster 0 osdmap e60: 8 total, 8 up, 8 in 2024-05-20T22:06:24.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:24 smithi050 bash[21866]: cluster 2024-05-20T22:06:23.995945+0000 mon.a (mon.0) 689 : cluster 0 osdmap e61: 8 total, 8 up, 8 in 2024-05-20T22:06:24.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:24 smithi050 bash[28929]: audit 2024-05-20T22:06:22.983699+0000 mon.a (mon.0) 687 : audit 1 from='client.24359 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-05-20T22:06:24.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:24 smithi050 bash[28929]: cluster 2024-05-20T22:06:22.991066+0000 mon.a (mon.0) 688 : cluster 0 osdmap e60: 8 total, 8 up, 8 in 2024-05-20T22:06:24.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:24 smithi050 bash[28929]: cluster 2024-05-20T22:06:23.995945+0000 mon.a (mon.0) 689 : cluster 0 osdmap e61: 8 total, 8 up, 8 in 2024-05-20T22:06:24.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:24.571+0000 7facb4024640 1 -- 172.21.15.145:0/3460620039 --> v1:172.21.15.145:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} v 0) -- 0x7fac90005370 con 0x7facac109880 2024-05-20T22:06:25.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:25.039+0000 7faca2ffd640 1 -- 172.21.15.145:0/3460620039 <== mon.1 v1:172.21.15.145:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]=0 pool 'datapool' created v62) ==== 160+0+0 (unknown 531222546 0 0) 0x7faca4056c20 con 0x7facac109880 2024-05-20T22:06:25.038 INFO:teuthology.orchestra.run.smithi145.stderr:pool 'datapool' created 2024-05-20T22:06:25.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:25.043+0000 7facb4024640 1 -- 172.21.15.145:0/3460620039 >> v1:172.21.15.50:6800/2944911247 conn(0x7fac9806ed90 legacy=0x7fac98071250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:25.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:25.043+0000 7facb4024640 1 -- 172.21.15.145:0/3460620039 >> v1:172.21.15.145:6789/0 conn(0x7facac109880 legacy=0x7facac1a2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:25.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:25.043+0000 7facb4024640 1 -- 172.21.15.145:0/3460620039 shutdown_connections 2024-05-20T22:06:25.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:25.047+0000 7facb4024640 1 -- 172.21.15.145:0/3460620039 >> 172.21.15.145:0/3460620039 conn(0x7facac0fccb0 msgr2=0x7facac10c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:06:25.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:25.047+0000 7facb4024640 1 -- 172.21.15.145:0/3460620039 shutdown_connections 2024-05-20T22:06:25.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:25.047+0000 7facb4024640 1 -- 172.21.15.145:0/3460620039 wait complete. 2024-05-20T22:06:25.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:25 smithi145 bash[23893]: cluster 2024-05-20T22:06:23.539409+0000 mgr.y (mgr.14150) 341 : cluster 0 pgmap v323: 33 pgs: 23 creating+peering, 4 active+clean, 6 unknown; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 127 B/s wr, 0 op/s 2024-05-20T22:06:25.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:25 smithi145 bash[23893]: audit 2024-05-20T22:06:24.004667+0000 mon.a (mon.0) 690 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-05-20T22:06:25.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:25 smithi050 bash[21866]: cluster 2024-05-20T22:06:23.539409+0000 mgr.y (mgr.14150) 341 : cluster 0 pgmap v323: 33 pgs: 23 creating+peering, 4 active+clean, 6 unknown; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 127 B/s wr, 0 op/s 2024-05-20T22:06:25.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:25 smithi050 bash[21866]: audit 2024-05-20T22:06:24.004667+0000 mon.a (mon.0) 690 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-05-20T22:06:25.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:25 smithi050 bash[28929]: cluster 2024-05-20T22:06:23.539409+0000 mgr.y (mgr.14150) 341 : cluster 0 pgmap v323: 33 pgs: 23 creating+peering, 4 active+clean, 6 unknown; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 127 B/s wr, 0 op/s 2024-05-20T22:06:25.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:25 smithi050 bash[28929]: audit 2024-05-20T22:06:24.004667+0000 mon.a (mon.0) 690 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-05-20T22:06:25.727 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- rbd pool init datapool 2024-05-20T22:06:26.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:26 smithi145 bash[23893]: audit 2024-05-20T22:06:24.573189+0000 mon.b (mon.1) 26 : audit 1 from='client.? v1:172.21.15.145:0/3460620039' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-05-20T22:06:26.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:26 smithi145 bash[23893]: audit 2024-05-20T22:06:24.574821+0000 mon.a (mon.0) 691 : audit 1 from='client.24388 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-05-20T22:06:26.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:26 smithi145 bash[23893]: audit 2024-05-20T22:06:25.034539+0000 mon.a (mon.0) 692 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-05-20T22:06:26.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:26 smithi145 bash[23893]: audit 2024-05-20T22:06:25.034717+0000 mon.a (mon.0) 693 : audit 1 from='client.24388 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-05-20T22:06:26.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:26 smithi145 bash[23893]: cluster 2024-05-20T22:06:25.040382+0000 mon.a (mon.0) 694 : cluster 0 osdmap e62: 8 total, 8 up, 8 in 2024-05-20T22:06:26.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:26 smithi145 bash[23893]: audit 2024-05-20T22:06:25.713738+0000 mon.a (mon.0) 695 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:26.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:26 smithi145 bash[23893]: audit 2024-05-20T22:06:25.718949+0000 mon.a (mon.0) 696 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:26.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:26 smithi145 bash[23893]: audit 2024-05-20T22:06:25.719898+0000 mon.a (mon.0) 697 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:26.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:26 smithi145 bash[23893]: audit 2024-05-20T22:06:25.720630+0000 mon.a (mon.0) 698 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:06:26.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:26 smithi050 bash[21866]: audit 2024-05-20T22:06:24.573189+0000 mon.b (mon.1) 26 : audit 1 from='client.? v1:172.21.15.145:0/3460620039' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-05-20T22:06:26.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:26 smithi050 bash[21866]: audit 2024-05-20T22:06:24.574821+0000 mon.a (mon.0) 691 : audit 1 from='client.24388 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-05-20T22:06:26.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:26 smithi050 bash[21866]: audit 2024-05-20T22:06:25.034539+0000 mon.a (mon.0) 692 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-05-20T22:06:26.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:26 smithi050 bash[21866]: audit 2024-05-20T22:06:25.034717+0000 mon.a (mon.0) 693 : audit 1 from='client.24388 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-05-20T22:06:26.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:26 smithi050 bash[21866]: cluster 2024-05-20T22:06:25.040382+0000 mon.a (mon.0) 694 : cluster 0 osdmap e62: 8 total, 8 up, 8 in 2024-05-20T22:06:26.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:26 smithi050 bash[21866]: audit 2024-05-20T22:06:25.713738+0000 mon.a (mon.0) 695 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:26.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:26 smithi050 bash[21866]: audit 2024-05-20T22:06:25.718949+0000 mon.a (mon.0) 696 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:26.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:26 smithi050 bash[21866]: audit 2024-05-20T22:06:25.719898+0000 mon.a (mon.0) 697 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:26.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:26 smithi050 bash[21866]: audit 2024-05-20T22:06:25.720630+0000 mon.a (mon.0) 698 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:06:26.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:26 smithi050 bash[28929]: audit 2024-05-20T22:06:24.573189+0000 mon.b (mon.1) 26 : audit 1 from='client.? v1:172.21.15.145:0/3460620039' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-05-20T22:06:26.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:26 smithi050 bash[28929]: audit 2024-05-20T22:06:24.574821+0000 mon.a (mon.0) 691 : audit 1 from='client.24388 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-05-20T22:06:26.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:26 smithi050 bash[28929]: audit 2024-05-20T22:06:25.034539+0000 mon.a (mon.0) 692 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-05-20T22:06:26.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:26 smithi050 bash[28929]: audit 2024-05-20T22:06:25.034717+0000 mon.a (mon.0) 693 : audit 1 from='client.24388 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-05-20T22:06:26.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:26 smithi050 bash[28929]: cluster 2024-05-20T22:06:25.040382+0000 mon.a (mon.0) 694 : cluster 0 osdmap e62: 8 total, 8 up, 8 in 2024-05-20T22:06:26.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:26 smithi050 bash[28929]: audit 2024-05-20T22:06:25.713738+0000 mon.a (mon.0) 695 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:26.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:26 smithi050 bash[28929]: audit 2024-05-20T22:06:25.718949+0000 mon.a (mon.0) 696 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:26.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:26 smithi050 bash[28929]: audit 2024-05-20T22:06:25.719898+0000 mon.a (mon.0) 697 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:26.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:26 smithi050 bash[28929]: audit 2024-05-20T22:06:25.720630+0000 mon.a (mon.0) 698 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:06:27.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:27 smithi145 bash[23893]: cluster 2024-05-20T22:06:25.539962+0000 mgr.y (mgr.14150) 342 : cluster 0 pgmap v326: 68 pgs: 23 creating+peering, 10 active+clean, 35 unknown; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-05-20T22:06:27.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:27 smithi145 bash[23893]: cephadm 2024-05-20T22:06:25.725055+0000 mgr.y (mgr.14150) 343 : cephadm 1 Checking dashboard <-> RGW credentials 2024-05-20T22:06:27.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:27 smithi145 bash[23893]: cluster 2024-05-20T22:06:26.364613+0000 mon.a (mon.0) 699 : cluster 3 Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:06:27.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:27 smithi145 bash[23893]: cluster 2024-05-20T22:06:26.375347+0000 mon.a (mon.0) 700 : cluster 0 osdmap e63: 8 total, 8 up, 8 in 2024-05-20T22:06:27.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:27 smithi145 bash[23893]: audit 2024-05-20T22:06:26.378978+0000 mon.a (mon.0) 701 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-05-20T22:06:27.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:27 smithi145 bash[23893]: audit 2024-05-20T22:06:26.388349+0000 mon.a (mon.0) 702 : audit 1 from='client.? v1:172.21.15.50:0/3188143680' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-05-20T22:06:27.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:27 smithi145 bash[23893]: audit 2024-05-20T22:06:27.369133+0000 mon.a (mon.0) 703 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-05-20T22:06:27.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:27 smithi145 bash[23893]: audit 2024-05-20T22:06:27.369310+0000 mon.a (mon.0) 704 : audit 1 from='client.? v1:172.21.15.50:0/3188143680' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-05-20T22:06:27.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:27 smithi145 bash[23893]: cluster 2024-05-20T22:06:27.377605+0000 mon.a (mon.0) 705 : cluster 0 osdmap e64: 8 total, 8 up, 8 in 2024-05-20T22:06:27.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:27 smithi050 bash[28929]: cluster 2024-05-20T22:06:25.539962+0000 mgr.y (mgr.14150) 342 : cluster 0 pgmap v326: 68 pgs: 23 creating+peering, 10 active+clean, 35 unknown; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-05-20T22:06:27.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:27 smithi050 bash[28929]: cephadm 2024-05-20T22:06:25.725055+0000 mgr.y (mgr.14150) 343 : cephadm 1 Checking dashboard <-> RGW credentials 2024-05-20T22:06:27.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:27 smithi050 bash[28929]: cluster 2024-05-20T22:06:26.364613+0000 mon.a (mon.0) 699 : cluster 3 Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:06:27.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:27 smithi050 bash[28929]: cluster 2024-05-20T22:06:26.375347+0000 mon.a (mon.0) 700 : cluster 0 osdmap e63: 8 total, 8 up, 8 in 2024-05-20T22:06:27.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:27 smithi050 bash[28929]: audit 2024-05-20T22:06:26.378978+0000 mon.a (mon.0) 701 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-05-20T22:06:27.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:27 smithi050 bash[28929]: audit 2024-05-20T22:06:26.388349+0000 mon.a (mon.0) 702 : audit 1 from='client.? v1:172.21.15.50:0/3188143680' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-05-20T22:06:27.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:27 smithi050 bash[28929]: audit 2024-05-20T22:06:27.369133+0000 mon.a (mon.0) 703 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-05-20T22:06:27.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:27 smithi050 bash[28929]: audit 2024-05-20T22:06:27.369310+0000 mon.a (mon.0) 704 : audit 1 from='client.? v1:172.21.15.50:0/3188143680' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-05-20T22:06:27.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:27 smithi050 bash[28929]: cluster 2024-05-20T22:06:27.377605+0000 mon.a (mon.0) 705 : cluster 0 osdmap e64: 8 total, 8 up, 8 in 2024-05-20T22:06:27.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:27 smithi050 bash[21866]: cluster 2024-05-20T22:06:25.539962+0000 mgr.y (mgr.14150) 342 : cluster 0 pgmap v326: 68 pgs: 23 creating+peering, 10 active+clean, 35 unknown; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-05-20T22:06:27.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:27 smithi050 bash[21866]: cephadm 2024-05-20T22:06:25.725055+0000 mgr.y (mgr.14150) 343 : cephadm 1 Checking dashboard <-> RGW credentials 2024-05-20T22:06:27.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:27 smithi050 bash[21866]: cluster 2024-05-20T22:06:26.364613+0000 mon.a (mon.0) 699 : cluster 3 Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:06:27.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:27 smithi050 bash[21866]: cluster 2024-05-20T22:06:26.375347+0000 mon.a (mon.0) 700 : cluster 0 osdmap e63: 8 total, 8 up, 8 in 2024-05-20T22:06:27.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:27 smithi050 bash[21866]: audit 2024-05-20T22:06:26.378978+0000 mon.a (mon.0) 701 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-05-20T22:06:27.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:27 smithi050 bash[21866]: audit 2024-05-20T22:06:26.388349+0000 mon.a (mon.0) 702 : audit 1 from='client.? v1:172.21.15.50:0/3188143680' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-05-20T22:06:27.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:27 smithi050 bash[21866]: audit 2024-05-20T22:06:27.369133+0000 mon.a (mon.0) 703 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-05-20T22:06:27.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:27 smithi050 bash[21866]: audit 2024-05-20T22:06:27.369310+0000 mon.a (mon.0) 704 : audit 1 from='client.? v1:172.21.15.50:0/3188143680' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-05-20T22:06:27.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:27 smithi050 bash[21866]: cluster 2024-05-20T22:06:27.377605+0000 mon.a (mon.0) 705 : cluster 0 osdmap e64: 8 total, 8 up, 8 in 2024-05-20T22:06:28.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:28 smithi050 bash[21866]: cluster 2024-05-20T22:06:27.540408+0000 mgr.y (mgr.14150) 344 : cluster 0 pgmap v329: 100 pgs: 17 creating+peering, 49 active+clean, 34 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 3 op/s 2024-05-20T22:06:28.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:28 smithi050 bash[28929]: cluster 2024-05-20T22:06:27.540408+0000 mgr.y (mgr.14150) 344 : cluster 0 pgmap v329: 100 pgs: 17 creating+peering, 49 active+clean, 34 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 3 op/s 2024-05-20T22:06:28.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:28 smithi145 bash[23893]: cluster 2024-05-20T22:06:27.540408+0000 mgr.y (mgr.14150) 344 : cluster 0 pgmap v329: 100 pgs: 17 creating+peering, 49 active+clean, 34 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 3 op/s 2024-05-20T22:06:29.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:29 smithi050 bash[21866]: cluster 2024-05-20T22:06:28.407507+0000 mon.a (mon.0) 706 : cluster 0 osdmap e65: 8 total, 8 up, 8 in 2024-05-20T22:06:29.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:29 smithi050 bash[21866]: audit 2024-05-20T22:06:28.410427+0000 mon.a (mon.0) 707 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-05-20T22:06:29.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:29 smithi050 bash[21866]: audit 2024-05-20T22:06:28.412601+0000 mon.a (mon.0) 708 : audit 1 from='client.? v1:172.21.15.50:0/3188143680' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-05-20T22:06:29.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:29 smithi050 bash[28929]: cluster 2024-05-20T22:06:28.407507+0000 mon.a (mon.0) 706 : cluster 0 osdmap e65: 8 total, 8 up, 8 in 2024-05-20T22:06:29.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:29 smithi050 bash[28929]: audit 2024-05-20T22:06:28.410427+0000 mon.a (mon.0) 707 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-05-20T22:06:29.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:29 smithi050 bash[28929]: audit 2024-05-20T22:06:28.412601+0000 mon.a (mon.0) 708 : audit 1 from='client.? v1:172.21.15.50:0/3188143680' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-05-20T22:06:29.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:29 smithi145 bash[23893]: cluster 2024-05-20T22:06:28.407507+0000 mon.a (mon.0) 706 : cluster 0 osdmap e65: 8 total, 8 up, 8 in 2024-05-20T22:06:29.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:29 smithi145 bash[23893]: audit 2024-05-20T22:06:28.410427+0000 mon.a (mon.0) 707 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-05-20T22:06:29.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:29 smithi145 bash[23893]: audit 2024-05-20T22:06:28.412601+0000 mon.a (mon.0) 708 : audit 1 from='client.? v1:172.21.15.50:0/3188143680' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-05-20T22:06:30.478 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T22:06:30.694 INFO:journalctl@ceph.rgw.foo.a.smithi050.stdout:May 20 22:06:30 smithi050 bash[53000]: debug 2024-05-20T22:06:30.541+0000 7f0c5b125880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-05-20T22:06:30.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:30 smithi050 bash[21866]: audit 2024-05-20T22:06:29.406175+0000 mon.a (mon.0) 709 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-05-20T22:06:30.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:30 smithi050 bash[21866]: audit 2024-05-20T22:06:29.406324+0000 mon.a (mon.0) 710 : audit 1 from='client.? v1:172.21.15.50:0/3188143680' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-05-20T22:06:30.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:30 smithi050 bash[21866]: cluster 2024-05-20T22:06:29.413929+0000 mon.a (mon.0) 711 : cluster 0 osdmap e66: 8 total, 8 up, 8 in 2024-05-20T22:06:30.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:30 smithi050 bash[21866]: audit 2024-05-20T22:06:29.418478+0000 mon.a (mon.0) 712 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-05-20T22:06:30.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:30 smithi050 bash[21866]: audit 2024-05-20T22:06:29.419327+0000 mon.a (mon.0) 713 : audit 1 from='client.? v1:172.21.15.50:0/3188143680' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-05-20T22:06:30.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:30 smithi050 bash[21866]: cluster 2024-05-20T22:06:29.541137+0000 mgr.y (mgr.14150) 345 : cluster 0 pgmap v332: 132 pgs: 21 creating+peering, 79 active+clean, 32 unknown; 578 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-05-20T22:06:30.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:30 smithi050 bash[21866]: audit 2024-05-20T22:06:30.408558+0000 mon.a (mon.0) 714 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-05-20T22:06:30.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:30 smithi050 bash[21866]: audit 2024-05-20T22:06:30.408815+0000 mon.a (mon.0) 715 : audit 1 from='client.? v1:172.21.15.50:0/3188143680' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-05-20T22:06:30.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:30 smithi050 bash[21866]: cluster 2024-05-20T22:06:30.416559+0000 mon.a (mon.0) 716 : cluster 0 osdmap e67: 8 total, 8 up, 8 in 2024-05-20T22:06:30.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:30 smithi050 bash[28929]: audit 2024-05-20T22:06:29.406175+0000 mon.a (mon.0) 709 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-05-20T22:06:30.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:30 smithi050 bash[28929]: audit 2024-05-20T22:06:29.406324+0000 mon.a (mon.0) 710 : audit 1 from='client.? v1:172.21.15.50:0/3188143680' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-05-20T22:06:30.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:30 smithi050 bash[28929]: cluster 2024-05-20T22:06:29.413929+0000 mon.a (mon.0) 711 : cluster 0 osdmap e66: 8 total, 8 up, 8 in 2024-05-20T22:06:30.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:30 smithi050 bash[28929]: audit 2024-05-20T22:06:29.418478+0000 mon.a (mon.0) 712 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-05-20T22:06:30.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:30 smithi050 bash[28929]: audit 2024-05-20T22:06:29.419327+0000 mon.a (mon.0) 713 : audit 1 from='client.? v1:172.21.15.50:0/3188143680' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-05-20T22:06:30.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:30 smithi050 bash[28929]: cluster 2024-05-20T22:06:29.541137+0000 mgr.y (mgr.14150) 345 : cluster 0 pgmap v332: 132 pgs: 21 creating+peering, 79 active+clean, 32 unknown; 578 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-05-20T22:06:30.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:30 smithi050 bash[28929]: audit 2024-05-20T22:06:30.408558+0000 mon.a (mon.0) 714 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-05-20T22:06:30.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:30 smithi050 bash[28929]: audit 2024-05-20T22:06:30.408815+0000 mon.a (mon.0) 715 : audit 1 from='client.? v1:172.21.15.50:0/3188143680' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-05-20T22:06:30.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:30 smithi050 bash[28929]: cluster 2024-05-20T22:06:30.416559+0000 mon.a (mon.0) 716 : cluster 0 osdmap e67: 8 total, 8 up, 8 in 2024-05-20T22:06:30.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:30 smithi145 bash[23893]: audit 2024-05-20T22:06:29.406175+0000 mon.a (mon.0) 709 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-05-20T22:06:30.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:30 smithi145 bash[23893]: audit 2024-05-20T22:06:29.406324+0000 mon.a (mon.0) 710 : audit 1 from='client.? v1:172.21.15.50:0/3188143680' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-05-20T22:06:30.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:30 smithi145 bash[23893]: cluster 2024-05-20T22:06:29.413929+0000 mon.a (mon.0) 711 : cluster 0 osdmap e66: 8 total, 8 up, 8 in 2024-05-20T22:06:30.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:30 smithi145 bash[23893]: audit 2024-05-20T22:06:29.418478+0000 mon.a (mon.0) 712 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-05-20T22:06:30.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:30 smithi145 bash[23893]: audit 2024-05-20T22:06:29.419327+0000 mon.a (mon.0) 713 : audit 1 from='client.? v1:172.21.15.50:0/3188143680' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-05-20T22:06:30.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:30 smithi145 bash[23893]: cluster 2024-05-20T22:06:29.541137+0000 mgr.y (mgr.14150) 345 : cluster 0 pgmap v332: 132 pgs: 21 creating+peering, 79 active+clean, 32 unknown; 578 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-05-20T22:06:30.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:30 smithi145 bash[23893]: audit 2024-05-20T22:06:30.408558+0000 mon.a (mon.0) 714 : audit 1 from='client.? v1:172.21.15.50:0/188390971' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-05-20T22:06:30.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:30 smithi145 bash[23893]: audit 2024-05-20T22:06:30.408815+0000 mon.a (mon.0) 715 : audit 1 from='client.? v1:172.21.15.50:0/3188143680' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-05-20T22:06:30.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:30 smithi145 bash[23893]: cluster 2024-05-20T22:06:30.416559+0000 mon.a (mon.0) 716 : cluster 0 osdmap e67: 8 total, 8 up, 8 in 2024-05-20T22:06:31.822 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:31 smithi145 bash[23893]: audit 2024-05-20T22:06:30.702414+0000 mon.a (mon.0) 717 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:31.822 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:31 smithi145 bash[23893]: audit 2024-05-20T22:06:30.707434+0000 mon.a (mon.0) 718 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:31.823 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:31 smithi145 bash[23893]: audit 2024-05-20T22:06:30.715936+0000 mon.a (mon.0) 719 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:31.823 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:31 smithi145 bash[23893]: audit 2024-05-20T22:06:30.772718+0000 mon.a (mon.0) 720 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:06:31.823 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:31 smithi145 bash[23893]: audit 2024-05-20T22:06:30.774349+0000 mon.a (mon.0) 721 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:31.823 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:31 smithi145 bash[23893]: audit 2024-05-20T22:06:30.775058+0000 mon.a (mon.0) 722 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:06:31.823 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:31 smithi145 bash[23893]: cephadm 2024-05-20T22:06:30.779104+0000 mgr.y (mgr.14150) 346 : cephadm 1 Checking dashboard <-> RGW credentials 2024-05-20T22:06:31.823 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:31 smithi145 bash[23893]: audit 2024-05-20T22:06:31.076582+0000 mon.a (mon.0) 723 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:32.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:31 smithi050 bash[21866]: audit 2024-05-20T22:06:30.702414+0000 mon.a (mon.0) 717 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:32.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:31 smithi050 bash[21866]: audit 2024-05-20T22:06:30.707434+0000 mon.a (mon.0) 718 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:32.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:31 smithi050 bash[21866]: audit 2024-05-20T22:06:30.715936+0000 mon.a (mon.0) 719 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:32.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:31 smithi050 bash[21866]: audit 2024-05-20T22:06:30.772718+0000 mon.a (mon.0) 720 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:06:32.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:31 smithi050 bash[21866]: audit 2024-05-20T22:06:30.774349+0000 mon.a (mon.0) 721 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:32.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:31 smithi050 bash[21866]: audit 2024-05-20T22:06:30.775058+0000 mon.a (mon.0) 722 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:06:32.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:31 smithi050 bash[21866]: cephadm 2024-05-20T22:06:30.779104+0000 mgr.y (mgr.14150) 346 : cephadm 1 Checking dashboard <-> RGW credentials 2024-05-20T22:06:32.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:31 smithi050 bash[21866]: audit 2024-05-20T22:06:31.076582+0000 mon.a (mon.0) 723 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:32.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:31 smithi050 bash[28929]: audit 2024-05-20T22:06:30.702414+0000 mon.a (mon.0) 717 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:32.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:31 smithi050 bash[28929]: audit 2024-05-20T22:06:30.707434+0000 mon.a (mon.0) 718 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:32.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:31 smithi050 bash[28929]: audit 2024-05-20T22:06:30.715936+0000 mon.a (mon.0) 719 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:32.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:31 smithi050 bash[28929]: audit 2024-05-20T22:06:30.772718+0000 mon.a (mon.0) 720 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:06:32.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:31 smithi050 bash[28929]: audit 2024-05-20T22:06:30.774349+0000 mon.a (mon.0) 721 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:32.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:31 smithi050 bash[28929]: audit 2024-05-20T22:06:30.775058+0000 mon.a (mon.0) 722 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:06:32.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:31 smithi050 bash[28929]: cephadm 2024-05-20T22:06:30.779104+0000 mgr.y (mgr.14150) 346 : cephadm 1 Checking dashboard <-> RGW credentials 2024-05-20T22:06:32.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:31 smithi050 bash[28929]: audit 2024-05-20T22:06:31.076582+0000 mon.a (mon.0) 723 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:33.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:33 smithi145 bash[23893]: cluster 2024-05-20T22:06:31.542166+0000 mgr.y (mgr.14150) 347 : cluster 0 pgmap v334: 132 pgs: 21 creating+peering, 86 active+clean, 25 unknown; 578 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 491 B/s wr, 2 op/s 2024-05-20T22:06:33.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:33 smithi145 bash[23893]: audit 2024-05-20T22:06:33.040176+0000 mon.b (mon.1) 27 : audit 1 from='client.? v1:172.21.15.145:0/3402930454' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-05-20T22:06:33.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:33 smithi145 bash[23893]: audit 2024-05-20T22:06:33.041826+0000 mon.a (mon.0) 724 : audit 1 from='client.24469 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-05-20T22:06:33.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:33 smithi050 bash[21866]: cluster 2024-05-20T22:06:31.542166+0000 mgr.y (mgr.14150) 347 : cluster 0 pgmap v334: 132 pgs: 21 creating+peering, 86 active+clean, 25 unknown; 578 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 491 B/s wr, 2 op/s 2024-05-20T22:06:33.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:33 smithi050 bash[21866]: audit 2024-05-20T22:06:33.040176+0000 mon.b (mon.1) 27 : audit 1 from='client.? v1:172.21.15.145:0/3402930454' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-05-20T22:06:33.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:33 smithi050 bash[21866]: audit 2024-05-20T22:06:33.041826+0000 mon.a (mon.0) 724 : audit 1 from='client.24469 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-05-20T22:06:33.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:33 smithi050 bash[28929]: cluster 2024-05-20T22:06:31.542166+0000 mgr.y (mgr.14150) 347 : cluster 0 pgmap v334: 132 pgs: 21 creating+peering, 86 active+clean, 25 unknown; 578 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 491 B/s wr, 2 op/s 2024-05-20T22:06:33.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:33 smithi050 bash[28929]: audit 2024-05-20T22:06:33.040176+0000 mon.b (mon.1) 27 : audit 1 from='client.? v1:172.21.15.145:0/3402930454' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-05-20T22:06:33.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:33 smithi050 bash[28929]: audit 2024-05-20T22:06:33.041826+0000 mon.a (mon.0) 724 : audit 1 from='client.24469 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-05-20T22:06:34.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:34 smithi145 bash[23893]: audit 2024-05-20T22:06:33.086222+0000 mon.a (mon.0) 725 : audit 1 from='client.24469 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-05-20T22:06:34.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:34 smithi145 bash[23893]: cluster 2024-05-20T22:06:33.092806+0000 mon.a (mon.0) 726 : cluster 0 osdmap e68: 8 total, 8 up, 8 in 2024-05-20T22:06:34.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:34 smithi050 bash[21866]: audit 2024-05-20T22:06:33.086222+0000 mon.a (mon.0) 725 : audit 1 from='client.24469 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-05-20T22:06:34.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:34 smithi050 bash[21866]: cluster 2024-05-20T22:06:33.092806+0000 mon.a (mon.0) 726 : cluster 0 osdmap e68: 8 total, 8 up, 8 in 2024-05-20T22:06:34.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:34 smithi050 bash[28929]: audit 2024-05-20T22:06:33.086222+0000 mon.a (mon.0) 725 : audit 1 from='client.24469 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-05-20T22:06:34.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:34 smithi050 bash[28929]: cluster 2024-05-20T22:06:33.092806+0000 mon.a (mon.0) 726 : cluster 0 osdmap e68: 8 total, 8 up, 8 in 2024-05-20T22:06:35.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:35 smithi145 bash[23893]: cluster 2024-05-20T22:06:33.543071+0000 mgr.y (mgr.14150) 348 : cluster 0 pgmap v336: 132 pgs: 5 creating+peering, 127 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s rd, 6.2 KiB/s wr, 192 op/s 2024-05-20T22:06:35.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:35 smithi145 bash[23893]: cluster 2024-05-20T22:06:34.086267+0000 mon.a (mon.0) 727 : cluster 1 Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-20T22:06:35.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:35 smithi145 bash[23893]: cluster 2024-05-20T22:06:34.086316+0000 mon.a (mon.0) 728 : cluster 1 Cluster is now healthy 2024-05-20T22:06:35.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:35 smithi145 bash[23893]: cluster 2024-05-20T22:06:34.103737+0000 mon.a (mon.0) 729 : cluster 0 osdmap e69: 8 total, 8 up, 8 in 2024-05-20T22:06:35.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:35 smithi050 bash[21866]: cluster 2024-05-20T22:06:33.543071+0000 mgr.y (mgr.14150) 348 : cluster 0 pgmap v336: 132 pgs: 5 creating+peering, 127 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s rd, 6.2 KiB/s wr, 192 op/s 2024-05-20T22:06:35.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:35 smithi050 bash[21866]: cluster 2024-05-20T22:06:34.086267+0000 mon.a (mon.0) 727 : cluster 1 Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-20T22:06:35.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:35 smithi050 bash[21866]: cluster 2024-05-20T22:06:34.086316+0000 mon.a (mon.0) 728 : cluster 1 Cluster is now healthy 2024-05-20T22:06:35.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:35 smithi050 bash[21866]: cluster 2024-05-20T22:06:34.103737+0000 mon.a (mon.0) 729 : cluster 0 osdmap e69: 8 total, 8 up, 8 in 2024-05-20T22:06:35.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:35 smithi050 bash[28929]: cluster 2024-05-20T22:06:33.543071+0000 mgr.y (mgr.14150) 348 : cluster 0 pgmap v336: 132 pgs: 5 creating+peering, 127 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s rd, 6.2 KiB/s wr, 192 op/s 2024-05-20T22:06:35.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:35 smithi050 bash[28929]: cluster 2024-05-20T22:06:34.086267+0000 mon.a (mon.0) 727 : cluster 1 Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-20T22:06:35.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:35 smithi050 bash[28929]: cluster 2024-05-20T22:06:34.086316+0000 mon.a (mon.0) 728 : cluster 1 Cluster is now healthy 2024-05-20T22:06:35.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:35 smithi050 bash[28929]: cluster 2024-05-20T22:06:34.103737+0000 mon.a (mon.0) 729 : cluster 0 osdmap e69: 8 total, 8 up, 8 in 2024-05-20T22:06:35.771 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph orch apply iscsi datapool admin admin --trusted_ip_list 172.21.15.145 --placement '1;smithi145=iscsi.a' 2024-05-20T22:06:36.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:36 smithi145 bash[23893]: cluster 2024-05-20T22:06:35.104351+0000 mon.a (mon.0) 730 : cluster 0 osdmap e70: 8 total, 8 up, 8 in 2024-05-20T22:06:36.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:36 smithi050 bash[21866]: cluster 2024-05-20T22:06:35.104351+0000 mon.a (mon.0) 730 : cluster 0 osdmap e70: 8 total, 8 up, 8 in 2024-05-20T22:06:36.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:36 smithi050 bash[28929]: cluster 2024-05-20T22:06:35.104351+0000 mon.a (mon.0) 730 : cluster 0 osdmap e70: 8 total, 8 up, 8 in 2024-05-20T22:06:37.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:37 smithi145 bash[23893]: cluster 2024-05-20T22:06:35.543831+0000 mgr.y (mgr.14150) 349 : cluster 0 pgmap v339: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s rd, 7.0 KiB/s wr, 222 op/s 2024-05-20T22:06:37.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:37 smithi050 bash[21866]: cluster 2024-05-20T22:06:35.543831+0000 mgr.y (mgr.14150) 349 : cluster 0 pgmap v339: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s rd, 7.0 KiB/s wr, 222 op/s 2024-05-20T22:06:37.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:37 smithi050 bash[28929]: cluster 2024-05-20T22:06:35.543831+0000 mgr.y (mgr.14150) 349 : cluster 0 pgmap v339: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s rd, 7.0 KiB/s wr, 222 op/s 2024-05-20T22:06:39.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:39 smithi145 bash[23893]: cluster 2024-05-20T22:06:37.545033+0000 mgr.y (mgr.14150) 350 : cluster 0 pgmap v340: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 6.3 KiB/s wr, 190 op/s 2024-05-20T22:06:39.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:39 smithi050 bash[21866]: cluster 2024-05-20T22:06:37.545033+0000 mgr.y (mgr.14150) 350 : cluster 0 pgmap v340: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 6.3 KiB/s wr, 190 op/s 2024-05-20T22:06:39.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:39 smithi050 bash[28929]: cluster 2024-05-20T22:06:37.545033+0000 mgr.y (mgr.14150) 350 : cluster 0 pgmap v340: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 6.3 KiB/s wr, 190 op/s 2024-05-20T22:06:40.516 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T22:06:41.375 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:41 smithi145 bash[23893]: cluster 2024-05-20T22:06:39.546160+0000 mgr.y (mgr.14150) 351 : cluster 0 pgmap v341: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 22 KiB/s rd, 1.9 KiB/s wr, 54 op/s 2024-05-20T22:06:41.375 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:41 smithi145 bash[23893]: cluster 2024-05-20T22:06:40.535054+0000 mon.a (mon.0) 731 : cluster 0 osdmap e71: 8 total, 8 up, 8 in 2024-05-20T22:06:41.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:41 smithi050 bash[21866]: cluster 2024-05-20T22:06:39.546160+0000 mgr.y (mgr.14150) 351 : cluster 0 pgmap v341: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 22 KiB/s rd, 1.9 KiB/s wr, 54 op/s 2024-05-20T22:06:41.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:41 smithi050 bash[21866]: cluster 2024-05-20T22:06:40.535054+0000 mon.a (mon.0) 731 : cluster 0 osdmap e71: 8 total, 8 up, 8 in 2024-05-20T22:06:41.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:41 smithi050 bash[28929]: cluster 2024-05-20T22:06:39.546160+0000 mgr.y (mgr.14150) 351 : cluster 0 pgmap v341: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 22 KiB/s rd, 1.9 KiB/s wr, 54 op/s 2024-05-20T22:06:41.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:41 smithi050 bash[28929]: cluster 2024-05-20T22:06:40.535054+0000 mon.a (mon.0) 731 : cluster 0 osdmap e71: 8 total, 8 up, 8 in 2024-05-20T22:06:42.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.711+0000 7f68312fe640 1 -- 172.21.15.145:0/3278020111 >> v1:172.21.15.145:6789/0 conn(0x7f682c10fe80 legacy=0x7f682c112340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:42.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.711+0000 7f68312fe640 1 -- 172.21.15.145:0/3278020111 shutdown_connections 2024-05-20T22:06:42.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.711+0000 7f68312fe640 1 -- 172.21.15.145:0/3278020111 >> 172.21.15.145:0/3278020111 conn(0x7f682c076d00 msgr2=0x7f682c079120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:06:42.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.711+0000 7f68312fe640 1 -- 172.21.15.145:0/3278020111 shutdown_connections 2024-05-20T22:06:42.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.711+0000 7f68312fe640 1 -- 172.21.15.145:0/3278020111 wait complete. 2024-05-20T22:06:42.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.711+0000 7f68312fe640 1 Processor -- start 2024-05-20T22:06:42.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.711+0000 7f68312fe640 1 -- start start 2024-05-20T22:06:42.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.711+0000 7f68312fe640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f682c19de60 con 0x7f682c10c140 2024-05-20T22:06:42.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.711+0000 7f68312fe640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f682c1a96b0 con 0x7f682c107d10 2024-05-20T22:06:42.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.711+0000 7f68312fe640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f682c1aa890 con 0x7f682c10fe80 2024-05-20T22:06:42.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.711+0000 7f682affd640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f682c107d10 0x7f682c19d370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:42070/0 (socket says 172.21.15.145:42070) 2024-05-20T22:06:42.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.711+0000 7f682affd640 1 -- 172.21.15.145:0/1843749346 learned_addr learned my addr 172.21.15.145:0/1843749346 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-05-20T22:06:42.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.715+0000 7f6823fff640 1 -- 172.21.15.145:0/1843749346 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 533350258 0 0) 0x7f682c1a96b0 con 0x7f682c107d10 2024-05-20T22:06:42.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.715+0000 7f6823fff640 1 -- 172.21.15.145:0/1843749346 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6818003520 con 0x7f682c107d10 2024-05-20T22:06:42.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.715+0000 7f6823fff640 1 -- 172.21.15.145:0/1843749346 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3016954789 0 0) 0x7f6818003520 con 0x7f682c107d10 2024-05-20T22:06:42.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.715+0000 7f6823fff640 1 -- 172.21.15.145:0/1843749346 --> v1:172.21.15.145:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f682c1a96b0 con 0x7f682c107d10 2024-05-20T22:06:42.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.715+0000 7f6823fff640 1 -- 172.21.15.145:0/1843749346 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f681c0018f0 con 0x7f682c107d10 2024-05-20T22:06:42.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.715+0000 7f6823fff640 1 -- 172.21.15.145:0/1843749346 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3754270456 0 0) 0x7f682c1aa890 con 0x7f682c10fe80 2024-05-20T22:06:42.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.715+0000 7f6823fff640 1 -- 172.21.15.145:0/1843749346 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6818003520 con 0x7f682c10fe80 2024-05-20T22:06:42.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.715+0000 7f6823fff640 1 -- 172.21.15.145:0/1843749346 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2891517475 0 0) 0x7f682c19de60 con 0x7f682c10c140 2024-05-20T22:06:42.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.715+0000 7f6823fff640 1 -- 172.21.15.145:0/1843749346 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f682c1aa890 con 0x7f682c10c140 2024-05-20T22:06:42.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.715+0000 7f6823fff640 1 -- 172.21.15.145:0/1843749346 <== mon.1 v1:172.21.15.145:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 695728603 0 0) 0x7f682c1a96b0 con 0x7f682c107d10 2024-05-20T22:06:42.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.715+0000 7f6823fff640 1 -- 172.21.15.145:0/1843749346 >> v1:172.21.15.50:6790/0 conn(0x7f682c10fe80 legacy=0x7f682c1a6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:42.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.715+0000 7f6823fff640 1 -- 172.21.15.145:0/1843749346 >> v1:172.21.15.50:6789/0 conn(0x7f682c10c140 legacy=0x7f682c1a3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:42.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.715+0000 7f6823fff640 1 -- 172.21.15.145:0/1843749346 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682c1aba70 con 0x7f682c107d10 2024-05-20T22:06:42.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.715+0000 7f68312fe640 1 -- 172.21.15.145:0/1843749346 --> v1:172.21.15.145:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f682c1aaac0 con 0x7f682c107d10 2024-05-20T22:06:42.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.715+0000 7f68312fe640 1 -- 172.21.15.145:0/1843749346 --> v1:172.21.15.145:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f682c1ab000 con 0x7f682c107d10 2024-05-20T22:06:42.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.715+0000 7f6823fff640 1 -- 172.21.15.145:0/1843749346 <== mon.1 v1:172.21.15.145:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f681c003b20 con 0x7f682c107d10 2024-05-20T22:06:42.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.715+0000 7f6823fff640 1 -- 172.21.15.145:0/1843749346 <== mon.1 v1:172.21.15.145:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f681c005ca0 con 0x7f682c107d10 2024-05-20T22:06:42.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.715+0000 7f68312fe640 1 -- 172.21.15.145:0/1843749346 --> v1:172.21.15.145:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f680c005080 con 0x7f682c107d10 2024-05-20T22:06:42.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.715+0000 7f6823fff640 1 -- 172.21.15.145:0/1843749346 <== mon.1 v1:172.21.15.145:6789/0 7 ==== mgrmap(e 15) ==== 92081+0+0 (unknown 2274281742 0 0) 0x7f681c003690 con 0x7f682c107d10 2024-05-20T22:06:42.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.715+0000 7f6823fff640 1 -- 172.21.15.145:0/1843749346 <== mon.1 v1:172.21.15.145:6789/0 8 ==== osd_map(71..71 src has 1..71) ==== 5942+0+0 (unknown 2135320820 0 0) 0x7f681c089500 con 0x7f682c107d10 2024-05-20T22:06:42.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.719+0000 7f6823fff640 1 -- 172.21.15.145:0/1843749346 <== mon.1 v1:172.21.15.145:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f681c056d40 con 0x7f682c107d10 2024-05-20T22:06:42.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.919+0000 7f68312fe640 1 -- 172.21.15.145:0/1843749346 --> v1:172.21.15.50:6800/2944911247 -- mgr_command(tid 0: {"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.145", "placement": "1;smithi145=iscsi.a", "target": ["mon-mgr", ""]}) -- 0x7f680c000c60 con 0x7f681806ee30 2024-05-20T22:06:42.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.935+0000 7f6823fff640 1 -- 172.21.15.145:0/1843749346 <== mgr.14150 v1:172.21.15.50:6800/2944911247 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+35 (unknown 0 0 803663096) 0x7f680c000c60 con 0x7f681806ee30 2024-05-20T22:06:42.934 INFO:teuthology.orchestra.run.smithi145.stdout:Scheduled iscsi.datapool update... 2024-05-20T22:06:42.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.939+0000 7f68312fe640 1 -- 172.21.15.145:0/1843749346 >> v1:172.21.15.50:6800/2944911247 conn(0x7f681806ee30 legacy=0x7f68180712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:42.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.939+0000 7f68312fe640 1 -- 172.21.15.145:0/1843749346 >> v1:172.21.15.145:6789/0 conn(0x7f682c107d10 legacy=0x7f682c19d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:42.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.939+0000 7f68312fe640 1 -- 172.21.15.145:0/1843749346 shutdown_connections 2024-05-20T22:06:42.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.939+0000 7f68312fe640 1 -- 172.21.15.145:0/1843749346 >> 172.21.15.145:0/1843749346 conn(0x7f682c076d00 msgr2=0x7f682c112aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:06:42.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.939+0000 7f68312fe640 1 -- 172.21.15.145:0/1843749346 shutdown_connections 2024-05-20T22:06:42.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:42.939+0000 7f68312fe640 1 -- 172.21.15.145:0/1843749346 wait complete. 2024-05-20T22:06:43.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:43 smithi145 bash[23893]: cluster 2024-05-20T22:06:41.546870+0000 mgr.y (mgr.14150) 352 : cluster 0 pgmap v343: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 274 B/s wr, 0 op/s 2024-05-20T22:06:43.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:43 smithi145 bash[23893]: audit 2024-05-20T22:06:42.937563+0000 mon.a (mon.0) 732 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:43.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:43 smithi145 bash[23893]: audit 2024-05-20T22:06:42.939602+0000 mon.a (mon.0) 733 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:06:43.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:43 smithi145 bash[23893]: audit 2024-05-20T22:06:42.943749+0000 mon.a (mon.0) 734 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:43.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:43 smithi145 bash[23893]: audit 2024-05-20T22:06:42.945520+0000 mon.a (mon.0) 735 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:06:43.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:43 smithi145 bash[23893]: audit 2024-05-20T22:06:42.955909+0000 mon.a (mon.0) 736 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:43.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:43 smithi145 bash[23893]: audit 2024-05-20T22:06:42.963067+0000 mon.a (mon.0) 737 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-20T22:06:43.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:43 smithi145 bash[23893]: audit 2024-05-20T22:06:42.966758+0000 mon.a (mon.0) 738 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-05-20T22:06:43.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:43 smithi145 bash[23893]: audit 2024-05-20T22:06:42.990535+0000 mon.a (mon.0) 739 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:43.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:43 smithi050 bash[21866]: cluster 2024-05-20T22:06:41.546870+0000 mgr.y (mgr.14150) 352 : cluster 0 pgmap v343: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 274 B/s wr, 0 op/s 2024-05-20T22:06:43.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:43 smithi050 bash[21866]: audit 2024-05-20T22:06:42.937563+0000 mon.a (mon.0) 732 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:43.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:43 smithi050 bash[21866]: audit 2024-05-20T22:06:42.939602+0000 mon.a (mon.0) 733 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:06:43.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:43 smithi050 bash[21866]: audit 2024-05-20T22:06:42.943749+0000 mon.a (mon.0) 734 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:43.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:43 smithi050 bash[21866]: audit 2024-05-20T22:06:42.945520+0000 mon.a (mon.0) 735 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:06:43.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:43 smithi050 bash[21866]: audit 2024-05-20T22:06:42.955909+0000 mon.a (mon.0) 736 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:43.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:43 smithi050 bash[21866]: audit 2024-05-20T22:06:42.963067+0000 mon.a (mon.0) 737 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-20T22:06:43.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:43 smithi050 bash[21866]: audit 2024-05-20T22:06:42.966758+0000 mon.a (mon.0) 738 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-05-20T22:06:43.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:43 smithi050 bash[21866]: audit 2024-05-20T22:06:42.990535+0000 mon.a (mon.0) 739 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:43.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:43 smithi050 bash[28929]: cluster 2024-05-20T22:06:41.546870+0000 mgr.y (mgr.14150) 352 : cluster 0 pgmap v343: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 274 B/s wr, 0 op/s 2024-05-20T22:06:43.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:43 smithi050 bash[28929]: audit 2024-05-20T22:06:42.937563+0000 mon.a (mon.0) 732 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:43.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:43 smithi050 bash[28929]: audit 2024-05-20T22:06:42.939602+0000 mon.a (mon.0) 733 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:06:43.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:43 smithi050 bash[28929]: audit 2024-05-20T22:06:42.943749+0000 mon.a (mon.0) 734 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:43.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:43 smithi050 bash[28929]: audit 2024-05-20T22:06:42.945520+0000 mon.a (mon.0) 735 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:06:43.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:43 smithi050 bash[28929]: audit 2024-05-20T22:06:42.955909+0000 mon.a (mon.0) 736 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:43.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:43 smithi050 bash[28929]: audit 2024-05-20T22:06:42.963067+0000 mon.a (mon.0) 737 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-20T22:06:43.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:43 smithi050 bash[28929]: audit 2024-05-20T22:06:42.966758+0000 mon.a (mon.0) 738 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-05-20T22:06:43.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:43 smithi050 bash[28929]: audit 2024-05-20T22:06:42.990535+0000 mon.a (mon.0) 739 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:43.950 INFO:tasks.cephadm:Distributing iscsi-gateway.cfg... 2024-05-20T22:06:43.950 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-20T22:06:43.950 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-05-20T22:06:43.966 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-05-20T22:06:43.966 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-05-20T22:06:43.981 DEBUG:teuthology.orchestra.run.smithi145:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@iscsi.iscsi.a.service 2024-05-20T22:06:44.026 INFO:tasks.cephadm:Adding prometheus.a on smithi145 2024-05-20T22:06:44.027 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph orch apply prometheus '1;smithi145=a' 2024-05-20T22:06:44.375 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:44 smithi145 bash[23893]: audit 2024-05-20T22:06:42.924876+0000 mgr.y (mgr.14150) 353 : audit 0 from='client.24475 v1:172.21.15.145:0/1843749346' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.145", "placement": "1;smithi145=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:06:44.375 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:44 smithi145 bash[23893]: cephadm 2024-05-20T22:06:42.930510+0000 mgr.y (mgr.14150) 354 : cephadm 1 Saving service iscsi.datapool spec with placement smithi145=iscsi.a;count:1 2024-05-20T22:06:44.376 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:44 smithi145 bash[23893]: cephadm 2024-05-20T22:06:42.992735+0000 mgr.y (mgr.14150) 355 : cephadm 1 Deploying daemon iscsi.iscsi.a on smithi145 2024-05-20T22:06:44.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:44 smithi050 bash[28929]: audit 2024-05-20T22:06:42.924876+0000 mgr.y (mgr.14150) 353 : audit 0 from='client.24475 v1:172.21.15.145:0/1843749346' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.145", "placement": "1;smithi145=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:06:44.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:44 smithi050 bash[28929]: cephadm 2024-05-20T22:06:42.930510+0000 mgr.y (mgr.14150) 354 : cephadm 1 Saving service iscsi.datapool spec with placement smithi145=iscsi.a;count:1 2024-05-20T22:06:44.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:44 smithi050 bash[28929]: cephadm 2024-05-20T22:06:42.992735+0000 mgr.y (mgr.14150) 355 : cephadm 1 Deploying daemon iscsi.iscsi.a on smithi145 2024-05-20T22:06:44.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:44 smithi050 bash[21866]: audit 2024-05-20T22:06:42.924876+0000 mgr.y (mgr.14150) 353 : audit 0 from='client.24475 v1:172.21.15.145:0/1843749346' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.145", "placement": "1;smithi145=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:06:44.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:44 smithi050 bash[21866]: cephadm 2024-05-20T22:06:42.930510+0000 mgr.y (mgr.14150) 354 : cephadm 1 Saving service iscsi.datapool spec with placement smithi145=iscsi.a;count:1 2024-05-20T22:06:44.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:44 smithi050 bash[21866]: cephadm 2024-05-20T22:06:42.992735+0000 mgr.y (mgr.14150) 355 : cephadm 1 Deploying daemon iscsi.iscsi.a on smithi145 2024-05-20T22:06:45.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:45 smithi145 bash[23893]: cluster 2024-05-20T22:06:43.548320+0000 mgr.y (mgr.14150) 356 : cluster 0 pgmap v344: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 242 B/s wr, 0 op/s 2024-05-20T22:06:45.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:45 smithi050 bash[21866]: cluster 2024-05-20T22:06:43.548320+0000 mgr.y (mgr.14150) 356 : cluster 0 pgmap v344: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 242 B/s wr, 0 op/s 2024-05-20T22:06:45.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:45 smithi050 bash[28929]: cluster 2024-05-20T22:06:43.548320+0000 mgr.y (mgr.14150) 356 : cluster 0 pgmap v344: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 242 B/s wr, 0 op/s 2024-05-20T22:06:45.734 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:45 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:45.734 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:06:45 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:45.734 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:06:45 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:45.734 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:06:45 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:45.735 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:06:45 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:45.735 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:06:45 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:45.735 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:06:45 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:45.735 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:06:45 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:45.735 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:06:45 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:45.736 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:06:45 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:45.736 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:45 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:45.736 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:45 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:45.736 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:45 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:46.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:45 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:46.141 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:06:45 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:46.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:45 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:46.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:45 smithi145 systemd[1]: Started Ceph iscsi.iscsi.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968. 2024-05-20T22:06:47.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:46 smithi050 bash[21866]: cluster 2024-05-20T22:06:45.549186+0000 mgr.y (mgr.14150) 357 : cluster 0 pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 204 B/s wr, 0 op/s 2024-05-20T22:06:47.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:46 smithi050 bash[21866]: audit 2024-05-20T22:06:45.902522+0000 mon.a (mon.0) 740 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:47.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:46 smithi050 bash[21866]: audit 2024-05-20T22:06:45.911538+0000 mon.a (mon.0) 741 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:47.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:46 smithi050 bash[21866]: audit 2024-05-20T22:06:45.919654+0000 mon.a (mon.0) 742 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:47.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:46 smithi050 bash[21866]: cephadm 2024-05-20T22:06:45.921242+0000 mgr.y (mgr.14150) 358 : cephadm 1 Checking pool "datapool" exists for service iscsi.datapool 2024-05-20T22:06:47.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:46 smithi050 bash[21866]: audit 2024-05-20T22:06:45.935779+0000 mon.a (mon.0) 743 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:47.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:46 smithi050 bash[21866]: audit 2024-05-20T22:06:45.967177+0000 mon.a (mon.0) 744 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:06:47.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:46 smithi050 bash[28929]: cluster 2024-05-20T22:06:45.549186+0000 mgr.y (mgr.14150) 357 : cluster 0 pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 204 B/s wr, 0 op/s 2024-05-20T22:06:47.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:46 smithi050 bash[28929]: audit 2024-05-20T22:06:45.902522+0000 mon.a (mon.0) 740 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:47.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:46 smithi050 bash[28929]: audit 2024-05-20T22:06:45.911538+0000 mon.a (mon.0) 741 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:47.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:46 smithi050 bash[28929]: audit 2024-05-20T22:06:45.919654+0000 mon.a (mon.0) 742 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:47.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:46 smithi050 bash[28929]: cephadm 2024-05-20T22:06:45.921242+0000 mgr.y (mgr.14150) 358 : cephadm 1 Checking pool "datapool" exists for service iscsi.datapool 2024-05-20T22:06:47.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:46 smithi050 bash[28929]: audit 2024-05-20T22:06:45.935779+0000 mon.a (mon.0) 743 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:47.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:46 smithi050 bash[28929]: audit 2024-05-20T22:06:45.967177+0000 mon.a (mon.0) 744 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:06:47.197 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:46 smithi145 bash[23893]: cluster 2024-05-20T22:06:45.549186+0000 mgr.y (mgr.14150) 357 : cluster 0 pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 204 B/s wr, 0 op/s 2024-05-20T22:06:47.197 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:46 smithi145 bash[23893]: audit 2024-05-20T22:06:45.902522+0000 mon.a (mon.0) 740 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:47.197 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:46 smithi145 bash[23893]: audit 2024-05-20T22:06:45.911538+0000 mon.a (mon.0) 741 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:47.197 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:46 smithi145 bash[23893]: audit 2024-05-20T22:06:45.919654+0000 mon.a (mon.0) 742 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:47.197 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:46 smithi145 bash[23893]: cephadm 2024-05-20T22:06:45.921242+0000 mgr.y (mgr.14150) 358 : cephadm 1 Checking pool "datapool" exists for service iscsi.datapool 2024-05-20T22:06:47.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:46 smithi145 bash[23893]: audit 2024-05-20T22:06:45.935779+0000 mon.a (mon.0) 743 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:47.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:46 smithi145 bash[23893]: audit 2024-05-20T22:06:45.967177+0000 mon.a (mon.0) 744 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:06:47.640 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:47 smithi145 bash[48584]: debug Started the configuration object watcher 2024-05-20T22:06:47.640 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:47 smithi145 bash[48584]: debug Checking for config object changes every 1s 2024-05-20T22:06:47.641 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:47 smithi145 bash[48584]: debug Processing osd blocklist entries for this node 2024-05-20T22:06:48.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:47 smithi145 bash[48584]: debug Reading the configuration object to update local LIO configuration 2024-05-20T22:06:48.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:47 smithi145 bash[48584]: debug Configuration does not have an entry for this host(smithi145.front.sepia.ceph.com) - nothing to define to LIO 2024-05-20T22:06:48.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:47 smithi145 bash[48584]: * Serving Flask app 'rbd-target-api' (lazy loading) 2024-05-20T22:06:48.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:47 smithi145 bash[48584]: * Environment: production 2024-05-20T22:06:48.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:47 smithi145 bash[48584]: WARNING: This is a development server. Do not use it in a production deployment. 2024-05-20T22:06:48.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:47 smithi145 bash[48584]: Use a production WSGI server instead. 2024-05-20T22:06:48.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:47 smithi145 bash[48584]: * Debug mode: off 2024-05-20T22:06:48.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:47 smithi145 bash[48584]: debug * Running on all addresses. 2024-05-20T22:06:48.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:47 smithi145 bash[48584]: WARNING: This is a development server. Do not use it in a production deployment. 2024-05-20T22:06:48.142 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:47 smithi145 bash[48584]: * Running on all addresses. 2024-05-20T22:06:48.142 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:47 smithi145 bash[48584]: WARNING: This is a development server. Do not use it in a production deployment. 2024-05-20T22:06:48.142 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:47 smithi145 bash[48584]: debug * Running on http://[fe80::ec4:7aff:fe88:7791]:5000/ (Press CTRL+C to quit) 2024-05-20T22:06:48.142 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:47 smithi145 bash[48584]: * Running on http://[fe80::ec4:7aff:fe88:7791]:5000/ (Press CTRL+C to quit) 2024-05-20T22:06:48.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:48 smithi050 bash[21866]: cluster 2024-05-20T22:06:47.164118+0000 mon.a (mon.0) 745 : cluster 0 mgrmap e16: y(active, since 9m), standbys: x 2024-05-20T22:06:48.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:48 smithi050 bash[21866]: audit 2024-05-20T22:06:47.635565+0000 mon.b (mon.1) 28 : audit 0 from='client.? v1:172.21.15.145:0/1306626242' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-20T22:06:48.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:48 smithi050 bash[28929]: cluster 2024-05-20T22:06:47.164118+0000 mon.a (mon.0) 745 : cluster 0 mgrmap e16: y(active, since 9m), standbys: x 2024-05-20T22:06:48.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:48 smithi050 bash[28929]: audit 2024-05-20T22:06:47.635565+0000 mon.b (mon.1) 28 : audit 0 from='client.? v1:172.21.15.145:0/1306626242' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-20T22:06:48.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:48 smithi145 bash[23893]: cluster 2024-05-20T22:06:47.164118+0000 mon.a (mon.0) 745 : cluster 0 mgrmap e16: y(active, since 9m), standbys: x 2024-05-20T22:06:48.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:48 smithi145 bash[23893]: audit 2024-05-20T22:06:47.635565+0000 mon.b (mon.1) 28 : audit 0 from='client.? v1:172.21.15.145:0/1306626242' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-20T22:06:48.819 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T22:06:49.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:49 smithi050 bash[21866]: cluster 2024-05-20T22:06:47.550286+0000 mgr.y (mgr.14150) 359 : cluster 0 pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:49.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:49 smithi050 bash[28929]: cluster 2024-05-20T22:06:47.550286+0000 mgr.y (mgr.14150) 359 : cluster 0 pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:49.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:49 smithi145 bash[23893]: cluster 2024-05-20T22:06:47.550286+0000 mgr.y (mgr.14150) 359 : cluster 0 pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:06:51.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:51 smithi050 bash[21866]: cluster 2024-05-20T22:06:49.551359+0000 mgr.y (mgr.14150) 360 : cluster 0 pgmap v347: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 102 B/s rd, 102 B/s wr, 0 op/s 2024-05-20T22:06:51.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:51 smithi050 bash[21866]: audit 2024-05-20T22:06:50.731678+0000 mon.a (mon.0) 746 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:51.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:51 smithi050 bash[28929]: cluster 2024-05-20T22:06:49.551359+0000 mgr.y (mgr.14150) 360 : cluster 0 pgmap v347: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 102 B/s rd, 102 B/s wr, 0 op/s 2024-05-20T22:06:51.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:51 smithi050 bash[28929]: audit 2024-05-20T22:06:50.731678+0000 mon.a (mon.0) 746 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:51.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.463+0000 7f4af8fd3640 1 -- 172.21.15.145:0/2640803714 >> v1:172.21.15.145:6789/0 conn(0x7f4af4104a30 legacy=0x7f4af4106e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:51.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.463+0000 7f4af8fd3640 1 -- 172.21.15.145:0/2640803714 shutdown_connections 2024-05-20T22:06:51.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.463+0000 7f4af8fd3640 1 -- 172.21.15.145:0/2640803714 >> 172.21.15.145:0/2640803714 conn(0x7f4af40fbba0 msgr2=0x7f4af40fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:06:51.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.463+0000 7f4af8fd3640 1 -- 172.21.15.145:0/2640803714 shutdown_connections 2024-05-20T22:06:51.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.463+0000 7f4af8fd3640 1 -- 172.21.15.145:0/2640803714 wait complete. 2024-05-20T22:06:51.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4af8fd3640 1 Processor -- start 2024-05-20T22:06:51.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4af8fd3640 1 -- start start 2024-05-20T22:06:51.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4af8fd3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f4af41a3b20 con 0x7f4af4108770 2024-05-20T22:06:51.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4af8fd3640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f4af41a4d60 con 0x7f4af4100600 2024-05-20T22:06:51.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4af8fd3640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f4af41a5fa0 con 0x7f4af4104a30 2024-05-20T22:06:51.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4af259c640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f4af4100600 0x7f4af4106900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:40806/0 (socket says 172.21.15.145:40806) 2024-05-20T22:06:51.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4af259c640 1 -- 172.21.15.145:0/3563963306 learned_addr learned my addr 172.21.15.145:0/3563963306 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-05-20T22:06:51.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4aeb7fe640 1 -- 172.21.15.145:0/3563963306 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1970273565 0 0) 0x7f4af41a4d60 con 0x7f4af4100600 2024-05-20T22:06:51.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4aeb7fe640 1 -- 172.21.15.145:0/3563963306 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ae0003520 con 0x7f4af4100600 2024-05-20T22:06:51.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4aeb7fe640 1 -- 172.21.15.145:0/3563963306 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2210128740 0 0) 0x7f4ae0003520 con 0x7f4af4100600 2024-05-20T22:06:51.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4aeb7fe640 1 -- 172.21.15.145:0/3563963306 --> v1:172.21.15.145:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4af41a4d60 con 0x7f4af4100600 2024-05-20T22:06:51.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4aeb7fe640 1 -- 172.21.15.145:0/3563963306 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f4ae4003fd0 con 0x7f4af4100600 2024-05-20T22:06:51.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4aeb7fe640 1 -- 172.21.15.145:0/3563963306 <== mon.1 v1:172.21.15.145:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1782436842 0 0) 0x7f4af41a4d60 con 0x7f4af4100600 2024-05-20T22:06:51.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4aeb7fe640 1 -- 172.21.15.145:0/3563963306 >> v1:172.21.15.50:6790/0 conn(0x7f4af4104a30 legacy=0x7f4af419e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:51.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4aeb7fe640 1 -- 172.21.15.145:0/3563963306 >> v1:172.21.15.50:6789/0 conn(0x7f4af4108770 legacy=0x7f4af41a2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:51.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4aeb7fe640 1 -- 172.21.15.145:0/3563963306 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af41a71e0 con 0x7f4af4100600 2024-05-20T22:06:51.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4af8fd3640 1 -- 172.21.15.145:0/3563963306 --> v1:172.21.15.145:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4af41a3d50 con 0x7f4af4100600 2024-05-20T22:06:51.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4af8fd3640 1 -- 172.21.15.145:0/3563963306 --> v1:172.21.15.145:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4af41a4290 con 0x7f4af4100600 2024-05-20T22:06:51.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4aeb7fe640 1 -- 172.21.15.145:0/3563963306 <== mon.1 v1:172.21.15.145:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f4ae4001360 con 0x7f4af4100600 2024-05-20T22:06:51.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4aeb7fe640 1 -- 172.21.15.145:0/3563963306 <== mon.1 v1:172.21.15.145:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f4ae4005c20 con 0x7f4af4100600 2024-05-20T22:06:51.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4af8fd3640 1 -- 172.21.15.145:0/3563963306 --> v1:172.21.15.145:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ad40050b0 con 0x7f4af4100600 2024-05-20T22:06:51.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4aeb7fe640 1 -- 172.21.15.145:0/3563963306 <== mon.1 v1:172.21.15.145:6789/0 7 ==== mgrmap(e 16) ==== 92132+0+0 (unknown 3303984484 0 0) 0x7f4ae4000ed0 con 0x7f4af4100600 2024-05-20T22:06:51.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.467+0000 7f4aeb7fe640 1 -- 172.21.15.145:0/3563963306 <== mon.1 v1:172.21.15.145:6789/0 8 ==== osd_map(71..71 src has 1..71) ==== 5942+0+0 (unknown 2135320820 0 0) 0x7f4ae40895a0 con 0x7f4af4100600 2024-05-20T22:06:51.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.471+0000 7f4aeb7fe640 1 -- 172.21.15.145:0/3563963306 <== mon.1 v1:172.21.15.145:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f4ae4056c80 con 0x7f4af4100600 2024-05-20T22:06:51.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:51 smithi145 bash[23893]: cluster 2024-05-20T22:06:49.551359+0000 mgr.y (mgr.14150) 360 : cluster 0 pgmap v347: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 102 B/s rd, 102 B/s wr, 0 op/s 2024-05-20T22:06:51.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:51 smithi145 bash[23893]: audit 2024-05-20T22:06:50.731678+0000 mon.a (mon.0) 746 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:51.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.667+0000 7f4af8fd3640 1 -- 172.21.15.145:0/3563963306 --> v1:172.21.15.50:6800/2944911247 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi145=a", "target": ["mon-mgr", ""]}) -- 0x7f4ad4000bc0 con 0x7f4ae006ecb0 2024-05-20T22:06:51.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.683+0000 7f4aeb7fe640 1 -- 172.21.15.145:0/3563963306 <== mgr.14150 v1:172.21.15.50:6800/2944911247 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+31 (unknown 0 0 1342662408) 0x7f4ad4000bc0 con 0x7f4ae006ecb0 2024-05-20T22:06:51.680 INFO:teuthology.orchestra.run.smithi145.stdout:Scheduled prometheus update... 2024-05-20T22:06:51.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.683+0000 7f4af8fd3640 1 -- 172.21.15.145:0/3563963306 >> v1:172.21.15.50:6800/2944911247 conn(0x7f4ae006ecb0 legacy=0x7f4ae0071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:51.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.683+0000 7f4af8fd3640 1 -- 172.21.15.145:0/3563963306 >> v1:172.21.15.145:6789/0 conn(0x7f4af4100600 legacy=0x7f4af4106900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:06:51.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.683+0000 7f4af8fd3640 1 -- 172.21.15.145:0/3563963306 shutdown_connections 2024-05-20T22:06:51.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.683+0000 7f4af8fd3640 1 -- 172.21.15.145:0/3563963306 >> 172.21.15.145:0/3563963306 conn(0x7f4af40fbba0 msgr2=0x7f4af4107cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:06:51.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.683+0000 7f4af8fd3640 1 -- 172.21.15.145:0/3563963306 shutdown_connections 2024-05-20T22:06:51.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:06:51.683+0000 7f4af8fd3640 1 -- 172.21.15.145:0/3563963306 wait complete. 2024-05-20T22:06:52.373 DEBUG:teuthology.orchestra.run.smithi145:prometheus.a> sudo journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@prometheus.a.service 2024-05-20T22:06:52.375 INFO:tasks.cephadm:Adding node-exporter.a on smithi050 2024-05-20T22:06:52.376 INFO:tasks.cephadm:Adding node-exporter.b on smithi145 2024-05-20T22:06:52.376 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph orch apply node-exporter '2;smithi050=a;smithi145=b' 2024-05-20T22:06:52.640 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:06:52 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:06:52.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: audit 2024-05-20T22:06:51.541337+0000 mon.a (mon.0) 747 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: audit 2024-05-20T22:06:51.550393+0000 mon.a (mon.0) 748 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: cluster 2024-05-20T22:06:51.552259+0000 mgr.y (mgr.14150) 361 : cluster 0 pgmap v348: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 92 B/s rd, 92 B/s wr, 0 op/s 2024-05-20T22:06:52.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: audit 2024-05-20T22:06:51.552640+0000 mon.a (mon.0) 749 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:52.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: audit 2024-05-20T22:06:51.555042+0000 mon.a (mon.0) 750 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:06:52.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: audit 2024-05-20T22:06:51.564606+0000 mon.a (mon.0) 751 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: audit 2024-05-20T22:06:51.637751+0000 mon.a (mon.0) 752 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-20T22:06:52.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: audit 2024-05-20T22:06:51.638714+0000 mgr.y (mgr.14150) 362 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-20T22:06:52.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: cephadm 2024-05-20T22:06:51.640867+0000 mgr.y (mgr.14150) 363 : cephadm 1 Adding iSCSI gateway http://:@172.21.15.145:5000 to Dashboard 2024-05-20T22:06:52.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: audit 2024-05-20T22:06:51.641447+0000 mon.a (mon.0) 753 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-20T22:06:52.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: audit 2024-05-20T22:06:51.642042+0000 mgr.y (mgr.14150) 364 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-20T22:06:52.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: audit 2024-05-20T22:06:51.648961+0000 mon.a (mon.0) 754 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: audit 2024-05-20T22:06:51.668240+0000 mon.a (mon.0) 755 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi145"}]: dispatch 2024-05-20T22:06:52.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: audit 2024-05-20T22:06:51.669024+0000 mgr.y (mgr.14150) 365 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi145"}]: dispatch 2024-05-20T22:06:52.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: audit 2024-05-20T22:06:51.674298+0000 mgr.y (mgr.14150) 366 : audit 0 from='client.24511 v1:172.21.15.145:0/3563963306' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi145=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:06:52.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: audit 2024-05-20T22:06:51.676244+0000 mon.a (mon.0) 756 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: cephadm 2024-05-20T22:06:51.677505+0000 mgr.y (mgr.14150) 367 : cephadm 1 Saving service prometheus spec with placement smithi145=a;count:1 2024-05-20T22:06:52.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: audit 2024-05-20T22:06:51.684909+0000 mon.a (mon.0) 757 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: audit 2024-05-20T22:06:51.685472+0000 mon.a (mon.0) 758 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:06:52.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: audit 2024-05-20T22:06:51.688453+0000 mon.a (mon.0) 759 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:52.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: audit 2024-05-20T22:06:51.690194+0000 mon.a (mon.0) 760 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:06:52.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: audit 2024-05-20T22:06:51.699565+0000 mon.a (mon.0) 761 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:52 smithi145 bash[23893]: cephadm 2024-05-20T22:06:52.011495+0000 mgr.y (mgr.14150) 368 : cephadm 1 Deploying daemon prometheus.a on smithi145 2024-05-20T22:06:52.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: audit 2024-05-20T22:06:51.541337+0000 mon.a (mon.0) 747 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: audit 2024-05-20T22:06:51.550393+0000 mon.a (mon.0) 748 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: cluster 2024-05-20T22:06:51.552259+0000 mgr.y (mgr.14150) 361 : cluster 0 pgmap v348: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 92 B/s rd, 92 B/s wr, 0 op/s 2024-05-20T22:06:52.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: audit 2024-05-20T22:06:51.552640+0000 mon.a (mon.0) 749 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:52.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: audit 2024-05-20T22:06:51.555042+0000 mon.a (mon.0) 750 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:06:52.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: audit 2024-05-20T22:06:51.564606+0000 mon.a (mon.0) 751 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: audit 2024-05-20T22:06:51.637751+0000 mon.a (mon.0) 752 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-20T22:06:52.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: audit 2024-05-20T22:06:51.638714+0000 mgr.y (mgr.14150) 362 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-20T22:06:52.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: cephadm 2024-05-20T22:06:51.640867+0000 mgr.y (mgr.14150) 363 : cephadm 1 Adding iSCSI gateway http://:@172.21.15.145:5000 to Dashboard 2024-05-20T22:06:52.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: audit 2024-05-20T22:06:51.641447+0000 mon.a (mon.0) 753 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-20T22:06:52.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: audit 2024-05-20T22:06:51.642042+0000 mgr.y (mgr.14150) 364 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-20T22:06:52.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: audit 2024-05-20T22:06:51.648961+0000 mon.a (mon.0) 754 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: audit 2024-05-20T22:06:51.668240+0000 mon.a (mon.0) 755 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi145"}]: dispatch 2024-05-20T22:06:52.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: audit 2024-05-20T22:06:51.669024+0000 mgr.y (mgr.14150) 365 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi145"}]: dispatch 2024-05-20T22:06:52.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: audit 2024-05-20T22:06:51.674298+0000 mgr.y (mgr.14150) 366 : audit 0 from='client.24511 v1:172.21.15.145:0/3563963306' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi145=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:06:52.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: audit 2024-05-20T22:06:51.676244+0000 mon.a (mon.0) 756 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: cephadm 2024-05-20T22:06:51.677505+0000 mgr.y (mgr.14150) 367 : cephadm 1 Saving service prometheus spec with placement smithi145=a;count:1 2024-05-20T22:06:52.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: audit 2024-05-20T22:06:51.684909+0000 mon.a (mon.0) 757 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: audit 2024-05-20T22:06:51.685472+0000 mon.a (mon.0) 758 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:06:52.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: audit 2024-05-20T22:06:51.541337+0000 mon.a (mon.0) 747 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: audit 2024-05-20T22:06:51.550393+0000 mon.a (mon.0) 748 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: cluster 2024-05-20T22:06:51.552259+0000 mgr.y (mgr.14150) 361 : cluster 0 pgmap v348: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 92 B/s rd, 92 B/s wr, 0 op/s 2024-05-20T22:06:52.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: audit 2024-05-20T22:06:51.552640+0000 mon.a (mon.0) 749 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:52.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: audit 2024-05-20T22:06:51.555042+0000 mon.a (mon.0) 750 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:06:52.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: audit 2024-05-20T22:06:51.564606+0000 mon.a (mon.0) 751 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: audit 2024-05-20T22:06:51.637751+0000 mon.a (mon.0) 752 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-20T22:06:52.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: audit 2024-05-20T22:06:51.638714+0000 mgr.y (mgr.14150) 362 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-20T22:06:52.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: cephadm 2024-05-20T22:06:51.640867+0000 mgr.y (mgr.14150) 363 : cephadm 1 Adding iSCSI gateway http://:@172.21.15.145:5000 to Dashboard 2024-05-20T22:06:52.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: audit 2024-05-20T22:06:51.641447+0000 mon.a (mon.0) 753 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-20T22:06:52.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: audit 2024-05-20T22:06:51.642042+0000 mgr.y (mgr.14150) 364 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-20T22:06:52.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: audit 2024-05-20T22:06:51.648961+0000 mon.a (mon.0) 754 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: audit 2024-05-20T22:06:51.668240+0000 mon.a (mon.0) 755 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi145"}]: dispatch 2024-05-20T22:06:52.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: audit 2024-05-20T22:06:51.669024+0000 mgr.y (mgr.14150) 365 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi145"}]: dispatch 2024-05-20T22:06:52.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: audit 2024-05-20T22:06:51.674298+0000 mgr.y (mgr.14150) 366 : audit 0 from='client.24511 v1:172.21.15.145:0/3563963306' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi145=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:06:52.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: audit 2024-05-20T22:06:51.676244+0000 mon.a (mon.0) 756 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: cephadm 2024-05-20T22:06:51.677505+0000 mgr.y (mgr.14150) 367 : cephadm 1 Saving service prometheus spec with placement smithi145=a;count:1 2024-05-20T22:06:52.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: audit 2024-05-20T22:06:51.684909+0000 mon.a (mon.0) 757 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: audit 2024-05-20T22:06:51.685472+0000 mon.a (mon.0) 758 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:06:52.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: audit 2024-05-20T22:06:51.688453+0000 mon.a (mon.0) 759 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:52.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: audit 2024-05-20T22:06:51.690194+0000 mon.a (mon.0) 760 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:06:52.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: audit 2024-05-20T22:06:51.699565+0000 mon.a (mon.0) 761 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:52 smithi050 bash[21866]: cephadm 2024-05-20T22:06:52.011495+0000 mgr.y (mgr.14150) 368 : cephadm 1 Deploying daemon prometheus.a on smithi145 2024-05-20T22:06:52.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: audit 2024-05-20T22:06:51.688453+0000 mon.a (mon.0) 759 : audit 0 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:06:52.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: audit 2024-05-20T22:06:51.690194+0000 mon.a (mon.0) 760 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:06:52.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: audit 2024-05-20T22:06:51.699565+0000 mon.a (mon.0) 761 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:06:52.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:52 smithi050 bash[28929]: cephadm 2024-05-20T22:06:52.011495+0000 mgr.y (mgr.14150) 368 : cephadm 1 Deploying daemon prometheus.a on smithi145 2024-05-20T22:06:54.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:54 smithi145 bash[23893]: cluster 2024-05-20T22:06:53.553620+0000 mgr.y (mgr.14150) 369 : cluster 0 pgmap v349: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 85 B/s wr, 1 op/s 2024-05-20T22:06:54.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:54 smithi050 bash[21866]: cluster 2024-05-20T22:06:53.553620+0000 mgr.y (mgr.14150) 369 : cluster 0 pgmap v349: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 85 B/s wr, 1 op/s 2024-05-20T22:06:54.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:54 smithi050 bash[28929]: cluster 2024-05-20T22:06:53.553620+0000 mgr.y (mgr.14150) 369 : cluster 0 pgmap v349: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 85 B/s wr, 1 op/s 2024-05-20T22:06:56.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:56 smithi145 bash[23893]: cluster 2024-05-20T22:06:55.554544+0000 mgr.y (mgr.14150) 370 : cluster 0 pgmap v350: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 85 B/s wr, 1 op/s 2024-05-20T22:06:56.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:56 smithi050 bash[21866]: cluster 2024-05-20T22:06:55.554544+0000 mgr.y (mgr.14150) 370 : cluster 0 pgmap v350: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 85 B/s wr, 1 op/s 2024-05-20T22:06:56.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:56 smithi050 bash[28929]: cluster 2024-05-20T22:06:55.554544+0000 mgr.y (mgr.14150) 370 : cluster 0 pgmap v350: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 85 B/s wr, 1 op/s 2024-05-20T22:06:57.155 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T22:06:57.640 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:06:57 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:06:58.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:58 smithi145 bash[23893]: audit 2024-05-20T22:06:57.385116+0000 mgr.y (mgr.14150) 371 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:06:58.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:06:58 smithi145 bash[23893]: cluster 2024-05-20T22:06:57.555686+0000 mgr.y (mgr.14150) 372 : cluster 0 pgmap v351: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 85 B/s wr, 1 op/s 2024-05-20T22:06:58.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:58 smithi050 bash[21866]: audit 2024-05-20T22:06:57.385116+0000 mgr.y (mgr.14150) 371 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:06:58.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:06:58 smithi050 bash[21866]: cluster 2024-05-20T22:06:57.555686+0000 mgr.y (mgr.14150) 372 : cluster 0 pgmap v351: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 85 B/s wr, 1 op/s 2024-05-20T22:06:58.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:58 smithi050 bash[28929]: audit 2024-05-20T22:06:57.385116+0000 mgr.y (mgr.14150) 371 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:06:58.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:06:58 smithi050 bash[28929]: cluster 2024-05-20T22:06:57.555686+0000 mgr.y (mgr.14150) 372 : cluster 0 pgmap v351: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 85 B/s wr, 1 op/s 2024-05-20T22:07:00.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:00 smithi145 bash[23893]: cluster 2024-05-20T22:06:59.556725+0000 mgr.y (mgr.14150) 373 : cluster 0 pgmap v352: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-05-20T22:07:00.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:00 smithi050 bash[21866]: cluster 2024-05-20T22:06:59.556725+0000 mgr.y (mgr.14150) 373 : cluster 0 pgmap v352: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-05-20T22:07:00.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:00 smithi050 bash[28929]: cluster 2024-05-20T22:06:59.556725+0000 mgr.y (mgr.14150) 373 : cluster 0 pgmap v352: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-05-20T22:07:02.873 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:02 smithi145 bash[23893]: cluster 2024-05-20T22:07:01.557544+0000 mgr.y (mgr.14150) 374 : cluster 0 pgmap v353: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:02.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:02 smithi050 bash[21866]: cluster 2024-05-20T22:07:01.557544+0000 mgr.y (mgr.14150) 374 : cluster 0 pgmap v353: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:02.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:02 smithi050 bash[28929]: cluster 2024-05-20T22:07:01.557544+0000 mgr.y (mgr.14150) 374 : cluster 0 pgmap v353: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:02.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.975+0000 7f54d64e8640 1 -- 172.21.15.145:0/2894397057 >> v1:172.21.15.145:6789/0 conn(0x7f54d0108770 legacy=0x7f54d010ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:02.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.975+0000 7f54d64e8640 1 -- 172.21.15.145:0/2894397057 shutdown_connections 2024-05-20T22:07:02.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.975+0000 7f54d64e8640 1 -- 172.21.15.145:0/2894397057 >> 172.21.15.145:0/2894397057 conn(0x7f54d00fbba0 msgr2=0x7f54d00fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:07:02.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.975+0000 7f54d64e8640 1 -- 172.21.15.145:0/2894397057 shutdown_connections 2024-05-20T22:07:02.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.975+0000 7f54d64e8640 1 -- 172.21.15.145:0/2894397057 wait complete. 2024-05-20T22:07:02.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54d64e8640 1 Processor -- start 2024-05-20T22:07:02.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54d64e8640 1 -- start start 2024-05-20T22:07:02.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54d64e8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f54d01977c0 con 0x7f54d0100600 2024-05-20T22:07:02.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54d64e8640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f54d01a3000 con 0x7f54d0104a30 2024-05-20T22:07:02.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54d64e8640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f54d01a41e0 con 0x7f54d0108770 2024-05-20T22:07:02.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54cf7fe640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f54d0104a30 0x7f54d019d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:50410/0 (socket says 172.21.15.145:50410) 2024-05-20T22:07:02.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54cf7fe640 1 -- 172.21.15.145:0/652041135 learned_addr learned my addr 172.21.15.145:0/652041135 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-05-20T22:07:02.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54cd7fa640 1 -- 172.21.15.145:0/652041135 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2275721490 0 0) 0x7f54d01a3000 con 0x7f54d0104a30 2024-05-20T22:07:02.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54cd7fa640 1 -- 172.21.15.145:0/652041135 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54bc003520 con 0x7f54d0104a30 2024-05-20T22:07:02.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54cd7fa640 1 -- 172.21.15.145:0/652041135 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4137077000 0 0) 0x7f54bc003520 con 0x7f54d0104a30 2024-05-20T22:07:02.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54cd7fa640 1 -- 172.21.15.145:0/652041135 --> v1:172.21.15.145:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f54d01a3000 con 0x7f54d0104a30 2024-05-20T22:07:02.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54cd7fa640 1 -- 172.21.15.145:0/652041135 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f54c00018f0 con 0x7f54d0104a30 2024-05-20T22:07:02.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54cd7fa640 1 -- 172.21.15.145:0/652041135 <== mon.1 v1:172.21.15.145:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3928756111 0 0) 0x7f54d01a3000 con 0x7f54d0104a30 2024-05-20T22:07:02.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54cd7fa640 1 -- 172.21.15.145:0/652041135 >> v1:172.21.15.50:6790/0 conn(0x7f54d0108770 legacy=0x7f54d01a08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:02.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54cd7fa640 1 -- 172.21.15.145:0/652041135 >> v1:172.21.15.50:6789/0 conn(0x7f54d0100600 legacy=0x7f54d0196cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:02.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54cd7fa640 1 -- 172.21.15.145:0/652041135 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d01a53c0 con 0x7f54d0104a30 2024-05-20T22:07:02.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54d64e8640 1 -- 172.21.15.145:0/652041135 --> v1:172.21.15.145:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f54d01a2050 con 0x7f54d0104a30 2024-05-20T22:07:02.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54d64e8640 1 -- 172.21.15.145:0/652041135 --> v1:172.21.15.145:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f54d01a2590 con 0x7f54d0104a30 2024-05-20T22:07:02.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54cd7fa640 1 -- 172.21.15.145:0/652041135 <== mon.1 v1:172.21.15.145:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f54c0003aa0 con 0x7f54d0104a30 2024-05-20T22:07:02.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54cd7fa640 1 -- 172.21.15.145:0/652041135 <== mon.1 v1:172.21.15.145:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f54c0005c70 con 0x7f54d0104a30 2024-05-20T22:07:02.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54d64e8640 1 -- 172.21.15.145:0/652041135 --> v1:172.21.15.145:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54b00050b0 con 0x7f54d0104a30 2024-05-20T22:07:02.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54cd7fa640 1 -- 172.21.15.145:0/652041135 <== mon.1 v1:172.21.15.145:6789/0 7 ==== mgrmap(e 16) ==== 92132+0+0 (unknown 3303984484 0 0) 0x7f54c00035f0 con 0x7f54d0104a30 2024-05-20T22:07:02.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.979+0000 7f54cd7fa640 1 -- 172.21.15.145:0/652041135 <== mon.1 v1:172.21.15.145:6789/0 8 ==== osd_map(71..71 src has 1..71) ==== 5942+0+0 (unknown 2135320820 0 0) 0x7f54c00896b0 con 0x7f54d0104a30 2024-05-20T22:07:02.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:02.983+0000 7f54cd7fa640 1 -- 172.21.15.145:0/652041135 <== mon.1 v1:172.21.15.145:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f54c0056d90 con 0x7f54d0104a30 2024-05-20T22:07:03.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:03.191+0000 7f54d64e8640 1 -- 172.21.15.145:0/652041135 --> v1:172.21.15.50:6800/2944911247 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi050=a;smithi145=b", "target": ["mon-mgr", ""]}) -- 0x7f54b0000bc0 con 0x7f54bc06ecb0 2024-05-20T22:07:03.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:03.203+0000 7f54cd7fa640 1 -- 172.21.15.145:0/652041135 <== mgr.14150 v1:172.21.15.50:6800/2944911247 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+34 (unknown 0 0 240551134) 0x7f54b0000bc0 con 0x7f54bc06ecb0 2024-05-20T22:07:03.202 INFO:teuthology.orchestra.run.smithi145.stdout:Scheduled node-exporter update... 2024-05-20T22:07:03.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:03.203+0000 7f54d64e8640 1 -- 172.21.15.145:0/652041135 >> v1:172.21.15.50:6800/2944911247 conn(0x7f54bc06ecb0 legacy=0x7f54bc071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:03.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:03.203+0000 7f54d64e8640 1 -- 172.21.15.145:0/652041135 >> v1:172.21.15.145:6789/0 conn(0x7f54d0104a30 legacy=0x7f54d019d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:03.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:03.203+0000 7f54d64e8640 1 -- 172.21.15.145:0/652041135 shutdown_connections 2024-05-20T22:07:03.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:03.203+0000 7f54d64e8640 1 -- 172.21.15.145:0/652041135 >> 172.21.15.145:0/652041135 conn(0x7f54d00fbba0 msgr2=0x7f54d0069b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:07:03.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:03.203+0000 7f54d64e8640 1 -- 172.21.15.145:0/652041135 shutdown_connections 2024-05-20T22:07:03.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:03.203+0000 7f54d64e8640 1 -- 172.21.15.145:0/652041135 wait complete. 2024-05-20T22:07:04.286 DEBUG:teuthology.orchestra.run.smithi050:node-exporter.a> sudo journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@node-exporter.a.service 2024-05-20T22:07:04.289 DEBUG:teuthology.orchestra.run.smithi145:node-exporter.b> sudo journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@node-exporter.b.service 2024-05-20T22:07:04.291 INFO:tasks.cephadm:Adding alertmanager.a on smithi050 2024-05-20T22:07:04.291 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph orch apply alertmanager '1;smithi050=a' 2024-05-20T22:07:04.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:04 smithi145 bash[23893]: audit 2024-05-20T22:07:03.196057+0000 mgr.y (mgr.14150) 375 : audit 0 from='client.24517 v1:172.21.15.145:0/652041135' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi050=a;smithi145=b", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:07:04.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:04 smithi145 bash[23893]: cephadm 2024-05-20T22:07:03.199248+0000 mgr.y (mgr.14150) 376 : cephadm 1 Saving service node-exporter spec with placement smithi050=a;smithi145=b;count:2 2024-05-20T22:07:04.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:04 smithi145 bash[23893]: audit 2024-05-20T22:07:03.206123+0000 mon.a (mon.0) 762 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:07:04.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:04 smithi050 bash[21866]: audit 2024-05-20T22:07:03.196057+0000 mgr.y (mgr.14150) 375 : audit 0 from='client.24517 v1:172.21.15.145:0/652041135' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi050=a;smithi145=b", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:07:04.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:04 smithi050 bash[21866]: cephadm 2024-05-20T22:07:03.199248+0000 mgr.y (mgr.14150) 376 : cephadm 1 Saving service node-exporter spec with placement smithi050=a;smithi145=b;count:2 2024-05-20T22:07:04.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:04 smithi050 bash[21866]: audit 2024-05-20T22:07:03.206123+0000 mon.a (mon.0) 762 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:07:04.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:04 smithi050 bash[28929]: audit 2024-05-20T22:07:03.196057+0000 mgr.y (mgr.14150) 375 : audit 0 from='client.24517 v1:172.21.15.145:0/652041135' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi050=a;smithi145=b", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:07:04.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:04 smithi050 bash[28929]: cephadm 2024-05-20T22:07:03.199248+0000 mgr.y (mgr.14150) 376 : cephadm 1 Saving service node-exporter spec with placement smithi050=a;smithi145=b;count:2 2024-05-20T22:07:04.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:04 smithi050 bash[28929]: audit 2024-05-20T22:07:03.206123+0000 mon.a (mon.0) 762 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:07:05.500 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:05 smithi145 bash[23893]: cluster 2024-05-20T22:07:03.558987+0000 mgr.y (mgr.14150) 377 : cluster 0 pgmap v354: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:05.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:05 smithi050 bash[21866]: cluster 2024-05-20T22:07:03.558987+0000 mgr.y (mgr.14150) 377 : cluster 0 pgmap v354: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:05.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:05 smithi050 bash[28929]: cluster 2024-05-20T22:07:03.558987+0000 mgr.y (mgr.14150) 377 : cluster 0 pgmap v354: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:06.237 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:07:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:06.237 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:07:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:06.238 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:07:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:06.238 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:07:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:06.238 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:06.239 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:07:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:06.239 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:06.526 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:06.526 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:06.526 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:07:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:06.527 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:07:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:06.527 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:07:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:06.527 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:07:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:06.527 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:07:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:06.528 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:06.528 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:06.528 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:06.528 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:06.528 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:06 smithi145 systemd[1]: Started Ceph prometheus.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968. 2024-05-20T22:07:07.488 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:07 smithi145 bash[23893]: cluster 2024-05-20T22:07:05.559961+0000 mgr.y (mgr.14150) 378 : cluster 0 pgmap v355: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:07.488 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:07 smithi145 bash[23893]: audit 2024-05-20T22:07:06.538179+0000 mon.a (mon.0) 763 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:07:07.489 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:07 smithi145 bash[23893]: audit 2024-05-20T22:07:06.547463+0000 mon.a (mon.0) 764 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:07:07.489 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:07 smithi145 bash[23893]: audit 2024-05-20T22:07:06.555327+0000 mon.a (mon.0) 765 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:07:07.489 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:07 smithi145 bash[23893]: audit 2024-05-20T22:07:06.559409+0000 mon.a (mon.0) 766 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-20T22:07:07.489 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:07:07.595 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:07 smithi050 bash[21866]: cluster 2024-05-20T22:07:05.559961+0000 mgr.y (mgr.14150) 378 : cluster 0 pgmap v355: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:07.595 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:07 smithi050 bash[21866]: audit 2024-05-20T22:07:06.538179+0000 mon.a (mon.0) 763 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:07:07.595 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:07 smithi050 bash[21866]: audit 2024-05-20T22:07:06.547463+0000 mon.a (mon.0) 764 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:07:07.595 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:07 smithi050 bash[21866]: audit 2024-05-20T22:07:06.555327+0000 mon.a (mon.0) 765 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:07:07.595 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:07 smithi050 bash[21866]: audit 2024-05-20T22:07:06.559409+0000 mon.a (mon.0) 766 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-20T22:07:07.595 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:07 smithi050 bash[28929]: cluster 2024-05-20T22:07:05.559961+0000 mgr.y (mgr.14150) 378 : cluster 0 pgmap v355: 132 pgs: 132 active+clean; 583 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:07.596 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:07 smithi050 bash[28929]: audit 2024-05-20T22:07:06.538179+0000 mon.a (mon.0) 763 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:07:07.596 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:07 smithi050 bash[28929]: audit 2024-05-20T22:07:06.547463+0000 mon.a (mon.0) 764 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:07:07.596 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:07 smithi050 bash[28929]: audit 2024-05-20T22:07:06.555327+0000 mon.a (mon.0) 765 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' 2024-05-20T22:07:07.596 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:07 smithi050 bash[28929]: audit 2024-05-20T22:07:06.559409+0000 mon.a (mon.0) 766 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-20T22:07:07.890 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:07 smithi145 bash[24790]: ignoring --setuser ceph since I am not root 2024-05-20T22:07:07.890 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:07 smithi145 bash[24790]: ignoring --setgroup ceph since I am not root 2024-05-20T22:07:07.891 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:07 smithi145 bash[24790]: debug 2024-05-20T22:07:07.719+0000 7fd632228040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T22:07:07.891 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[49673]: ts=2024-05-20T22:07:07.492Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-05-20T22:07:07.891 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[49673]: ts=2024-05-20T22:07:07.492Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-05-20T22:07:07.891 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[49673]: ts=2024-05-20T22:07:07.492Z caller=main.go:570 level=info host_details="(Linux 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 x86_64 smithi145 (none))" 2024-05-20T22:07:07.891 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[49673]: ts=2024-05-20T22:07:07.492Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-05-20T22:07:07.891 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[49673]: ts=2024-05-20T22:07:07.493Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-05-20T22:07:07.891 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[49673]: ts=2024-05-20T22:07:07.494Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-05-20T22:07:07.891 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[49673]: ts=2024-05-20T22:07:07.494Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-05-20T22:07:07.891 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[49673]: ts=2024-05-20T22:07:07.495Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-05-20T22:07:07.892 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[49673]: ts=2024-05-20T22:07:07.495Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-05-20T22:07:07.892 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[49673]: ts=2024-05-20T22:07:07.498Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-05-20T22:07:07.892 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[49673]: ts=2024-05-20T22:07:07.498Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=3.565µs 2024-05-20T22:07:07.892 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[49673]: ts=2024-05-20T22:07:07.498Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-05-20T22:07:07.892 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[49673]: ts=2024-05-20T22:07:07.499Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-05-20T22:07:07.892 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[49673]: ts=2024-05-20T22:07:07.499Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=42.474µs wal_replay_duration=972.473µs wbl_replay_duration=100ns total_replay_duration=1.097133ms 2024-05-20T22:07:07.892 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[49673]: ts=2024-05-20T22:07:07.500Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-05-20T22:07:07.892 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[49673]: ts=2024-05-20T22:07:07.500Z caller=main.go:1029 level=info msg="TSDB started" 2024-05-20T22:07:07.892 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[49673]: ts=2024-05-20T22:07:07.500Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-05-20T22:07:07.892 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[49673]: ts=2024-05-20T22:07:07.524Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=24.63309ms db_storage=911ns remote_storage=1.332µs web_handler=426ns query_engine=659ns scrape=290.225µs scrape_sd=107.914µs notify=1.275µs notify_sd=1.558µs rules=23.846858ms tracing=6.683µs 2024-05-20T22:07:07.892 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[49673]: ts=2024-05-20T22:07:07.524Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-05-20T22:07:07.892 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:07 smithi145 bash[49673]: ts=2024-05-20T22:07:07.524Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-05-20T22:07:07.943 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:07 smithi050 bash[22118]: ignoring --setuser ceph since I am not root 2024-05-20T22:07:07.944 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:07 smithi050 bash[22118]: ignoring --setgroup ceph since I am not root 2024-05-20T22:07:07.944 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:07 smithi050 bash[22118]: debug 2024-05-20T22:07:07.736+0000 7fb2d7dd2040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T22:07:08.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:08 smithi145 bash[23893]: audit 2024-05-20T22:07:07.556048+0000 mon.a (mon.0) 767 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-05-20T22:07:08.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:08 smithi145 bash[23893]: cluster 2024-05-20T22:07:07.570590+0000 mon.a (mon.0) 768 : cluster 0 mgrmap e17: y(active, since 9m), standbys: x 2024-05-20T22:07:08.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:08 smithi050 bash[21866]: audit 2024-05-20T22:07:07.556048+0000 mon.a (mon.0) 767 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-05-20T22:07:08.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:08 smithi050 bash[21866]: cluster 2024-05-20T22:07:07.570590+0000 mon.a (mon.0) 768 : cluster 0 mgrmap e17: y(active, since 9m), standbys: x 2024-05-20T22:07:08.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:08 smithi050 bash[28929]: audit 2024-05-20T22:07:07.556048+0000 mon.a (mon.0) 767 : audit 1 from='mgr.14150 v1:172.21.15.50:0/3230959122' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-05-20T22:07:08.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:08 smithi050 bash[28929]: cluster 2024-05-20T22:07:07.570590+0000 mon.a (mon.0) 768 : cluster 0 mgrmap e17: y(active, since 9m), standbys: x 2024-05-20T22:07:09.085 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T22:07:09.390 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:08 smithi145 bash[24790]: debug 2024-05-20T22:07:08.931+0000 7fd632228040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T22:07:09.390 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:08 smithi145 bash[24790]: debug 2024-05-20T22:07:08.995+0000 7fd632228040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T22:07:09.390 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:09 smithi145 bash[24790]: debug 2024-05-20T22:07:09.155+0000 7fd632228040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T22:07:09.443 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:09 smithi050 bash[22118]: debug 2024-05-20T22:07:09.020+0000 7fb2d7dd2040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T22:07:09.444 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:09 smithi050 bash[22118]: debug 2024-05-20T22:07:09.088+0000 7fb2d7dd2040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T22:07:09.444 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:09 smithi050 bash[22118]: debug 2024-05-20T22:07:09.252+0000 7fb2d7dd2040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T22:07:10.078 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:09 smithi145 bash[24790]: debug 2024-05-20T22:07:09.823+0000 7fd632228040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T22:07:10.078 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:09 smithi145 bash[24790]: debug 2024-05-20T22:07:09.895+0000 7fd632228040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T22:07:10.078 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:09 smithi145 bash[24790]: debug 2024-05-20T22:07:09.967+0000 7fd632228040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T22:07:10.296 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:09 smithi050 bash[22118]: debug 2024-05-20T22:07:09.948+0000 7fb2d7dd2040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T22:07:10.296 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:10 smithi050 bash[22118]: debug 2024-05-20T22:07:10.024+0000 7fb2d7dd2040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T22:07:10.296 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:10 smithi050 bash[22118]: debug 2024-05-20T22:07:10.100+0000 7fb2d7dd2040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T22:07:10.390 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:10 smithi145 bash[24790]: debug 2024-05-20T22:07:10.167+0000 7fd632228040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T22:07:10.390 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:10 smithi145 bash[24790]: debug 2024-05-20T22:07:10.247+0000 7fd632228040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T22:07:10.390 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:10 smithi145 bash[24790]: debug 2024-05-20T22:07:10.319+0000 7fd632228040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T22:07:10.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:10 smithi050 bash[22118]: debug 2024-05-20T22:07:10.296+0000 7fb2d7dd2040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T22:07:10.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:10 smithi050 bash[22118]: debug 2024-05-20T22:07:10.380+0000 7fb2d7dd2040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T22:07:10.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:10 smithi050 bash[22118]: debug 2024-05-20T22:07:10.452+0000 7fb2d7dd2040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T22:07:10.856 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:10 smithi145 bash[24790]: debug 2024-05-20T22:07:10.583+0000 7fd632228040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T22:07:10.856 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:10 smithi145 bash[24790]: debug 2024-05-20T22:07:10.655+0000 7fd632228040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T22:07:10.856 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:10 smithi145 bash[24790]: debug 2024-05-20T22:07:10.855+0000 7fd632228040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T22:07:11.013 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:10 smithi050 bash[22118]: debug 2024-05-20T22:07:10.728+0000 7fb2d7dd2040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T22:07:11.013 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:10 smithi050 bash[22118]: debug 2024-05-20T22:07:10.800+0000 7fb2d7dd2040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T22:07:11.140 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:10 smithi145 bash[24790]: debug 2024-05-20T22:07:10.939+0000 7fd632228040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T22:07:11.364 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:11 smithi050 bash[22118]: debug 2024-05-20T22:07:11.012+0000 7fb2d7dd2040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T22:07:11.364 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:11 smithi050 bash[22118]: debug 2024-05-20T22:07:11.096+0000 7fb2d7dd2040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T22:07:11.549 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:11 smithi145 bash[24790]: debug 2024-05-20T22:07:11.199+0000 7fd632228040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T22:07:11.549 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:11 smithi145 bash[24790]: debug 2024-05-20T22:07:11.379+0000 7fd632228040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T22:07:11.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:11 smithi050 bash[22118]: debug 2024-05-20T22:07:11.364+0000 7fb2d7dd2040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T22:07:11.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:11 smithi050 bash[22118]: debug 2024-05-20T22:07:11.552+0000 7fb2d7dd2040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T22:07:11.825 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:11 smithi145 bash[24790]: debug 2024-05-20T22:07:11.551+0000 7fd632228040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T22:07:11.825 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:11 smithi145 bash[24790]: debug 2024-05-20T22:07:11.631+0000 7fd632228040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T22:07:11.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.835+0000 7fc27a7ef640 1 -- 172.21.15.145:0/816880365 >> v1:172.21.15.145:6789/0 conn(0x7fc2741041a0 legacy=0x7fc2741065f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:11.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.835+0000 7fc27a7ef640 1 -- 172.21.15.145:0/816880365 shutdown_connections 2024-05-20T22:07:11.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.835+0000 7fc27a7ef640 1 -- 172.21.15.145:0/816880365 >> 172.21.15.145:0/816880365 conn(0x7fc2740fb310 msgr2=0x7fc2740fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:07:11.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.835+0000 7fc27a7ef640 1 -- 172.21.15.145:0/816880365 shutdown_connections 2024-05-20T22:07:11.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.835+0000 7fc27a7ef640 1 -- 172.21.15.145:0/816880365 wait complete. 2024-05-20T22:07:11.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc27a7ef640 1 Processor -- start 2024-05-20T22:07:11.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc27a7ef640 1 -- start start 2024-05-20T22:07:11.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc27a7ef640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc274199a40 con 0x7fc274107ee0 2024-05-20T22:07:11.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc27a7ef640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc2741a5290 con 0x7fc2740ffd70 2024-05-20T22:07:11.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc27a7ef640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc2741a6470 con 0x7fc2741041a0 2024-05-20T22:07:11.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc273fff640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fc2740ffd70 0x7fc274198f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:55614/0 (socket says 172.21.15.145:55614) 2024-05-20T22:07:11.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc273fff640 1 -- 172.21.15.145:0/2211096582 learned_addr learned my addr 172.21.15.145:0/2211096582 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-05-20T22:07:11.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 529281649 0 0) 0x7fc2741a5290 con 0x7fc2740ffd70 2024-05-20T22:07:11.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc25c004630 con 0x7fc2740ffd70 2024-05-20T22:07:11.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 675392322 0 0) 0x7fc2741a6470 con 0x7fc2741041a0 2024-05-20T22:07:11.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2741a5290 con 0x7fc2741041a0 2024-05-20T22:07:11.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3618700122 0 0) 0x7fc25c004630 con 0x7fc2740ffd70 2024-05-20T22:07:11.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 --> v1:172.21.15.145:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc2741a6470 con 0x7fc2740ffd70 2024-05-20T22:07:11.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fc2640018f0 con 0x7fc2740ffd70 2024-05-20T22:07:11.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4233872879 0 0) 0x7fc274199a40 con 0x7fc274107ee0 2024-05-20T22:07:11.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc25c004630 con 0x7fc274107ee0 2024-05-20T22:07:11.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 <== mon.1 v1:172.21.15.145:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 714233546 0 0) 0x7fc2741a6470 con 0x7fc2740ffd70 2024-05-20T22:07:11.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 >> v1:172.21.15.50:6790/0 conn(0x7fc2741041a0 legacy=0x7fc27419f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:11.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 >> v1:172.21.15.50:6789/0 conn(0x7fc274107ee0 legacy=0x7fc2741a2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:11.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2741a7650 con 0x7fc2740ffd70 2024-05-20T22:07:11.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc27a7ef640 1 -- 172.21.15.145:0/2211096582 --> v1:172.21.15.145:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc2741a66a0 con 0x7fc2740ffd70 2024-05-20T22:07:11.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc27a7ef640 1 -- 172.21.15.145:0/2211096582 --> v1:172.21.15.145:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc2741a6be0 con 0x7fc2740ffd70 2024-05-20T22:07:11.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 <== mon.1 v1:172.21.15.145:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7fc264001cc0 con 0x7fc2740ffd70 2024-05-20T22:07:11.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 <== mon.1 v1:172.21.15.145:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fc264005c80 con 0x7fc2740ffd70 2024-05-20T22:07:11.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc27a7ef640 1 -- 172.21.15.145:0/2211096582 --> v1:172.21.15.145:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc260005080 con 0x7fc2740ffd70 2024-05-20T22:07:11.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 <== mon.1 v1:172.21.15.145:6789/0 7 ==== mgrmap(e 17) ==== 92146+0+0 (unknown 2500812878 0 0) 0x7fc264003fc0 con 0x7fc2740ffd70 2024-05-20T22:07:11.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc2737fe640 1 -- 172.21.15.145:0/2211096582 >> v1:172.21.15.50:6800/2944911247 conn(0x7fc25c06eec0 legacy=0x7fc25c071380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/2944911247 2024-05-20T22:07:11.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.839+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 <== mon.1 v1:172.21.15.145:6789/0 8 ==== osd_map(71..71 src has 1..71) ==== 5942+0+0 (unknown 2135320820 0 0) 0x7fc2640895b0 con 0x7fc2740ffd70 2024-05-20T22:07:11.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:11.847+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 <== mon.1 v1:172.21.15.145:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7fc264056c90 con 0x7fc2740ffd70 2024-05-20T22:07:12.006 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:11 smithi050 bash[22118]: debug 2024-05-20T22:07:11.728+0000 7fb2d7dd2040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T22:07:12.007 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:11 smithi050 bash[22118]: debug 2024-05-20T22:07:11.812+0000 7fb2d7dd2040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T22:07:12.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:12.039+0000 7fc27a7ef640 1 -- 172.21.15.145:0/2211096582 --> v1:172.21.15.50:6800/2944911247 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi050=a", "target": ["mon-mgr", ""]}) -- 0x7fc260000b90 con 0x7fc25c06eec0 2024-05-20T22:07:12.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:12.043+0000 7fc2737fe640 1 -- 172.21.15.145:0/2211096582 >> v1:172.21.15.50:6800/2944911247 conn(0x7fc25c06eec0 legacy=0x7fc25c071380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/2944911247 2024-05-20T22:07:12.140 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:11 smithi145 bash[24790]: debug 2024-05-20T22:07:11.827+0000 7fd632228040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T22:07:12.443 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:12 smithi050 bash[22118]: debug 2024-05-20T22:07:12.008+0000 7fb2d7dd2040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T22:07:12.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:12.447+0000 7fc2737fe640 1 -- 172.21.15.145:0/2211096582 >> v1:172.21.15.50:6800/2944911247 conn(0x7fc25c06eec0 legacy=0x7fc25c071380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/2944911247 2024-05-20T22:07:12.954 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:12 smithi145 bash[24790]: debug 2024-05-20T22:07:12.647+0000 7fd632228040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T22:07:12.954 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:12 smithi145 bash[24790]: debug 2024-05-20T22:07:12.727+0000 7fd632228040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T22:07:13.194 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:12 smithi050 bash[22118]: debug 2024-05-20T22:07:12.876+0000 7fb2d7dd2040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T22:07:13.194 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:12 smithi050 bash[22118]: debug 2024-05-20T22:07:12.960+0000 7fb2d7dd2040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T22:07:13.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:13.251+0000 7fc2737fe640 1 -- 172.21.15.145:0/2211096582 >> v1:172.21.15.50:6800/2944911247 conn(0x7fc25c06eec0 legacy=0x7fc25c071380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.50:6800/2944911247 2024-05-20T22:07:13.390 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:12 smithi145 bash[24790]: debug 2024-05-20T22:07:12.955+0000 7fd632228040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T22:07:13.390 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:13 smithi145 bash[24790]: debug 2024-05-20T22:07:13.031+0000 7fd632228040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T22:07:13.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:13.595+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 <== mon.1 v1:172.21.15.145:6789/0 10 ==== mgrmap(e 18) ==== 92146+0+0 (unknown 2612429557 0 0) 0x7fc264004330 con 0x7fc2740ffd70 2024-05-20T22:07:13.599 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:13 smithi050 bash[22118]: debug 2024-05-20T22:07:13.204+0000 7fb2d7dd2040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T22:07:13.599 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:13 smithi050 bash[22118]: debug 2024-05-20T22:07:13.280+0000 7fb2d7dd2040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T22:07:13.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:13.827+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 <== mon.1 v1:172.21.15.145:6789/0 11 ==== mgrmap(e 19) ==== 91798+0+0 (unknown 2238744653 0 0) 0x7fc264052250 con 0x7fc2740ffd70 2024-05-20T22:07:13.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:13.827+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 >> v1:172.21.15.50:6800/2944911247 conn(0x7fc25c06eec0 legacy=0x7fc25c071380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T22:07:13.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:13 smithi145 bash[23893]: cluster 2024-05-20T22:07:13.537421+0000 mon.a (mon.0) 769 : cluster 0 Standby manager daemon x restarted 2024-05-20T22:07:13.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:13 smithi145 bash[23893]: cluster 2024-05-20T22:07:13.537620+0000 mon.a (mon.0) 770 : cluster 0 Standby manager daemon x started 2024-05-20T22:07:13.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:13 smithi145 bash[23893]: audit 2024-05-20T22:07:13.539524+0000 mon.c (mon.2) 13 : audit 0 from='mgr.? v1:172.21.15.145:0/3687150320' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-20T22:07:13.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:13 smithi145 bash[23893]: audit 2024-05-20T22:07:13.540559+0000 mon.c (mon.2) 14 : audit 0 from='mgr.? v1:172.21.15.145:0/3687150320' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T22:07:13.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:13 smithi145 bash[23893]: audit 2024-05-20T22:07:13.543399+0000 mon.c (mon.2) 15 : audit 0 from='mgr.? v1:172.21.15.145:0/3687150320' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-20T22:07:13.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:13 smithi145 bash[23893]: audit 2024-05-20T22:07:13.543984+0000 mon.c (mon.2) 16 : audit 0 from='mgr.? v1:172.21.15.145:0/3687150320' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T22:07:13.891 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:13 smithi145 bash[24790]: debug 2024-05-20T22:07:13.431+0000 7fd632228040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T22:07:13.891 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:13 smithi145 bash[24790]: debug 2024-05-20T22:07:13.511+0000 7fd632228040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T22:07:13.891 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:13 smithi145 bash[24790]: [20/May/2024:22:07:13] ENGINE Bus STARTING 2024-05-20T22:07:13.891 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:13 smithi145 bash[24790]: CherryPy Checker: 2024-05-20T22:07:13.892 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:13 smithi145 bash[24790]: The Application mounted at '' has an empty config. 2024-05-20T22:07:13.892 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:13 smithi145 bash[24790]: [20/May/2024:22:07:13] ENGINE Serving on http://:::9283 2024-05-20T22:07:13.892 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:13 smithi145 bash[24790]: [20/May/2024:22:07:13] ENGINE Bus STARTED 2024-05-20T22:07:13.915 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:13 smithi050 bash[22118]: debug 2024-05-20T22:07:13.704+0000 7fb2d7dd2040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T22:07:13.916 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:13 smithi050 bash[22118]: debug 2024-05-20T22:07:13.788+0000 7fb2d7dd2040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T22:07:13.916 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:13 smithi050 bash[28929]: cluster 2024-05-20T22:07:13.537421+0000 mon.a (mon.0) 769 : cluster 0 Standby manager daemon x restarted 2024-05-20T22:07:13.916 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:13 smithi050 bash[28929]: cluster 2024-05-20T22:07:13.537620+0000 mon.a (mon.0) 770 : cluster 0 Standby manager daemon x started 2024-05-20T22:07:13.916 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:13 smithi050 bash[28929]: audit 2024-05-20T22:07:13.539524+0000 mon.c (mon.2) 13 : audit 0 from='mgr.? v1:172.21.15.145:0/3687150320' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-20T22:07:13.916 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:13 smithi050 bash[28929]: audit 2024-05-20T22:07:13.540559+0000 mon.c (mon.2) 14 : audit 0 from='mgr.? v1:172.21.15.145:0/3687150320' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T22:07:13.916 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:13 smithi050 bash[28929]: audit 2024-05-20T22:07:13.543399+0000 mon.c (mon.2) 15 : audit 0 from='mgr.? v1:172.21.15.145:0/3687150320' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-20T22:07:13.916 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:13 smithi050 bash[28929]: audit 2024-05-20T22:07:13.543984+0000 mon.c (mon.2) 16 : audit 0 from='mgr.? v1:172.21.15.145:0/3687150320' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T22:07:13.916 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:13 smithi050 bash[21866]: cluster 2024-05-20T22:07:13.537421+0000 mon.a (mon.0) 769 : cluster 0 Standby manager daemon x restarted 2024-05-20T22:07:13.917 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:13 smithi050 bash[21866]: cluster 2024-05-20T22:07:13.537620+0000 mon.a (mon.0) 770 : cluster 0 Standby manager daemon x started 2024-05-20T22:07:13.917 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:13 smithi050 bash[21866]: audit 2024-05-20T22:07:13.539524+0000 mon.c (mon.2) 13 : audit 0 from='mgr.? v1:172.21.15.145:0/3687150320' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-20T22:07:13.917 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:13 smithi050 bash[21866]: audit 2024-05-20T22:07:13.540559+0000 mon.c (mon.2) 14 : audit 0 from='mgr.? v1:172.21.15.145:0/3687150320' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T22:07:13.917 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:13 smithi050 bash[21866]: audit 2024-05-20T22:07:13.543399+0000 mon.c (mon.2) 15 : audit 0 from='mgr.? v1:172.21.15.145:0/3687150320' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-20T22:07:13.917 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:13 smithi050 bash[21866]: audit 2024-05-20T22:07:13.543984+0000 mon.c (mon.2) 16 : audit 0 from='mgr.? v1:172.21.15.145:0/3687150320' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T22:07:14.184 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:13 smithi050 bash[22118]: [20/May/2024:22:07:13] ENGINE Bus STARTING 2024-05-20T22:07:14.184 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:13 smithi050 bash[22118]: CherryPy Checker: 2024-05-20T22:07:14.184 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:13 smithi050 bash[22118]: The Application mounted at '' has an empty config. 2024-05-20T22:07:14.184 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:14 smithi050 bash[22118]: [20/May/2024:22:07:14] ENGINE Serving on http://:::9283 2024-05-20T22:07:14.184 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:14 smithi050 bash[22118]: [20/May/2024:22:07:14] ENGINE Bus STARTED 2024-05-20T22:07:14.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:14.831+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 <== mon.1 v1:172.21.15.145:6789/0 12 ==== mgrmap(e 20) ==== 91890+0+0 (unknown 74020004 0 0) 0x7fc264051d40 con 0x7fc2740ffd70 2024-05-20T22:07:14.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:14.831+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 --> v1:172.21.15.50:6800/3332714287 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi050=a", "target": ["mon-mgr", ""]}) -- 0x7fc264055280 con 0x7fc25c078f00 2024-05-20T22:07:14.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:14.847+0000 7fc2717fa640 1 -- 172.21.15.145:0/2211096582 <== mgr.14592 v1:172.21.15.50:6800/3332714287 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+33 (unknown 0 0 1850065467) 0x7fc264055280 con 0x7fc25c078f00 2024-05-20T22:07:14.846 INFO:teuthology.orchestra.run.smithi145.stdout:Scheduled alertmanager update... 2024-05-20T22:07:14.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:14.851+0000 7fc27a7ef640 1 -- 172.21.15.145:0/2211096582 >> v1:172.21.15.50:6800/3332714287 conn(0x7fc25c078f00 legacy=0x7fc25c07b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:14.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:14.851+0000 7fc27a7ef640 1 -- 172.21.15.145:0/2211096582 >> v1:172.21.15.145:6789/0 conn(0x7fc2740ffd70 legacy=0x7fc274198f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:14.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:14.851+0000 7fc278d8c640 1 -- 172.21.15.145:0/2211096582 reap_dead start 2024-05-20T22:07:14.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:14.851+0000 7fc27a7ef640 1 -- 172.21.15.145:0/2211096582 shutdown_connections 2024-05-20T22:07:14.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:14.851+0000 7fc27a7ef640 1 -- 172.21.15.145:0/2211096582 >> 172.21.15.145:0/2211096582 conn(0x7fc2740fb310 msgr2=0x7fc2741075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:07:14.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:14.851+0000 7fc27a7ef640 1 -- 172.21.15.145:0/2211096582 shutdown_connections 2024-05-20T22:07:14.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:14.851+0000 7fc27a7ef640 1 -- 172.21.15.145:0/2211096582 wait complete. 2024-05-20T22:07:14.858 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: cluster 2024-05-20T22:07:13.602627+0000 mon.a (mon.0) 771 : cluster 0 mgrmap e18: y(active, since 9m), standbys: x 2024-05-20T22:07:14.858 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: cluster 2024-05-20T22:07:13.813745+0000 mon.a (mon.0) 772 : cluster 1 Active manager daemon y restarted 2024-05-20T22:07:14.859 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: cluster 2024-05-20T22:07:13.814334+0000 mon.a (mon.0) 773 : cluster 1 Activating manager daemon y 2024-05-20T22:07:14.859 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: cluster 2024-05-20T22:07:13.822594+0000 mon.a (mon.0) 774 : cluster 0 osdmap e72: 8 total, 8 up, 8 in 2024-05-20T22:07:14.859 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: cluster 2024-05-20T22:07:13.822959+0000 mon.a (mon.0) 775 : cluster 0 mgrmap e19: y(active, starting, since 0.0088014s), standbys: x 2024-05-20T22:07:14.859 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.831055+0000 mon.a (mon.0) 776 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T22:07:14.859 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.831171+0000 mon.a (mon.0) 777 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T22:07:14.859 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.831271+0000 mon.a (mon.0) 778 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T22:07:14.859 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.834549+0000 mon.a (mon.0) 779 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-20T22:07:14.859 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.834751+0000 mon.a (mon.0) 780 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-20T22:07:14.859 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.835004+0000 mon.a (mon.0) 781 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T22:07:14.859 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.835203+0000 mon.a (mon.0) 782 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T22:07:14.859 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.835349+0000 mon.a (mon.0) 783 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:07:14.860 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.835508+0000 mon.a (mon.0) 784 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:07:14.860 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.835703+0000 mon.a (mon.0) 785 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T22:07:14.860 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.835886+0000 mon.a (mon.0) 786 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T22:07:14.860 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.836069+0000 mon.a (mon.0) 787 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T22:07:14.860 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.836271+0000 mon.a (mon.0) 788 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T22:07:14.860 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.836520+0000 mon.a (mon.0) 789 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-20T22:07:14.860 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.836692+0000 mon.a (mon.0) 790 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-20T22:07:14.860 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.837150+0000 mon.a (mon.0) 791 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-20T22:07:14.860 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: cluster 2024-05-20T22:07:13.861967+0000 mon.a (mon.0) 792 : cluster 1 Manager daemon y is now available 2024-05-20T22:07:14.860 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.891848+0000 mon.a (mon.0) 793 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:07:14.860 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.916546+0000 mon.a (mon.0) 794 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:14.860 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.921152+0000 mon.a (mon.0) 795 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:07:14.860 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.930703+0000 mon.a (mon.0) 796 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-20T22:07:14.861 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:14 smithi145 bash[23893]: audit 2024-05-20T22:07:13.954703+0000 mon.a (mon.0) 797 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-20T22:07:14.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: cluster 2024-05-20T22:07:13.602627+0000 mon.a (mon.0) 771 : cluster 0 mgrmap e18: y(active, since 9m), standbys: x 2024-05-20T22:07:14.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: cluster 2024-05-20T22:07:13.813745+0000 mon.a (mon.0) 772 : cluster 1 Active manager daemon y restarted 2024-05-20T22:07:14.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: cluster 2024-05-20T22:07:13.814334+0000 mon.a (mon.0) 773 : cluster 1 Activating manager daemon y 2024-05-20T22:07:14.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: cluster 2024-05-20T22:07:13.822594+0000 mon.a (mon.0) 774 : cluster 0 osdmap e72: 8 total, 8 up, 8 in 2024-05-20T22:07:14.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: cluster 2024-05-20T22:07:13.822959+0000 mon.a (mon.0) 775 : cluster 0 mgrmap e19: y(active, starting, since 0.0088014s), standbys: x 2024-05-20T22:07:14.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.831055+0000 mon.a (mon.0) 776 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T22:07:14.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.831171+0000 mon.a (mon.0) 777 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T22:07:14.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.831271+0000 mon.a (mon.0) 778 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T22:07:14.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.834549+0000 mon.a (mon.0) 779 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-20T22:07:14.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.834751+0000 mon.a (mon.0) 780 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-20T22:07:14.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.835004+0000 mon.a (mon.0) 781 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T22:07:14.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.835203+0000 mon.a (mon.0) 782 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T22:07:14.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.835349+0000 mon.a (mon.0) 783 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:07:14.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.835508+0000 mon.a (mon.0) 784 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:07:14.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.835703+0000 mon.a (mon.0) 785 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T22:07:14.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.835886+0000 mon.a (mon.0) 786 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T22:07:14.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.836069+0000 mon.a (mon.0) 787 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T22:07:14.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.836271+0000 mon.a (mon.0) 788 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T22:07:14.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.836520+0000 mon.a (mon.0) 789 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-20T22:07:14.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.836692+0000 mon.a (mon.0) 790 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-20T22:07:14.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.837150+0000 mon.a (mon.0) 791 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-20T22:07:14.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: cluster 2024-05-20T22:07:13.861967+0000 mon.a (mon.0) 792 : cluster 1 Manager daemon y is now available 2024-05-20T22:07:14.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.891848+0000 mon.a (mon.0) 793 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:07:14.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.916546+0000 mon.a (mon.0) 794 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:14.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.921152+0000 mon.a (mon.0) 795 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:07:14.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.930703+0000 mon.a (mon.0) 796 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-20T22:07:14.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:14 smithi050 bash[21866]: audit 2024-05-20T22:07:13.954703+0000 mon.a (mon.0) 797 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-20T22:07:14.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: cluster 2024-05-20T22:07:13.602627+0000 mon.a (mon.0) 771 : cluster 0 mgrmap e18: y(active, since 9m), standbys: x 2024-05-20T22:07:14.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: cluster 2024-05-20T22:07:13.813745+0000 mon.a (mon.0) 772 : cluster 1 Active manager daemon y restarted 2024-05-20T22:07:14.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: cluster 2024-05-20T22:07:13.814334+0000 mon.a (mon.0) 773 : cluster 1 Activating manager daemon y 2024-05-20T22:07:14.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: cluster 2024-05-20T22:07:13.822594+0000 mon.a (mon.0) 774 : cluster 0 osdmap e72: 8 total, 8 up, 8 in 2024-05-20T22:07:14.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: cluster 2024-05-20T22:07:13.822959+0000 mon.a (mon.0) 775 : cluster 0 mgrmap e19: y(active, starting, since 0.0088014s), standbys: x 2024-05-20T22:07:14.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.831055+0000 mon.a (mon.0) 776 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T22:07:14.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.831171+0000 mon.a (mon.0) 777 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T22:07:14.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.831271+0000 mon.a (mon.0) 778 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T22:07:14.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.834549+0000 mon.a (mon.0) 779 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-20T22:07:14.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.834751+0000 mon.a (mon.0) 780 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-20T22:07:14.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.835004+0000 mon.a (mon.0) 781 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T22:07:14.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.835203+0000 mon.a (mon.0) 782 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T22:07:14.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.835349+0000 mon.a (mon.0) 783 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T22:07:14.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.835508+0000 mon.a (mon.0) 784 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T22:07:14.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.835703+0000 mon.a (mon.0) 785 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T22:07:14.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.835886+0000 mon.a (mon.0) 786 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T22:07:14.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.836069+0000 mon.a (mon.0) 787 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T22:07:14.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.836271+0000 mon.a (mon.0) 788 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T22:07:14.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.836520+0000 mon.a (mon.0) 789 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-20T22:07:14.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.836692+0000 mon.a (mon.0) 790 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-20T22:07:14.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.837150+0000 mon.a (mon.0) 791 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-20T22:07:14.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: cluster 2024-05-20T22:07:13.861967+0000 mon.a (mon.0) 792 : cluster 1 Manager daemon y is now available 2024-05-20T22:07:14.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.891848+0000 mon.a (mon.0) 793 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:07:14.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.916546+0000 mon.a (mon.0) 794 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:14.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.921152+0000 mon.a (mon.0) 795 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:07:14.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.930703+0000 mon.a (mon.0) 796 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-20T22:07:14.948 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:14 smithi050 bash[28929]: audit 2024-05-20T22:07:13.954703+0000 mon.a (mon.0) 797 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-20T22:07:15.557 DEBUG:teuthology.orchestra.run.smithi050:alertmanager.a> sudo journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@alertmanager.a.service 2024-05-20T22:07:15.559 INFO:tasks.cephadm:Adding grafana.a on smithi145 2024-05-20T22:07:15.559 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph orch apply grafana '1;smithi145=a' 2024-05-20T22:07:16.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:15 smithi145 bash[23893]: cluster 2024-05-20T22:07:14.836506+0000 mon.a (mon.0) 798 : cluster 0 mgrmap e20: y(active, since 1.02224s), standbys: x 2024-05-20T22:07:16.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:15 smithi145 bash[23893]: cephadm 2024-05-20T22:07:14.846407+0000 mgr.y (mgr.14592) 2 : cephadm 1 Saving service alertmanager spec with placement smithi050=a;count:1 2024-05-20T22:07:16.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:15 smithi145 bash[23893]: cluster 2024-05-20T22:07:14.849105+0000 mgr.y (mgr.14592) 3 : cluster 0 pgmap v3: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:07:16.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:15 smithi145 bash[23893]: audit 2024-05-20T22:07:14.851036+0000 mon.a (mon.0) 799 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:16.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:15 smithi145 bash[23893]: audit 2024-05-20T22:07:14.912500+0000 mon.a (mon.0) 800 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:16.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:15 smithi145 bash[23893]: audit 2024-05-20T22:07:14.916067+0000 mon.a (mon.0) 801 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:16.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:15 smithi050 bash[21866]: cluster 2024-05-20T22:07:14.836506+0000 mon.a (mon.0) 798 : cluster 0 mgrmap e20: y(active, since 1.02224s), standbys: x 2024-05-20T22:07:16.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:15 smithi050 bash[21866]: cephadm 2024-05-20T22:07:14.846407+0000 mgr.y (mgr.14592) 2 : cephadm 1 Saving service alertmanager spec with placement smithi050=a;count:1 2024-05-20T22:07:16.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:15 smithi050 bash[21866]: cluster 2024-05-20T22:07:14.849105+0000 mgr.y (mgr.14592) 3 : cluster 0 pgmap v3: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:07:16.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:15 smithi050 bash[21866]: audit 2024-05-20T22:07:14.851036+0000 mon.a (mon.0) 799 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:16.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:15 smithi050 bash[21866]: audit 2024-05-20T22:07:14.912500+0000 mon.a (mon.0) 800 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:16.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:15 smithi050 bash[21866]: audit 2024-05-20T22:07:14.916067+0000 mon.a (mon.0) 801 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:16.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:15 smithi050 bash[28929]: cluster 2024-05-20T22:07:14.836506+0000 mon.a (mon.0) 798 : cluster 0 mgrmap e20: y(active, since 1.02224s), standbys: x 2024-05-20T22:07:16.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:15 smithi050 bash[28929]: cephadm 2024-05-20T22:07:14.846407+0000 mgr.y (mgr.14592) 2 : cephadm 1 Saving service alertmanager spec with placement smithi050=a;count:1 2024-05-20T22:07:16.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:15 smithi050 bash[28929]: cluster 2024-05-20T22:07:14.849105+0000 mgr.y (mgr.14592) 3 : cluster 0 pgmap v3: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:07:16.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:15 smithi050 bash[28929]: audit 2024-05-20T22:07:14.851036+0000 mon.a (mon.0) 799 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:16.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:15 smithi050 bash[28929]: audit 2024-05-20T22:07:14.912500+0000 mon.a (mon.0) 800 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:16.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:15 smithi050 bash[28929]: audit 2024-05-20T22:07:14.916067+0000 mon.a (mon.0) 801 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:17.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:16 smithi145 bash[23893]: cluster 2024-05-20T22:07:15.836735+0000 mgr.y (mgr.14592) 4 : cluster 0 pgmap v4: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:07:17.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:16 smithi145 bash[23893]: cluster 2024-05-20T22:07:16.833860+0000 mon.a (mon.0) 802 : cluster 0 mgrmap e21: y(active, since 3s), standbys: x 2024-05-20T22:07:17.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:16 smithi050 bash[21866]: cluster 2024-05-20T22:07:15.836735+0000 mgr.y (mgr.14592) 4 : cluster 0 pgmap v4: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:07:17.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:16 smithi050 bash[21866]: cluster 2024-05-20T22:07:16.833860+0000 mon.a (mon.0) 802 : cluster 0 mgrmap e21: y(active, since 3s), standbys: x 2024-05-20T22:07:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:16 smithi050 bash[28929]: cluster 2024-05-20T22:07:15.836735+0000 mgr.y (mgr.14592) 4 : cluster 0 pgmap v4: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:07:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:16 smithi050 bash[28929]: cluster 2024-05-20T22:07:16.833860+0000 mon.a (mon.0) 802 : cluster 0 mgrmap e21: y(active, since 3s), standbys: x 2024-05-20T22:07:17.194 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:17 smithi050 bash[22118]: debug 2024-05-20T22:07:17.044+0000 7fb22b87e640 -1 log_channel(cephadm) log [ERR] : [20/May/2024:22:07:17] ENGINE Error in HTTPServer.serve 2024-05-20T22:07:17.195 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:17 smithi050 bash[22118]: Traceback (most recent call last): 2024-05-20T22:07:17.195 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:17 smithi050 bash[22118]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-05-20T22:07:17.195 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:17 smithi050 bash[22118]: self._connections.run(self.expiration_interval) 2024-05-20T22:07:17.195 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:17 smithi050 bash[22118]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-05-20T22:07:17.195 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:17 smithi050 bash[22118]: self._run(expiration_interval) 2024-05-20T22:07:17.195 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:17 smithi050 bash[22118]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-05-20T22:07:17.195 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:17 smithi050 bash[22118]: new_conn = self._from_server_socket(self.server.socket) 2024-05-20T22:07:17.195 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:17 smithi050 bash[22118]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-05-20T22:07:17.195 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:17 smithi050 bash[22118]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-05-20T22:07:17.195 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:17 smithi050 bash[22118]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-05-20T22:07:17.195 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:17 smithi050 bash[22118]: s = self.context.wrap_socket( 2024-05-20T22:07:17.195 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:17 smithi050 bash[22118]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-05-20T22:07:17.195 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:17 smithi050 bash[22118]: return self.sslsocket_class._create( 2024-05-20T22:07:17.195 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:17 smithi050 bash[22118]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-05-20T22:07:17.195 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:17 smithi050 bash[22118]: self.do_handshake() 2024-05-20T22:07:17.195 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:17 smithi050 bash[22118]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-05-20T22:07:17.196 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:17 smithi050 bash[22118]: self._sslobj.do_handshake() 2024-05-20T22:07:17.196 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:17 smithi050 bash[22118]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-05-20T22:07:17.857 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:07:17 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:07:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: cephadm 2024-05-20T22:07:16.821001+0000 mgr.y (mgr.14592) 5 : cephadm 1 [20/May/2024:22:07:16] ENGINE Bus STARTING 2024-05-20T22:07:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: cephadm 2024-05-20T22:07:16.922806+0000 mgr.y (mgr.14592) 6 : cephadm 1 [20/May/2024:22:07:16] ENGINE Serving on http://172.21.15.50:8765 2024-05-20T22:07:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: cephadm 2024-05-20T22:07:17.047077+0000 mgr.y (mgr.14592) 7 : cephadm 1 [20/May/2024:22:07:17] ENGINE Serving on https://172.21.15.50:7150 2024-05-20T22:07:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: cephadm 2024-05-20T22:07:17.047263+0000 mgr.y (mgr.14592) 8 : cephadm 1 [20/May/2024:22:07:17] ENGINE Bus STARTED 2024-05-20T22:07:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: cephadm 2024-05-20T22:07:17.049174+0000 mgr.y (mgr.14592) 9 : cephadm 4 [20/May/2024:22:07:17] ENGINE Error in HTTPServer.serve 2024-05-20T22:07:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: Traceback (most recent call last): 2024-05-20T22:07:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-05-20T22:07:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: self._connections.run(self.expiration_interval) 2024-05-20T22:07:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-05-20T22:07:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: self._run(expiration_interval) 2024-05-20T22:07:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-05-20T22:07:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: new_conn = self._from_server_socket(self.server.socket) 2024-05-20T22:07:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-05-20T22:07:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-05-20T22:07:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-05-20T22:07:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: s = self.context.wrap_socket( 2024-05-20T22:07:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-05-20T22:07:18.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: return self.sslsocket_class._create( 2024-05-20T22:07:18.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-05-20T22:07:18.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: self.do_handshake() 2024-05-20T22:07:18.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-05-20T22:07:18.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: self._sslobj.do_handshake() 2024-05-20T22:07:18.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-05-20T22:07:18.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:17 smithi145 bash[23893]: audit 2024-05-20T22:07:17.405387+0000 mgr.y (mgr.14592) 10 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:07:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: cephadm 2024-05-20T22:07:16.821001+0000 mgr.y (mgr.14592) 5 : cephadm 1 [20/May/2024:22:07:16] ENGINE Bus STARTING 2024-05-20T22:07:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: cephadm 2024-05-20T22:07:16.922806+0000 mgr.y (mgr.14592) 6 : cephadm 1 [20/May/2024:22:07:16] ENGINE Serving on http://172.21.15.50:8765 2024-05-20T22:07:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: cephadm 2024-05-20T22:07:17.047077+0000 mgr.y (mgr.14592) 7 : cephadm 1 [20/May/2024:22:07:17] ENGINE Serving on https://172.21.15.50:7150 2024-05-20T22:07:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: cephadm 2024-05-20T22:07:17.047263+0000 mgr.y (mgr.14592) 8 : cephadm 1 [20/May/2024:22:07:17] ENGINE Bus STARTED 2024-05-20T22:07:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: cephadm 2024-05-20T22:07:17.049174+0000 mgr.y (mgr.14592) 9 : cephadm 4 [20/May/2024:22:07:17] ENGINE Error in HTTPServer.serve 2024-05-20T22:07:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: Traceback (most recent call last): 2024-05-20T22:07:18.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-05-20T22:07:18.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: self._connections.run(self.expiration_interval) 2024-05-20T22:07:18.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-05-20T22:07:18.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: self._run(expiration_interval) 2024-05-20T22:07:18.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-05-20T22:07:18.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: new_conn = self._from_server_socket(self.server.socket) 2024-05-20T22:07:18.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-05-20T22:07:18.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-05-20T22:07:18.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-05-20T22:07:18.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: s = self.context.wrap_socket( 2024-05-20T22:07:18.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-05-20T22:07:18.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: return self.sslsocket_class._create( 2024-05-20T22:07:18.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-05-20T22:07:18.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: self.do_handshake() 2024-05-20T22:07:18.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-05-20T22:07:18.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: self._sslobj.do_handshake() 2024-05-20T22:07:18.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-05-20T22:07:18.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:17 smithi050 bash[28929]: audit 2024-05-20T22:07:17.405387+0000 mgr.y (mgr.14592) 10 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:07:18.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: cephadm 2024-05-20T22:07:16.821001+0000 mgr.y (mgr.14592) 5 : cephadm 1 [20/May/2024:22:07:16] ENGINE Bus STARTING 2024-05-20T22:07:18.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: cephadm 2024-05-20T22:07:16.922806+0000 mgr.y (mgr.14592) 6 : cephadm 1 [20/May/2024:22:07:16] ENGINE Serving on http://172.21.15.50:8765 2024-05-20T22:07:18.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: cephadm 2024-05-20T22:07:17.047077+0000 mgr.y (mgr.14592) 7 : cephadm 1 [20/May/2024:22:07:17] ENGINE Serving on https://172.21.15.50:7150 2024-05-20T22:07:18.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: cephadm 2024-05-20T22:07:17.047263+0000 mgr.y (mgr.14592) 8 : cephadm 1 [20/May/2024:22:07:17] ENGINE Bus STARTED 2024-05-20T22:07:18.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: cephadm 2024-05-20T22:07:17.049174+0000 mgr.y (mgr.14592) 9 : cephadm 4 [20/May/2024:22:07:17] ENGINE Error in HTTPServer.serve 2024-05-20T22:07:18.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: Traceback (most recent call last): 2024-05-20T22:07:18.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-05-20T22:07:18.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: self._connections.run(self.expiration_interval) 2024-05-20T22:07:18.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-05-20T22:07:18.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: self._run(expiration_interval) 2024-05-20T22:07:18.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-05-20T22:07:18.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: new_conn = self._from_server_socket(self.server.socket) 2024-05-20T22:07:18.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-05-20T22:07:18.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-05-20T22:07:18.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-05-20T22:07:18.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: s = self.context.wrap_socket( 2024-05-20T22:07:18.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-05-20T22:07:18.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: return self.sslsocket_class._create( 2024-05-20T22:07:18.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-05-20T22:07:18.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: self.do_handshake() 2024-05-20T22:07:18.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-05-20T22:07:18.203 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: self._sslobj.do_handshake() 2024-05-20T22:07:18.203 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-05-20T22:07:18.203 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:17 smithi050 bash[21866]: audit 2024-05-20T22:07:17.405387+0000 mgr.y (mgr.14592) 10 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:07:19.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:18 smithi050 bash[21866]: cluster 2024-05-20T22:07:17.837419+0000 mgr.y (mgr.14592) 11 : cluster 0 pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:07:19.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:18 smithi050 bash[21866]: cluster 2024-05-20T22:07:17.914794+0000 mon.a (mon.0) 803 : cluster 0 mgrmap e22: y(active, since 4s), standbys: x 2024-05-20T22:07:19.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:18 smithi050 bash[28929]: cluster 2024-05-20T22:07:17.837419+0000 mgr.y (mgr.14592) 11 : cluster 0 pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:07:19.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:18 smithi050 bash[28929]: cluster 2024-05-20T22:07:17.914794+0000 mon.a (mon.0) 803 : cluster 0 mgrmap e22: y(active, since 4s), standbys: x 2024-05-20T22:07:19.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:18 smithi145 bash[23893]: cluster 2024-05-20T22:07:17.837419+0000 mgr.y (mgr.14592) 11 : cluster 0 pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:07:19.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:18 smithi145 bash[23893]: cluster 2024-05-20T22:07:17.914794+0000 mon.a (mon.0) 803 : cluster 0 mgrmap e22: y(active, since 4s), standbys: x 2024-05-20T22:07:19.530 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T22:07:19.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:07:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:07:21.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:21 smithi145 bash[23893]: cluster 2024-05-20T22:07:19.838133+0000 mgr.y (mgr.14592) 12 : cluster 0 pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:07:21.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:21 smithi145 bash[23893]: audit 2024-05-20T22:07:20.143710+0000 mon.a (mon.0) 804 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:21 smithi145 bash[23893]: audit 2024-05-20T22:07:20.148259+0000 mon.a (mon.0) 805 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:21 smithi145 bash[23893]: audit 2024-05-20T22:07:20.262109+0000 mon.a (mon.0) 806 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:21 smithi145 bash[23893]: audit 2024-05-20T22:07:20.266421+0000 mon.a (mon.0) 807 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:21.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:21 smithi050 bash[21866]: cluster 2024-05-20T22:07:19.838133+0000 mgr.y (mgr.14592) 12 : cluster 0 pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:07:21.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:21 smithi050 bash[21866]: audit 2024-05-20T22:07:20.143710+0000 mon.a (mon.0) 804 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:21.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:21 smithi050 bash[21866]: audit 2024-05-20T22:07:20.148259+0000 mon.a (mon.0) 805 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:21.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:21 smithi050 bash[21866]: audit 2024-05-20T22:07:20.262109+0000 mon.a (mon.0) 806 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:21.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:21 smithi050 bash[21866]: audit 2024-05-20T22:07:20.266421+0000 mon.a (mon.0) 807 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:21 smithi050 bash[28929]: cluster 2024-05-20T22:07:19.838133+0000 mgr.y (mgr.14592) 12 : cluster 0 pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:07:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:21 smithi050 bash[28929]: audit 2024-05-20T22:07:20.143710+0000 mon.a (mon.0) 804 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:21 smithi050 bash[28929]: audit 2024-05-20T22:07:20.148259+0000 mon.a (mon.0) 805 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:21 smithi050 bash[28929]: audit 2024-05-20T22:07:20.262109+0000 mon.a (mon.0) 806 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:21 smithi050 bash[28929]: audit 2024-05-20T22:07:20.266421+0000 mon.a (mon.0) 807 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6f620f640 1 -- 172.21.15.145:0/2090228369 >> v1:172.21.15.145:6789/0 conn(0x7fb6f0100180 legacy=0x7fb6f0100560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:22.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6f620f640 1 -- 172.21.15.145:0/2090228369 shutdown_connections 2024-05-20T22:07:22.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6f620f640 1 -- 172.21.15.145:0/2090228369 >> 172.21.15.145:0/2090228369 conn(0x7fb6f00758a0 msgr2=0x7fb6f0075cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:07:22.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6f620f640 1 -- 172.21.15.145:0/2090228369 shutdown_connections 2024-05-20T22:07:22.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6f620f640 1 -- 172.21.15.145:0/2090228369 wait complete. 2024-05-20T22:07:22.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6f620f640 1 Processor -- start 2024-05-20T22:07:22.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6f620f640 1 -- start start 2024-05-20T22:07:22.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6f620f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb6f01a8990 con 0x7fb6f010c8d0 2024-05-20T22:07:22.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6f620f640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb6f01a9b70 con 0x7fb6f0100180 2024-05-20T22:07:22.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6f620f640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb6f01aadb0 con 0x7fb6f0108d60 2024-05-20T22:07:22.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6ef7fe640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fb6f0100180 0x7fb6f0103d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:34812/0 (socket says 172.21.15.145:34812) 2024-05-20T22:07:22.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6ef7fe640 1 -- 172.21.15.145:0/1689425745 learned_addr learned my addr 172.21.15.145:0/1689425745 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-05-20T22:07:22.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6ed7fa640 1 -- 172.21.15.145:0/1689425745 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2525308284 0 0) 0x7fb6f01a9b70 con 0x7fb6f0100180 2024-05-20T22:07:22.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6ed7fa640 1 -- 172.21.15.145:0/1689425745 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6dc003520 con 0x7fb6f0100180 2024-05-20T22:07:22.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6ed7fa640 1 -- 172.21.15.145:0/1689425745 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1707396335 0 0) 0x7fb6dc003520 con 0x7fb6f0100180 2024-05-20T22:07:22.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6ed7fa640 1 -- 172.21.15.145:0/1689425745 --> v1:172.21.15.145:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6f01a9b70 con 0x7fb6f0100180 2024-05-20T22:07:22.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6ed7fa640 1 -- 172.21.15.145:0/1689425745 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fb6e0001ae0 con 0x7fb6f0100180 2024-05-20T22:07:22.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6ed7fa640 1 -- 172.21.15.145:0/1689425745 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 498241379 0 0) 0x7fb6f01aadb0 con 0x7fb6f0108d60 2024-05-20T22:07:22.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6ed7fa640 1 -- 172.21.15.145:0/1689425745 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6dc003520 con 0x7fb6f0108d60 2024-05-20T22:07:22.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6ed7fa640 1 -- 172.21.15.145:0/1689425745 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3506647034 0 0) 0x7fb6f01a8990 con 0x7fb6f010c8d0 2024-05-20T22:07:22.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6ed7fa640 1 -- 172.21.15.145:0/1689425745 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6f01aadb0 con 0x7fb6f010c8d0 2024-05-20T22:07:22.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6ed7fa640 1 -- 172.21.15.145:0/1689425745 <== mon.1 v1:172.21.15.145:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 913729541 0 0) 0x7fb6f01a9b70 con 0x7fb6f0100180 2024-05-20T22:07:22.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6ed7fa640 1 -- 172.21.15.145:0/1689425745 >> v1:172.21.15.50:6790/0 conn(0x7fb6f0108d60 legacy=0x7fb6f0104430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:22.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6ed7fa640 1 -- 172.21.15.145:0/1689425745 >> v1:172.21.15.50:6789/0 conn(0x7fb6f010c8d0 legacy=0x7fb6f01a7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:22.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6ed7fa640 1 -- 172.21.15.145:0/1689425745 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f01abff0 con 0x7fb6f0100180 2024-05-20T22:07:22.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6f620f640 1 -- 172.21.15.145:0/1689425745 --> v1:172.21.15.145:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb6f01aafe0 con 0x7fb6f0100180 2024-05-20T22:07:22.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6f620f640 1 -- 172.21.15.145:0/1689425745 --> v1:172.21.15.145:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb6f01ab4a0 con 0x7fb6f0100180 2024-05-20T22:07:22.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6ed7fa640 1 -- 172.21.15.145:0/1689425745 <== mon.1 v1:172.21.15.145:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7fb6e0003eb0 con 0x7fb6f0100180 2024-05-20T22:07:22.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.135+0000 7fb6ed7fa640 1 -- 172.21.15.145:0/1689425745 <== mon.1 v1:172.21.15.145:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fb6e00036d0 con 0x7fb6f0100180 2024-05-20T22:07:22.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.139+0000 7fb6f620f640 1 -- 172.21.15.145:0/1689425745 --> v1:172.21.15.145:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6d0005080 con 0x7fb6f0100180 2024-05-20T22:07:22.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.139+0000 7fb6ed7fa640 1 -- 172.21.15.145:0/1689425745 <== mon.1 v1:172.21.15.145:6789/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7fb6e0003a20 con 0x7fb6f0100180 2024-05-20T22:07:22.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.139+0000 7fb6ed7fa640 1 -- 172.21.15.145:0/1689425745 <== mon.1 v1:172.21.15.145:6789/0 8 ==== osd_map(72..72 src has 1..72) ==== 6172+0+0 (unknown 1924863387 0 0) 0x7fb6e00898a0 con 0x7fb6f0100180 2024-05-20T22:07:22.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.143+0000 7fb6ed7fa640 1 -- 172.21.15.145:0/1689425745 <== mon.1 v1:172.21.15.145:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7fb6e0057140 con 0x7fb6f0100180 2024-05-20T22:07:22.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.347+0000 7fb6f620f640 1 -- 172.21.15.145:0/1689425745 --> v1:172.21.15.50:6800/3332714287 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi145=a", "target": ["mon-mgr", ""]}) -- 0x7fb6d0000b90 con 0x7fb6dc06f0a0 2024-05-20T22:07:22.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.359+0000 7fb6ed7fa640 1 -- 172.21.15.145:0/1689425745 <== mgr.14592 v1:172.21.15.50:6800/3332714287 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (unknown 0 0 664801700) 0x7fb6d0000b90 con 0x7fb6dc06f0a0 2024-05-20T22:07:22.359 INFO:teuthology.orchestra.run.smithi145.stdout:Scheduled grafana update... 2024-05-20T22:07:22.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.363+0000 7fb6f620f640 1 -- 172.21.15.145:0/1689425745 >> v1:172.21.15.50:6800/3332714287 conn(0x7fb6dc06f0a0 legacy=0x7fb6dc071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:22.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.363+0000 7fb6f620f640 1 -- 172.21.15.145:0/1689425745 >> v1:172.21.15.145:6789/0 conn(0x7fb6f0100180 legacy=0x7fb6f0103d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:22.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.363+0000 7fb6f620f640 1 -- 172.21.15.145:0/1689425745 shutdown_connections 2024-05-20T22:07:22.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.363+0000 7fb6f620f640 1 -- 172.21.15.145:0/1689425745 >> 172.21.15.145:0/1689425745 conn(0x7fb6f00758a0 msgr2=0x7fb6f010fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:07:22.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.363+0000 7fb6f620f640 1 -- 172.21.15.145:0/1689425745 shutdown_connections 2024-05-20T22:07:22.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:22.363+0000 7fb6f620f640 1 -- 172.21.15.145:0/1689425745 wait complete. 2024-05-20T22:07:22.372 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.152836+0000 mon.a (mon.0) 808 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.372 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.159391+0000 mon.a (mon.0) 809 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.373 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.161471+0000 mon.a (mon.0) 810 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.373 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.162691+0000 mon.a (mon.0) 811 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.373 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.163696+0000 mon.a (mon.0) 812 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.373 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.164877+0000 mon.a (mon.0) 813 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.373 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: cephadm 2024-05-20T22:07:21.165740+0000 mgr.y (mgr.14592) 13 : cephadm 1 Adjusting osd_memory_target on smithi145 to 3804M 2024-05-20T22:07:22.373 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.171289+0000 mon.a (mon.0) 814 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.373 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.305478+0000 mon.a (mon.0) 815 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.373 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.310817+0000 mon.a (mon.0) 816 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.373 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.311835+0000 mon.a (mon.0) 817 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.373 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.312713+0000 mon.a (mon.0) 818 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.373 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.313945+0000 mon.a (mon.0) 819 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.373 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.315049+0000 mon.a (mon.0) 820 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.374 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: cephadm 2024-05-20T22:07:21.315978+0000 mgr.y (mgr.14592) 14 : cephadm 1 Adjusting osd_memory_target on smithi050 to 3805M 2024-05-20T22:07:22.374 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.319314+0000 mon.a (mon.0) 821 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.374 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.321608+0000 mon.a (mon.0) 822 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:07:22.374 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.322504+0000 mon.a (mon.0) 823 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:07:22.374 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: cephadm 2024-05-20T22:07:21.323623+0000 mgr.y (mgr.14592) 15 : cephadm 1 Updating smithi050:/etc/ceph/ceph.conf 2024-05-20T22:07:22.374 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: cephadm 2024-05-20T22:07:21.324047+0000 mgr.y (mgr.14592) 16 : cephadm 1 Updating smithi145:/etc/ceph/ceph.conf 2024-05-20T22:07:22.374 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: cephadm 2024-05-20T22:07:21.523384+0000 mgr.y (mgr.14592) 17 : cephadm 1 Updating smithi050:/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T22:07:22.374 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: cephadm 2024-05-20T22:07:21.526329+0000 mgr.y (mgr.14592) 18 : cephadm 1 Updating smithi145:/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T22:07:22.375 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.946308+0000 mon.a (mon.0) 824 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.375 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.954633+0000 mon.a (mon.0) 825 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.375 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.961137+0000 mon.a (mon.0) 826 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.375 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.967988+0000 mon.a (mon.0) 827 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.375 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:22 smithi145 bash[23893]: audit 2024-05-20T22:07:21.975678+0000 mon.a (mon.0) 828 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.413 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.152836+0000 mon.a (mon.0) 808 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.413 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.159391+0000 mon.a (mon.0) 809 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.413 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.161471+0000 mon.a (mon.0) 810 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.413 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.162691+0000 mon.a (mon.0) 811 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.413 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.163696+0000 mon.a (mon.0) 812 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.413 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.164877+0000 mon.a (mon.0) 813 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.414 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: cephadm 2024-05-20T22:07:21.165740+0000 mgr.y (mgr.14592) 13 : cephadm 1 Adjusting osd_memory_target on smithi145 to 3804M 2024-05-20T22:07:22.414 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.171289+0000 mon.a (mon.0) 814 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.414 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.305478+0000 mon.a (mon.0) 815 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.414 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.310817+0000 mon.a (mon.0) 816 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.414 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.311835+0000 mon.a (mon.0) 817 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.415 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.312713+0000 mon.a (mon.0) 818 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.415 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.313945+0000 mon.a (mon.0) 819 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.415 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.315049+0000 mon.a (mon.0) 820 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.415 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: cephadm 2024-05-20T22:07:21.315978+0000 mgr.y (mgr.14592) 14 : cephadm 1 Adjusting osd_memory_target on smithi050 to 3805M 2024-05-20T22:07:22.415 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.319314+0000 mon.a (mon.0) 821 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.415 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.321608+0000 mon.a (mon.0) 822 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:07:22.415 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.322504+0000 mon.a (mon.0) 823 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:07:22.416 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: cephadm 2024-05-20T22:07:21.323623+0000 mgr.y (mgr.14592) 15 : cephadm 1 Updating smithi050:/etc/ceph/ceph.conf 2024-05-20T22:07:22.416 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: cephadm 2024-05-20T22:07:21.324047+0000 mgr.y (mgr.14592) 16 : cephadm 1 Updating smithi145:/etc/ceph/ceph.conf 2024-05-20T22:07:22.416 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: cephadm 2024-05-20T22:07:21.523384+0000 mgr.y (mgr.14592) 17 : cephadm 1 Updating smithi050:/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T22:07:22.416 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: cephadm 2024-05-20T22:07:21.526329+0000 mgr.y (mgr.14592) 18 : cephadm 1 Updating smithi145:/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T22:07:22.416 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.946308+0000 mon.a (mon.0) 824 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.416 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.954633+0000 mon.a (mon.0) 825 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.417 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.961137+0000 mon.a (mon.0) 826 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.417 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.967988+0000 mon.a (mon.0) 827 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.417 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 bash[28929]: audit 2024-05-20T22:07:21.975678+0000 mon.a (mon.0) 828 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.417 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.152836+0000 mon.a (mon.0) 808 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.418 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.159391+0000 mon.a (mon.0) 809 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.418 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.161471+0000 mon.a (mon.0) 810 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.418 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.162691+0000 mon.a (mon.0) 811 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.418 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.163696+0000 mon.a (mon.0) 812 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.418 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.164877+0000 mon.a (mon.0) 813 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.418 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: cephadm 2024-05-20T22:07:21.165740+0000 mgr.y (mgr.14592) 13 : cephadm 1 Adjusting osd_memory_target on smithi145 to 3804M 2024-05-20T22:07:22.419 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.171289+0000 mon.a (mon.0) 814 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.419 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.305478+0000 mon.a (mon.0) 815 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.419 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.310817+0000 mon.a (mon.0) 816 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.419 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.311835+0000 mon.a (mon.0) 817 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.419 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.312713+0000 mon.a (mon.0) 818 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.419 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.313945+0000 mon.a (mon.0) 819 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.420 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.315049+0000 mon.a (mon.0) 820 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:07:22.420 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: cephadm 2024-05-20T22:07:21.315978+0000 mgr.y (mgr.14592) 14 : cephadm 1 Adjusting osd_memory_target on smithi050 to 3805M 2024-05-20T22:07:22.420 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.319314+0000 mon.a (mon.0) 821 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.420 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.321608+0000 mon.a (mon.0) 822 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:07:22.420 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.322504+0000 mon.a (mon.0) 823 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:07:22.420 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: cephadm 2024-05-20T22:07:21.323623+0000 mgr.y (mgr.14592) 15 : cephadm 1 Updating smithi050:/etc/ceph/ceph.conf 2024-05-20T22:07:22.421 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: cephadm 2024-05-20T22:07:21.324047+0000 mgr.y (mgr.14592) 16 : cephadm 1 Updating smithi145:/etc/ceph/ceph.conf 2024-05-20T22:07:22.421 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: cephadm 2024-05-20T22:07:21.523384+0000 mgr.y (mgr.14592) 17 : cephadm 1 Updating smithi050:/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T22:07:22.421 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: cephadm 2024-05-20T22:07:21.526329+0000 mgr.y (mgr.14592) 18 : cephadm 1 Updating smithi145:/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T22:07:22.421 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.946308+0000 mon.a (mon.0) 824 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.421 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.954633+0000 mon.a (mon.0) 825 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.421 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.961137+0000 mon.a (mon.0) 826 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.421 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.967988+0000 mon.a (mon.0) 827 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.422 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 bash[21866]: audit 2024-05-20T22:07:21.975678+0000 mon.a (mon.0) 828 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:22.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:22.694 INFO:journalctl@ceph.osd.1.smithi050.stdout:May 20 22:07:22 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:22.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:22 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:22.694 INFO:journalctl@ceph.osd.0.smithi050.stdout:May 20 22:07:22 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:22.695 INFO:journalctl@ceph.osd.2.smithi050.stdout:May 20 22:07:22 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:22.695 INFO:journalctl@ceph.osd.3.smithi050.stdout:May 20 22:07:22 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:22.695 INFO:journalctl@ceph.rgw.foo.a.smithi050.stdout:May 20 22:07:22 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:22.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:22.993 DEBUG:teuthology.orchestra.run.smithi145:grafana.a> sudo journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@grafana.a.service 2024-05-20T22:07:22.996 INFO:tasks.cephadm:Setting up client nodes... 2024-05-20T22:07:22.997 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-20T22:07:23.000 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:22 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:23.000 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:22 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:23.000 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:22 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:23.001 INFO:journalctl@ceph.osd.0.smithi050.stdout:May 20 22:07:22 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:23.002 INFO:journalctl@ceph.osd.1.smithi050.stdout:May 20 22:07:22 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:23.002 INFO:journalctl@ceph.osd.2.smithi050.stdout:May 20 22:07:22 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:23.002 INFO:journalctl@ceph.osd.3.smithi050.stdout:May 20 22:07:22 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:23.003 INFO:journalctl@ceph.rgw.foo.a.smithi050.stdout:May 20 22:07:22 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:23.003 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:22 smithi050 systemd[1]: Started Ceph node-exporter.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968. 2024-05-20T22:07:23.357 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:23 smithi050 bash[57451]: Unable to find image 'quay.io/prometheus/node-exporter:v1.5.0' locally 2024-05-20T22:07:23.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:23 smithi145 bash[23893]: cephadm 2024-05-20T22:07:21.660297+0000 mgr.y (mgr.14592) 19 : cephadm 1 Updating smithi050:/etc/ceph/ceph.client.admin.keyring 2024-05-20T22:07:23.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:23 smithi145 bash[23893]: cephadm 2024-05-20T22:07:21.671566+0000 mgr.y (mgr.14592) 20 : cephadm 1 Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-05-20T22:07:23.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:23 smithi145 bash[23893]: cephadm 2024-05-20T22:07:21.797523+0000 mgr.y (mgr.14592) 21 : cephadm 1 Updating smithi050:/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T22:07:23.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:23 smithi145 bash[23893]: cephadm 2024-05-20T22:07:21.816273+0000 mgr.y (mgr.14592) 22 : cephadm 1 Updating smithi145:/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T22:07:23.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:23 smithi145 bash[23893]: cluster 2024-05-20T22:07:21.839075+0000 mgr.y (mgr.14592) 23 : cluster 0 pgmap v7: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-20T22:07:23.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:23 smithi145 bash[23893]: cephadm 2024-05-20T22:07:21.982050+0000 mgr.y (mgr.14592) 24 : cephadm 1 Deploying daemon node-exporter.a on smithi050 2024-05-20T22:07:23.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:23 smithi145 bash[23893]: audit 2024-05-20T22:07:22.353768+0000 mgr.y (mgr.14592) 25 : audit 0 from='client.24562 v1:172.21.15.145:0/1689425745' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi145=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:07:23.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:23 smithi145 bash[23893]: cephadm 2024-05-20T22:07:22.357334+0000 mgr.y (mgr.14592) 26 : cephadm 1 Saving service grafana spec with placement smithi145=a;count:1 2024-05-20T22:07:23.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:23 smithi145 bash[23893]: audit 2024-05-20T22:07:22.364070+0000 mon.a (mon.0) 829 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:23.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:23 smithi145 bash[23893]: audit 2024-05-20T22:07:23.009711+0000 mon.a (mon.0) 830 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:23.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:23 smithi145 bash[23893]: audit 2024-05-20T22:07:23.015454+0000 mon.a (mon.0) 831 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:23.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:23 smithi145 bash[23893]: audit 2024-05-20T22:07:23.019838+0000 mon.a (mon.0) 832 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:23 smithi050 bash[21866]: cephadm 2024-05-20T22:07:21.660297+0000 mgr.y (mgr.14592) 19 : cephadm 1 Updating smithi050:/etc/ceph/ceph.client.admin.keyring 2024-05-20T22:07:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:23 smithi050 bash[21866]: cephadm 2024-05-20T22:07:21.671566+0000 mgr.y (mgr.14592) 20 : cephadm 1 Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-05-20T22:07:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:23 smithi050 bash[21866]: cephadm 2024-05-20T22:07:21.797523+0000 mgr.y (mgr.14592) 21 : cephadm 1 Updating smithi050:/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T22:07:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:23 smithi050 bash[21866]: cephadm 2024-05-20T22:07:21.816273+0000 mgr.y (mgr.14592) 22 : cephadm 1 Updating smithi145:/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T22:07:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:23 smithi050 bash[21866]: cluster 2024-05-20T22:07:21.839075+0000 mgr.y (mgr.14592) 23 : cluster 0 pgmap v7: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-20T22:07:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:23 smithi050 bash[21866]: cephadm 2024-05-20T22:07:21.982050+0000 mgr.y (mgr.14592) 24 : cephadm 1 Deploying daemon node-exporter.a on smithi050 2024-05-20T22:07:23.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:23 smithi050 bash[21866]: audit 2024-05-20T22:07:22.353768+0000 mgr.y (mgr.14592) 25 : audit 0 from='client.24562 v1:172.21.15.145:0/1689425745' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi145=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:07:23.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:23 smithi050 bash[21866]: cephadm 2024-05-20T22:07:22.357334+0000 mgr.y (mgr.14592) 26 : cephadm 1 Saving service grafana spec with placement smithi145=a;count:1 2024-05-20T22:07:23.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:23 smithi050 bash[21866]: audit 2024-05-20T22:07:22.364070+0000 mon.a (mon.0) 829 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:23.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:23 smithi050 bash[21866]: audit 2024-05-20T22:07:23.009711+0000 mon.a (mon.0) 830 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:23.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:23 smithi050 bash[21866]: audit 2024-05-20T22:07:23.015454+0000 mon.a (mon.0) 831 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:23.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:23 smithi050 bash[21866]: audit 2024-05-20T22:07:23.019838+0000 mon.a (mon.0) 832 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:23.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:23 smithi050 bash[28929]: cephadm 2024-05-20T22:07:21.660297+0000 mgr.y (mgr.14592) 19 : cephadm 1 Updating smithi050:/etc/ceph/ceph.client.admin.keyring 2024-05-20T22:07:23.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:23 smithi050 bash[28929]: cephadm 2024-05-20T22:07:21.671566+0000 mgr.y (mgr.14592) 20 : cephadm 1 Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-05-20T22:07:23.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:23 smithi050 bash[28929]: cephadm 2024-05-20T22:07:21.797523+0000 mgr.y (mgr.14592) 21 : cephadm 1 Updating smithi050:/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T22:07:23.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:23 smithi050 bash[28929]: cephadm 2024-05-20T22:07:21.816273+0000 mgr.y (mgr.14592) 22 : cephadm 1 Updating smithi145:/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T22:07:23.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:23 smithi050 bash[28929]: cluster 2024-05-20T22:07:21.839075+0000 mgr.y (mgr.14592) 23 : cluster 0 pgmap v7: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-20T22:07:23.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:23 smithi050 bash[28929]: cephadm 2024-05-20T22:07:21.982050+0000 mgr.y (mgr.14592) 24 : cephadm 1 Deploying daemon node-exporter.a on smithi050 2024-05-20T22:07:23.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:23 smithi050 bash[28929]: audit 2024-05-20T22:07:22.353768+0000 mgr.y (mgr.14592) 25 : audit 0 from='client.24562 v1:172.21.15.145:0/1689425745' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi145=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T22:07:23.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:23 smithi050 bash[28929]: cephadm 2024-05-20T22:07:22.357334+0000 mgr.y (mgr.14592) 26 : cephadm 1 Saving service grafana spec with placement smithi145=a;count:1 2024-05-20T22:07:23.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:23 smithi050 bash[28929]: audit 2024-05-20T22:07:22.364070+0000 mon.a (mon.0) 829 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:23.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:23 smithi050 bash[28929]: audit 2024-05-20T22:07:23.009711+0000 mon.a (mon.0) 830 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:23.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:23 smithi050 bash[28929]: audit 2024-05-20T22:07:23.015454+0000 mon.a (mon.0) 831 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:23.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:23 smithi050 bash[28929]: audit 2024-05-20T22:07:23.019838+0000 mon.a (mon.0) 832 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:24.070 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:23 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:24.071 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:23 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:24.071 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:23 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:24.071 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:23 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:24.071 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:07:23 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:24.072 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:07:23 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:24.072 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:07:23 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:24.072 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:07:23 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:24.072 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:07:23 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:24.072 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:07:23 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:24.073 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:23 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:24.073 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:23 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:24.073 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:24 smithi145 systemd[1]: Started Ceph node-exporter.b for 9a9abba0-16f3-11ef-bc9a-c7b262605968. 2024-05-20T22:07:24.073 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:07:23 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:24.073 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:07:23 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:24.073 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:07:23 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:24.074 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:07:23 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:24.265 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:23 smithi050 bash[57451]: v1.5.0: Pulling from prometheus/node-exporter 2024-05-20T22:07:24.365 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:24 smithi145 bash[50647]: Unable to find image 'quay.io/prometheus/node-exporter:v1.5.0' locally 2024-05-20T22:07:24.635 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:24 smithi050 bash[21866]: cephadm 2024-05-20T22:07:23.020752+0000 mgr.y (mgr.14592) 27 : cephadm 1 Deploying daemon node-exporter.b on smithi145 2024-05-20T22:07:24.635 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:24 smithi050 bash[21866]: audit 2024-05-20T22:07:24.123102+0000 mon.a (mon.0) 833 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:24.635 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:24 smithi050 bash[21866]: audit 2024-05-20T22:07:24.132938+0000 mon.a (mon.0) 834 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:24.635 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:24 smithi050 bash[21866]: audit 2024-05-20T22:07:24.141667+0000 mon.a (mon.0) 835 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:24.635 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:24 smithi050 bash[21866]: audit 2024-05-20T22:07:24.149232+0000 mon.a (mon.0) 836 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:24.635 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:24 smithi050 bash[21866]: audit 2024-05-20T22:07:24.165290+0000 mon.a (mon.0) 837 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:24.636 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:24 smithi050 bash[57451]: 22b70bddd3ac: Pulling fs layer 2024-05-20T22:07:24.636 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:24 smithi050 bash[57451]: 5c12815fee55: Pulling fs layer 2024-05-20T22:07:24.636 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:24 smithi050 bash[57451]: c0e87333d380: Pulling fs layer 2024-05-20T22:07:24.636 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:24 smithi050 bash[28929]: cephadm 2024-05-20T22:07:23.020752+0000 mgr.y (mgr.14592) 27 : cephadm 1 Deploying daemon node-exporter.b on smithi145 2024-05-20T22:07:24.636 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:24 smithi050 bash[28929]: audit 2024-05-20T22:07:24.123102+0000 mon.a (mon.0) 833 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:24.636 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:24 smithi050 bash[28929]: audit 2024-05-20T22:07:24.132938+0000 mon.a (mon.0) 834 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:24.636 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:24 smithi050 bash[28929]: audit 2024-05-20T22:07:24.141667+0000 mon.a (mon.0) 835 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:24.637 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:24 smithi050 bash[28929]: audit 2024-05-20T22:07:24.149232+0000 mon.a (mon.0) 836 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:24.637 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:24 smithi050 bash[28929]: audit 2024-05-20T22:07:24.165290+0000 mon.a (mon.0) 837 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:24.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:24 smithi145 bash[23893]: cephadm 2024-05-20T22:07:23.020752+0000 mgr.y (mgr.14592) 27 : cephadm 1 Deploying daemon node-exporter.b on smithi145 2024-05-20T22:07:24.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:24 smithi145 bash[23893]: audit 2024-05-20T22:07:24.123102+0000 mon.a (mon.0) 833 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:24.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:24 smithi145 bash[23893]: audit 2024-05-20T22:07:24.132938+0000 mon.a (mon.0) 834 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:24.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:24 smithi145 bash[23893]: audit 2024-05-20T22:07:24.141667+0000 mon.a (mon.0) 835 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:24.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:24 smithi145 bash[23893]: audit 2024-05-20T22:07:24.149232+0000 mon.a (mon.0) 836 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:24.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:24 smithi145 bash[23893]: audit 2024-05-20T22:07:24.165290+0000 mon.a (mon.0) 837 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:24.943 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:24 smithi050 bash[57451]: 5c12815fee55: Verifying Checksum 2024-05-20T22:07:24.944 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:24 smithi050 bash[57451]: 5c12815fee55: Download complete 2024-05-20T22:07:24.944 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:24 smithi050 bash[57451]: 22b70bddd3ac: Download complete 2024-05-20T22:07:24.944 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:24 smithi050 bash[57451]: 22b70bddd3ac: Pull complete 2024-05-20T22:07:24.944 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:07:24 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:25.293 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:25 smithi145 bash[50647]: v1.5.0: Pulling from prometheus/node-exporter 2024-05-20T22:07:25.326 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:24 smithi050 bash[57451]: c0e87333d380: Verifying Checksum 2024-05-20T22:07:25.326 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:24 smithi050 bash[57451]: c0e87333d380: Download complete 2024-05-20T22:07:25.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:25 smithi145 bash[23893]: cluster 2024-05-20T22:07:23.839794+0000 mgr.y (mgr.14592) 28 : cluster 0 pgmap v8: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-20T22:07:25.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:25 smithi145 bash[23893]: cephadm 2024-05-20T22:07:24.196746+0000 mgr.y (mgr.14592) 29 : cephadm 1 Deploying daemon alertmanager.a on smithi050 2024-05-20T22:07:25.619 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:25 smithi145 bash[50647]: 22b70bddd3ac: Pulling fs layer 2024-05-20T22:07:25.619 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:25 smithi145 bash[50647]: 5c12815fee55: Pulling fs layer 2024-05-20T22:07:25.619 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:25 smithi145 bash[50647]: c0e87333d380: Pulling fs layer 2024-05-20T22:07:25.619 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:25 smithi145 bash[50647]: 5c12815fee55: Verifying Checksum 2024-05-20T22:07:25.620 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:25 smithi145 bash[50647]: 5c12815fee55: Download complete 2024-05-20T22:07:25.693 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:25 smithi050 bash[57451]: 5c12815fee55: Pull complete 2024-05-20T22:07:25.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:25 smithi050 bash[21866]: cluster 2024-05-20T22:07:23.839794+0000 mgr.y (mgr.14592) 28 : cluster 0 pgmap v8: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-20T22:07:25.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:25 smithi050 bash[21866]: cephadm 2024-05-20T22:07:24.196746+0000 mgr.y (mgr.14592) 29 : cephadm 1 Deploying daemon alertmanager.a on smithi050 2024-05-20T22:07:25.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:25 smithi050 bash[28929]: cluster 2024-05-20T22:07:23.839794+0000 mgr.y (mgr.14592) 28 : cluster 0 pgmap v8: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-20T22:07:25.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:25 smithi050 bash[28929]: cephadm 2024-05-20T22:07:24.196746+0000 mgr.y (mgr.14592) 29 : cephadm 1 Deploying daemon alertmanager.a on smithi050 2024-05-20T22:07:25.890 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:25 smithi145 bash[50647]: 22b70bddd3ac: Download complete 2024-05-20T22:07:25.890 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:25 smithi145 bash[50647]: 22b70bddd3ac: Pull complete 2024-05-20T22:07:26.112 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:25 smithi050 bash[57451]: c0e87333d380: Pull complete 2024-05-20T22:07:26.112 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:26 smithi050 bash[57451]: Digest: sha256:39c642b2b337e38c18e80266fb14383754178202f40103646337722a594d984c 2024-05-20T22:07:26.390 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:26 smithi145 bash[50647]: c0e87333d380: Verifying Checksum 2024-05-20T22:07:26.390 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:26 smithi145 bash[50647]: c0e87333d380: Download complete 2024-05-20T22:07:26.390 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:26 smithi145 bash[50647]: 5c12815fee55: Pull complete 2024-05-20T22:07:26.443 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:26 smithi050 bash[57451]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.5.0 2024-05-20T22:07:26.946 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:26 smithi145 bash[50647]: c0e87333d380: Pull complete 2024-05-20T22:07:26.946 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:26 smithi145 bash[50647]: Digest: sha256:39c642b2b337e38c18e80266fb14383754178202f40103646337722a594d984c 2024-05-20T22:07:26.946 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:26 smithi145 bash[50647]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.5.0 2024-05-20T22:07:27.640 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:07:27 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:07:27.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:27 smithi145 bash[23893]: cluster 2024-05-20T22:07:25.841268+0000 mgr.y (mgr.14592) 30 : cluster 0 pgmap v9: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-20T22:07:27.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:27 smithi050 bash[21866]: cluster 2024-05-20T22:07:25.841268+0000 mgr.y (mgr.14592) 30 : cluster 0 pgmap v9: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-20T22:07:27.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:27 smithi050 bash[28929]: cluster 2024-05-20T22:07:25.841268+0000 mgr.y (mgr.14592) 30 : cluster 0 pgmap v9: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-20T22:07:27.760 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:07:28.380 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.211Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-05-20T22:07:28.380 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.211Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-05-20T22:07:28.380 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.212Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-05-20T22:07:28.380 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.212Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-05-20T22:07:28.380 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.212Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-05-20T22:07:28.380 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.212Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-05-20T22:07:28.381 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-05-20T22:07:28.381 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=arp 2024-05-20T22:07:28.381 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=bcache 2024-05-20T22:07:28.381 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=bonding 2024-05-20T22:07:28.381 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=btrfs 2024-05-20T22:07:28.381 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=conntrack 2024-05-20T22:07:28.381 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=cpu 2024-05-20T22:07:28.381 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-05-20T22:07:28.381 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=diskstats 2024-05-20T22:07:28.381 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=dmi 2024-05-20T22:07:28.381 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=edac 2024-05-20T22:07:28.381 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=entropy 2024-05-20T22:07:28.381 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-05-20T22:07:28.381 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=filefd 2024-05-20T22:07:28.382 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=filesystem 2024-05-20T22:07:28.382 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=hwmon 2024-05-20T22:07:28.382 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=infiniband 2024-05-20T22:07:28.382 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=ipvs 2024-05-20T22:07:28.382 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=loadavg 2024-05-20T22:07:28.382 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=mdadm 2024-05-20T22:07:28.382 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=meminfo 2024-05-20T22:07:28.382 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=netclass 2024-05-20T22:07:28.383 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=netdev 2024-05-20T22:07:28.383 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=netstat 2024-05-20T22:07:28.383 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=nfs 2024-05-20T22:07:28.383 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=nfsd 2024-05-20T22:07:28.383 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=nvme 2024-05-20T22:07:28.383 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=os 2024-05-20T22:07:28.383 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-05-20T22:07:28.383 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=pressure 2024-05-20T22:07:28.383 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=rapl 2024-05-20T22:07:28.383 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=schedstat 2024-05-20T22:07:28.383 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=selinux 2024-05-20T22:07:28.383 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=sockstat 2024-05-20T22:07:28.383 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=softnet 2024-05-20T22:07:28.384 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=stat 2024-05-20T22:07:28.384 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=tapestats 2024-05-20T22:07:28.384 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=textfile 2024-05-20T22:07:28.384 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-05-20T22:07:28.384 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=time 2024-05-20T22:07:28.384 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-05-20T22:07:28.384 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=uname 2024-05-20T22:07:28.384 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=vmstat 2024-05-20T22:07:28.384 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=xfs 2024-05-20T22:07:28.384 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.213Z caller=node_exporter.go:117 level=info collector=zfs 2024-05-20T22:07:28.384 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.214Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-05-20T22:07:28.384 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[50647]: ts=2024-05-20T22:07:28.214Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-05-20T22:07:28.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:28 smithi145 bash[23893]: audit 2024-05-20T22:07:27.414465+0000 mgr.y (mgr.14592) 31 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:07:28.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[21866]: audit 2024-05-20T22:07:27.414465+0000 mgr.y (mgr.14592) 31 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:07:28.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:28 smithi050 bash[28929]: audit 2024-05-20T22:07:27.414465+0000 mgr.y (mgr.14592) 31 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:07:29.114 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.932Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-05-20T22:07:29.114 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.932Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-05-20T22:07:29.114 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.932Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-05-20T22:07:29.114 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.933Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-05-20T22:07:29.114 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-05-20T22:07:29.114 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-05-20T22:07:29.114 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-05-20T22:07:29.115 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=arp 2024-05-20T22:07:29.115 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=bcache 2024-05-20T22:07:29.115 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=bonding 2024-05-20T22:07:29.115 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=btrfs 2024-05-20T22:07:29.115 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=conntrack 2024-05-20T22:07:29.115 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=cpu 2024-05-20T22:07:29.115 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-05-20T22:07:29.115 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=diskstats 2024-05-20T22:07:29.115 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=dmi 2024-05-20T22:07:29.115 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=edac 2024-05-20T22:07:29.115 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=entropy 2024-05-20T22:07:29.115 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-05-20T22:07:29.116 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=filefd 2024-05-20T22:07:29.116 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=filesystem 2024-05-20T22:07:29.116 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=hwmon 2024-05-20T22:07:29.116 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=infiniband 2024-05-20T22:07:29.116 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=ipvs 2024-05-20T22:07:29.116 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=loadavg 2024-05-20T22:07:29.116 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=mdadm 2024-05-20T22:07:29.116 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=meminfo 2024-05-20T22:07:29.116 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=netclass 2024-05-20T22:07:29.116 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=netdev 2024-05-20T22:07:29.116 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=netstat 2024-05-20T22:07:29.116 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=nfs 2024-05-20T22:07:29.116 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=nfsd 2024-05-20T22:07:29.117 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=nvme 2024-05-20T22:07:29.117 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=os 2024-05-20T22:07:29.117 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-05-20T22:07:29.117 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=pressure 2024-05-20T22:07:29.117 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=rapl 2024-05-20T22:07:29.117 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=schedstat 2024-05-20T22:07:29.117 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=selinux 2024-05-20T22:07:29.117 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=sockstat 2024-05-20T22:07:29.117 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=softnet 2024-05-20T22:07:29.117 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=stat 2024-05-20T22:07:29.117 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=tapestats 2024-05-20T22:07:29.117 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=textfile 2024-05-20T22:07:29.117 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-05-20T22:07:29.117 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=time 2024-05-20T22:07:29.118 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-05-20T22:07:29.118 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=uname 2024-05-20T22:07:29.118 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=vmstat 2024-05-20T22:07:29.118 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=xfs 2024-05-20T22:07:29.118 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.934Z caller=node_exporter.go:117 level=info collector=zfs 2024-05-20T22:07:29.118 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.935Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-05-20T22:07:29.118 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:28 smithi050 bash[57451]: ts=2024-05-20T22:07:28.935Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-05-20T22:07:29.389 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:29 smithi050 bash[21866]: cluster 2024-05-20T22:07:27.841758+0000 mgr.y (mgr.14592) 32 : cluster 0 pgmap v10: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-20T22:07:29.389 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:29 smithi050 bash[21866]: audit 2024-05-20T22:07:28.912119+0000 mon.a (mon.0) 838 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:29.389 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:29 smithi050 bash[21866]: audit 2024-05-20T22:07:28.955016+0000 mon.a (mon.0) 839 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:07:29.390 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:29 smithi050 bash[28929]: cluster 2024-05-20T22:07:27.841758+0000 mgr.y (mgr.14592) 32 : cluster 0 pgmap v10: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-20T22:07:29.390 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:29 smithi050 bash[28929]: audit 2024-05-20T22:07:28.912119+0000 mon.a (mon.0) 838 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:29.390 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:29 smithi050 bash[28929]: audit 2024-05-20T22:07:28.955016+0000 mon.a (mon.0) 839 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:07:29.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:29 smithi145 bash[23893]: cluster 2024-05-20T22:07:27.841758+0000 mgr.y (mgr.14592) 32 : cluster 0 pgmap v10: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-20T22:07:29.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:29 smithi145 bash[23893]: audit 2024-05-20T22:07:28.912119+0000 mon.a (mon.0) 838 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:29.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:29 smithi145 bash[23893]: audit 2024-05-20T22:07:28.955016+0000 mon.a (mon.0) 839 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:07:29.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:07:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:07:31.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:31 smithi145 bash[23893]: cluster 2024-05-20T22:07:29.842829+0000 mgr.y (mgr.14592) 33 : cluster 0 pgmap v11: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-20T22:07:31.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:31 smithi050 bash[21866]: cluster 2024-05-20T22:07:29.842829+0000 mgr.y (mgr.14592) 33 : cluster 0 pgmap v11: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-20T22:07:31.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:31 smithi050 bash[28929]: cluster 2024-05-20T22:07:29.842829+0000 mgr.y (mgr.14592) 33 : cluster 0 pgmap v11: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-20T22:07:32.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.088+0000 7f13d7cd1640 1 -- 172.21.15.50:0/2288624750 >> v1:172.21.15.50:6789/0 conn(0x7f13d010e210 legacy=0x7f13d0110600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:32.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.088+0000 7f13d7cd1640 1 -- 172.21.15.50:0/2288624750 shutdown_connections 2024-05-20T22:07:32.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.088+0000 7f13d7cd1640 1 -- 172.21.15.50:0/2288624750 >> 172.21.15.50:0/2288624750 conn(0x7f13d00fc080 msgr2=0x7f13d00fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:07:32.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.088+0000 7f13d7cd1640 1 -- 172.21.15.50:0/2288624750 shutdown_connections 2024-05-20T22:07:32.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.088+0000 7f13d7cd1640 1 -- 172.21.15.50:0/2288624750 wait complete. 2024-05-20T22:07:32.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13d7cd1640 1 Processor -- start 2024-05-20T22:07:32.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13d7cd1640 1 -- start start 2024-05-20T22:07:32.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13d7cd1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f13d010da90 con 0x7f13d01028f0 2024-05-20T22:07:32.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13d7cd1640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f13d01a9b70 con 0x7f13d010a700 2024-05-20T22:07:32.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13d7cd1640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f13d01aad50 con 0x7f13d010e210 2024-05-20T22:07:32.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13d5a6d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f13d01028f0 0x7f13d010ceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56298/0 (socket says 172.21.15.50:56298) 2024-05-20T22:07:32.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13d5a6d640 1 -- 172.21.15.50:0/731135300 learned_addr learned my addr 172.21.15.50:0/731135300 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:07:32.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3520443819 0 0) 0x7f13d01aad50 con 0x7f13d010e210 2024-05-20T22:07:32.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13bc003520 con 0x7f13d010e210 2024-05-20T22:07:32.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 390531194 0 0) 0x7f13d010da90 con 0x7f13d01028f0 2024-05-20T22:07:32.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13d01aad50 con 0x7f13d01028f0 2024-05-20T22:07:32.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3983575665 0 0) 0x7f13bc003520 con 0x7f13d010e210 2024-05-20T22:07:32.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13d010da90 con 0x7f13d010e210 2024-05-20T22:07:32.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f13c80046f0 con 0x7f13d010e210 2024-05-20T22:07:32.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4130863913 0 0) 0x7f13d01aad50 con 0x7f13d01028f0 2024-05-20T22:07:32.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13bc003520 con 0x7f13d01028f0 2024-05-20T22:07:32.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f13cc001a30 con 0x7f13d01028f0 2024-05-20T22:07:32.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3405220870 0 0) 0x7f13d01a9b70 con 0x7f13d010a700 2024-05-20T22:07:32.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13d01aad50 con 0x7f13d010a700 2024-05-20T22:07:32.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1084412947 0 0) 0x7f13d010da90 con 0x7f13d010e210 2024-05-20T22:07:32.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 >> v1:172.21.15.145:6789/0 conn(0x7f13d010a700 legacy=0x7f13d01a3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:32.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 >> v1:172.21.15.50:6789/0 conn(0x7f13d01028f0 legacy=0x7f13d010ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:32.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d01abf90 con 0x7f13d010e210 2024-05-20T22:07:32.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13d7cd1640 1 -- 172.21.15.50:0/731135300 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f13d01a8bc0 con 0x7f13d010e210 2024-05-20T22:07:32.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13d7cd1640 1 -- 172.21.15.50:0/731135300 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f13d01a9080 con 0x7f13d010e210 2024-05-20T22:07:32.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f13c80014b0 con 0x7f13d010e210 2024-05-20T22:07:32.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f13c8004f00 con 0x7f13d010e210 2024-05-20T22:07:32.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13d7cd1640 1 -- 172.21.15.50:0/731135300 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13b4005080 con 0x7f13d010e210 2024-05-20T22:07:32.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.092+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f13c801b8a0 con 0x7f13d010e210 2024-05-20T22:07:32.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.096+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(72..72 src has 1..72) ==== 6172+0+0 (unknown 1924863387 0 0) 0x7f13c8088620 con 0x7f13d010e210 2024-05-20T22:07:32.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.100+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f13c8055ec0 con 0x7f13d010e210 2024-05-20T22:07:32.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.364+0000 7f13d7cd1640 1 -- 172.21.15.50:0/731135300 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f13b4005370 con 0x7f13d010e210 2024-05-20T22:07:32.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.372+0000 7f13c2ffd640 1 -- 172.21.15.50:0/731135300 <== mon.2 v1:172.21.15.50:6790/0 10 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v18) ==== 170+0+59 (unknown 2200942065 0 3310330336) 0x7f13c8059b70 con 0x7f13d010e210 2024-05-20T22:07:32.372 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-05-20T22:07:32.372 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCkyUtm8EIyFhAA5MYBD37dS0bLHbBEhN+g7Q== 2024-05-20T22:07:32.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.376+0000 7f13d7cd1640 1 -- 172.21.15.50:0/731135300 >> v1:172.21.15.50:6800/3332714287 conn(0x7f13bc06edb0 legacy=0x7f13bc071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:32.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.376+0000 7f13d7cd1640 1 -- 172.21.15.50:0/731135300 >> v1:172.21.15.50:6790/0 conn(0x7f13d010e210 legacy=0x7f13d01a7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:32.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.376+0000 7f13d7cd1640 1 -- 172.21.15.50:0/731135300 shutdown_connections 2024-05-20T22:07:32.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.376+0000 7f13d7cd1640 1 -- 172.21.15.50:0/731135300 >> 172.21.15.50:0/731135300 conn(0x7f13d00fc080 msgr2=0x7f13d0110600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:07:32.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.376+0000 7f13d7cd1640 1 -- 172.21.15.50:0/731135300 shutdown_connections 2024-05-20T22:07:32.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:32.376+0000 7f13d7cd1640 1 -- 172.21.15.50:0/731135300 wait complete. 2024-05-20T22:07:32.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:32 smithi145 bash[23893]: audit 2024-05-20T22:07:32.371758+0000 mon.c (mon.2) 17 : audit 1 from='client.? v1:172.21.15.50:0/731135300' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-20T22:07:32.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:32 smithi145 bash[23893]: audit 2024-05-20T22:07:32.372216+0000 mon.a (mon.0) 840 : audit 1 from='client.24521 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-20T22:07:32.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:32 smithi145 bash[23893]: audit 2024-05-20T22:07:32.374764+0000 mon.a (mon.0) 841 : audit 1 from='client.24521 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-20T22:07:32.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:32 smithi050 bash[21866]: audit 2024-05-20T22:07:32.371758+0000 mon.c (mon.2) 17 : audit 1 from='client.? v1:172.21.15.50:0/731135300' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-20T22:07:32.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:32 smithi050 bash[21866]: audit 2024-05-20T22:07:32.372216+0000 mon.a (mon.0) 840 : audit 1 from='client.24521 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-20T22:07:32.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:32 smithi050 bash[21866]: audit 2024-05-20T22:07:32.374764+0000 mon.a (mon.0) 841 : audit 1 from='client.24521 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-20T22:07:32.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:32 smithi050 bash[28929]: audit 2024-05-20T22:07:32.371758+0000 mon.c (mon.2) 17 : audit 1 from='client.? v1:172.21.15.50:0/731135300' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-20T22:07:32.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:32 smithi050 bash[28929]: audit 2024-05-20T22:07:32.372216+0000 mon.a (mon.0) 840 : audit 1 from='client.24521 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-20T22:07:32.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:32 smithi050 bash[28929]: audit 2024-05-20T22:07:32.374764+0000 mon.a (mon.0) 841 : audit 1 from='client.24521 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-20T22:07:33.592 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-20T22:07:33.593 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-20T22:07:33.593 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-20T22:07:33.616 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-20T22:07:33.651 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:33 smithi050 bash[21866]: cluster 2024-05-20T22:07:31.844294+0000 mgr.y (mgr.14592) 34 : cluster 0 pgmap v12: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-20T22:07:33.651 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:33 smithi050 bash[28929]: cluster 2024-05-20T22:07:31.844294+0000 mgr.y (mgr.14592) 34 : cluster 0 pgmap v12: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-20T22:07:33.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:33 smithi145 bash[23893]: cluster 2024-05-20T22:07:31.844294+0000 mgr.y (mgr.14592) 34 : cluster 0 pgmap v12: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-20T22:07:35.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:35 smithi050 bash[21866]: cluster 2024-05-20T22:07:33.845007+0000 mgr.y (mgr.14592) 35 : cluster 0 pgmap v13: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:35.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:35 smithi050 bash[28929]: cluster 2024-05-20T22:07:33.845007+0000 mgr.y (mgr.14592) 35 : cluster 0 pgmap v13: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:35.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:35 smithi145 bash[23893]: cluster 2024-05-20T22:07:33.845007+0000 mgr.y (mgr.14592) 35 : cluster 0 pgmap v13: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:36.750 INFO:journalctl@ceph.osd.2.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:36.751 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:36.751 INFO:journalctl@ceph.osd.0.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:36.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:36.752 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:36.752 INFO:journalctl@ceph.osd.3.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:36.752 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:36.753 INFO:journalctl@ceph.rgw.foo.a.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:36.753 INFO:journalctl@ceph.osd.1.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:37.006 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:37.006 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:37.006 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:37.007 INFO:journalctl@ceph.osd.2.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:37.007 INFO:journalctl@ceph.rgw.foo.a.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:37.007 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:37.007 INFO:journalctl@ceph.osd.0.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:37.008 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:37.008 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:37.008 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:37.008 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:37.008 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:07:37 smithi050 systemd[1]: Started Ceph alertmanager.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968. 2024-05-20T22:07:37.008 INFO:journalctl@ceph.osd.3.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:37.009 INFO:journalctl@ceph.osd.1.smithi050.stdout:May 20 22:07:36 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:37.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:37 smithi050 bash[21866]: cluster 2024-05-20T22:07:35.845780+0000 mgr.y (mgr.14592) 36 : cluster 0 pgmap v14: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:37.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:37 smithi050 bash[21866]: audit 2024-05-20T22:07:37.052798+0000 mon.a (mon.0) 842 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:37.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:37 smithi050 bash[21866]: audit 2024-05-20T22:07:37.058089+0000 mon.a (mon.0) 843 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:37.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:37 smithi050 bash[21866]: audit 2024-05-20T22:07:37.062943+0000 mon.a (mon.0) 844 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:37.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:37 smithi050 bash[21866]: audit 2024-05-20T22:07:37.068545+0000 mon.a (mon.0) 845 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:37.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:37 smithi050 bash[21866]: audit 2024-05-20T22:07:37.100680+0000 mon.a (mon.0) 846 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:07:37.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:37 smithi050 bash[28929]: cluster 2024-05-20T22:07:35.845780+0000 mgr.y (mgr.14592) 36 : cluster 0 pgmap v14: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:37.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:37 smithi050 bash[28929]: audit 2024-05-20T22:07:37.052798+0000 mon.a (mon.0) 842 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:37.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:37 smithi050 bash[28929]: audit 2024-05-20T22:07:37.058089+0000 mon.a (mon.0) 843 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:37.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:37 smithi050 bash[28929]: audit 2024-05-20T22:07:37.062943+0000 mon.a (mon.0) 844 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:37.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:37 smithi050 bash[28929]: audit 2024-05-20T22:07:37.068545+0000 mon.a (mon.0) 845 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:37.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:37 smithi050 bash[28929]: audit 2024-05-20T22:07:37.100680+0000 mon.a (mon.0) 846 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:07:37.890 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:07:37 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:07:37.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:37 smithi145 bash[23893]: cluster 2024-05-20T22:07:35.845780+0000 mgr.y (mgr.14592) 36 : cluster 0 pgmap v14: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:37.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:37 smithi145 bash[23893]: audit 2024-05-20T22:07:37.052798+0000 mon.a (mon.0) 842 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:37.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:37 smithi145 bash[23893]: audit 2024-05-20T22:07:37.058089+0000 mon.a (mon.0) 843 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:37.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:37 smithi145 bash[23893]: audit 2024-05-20T22:07:37.062943+0000 mon.a (mon.0) 844 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:37.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:37 smithi145 bash[23893]: audit 2024-05-20T22:07:37.068545+0000 mon.a (mon.0) 845 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:37.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:37 smithi145 bash[23893]: audit 2024-05-20T22:07:37.100680+0000 mon.a (mon.0) 846 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:07:38.405 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T22:07:38.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:38 smithi050 bash[21866]: audit 2024-05-20T22:07:37.425490+0000 mgr.y (mgr.14592) 37 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:07:38.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:38 smithi050 bash[28929]: audit 2024-05-20T22:07:37.425490+0000 mgr.y (mgr.14592) 37 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:07:38.444 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:07:38 smithi050 bash[58002]: ts=2024-05-20T22:07:38.260Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-05-20T22:07:38.444 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:07:38 smithi050 bash[58002]: ts=2024-05-20T22:07:38.260Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-05-20T22:07:38.444 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:07:38 smithi050 bash[58002]: ts=2024-05-20T22:07:38.262Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.50 port=9094 2024-05-20T22:07:38.444 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:07:38 smithi050 bash[58002]: ts=2024-05-20T22:07:38.263Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-05-20T22:07:38.444 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:07:38 smithi050 bash[58002]: ts=2024-05-20T22:07:38.293Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-05-20T22:07:38.445 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:07:38 smithi050 bash[58002]: ts=2024-05-20T22:07:38.293Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-05-20T22:07:38.445 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:07:38 smithi050 bash[58002]: ts=2024-05-20T22:07:38.298Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-05-20T22:07:38.445 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:07:38 smithi050 bash[58002]: ts=2024-05-20T22:07:38.298Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-05-20T22:07:38.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:38 smithi145 bash[23893]: audit 2024-05-20T22:07:37.425490+0000 mgr.y (mgr.14592) 37 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:07:39.558 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:39 smithi145 bash[23893]: cluster 2024-05-20T22:07:37.846445+0000 mgr.y (mgr.14592) 38 : cluster 0 pgmap v15: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:39.559 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:39 smithi145 bash[23893]: audit 2024-05-20T22:07:38.921780+0000 mon.a (mon.0) 847 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:39.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:07:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:07:39.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:39 smithi050 bash[21866]: cluster 2024-05-20T22:07:37.846445+0000 mgr.y (mgr.14592) 38 : cluster 0 pgmap v15: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:39.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:39 smithi050 bash[21866]: audit 2024-05-20T22:07:38.921780+0000 mon.a (mon.0) 847 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:39.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:39 smithi050 bash[28929]: cluster 2024-05-20T22:07:37.846445+0000 mgr.y (mgr.14592) 38 : cluster 0 pgmap v15: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:39.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:39 smithi050 bash[28929]: audit 2024-05-20T22:07:38.921780+0000 mon.a (mon.0) 847 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:40.693 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:07:40 smithi050 bash[58002]: ts=2024-05-20T22:07:40.263Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000589164s 2024-05-20T22:07:40.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.906+0000 7f1b80c46640 1 -- 172.21.15.145:0/1151892595 >> v1:172.21.15.145:6789/0 conn(0x7f1b7c102830 legacy=0x7f1b7c102c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:40.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.906+0000 7f1b80c46640 1 -- 172.21.15.145:0/1151892595 shutdown_connections 2024-05-20T22:07:40.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.906+0000 7f1b80c46640 1 -- 172.21.15.145:0/1151892595 >> 172.21.15.145:0/1151892595 conn(0x7f1b7c0fc040 msgr2=0x7f1b7c0fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:07:40.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.906+0000 7f1b80c46640 1 -- 172.21.15.145:0/1151892595 shutdown_connections 2024-05-20T22:07:40.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.906+0000 7f1b80c46640 1 -- 172.21.15.145:0/1151892595 wait complete. 2024-05-20T22:07:40.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b80c46640 1 Processor -- start 2024-05-20T22:07:40.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b80c46640 1 -- start start 2024-05-20T22:07:40.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b80c46640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f1b7c10a2b0 con 0x7f1b7c10a640 2024-05-20T22:07:40.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b80c46640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f1b7c1a7cb0 con 0x7f1b7c10e150 2024-05-20T22:07:40.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b80c46640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f1b7c1a8e90 con 0x7f1b7c102830 2024-05-20T22:07:40.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b7ad9d640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f1b7c10e150 0x7f1b7c1a5580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:40692/0 (socket says 172.21.15.145:40692) 2024-05-20T22:07:40.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b7ad9d640 1 -- 172.21.15.145:0/2244051894 learned_addr learned my addr 172.21.15.145:0/2244051894 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-05-20T22:07:40.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b737fe640 1 -- 172.21.15.145:0/2244051894 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1300478897 0 0) 0x7f1b7c1a7cb0 con 0x7f1b7c10e150 2024-05-20T22:07:40.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b737fe640 1 -- 172.21.15.145:0/2244051894 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b68003520 con 0x7f1b7c10e150 2024-05-20T22:07:40.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b737fe640 1 -- 172.21.15.145:0/2244051894 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 613721630 0 0) 0x7f1b68003520 con 0x7f1b7c10e150 2024-05-20T22:07:40.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b737fe640 1 -- 172.21.15.145:0/2244051894 --> v1:172.21.15.145:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1b7c1a7cb0 con 0x7f1b7c10e150 2024-05-20T22:07:40.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b737fe640 1 -- 172.21.15.145:0/2244051894 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f1b74001b70 con 0x7f1b7c10e150 2024-05-20T22:07:40.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b737fe640 1 -- 172.21.15.145:0/2244051894 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3803187746 0 0) 0x7f1b7c10a2b0 con 0x7f1b7c10a640 2024-05-20T22:07:40.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b737fe640 1 -- 172.21.15.145:0/2244051894 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b68003520 con 0x7f1b7c10a640 2024-05-20T22:07:40.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b737fe640 1 -- 172.21.15.145:0/2244051894 <== mon.1 v1:172.21.15.145:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2036600205 0 0) 0x7f1b7c1a7cb0 con 0x7f1b7c10e150 2024-05-20T22:07:40.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b737fe640 1 -- 172.21.15.145:0/2244051894 >> v1:172.21.15.50:6790/0 conn(0x7f1b7c102830 legacy=0x7f1b7c107140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:40.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b737fe640 1 -- 172.21.15.145:0/2244051894 >> v1:172.21.15.50:6789/0 conn(0x7f1b7c10a640 legacy=0x7f1b7c107850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:40.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b737fe640 1 -- 172.21.15.145:0/2244051894 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7c1aa070 con 0x7f1b7c10e150 2024-05-20T22:07:40.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b80c46640 1 -- 172.21.15.145:0/2244051894 --> v1:172.21.15.145:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1b7c1a6d00 con 0x7f1b7c10e150 2024-05-20T22:07:40.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b80c46640 1 -- 172.21.15.145:0/2244051894 --> v1:172.21.15.145:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1b7c1a71c0 con 0x7f1b7c10e150 2024-05-20T22:07:40.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b737fe640 1 -- 172.21.15.145:0/2244051894 <== mon.1 v1:172.21.15.145:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f1b74003e20 con 0x7f1b7c10e150 2024-05-20T22:07:40.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b737fe640 1 -- 172.21.15.145:0/2244051894 <== mon.1 v1:172.21.15.145:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f1b74005f30 con 0x7f1b7c10e150 2024-05-20T22:07:40.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b80c46640 1 -- 172.21.15.145:0/2244051894 --> v1:172.21.15.145:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b5c005080 con 0x7f1b7c10e150 2024-05-20T22:07:40.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b737fe640 1 -- 172.21.15.145:0/2244051894 <== mon.1 v1:172.21.15.145:6789/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f1b74003970 con 0x7f1b7c10e150 2024-05-20T22:07:40.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.910+0000 7f1b737fe640 1 -- 172.21.15.145:0/2244051894 <== mon.1 v1:172.21.15.145:6789/0 8 ==== osd_map(72..72 src has 1..72) ==== 6172+0+0 (unknown 1924863387 0 0) 0x7f1b740899e0 con 0x7f1b7c10e150 2024-05-20T22:07:40.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:40.918+0000 7f1b737fe640 1 -- 172.21.15.145:0/2244051894 <== mon.1 v1:172.21.15.145:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f1b740571a0 con 0x7f1b7c10e150 2024-05-20T22:07:41.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:41.170+0000 7f1b80c46640 1 -- 172.21.15.145:0/2244051894 --> v1:172.21.15.145:6789/0 -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f1b5c005370 con 0x7f1b7c10e150 2024-05-20T22:07:41.181 INFO:teuthology.orchestra.run.smithi145.stdout:[client.1] 2024-05-20T22:07:41.181 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCtyUtmUy+uChAAi8B5l3fYeSxqB12NoiK84w== 2024-05-20T22:07:41.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:41.182+0000 7f1b737fe640 1 -- 172.21.15.145:0/2244051894 <== mon.1 v1:172.21.15.145:6789/0 10 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v19) ==== 170+0+59 (unknown 1383567223 0 3150669382) 0x7f1b7405ae50 con 0x7f1b7c10e150 2024-05-20T22:07:41.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:41.182+0000 7f1b80c46640 1 -- 172.21.15.145:0/2244051894 >> v1:172.21.15.50:6800/3332714287 conn(0x7f1b6806ee80 legacy=0x7f1b68071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:41.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:41.182+0000 7f1b80c46640 1 -- 172.21.15.145:0/2244051894 >> v1:172.21.15.145:6789/0 conn(0x7f1b7c10e150 legacy=0x7f1b7c1a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:41.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:41.182+0000 7f1b80c46640 1 -- 172.21.15.145:0/2244051894 shutdown_connections 2024-05-20T22:07:41.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:41.182+0000 7f1b80c46640 1 -- 172.21.15.145:0/2244051894 >> 172.21.15.145:0/2244051894 conn(0x7f1b7c0fc040 msgr2=0x7f1b7c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:07:41.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:41.182+0000 7f1b80c46640 1 -- 172.21.15.145:0/2244051894 shutdown_connections 2024-05-20T22:07:41.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-05-20T22:07:41.182+0000 7f1b80c46640 1 -- 172.21.15.145:0/2244051894 wait complete. 2024-05-20T22:07:41.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:41 smithi145 bash[23893]: cluster 2024-05-20T22:07:39.847652+0000 mgr.y (mgr.14592) 39 : cluster 0 pgmap v16: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:41.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:41 smithi145 bash[23893]: audit 2024-05-20T22:07:41.177143+0000 mon.b (mon.1) 29 : audit 1 from='client.? v1:172.21.15.145:0/2244051894' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-20T22:07:41.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:41 smithi145 bash[23893]: audit 2024-05-20T22:07:41.178871+0000 mon.a (mon.0) 848 : audit 1 from='client.24574 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-20T22:07:41.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:41 smithi145 bash[23893]: audit 2024-05-20T22:07:41.182367+0000 mon.a (mon.0) 849 : audit 1 from='client.24574 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-20T22:07:41.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:41 smithi050 bash[21866]: cluster 2024-05-20T22:07:39.847652+0000 mgr.y (mgr.14592) 39 : cluster 0 pgmap v16: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:41.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:41 smithi050 bash[21866]: audit 2024-05-20T22:07:41.177143+0000 mon.b (mon.1) 29 : audit 1 from='client.? v1:172.21.15.145:0/2244051894' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-20T22:07:41.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:41 smithi050 bash[21866]: audit 2024-05-20T22:07:41.178871+0000 mon.a (mon.0) 848 : audit 1 from='client.24574 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-20T22:07:41.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:41 smithi050 bash[21866]: audit 2024-05-20T22:07:41.182367+0000 mon.a (mon.0) 849 : audit 1 from='client.24574 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-20T22:07:41.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:41 smithi050 bash[28929]: cluster 2024-05-20T22:07:39.847652+0000 mgr.y (mgr.14592) 39 : cluster 0 pgmap v16: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:41.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:41 smithi050 bash[28929]: audit 2024-05-20T22:07:41.177143+0000 mon.b (mon.1) 29 : audit 1 from='client.? v1:172.21.15.145:0/2244051894' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-20T22:07:41.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:41 smithi050 bash[28929]: audit 2024-05-20T22:07:41.178871+0000 mon.a (mon.0) 848 : audit 1 from='client.24574 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-20T22:07:41.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:41 smithi050 bash[28929]: audit 2024-05-20T22:07:41.182367+0000 mon.a (mon.0) 849 : audit 1 from='client.24574 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-20T22:07:41.847 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-05-20T22:07:41.847 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-05-20T22:07:41.847 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-20T22:07:41.868 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-20T22:07:41.868 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-20T22:07:41.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph mgr dump --format=json 2024-05-20T22:07:43.419 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:43 smithi050 bash[22118]: [20/May/2024:22:07:43] ENGINE Bus STOPPING 2024-05-20T22:07:43.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:43 smithi050 bash[22118]: [20/May/2024:22:07:43] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-20T22:07:43.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:43 smithi050 bash[22118]: [20/May/2024:22:07:43] ENGINE Bus STOPPED 2024-05-20T22:07:43.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:43 smithi050 bash[22118]: [20/May/2024:22:07:43] ENGINE Bus STARTING 2024-05-20T22:07:43.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:43 smithi050 bash[22118]: [20/May/2024:22:07:43] ENGINE Serving on http://:::9283 2024-05-20T22:07:43.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:43 smithi050 bash[22118]: [20/May/2024:22:07:43] ENGINE Bus STARTED 2024-05-20T22:07:43.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:43 smithi050 bash[21866]: cluster 2024-05-20T22:07:41.848737+0000 mgr.y (mgr.14592) 40 : cluster 0 pgmap v17: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:43.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:43 smithi050 bash[21866]: audit 2024-05-20T22:07:42.642022+0000 mon.a (mon.0) 850 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:43 smithi050 bash[21866]: audit 2024-05-20T22:07:42.646108+0000 mon.a (mon.0) 851 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:43 smithi050 bash[21866]: audit 2024-05-20T22:07:42.940946+0000 mon.a (mon.0) 852 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:43 smithi050 bash[21866]: audit 2024-05-20T22:07:42.950242+0000 mon.a (mon.0) 853 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:43 smithi050 bash[21866]: audit 2024-05-20T22:07:42.952442+0000 mon.a (mon.0) 854 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:07:43.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:43 smithi050 bash[21866]: audit 2024-05-20T22:07:42.954167+0000 mon.a (mon.0) 855 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:07:43.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:43 smithi050 bash[21866]: audit 2024-05-20T22:07:42.963679+0000 mon.a (mon.0) 856 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:43 smithi050 bash[21866]: audit 2024-05-20T22:07:43.135310+0000 mon.a (mon.0) 857 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:43 smithi050 bash[21866]: audit 2024-05-20T22:07:43.141689+0000 mon.a (mon.0) 858 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:43 smithi050 bash[21866]: audit 2024-05-20T22:07:43.145722+0000 mon.a (mon.0) 859 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-20T22:07:43.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:43 smithi050 bash[21866]: audit 2024-05-20T22:07:43.153735+0000 mon.a (mon.0) 860 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:43 smithi050 bash[28929]: cluster 2024-05-20T22:07:41.848737+0000 mgr.y (mgr.14592) 40 : cluster 0 pgmap v17: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:43.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:43 smithi050 bash[28929]: audit 2024-05-20T22:07:42.642022+0000 mon.a (mon.0) 850 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:43 smithi050 bash[28929]: audit 2024-05-20T22:07:42.646108+0000 mon.a (mon.0) 851 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:43 smithi050 bash[28929]: audit 2024-05-20T22:07:42.940946+0000 mon.a (mon.0) 852 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:43 smithi050 bash[28929]: audit 2024-05-20T22:07:42.950242+0000 mon.a (mon.0) 853 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:43 smithi050 bash[28929]: audit 2024-05-20T22:07:42.952442+0000 mon.a (mon.0) 854 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:07:43.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:43 smithi050 bash[28929]: audit 2024-05-20T22:07:42.954167+0000 mon.a (mon.0) 855 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:07:43.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:43 smithi050 bash[28929]: audit 2024-05-20T22:07:42.963679+0000 mon.a (mon.0) 856 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:43 smithi050 bash[28929]: audit 2024-05-20T22:07:43.135310+0000 mon.a (mon.0) 857 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:43 smithi050 bash[28929]: audit 2024-05-20T22:07:43.141689+0000 mon.a (mon.0) 858 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:43 smithi050 bash[28929]: audit 2024-05-20T22:07:43.145722+0000 mon.a (mon.0) 859 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-20T22:07:43.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:43 smithi050 bash[28929]: audit 2024-05-20T22:07:43.153735+0000 mon.a (mon.0) 860 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:43 smithi145 bash[23893]: cluster 2024-05-20T22:07:41.848737+0000 mgr.y (mgr.14592) 40 : cluster 0 pgmap v17: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:43.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:43 smithi145 bash[23893]: audit 2024-05-20T22:07:42.642022+0000 mon.a (mon.0) 850 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:43 smithi145 bash[23893]: audit 2024-05-20T22:07:42.646108+0000 mon.a (mon.0) 851 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:43 smithi145 bash[23893]: audit 2024-05-20T22:07:42.940946+0000 mon.a (mon.0) 852 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:43 smithi145 bash[23893]: audit 2024-05-20T22:07:42.950242+0000 mon.a (mon.0) 853 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:43 smithi145 bash[23893]: audit 2024-05-20T22:07:42.952442+0000 mon.a (mon.0) 854 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:07:43.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:43 smithi145 bash[23893]: audit 2024-05-20T22:07:42.954167+0000 mon.a (mon.0) 855 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:07:43.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:43 smithi145 bash[23893]: audit 2024-05-20T22:07:42.963679+0000 mon.a (mon.0) 856 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:43 smithi145 bash[23893]: audit 2024-05-20T22:07:43.135310+0000 mon.a (mon.0) 857 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:43 smithi145 bash[23893]: audit 2024-05-20T22:07:43.141689+0000 mon.a (mon.0) 858 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:43.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:43 smithi145 bash[23893]: audit 2024-05-20T22:07:43.145722+0000 mon.a (mon.0) 859 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-20T22:07:43.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:43 smithi145 bash[23893]: audit 2024-05-20T22:07:43.153735+0000 mon.a (mon.0) 860 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:44.390 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:43 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:44.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:44 smithi050 bash[21866]: cephadm 2024-05-20T22:07:43.001243+0000 mgr.y (mgr.14592) 41 : cephadm 1 Regenerating cephadm self-signed grafana TLS certificates 2024-05-20T22:07:44.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:44 smithi050 bash[21866]: audit 2024-05-20T22:07:43.146350+0000 mgr.y (mgr.14592) 42 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-20T22:07:44.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:44 smithi050 bash[21866]: cephadm 2024-05-20T22:07:43.172963+0000 mgr.y (mgr.14592) 43 : cephadm 1 Deploying daemon grafana.a on smithi145 2024-05-20T22:07:44.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:44 smithi050 bash[21866]: audit 2024-05-20T22:07:43.981657+0000 mon.a (mon.0) 861 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:07:44.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:44 smithi050 bash[28929]: cephadm 2024-05-20T22:07:43.001243+0000 mgr.y (mgr.14592) 41 : cephadm 1 Regenerating cephadm self-signed grafana TLS certificates 2024-05-20T22:07:44.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:44 smithi050 bash[28929]: audit 2024-05-20T22:07:43.146350+0000 mgr.y (mgr.14592) 42 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-20T22:07:44.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:44 smithi050 bash[28929]: cephadm 2024-05-20T22:07:43.172963+0000 mgr.y (mgr.14592) 43 : cephadm 1 Deploying daemon grafana.a on smithi145 2024-05-20T22:07:44.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:44 smithi050 bash[28929]: audit 2024-05-20T22:07:43.981657+0000 mon.a (mon.0) 861 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:07:44.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:44 smithi145 bash[23893]: cephadm 2024-05-20T22:07:43.001243+0000 mgr.y (mgr.14592) 41 : cephadm 1 Regenerating cephadm self-signed grafana TLS certificates 2024-05-20T22:07:44.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:44 smithi145 bash[23893]: audit 2024-05-20T22:07:43.146350+0000 mgr.y (mgr.14592) 42 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-20T22:07:44.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:44 smithi145 bash[23893]: cephadm 2024-05-20T22:07:43.172963+0000 mgr.y (mgr.14592) 43 : cephadm 1 Deploying daemon grafana.a on smithi145 2024-05-20T22:07:44.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:44 smithi145 bash[23893]: audit 2024-05-20T22:07:43.981657+0000 mon.a (mon.0) 861 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:07:45.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:45 smithi050 bash[21866]: cluster 2024-05-20T22:07:43.849385+0000 mgr.y (mgr.14592) 44 : cluster 0 pgmap v18: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:45.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:45 smithi050 bash[28929]: cluster 2024-05-20T22:07:43.849385+0000 mgr.y (mgr.14592) 44 : cluster 0 pgmap v18: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:45.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:45 smithi145 bash[23893]: cluster 2024-05-20T22:07:43.849385+0000 mgr.y (mgr.14592) 44 : cluster 0 pgmap v18: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:46.187 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:07:47.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:47 smithi050 bash[21866]: cluster 2024-05-20T22:07:45.850835+0000 mgr.y (mgr.14592) 45 : cluster 0 pgmap v19: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:47.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:47 smithi050 bash[28929]: cluster 2024-05-20T22:07:45.850835+0000 mgr.y (mgr.14592) 45 : cluster 0 pgmap v19: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:47.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:47 smithi145 bash[23893]: cluster 2024-05-20T22:07:45.850835+0000 mgr.y (mgr.14592) 45 : cluster 0 pgmap v19: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:47.890 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:07:47 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:07:48.440 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:07:48 smithi050 bash[58002]: ts=2024-05-20T22:07:48.266Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.002906601s 2024-05-20T22:07:48.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:48 smithi050 bash[21866]: audit 2024-05-20T22:07:47.434207+0000 mgr.y (mgr.14592) 46 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:07:48.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:48 smithi050 bash[28929]: audit 2024-05-20T22:07:47.434207+0000 mgr.y (mgr.14592) 46 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:07:48.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:48 smithi145 bash[23893]: audit 2024-05-20T22:07:47.434207+0000 mgr.y (mgr.14592) 46 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:07:48.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.983+0000 7fa4e8d06640 1 -- 172.21.15.50:0/2295385488 >> v1:172.21.15.50:6789/0 conn(0x7fa4e4106650 legacy=0x7fa4e4106a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:48.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.983+0000 7fa4e8d06640 1 -- 172.21.15.50:0/2295385488 shutdown_connections 2024-05-20T22:07:48.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.983+0000 7fa4e8d06640 1 -- 172.21.15.50:0/2295385488 >> 172.21.15.50:0/2295385488 conn(0x7fa4e40fc0d0 msgr2=0x7fa4e40fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:07:48.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.983+0000 7fa4e8d06640 1 -- 172.21.15.50:0/2295385488 shutdown_connections 2024-05-20T22:07:48.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.983+0000 7fa4e8d06640 1 -- 172.21.15.50:0/2295385488 wait complete. 2024-05-20T22:07:48.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.983+0000 7fa4e8d06640 1 Processor -- start 2024-05-20T22:07:48.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.983+0000 7fa4e8d06640 1 -- start start 2024-05-20T22:07:48.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.983+0000 7fa4e8d06640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa4e41a87c0 con 0x7fa4e4106650 2024-05-20T22:07:48.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.983+0000 7fa4e8d06640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa4e41a9a00 con 0x7fa4e410d010 2024-05-20T22:07:48.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.983+0000 7fa4e8d06640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa4e41aac40 con 0x7fa4e4109470 2024-05-20T22:07:48.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.983+0000 7fa4e259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa4e4106650 0x7fa4e4105940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46250/0 (socket says 172.21.15.50:46250) 2024-05-20T22:07:48.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.983+0000 7fa4e259c640 1 -- 172.21.15.50:0/1672895312 learned_addr learned my addr 172.21.15.50:0/1672895312 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:07:48.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.983+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3141259312 0 0) 0x7fa4e41a87c0 con 0x7fa4e4106650 2024-05-20T22:07:48.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.983+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4cc003520 con 0x7fa4e4106650 2024-05-20T22:07:48.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.983+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2909100780 0 0) 0x7fa4e41aac40 con 0x7fa4e4109470 2024-05-20T22:07:48.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.983+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4e41a87c0 con 0x7fa4e4109470 2024-05-20T22:07:48.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.987+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1859684622 0 0) 0x7fa4e41a9a00 con 0x7fa4e410d010 2024-05-20T22:07:48.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.987+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4e41aac40 con 0x7fa4e410d010 2024-05-20T22:07:48.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.987+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1747116679 0 0) 0x7fa4cc003520 con 0x7fa4e4106650 2024-05-20T22:07:48.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.987+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4e41a9a00 con 0x7fa4e4106650 2024-05-20T22:07:48.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.987+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fa4d4004570 con 0x7fa4e4106650 2024-05-20T22:07:48.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.987+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3631152034 0 0) 0x7fa4e41a87c0 con 0x7fa4e4109470 2024-05-20T22:07:48.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.987+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4cc003520 con 0x7fa4e4109470 2024-05-20T22:07:48.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.987+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fa4d8001370 con 0x7fa4e4109470 2024-05-20T22:07:48.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.987+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2292365740 0 0) 0x7fa4e41a9a00 con 0x7fa4e4106650 2024-05-20T22:07:48.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.987+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 >> v1:172.21.15.50:6790/0 conn(0x7fa4e4109470 legacy=0x7fa4e41a3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:48.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.987+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 >> v1:172.21.15.145:6789/0 conn(0x7fa4e410d010 legacy=0x7fa4e41a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:48.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.987+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e41abe80 con 0x7fa4e4106650 2024-05-20T22:07:48.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.987+0000 7fa4e8d06640 1 -- 172.21.15.50:0/1672895312 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa4e41aae10 con 0x7fa4e4106650 2024-05-20T22:07:48.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.987+0000 7fa4e8d06640 1 -- 172.21.15.50:0/1672895312 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa4e41ab2d0 con 0x7fa4e4106650 2024-05-20T22:07:48.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.987+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7fa4d4001100 con 0x7fa4e4106650 2024-05-20T22:07:48.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.987+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fa4d4004d20 con 0x7fa4e4106650 2024-05-20T22:07:48.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.987+0000 7fa4e8d06640 1 -- 172.21.15.50:0/1672895312 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4c4005080 con 0x7fa4e4106650 2024-05-20T22:07:48.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.987+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7fa4d4001af0 con 0x7fa4e4106650 2024-05-20T22:07:48.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.987+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(72..72 src has 1..72) ==== 6172+0+0 (unknown 1924863387 0 0) 0x7fa4d4089730 con 0x7fa4e4106650 2024-05-20T22:07:48.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:48.991+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7fa4d4056ef0 con 0x7fa4e4106650 2024-05-20T22:07:49.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:49.235+0000 7fa4e8d06640 1 -- 172.21.15.50:0/1672895312 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fa4c4005370 con 0x7fa4e4106650 2024-05-20T22:07:49.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:49.243+0000 7fa4d37fe640 1 -- 172.21.15.50:0/1672895312 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v22) ==== 74+0+175911 (unknown 3269696449 0 2676616778) 0x7fa4d405aba0 con 0x7fa4e4106650 2024-05-20T22:07:49.243 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-20T22:07:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:49.247+0000 7fa4e8d06640 1 -- 172.21.15.50:0/1672895312 >> v1:172.21.15.50:6800/3332714287 conn(0x7fa4cc06ee80 legacy=0x7fa4cc071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:49.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:49.247+0000 7fa4e8d06640 1 -- 172.21.15.50:0/1672895312 >> v1:172.21.15.50:6789/0 conn(0x7fa4e4106650 legacy=0x7fa4e4105940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:49.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:49.247+0000 7fa4e8d06640 1 -- 172.21.15.50:0/1672895312 shutdown_connections 2024-05-20T22:07:49.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:49.247+0000 7fa4e8d06640 1 -- 172.21.15.50:0/1672895312 >> 172.21.15.50:0/1672895312 conn(0x7fa4e40fc0d0 msgr2=0x7fa4e4110530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:07:49.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:49.247+0000 7fa4e8d06640 1 -- 172.21.15.50:0/1672895312 shutdown_connections 2024-05-20T22:07:49.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:49.247+0000 7fa4e8d06640 1 -- 172.21.15.50:0/1672895312 wait complete. 2024-05-20T22:07:49.545 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:49 smithi050 bash[21866]: cluster 2024-05-20T22:07:47.851536+0000 mgr.y (mgr.14592) 47 : cluster 0 pgmap v20: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:49.545 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:49 smithi050 bash[21866]: audit 2024-05-20T22:07:49.238993+0000 mon.a (mon.0) 862 : audit 0 from='client.? v1:172.21.15.50:0/1672895312' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-20T22:07:49.545 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:07:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:07:49.545 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:49 smithi050 bash[28929]: cluster 2024-05-20T22:07:47.851536+0000 mgr.y (mgr.14592) 47 : cluster 0 pgmap v20: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:49.545 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:49 smithi050 bash[28929]: audit 2024-05-20T22:07:49.238993+0000 mon.a (mon.0) 862 : audit 0 from='client.? v1:172.21.15.50:0/1672895312' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-20T22:07:49.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:49 smithi145 bash[23893]: cluster 2024-05-20T22:07:47.851536+0000 mgr.y (mgr.14592) 47 : cluster 0 pgmap v20: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:49.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:49 smithi145 bash[23893]: audit 2024-05-20T22:07:49.238993+0000 mon.a (mon.0) 862 : audit 0 from='client.? v1:172.21.15.50:0/1672895312' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-20T22:07:50.039 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":22,"flags":0,"active_gid":14592,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6800","nonce":3332714287}]},"active_addr":"172.21.15.50:6800/3332714287","active_change":"2024-05-20T22:07:13.814147+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24479,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.50:8443/","prometheus":"http://172.21.15.50:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":72,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":2006801434}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":3198734955}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":1326005978}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":3907285965}]}]} 2024-05-20T22:07:50.043 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-20T22:07:50.043 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-20T22:07:50.043 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph osd dump --format=json 2024-05-20T22:07:51.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:51 smithi145 bash[23893]: cluster 2024-05-20T22:07:49.853017+0000 mgr.y (mgr.14592) 48 : cluster 0 pgmap v21: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:51.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:51 smithi050 bash[21866]: cluster 2024-05-20T22:07:49.853017+0000 mgr.y (mgr.14592) 48 : cluster 0 pgmap v21: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:51.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:51 smithi050 bash[28929]: cluster 2024-05-20T22:07:49.853017+0000 mgr.y (mgr.14592) 48 : cluster 0 pgmap v21: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:53.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:53 smithi145 bash[23893]: cluster 2024-05-20T22:07:51.854000+0000 mgr.y (mgr.14592) 49 : cluster 0 pgmap v22: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:53.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:53 smithi050 bash[21866]: cluster 2024-05-20T22:07:51.854000+0000 mgr.y (mgr.14592) 49 : cluster 0 pgmap v22: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:53.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:53 smithi050 bash[28929]: cluster 2024-05-20T22:07:51.854000+0000 mgr.y (mgr.14592) 49 : cluster 0 pgmap v22: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:54.830 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:07:55.707 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:55 smithi050 bash[21866]: cluster 2024-05-20T22:07:53.854689+0000 mgr.y (mgr.14592) 50 : cluster 0 pgmap v23: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:55.708 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:55 smithi050 bash[28929]: cluster 2024-05-20T22:07:53.854689+0000 mgr.y (mgr.14592) 50 : cluster 0 pgmap v23: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:55.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:55 smithi145 bash[23893]: cluster 2024-05-20T22:07:53.854689+0000 mgr.y (mgr.14592) 50 : cluster 0 pgmap v23: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:57.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6533e5e640 1 -- 172.21.15.50:0/1747595921 >> v1:172.21.15.50:6789/0 conn(0x7f652c1076b0 legacy=0x7f652c107a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:57.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6533e5e640 1 -- 172.21.15.50:0/1747595921 shutdown_connections 2024-05-20T22:07:57.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6533e5e640 1 -- 172.21.15.50:0/1747595921 >> 172.21.15.50:0/1747595921 conn(0x7f652c0fd1e0 msgr2=0x7f652c0ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:07:57.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6533e5e640 1 -- 172.21.15.50:0/1747595921 shutdown_connections 2024-05-20T22:07:57.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6533e5e640 1 -- 172.21.15.50:0/1747595921 wait complete. 2024-05-20T22:07:57.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6533e5e640 1 Processor -- start 2024-05-20T22:07:57.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6533e5e640 1 -- start start 2024-05-20T22:07:57.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6533e5e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f652c1a6720 con 0x7f652c10a560 2024-05-20T22:07:57.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6533e5e640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f652c1a7960 con 0x7f652c1076b0 2024-05-20T22:07:57.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6533e5e640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f652c1a8ba0 con 0x7f652c10e100 2024-05-20T22:07:57.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f65313f9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f652c10a560 0x7f652c1a1570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46262/0 (socket says 172.21.15.50:46262) 2024-05-20T22:07:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f65313f9640 1 -- 172.21.15.50:0/179327590 learned_addr learned my addr 172.21.15.50:0/179327590 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:07:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1986221551 0 0) 0x7f652c1a6720 con 0x7f652c10a560 2024-05-20T22:07:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6518003520 con 0x7f652c10a560 2024-05-20T22:07:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2998514166 0 0) 0x7f652c1a8ba0 con 0x7f652c10e100 2024-05-20T22:07:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f652c1a6720 con 0x7f652c10e100 2024-05-20T22:07:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 78381601 0 0) 0x7f652c1a7960 con 0x7f652c1076b0 2024-05-20T22:07:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f652c1a8ba0 con 0x7f652c1076b0 2024-05-20T22:07:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1794196029 0 0) 0x7f6518003520 con 0x7f652c10a560 2024-05-20T22:07:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f652c1a7960 con 0x7f652c10a560 2024-05-20T22:07:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3220979671 0 0) 0x7f652c1a6720 con 0x7f652c10e100 2024-05-20T22:07:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6518003520 con 0x7f652c10e100 2024-05-20T22:07:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f651c001a10 con 0x7f652c10a560 2024-05-20T22:07:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f6524001720 con 0x7f652c10e100 2024-05-20T22:07:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3418654725 0 0) 0x7f652c1a8ba0 con 0x7f652c1076b0 2024-05-20T22:07:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 --> v1:172.21.15.145:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f652c1a6720 con 0x7f652c1076b0 2024-05-20T22:07:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f6528001bb0 con 0x7f652c1076b0 2024-05-20T22:07:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 522635825 0 0) 0x7f6518003520 con 0x7f652c10e100 2024-05-20T22:07:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 >> v1:172.21.15.145:6789/0 conn(0x7f652c1076b0 legacy=0x7f652c10d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 >> v1:172.21.15.50:6789/0 conn(0x7f652c10a560 legacy=0x7f652c1a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c1a9de0 con 0x7f652c10e100 2024-05-20T22:07:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6533e5e640 1 -- 172.21.15.50:0/179327590 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f652c1a8dd0 con 0x7f652c10e100 2024-05-20T22:07:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6533e5e640 1 -- 172.21.15.50:0/179327590 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f652c1a9290 con 0x7f652c10e100 2024-05-20T22:07:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f65240018c0 con 0x7f652c10e100 2024-05-20T22:07:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.407+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f6524004820 con 0x7f652c10e100 2024-05-20T22:07:57.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.411+0000 7f6533e5e640 1 -- 172.21.15.50:0/179327590 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65100050b0 con 0x7f652c10e100 2024-05-20T22:07:57.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.411+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f65240035f0 con 0x7f652c10e100 2024-05-20T22:07:57.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.411+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(72..72 src has 1..72) ==== 6172+0+0 (unknown 1924863387 0 0) 0x7f6524087ed0 con 0x7f652c10e100 2024-05-20T22:07:57.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.415+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f6524055690 con 0x7f652c10e100 2024-05-20T22:07:57.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.611+0000 7f6533e5e640 1 -- 172.21.15.50:0/179327590 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65100053a0 con 0x7f652c10e100 2024-05-20T22:07:57.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.615+0000 7f6522ffd640 1 -- 172.21.15.50:0/179327590 <== mon.2 v1:172.21.15.50:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+20907 (unknown 1686360691 0 301376064) 0x7f6524059340 con 0x7f652c10e100 2024-05-20T22:07:57.610 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-20T22:07:57.610 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":72,"fsid":"9a9abba0-16f3-11ef-bc9a-c7b262605968","created":"2024-05-20T21:56:19.800804+0000","modified":"2024-05-20T22:07:13.813858+0000","last_up_change":"2024-05-20T22:05:42.257017+0000","last_in_change":"2024-05-20T22:05:17.807939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T22:01:30.033740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-05-20T22:06:21.770941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.log","create_time":"2024-05-20T22:06:23.509831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"datapool","create_time":"2024-05-20T22:06:25.031250+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-05-20T22:06:25.522299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-05-20T22:06:27.955030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e24659f-5dce-416d-83fd-beff6359fc45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":4039291270}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":4039291270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":4039291270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":4039291270}]},"public_addr":"172.21.15.50:6801/4039291270","cluster_addr":"172.21.15.50:6802/4039291270","heartbeat_back_addr":"172.21.15.50:6804/4039291270","heartbeat_front_addr":"172.21.15.50:6803/4039291270","state":["exists","up"]},{"osd":1,"uuid":"507cd562-6be9-4469-bafe-17f52cd04ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":4214903941}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":4214903941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":4214903941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":4214903941}]},"public_addr":"172.21.15.50:6805/4214903941","cluster_addr":"172.21.15.50:6806/4214903941","heartbeat_back_addr":"172.21.15.50:6808/4214903941","heartbeat_front_addr":"172.21.15.50:6807/4214903941","state":["exists","up"]},{"osd":2,"uuid":"a21d4e6b-3116-4dcd-a4fe-a224f2082926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":3675120581}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":3675120581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":3675120581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":3675120581}]},"public_addr":"172.21.15.50:6809/3675120581","cluster_addr":"172.21.15.50:6810/3675120581","heartbeat_back_addr":"172.21.15.50:6812/3675120581","heartbeat_front_addr":"172.21.15.50:6811/3675120581","state":["exists","up"]},{"osd":3,"uuid":"6e60bb64-706c-438b-8edf-49c2709374c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":3714877290}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":3714877290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":3714877290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":3714877290}]},"public_addr":"172.21.15.50:6813/3714877290","cluster_addr":"172.21.15.50:6814/3714877290","heartbeat_back_addr":"172.21.15.50:6816/3714877290","heartbeat_front_addr":"172.21.15.50:6815/3714877290","state":["exists","up"]},{"osd":4,"uuid":"369f2c71-4164-48c1-aaa5-5cd9a5644309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6800","nonce":2241357489}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6801","nonce":2241357489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6803","nonce":2241357489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6802","nonce":2241357489}]},"public_addr":"172.21.15.145:6800/2241357489","cluster_addr":"172.21.15.145:6801/2241357489","heartbeat_back_addr":"172.21.15.145:6803/2241357489","heartbeat_front_addr":"172.21.15.145:6802/2241357489","state":["exists","up"]},{"osd":5,"uuid":"706eb62f-93b9-4465-a352-cade0e490194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6804","nonce":1463480843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6805","nonce":1463480843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6807","nonce":1463480843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6806","nonce":1463480843}]},"public_addr":"172.21.15.145:6804/1463480843","cluster_addr":"172.21.15.145:6805/1463480843","heartbeat_back_addr":"172.21.15.145:6807/1463480843","heartbeat_front_addr":"172.21.15.145:6806/1463480843","state":["exists","up"]},{"osd":6,"uuid":"cb87446a-56f6-4a73-813b-ce70360ae5f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6808","nonce":856530538}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6809","nonce":856530538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6811","nonce":856530538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6810","nonce":856530538}]},"public_addr":"172.21.15.145:6808/856530538","cluster_addr":"172.21.15.145:6809/856530538","heartbeat_back_addr":"172.21.15.145:6811/856530538","heartbeat_front_addr":"172.21.15.145:6810/856530538","state":["exists","up"]},{"osd":7,"uuid":"a29bd67b-c55e-423c-b251-0ba4b656544a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6812","nonce":2864002573}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6813","nonce":2864002573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6815","nonce":2864002573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6814","nonce":2864002573}]},"public_addr":"172.21.15.145:6812/2864002573","cluster_addr":"172.21.15.145:6813/2864002573","heartbeat_back_addr":"172.21.15.145:6815/2864002573","heartbeat_front_addr":"172.21.15.145:6814/2864002573","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T21:59:41.084272+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:00:34.330079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:01:27.148884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:02:20.988321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:03:10.755672+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:04:00.708157+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:04:50.388089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:05:41.164844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/299170294":"2024-05-21T22:07:13.813778+0000","172.21.15.50:6800/2047033350":"2024-05-21T21:56:45.401749+0000","172.21.15.50:0/438442029":"2024-05-21T21:56:45.401749+0000","172.21.15.50:0/2072209505":"2024-05-21T21:56:45.401749+0000","172.21.15.50:0/3248870305":"2024-05-21T21:56:45.401749+0000","172.21.15.50:0/4166168321":"2024-05-21T22:07:13.813778+0000","172.21.15.50:0/3504814165":"2024-05-21T21:57:17.389846+0000","172.21.15.50:0/376844583":"2024-05-21T22:07:13.813778+0000","172.21.15.50:6800/2944911247":"2024-05-21T22:07:13.813778+0000","172.21.15.50:0/1181319036":"2024-05-21T21:57:17.389846+0000","172.21.15.50:0/3225566634":"2024-05-21T22:07:13.813778+0000","172.21.15.50:6800/3032841639":"2024-05-21T21:57:17.389846+0000","172.21.15.50:0/2157528765":"2024-05-21T21:57:17.389846+0000","172.21.15.50:0/2176782899":"2024-05-21T22:07:13.813778+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T22:07:57.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.615+0000 7f6533e5e640 1 -- 172.21.15.50:0/179327590 >> v1:172.21.15.50:6800/3332714287 conn(0x7f651806ee90 legacy=0x7f6518071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:57.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.615+0000 7f6533e5e640 1 -- 172.21.15.50:0/179327590 >> v1:172.21.15.50:6790/0 conn(0x7f652c10e100 legacy=0x7f652c1a4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:07:57.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.615+0000 7f6533e5e640 1 -- 172.21.15.50:0/179327590 shutdown_connections 2024-05-20T22:07:57.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.615+0000 7f6533e5e640 1 -- 172.21.15.50:0/179327590 >> 172.21.15.50:0/179327590 conn(0x7f652c0fd1e0 msgr2=0x7f652c1016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:07:57.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.615+0000 7f6533e5e640 1 -- 172.21.15.50:0/179327590 shutdown_connections 2024-05-20T22:07:57.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:07:57.615+0000 7f6533e5e640 1 -- 172.21.15.50:0/179327590 wait complete. 2024-05-20T22:07:57.623 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:57 smithi050 bash[21866]: cluster 2024-05-20T22:07:55.855605+0000 mgr.y (mgr.14592) 51 : cluster 0 pgmap v24: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:57.623 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:57 smithi050 bash[28929]: cluster 2024-05-20T22:07:55.855605+0000 mgr.y (mgr.14592) 51 : cluster 0 pgmap v24: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:57.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:57 smithi145 bash[23893]: cluster 2024-05-20T22:07:55.855605+0000 mgr.y (mgr.14592) 51 : cluster 0 pgmap v24: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:07:57.642 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:07:57 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:07:58.309 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-20T22:07:58.309 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph osd dump --format=json 2024-05-20T22:07:58.403 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.403 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.403 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.404 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.404 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.404 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.405 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.405 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.405 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:58 smithi050 bash[21866]: audit 2024-05-20T22:07:57.443044+0000 mgr.y (mgr.14592) 52 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:07:58.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:58 smithi050 bash[21866]: audit 2024-05-20T22:07:57.612678+0000 mon.c (mon.2) 18 : audit 0 from='client.? v1:172.21.15.50:0/179327590' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T22:07:58.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:58 smithi050 bash[28929]: audit 2024-05-20T22:07:57.443044+0000 mgr.y (mgr.14592) 52 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:07:58.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:58 smithi050 bash[28929]: audit 2024-05-20T22:07:57.612678+0000 mon.c (mon.2) 18 : audit 0 from='client.? v1:172.21.15.50:0/179327590' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T22:07:58.695 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.695 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.695 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:58 smithi145 bash[23893]: audit 2024-05-20T22:07:57.443044+0000 mgr.y (mgr.14592) 52 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:07:58.696 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:58 smithi145 bash[23893]: audit 2024-05-20T22:07:57.612678+0000 mon.c (mon.2) 18 : audit 0 from='client.? v1:172.21.15.50:0/179327590' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T22:07:58.696 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.696 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.696 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.697 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.697 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.697 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.697 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.697 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: Started Ceph grafana.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968. 2024-05-20T22:07:58.697 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.697 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.698 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:58.698 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:07:58 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:07:59.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:07:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:07:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:07:59.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:59 smithi050 bash[21866]: cluster 2024-05-20T22:07:57.856296+0000 mgr.y (mgr.14592) 53 : cluster 0 pgmap v25: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:59.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:59 smithi050 bash[21866]: audit 2024-05-20T22:07:58.704611+0000 mon.a (mon.0) 863 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:59.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:59 smithi050 bash[21866]: audit 2024-05-20T22:07:58.714397+0000 mon.a (mon.0) 864 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:59.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:59 smithi050 bash[21866]: audit 2024-05-20T22:07:58.723141+0000 mon.a (mon.0) 865 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:59.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:59 smithi050 bash[21866]: audit 2024-05-20T22:07:58.730563+0000 mon.a (mon.0) 866 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:59.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:59 smithi050 bash[21866]: audit 2024-05-20T22:07:58.788918+0000 mon.a (mon.0) 867 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:07:59.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:59 smithi050 bash[21866]: audit 2024-05-20T22:07:58.932124+0000 mon.a (mon.0) 868 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:59.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:59 smithi050 bash[21866]: audit 2024-05-20T22:07:59.005671+0000 mon.a (mon.0) 869 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:07:59.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:59 smithi050 bash[21866]: audit 2024-05-20T22:07:59.309878+0000 mon.a (mon.0) 870 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:59.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:07:59 smithi050 bash[21866]: audit 2024-05-20T22:07:59.314287+0000 mon.a (mon.0) 871 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:59.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:59 smithi050 bash[28929]: cluster 2024-05-20T22:07:57.856296+0000 mgr.y (mgr.14592) 53 : cluster 0 pgmap v25: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:59.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:59 smithi050 bash[28929]: audit 2024-05-20T22:07:58.704611+0000 mon.a (mon.0) 863 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:59.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:59 smithi050 bash[28929]: audit 2024-05-20T22:07:58.714397+0000 mon.a (mon.0) 864 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:59.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:59 smithi050 bash[28929]: audit 2024-05-20T22:07:58.723141+0000 mon.a (mon.0) 865 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:59.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:59 smithi050 bash[28929]: audit 2024-05-20T22:07:58.730563+0000 mon.a (mon.0) 866 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:59.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:59 smithi050 bash[28929]: audit 2024-05-20T22:07:58.788918+0000 mon.a (mon.0) 867 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:07:59.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:59 smithi050 bash[28929]: audit 2024-05-20T22:07:58.932124+0000 mon.a (mon.0) 868 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:59.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:59 smithi050 bash[28929]: audit 2024-05-20T22:07:59.005671+0000 mon.a (mon.0) 869 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:07:59.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:59 smithi050 bash[28929]: audit 2024-05-20T22:07:59.309878+0000 mon.a (mon.0) 870 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:59.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:07:59 smithi050 bash[28929]: audit 2024-05-20T22:07:59.314287+0000 mon.a (mon.0) 871 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:59.746 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:59 smithi145 bash[23893]: cluster 2024-05-20T22:07:57.856296+0000 mgr.y (mgr.14592) 53 : cluster 0 pgmap v25: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:07:59.746 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:59 smithi145 bash[23893]: audit 2024-05-20T22:07:58.704611+0000 mon.a (mon.0) 863 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:59.746 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:59 smithi145 bash[23893]: audit 2024-05-20T22:07:58.714397+0000 mon.a (mon.0) 864 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:59.746 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:59 smithi145 bash[23893]: audit 2024-05-20T22:07:58.723141+0000 mon.a (mon.0) 865 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:59.746 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:59 smithi145 bash[23893]: audit 2024-05-20T22:07:58.730563+0000 mon.a (mon.0) 866 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:59.746 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:59 smithi145 bash[23893]: audit 2024-05-20T22:07:58.788918+0000 mon.a (mon.0) 867 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:07:59.746 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:59 smithi145 bash[23893]: audit 2024-05-20T22:07:58.932124+0000 mon.a (mon.0) 868 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:59.746 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:59 smithi145 bash[23893]: audit 2024-05-20T22:07:59.005671+0000 mon.a (mon.0) 869 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:07:59.746 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:59 smithi145 bash[23893]: audit 2024-05-20T22:07:59.309878+0000 mon.a (mon.0) 870 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:07:59.747 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:07:59 smithi145 bash[23893]: audit 2024-05-20T22:07:59.314287+0000 mon.a (mon.0) 871 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:00.001 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=settings t=2024-05-20T22:07:59.750864944Z level=info msg="Starting Grafana" version=9.4.12 commit=37ee25ba46 branch=HEAD compiled=2023-05-22T15:58:05Z 2024-05-20T22:08:00.001 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=settings t=2024-05-20T22:07:59.751102737Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-05-20T22:08:00.002 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=settings t=2024-05-20T22:07:59.751117768Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-05-20T22:08:00.002 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=settings t=2024-05-20T22:07:59.751123474Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-05-20T22:08:00.002 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=settings t=2024-05-20T22:07:59.751128545Z level=info msg="Config overridden from command line" arg="default.paths.data=/var/lib/grafana" 2024-05-20T22:08:00.002 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=settings t=2024-05-20T22:07:59.751133461Z level=info msg="Config overridden from command line" arg="default.paths.logs=/var/log/grafana" 2024-05-20T22:08:00.002 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=settings t=2024-05-20T22:07:59.751138198Z level=info msg="Config overridden from command line" arg="default.paths.plugins=/var/lib/grafana/plugins" 2024-05-20T22:08:00.002 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=settings t=2024-05-20T22:07:59.751142724Z level=info msg="Config overridden from command line" arg="default.paths.provisioning=/etc/grafana/provisioning" 2024-05-20T22:08:00.002 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=settings t=2024-05-20T22:07:59.751147838Z level=info msg="Config overridden from command line" arg="default.log.mode=console" 2024-05-20T22:08:00.002 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=settings t=2024-05-20T22:07:59.751152865Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-05-20T22:08:00.002 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=settings t=2024-05-20T22:07:59.751157599Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-05-20T22:08:00.002 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=settings t=2024-05-20T22:07:59.751162816Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-05-20T22:08:00.002 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=settings t=2024-05-20T22:07:59.751167636Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-05-20T22:08:00.003 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=settings t=2024-05-20T22:07:59.751172653Z level=info msg="Path Home" path=/usr/share/grafana 2024-05-20T22:08:00.003 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=settings t=2024-05-20T22:07:59.751177186Z level=info msg="Path Data" path=/var/lib/grafana 2024-05-20T22:08:00.003 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=settings t=2024-05-20T22:07:59.751181444Z level=info msg="Path Logs" path=/var/log/grafana 2024-05-20T22:08:00.003 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=settings t=2024-05-20T22:07:59.751186391Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-05-20T22:08:00.003 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=settings t=2024-05-20T22:07:59.751190973Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-05-20T22:08:00.003 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=settings t=2024-05-20T22:07:59.751195821Z level=info msg="App mode production" 2024-05-20T22:08:00.003 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=sqlstore t=2024-05-20T22:07:59.75126229Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-05-20T22:08:00.003 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=sqlstore t=2024-05-20T22:07:59.7512857Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-05-20T22:08:00.003 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:07:59.752316794Z level=info msg="Starting DB migrations" 2024-05-20T22:08:00.003 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:07:59.752401213Z level=info msg="Executing migration" id="create migration_log table" 2024-05-20T22:08:00.003 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:07:59.778106067Z level=info msg="Executing migration" id="create user table" 2024-05-20T22:08:00.003 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:07:59.803393738Z level=info msg="Executing migration" id="add unique index user.login" 2024-05-20T22:08:00.003 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:07:59.828499738Z level=info msg="Executing migration" id="add unique index user.email" 2024-05-20T22:08:00.003 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:07:59.870785289Z level=info msg="Executing migration" id="drop index UQE_user_login - v1" 2024-05-20T22:08:00.003 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:07:59.912834085Z level=info msg="Executing migration" id="drop index UQE_user_email - v1" 2024-05-20T22:08:00.004 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:07:59 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:07:59.963495205Z level=info msg="Executing migration" id="Rename table user to user_v1 - v1" 2024-05-20T22:08:00.004 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.005458993Z level=info msg="Executing migration" id="create user table v2" 2024-05-20T22:08:00.261 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.030796764Z level=info msg="Executing migration" id="create index UQE_user_login - v2" 2024-05-20T22:08:00.261 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.047615515Z level=info msg="Executing migration" id="create index UQE_user_email - v2" 2024-05-20T22:08:00.261 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.073027086Z level=info msg="Executing migration" id="copy data_source v1 to v2" 2024-05-20T22:08:00.261 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.098195943Z level=info msg="Executing migration" id="Drop old table user_v1" 2024-05-20T22:08:00.262 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.173512008Z level=info msg="Executing migration" id="Add column help_flags1 to user table" 2024-05-20T22:08:00.262 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.19881887Z level=info msg="Executing migration" id="Update user table charset" 2024-05-20T22:08:00.262 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.224061679Z level=info msg="Executing migration" id="Add last_seen_at column to user" 2024-05-20T22:08:00.262 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.265870639Z level=info msg="Executing migration" id="Add missing user data" 2024-05-20T22:08:00.522 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.291254879Z level=info msg="Executing migration" id="Add is_disabled column to user" 2024-05-20T22:08:00.522 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.316480593Z level=info msg="Executing migration" id="Add index user.login/user.email" 2024-05-20T22:08:00.523 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.341721371Z level=info msg="Executing migration" id="Add is_service_account column to user" 2024-05-20T22:08:00.523 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.366986497Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2024-05-20T22:08:00.523 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.392224927Z level=info msg="Executing migration" id="create temp user table v1-7" 2024-05-20T22:08:00.523 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.434295556Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v1-7" 2024-05-20T22:08:00.523 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.459511113Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v1-7" 2024-05-20T22:08:00.523 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.501614519Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v1-7" 2024-05-20T22:08:00.523 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.526849056Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v1-7" 2024-05-20T22:08:00.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.552020795Z level=info msg="Executing migration" id="Update temp_user table charset" 2024-05-20T22:08:00.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.577199318Z level=info msg="Executing migration" id="drop index IDX_temp_user_email - v1" 2024-05-20T22:08:00.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.602643793Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" 2024-05-20T22:08:00.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.627846452Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" 2024-05-20T22:08:00.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.669785867Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" 2024-05-20T22:08:00.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.695131391Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-05-20T22:08:00.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.72040723Z level=info msg="Executing migration" id="create temp_user v2" 2024-05-20T22:08:00.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.762402494Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" 2024-05-20T22:08:00.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.78743419Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" 2024-05-20T22:08:01.044 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.812966375Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" 2024-05-20T22:08:01.044 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.838437059Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" 2024-05-20T22:08:01.045 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.880455743Z level=info msg="Executing migration" id="copy temp_user v1 to v2" 2024-05-20T22:08:01.045 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.905651029Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" 2024-05-20T22:08:01.045 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.930911902Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" 2024-05-20T22:08:01.045 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.96455614Z level=info msg="Executing migration" id="create star table" 2024-05-20T22:08:01.045 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:00 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:00.998203711Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" 2024-05-20T22:08:01.045 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.015159497Z level=info msg="Executing migration" id="create org table v1" 2024-05-20T22:08:01.045 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.032092807Z level=info msg="Executing migration" id="create index UQE_org_name - v1" 2024-05-20T22:08:01.045 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.04897122Z level=info msg="Executing migration" id="create org_user table v1" 2024-05-20T22:08:01.297 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.091019694Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" 2024-05-20T22:08:01.297 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.116341582Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" 2024-05-20T22:08:01.297 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.15834671Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" 2024-05-20T22:08:01.297 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.183604753Z level=info msg="Executing migration" id="Update org table charset" 2024-05-20T22:08:01.297 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.225455542Z level=info msg="Executing migration" id="Update org_user table charset" 2024-05-20T22:08:01.297 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.250798807Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" 2024-05-20T22:08:01.297 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.276166188Z level=info msg="Executing migration" id="create dashboard table" 2024-05-20T22:08:01.297 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.301357522Z level=info msg="Executing migration" id="add index dashboard.account_id" 2024-05-20T22:08:01.549 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:01 smithi145 bash[23893]: cluster 2024-05-20T22:07:59.857724+0000 mgr.y (mgr.14592) 54 : cluster 0 pgmap v26: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:01.549 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.326631844Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" 2024-05-20T22:08:01.549 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.351951489Z level=info msg="Executing migration" id="create dashboard_tag table" 2024-05-20T22:08:01.549 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.393866654Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" 2024-05-20T22:08:01.549 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.435813942Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-05-20T22:08:01.549 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.461079401Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" 2024-05-20T22:08:01.549 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.503188004Z level=info msg="Executing migration" id="create dashboard v2" 2024-05-20T22:08:01.549 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.528203202Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" 2024-05-20T22:08:01.549 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.55360681Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" 2024-05-20T22:08:01.803 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.578752604Z level=info msg="Executing migration" id="copy dashboard v1 to v2" 2024-05-20T22:08:01.803 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.604045904Z level=info msg="Executing migration" id="drop table dashboard_v1" 2024-05-20T22:08:01.803 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.629295073Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" 2024-05-20T22:08:01.803 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.671229607Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" 2024-05-20T22:08:01.803 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.705088449Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" 2024-05-20T22:08:01.803 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.73053028Z level=info msg="Executing migration" id="Add column gnetId in dashboard" 2024-05-20T22:08:01.803 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.7557381Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" 2024-05-20T22:08:01.803 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.781046056Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" 2024-05-20T22:08:01.803 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.806351076Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" 2024-05-20T22:08:01.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:01 smithi050 bash[21866]: cluster 2024-05-20T22:07:59.857724+0000 mgr.y (mgr.14592) 54 : cluster 0 pgmap v26: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:01 smithi050 bash[28929]: cluster 2024-05-20T22:07:59.857724+0000 mgr.y (mgr.14592) 54 : cluster 0 pgmap v26: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:02.054 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.848367592Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" 2024-05-20T22:08:02.054 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.890249047Z level=info msg="Executing migration" id="Update dashboard table charset" 2024-05-20T22:08:02.054 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.915430995Z level=info msg="Executing migration" id="Update dashboard_tag table charset" 2024-05-20T22:08:02.054 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.949171327Z level=info msg="Executing migration" id="Add column folder_id in dashboard" 2024-05-20T22:08:02.054 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:01 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:01.991268814Z level=info msg="Executing migration" id="Add column isFolder in dashboard" 2024-05-20T22:08:02.055 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.033260215Z level=info msg="Executing migration" id="Add column has_acl in dashboard" 2024-05-20T22:08:02.055 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.058478897Z level=info msg="Executing migration" id="Add column uid in dashboard" 2024-05-20T22:08:02.331 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.083769093Z level=info msg="Executing migration" id="Update uid column values in dashboard" 2024-05-20T22:08:02.331 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.109029613Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" 2024-05-20T22:08:02.331 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.15104851Z level=info msg="Executing migration" id="Remove unique index org_id_slug" 2024-05-20T22:08:02.332 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.176319966Z level=info msg="Executing migration" id="Update dashboard title length" 2024-05-20T22:08:02.332 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.218261968Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" 2024-05-20T22:08:02.332 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.243625197Z level=info msg="Executing migration" id="create dashboard_provisioning" 2024-05-20T22:08:02.332 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.285501024Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-05-20T22:08:02.332 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.302523927Z level=info msg="Executing migration" id="create dashboard_provisioning v2" 2024-05-20T22:08:02.601 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.336212308Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-05-20T22:08:02.601 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.361253076Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-05-20T22:08:02.601 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.386571896Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" 2024-05-20T22:08:02.602 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.42869381Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" 2024-05-20T22:08:02.602 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.45390991Z level=info msg="Executing migration" id="Add check_sum column" 2024-05-20T22:08:02.602 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.495994928Z level=info msg="Executing migration" id="Add index for dashboard_title" 2024-05-20T22:08:02.602 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.521278937Z level=info msg="Executing migration" id="delete tags for deleted dashboards" 2024-05-20T22:08:02.602 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.546523523Z level=info msg="Executing migration" id="delete stars for deleted dashboards" 2024-05-20T22:08:02.602 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.58036092Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" 2024-05-20T22:08:02.602 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.605635642Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-05-20T22:08:02.870 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.647616831Z level=info msg="Executing migration" id="create data_source table" 2024-05-20T22:08:02.870 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.689604358Z level=info msg="Executing migration" id="add index data_source.account_id" 2024-05-20T22:08:02.870 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.714951393Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" 2024-05-20T22:08:02.871 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.74011949Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" 2024-05-20T22:08:02.871 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.765323483Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" 2024-05-20T22:08:02.871 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.807381194Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" 2024-05-20T22:08:02.871 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.832668489Z level=info msg="Executing migration" id="create data_source table v2" 2024-05-20T22:08:02.871 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.874765647Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" 2024-05-20T22:08:03.104 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:08:03.131 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.899982216Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" 2024-05-20T22:08:03.131 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.941966827Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" 2024-05-20T22:08:03.131 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.967249056Z level=info msg="Executing migration" id="Add column with_credentials" 2024-05-20T22:08:03.131 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:02 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:02.98412666Z level=info msg="Executing migration" id="Add secure json data column" 2024-05-20T22:08:03.131 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.017803459Z level=info msg="Executing migration" id="Update data_source table charset" 2024-05-20T22:08:03.131 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.034748888Z level=info msg="Executing migration" id="Update initial version to 1" 2024-05-20T22:08:03.132 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.051714141Z level=info msg="Executing migration" id="Add read_only data column" 2024-05-20T22:08:03.132 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.068584851Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" 2024-05-20T22:08:03.132 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.093771232Z level=info msg="Executing migration" id="Update json_data with nulls" 2024-05-20T22:08:03.132 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.135800792Z level=info msg="Executing migration" id="Add uid column" 2024-05-20T22:08:03.385 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.17786294Z level=info msg="Executing migration" id="Update uid value" 2024-05-20T22:08:03.386 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.203038152Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" 2024-05-20T22:08:03.386 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.220015476Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" 2024-05-20T22:08:03.386 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.245256123Z level=info msg="Executing migration" id="create api_key table" 2024-05-20T22:08:03.386 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.27063472Z level=info msg="Executing migration" id="add index api_key.account_id" 2024-05-20T22:08:03.386 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.295875983Z level=info msg="Executing migration" id="add index api_key.key" 2024-05-20T22:08:03.386 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.337844315Z level=info msg="Executing migration" id="add index api_key.account_id_name" 2024-05-20T22:08:03.386 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.363165494Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" 2024-05-20T22:08:03.386 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.388336908Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" 2024-05-20T22:08:03.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:03 smithi145 bash[23893]: cluster 2024-05-20T22:08:01.858439+0000 mgr.y (mgr.14592) 55 : cluster 0 pgmap v27: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:03.640 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.439021681Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" 2024-05-20T22:08:03.640 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.46430615Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" 2024-05-20T22:08:03.640 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.506450273Z level=info msg="Executing migration" id="create api_key table v2" 2024-05-20T22:08:03.640 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.53165754Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" 2024-05-20T22:08:03.640 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.556941413Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" 2024-05-20T22:08:03.640 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.582108863Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" 2024-05-20T22:08:03.640 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.624068844Z level=info msg="Executing migration" id="copy api_key v1 to v2" 2024-05-20T22:08:03.913 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.666000333Z level=info msg="Executing migration" id="Drop old table api_key_v1" 2024-05-20T22:08:03.913 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.733135038Z level=info msg="Executing migration" id="Update api_key table charset" 2024-05-20T22:08:03.914 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.758391107Z level=info msg="Executing migration" id="Add expires to api_key table" 2024-05-20T22:08:03.914 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.7836403Z level=info msg="Executing migration" id="Add service account foreign key" 2024-05-20T22:08:03.914 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.808884923Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-05-20T22:08:03.914 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.850833038Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-05-20T22:08:03.914 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.892854665Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-05-20T22:08:03.914 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.918112301Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" 2024-05-20T22:08:03.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:03 smithi050 bash[21866]: cluster 2024-05-20T22:08:01.858439+0000 mgr.y (mgr.14592) 55 : cluster 0 pgmap v27: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:03.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:03 smithi050 bash[28929]: cluster 2024-05-20T22:08:01.858439+0000 mgr.y (mgr.14592) 55 : cluster 0 pgmap v27: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:04.166 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:03 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:03.976780223Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" 2024-05-20T22:08:04.166 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.018958929Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" 2024-05-20T22:08:04.166 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.044123906Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_key - v5" 2024-05-20T22:08:04.166 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.069305296Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-05-20T22:08:04.166 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.094713362Z level=info msg="Executing migration" id="create index IDX_dashboard_snapshot_user_id - v5" 2024-05-20T22:08:04.166 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.11999298Z level=info msg="Executing migration" id="alter dashboard_snapshot to mediumtext v2" 2024-05-20T22:08:04.166 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.136861991Z level=info msg="Executing migration" id="Update dashboard_snapshot table charset" 2024-05-20T22:08:04.166 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.170482632Z level=info msg="Executing migration" id="Add column external_delete_url to dashboard_snapshots table" 2024-05-20T22:08:04.434 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.187426519Z level=info msg="Executing migration" id="Add encrypted dashboard json column" 2024-05-20T22:08:04.434 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.246155652Z level=info msg="Executing migration" id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-05-20T22:08:04.435 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.263168715Z level=info msg="Executing migration" id="create quota table v1" 2024-05-20T22:08:04.435 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.313775476Z level=info msg="Executing migration" id="create index UQE_quota_org_id_user_id_target - v1" 2024-05-20T22:08:04.435 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.355846107Z level=info msg="Executing migration" id="Update quota table charset" 2024-05-20T22:08:04.435 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.397748018Z level=info msg="Executing migration" id="create plugin_setting table" 2024-05-20T22:08:04.687 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:04 smithi145 bash[23893]: audit 2024-05-20T22:08:03.666729+0000 mon.a (mon.0) 872 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:04.687 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:04 smithi145 bash[23893]: audit 2024-05-20T22:08:03.672002+0000 mon.a (mon.0) 873 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:04.687 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:04 smithi145 bash[23893]: cluster 2024-05-20T22:08:03.859249+0000 mgr.y (mgr.14592) 56 : cluster 0 pgmap v28: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:04.687 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.439605116Z level=info msg="Executing migration" id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-05-20T22:08:04.688 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.464981236Z level=info msg="Executing migration" id="Add column plugin_version to plugin_settings" 2024-05-20T22:08:04.688 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.507044676Z level=info msg="Executing migration" id="Update plugin_setting table charset" 2024-05-20T22:08:04.688 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.532325126Z level=info msg="Executing migration" id="create session table" 2024-05-20T22:08:04.688 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.557535075Z level=info msg="Executing migration" id="Drop old table playlist table" 2024-05-20T22:08:04.688 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.599564552Z level=info msg="Executing migration" id="Drop old table playlist_item table" 2024-05-20T22:08:04.688 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.624743452Z level=info msg="Executing migration" id="create playlist table v2" 2024-05-20T22:08:04.688 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.650063599Z level=info msg="Executing migration" id="create playlist item table v2" 2024-05-20T22:08:04.688 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.692007386Z level=info msg="Executing migration" id="Update playlist table charset" 2024-05-20T22:08:04.962 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:04 smithi050 bash[21866]: audit 2024-05-20T22:08:03.666729+0000 mon.a (mon.0) 872 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:04.962 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:04 smithi050 bash[21866]: audit 2024-05-20T22:08:03.672002+0000 mon.a (mon.0) 873 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:04.962 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:04 smithi050 bash[21866]: cluster 2024-05-20T22:08:03.859249+0000 mgr.y (mgr.14592) 56 : cluster 0 pgmap v28: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:04.962 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:04 smithi050 bash[28929]: audit 2024-05-20T22:08:03.666729+0000 mon.a (mon.0) 872 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:04.962 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:04 smithi050 bash[28929]: audit 2024-05-20T22:08:03.672002+0000 mon.a (mon.0) 873 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:04.962 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:04 smithi050 bash[28929]: cluster 2024-05-20T22:08:03.859249+0000 mgr.y (mgr.14592) 56 : cluster 0 pgmap v28: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:04.964 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.734132645Z level=info msg="Executing migration" id="Update playlist_item table charset" 2024-05-20T22:08:04.964 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.759410312Z level=info msg="Executing migration" id="drop preferences table v2" 2024-05-20T22:08:04.965 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.784583099Z level=info msg="Executing migration" id="drop preferences table v3" 2024-05-20T22:08:04.965 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.809866056Z level=info msg="Executing migration" id="create preferences table v3" 2024-05-20T22:08:04.965 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.835109861Z level=info msg="Executing migration" id="Update preferences table charset" 2024-05-20T22:08:04.965 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.877231609Z level=info msg="Executing migration" id="Add column team_id in preferences" 2024-05-20T22:08:04.965 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.894132361Z level=info msg="Executing migration" id="Update team_id column values in preferences" 2024-05-20T22:08:04.965 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.928032308Z level=info msg="Executing migration" id="Add column week_start in preferences" 2024-05-20T22:08:04.965 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.969898274Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-05-20T22:08:05.226 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:04 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:04.995288719Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-05-20T22:08:05.226 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.02053587Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-05-20T22:08:05.226 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.062699513Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-05-20T22:08:05.226 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.121488643Z level=info msg="Executing migration" id="create alert table v1" 2024-05-20T22:08:05.226 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.163870248Z level=info msg="Executing migration" id="add index alert org_id & id " 2024-05-20T22:08:05.226 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.205883682Z level=info msg="Executing migration" id="add index alert state" 2024-05-20T22:08:05.226 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.231130018Z level=info msg="Executing migration" id="add index alert dashboard_id" 2024-05-20T22:08:05.496 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.273403385Z level=info msg="Executing migration" id="Create alert_rule_tag table v1" 2024-05-20T22:08:05.496 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.298676042Z level=info msg="Executing migration" id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-05-20T22:08:05.496 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.340548601Z level=info msg="Executing migration" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-05-20T22:08:05.496 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.365743113Z level=info msg="Executing migration" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-05-20T22:08:05.496 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.391033303Z level=info msg="Executing migration" id="Create alert_rule_tag table v2" 2024-05-20T22:08:05.496 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.432982733Z level=info msg="Executing migration" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-05-20T22:08:05.496 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.475003962Z level=info msg="Executing migration" id="copy alert_rule_tag v1 to v2" 2024-05-20T22:08:05.496 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.500396972Z level=info msg="Executing migration" id="drop table alert_rule_tag_v1" 2024-05-20T22:08:05.756 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.52553665Z level=info msg="Executing migration" id="create alert_notification table v1" 2024-05-20T22:08:05.757 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.550898041Z level=info msg="Executing migration" id="Add column is_default" 2024-05-20T22:08:05.757 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.592857045Z level=info msg="Executing migration" id="Add column frequency" 2024-05-20T22:08:05.757 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.618080678Z level=info msg="Executing migration" id="Add column send_reminder" 2024-05-20T22:08:05.757 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.643493157Z level=info msg="Executing migration" id="Add column disable_resolve_message" 2024-05-20T22:08:05.757 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.685466087Z level=info msg="Executing migration" id="add index alert_notification org_id & name" 2024-05-20T22:08:05.757 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.710796766Z level=info msg="Executing migration" id="Update alert table charset" 2024-05-20T22:08:05.757 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.735997102Z level=info msg="Executing migration" id="Update alert_notification table charset" 2024-05-20T22:08:05.757 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.761232779Z level=info msg="Executing migration" id="create notification_journal table v1" 2024-05-20T22:08:05.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327d9a9640 1 -- 172.21.15.50:0/627901661 >> v1:172.21.15.50:6790/0 conn(0x7f3278102840 legacy=0x7f3278102c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:05.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327d9a9640 1 -- 172.21.15.50:0/627901661 shutdown_connections 2024-05-20T22:08:05.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327d9a9640 1 -- 172.21.15.50:0/627901661 >> 172.21.15.50:0/627901661 conn(0x7f32780fc0b0 msgr2=0x7f32780fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:05.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327d9a9640 1 -- 172.21.15.50:0/627901661 shutdown_connections 2024-05-20T22:08:05.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327d9a9640 1 -- 172.21.15.50:0/627901661 wait complete. 2024-05-20T22:08:05.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327d9a9640 1 Processor -- start 2024-05-20T22:08:05.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327d9a9640 1 -- start start 2024-05-20T22:08:05.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327d9a9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f32781a6680 con 0x7f3278102840 2024-05-20T22:08:05.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327d9a9640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f32781a78c0 con 0x7f327810e160 2024-05-20T22:08:05.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327d9a9640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f32781a8b00 con 0x7f327810a650 2024-05-20T22:08:05.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f3276ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3278102840 0x7f3278109da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56634/0 (socket says 172.21.15.50:56634) 2024-05-20T22:08:05.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f3276ffd640 1 -- 172.21.15.50:0/2241612884 learned_addr learned my addr 172.21.15.50:0/2241612884 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:08:05.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2497725454 0 0) 0x7f32781a6680 con 0x7f3278102840 2024-05-20T22:08:05.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3264003160 con 0x7f3278102840 2024-05-20T22:08:05.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1056260109 0 0) 0x7f32781a8b00 con 0x7f327810a650 2024-05-20T22:08:05.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32781a6680 con 0x7f327810a650 2024-05-20T22:08:05.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3306319658 0 0) 0x7f32781a78c0 con 0x7f327810e160 2024-05-20T22:08:05.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32781a8b00 con 0x7f327810e160 2024-05-20T22:08:05.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2749189471 0 0) 0x7f3264003160 con 0x7f3278102840 2024-05-20T22:08:05.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f32781a78c0 con 0x7f3278102840 2024-05-20T22:08:05.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f32600043e0 con 0x7f3278102840 2024-05-20T22:08:05.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2605123928 0 0) 0x7f32781a6680 con 0x7f327810a650 2024-05-20T22:08:05.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3264003160 con 0x7f327810a650 2024-05-20T22:08:05.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f3268001230 con 0x7f327810a650 2024-05-20T22:08:05.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1424981603 0 0) 0x7f32781a78c0 con 0x7f3278102840 2024-05-20T22:08:05.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 >> v1:172.21.15.50:6790/0 conn(0x7f327810a650 legacy=0x7f32781a1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:05.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 >> v1:172.21.15.145:6789/0 conn(0x7f327810e160 legacy=0x7f32781a4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:05.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32781a9d40 con 0x7f3278102840 2024-05-20T22:08:05.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327d9a9640 1 -- 172.21.15.50:0/2241612884 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f32781a8d30 con 0x7f3278102840 2024-05-20T22:08:05.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327d9a9640 1 -- 172.21.15.50:0/2241612884 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f32781a91f0 con 0x7f3278102840 2024-05-20T22:08:05.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f3260001a40 con 0x7f3278102840 2024-05-20T22:08:05.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.931+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f3260004e30 con 0x7f3278102840 2024-05-20T22:08:05.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.935+0000 7f327d9a9640 1 -- 172.21.15.50:0/2241612884 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3258005080 con 0x7f3278102840 2024-05-20T22:08:05.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.935+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f32600050b0 con 0x7f3278102840 2024-05-20T22:08:05.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.935+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(72..72 src has 1..72) ==== 6172+0+0 (unknown 1924863387 0 0) 0x7f3260089730 con 0x7f3278102840 2024-05-20T22:08:05.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:05.939+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f3260056fd0 con 0x7f3278102840 2024-05-20T22:08:06.008 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.791043172Z level=info msg="Executing migration" id="add index notification_journal org_id & alert_id & notifier_id" 2024-05-20T22:08:06.008 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.820137621Z level=info msg="Executing migration" id="drop alert_notification_journal" 2024-05-20T22:08:06.009 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.845296078Z level=info msg="Executing migration" id="create alert_notification_state table v1" 2024-05-20T22:08:06.009 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.887281163Z level=info msg="Executing migration" id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-05-20T22:08:06.009 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.929247055Z level=info msg="Executing migration" id="Add for to alert table" 2024-05-20T22:08:06.009 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:05 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:05.97129138Z level=info msg="Executing migration" id="Add column uid in alert_notification" 2024-05-20T22:08:06.009 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.013254858Z level=info msg="Executing migration" id="Update uid column values in alert_notification" 2024-05-20T22:08:06.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:06.135+0000 7f327d9a9640 1 -- 172.21.15.50:0/2241612884 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3258005370 con 0x7f3278102840 2024-05-20T22:08:06.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:06.135+0000 7f327c9a7640 1 -- 172.21.15.50:0/2241612884 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+20907 (unknown 1686360691 0 301376064) 0x7f326005ac80 con 0x7f3278102840 2024-05-20T22:08:06.133 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-20T22:08:06.134 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":72,"fsid":"9a9abba0-16f3-11ef-bc9a-c7b262605968","created":"2024-05-20T21:56:19.800804+0000","modified":"2024-05-20T22:07:13.813858+0000","last_up_change":"2024-05-20T22:05:42.257017+0000","last_in_change":"2024-05-20T22:05:17.807939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T22:01:30.033740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-05-20T22:06:21.770941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.log","create_time":"2024-05-20T22:06:23.509831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"datapool","create_time":"2024-05-20T22:06:25.031250+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-05-20T22:06:25.522299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-05-20T22:06:27.955030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e24659f-5dce-416d-83fd-beff6359fc45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6801","nonce":4039291270}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6802","nonce":4039291270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6804","nonce":4039291270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6803","nonce":4039291270}]},"public_addr":"172.21.15.50:6801/4039291270","cluster_addr":"172.21.15.50:6802/4039291270","heartbeat_back_addr":"172.21.15.50:6804/4039291270","heartbeat_front_addr":"172.21.15.50:6803/4039291270","state":["exists","up"]},{"osd":1,"uuid":"507cd562-6be9-4469-bafe-17f52cd04ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6805","nonce":4214903941}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6806","nonce":4214903941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6808","nonce":4214903941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6807","nonce":4214903941}]},"public_addr":"172.21.15.50:6805/4214903941","cluster_addr":"172.21.15.50:6806/4214903941","heartbeat_back_addr":"172.21.15.50:6808/4214903941","heartbeat_front_addr":"172.21.15.50:6807/4214903941","state":["exists","up"]},{"osd":2,"uuid":"a21d4e6b-3116-4dcd-a4fe-a224f2082926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6809","nonce":3675120581}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6810","nonce":3675120581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6812","nonce":3675120581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6811","nonce":3675120581}]},"public_addr":"172.21.15.50:6809/3675120581","cluster_addr":"172.21.15.50:6810/3675120581","heartbeat_back_addr":"172.21.15.50:6812/3675120581","heartbeat_front_addr":"172.21.15.50:6811/3675120581","state":["exists","up"]},{"osd":3,"uuid":"6e60bb64-706c-438b-8edf-49c2709374c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6813","nonce":3714877290}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6814","nonce":3714877290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6816","nonce":3714877290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.50:6815","nonce":3714877290}]},"public_addr":"172.21.15.50:6813/3714877290","cluster_addr":"172.21.15.50:6814/3714877290","heartbeat_back_addr":"172.21.15.50:6816/3714877290","heartbeat_front_addr":"172.21.15.50:6815/3714877290","state":["exists","up"]},{"osd":4,"uuid":"369f2c71-4164-48c1-aaa5-5cd9a5644309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6800","nonce":2241357489}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6801","nonce":2241357489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6803","nonce":2241357489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6802","nonce":2241357489}]},"public_addr":"172.21.15.145:6800/2241357489","cluster_addr":"172.21.15.145:6801/2241357489","heartbeat_back_addr":"172.21.15.145:6803/2241357489","heartbeat_front_addr":"172.21.15.145:6802/2241357489","state":["exists","up"]},{"osd":5,"uuid":"706eb62f-93b9-4465-a352-cade0e490194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6804","nonce":1463480843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6805","nonce":1463480843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6807","nonce":1463480843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6806","nonce":1463480843}]},"public_addr":"172.21.15.145:6804/1463480843","cluster_addr":"172.21.15.145:6805/1463480843","heartbeat_back_addr":"172.21.15.145:6807/1463480843","heartbeat_front_addr":"172.21.15.145:6806/1463480843","state":["exists","up"]},{"osd":6,"uuid":"cb87446a-56f6-4a73-813b-ce70360ae5f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6808","nonce":856530538}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6809","nonce":856530538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6811","nonce":856530538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6810","nonce":856530538}]},"public_addr":"172.21.15.145:6808/856530538","cluster_addr":"172.21.15.145:6809/856530538","heartbeat_back_addr":"172.21.15.145:6811/856530538","heartbeat_front_addr":"172.21.15.145:6810/856530538","state":["exists","up"]},{"osd":7,"uuid":"a29bd67b-c55e-423c-b251-0ba4b656544a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6812","nonce":2864002573}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6813","nonce":2864002573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6815","nonce":2864002573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.145:6814","nonce":2864002573}]},"public_addr":"172.21.15.145:6812/2864002573","cluster_addr":"172.21.15.145:6813/2864002573","heartbeat_back_addr":"172.21.15.145:6815/2864002573","heartbeat_front_addr":"172.21.15.145:6814/2864002573","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T21:59:41.084272+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:00:34.330079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:01:27.148884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:02:20.988321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:03:10.755672+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:04:00.708157+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:04:50.388089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T22:05:41.164844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:0/299170294":"2024-05-21T22:07:13.813778+0000","172.21.15.50:6800/2047033350":"2024-05-21T21:56:45.401749+0000","172.21.15.50:0/438442029":"2024-05-21T21:56:45.401749+0000","172.21.15.50:0/2072209505":"2024-05-21T21:56:45.401749+0000","172.21.15.50:0/3248870305":"2024-05-21T21:56:45.401749+0000","172.21.15.50:0/4166168321":"2024-05-21T22:07:13.813778+0000","172.21.15.50:0/3504814165":"2024-05-21T21:57:17.389846+0000","172.21.15.50:0/376844583":"2024-05-21T22:07:13.813778+0000","172.21.15.50:6800/2944911247":"2024-05-21T22:07:13.813778+0000","172.21.15.50:0/1181319036":"2024-05-21T21:57:17.389846+0000","172.21.15.50:0/3225566634":"2024-05-21T22:07:13.813778+0000","172.21.15.50:6800/3032841639":"2024-05-21T21:57:17.389846+0000","172.21.15.50:0/2157528765":"2024-05-21T21:57:17.389846+0000","172.21.15.50:0/2176782899":"2024-05-21T22:07:13.813778+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T22:08:06.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:06.139+0000 7f327d9a9640 1 -- 172.21.15.50:0/2241612884 >> v1:172.21.15.50:6800/3332714287 conn(0x7f326406ede0 legacy=0x7f32640712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:06.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:06.139+0000 7f327d9a9640 1 -- 172.21.15.50:0/2241612884 >> v1:172.21.15.50:6789/0 conn(0x7f3278102840 legacy=0x7f3278109da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:06.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:06.139+0000 7f327d9a9640 1 -- 172.21.15.50:0/2241612884 shutdown_connections 2024-05-20T22:08:06.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:06.139+0000 7f327d9a9640 1 -- 172.21.15.50:0/2241612884 >> 172.21.15.50:0/2241612884 conn(0x7f32780fc0b0 msgr2=0x7f32780fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:06.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:06.139+0000 7f327d9a9640 1 -- 172.21.15.50:0/2241612884 shutdown_connections 2024-05-20T22:08:06.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:06.139+0000 7f327d9a9640 1 -- 172.21.15.50:0/2241612884 wait complete. 2024-05-20T22:08:06.295 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.038502284Z level=info msg="Executing migration" id="Add unique index alert_notification_org_id_uid" 2024-05-20T22:08:06.295 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.064047568Z level=info msg="Executing migration" id="Remove unique index org_id_name" 2024-05-20T22:08:06.295 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.106058272Z level=info msg="Executing migration" id="Add column secure_settings in alert_notification" 2024-05-20T22:08:06.295 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.131369092Z level=info msg="Executing migration" id="alter alert.settings to mediumtext" 2024-05-20T22:08:06.295 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.156518406Z level=info msg="Executing migration" id="Add non-unique index alert_notification_state_alert_id" 2024-05-20T22:08:06.295 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.181819699Z level=info msg="Executing migration" id="Add non-unique index alert_rule_tag_alert_id" 2024-05-20T22:08:06.295 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.207169168Z level=info msg="Executing migration" id="Drop old annotation table v4" 2024-05-20T22:08:06.295 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.232267385Z level=info msg="Executing migration" id="create annotation table v5" 2024-05-20T22:08:06.296 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.257571259Z level=info msg="Executing migration" id="add index annotation 0 v3" 2024-05-20T22:08:06.296 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.299566353Z level=info msg="Executing migration" id="add index annotation 1 v3" 2024-05-20T22:08:06.556 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:06 smithi145 bash[23893]: audit 2024-05-20T22:08:05.406749+0000 mon.a (mon.0) 874 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:06.556 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:06 smithi145 bash[23893]: audit 2024-05-20T22:08:05.416690+0000 mon.a (mon.0) 875 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:06.556 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:06 smithi145 bash[23893]: audit 2024-05-20T22:08:05.418857+0000 mon.a (mon.0) 876 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:08:06.556 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:06 smithi145 bash[23893]: audit 2024-05-20T22:08:05.420848+0000 mon.a (mon.0) 877 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:08:06.556 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:06 smithi145 bash[23893]: audit 2024-05-20T22:08:05.431055+0000 mon.a (mon.0) 878 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:06.556 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:06 smithi145 bash[23893]: cephadm 2024-05-20T22:08:05.497218+0000 mgr.y (mgr.14592) 57 : cephadm 1 Reconfiguring alertmanager.a (dependencies changed)... 2024-05-20T22:08:06.556 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:06 smithi145 bash[23893]: cephadm 2024-05-20T22:08:05.505123+0000 mgr.y (mgr.14592) 58 : cephadm 1 Reconfiguring daemon alertmanager.a on smithi050 2024-05-20T22:08:06.556 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:06 smithi145 bash[23893]: audit 2024-05-20T22:08:06.138043+0000 mon.a (mon.0) 879 : audit 0 from='client.? v1:172.21.15.50:0/2241612884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T22:08:06.557 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.32489233Z level=info msg="Executing migration" id="add index annotation 2 v3" 2024-05-20T22:08:06.557 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.366865297Z level=info msg="Executing migration" id="add index annotation 3 v3" 2024-05-20T22:08:06.557 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.392182594Z level=info msg="Executing migration" id="add index annotation 4 v3" 2024-05-20T22:08:06.557 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.434198745Z level=info msg="Executing migration" id="Update annotation table charset" 2024-05-20T22:08:06.557 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.459488458Z level=info msg="Executing migration" id="Add column region_id to annotation table" 2024-05-20T22:08:06.557 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.484703551Z level=info msg="Executing migration" id="Drop category_id index" 2024-05-20T22:08:06.557 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.509980978Z level=info msg="Executing migration" id="Add column tags to annotation table" 2024-05-20T22:08:06.557 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.535176898Z level=info msg="Executing migration" id="Create annotation_tag table v2" 2024-05-20T22:08:06.557 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.56050737Z level=info msg="Executing migration" id="Add unique index annotation_tag.annotation_id_tag_id" 2024-05-20T22:08:06.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:06 smithi050 bash[28929]: audit 2024-05-20T22:08:05.406749+0000 mon.a (mon.0) 874 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:06.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:06 smithi050 bash[28929]: audit 2024-05-20T22:08:05.416690+0000 mon.a (mon.0) 875 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:06.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:06 smithi050 bash[28929]: audit 2024-05-20T22:08:05.418857+0000 mon.a (mon.0) 876 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:08:06.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:06 smithi050 bash[28929]: audit 2024-05-20T22:08:05.420848+0000 mon.a (mon.0) 877 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:08:06.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:06 smithi050 bash[28929]: audit 2024-05-20T22:08:05.431055+0000 mon.a (mon.0) 878 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:06.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:06 smithi050 bash[28929]: cephadm 2024-05-20T22:08:05.497218+0000 mgr.y (mgr.14592) 57 : cephadm 1 Reconfiguring alertmanager.a (dependencies changed)... 2024-05-20T22:08:06.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:06 smithi050 bash[28929]: cephadm 2024-05-20T22:08:05.505123+0000 mgr.y (mgr.14592) 58 : cephadm 1 Reconfiguring daemon alertmanager.a on smithi050 2024-05-20T22:08:06.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:06 smithi050 bash[28929]: audit 2024-05-20T22:08:06.138043+0000 mon.a (mon.0) 879 : audit 0 from='client.? v1:172.21.15.50:0/2241612884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T22:08:06.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:06 smithi050 bash[21866]: audit 2024-05-20T22:08:05.406749+0000 mon.a (mon.0) 874 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:06.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:06 smithi050 bash[21866]: audit 2024-05-20T22:08:05.416690+0000 mon.a (mon.0) 875 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:06.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:06 smithi050 bash[21866]: audit 2024-05-20T22:08:05.418857+0000 mon.a (mon.0) 876 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:08:06.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:06 smithi050 bash[21866]: audit 2024-05-20T22:08:05.420848+0000 mon.a (mon.0) 877 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:08:06.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:06 smithi050 bash[21866]: audit 2024-05-20T22:08:05.431055+0000 mon.a (mon.0) 878 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:06.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:06 smithi050 bash[21866]: cephadm 2024-05-20T22:08:05.497218+0000 mgr.y (mgr.14592) 57 : cephadm 1 Reconfiguring alertmanager.a (dependencies changed)... 2024-05-20T22:08:06.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:06 smithi050 bash[21866]: cephadm 2024-05-20T22:08:05.505123+0000 mgr.y (mgr.14592) 58 : cephadm 1 Reconfiguring daemon alertmanager.a on smithi050 2024-05-20T22:08:06.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:06 smithi050 bash[21866]: audit 2024-05-20T22:08:06.138043+0000 mon.a (mon.0) 879 : audit 0 from='client.? v1:172.21.15.50:0/2241612884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T22:08:06.825 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.585691051Z level=info msg="Executing migration" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-05-20T22:08:06.825 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.627632786Z level=info msg="Executing migration" id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-05-20T22:08:06.825 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.661362615Z level=info msg="Executing migration" id="Create annotation_tag table v3" 2024-05-20T22:08:06.826 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.686596261Z level=info msg="Executing migration" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-05-20T22:08:06.826 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.711941974Z level=info msg="Executing migration" id="copy annotation_tag v2 to v3" 2024-05-20T22:08:06.826 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.737214739Z level=info msg="Executing migration" id="drop table annotation_tag_v2" 2024-05-20T22:08:06.826 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.754154413Z level=info msg="Executing migration" id="Update alert annotations and set TEXT to empty" 2024-05-20T22:08:06.826 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.779401723Z level=info msg="Executing migration" id="Add created time to annotation table" 2024-05-20T22:08:06.826 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.804690356Z level=info msg="Executing migration" id="Add updated time to annotation table" 2024-05-20T22:08:07.094 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.82990951Z level=info msg="Executing migration" id="Add index for created in annotation table" 2024-05-20T22:08:07.095 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.871895594Z level=info msg="Executing migration" id="Add index for updated in annotation table" 2024-05-20T22:08:07.095 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.914131497Z level=info msg="Executing migration" id="Convert existing annotations from seconds to milliseconds" 2024-05-20T22:08:07.095 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.9393816Z level=info msg="Executing migration" id="Add epoch_end column" 2024-05-20T22:08:07.095 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.964585994Z level=info msg="Executing migration" id="Add index for epoch_end" 2024-05-20T22:08:07.095 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:06 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:06.989858573Z level=info msg="Executing migration" id="Make epoch_end the same as epoch" 2024-05-20T22:08:07.095 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.031828649Z level=info msg="Executing migration" id="Move region to single row" 2024-05-20T22:08:07.095 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.057204318Z level=info msg="Executing migration" id="Remove index org_id_epoch from annotation table" 2024-05-20T22:08:07.095 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.099140353Z level=info msg="Executing migration" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-05-20T22:08:07.355 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.141170605Z level=info msg="Executing migration" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-05-20T22:08:07.355 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.166433505Z level=info msg="Executing migration" id="Add index for org_id_epoch_end_epoch on annotation table" 2024-05-20T22:08:07.355 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.191715547Z level=info msg="Executing migration" id="Remove index org_id_epoch_epoch_end from annotation table" 2024-05-20T22:08:07.355 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.216966194Z level=info msg="Executing migration" id="Add index for alert_id on annotation table" 2024-05-20T22:08:07.355 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.242161895Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-05-20T22:08:07.355 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.301507549Z level=info msg="Executing migration" id="create test_data table" 2024-05-20T22:08:07.355 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.334496668Z level=info msg="Executing migration" id="create dashboard_version table v1" 2024-05-20T22:08:07.378 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-20T22:08:07.378 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-20T22:08:07.379 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-20T22:08:07.379 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-20T22:08:07.379 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-20T22:08:07.380 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-20T22:08:07.380 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-20T22:08:07.381 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-20T22:08:07.632 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:07 smithi145 bash[23893]: cluster 2024-05-20T22:08:05.860052+0000 mgr.y (mgr.14592) 59 : cluster 0 pgmap v29: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:07.632 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:08:07.633 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.359695672Z level=info msg="Executing migration" id="add index dashboard_version.dashboard_id" 2024-05-20T22:08:07.633 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.401666137Z level=info msg="Executing migration" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-05-20T22:08:07.633 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.44358274Z level=info msg="Executing migration" id="Set dashboard version to 1 where 0" 2024-05-20T22:08:07.633 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.485696471Z level=info msg="Executing migration" id="save existing dashboard data in dashboard_version table v1" 2024-05-20T22:08:07.633 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.527709669Z level=info msg="Executing migration" id="alter dashboard_version.data to mediumtext v1" 2024-05-20T22:08:07.633 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.553017615Z level=info msg="Executing migration" id="create team table" 2024-05-20T22:08:07.633 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.595056463Z level=info msg="Executing migration" id="add index team.org_id" 2024-05-20T22:08:07.633 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.637051818Z level=info msg="Executing migration" id="add unique index team_org_id_name" 2024-05-20T22:08:07.665 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:07 smithi050 bash[21866]: cluster 2024-05-20T22:08:05.860052+0000 mgr.y (mgr.14592) 59 : cluster 0 pgmap v29: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:07.665 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:07 smithi050 bash[28929]: cluster 2024-05-20T22:08:05.860052+0000 mgr.y (mgr.14592) 59 : cluster 0 pgmap v29: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:07.890 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.679011587Z level=info msg="Executing migration" id="create team member table" 2024-05-20T22:08:07.890 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.695937371Z level=info msg="Executing migration" id="add index team_member.org_id" 2024-05-20T22:08:07.890 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.712843758Z level=info msg="Executing migration" id="add unique index team_member_org_id_team_id_user_id" 2024-05-20T22:08:07.890 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.729681846Z level=info msg="Executing migration" id="add index team_member.team_id" 2024-05-20T22:08:07.890 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.746615672Z level=info msg="Executing migration" id="Add column email to team table" 2024-05-20T22:08:07.890 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.763548416Z level=info msg="Executing migration" id="Add column external to team_member table" 2024-05-20T22:08:07.891 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.780390947Z level=info msg="Executing migration" id="Add column permission to team_member table" 2024-05-20T22:08:07.891 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.814308467Z level=info msg="Executing migration" id="create dashboard acl table" 2024-05-20T22:08:07.891 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.839574729Z level=info msg="Executing migration" id="add index dashboard_acl_dashboard_id" 2024-05-20T22:08:07.891 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.881593578Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_user_id" 2024-05-20T22:08:08.188 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.923618223Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_team_id" 2024-05-20T22:08:08.188 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.948820286Z level=info msg="Executing migration" id="add index dashboard_acl_user_id" 2024-05-20T22:08:08.188 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:07 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:07.974087326Z level=info msg="Executing migration" id="add index dashboard_acl_team_id" 2024-05-20T22:08:08.188 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.016013049Z level=info msg="Executing migration" id="add index dashboard_acl_org_id_role" 2024-05-20T22:08:08.188 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.041316562Z level=info msg="Executing migration" id="add index dashboard_permission" 2024-05-20T22:08:08.188 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.083318781Z level=info msg="Executing migration" id="save default acl rules in dashboard_acl table" 2024-05-20T22:08:08.188 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.125321383Z level=info msg="Executing migration" id="delete acl rules for deleted dashboards and folders" 2024-05-20T22:08:08.188 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.167236344Z level=info msg="Executing migration" id="create tag table" 2024-05-20T22:08:08.188 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.192471999Z level=info msg="Executing migration" id="add index tag.key_value" 2024-05-20T22:08:08.448 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:08 smithi145 bash[23893]: audit 2024-05-20T22:08:07.450118+0000 mgr.y (mgr.14592) 60 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:08:08.448 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.217730677Z level=info msg="Executing migration" id="create login attempt table" 2024-05-20T22:08:08.449 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.259942289Z level=info msg="Executing migration" id="add index login_attempt.username" 2024-05-20T22:08:08.449 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.285160539Z level=info msg="Executing migration" id="drop index IDX_login_attempt_username - v1" 2024-05-20T22:08:08.449 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.310431632Z level=info msg="Executing migration" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-05-20T22:08:08.449 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.343891107Z level=info msg="Executing migration" id="create login_attempt v2" 2024-05-20T22:08:08.449 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.385929515Z level=info msg="Executing migration" id="create index IDX_login_attempt_username - v2" 2024-05-20T22:08:08.449 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.411250144Z level=info msg="Executing migration" id="copy login_attempt v1 to v2" 2024-05-20T22:08:08.449 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.45319283Z level=info msg="Executing migration" id="drop login_attempt_tmp_qwerty" 2024-05-20T22:08:08.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:08 smithi050 bash[21866]: audit 2024-05-20T22:08:07.450118+0000 mgr.y (mgr.14592) 60 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:08:08.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:08 smithi050 bash[28929]: audit 2024-05-20T22:08:07.450118+0000 mgr.y (mgr.14592) 60 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:08:08.709 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.47849437Z level=info msg="Executing migration" id="create user auth table" 2024-05-20T22:08:08.709 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.5037229Z level=info msg="Executing migration" id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-05-20T22:08:08.709 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.528969304Z level=info msg="Executing migration" id="alter user_auth.auth_id to length 190" 2024-05-20T22:08:08.709 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.55416566Z level=info msg="Executing migration" id="Add OAuth access token to user_auth" 2024-05-20T22:08:08.709 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.579450963Z level=info msg="Executing migration" id="Add OAuth refresh token to user_auth" 2024-05-20T22:08:08.710 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.621405589Z level=info msg="Executing migration" id="Add OAuth token type to user_auth" 2024-05-20T22:08:08.710 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.646707882Z level=info msg="Executing migration" id="Add OAuth expiry to user_auth" 2024-05-20T22:08:08.710 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.672079297Z level=info msg="Executing migration" id="Add index to user_id column in user_auth" 2024-05-20T22:08:08.710 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.713941974Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-05-20T22:08:08.970 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.747759588Z level=info msg="Executing migration" id="create server_lock table" 2024-05-20T22:08:08.970 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.773061985Z level=info msg="Executing migration" id="add index server_lock.operation_uid" 2024-05-20T22:08:08.970 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.798191049Z level=info msg="Executing migration" id="create user auth token table" 2024-05-20T22:08:08.970 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.840220081Z level=info msg="Executing migration" id="add unique index user_auth_token.auth_token" 2024-05-20T22:08:08.970 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.882215066Z level=info msg="Executing migration" id="add unique index user_auth_token.prev_auth_token" 2024-05-20T22:08:08.970 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.924277081Z level=info msg="Executing migration" id="add index user_auth_token.user_id" 2024-05-20T22:08:08.971 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.949441128Z level=info msg="Executing migration" id="Add revoked_at to the user auth token" 2024-05-20T22:08:08.971 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:08 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:08.974763888Z level=info msg="Executing migration" id="create cache_data table" 2024-05-20T22:08:09.222 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.000091441Z level=info msg="Executing migration" id="add unique index cache_data.cache_key" 2024-05-20T22:08:09.223 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.042084016Z level=info msg="Executing migration" id="create short_url table v1" 2024-05-20T22:08:09.223 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.08418266Z level=info msg="Executing migration" id="add index short_url.org_id-uid" 2024-05-20T22:08:09.223 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.109390105Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-05-20T22:08:09.223 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.151348997Z level=info msg="Executing migration" id="delete alert_definition table" 2024-05-20T22:08:09.223 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.176789509Z level=info msg="Executing migration" id="recreate alert_definition table" 2024-05-20T22:08:09.223 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.202072675Z level=info msg="Executing migration" id="add index in alert_definition on org_id and title columns" 2024-05-20T22:08:09.223 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.227339351Z level=info msg="Executing migration" id="add index in alert_definition on org_id and uid columns" 2024-05-20T22:08:09.482 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:09 smithi145 bash[23893]: cluster 2024-05-20T22:08:07.860489+0000 mgr.y (mgr.14592) 61 : cluster 0 pgmap v30: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:09.482 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.252523243Z level=info msg="Executing migration" id="alter alert_definition table data column to mediumtext in mysql" 2024-05-20T22:08:09.482 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.294447869Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and title columns" 2024-05-20T22:08:09.483 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.403341064Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and uid columns" 2024-05-20T22:08:09.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:09 smithi050 bash[28929]: cluster 2024-05-20T22:08:07.860489+0000 mgr.y (mgr.14592) 61 : cluster 0 pgmap v30: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:09 smithi050 bash[21866]: cluster 2024-05-20T22:08:07.860489+0000 mgr.y (mgr.14592) 61 : cluster 0 pgmap v30: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:09.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:08:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:08:09.750 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.487170619Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and title columns" 2024-05-20T22:08:09.751 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.53735621Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and uid columns" 2024-05-20T22:08:09.753 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.587709368Z level=info msg="Executing migration" id="Add column paused in alert_definition" 2024-05-20T22:08:09.753 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.688122177Z level=info msg="Executing migration" id="drop alert_definition table" 2024-05-20T22:08:09.753 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.73013062Z level=info msg="Executing migration" id="delete alert_definition_version table" 2024-05-20T22:08:09.754 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.755426315Z level=info msg="Executing migration" id="recreate alert_definition_version table" 2024-05-20T22:08:10.030 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.780701392Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-05-20T22:08:10.030 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.82484788Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-05-20T22:08:10.030 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.875247522Z level=info msg="Executing migration" id="alter alert_definition_version table data column to mediumtext in mysql" 2024-05-20T22:08:10.030 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.917277354Z level=info msg="Executing migration" id="drop alert_definition_version table" 2024-05-20T22:08:10.031 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.94259238Z level=info msg="Executing migration" id="create alert_instance table" 2024-05-20T22:08:10.031 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.967790384Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-05-20T22:08:10.031 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:09 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:09.993031108Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, current_state columns" 2024-05-20T22:08:10.031 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.034978447Z level=info msg="Executing migration" id="add column current_state_end to alert_instance" 2024-05-20T22:08:10.290 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.060260487Z level=info msg="Executing migration" id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-05-20T22:08:10.291 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.102173243Z level=info msg="Executing migration" id="remove index def_org_id, current_state on alert_instance" 2024-05-20T22:08:10.291 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.127461527Z level=info msg="Executing migration" id="rename def_org_id to rule_org_id in alert_instance" 2024-05-20T22:08:10.291 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.186023596Z level=info msg="Executing migration" id="rename def_uid to rule_uid in alert_instance" 2024-05-20T22:08:10.291 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.228017939Z level=info msg="Executing migration" id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-05-20T22:08:10.291 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.269957815Z level=info msg="Executing migration" id="add index rule_org_id, current_state on alert_instance" 2024-05-20T22:08:10.292 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.295233452Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-05-20T22:08:10.443 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:08:10 smithi050 systemd[1]: Stopping Ceph alertmanager.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:08:10.444 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:08:10 smithi050 bash[58002]: ts=2024-05-20T22:08:10.255Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-05-20T22:08:10.542 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.337455356Z level=info msg="Executing migration" id="create alert_rule table" 2024-05-20T22:08:10.543 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.36250955Z level=info msg="Executing migration" id="add index in alert_rule on org_id and title columns" 2024-05-20T22:08:10.543 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.387778891Z level=info msg="Executing migration" id="add index in alert_rule on org_id and uid columns" 2024-05-20T22:08:10.543 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.429677788Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-05-20T22:08:10.543 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.471791818Z level=info msg="Executing migration" id="alter alert_rule table data column to mediumtext in mysql" 2024-05-20T22:08:10.543 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.497048389Z level=info msg="Executing migration" id="add column for to alert_rule" 2024-05-20T22:08:10.543 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.522314376Z level=info msg="Executing migration" id="add column annotations to alert_rule" 2024-05-20T22:08:10.543 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.547495376Z level=info msg="Executing migration" id="add column labels to alert_rule" 2024-05-20T22:08:10.804 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.572744253Z level=info msg="Executing migration" id="remove unique index from alert_rule on org_id, title columns" 2024-05-20T22:08:10.804 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.614734902Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-05-20T22:08:10.804 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.639984019Z level=info msg="Executing migration" id="add dashboard_uid column to alert_rule" 2024-05-20T22:08:10.804 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.66521036Z level=info msg="Executing migration" id="add panel_id column to alert_rule" 2024-05-20T22:08:10.804 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.690483467Z level=info msg="Executing migration" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-05-20T22:08:10.804 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.715784066Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-05-20T22:08:10.804 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.740997514Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-05-20T22:08:10.804 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.783128018Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-05-20T22:08:10.804 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.808560523Z level=info msg="Executing migration" id="create alert_rule_version table" 2024-05-20T22:08:10.898 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:08:10 smithi050 bash[59616]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-alertmanager-a 2024-05-20T22:08:11.056 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.833886746Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-05-20T22:08:11.056 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.900828126Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-05-20T22:08:11.056 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.917683586Z level=info msg="Executing migration" id="alter alert_rule_version table data column to mediumtext in mysql" 2024-05-20T22:08:11.056 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.934590743Z level=info msg="Executing migration" id="add column for to alert_rule_version" 2024-05-20T22:08:11.057 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.959925923Z level=info msg="Executing migration" id="add column annotations to alert_rule_version" 2024-05-20T22:08:11.057 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:10 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:10.993419207Z level=info msg="Executing migration" id="add column labels to alert_rule_version" 2024-05-20T22:08:11.057 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.010550889Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-05-20T22:08:11.057 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.035792943Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-05-20T22:08:11.057 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.06105074Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-05-20T22:08:11.194 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:08:10 smithi050 bash[59803]: Error response from daemon: No such container: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-alertmanager-a 2024-05-20T22:08:11.194 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:08:10 smithi050 systemd[1]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-05-20T22:08:11.194 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:08:10 smithi050 systemd[1]: Stopped Ceph alertmanager.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968. 2024-05-20T22:08:11.194 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:08:10 smithi050 systemd[1]: Started Ceph alertmanager.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968. 2024-05-20T22:08:11.308 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.086266797Z level=info msg="Executing migration" id=create_alert_configuration_table 2024-05-20T22:08:11.308 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.11155945Z level=info msg="Executing migration" id="Add column default in alert_configuration" 2024-05-20T22:08:11.308 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.153423471Z level=info msg="Executing migration" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-05-20T22:08:11.309 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.17875882Z level=info msg="Executing migration" id="add column org_id in alert_configuration" 2024-05-20T22:08:11.309 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.20403771Z level=info msg="Executing migration" id="add index in alert_configuration table on org_id column" 2024-05-20T22:08:11.309 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.245982127Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-05-20T22:08:11.309 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.271373069Z level=info msg="Executing migration" id=create_ngalert_configuration_table 2024-05-20T22:08:11.569 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.313269339Z level=info msg="Executing migration" id="add index in ngalert_configuration on org_id column" 2024-05-20T22:08:11.570 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.355412284Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-05-20T22:08:11.570 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.380624335Z level=info msg="Executing migration" id="create provenance_type table" 2024-05-20T22:08:11.570 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.422708453Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-05-20T22:08:11.570 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.464925266Z level=info msg="Executing migration" id="create alert_image table" 2024-05-20T22:08:11.570 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.490140257Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-05-20T22:08:11.570 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.523704408Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-05-20T22:08:11.570 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.548882236Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-05-20T22:08:11.571 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:11 smithi145 bash[23893]: cluster 2024-05-20T22:08:09.861965+0000 mgr.y (mgr.14592) 62 : cluster 0 pgmap v31: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:11.571 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:11 smithi145 bash[23893]: audit 2024-05-20T22:08:10.967456+0000 mon.a (mon.0) 880 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:11.571 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:11 smithi145 bash[23893]: audit 2024-05-20T22:08:10.976282+0000 mon.a (mon.0) 881 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:11 smithi050 bash[21866]: cluster 2024-05-20T22:08:09.861965+0000 mgr.y (mgr.14592) 62 : cluster 0 pgmap v31: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:11 smithi050 bash[21866]: audit 2024-05-20T22:08:10.967456+0000 mon.a (mon.0) 880 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:11 smithi050 bash[21866]: audit 2024-05-20T22:08:10.976282+0000 mon.a (mon.0) 881 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:11.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:11 smithi050 bash[28929]: cluster 2024-05-20T22:08:09.861965+0000 mgr.y (mgr.14592) 62 : cluster 0 pgmap v31: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:11.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:11 smithi050 bash[28929]: audit 2024-05-20T22:08:10.967456+0000 mon.a (mon.0) 880 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:11.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:11 smithi050 bash[28929]: audit 2024-05-20T22:08:10.976282+0000 mon.a (mon.0) 881 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:11.873 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.574130486Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-05-20T22:08:11.874 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.599373523Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-05-20T22:08:11.874 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.599692627Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-05-20T22:08:11.874 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.641571014Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-05-20T22:08:11.874 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.666878983Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-05-20T22:08:11.874 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.708560978Z level=info msg="Executing migration" id="clear migration entry \"remove unified alerting data\"" 2024-05-20T22:08:11.874 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.708865042Z level=info msg="Executing migration" id="move dashboard alerts to unified alerting" 2024-05-20T22:08:11.874 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.709065531Z level=info msg="alerts found to migrate" alerts=0 2024-05-20T22:08:11.874 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:11 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:11.878044612Z level=info msg="Executing migration" id="create library_element table v1" 2024-05-20T22:08:12.194 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:08:11 smithi050 bash[59831]: ts=2024-05-20T22:08:11.912Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-05-20T22:08:12.194 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:08:11 smithi050 bash[59831]: ts=2024-05-20T22:08:11.912Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-05-20T22:08:12.194 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:08:11 smithi050 bash[59831]: ts=2024-05-20T22:08:11.914Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.50 port=9094 2024-05-20T22:08:12.194 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:08:11 smithi050 bash[59831]: ts=2024-05-20T22:08:11.915Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-05-20T22:08:12.194 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:08:11 smithi050 bash[59831]: ts=2024-05-20T22:08:11.945Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-05-20T22:08:12.194 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:08:11 smithi050 bash[59831]: ts=2024-05-20T22:08:11.945Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-05-20T22:08:12.194 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:08:11 smithi050 bash[59831]: ts=2024-05-20T22:08:11.949Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-05-20T22:08:12.195 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:08:11 smithi050 bash[59831]: ts=2024-05-20T22:08:11.950Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-05-20T22:08:12.307 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:08:12.307 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:08:12.308 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:08:12.308 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:08:12.308 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:08:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:08:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:08:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:08:12.447 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:12 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:12.157352815Z level=info msg="Executing migration" id="add index library_element org_id-folder_id-name-kind" 2024-05-20T22:08:12.447 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:12 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:12.287638754Z level=info msg="Executing migration" id="create library_element_connection table v1" 2024-05-20T22:08:12.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:12 smithi050 bash[21866]: cephadm 2024-05-20T22:08:10.977820+0000 mgr.y (mgr.14592) 63 : cephadm 1 Reconfiguring prometheus.a (dependencies changed)... 2024-05-20T22:08:12.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:12 smithi050 bash[21866]: cephadm 2024-05-20T22:08:11.238505+0000 mgr.y (mgr.14592) 64 : cephadm 1 Reconfiguring daemon prometheus.a on smithi145 2024-05-20T22:08:12.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:12 smithi050 bash[28929]: cephadm 2024-05-20T22:08:10.977820+0000 mgr.y (mgr.14592) 63 : cephadm 1 Reconfiguring prometheus.a (dependencies changed)... 2024-05-20T22:08:12.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:12 smithi050 bash[28929]: cephadm 2024-05-20T22:08:11.238505+0000 mgr.y (mgr.14592) 64 : cephadm 1 Reconfiguring daemon prometheus.a on smithi145 2024-05-20T22:08:12.709 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:12 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:12.524382748Z level=info msg="Executing migration" id="add index library_element_connection element_id-kind-connection_id" 2024-05-20T22:08:12.709 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:12 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:12.646729671Z level=info msg="Executing migration" id="add unique index library_element org_id_uid" 2024-05-20T22:08:12.710 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:12 smithi145 bash[23893]: cephadm 2024-05-20T22:08:10.977820+0000 mgr.y (mgr.14592) 63 : cephadm 1 Reconfiguring prometheus.a (dependencies changed)... 2024-05-20T22:08:12.710 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:12 smithi145 bash[23893]: cephadm 2024-05-20T22:08:11.238505+0000 mgr.y (mgr.14592) 64 : cephadm 1 Reconfiguring daemon prometheus.a on smithi145 2024-05-20T22:08:12.986 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:12 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:12.714706935Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-05-20T22:08:12.986 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:12 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:12.819752831Z level=info msg="Executing migration" id="clone move dashboard alerts to unified alerting" 2024-05-20T22:08:12.987 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:12 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:12.906403274Z level=info msg="Executing migration" id="create data_keys table" 2024-05-20T22:08:13.243 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:12 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:12.991431083Z level=info msg="Executing migration" id="create secrets table" 2024-05-20T22:08:13.243 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:13 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:13.065860045Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-05-20T22:08:13.243 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:13 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:13.150062836Z level=info msg="Executing migration" id="add name column into data_keys" 2024-05-20T22:08:13.243 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:13 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:13.2004646Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-05-20T22:08:13.243 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:13 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:13.225832294Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-05-20T22:08:13.582 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:13 smithi145 bash[23893]: cluster 2024-05-20T22:08:11.862432+0000 mgr.y (mgr.14592) 65 : cluster 0 pgmap v32: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:13.582 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:13 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:13.28482271Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-05-20T22:08:13.582 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:13 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:13.352240215Z level=info msg="Executing migration" id="create kv_store table v1" 2024-05-20T22:08:13.582 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:13 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:13.402686141Z level=info msg="Executing migration" id="add index kv_store.org_id-namespace-key" 2024-05-20T22:08:13.583 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:13 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:13.494853119Z level=info msg="Executing migration" id="update dashboard_uid and panel_id from existing annotations" 2024-05-20T22:08:13.583 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:13 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:13.587112854Z level=info msg="Executing migration" id="create permission table" 2024-05-20T22:08:13.784 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:13 smithi050 bash[21866]: cluster 2024-05-20T22:08:11.862432+0000 mgr.y (mgr.14592) 65 : cluster 0 pgmap v32: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:13.784 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:13 smithi050 bash[28929]: cluster 2024-05-20T22:08:11.862432+0000 mgr.y (mgr.14592) 65 : cluster 0 pgmap v32: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:13.889 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:13 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:13.774533738Z level=info msg="Executing migration" id="add unique index permission.role_id" 2024-05-20T22:08:14.193 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:08:13 smithi050 bash[59831]: ts=2024-05-20T22:08:13.915Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000417743s 2024-05-20T22:08:14.261 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:14 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:14.005374292Z level=info msg="Executing migration" id="add unique index role_id_action_scope" 2024-05-20T22:08:14.261 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:14 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:14.131151989Z level=info msg="Executing migration" id="create role table" 2024-05-20T22:08:14.261 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:14 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:14.198376497Z level=info msg="Executing migration" id="add column display_name" 2024-05-20T22:08:14.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:14 smithi145 bash[23893]: audit 2024-05-20T22:08:13.874941+0000 mon.a (mon.0) 882 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-05-20T22:08:14.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:14 smithi145 bash[23893]: audit 2024-05-20T22:08:14.035527+0000 mon.a (mon.0) 883 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:08:14.614 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:14 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:14.266125959Z level=info msg="Executing migration" id="add column group_name" 2024-05-20T22:08:14.614 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:14 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:14.346565869Z level=info msg="Executing migration" id="add index role.org_id" 2024-05-20T22:08:14.890 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:14 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:14.618338125Z level=info msg="Executing migration" id="add unique index role_org_id_name" 2024-05-20T22:08:14.890 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:14 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:14.752822751Z level=info msg="Executing migration" id="add index role_org_id_uid" 2024-05-20T22:08:14.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:14 smithi050 bash[28929]: audit 2024-05-20T22:08:13.874941+0000 mon.a (mon.0) 882 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-05-20T22:08:14.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:14 smithi050 bash[28929]: audit 2024-05-20T22:08:14.035527+0000 mon.a (mon.0) 883 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:08:14.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:14 smithi050 bash[21866]: audit 2024-05-20T22:08:13.874941+0000 mon.a (mon.0) 882 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-05-20T22:08:14.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:14 smithi050 bash[21866]: audit 2024-05-20T22:08:14.035527+0000 mon.a (mon.0) 883 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:08:15.381 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:15 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:15.073367294Z level=info msg="Executing migration" id="create team role table" 2024-05-20T22:08:15.381 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:15 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:15.187762252Z level=info msg="Executing migration" id="add index team_role.org_id" 2024-05-20T22:08:15.381 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:15 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:15.288639036Z level=info msg="Executing migration" id="add unique index team_role_org_id_team_id_role_id" 2024-05-20T22:08:15.381 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:15 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:15.386043625Z level=info msg="Executing migration" id="add index team_role.team_id" 2024-05-20T22:08:15.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:15 smithi145 bash[23893]: cluster 2024-05-20T22:08:13.863007+0000 mgr.y (mgr.14592) 66 : cluster 0 pgmap v33: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-20T22:08:15.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:15 smithi145 bash[23893]: audit 2024-05-20T22:08:14.462631+0000 mon.a (mon.0) 884 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]': finished 2024-05-20T22:08:15.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:15 smithi145 bash[23893]: cluster 2024-05-20T22:08:14.471308+0000 mon.a (mon.0) 885 : cluster 0 osdmap e73: 8 total, 8 up, 8 in 2024-05-20T22:08:15.640 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:15 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:15.474805122Z level=info msg="Executing migration" id="create user role table" 2024-05-20T22:08:15.640 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:15 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:15.55660289Z level=info msg="Executing migration" id="add index user_role.org_id" 2024-05-20T22:08:15.640 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:15 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:15.626306063Z level=info msg="Executing migration" id="add unique index user_role_org_id_user_id_role_id" 2024-05-20T22:08:15.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:15 smithi050 bash[21866]: cluster 2024-05-20T22:08:13.863007+0000 mgr.y (mgr.14592) 66 : cluster 0 pgmap v33: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-20T22:08:15.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:15 smithi050 bash[21866]: audit 2024-05-20T22:08:14.462631+0000 mon.a (mon.0) 884 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]': finished 2024-05-20T22:08:15.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:15 smithi050 bash[21866]: cluster 2024-05-20T22:08:14.471308+0000 mon.a (mon.0) 885 : cluster 0 osdmap e73: 8 total, 8 up, 8 in 2024-05-20T22:08:15.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:15 smithi050 bash[28929]: cluster 2024-05-20T22:08:13.863007+0000 mgr.y (mgr.14592) 66 : cluster 0 pgmap v33: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-20T22:08:15.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:15 smithi050 bash[28929]: audit 2024-05-20T22:08:14.462631+0000 mon.a (mon.0) 884 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]': finished 2024-05-20T22:08:15.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:15 smithi050 bash[28929]: cluster 2024-05-20T22:08:14.471308+0000 mon.a (mon.0) 885 : cluster 0 osdmap e73: 8 total, 8 up, 8 in 2024-05-20T22:08:15.980 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:15 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:15.68250631Z level=info msg="Executing migration" id="add index user_role.user_id" 2024-05-20T22:08:15.981 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:15 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:15.724797478Z level=info msg="Executing migration" id="create builtin role table" 2024-05-20T22:08:15.981 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:15 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:15.767043129Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2024-05-20T22:08:15.981 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:15 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:15.784060666Z level=info msg="Executing migration" id="add index builtin_role.name" 2024-05-20T22:08:15.981 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:15 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:15.859670851Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2024-05-20T22:08:15.981 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:15 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:15.901483172Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2024-05-20T22:08:16.374 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:15 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:15.985515089Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2024-05-20T22:08:16.374 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:16 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:16.055712445Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2024-05-20T22:08:16.374 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:16 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:16.163927077Z level=info msg="Executing migration" id="add unique index role.uid" 2024-05-20T22:08:16.636 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:16 smithi145 bash[23893]: cluster 2024-05-20T22:08:15.472120+0000 mon.a (mon.0) 886 : cluster 0 osdmap e74: 8 total, 8 up, 8 in 2024-05-20T22:08:16.636 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:16 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:16.378657111Z level=info msg="Executing migration" id="create seed assignment table" 2024-05-20T22:08:16.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:16 smithi050 bash[21866]: cluster 2024-05-20T22:08:15.472120+0000 mon.a (mon.0) 886 : cluster 0 osdmap e74: 8 total, 8 up, 8 in 2024-05-20T22:08:16.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:16 smithi050 bash[28929]: cluster 2024-05-20T22:08:15.472120+0000 mon.a (mon.0) 886 : cluster 0 osdmap e74: 8 total, 8 up, 8 in 2024-05-20T22:08:16.890 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:16 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:16.64094346Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2024-05-20T22:08:16.890 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:16 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:16.771817824Z level=info msg="Executing migration" id="add column hidden to role table" 2024-05-20T22:08:16.890 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:16 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:16.847319845Z level=info msg="Executing migration" id="create query_history table v1" 2024-05-20T22:08:17.154 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:16 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:16.898470662Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-05-20T22:08:17.154 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:16 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:16.940362979Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-05-20T22:08:17.155 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:16 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:16.965496032Z level=info msg="Executing migration" id="teams permissions migration" 2024-05-20T22:08:17.155 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:17.016862891Z level=info msg="Executing migration" id="dashboard permissions" 2024-05-20T22:08:17.155 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:17.075314205Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-05-20T22:08:17.155 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:17.10913521Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-05-20T22:08:17.155 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:16 smithi145 systemd[1]: Stopping Ceph prometheus.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:08:17.155 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[49673]: ts=2024-05-20T22:08:17.071Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-05-20T22:08:17.155 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[49673]: ts=2024-05-20T22:08:17.071Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-05-20T22:08:17.155 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[49673]: ts=2024-05-20T22:08:17.071Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-05-20T22:08:17.155 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[49673]: ts=2024-05-20T22:08:17.071Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-05-20T22:08:17.155 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[49673]: ts=2024-05-20T22:08:17.071Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-05-20T22:08:17.156 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[49673]: ts=2024-05-20T22:08:17.071Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-05-20T22:08:17.156 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[49673]: ts=2024-05-20T22:08:17.071Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-05-20T22:08:17.156 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[49673]: ts=2024-05-20T22:08:17.071Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-05-20T22:08:17.156 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[49673]: ts=2024-05-20T22:08:17.071Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-05-20T22:08:17.156 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[49673]: ts=2024-05-20T22:08:17.072Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-05-20T22:08:17.156 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[49673]: ts=2024-05-20T22:08:17.072Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-05-20T22:08:17.156 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[49673]: ts=2024-05-20T22:08:17.072Z caller=main.go:1147 level=info msg="See you next time!" 2024-05-20T22:08:17.453 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:17.159632071Z level=info msg="Executing migration" id="alerting notification permissions" 2024-05-20T22:08:17.453 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:17.244051838Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-05-20T22:08:17.453 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:17.345164124Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-05-20T22:08:17.741 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:17 smithi050 bash[28929]: cluster 2024-05-20T22:08:15.863959+0000 mgr.y (mgr.14592) 67 : cluster 0 pgmap v36: 132 pgs: 1 peering, 131 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:17.742 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:17 smithi050 bash[28929]: cluster 2024-05-20T22:08:16.475686+0000 mon.a (mon.0) 887 : cluster 3 Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-20T22:08:17.742 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:17 smithi050 bash[21866]: cluster 2024-05-20T22:08:15.863959+0000 mgr.y (mgr.14592) 67 : cluster 0 pgmap v36: 132 pgs: 1 peering, 131 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:17.746 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:17 smithi050 bash[21866]: cluster 2024-05-20T22:08:16.475686+0000 mon.a (mon.0) 887 : cluster 3 Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-20T22:08:17.815 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:17.519717614Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-05-20T22:08:17.816 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:17 smithi145 bash[23893]: cluster 2024-05-20T22:08:15.863959+0000 mgr.y (mgr.14592) 67 : cluster 0 pgmap v36: 132 pgs: 1 peering, 131 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:17.816 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:17 smithi145 bash[23893]: cluster 2024-05-20T22:08:16.475686+0000 mon.a (mon.0) 887 : cluster 3 Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-20T22:08:17.816 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:08:18.078 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[52199]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-prometheus-a 2024-05-20T22:08:18.078 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:18 smithi145 bash[52260]: Error response from daemon: No such container: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-prometheus-a 2024-05-20T22:08:18.078 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:18 smithi145 systemd[1]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-05-20T22:08:18.078 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:18 smithi145 systemd[1]: Stopped Ceph prometheus.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968. 2024-05-20T22:08:18.078 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:18 smithi145 systemd[1]: Started Ceph prometheus.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968. 2024-05-20T22:08:18.079 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:17.820412271Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-05-20T22:08:18.079 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:17.912933942Z level=info msg="Executing migration" id="create correlation table v1" 2024-05-20T22:08:18.079 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:17 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:17.980568873Z level=info msg="Executing migration" id="add index correlations.uid" 2024-05-20T22:08:18.079 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:18 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:18.048341182Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-05-20T22:08:18.378 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:18 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:18.135075991Z level=info msg="Executing migration" id="add correlation config column" 2024-05-20T22:08:18.443 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:18 smithi050 bash[22118]: [20/May/2024:22:08:18] ENGINE Bus STOPPING 2024-05-20T22:08:18.640 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:18 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:18.38360396Z level=info msg="Executing migration" id="create entity_events table" 2024-05-20T22:08:18.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:18 smithi145 bash[23893]: audit 2024-05-20T22:08:17.458027+0000 mgr.y (mgr.14592) 68 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:08:18.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:18 smithi145 bash[23893]: audit 2024-05-20T22:08:18.085723+0000 mon.a (mon.0) 888 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:18.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:18 smithi145 bash[23893]: audit 2024-05-20T22:08:18.095327+0000 mon.a (mon.0) 889 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:18.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:18 smithi145 bash[23893]: audit 2024-05-20T22:08:18.102284+0000 mon.a (mon.0) 890 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-20T22:08:18.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:18 smithi145 bash[23893]: audit 2024-05-20T22:08:18.104624+0000 mon.a (mon.0) 891 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi050.front.sepia.ceph.com:9093"}]: dispatch 2024-05-20T22:08:18.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:18 smithi145 bash[23893]: audit 2024-05-20T22:08:18.111889+0000 mon.a (mon.0) 892 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:18.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:18 smithi145 bash[23893]: audit 2024-05-20T22:08:18.130971+0000 mon.a (mon.0) 893 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-20T22:08:18.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:18 smithi145 bash[23893]: audit 2024-05-20T22:08:18.135262+0000 mon.a (mon.0) 894 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi145.front.sepia.ceph.com:9095"}]: dispatch 2024-05-20T22:08:18.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:18 smithi145 bash[23893]: audit 2024-05-20T22:08:18.142014+0000 mon.a (mon.0) 895 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:18.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:18 smithi145 bash[23893]: audit 2024-05-20T22:08:18.158588+0000 mon.a (mon.0) 896 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-20T22:08:18.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:18 smithi145 bash[23893]: audit 2024-05-20T22:08:18.161827+0000 mon.a (mon.0) 897 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi145.front.sepia.ceph.com:3000"}]: dispatch 2024-05-20T22:08:18.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:18 smithi145 bash[23893]: audit 2024-05-20T22:08:18.170221+0000 mon.a (mon.0) 898 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:18.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:18 smithi145 bash[23893]: audit 2024-05-20T22:08:18.257309+0000 mon.a (mon.0) 899 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:08:18.794 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:18 smithi050 bash[22118]: [20/May/2024:22:08:18] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-20T22:08:18.794 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:18 smithi050 bash[22118]: [20/May/2024:22:08:18] ENGINE Bus STOPPED 2024-05-20T22:08:18.794 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:18 smithi050 bash[22118]: [20/May/2024:22:08:18] ENGINE Bus STARTING 2024-05-20T22:08:18.794 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:18 smithi050 bash[22118]: [20/May/2024:22:08:18] ENGINE Serving on http://:::9283 2024-05-20T22:08:18.794 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:18 smithi050 bash[22118]: [20/May/2024:22:08:18] ENGINE Bus STARTED 2024-05-20T22:08:18.794 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:18 smithi050 bash[22118]: [20/May/2024:22:08:18] ENGINE Bus STOPPING 2024-05-20T22:08:18.794 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:18 smithi050 bash[22118]: [20/May/2024:22:08:18] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-20T22:08:18.795 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:18 smithi050 bash[22118]: [20/May/2024:22:08:18] ENGINE Bus STOPPED 2024-05-20T22:08:18.795 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:18 smithi050 bash[22118]: [20/May/2024:22:08:18] ENGINE Bus STARTING 2024-05-20T22:08:18.795 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:18 smithi050 bash[21866]: audit 2024-05-20T22:08:17.458027+0000 mgr.y (mgr.14592) 68 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:08:18.795 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:18 smithi050 bash[21866]: audit 2024-05-20T22:08:18.085723+0000 mon.a (mon.0) 888 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:18.795 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:18 smithi050 bash[21866]: audit 2024-05-20T22:08:18.095327+0000 mon.a (mon.0) 889 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:18.795 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:18 smithi050 bash[21866]: audit 2024-05-20T22:08:18.102284+0000 mon.a (mon.0) 890 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-20T22:08:18.795 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:18 smithi050 bash[21866]: audit 2024-05-20T22:08:18.104624+0000 mon.a (mon.0) 891 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi050.front.sepia.ceph.com:9093"}]: dispatch 2024-05-20T22:08:18.795 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:18 smithi050 bash[21866]: audit 2024-05-20T22:08:18.111889+0000 mon.a (mon.0) 892 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:18.796 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:18 smithi050 bash[21866]: audit 2024-05-20T22:08:18.130971+0000 mon.a (mon.0) 893 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-20T22:08:18.796 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:18 smithi050 bash[21866]: audit 2024-05-20T22:08:18.135262+0000 mon.a (mon.0) 894 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi145.front.sepia.ceph.com:9095"}]: dispatch 2024-05-20T22:08:18.796 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:18 smithi050 bash[21866]: audit 2024-05-20T22:08:18.142014+0000 mon.a (mon.0) 895 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:18.796 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:18 smithi050 bash[21866]: audit 2024-05-20T22:08:18.158588+0000 mon.a (mon.0) 896 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-20T22:08:18.796 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:18 smithi050 bash[21866]: audit 2024-05-20T22:08:18.161827+0000 mon.a (mon.0) 897 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi145.front.sepia.ceph.com:3000"}]: dispatch 2024-05-20T22:08:18.796 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:18 smithi050 bash[21866]: audit 2024-05-20T22:08:18.170221+0000 mon.a (mon.0) 898 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:18.796 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:18 smithi050 bash[21866]: audit 2024-05-20T22:08:18.257309+0000 mon.a (mon.0) 899 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:08:18.796 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:18 smithi050 bash[28929]: audit 2024-05-20T22:08:17.458027+0000 mgr.y (mgr.14592) 68 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:08:18.796 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:18 smithi050 bash[28929]: audit 2024-05-20T22:08:18.085723+0000 mon.a (mon.0) 888 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:18.796 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:18 smithi050 bash[28929]: audit 2024-05-20T22:08:18.095327+0000 mon.a (mon.0) 889 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:18.796 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:18 smithi050 bash[28929]: audit 2024-05-20T22:08:18.102284+0000 mon.a (mon.0) 890 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-20T22:08:18.796 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:18 smithi050 bash[28929]: audit 2024-05-20T22:08:18.104624+0000 mon.a (mon.0) 891 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi050.front.sepia.ceph.com:9093"}]: dispatch 2024-05-20T22:08:18.796 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:18 smithi050 bash[28929]: audit 2024-05-20T22:08:18.111889+0000 mon.a (mon.0) 892 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:18.797 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:18 smithi050 bash[28929]: audit 2024-05-20T22:08:18.130971+0000 mon.a (mon.0) 893 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-20T22:08:18.797 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:18 smithi050 bash[28929]: audit 2024-05-20T22:08:18.135262+0000 mon.a (mon.0) 894 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi145.front.sepia.ceph.com:9095"}]: dispatch 2024-05-20T22:08:18.797 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:18 smithi050 bash[28929]: audit 2024-05-20T22:08:18.142014+0000 mon.a (mon.0) 895 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:18.797 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:18 smithi050 bash[28929]: audit 2024-05-20T22:08:18.158588+0000 mon.a (mon.0) 896 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-20T22:08:18.797 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:18 smithi050 bash[28929]: audit 2024-05-20T22:08:18.161827+0000 mon.a (mon.0) 897 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi145.front.sepia.ceph.com:3000"}]: dispatch 2024-05-20T22:08:18.797 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:18 smithi050 bash[28929]: audit 2024-05-20T22:08:18.170221+0000 mon.a (mon.0) 898 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:18.797 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:18 smithi050 bash[28929]: audit 2024-05-20T22:08:18.257309+0000 mon.a (mon.0) 899 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:08:19.042 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:18 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:18.699655652Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-05-20T22:08:19.042 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:18 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:18.789643901Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-05-20T22:08:19.042 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:18 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:18.790016007Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-05-20T22:08:19.042 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:18 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:18.94502048Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-05-20T22:08:19.042 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:18 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:18.945358633Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-05-20T22:08:19.042 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:19.04680473Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-05-20T22:08:19.125 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:18 smithi050 bash[22118]: [20/May/2024:22:08:18] ENGINE Serving on http://:::9283 2024-05-20T22:08:19.125 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:18 smithi050 bash[22118]: [20/May/2024:22:08:18] ENGINE Bus STARTED 2024-05-20T22:08:19.125 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:18 smithi050 bash[22118]: [20/May/2024:22:08:18] ENGINE Bus STOPPING 2024-05-20T22:08:19.309 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:19.17173503Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-05-20T22:08:19.309 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:19.266280525Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-05-20T22:08:19.309 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:19.313970758Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-05-20T22:08:19.403 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:19 smithi050 bash[22118]: [20/May/2024:22:08:19] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-20T22:08:19.403 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:19 smithi050 bash[22118]: [20/May/2024:22:08:19] ENGINE Bus STOPPED 2024-05-20T22:08:19.403 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:19 smithi050 bash[22118]: [20/May/2024:22:08:19] ENGINE Bus STARTING 2024-05-20T22:08:19.576 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:19.392169678Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-05-20T22:08:19.576 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:19.456620544Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-05-20T22:08:19.576 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:19.498572624Z level=info msg="Executing migration" id="Drop public config table" 2024-05-20T22:08:19.576 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:19.5326293Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-05-20T22:08:19.576 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:19.549226808Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-05-20T22:08:19.577 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:19 smithi145 bash[23893]: cluster 2024-05-20T22:08:17.864745+0000 mgr.y (mgr.14592) 69 : cluster 0 pgmap v37: 132 pgs: 1 peering, 131 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:08:19.577 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:19 smithi145 bash[23893]: audit 2024-05-20T22:08:18.103160+0000 mgr.y (mgr.14592) 70 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-20T22:08:19.577 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:19 smithi145 bash[23893]: audit 2024-05-20T22:08:18.105326+0000 mgr.y (mgr.14592) 71 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi050.front.sepia.ceph.com:9093"}]: dispatch 2024-05-20T22:08:19.577 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:19 smithi145 bash[23893]: audit 2024-05-20T22:08:18.131589+0000 mgr.y (mgr.14592) 72 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-20T22:08:19.577 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:19 smithi145 bash[23893]: audit 2024-05-20T22:08:18.135740+0000 mgr.y (mgr.14592) 73 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi145.front.sepia.ceph.com:9095"}]: dispatch 2024-05-20T22:08:19.577 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:19 smithi145 bash[23893]: audit 2024-05-20T22:08:18.159194+0000 mgr.y (mgr.14592) 74 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-20T22:08:19.577 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:19 smithi145 bash[23893]: audit 2024-05-20T22:08:18.162503+0000 mgr.y (mgr.14592) 75 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi145.front.sepia.ceph.com:3000"}]: dispatch 2024-05-20T22:08:19.692 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:19 smithi050 bash[22118]: [20/May/2024:22:08:19] ENGINE Serving on http://:::9283 2024-05-20T22:08:19.692 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:19 smithi050 bash[22118]: [20/May/2024:22:08:19] ENGINE Bus STARTED 2024-05-20T22:08:19.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:19 smithi050 bash[21866]: cluster 2024-05-20T22:08:17.864745+0000 mgr.y (mgr.14592) 69 : cluster 0 pgmap v37: 132 pgs: 1 peering, 131 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:08:19.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:19 smithi050 bash[21866]: audit 2024-05-20T22:08:18.103160+0000 mgr.y (mgr.14592) 70 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-20T22:08:19.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:19 smithi050 bash[21866]: audit 2024-05-20T22:08:18.105326+0000 mgr.y (mgr.14592) 71 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi050.front.sepia.ceph.com:9093"}]: dispatch 2024-05-20T22:08:19.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:19 smithi050 bash[21866]: audit 2024-05-20T22:08:18.131589+0000 mgr.y (mgr.14592) 72 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-20T22:08:19.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:19 smithi050 bash[21866]: audit 2024-05-20T22:08:18.135740+0000 mgr.y (mgr.14592) 73 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi145.front.sepia.ceph.com:9095"}]: dispatch 2024-05-20T22:08:19.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:19 smithi050 bash[21866]: audit 2024-05-20T22:08:18.159194+0000 mgr.y (mgr.14592) 74 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-20T22:08:19.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:19 smithi050 bash[21866]: audit 2024-05-20T22:08:18.162503+0000 mgr.y (mgr.14592) 75 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi145.front.sepia.ceph.com:3000"}]: dispatch 2024-05-20T22:08:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:19 smithi050 bash[28929]: cluster 2024-05-20T22:08:17.864745+0000 mgr.y (mgr.14592) 69 : cluster 0 pgmap v37: 132 pgs: 1 peering, 131 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:08:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:19 smithi050 bash[28929]: audit 2024-05-20T22:08:18.103160+0000 mgr.y (mgr.14592) 70 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-20T22:08:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:19 smithi050 bash[28929]: audit 2024-05-20T22:08:18.105326+0000 mgr.y (mgr.14592) 71 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi050.front.sepia.ceph.com:9093"}]: dispatch 2024-05-20T22:08:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:19 smithi050 bash[28929]: audit 2024-05-20T22:08:18.131589+0000 mgr.y (mgr.14592) 72 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-20T22:08:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:19 smithi050 bash[28929]: audit 2024-05-20T22:08:18.135740+0000 mgr.y (mgr.14592) 73 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi145.front.sepia.ceph.com:9095"}]: dispatch 2024-05-20T22:08:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:19 smithi050 bash[28929]: audit 2024-05-20T22:08:18.159194+0000 mgr.y (mgr.14592) 74 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-20T22:08:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:19 smithi050 bash[28929]: audit 2024-05-20T22:08:18.162503+0000 mgr.y (mgr.14592) 75 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi145.front.sepia.ceph.com:3000"}]: dispatch 2024-05-20T22:08:19.865 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:19.625278761Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-05-20T22:08:19.865 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:19.68460804Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-05-20T22:08:19.865 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:19.709866391Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-05-20T22:08:19.865 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:19.751888138Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-05-20T22:08:19.865 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:19.777044817Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-05-20T22:08:19.865 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:19.802250732Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-05-20T22:08:19.865 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:19.827434991Z level=info msg="Executing migration" id="add share column" 2024-05-20T22:08:19.865 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:19.869584933Z level=info msg="Executing migration" id="create default alerting folders" 2024-05-20T22:08:19.866 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.580Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-05-20T22:08:19.866 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.581Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-05-20T22:08:19.866 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.581Z caller=main.go:570 level=info host_details="(Linux 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 x86_64 smithi145 (none))" 2024-05-20T22:08:19.866 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.581Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-05-20T22:08:19.866 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.581Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-05-20T22:08:19.866 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.582Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-05-20T22:08:19.866 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.583Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-05-20T22:08:19.866 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.584Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-05-20T22:08:19.866 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.584Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-05-20T22:08:19.866 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.586Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-05-20T22:08:19.867 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.586Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.758µs 2024-05-20T22:08:19.867 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.586Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-05-20T22:08:19.867 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.587Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-05-20T22:08:19.867 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.587Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-05-20T22:08:19.867 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.587Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=22.813µs wal_replay_duration=778.38µs wbl_replay_duration=101ns total_replay_duration=821.038µs 2024-05-20T22:08:19.867 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.588Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-05-20T22:08:19.867 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.588Z caller=main.go:1029 level=info msg="TSDB started" 2024-05-20T22:08:19.867 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.588Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-05-20T22:08:19.867 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.613Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=24.687608ms db_storage=1.214µs remote_storage=1.192µs web_handler=387ns query_engine=616ns scrape=281.14µs scrape_sd=94.784µs notify=29.005µs notify_sd=24.049µs rules=23.844855ms tracing=8.326µs 2024-05-20T22:08:19.867 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.613Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-05-20T22:08:19.867 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[52289]: ts=2024-05-20T22:08:19.613Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-05-20T22:08:20.125 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:19.92966117Z level=info msg="Executing migration" id="create file table" 2024-05-20T22:08:20.125 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:19.953519621Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-05-20T22:08:20.126 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:19 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:19.978860861Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-05-20T22:08:20.126 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.020925855Z level=info msg="Executing migration" id="create file_meta table" 2024-05-20T22:08:20.126 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.046129606Z level=info msg="Executing migration" id="file table idx: path key" 2024-05-20T22:08:20.126 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.063030718Z level=info msg="Executing migration" id="set path collation in file table" 2024-05-20T22:08:20.126 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.09659543Z level=info msg="Executing migration" id="managed permissions migration" 2024-05-20T22:08:20.126 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.11355293Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-05-20T22:08:20.126 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.130365673Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-05-20T22:08:20.390 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.147388785Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-05-20T22:08:20.390 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.164322446Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-05-20T22:08:20.390 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.189460848Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-05-20T22:08:20.390 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.214816803Z level=info msg="Executing migration" id="update group index for alert rules" 2024-05-20T22:08:20.390 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.240050854Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-05-20T22:08:20.390 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.282072644Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-05-20T22:08:20.390 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.307352862Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-05-20T22:08:20.391 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.349294488Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-05-20T22:08:20.391 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.374566657Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-05-20T22:08:20.680 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:20 smithi145 bash[23893]: cluster 2024-05-20T22:08:20.489277+0000 mon.a (mon.0) 900 : cluster 1 Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-20T22:08:20.681 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:20 smithi145 bash[23893]: cluster 2024-05-20T22:08:20.489320+0000 mon.a (mon.0) 901 : cluster 1 Cluster is now healthy 2024-05-20T22:08:20.681 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.416850679Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-05-20T22:08:20.681 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.483929318Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-05-20T22:08:20.681 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.525897184Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-05-20T22:08:20.681 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.568060257Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-05-20T22:08:20.681 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.601653303Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-05-20T22:08:20.682 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.643563653Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-05-20T22:08:20.682 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.685493261Z level=info msg="Executing migration" id="create folder table" 2024-05-20T22:08:20.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:20 smithi050 bash[21866]: cluster 2024-05-20T22:08:20.489277+0000 mon.a (mon.0) 900 : cluster 1 Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-20T22:08:20.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:20 smithi050 bash[21866]: cluster 2024-05-20T22:08:20.489320+0000 mon.a (mon.0) 901 : cluster 1 Cluster is now healthy 2024-05-20T22:08:20.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:20 smithi050 bash[28929]: cluster 2024-05-20T22:08:20.489277+0000 mon.a (mon.0) 900 : cluster 1 Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-20T22:08:20.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:20 smithi050 bash[28929]: cluster 2024-05-20T22:08:20.489320+0000 mon.a (mon.0) 901 : cluster 1 Cluster is now healthy 2024-05-20T22:08:21.140 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.710827301Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-05-20T22:08:21.141 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.736139808Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-05-20T22:08:21.141 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.761439286Z level=info msg="Executing migration" id="Update folder title length" 2024-05-20T22:08:21.141 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.786582285Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-05-20T22:08:21.141 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=migrator t=2024-05-20T22:08:20.811818126Z level=info msg="migrations completed" performed=485 skipped=0 duration=21.059433733s 2024-05-20T22:08:21.141 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=sqlstore t=2024-05-20T22:08:20.813253916Z level=info msg="Created default organization" 2024-05-20T22:08:21.141 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=plugin.finder t=2024-05-20T22:08:20.92178713Z level=warn msg="Skipping finding plugins as directory does not exist" path=/usr/share/grafana/plugins-bundled 2024-05-20T22:08:21.142 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=secrets t=2024-05-20T22:08:20.921969495Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-05-20T22:08:21.142 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=query_data t=2024-05-20T22:08:20.929426117Z level=info msg="Query Service initialization" 2024-05-20T22:08:21.142 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:20 smithi145 bash[51536]: logger=live.push_http t=2024-05-20T22:08:20.934520617Z level=info msg="Live Push Gateway initialization" 2024-05-20T22:08:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e9dd2640 1 -- 172.21.15.50:0/2591302993 >> v1:172.21.15.50:6790/0 conn(0x7f08e4100fb0 legacy=0x7f08e410ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e9dd2640 1 -- 172.21.15.50:0/2591302993 shutdown_connections 2024-05-20T22:08:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e9dd2640 1 -- 172.21.15.50:0/2591302993 >> 172.21.15.50:0/2591302993 conn(0x7f08e40fc0b0 msgr2=0x7f08e40fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e9dd2640 1 -- 172.21.15.50:0/2591302993 shutdown_connections 2024-05-20T22:08:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e9dd2640 1 -- 172.21.15.50:0/2591302993 wait complete. 2024-05-20T22:08:21.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e9dd2640 1 Processor -- start 2024-05-20T22:08:21.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e9dd2640 1 -- start start 2024-05-20T22:08:21.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e9dd2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f08e41a8860 con 0x7f08e41003d0 2024-05-20T22:08:21.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e9dd2640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f08e41a9aa0 con 0x7f08e4110300 2024-05-20T22:08:21.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e9dd2640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f08e41aace0 con 0x7f08e4100fb0 2024-05-20T22:08:21.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e2ffd640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7f08e4100fb0 0x7f08e41a3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:59046/0 (socket says 172.21.15.50:59046) 2024-05-20T22:08:21.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e2ffd640 1 -- 172.21.15.50:0/3573204419 learned_addr learned my addr 172.21.15.50:0/3573204419 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:08:21.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e37fe640 1 --1- 172.21.15.50:0/3573204419 >> v1:172.21.15.50:6789/0 conn(0x7f08e41003d0 0x7f08e410e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48370/0 (socket says 172.21.15.50:48370) 2024-05-20T22:08:21.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3736832516 0 0) 0x7f08e41a8860 con 0x7f08e41003d0 2024-05-20T22:08:21.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08d0003160 con 0x7f08e41003d0 2024-05-20T22:08:21.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 343066432 0 0) 0x7f08e41aace0 con 0x7f08e4100fb0 2024-05-20T22:08:21.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08e41a8860 con 0x7f08e4100fb0 2024-05-20T22:08:21.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 73256090 0 0) 0x7f08e41a9aa0 con 0x7f08e4110300 2024-05-20T22:08:21.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08e41aace0 con 0x7f08e4110300 2024-05-20T22:08:21.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4276585167 0 0) 0x7f08d0003160 con 0x7f08e41003d0 2024-05-20T22:08:21.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f08e41a9aa0 con 0x7f08e41003d0 2024-05-20T22:08:21.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f08d4001a30 con 0x7f08e41003d0 2024-05-20T22:08:21.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 128763141 0 0) 0x7f08e41a8860 con 0x7f08e4100fb0 2024-05-20T22:08:21.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f08d0003160 con 0x7f08e4100fb0 2024-05-20T22:08:21.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f08cc004480 con 0x7f08e4100fb0 2024-05-20T22:08:21.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2222258559 0 0) 0x7f08e41a9aa0 con 0x7f08e41003d0 2024-05-20T22:08:21.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 >> v1:172.21.15.50:6790/0 conn(0x7f08e4100fb0 legacy=0x7f08e41a3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:21.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 >> v1:172.21.15.145:6789/0 conn(0x7f08e4110300 legacy=0x7f08e41a6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:21.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e41abf20 con 0x7f08e41003d0 2024-05-20T22:08:21.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e9dd2640 1 -- 172.21.15.50:0/3573204419 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f08e41aaf10 con 0x7f08e41003d0 2024-05-20T22:08:21.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e9dd2640 1 -- 172.21.15.50:0/3573204419 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f08e41ab3d0 con 0x7f08e41003d0 2024-05-20T22:08:21.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f08d4001ce0 con 0x7f08e41003d0 2024-05-20T22:08:21.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.702+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f08d4005af0 con 0x7f08e41003d0 2024-05-20T22:08:21.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.706+0000 7f08e9dd2640 1 -- 172.21.15.50:0/3573204419 --> v1:172.21.15.50:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f08c4000f80 con 0x7f08e41003d0 2024-05-20T22:08:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.706+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f08d40038a0 con 0x7f08e41003d0 2024-05-20T22:08:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.706+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(74..74 src has 1..74) ==== 6201+0+0 (unknown 2490794606 0 0) 0x7f08d4089180 con 0x7f08e41003d0 2024-05-20T22:08:21.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.706+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 --> v1:172.21.15.50:6801/4039291270 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f08d4004210 con 0x7f08d00792b0 2024-05-20T22:08:21.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.706+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (unknown 3287965567 0 0) 0x7f08d4089600 con 0x7f08e41003d0 2024-05-20T22:08:21.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.706+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 <== osd.0 v1:172.21.15.50:6801/4039291270 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f08d4004210 con 0x7f08d00792b0 2024-05-20T22:08:21.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.722+0000 7f08e9dd2640 1 -- 172.21.15.50:0/3573204419 --> v1:172.21.15.50:6801/4039291270 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f08c4002c50 con 0x7f08d00792b0 2024-05-20T22:08:21.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.722+0000 7f08e0ff9640 1 -- 172.21.15.50:0/3573204419 <== osd.0 v1:172.21.15.50:6801/4039291270 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3422513357) 0x7f08c4002c50 con 0x7f08d00792b0 2024-05-20T22:08:21.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.722+0000 7f08e9dd2640 1 -- 172.21.15.50:0/3573204419 >> v1:172.21.15.50:6801/4039291270 conn(0x7f08d00792b0 legacy=0x7f08d007b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:21.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.722+0000 7f08e9dd2640 1 -- 172.21.15.50:0/3573204419 >> v1:172.21.15.50:6800/3332714287 conn(0x7f08d006eb40 legacy=0x7f08d0071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:21.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.722+0000 7f08e9dd2640 1 -- 172.21.15.50:0/3573204419 >> v1:172.21.15.50:6789/0 conn(0x7f08e41003d0 legacy=0x7f08e410e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:21.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.722+0000 7f08e3fff640 1 -- 172.21.15.50:0/3573204419 reap_dead start 2024-05-20T22:08:21.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.722+0000 7f08e9dd2640 1 -- 172.21.15.50:0/3573204419 shutdown_connections 2024-05-20T22:08:21.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.722+0000 7f08e9dd2640 1 -- 172.21.15.50:0/3573204419 >> 172.21.15.50:0/3573204419 conn(0x7f08e40fc0b0 msgr2=0x7f08e41127a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:21.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.722+0000 7f08e9dd2640 1 -- 172.21.15.50:0/3573204419 shutdown_connections 2024-05-20T22:08:21.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:21.722+0000 7f08e9dd2640 1 -- 172.21.15.50:0/3573204419 wait complete. 2024-05-20T22:08:21.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:21 smithi145 bash[23893]: cluster 2024-05-20T22:08:19.866107+0000 mgr.y (mgr.14592) 76 : cluster 0 pgmap v38: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:21.912 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:21 smithi050 bash[21866]: cluster 2024-05-20T22:08:19.866107+0000 mgr.y (mgr.14592) 76 : cluster 0 pgmap v38: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:21.913 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:21 smithi050 bash[28929]: cluster 2024-05-20T22:08:19.866107+0000 mgr.y (mgr.14592) 76 : cluster 0 pgmap v38: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:22.193 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:08:21 smithi050 bash[59831]: ts=2024-05-20T22:08:21.918Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.002817925s 2024-05-20T22:08:22.390 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:21 smithi145 bash[51536]: logger=infra.usagestats.collector t=2024-05-20T22:08:21.909183172Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-05-20T22:08:22.390 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:21 smithi145 bash[51536]: logger=provisioning.datasources t=2024-05-20T22:08:21.910289686Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-05-20T22:08:22.390 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:21 smithi145 bash[51536]: logger=provisioning.datasources t=2024-05-20T22:08:21.94624409Z level=info msg="inserting datasource from configuration " name=Loki uid=P8E80F9AEF21F6940 2024-05-20T22:08:22.390 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:21 smithi145 bash[51536]: logger=provisioning.alerting t=2024-05-20T22:08:21.988108349Z level=info msg="starting to provision alerting" 2024-05-20T22:08:22.390 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:21 smithi145 bash[51536]: logger=provisioning.alerting t=2024-05-20T22:08:21.988128484Z level=info msg="finished to provision alerting" 2024-05-20T22:08:22.390 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:21 smithi145 bash[51536]: logger=ngalert.state.manager t=2024-05-20T22:08:21.988252165Z level=info msg="Warming state cache for startup" 2024-05-20T22:08:22.390 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:21 smithi145 bash[51536]: logger=grafanaStorageLogger t=2024-05-20T22:08:21.988344446Z level=info msg="storage starting" 2024-05-20T22:08:22.391 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:21 smithi145 bash[51536]: logger=ngalert.state.manager t=2024-05-20T22:08:21.988517139Z level=info msg="State cache has been initialized" states=0 duration=263.296µs 2024-05-20T22:08:22.391 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:21 smithi145 bash[51536]: logger=ngalert.multiorg.alertmanager t=2024-05-20T22:08:21.988699407Z level=info msg="starting MultiOrg Alertmanager" 2024-05-20T22:08:22.391 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:21 smithi145 bash[51536]: logger=ticker t=2024-05-20T22:08:21.988714824Z level=info msg=starting first_tick=2024-05-20T22:08:30Z 2024-05-20T22:08:22.391 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:21 smithi145 bash[51536]: logger=http.server t=2024-05-20T22:08:21.99430986Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-05-20T22:08:22.391 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:22 smithi145 bash[51536]: logger=sqlstore.transactions t=2024-05-20T22:08:22.092411474Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-05-20T22:08:23.389 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:08:22 smithi145 bash[51536]: logger=sqlstore.transactions t=2024-05-20T22:08:22.934776971Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-05-20T22:08:23.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:23 smithi145 bash[23893]: cluster 2024-05-20T22:08:21.866725+0000 mgr.y (mgr.14592) 77 : cluster 0 pgmap v39: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:23.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:23 smithi050 bash[21866]: cluster 2024-05-20T22:08:21.866725+0000 mgr.y (mgr.14592) 77 : cluster 0 pgmap v39: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:23.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:23 smithi050 bash[28929]: cluster 2024-05-20T22:08:21.866725+0000 mgr.y (mgr.14592) 77 : cluster 0 pgmap v39: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f3361f42640 1 -- 172.21.15.50:0/3633939803 >> v1:172.21.15.50:6790/0 conn(0x7f335c1093f0 legacy=0x7f335c10b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f3361f42640 1 -- 172.21.15.50:0/3633939803 shutdown_connections 2024-05-20T22:08:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f3361f42640 1 -- 172.21.15.50:0/3633939803 >> 172.21.15.50:0/3633939803 conn(0x7f335c0fc080 msgr2=0x7f335c0fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f3361f42640 1 -- 172.21.15.50:0/3633939803 shutdown_connections 2024-05-20T22:08:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f3361f42640 1 -- 172.21.15.50:0/3633939803 wait complete. 2024-05-20T22:08:25.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f3361f42640 1 Processor -- start 2024-05-20T22:08:25.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f3361f42640 1 -- start start 2024-05-20T22:08:25.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f3361f42640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f335c105da0 con 0x7f335c106640 2024-05-20T22:08:25.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f3361f42640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f335c1a7bb0 con 0x7f335c10cff0 2024-05-20T22:08:25.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f3361f42640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f335c1a8d90 con 0x7f335c1093f0 2024-05-20T22:08:25.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f335affd640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7f335c1093f0 0x7f335c104330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:59066/0 (socket says 172.21.15.50:59066) 2024-05-20T22:08:25.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f335b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f335c106640 0x7f335c103c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48386/0 (socket says 172.21.15.50:48386) 2024-05-20T22:08:25.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f335affd640 1 -- 172.21.15.50:0/2993449015 learned_addr learned my addr 172.21.15.50:0/2993449015 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:08:25.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 670480855 0 0) 0x7f335c105da0 con 0x7f335c106640 2024-05-20T22:08:25.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3344003520 con 0x7f335c106640 2024-05-20T22:08:25.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4096384942 0 0) 0x7f335c1a8d90 con 0x7f335c1093f0 2024-05-20T22:08:25.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f335c105da0 con 0x7f335c1093f0 2024-05-20T22:08:25.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3158497448 0 0) 0x7f335c1a7bb0 con 0x7f335c10cff0 2024-05-20T22:08:25.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f335c1a8d90 con 0x7f335c10cff0 2024-05-20T22:08:25.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 270076712 0 0) 0x7f3344003520 con 0x7f335c106640 2024-05-20T22:08:25.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.046+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f335c1a7bb0 con 0x7f335c106640 2024-05-20T22:08:25.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.050+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f334c0018b0 con 0x7f335c106640 2024-05-20T22:08:25.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.050+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1483559981 0 0) 0x7f335c105da0 con 0x7f335c1093f0 2024-05-20T22:08:25.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.050+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3344003520 con 0x7f335c1093f0 2024-05-20T22:08:25.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.050+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f33500044f0 con 0x7f335c1093f0 2024-05-20T22:08:25.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.050+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 617705532 0 0) 0x7f335c1a7bb0 con 0x7f335c106640 2024-05-20T22:08:25.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.050+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 >> v1:172.21.15.50:6790/0 conn(0x7f335c1093f0 legacy=0x7f335c104330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:25.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.050+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 >> v1:172.21.15.145:6789/0 conn(0x7f335c10cff0 legacy=0x7f335c1a5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:25.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.050+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335c1a9f70 con 0x7f335c106640 2024-05-20T22:08:25.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.050+0000 7f3361f42640 1 -- 172.21.15.50:0/2993449015 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f335c1a8fc0 con 0x7f335c106640 2024-05-20T22:08:25.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.050+0000 7f3361f42640 1 -- 172.21.15.50:0/2993449015 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f335c1a9480 con 0x7f335c106640 2024-05-20T22:08:25.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.050+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f334c003aa0 con 0x7f335c106640 2024-05-20T22:08:25.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.050+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f334c005c10 con 0x7f335c106640 2024-05-20T22:08:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.050+0000 7f3361f42640 1 -- 172.21.15.50:0/2993449015 --> v1:172.21.15.50:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f3348000f80 con 0x7f335c106640 2024-05-20T22:08:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.050+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f334c003610 con 0x7f335c106640 2024-05-20T22:08:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.050+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(74..74 src has 1..74) ==== 6201+0+0 (unknown 2490794606 0 0) 0x7f334c0896b0 con 0x7f335c106640 2024-05-20T22:08:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.050+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 --> v1:172.21.15.145:6804/1463480843 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f334c004230 con 0x7f33440795a0 2024-05-20T22:08:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.050+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (unknown 3287965567 0 0) 0x7f334c089a40 con 0x7f335c106640 2024-05-20T22:08:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.054+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 <== osd.5 v1:172.21.15.145:6804/1463480843 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f334c004230 con 0x7f33440795a0 2024-05-20T22:08:25.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.070+0000 7f3361f42640 1 -- 172.21.15.50:0/2993449015 --> v1:172.21.15.145:6804/1463480843 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3348002c50 con 0x7f33440795a0 2024-05-20T22:08:25.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.070+0000 7f3358ff9640 1 -- 172.21.15.50:0/2993449015 <== osd.5 v1:172.21.15.145:6804/1463480843 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 3997404244) 0x7f3348002c50 con 0x7f33440795a0 2024-05-20T22:08:25.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.070+0000 7f3361f42640 1 -- 172.21.15.50:0/2993449015 >> v1:172.21.15.145:6804/1463480843 conn(0x7f33440795a0 legacy=0x7f334407ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:25.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.070+0000 7f3361f42640 1 -- 172.21.15.50:0/2993449015 >> v1:172.21.15.50:6800/3332714287 conn(0x7f334406ee30 legacy=0x7f33440712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:25.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.070+0000 7f3361f42640 1 -- 172.21.15.50:0/2993449015 >> v1:172.21.15.50:6789/0 conn(0x7f335c106640 legacy=0x7f335c103c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:25.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.070+0000 7f335bfff640 1 -- 172.21.15.50:0/2993449015 reap_dead start 2024-05-20T22:08:25.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.070+0000 7f3361f42640 1 -- 172.21.15.50:0/2993449015 shutdown_connections 2024-05-20T22:08:25.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.070+0000 7f3361f42640 1 -- 172.21.15.50:0/2993449015 >> 172.21.15.50:0/2993449015 conn(0x7f335c0fc080 msgr2=0x7f335c10fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:25.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.070+0000 7f3361f42640 1 -- 172.21.15.50:0/2993449015 shutdown_connections 2024-05-20T22:08:25.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:25.070+0000 7f3361f42640 1 -- 172.21.15.50:0/2993449015 wait complete. 2024-05-20T22:08:25.572 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:25 smithi050 bash[21866]: cluster 2024-05-20T22:08:23.867472+0000 mgr.y (mgr.14592) 78 : cluster 0 pgmap v40: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-20T22:08:25.572 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:25 smithi050 bash[21866]: audit 2024-05-20T22:08:24.317873+0000 mon.a (mon.0) 902 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:25.573 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:25 smithi050 bash[21866]: audit 2024-05-20T22:08:24.327989+0000 mon.a (mon.0) 903 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:25.573 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:25 smithi050 bash[28929]: cluster 2024-05-20T22:08:23.867472+0000 mgr.y (mgr.14592) 78 : cluster 0 pgmap v40: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-20T22:08:25.573 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:25 smithi050 bash[28929]: audit 2024-05-20T22:08:24.317873+0000 mon.a (mon.0) 902 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:25.573 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:25 smithi050 bash[28929]: audit 2024-05-20T22:08:24.327989+0000 mon.a (mon.0) 903 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:25.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:25 smithi145 bash[23893]: cluster 2024-05-20T22:08:23.867472+0000 mgr.y (mgr.14592) 78 : cluster 0 pgmap v40: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-20T22:08:25.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:25 smithi145 bash[23893]: audit 2024-05-20T22:08:24.317873+0000 mon.a (mon.0) 902 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:25.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:25 smithi145 bash[23893]: audit 2024-05-20T22:08:24.327989+0000 mon.a (mon.0) 903 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:26.344 INFO:teuthology.orchestra.run.smithi050.stdout:34359738473 2024-05-20T22:08:26.345 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-20T22:08:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc94492640 1 -- 172.21.15.50:0/3775609465 >> v1:172.21.15.50:6789/0 conn(0x7fcc8c1076d0 legacy=0x7fcc8c107ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc94492640 1 -- 172.21.15.50:0/3775609465 shutdown_connections 2024-05-20T22:08:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc94492640 1 -- 172.21.15.50:0/3775609465 >> 172.21.15.50:0/3775609465 conn(0x7fcc8c0fd1e0 msgr2=0x7fcc8c0ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc94492640 1 -- 172.21.15.50:0/3775609465 shutdown_connections 2024-05-20T22:08:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc94492640 1 -- 172.21.15.50:0/3775609465 wait complete. 2024-05-20T22:08:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc94492640 1 Processor -- start 2024-05-20T22:08:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc94492640 1 -- start start 2024-05-20T22:08:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc94492640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fcc8c1a8990 con 0x7fcc8c10a580 2024-05-20T22:08:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc94492640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fcc8c1a9bd0 con 0x7fcc8c10e120 2024-05-20T22:08:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc94492640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fcc8c1aae10 con 0x7fcc8c1076d0 2024-05-20T22:08:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc91a2d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcc8c10a580 0x7fcc8c1a3980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48404/0 (socket says 172.21.15.50:48404) 2024-05-20T22:08:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc91a2d640 1 -- 172.21.15.50:0/513462174 learned_addr learned my addr 172.21.15.50:0/513462174 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:08:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1665924353 0 0) 0x7fcc8c1aae10 con 0x7fcc8c1076d0 2024-05-20T22:08:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc78003160 con 0x7fcc8c1076d0 2024-05-20T22:08:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3868914711 0 0) 0x7fcc8c1a8990 con 0x7fcc8c10a580 2024-05-20T22:08:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc8c1aae10 con 0x7fcc8c10a580 2024-05-20T22:08:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4040582852 0 0) 0x7fcc78003160 con 0x7fcc8c1076d0 2024-05-20T22:08:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcc8c1a8990 con 0x7fcc8c1076d0 2024-05-20T22:08:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fcc880044b0 con 0x7fcc8c1076d0 2024-05-20T22:08:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1284080558 0 0) 0x7fcc8c1a9bd0 con 0x7fcc8c10e120 2024-05-20T22:08:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc78003160 con 0x7fcc8c10e120 2024-05-20T22:08:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2217429076 0 0) 0x7fcc8c1aae10 con 0x7fcc8c10a580 2024-05-20T22:08:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcc8c1a9bd0 con 0x7fcc8c10a580 2024-05-20T22:08:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fcc7c001870 con 0x7fcc8c10a580 2024-05-20T22:08:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1103410180 0 0) 0x7fcc8c1a8990 con 0x7fcc8c1076d0 2024-05-20T22:08:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 >> v1:172.21.15.145:6789/0 conn(0x7fcc8c10e120 legacy=0x7fcc8c1a70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 >> v1:172.21.15.50:6789/0 conn(0x7fcc8c10a580 legacy=0x7fcc8c1a3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.610+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc8c1ac050 con 0x7fcc8c1076d0 2024-05-20T22:08:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.614+0000 7fcc94492640 1 -- 172.21.15.50:0/513462174 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcc8c1a8bc0 con 0x7fcc8c1076d0 2024-05-20T22:08:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.614+0000 7fcc94492640 1 -- 172.21.15.50:0/513462174 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fcc8c1a9080 con 0x7fcc8c1076d0 2024-05-20T22:08:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.614+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7fcc88001b10 con 0x7fcc8c1076d0 2024-05-20T22:08:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.614+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fcc88004c70 con 0x7fcc8c1076d0 2024-05-20T22:08:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.614+0000 7fcc94492640 1 -- 172.21.15.50:0/513462174 --> v1:172.21.15.50:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fcc70000f80 con 0x7fcc8c1076d0 2024-05-20T22:08:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.614+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7fcc880035f0 con 0x7fcc8c1076d0 2024-05-20T22:08:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.614+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(74..74 src has 1..74) ==== 6201+0+0 (unknown 2490794606 0 0) 0x7fcc880883e0 con 0x7fcc8c1076d0 2024-05-20T22:08:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.614+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 --> v1:172.21.15.145:6808/856530538 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc7807d2e0 con 0x7fcc78079610 2024-05-20T22:08:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.614+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (unknown 3287965567 0 0) 0x7fcc88088820 con 0x7fcc8c1076d0 2024-05-20T22:08:26.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.618+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 <== osd.6 v1:172.21.15.145:6808/856530538 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fcc7807d2e0 con 0x7fcc78079610 2024-05-20T22:08:26.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.630+0000 7fcc94492640 1 -- 172.21.15.50:0/513462174 --> v1:172.21.15.145:6808/856530538 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcc70002c50 con 0x7fcc78079610 2024-05-20T22:08:26.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.634+0000 7fcc837fe640 1 -- 172.21.15.50:0/513462174 <== osd.6 v1:172.21.15.145:6808/856530538 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 3806739625) 0x7fcc70002c50 con 0x7fcc78079610 2024-05-20T22:08:26.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.634+0000 7fcc94492640 1 -- 172.21.15.50:0/513462174 >> v1:172.21.15.145:6808/856530538 conn(0x7fcc78079610 legacy=0x7fcc7807ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:26.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.634+0000 7fcc94492640 1 -- 172.21.15.50:0/513462174 >> v1:172.21.15.50:6800/3332714287 conn(0x7fcc7806ee20 legacy=0x7fcc780712e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:26.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.634+0000 7fcc94492640 1 -- 172.21.15.50:0/513462174 >> v1:172.21.15.50:6790/0 conn(0x7fcc8c1076d0 legacy=0x7fcc8c10d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:26.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.634+0000 7fcc92a2f640 1 -- 172.21.15.50:0/513462174 reap_dead start 2024-05-20T22:08:26.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.634+0000 7fcc94492640 1 -- 172.21.15.50:0/513462174 shutdown_connections 2024-05-20T22:08:26.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.634+0000 7fcc94492640 1 -- 172.21.15.50:0/513462174 >> 172.21.15.50:0/513462174 conn(0x7fcc8c0fd1e0 msgr2=0x7fcc8c0ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:26.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.634+0000 7fcc94492640 1 -- 172.21.15.50:0/513462174 shutdown_connections 2024-05-20T22:08:26.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.634+0000 7fcc94492640 1 -- 172.21.15.50:0/513462174 wait complete. 2024-05-20T22:08:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.870+0000 7f2724fcf640 1 -- 172.21.15.50:0/3660327315 >> v1:172.21.15.50:6789/0 conn(0x7f27201076a0 legacy=0x7f2720107a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:26.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.870+0000 7f2724fcf640 1 -- 172.21.15.50:0/3660327315 shutdown_connections 2024-05-20T22:08:26.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.870+0000 7f2724fcf640 1 -- 172.21.15.50:0/3660327315 >> 172.21.15.50:0/3660327315 conn(0x7f27200fd1b0 msgr2=0x7f27200ff5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:26.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.870+0000 7f2724fcf640 1 -- 172.21.15.50:0/3660327315 shutdown_connections 2024-05-20T22:08:26.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.870+0000 7f2724fcf640 1 -- 172.21.15.50:0/3660327315 wait complete. 2024-05-20T22:08:26.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.870+0000 7f2724fcf640 1 Processor -- start 2024-05-20T22:08:26.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.870+0000 7f2724fcf640 1 -- start start 2024-05-20T22:08:26.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.870+0000 7f2724fcf640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f27201a8830 con 0x7f272010e0f0 2024-05-20T22:08:26.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.870+0000 7f2724fcf640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f27201a9a10 con 0x7f272010a550 2024-05-20T22:08:26.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.870+0000 7f2724fcf640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f27201aac30 con 0x7f27201076a0 2024-05-20T22:08:26.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f271ed9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f272010e0f0 0x7f27201a7080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48422/0 (socket says 172.21.15.50:48422) 2024-05-20T22:08:26.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f271ed9d640 1 -- 172.21.15.50:0/1885914418 learned_addr learned my addr 172.21.15.50:0/1885914418 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:08:26.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f271e59c640 1 --1- 172.21.15.50:0/1885914418 >> v1:172.21.15.50:6790/0 conn(0x7f27201076a0 0x7f2720075430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:59110/0 (socket says 172.21.15.50:59110) 2024-05-20T22:08:26.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2481677795 0 0) 0x7f27201a8830 con 0x7f272010e0f0 2024-05-20T22:08:26.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2708003160 con 0x7f272010e0f0 2024-05-20T22:08:26.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1178209547 0 0) 0x7f27201aac30 con 0x7f27201076a0 2024-05-20T22:08:26.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27201a8830 con 0x7f27201076a0 2024-05-20T22:08:26.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3006413600 0 0) 0x7f27201a8830 con 0x7f27201076a0 2024-05-20T22:08:26.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f27201aac30 con 0x7f27201076a0 2024-05-20T22:08:26.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3571752175 0 0) 0x7f2708003160 con 0x7f272010e0f0 2024-05-20T22:08:26.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f27201a8830 con 0x7f272010e0f0 2024-05-20T22:08:26.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f27100014f0 con 0x7f27201076a0 2024-05-20T22:08:26.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f2718001c10 con 0x7f272010e0f0 2024-05-20T22:08:26.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3465638346 0 0) 0x7f27201a9a10 con 0x7f272010a550 2024-05-20T22:08:26.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2708003160 con 0x7f272010a550 2024-05-20T22:08:26.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2583085607 0 0) 0x7f27201aac30 con 0x7f27201076a0 2024-05-20T22:08:26.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 >> v1:172.21.15.145:6789/0 conn(0x7f272010a550 legacy=0x7f27201a3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:26.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 >> v1:172.21.15.50:6789/0 conn(0x7f272010e0f0 legacy=0x7f27201a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:26.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27201abe70 con 0x7f27201076a0 2024-05-20T22:08:26.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f2724fcf640 1 -- 172.21.15.50:0/1885914418 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f27201aae60 con 0x7f27201076a0 2024-05-20T22:08:26.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f2724fcf640 1 -- 172.21.15.50:0/1885914418 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f27201ab320 con 0x7f27201076a0 2024-05-20T22:08:26.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f2710003bf0 con 0x7f27201076a0 2024-05-20T22:08:26.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f2710004bb0 con 0x7f27201076a0 2024-05-20T22:08:26.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f2724fcf640 1 -- 172.21.15.50:0/1885914418 --> v1:172.21.15.50:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f2700000fb0 con 0x7f27201076a0 2024-05-20T22:08:26.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f2710004e90 con 0x7f27201076a0 2024-05-20T22:08:26.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(74..74 src has 1..74) ==== 6201+0+0 (unknown 2490794606 0 0) 0x7f2710089550 con 0x7f27201076a0 2024-05-20T22:08:26.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 --> v1:172.21.15.50:6809/3675120581 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f270807d3d0 con 0x7f2708079700 2024-05-20T22:08:26.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.874+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (unknown 3287965567 0 0) 0x7f27100899c0 con 0x7f27201076a0 2024-05-20T22:08:26.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.878+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 <== osd.2 v1:172.21.15.50:6809/3675120581 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f270807d3d0 con 0x7f2708079700 2024-05-20T22:08:26.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.890+0000 7f2724fcf640 1 -- 172.21.15.50:0/1885914418 --> v1:172.21.15.50:6809/3675120581 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2700002c80 con 0x7f2708079700 2024-05-20T22:08:26.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.890+0000 7f270f7fe640 1 -- 172.21.15.50:0/1885914418 <== osd.2 v1:172.21.15.50:6809/3675120581 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1508659346) 0x7f2700002c80 con 0x7f2708079700 2024-05-20T22:08:26.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.894+0000 7f2724fcf640 1 -- 172.21.15.50:0/1885914418 >> v1:172.21.15.50:6809/3675120581 conn(0x7f2708079700 legacy=0x7f270807bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:26.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.894+0000 7f2724fcf640 1 -- 172.21.15.50:0/1885914418 >> v1:172.21.15.50:6800/3332714287 conn(0x7f270806ee90 legacy=0x7f2708071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:26.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.894+0000 7f2724fcf640 1 -- 172.21.15.50:0/1885914418 >> v1:172.21.15.50:6790/0 conn(0x7f27201076a0 legacy=0x7f2720075430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:26.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.894+0000 7f271ed9d640 1 -- 172.21.15.50:0/1885914418 reap_dead start 2024-05-20T22:08:26.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.894+0000 7f2724fcf640 1 -- 172.21.15.50:0/1885914418 shutdown_connections 2024-05-20T22:08:26.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.894+0000 7f2724fcf640 1 -- 172.21.15.50:0/1885914418 >> 172.21.15.50:0/1885914418 conn(0x7f27200fd1b0 msgr2=0x7f27200ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:26.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.894+0000 7f2724fcf640 1 -- 172.21.15.50:0/1885914418 shutdown_connections 2024-05-20T22:08:26.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:26.894+0000 7f2724fcf640 1 -- 172.21.15.50:0/1885914418 wait complete. 2024-05-20T22:08:27.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:27 smithi145 bash[23893]: cluster 2024-05-20T22:08:25.869070+0000 mgr.y (mgr.14592) 79 : cluster 0 pgmap v41: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 984 B/s rd, 0 op/s 2024-05-20T22:08:27.640 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:08:27 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:08:27.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:27 smithi050 bash[21866]: cluster 2024-05-20T22:08:25.869070+0000 mgr.y (mgr.14592) 79 : cluster 0 pgmap v41: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 984 B/s rd, 0 op/s 2024-05-20T22:08:27.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:27 smithi050 bash[28929]: cluster 2024-05-20T22:08:25.869070+0000 mgr.y (mgr.14592) 79 : cluster 0 pgmap v41: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 984 B/s rd, 0 op/s 2024-05-20T22:08:28.104 INFO:teuthology.orchestra.run.smithi050.stdout:163208757303 2024-05-20T22:08:28.104 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-20T22:08:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.150+0000 7fe9b9bb4640 1 -- 172.21.15.50:0/1442657392 >> v1:172.21.15.50:6789/0 conn(0x7fe9b4106650 legacy=0x7fe9b4106a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.150+0000 7fe9b9bb4640 1 -- 172.21.15.50:0/1442657392 shutdown_connections 2024-05-20T22:08:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.150+0000 7fe9b9bb4640 1 -- 172.21.15.50:0/1442657392 >> 172.21.15.50:0/1442657392 conn(0x7fe9b40fc0b0 msgr2=0x7fe9b40fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b9bb4640 1 -- 172.21.15.50:0/1442657392 shutdown_connections 2024-05-20T22:08:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b9bb4640 1 -- 172.21.15.50:0/1442657392 wait complete. 2024-05-20T22:08:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b9bb4640 1 Processor -- start 2024-05-20T22:08:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b9bb4640 1 -- start start 2024-05-20T22:08:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b9bb4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe9b4105e00 con 0x7fe9b4109400 2024-05-20T22:08:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b9bb4640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe9b41a7bc0 con 0x7fe9b410d000 2024-05-20T22:08:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b9bb4640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe9b41a8da0 con 0x7fe9b4106650 2024-05-20T22:08:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b37fe640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7fe9b4106650 0x7fe9b4103c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:56786/0 (socket says 172.21.15.50:56786) 2024-05-20T22:08:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b2ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe9b4109400 0x7fe9b4104350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33690/0 (socket says 172.21.15.50:33690) 2024-05-20T22:08:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b37fe640 1 -- 172.21.15.50:0/499054561 learned_addr learned my addr 172.21.15.50:0/499054561 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:08:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277359491 0 0) 0x7fe9b41a8da0 con 0x7fe9b4106650 2024-05-20T22:08:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9a0003520 con 0x7fe9b4106650 2024-05-20T22:08:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1266611173 0 0) 0x7fe9b4105e00 con 0x7fe9b4109400 2024-05-20T22:08:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9b41a8da0 con 0x7fe9b4109400 2024-05-20T22:08:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1204204695 0 0) 0x7fe9a0003520 con 0x7fe9b4106650 2024-05-20T22:08:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe9b4105e00 con 0x7fe9b4106650 2024-05-20T22:08:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fe9a4004540 con 0x7fe9b4106650 2024-05-20T22:08:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1510105570 0 0) 0x7fe9b41a8da0 con 0x7fe9b4109400 2024-05-20T22:08:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe9a0003520 con 0x7fe9b4109400 2024-05-20T22:08:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fe99c001830 con 0x7fe9b4109400 2024-05-20T22:08:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 380852691 0 0) 0x7fe9b41a7bc0 con 0x7fe9b410d000 2024-05-20T22:08:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9b41a8da0 con 0x7fe9b410d000 2024-05-20T22:08:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 112091400 0 0) 0x7fe9b4105e00 con 0x7fe9b4106650 2024-05-20T22:08:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 >> v1:172.21.15.145:6789/0 conn(0x7fe9b410d000 legacy=0x7fe9b41a5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 >> v1:172.21.15.50:6789/0 conn(0x7fe9b4109400 legacy=0x7fe9b4104350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:28.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b41a9f80 con 0x7fe9b4106650 2024-05-20T22:08:28.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b9bb4640 1 -- 172.21.15.50:0/499054561 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe9b41a6c10 con 0x7fe9b4106650 2024-05-20T22:08:28.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b9bb4640 1 -- 172.21.15.50:0/499054561 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe9b41a70d0 con 0x7fe9b4106650 2024-05-20T22:08:28.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7fe9a4003bf0 con 0x7fe9b4106650 2024-05-20T22:08:28.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.154+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fe9a40050a0 con 0x7fe9b4106650 2024-05-20T22:08:28.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.158+0000 7fe9b9bb4640 1 -- 172.21.15.50:0/499054561 --> v1:172.21.15.50:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fe9b4101cc0 con 0x7fe9b4106650 2024-05-20T22:08:28.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.158+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7fe9a4003760 con 0x7fe9b4106650 2024-05-20T22:08:28.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.158+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(74..74 src has 1..74) ==== 6201+0+0 (unknown 2490794606 0 0) 0x7fe9a4089860 con 0x7fe9b4106650 2024-05-20T22:08:28.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.158+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 --> v1:172.21.15.145:6800/2241357489 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9a4005830 con 0x7fe9a0079710 2024-05-20T22:08:28.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.158+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (unknown 3287965567 0 0) 0x7fe9a4089cd0 con 0x7fe9b4106650 2024-05-20T22:08:28.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.162+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 <== osd.4 v1:172.21.15.145:6800/2241357489 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fe9a4005830 con 0x7fe9a0079710 2024-05-20T22:08:28.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.194+0000 7fe9b9bb4640 1 -- 172.21.15.50:0/499054561 --> v1:172.21.15.145:6800/2241357489 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe9b40feed0 con 0x7fe9a0079710 2024-05-20T22:08:28.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.194+0000 7fe9b0ff9640 1 -- 172.21.15.50:0/499054561 <== osd.4 v1:172.21.15.145:6800/2241357489 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 177257940) 0x7fe9b40feed0 con 0x7fe9a0079710 2024-05-20T22:08:28.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.194+0000 7fe9b9bb4640 1 -- 172.21.15.50:0/499054561 >> v1:172.21.15.145:6800/2241357489 conn(0x7fe9a0079710 legacy=0x7fe9a007bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:28.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.194+0000 7fe9b9bb4640 1 -- 172.21.15.50:0/499054561 >> v1:172.21.15.50:6800/3332714287 conn(0x7fe9a006eea0 legacy=0x7fe9a0071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:28.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.194+0000 7fe9b9bb4640 1 -- 172.21.15.50:0/499054561 >> v1:172.21.15.50:6790/0 conn(0x7fe9b4106650 legacy=0x7fe9b4103c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:28.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.194+0000 7fe9b3fff640 1 -- 172.21.15.50:0/499054561 reap_dead start 2024-05-20T22:08:28.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.194+0000 7fe9b9bb4640 1 -- 172.21.15.50:0/499054561 shutdown_connections 2024-05-20T22:08:28.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.194+0000 7fe9b9bb4640 1 -- 172.21.15.50:0/499054561 >> 172.21.15.50:0/499054561 conn(0x7fe9b40fc0b0 msgr2=0x7fe9b4110500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:28.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.194+0000 7fe9b9bb4640 1 -- 172.21.15.50:0/499054561 shutdown_connections 2024-05-20T22:08:28.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:28.194+0000 7fe9b9bb4640 1 -- 172.21.15.50:0/499054561 wait complete. 2024-05-20T22:08:28.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:28 smithi050 bash[21866]: audit 2024-05-20T22:08:27.469247+0000 mgr.y (mgr.14592) 80 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:08:28.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:28 smithi050 bash[28929]: audit 2024-05-20T22:08:27.469247+0000 mgr.y (mgr.14592) 80 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:08:28.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:28 smithi145 bash[23893]: audit 2024-05-20T22:08:27.469247+0000 mgr.y (mgr.14592) 80 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:08:29.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.398+0000 7ff8d28ff640 1 -- 172.21.15.50:0/3472376470 >> v1:172.21.15.50:6789/0 conn(0x7ff8cc106650 legacy=0x7ff8cc106a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:29.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.398+0000 7ff8d28ff640 1 -- 172.21.15.50:0/3472376470 shutdown_connections 2024-05-20T22:08:29.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.398+0000 7ff8d28ff640 1 -- 172.21.15.50:0/3472376470 >> 172.21.15.50:0/3472376470 conn(0x7ff8cc0fc0b0 msgr2=0x7ff8cc0fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:29.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.398+0000 7ff8d28ff640 1 -- 172.21.15.50:0/3472376470 shutdown_connections 2024-05-20T22:08:29.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.398+0000 7ff8d28ff640 1 -- 172.21.15.50:0/3472376470 wait complete. 2024-05-20T22:08:29.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8d28ff640 1 Processor -- start 2024-05-20T22:08:29.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8d28ff640 1 -- start start 2024-05-20T22:08:29.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8d28ff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff8cc1a8ab0 con 0x7ff8cc109400 2024-05-20T22:08:29.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8d28ff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff8cc1a9cb0 con 0x7ff8cc10d000 2024-05-20T22:08:29.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8d28ff640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff8cc1aaef0 con 0x7ff8cc106650 2024-05-20T22:08:29.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8cbfff640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7ff8cc106650 0x7ff8cc10ef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:56810/0 (socket says 172.21.15.50:56810) 2024-05-20T22:08:29.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8cbfff640 1 -- 172.21.15.50:0/1542277173 learned_addr learned my addr 172.21.15.50:0/1542277173 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:08:29.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2550242260 0 0) 0x7ff8cc1aaef0 con 0x7ff8cc106650 2024-05-20T22:08:29.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8b8003520 con 0x7ff8cc106650 2024-05-20T22:08:29.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 893591877 0 0) 0x7ff8cc1a8ab0 con 0x7ff8cc109400 2024-05-20T22:08:29.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8cc1aaef0 con 0x7ff8cc109400 2024-05-20T22:08:29.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 792387727 0 0) 0x7ff8b8003520 con 0x7ff8cc106650 2024-05-20T22:08:29.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff8cc1a8ab0 con 0x7ff8cc106650 2024-05-20T22:08:29.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 931566342 0 0) 0x7ff8cc1aaef0 con 0x7ff8cc109400 2024-05-20T22:08:29.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff8b8003520 con 0x7ff8cc109400 2024-05-20T22:08:29.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7ff8bc0043b0 con 0x7ff8cc106650 2024-05-20T22:08:29.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7ff8b40018d0 con 0x7ff8cc109400 2024-05-20T22:08:29.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2000656199 0 0) 0x7ff8cc1a9cb0 con 0x7ff8cc10d000 2024-05-20T22:08:29.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8cc1aaef0 con 0x7ff8cc10d000 2024-05-20T22:08:29.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2670862357 0 0) 0x7ff8cc1a8ab0 con 0x7ff8cc106650 2024-05-20T22:08:29.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 >> v1:172.21.15.145:6789/0 conn(0x7ff8cc10d000 legacy=0x7ff8cc1a71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:29.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 >> v1:172.21.15.50:6789/0 conn(0x7ff8cc109400 legacy=0x7ff8cc1a3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:29.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc1ac130 con 0x7ff8cc106650 2024-05-20T22:08:29.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8d28ff640 1 -- 172.21.15.50:0/1542277173 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff8cc1a8ce0 con 0x7ff8cc106650 2024-05-20T22:08:29.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8d28ff640 1 -- 172.21.15.50:0/1542277173 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff8cc1a91a0 con 0x7ff8cc106650 2024-05-20T22:08:29.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7ff8bc001180 con 0x7ff8cc106650 2024-05-20T22:08:29.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7ff8bc004d20 con 0x7ff8cc106650 2024-05-20T22:08:29.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8d28ff640 1 -- 172.21.15.50:0/1542277173 --> v1:172.21.15.50:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff8ac000f80 con 0x7ff8cc106650 2024-05-20T22:08:29.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7ff8bc001ae0 con 0x7ff8cc106650 2024-05-20T22:08:29.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.402+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(74..74 src has 1..74) ==== 6201+0+0 (unknown 2490794606 0 0) 0x7ff8bc0896b0 con 0x7ff8cc106650 2024-05-20T22:08:29.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.406+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 --> v1:172.21.15.50:6805/4214903941 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8b807d2d0 con 0x7ff8b8079600 2024-05-20T22:08:29.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.406+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (unknown 3287965567 0 0) 0x7ff8bc089af0 con 0x7ff8cc106650 2024-05-20T22:08:29.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.406+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 <== osd.1 v1:172.21.15.50:6805/4214903941 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7ff8b807d2d0 con 0x7ff8b8079600 2024-05-20T22:08:29.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.422+0000 7ff8d28ff640 1 -- 172.21.15.50:0/1542277173 --> v1:172.21.15.50:6805/4214903941 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff8ac002c50 con 0x7ff8b8079600 2024-05-20T22:08:29.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.422+0000 7ff8c97fa640 1 -- 172.21.15.50:0/1542277173 <== osd.1 v1:172.21.15.50:6805/4214903941 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3112346271) 0x7ff8ac002c50 con 0x7ff8b8079600 2024-05-20T22:08:29.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.422+0000 7ff8d28ff640 1 -- 172.21.15.50:0/1542277173 >> v1:172.21.15.50:6805/4214903941 conn(0x7ff8b8079600 legacy=0x7ff8b807ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:29.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.422+0000 7ff8d28ff640 1 -- 172.21.15.50:0/1542277173 >> v1:172.21.15.50:6800/3332714287 conn(0x7ff8b806ee10 legacy=0x7ff8b80712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:29.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.422+0000 7ff8d28ff640 1 -- 172.21.15.50:0/1542277173 >> v1:172.21.15.50:6790/0 conn(0x7ff8cc106650 legacy=0x7ff8cc10ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.422+0000 7ff8d0e9c640 1 -- 172.21.15.50:0/1542277173 reap_dead start 2024-05-20T22:08:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.422+0000 7ff8d28ff640 1 -- 172.21.15.50:0/1542277173 shutdown_connections 2024-05-20T22:08:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.422+0000 7ff8d28ff640 1 -- 172.21.15.50:0/1542277173 >> 172.21.15.50:0/1542277173 conn(0x7ff8cc0fc0b0 msgr2=0x7ff8cc1104e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.422+0000 7ff8d28ff640 1 -- 172.21.15.50:0/1542277173 shutdown_connections 2024-05-20T22:08:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.422+0000 7ff8d28ff640 1 -- 172.21.15.50:0/1542277173 wait complete. 2024-05-20T22:08:29.451 INFO:teuthology.orchestra.run.smithi050.stdout:197568495661 2024-05-20T22:08:29.451 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-20T22:08:29.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.478+0000 7fc6376b5640 1 -- 172.21.15.50:0/2781628836 >> v1:172.21.15.50:6790/0 conn(0x7fc63010e150 legacy=0x7fc6301105c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:29.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.478+0000 7fc6376b5640 1 -- 172.21.15.50:0/2781628836 shutdown_connections 2024-05-20T22:08:29.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.478+0000 7fc6376b5640 1 -- 172.21.15.50:0/2781628836 >> 172.21.15.50:0/2781628836 conn(0x7fc6300fc080 msgr2=0x7fc6300fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:29.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.478+0000 7fc6376b5640 1 -- 172.21.15.50:0/2781628836 shutdown_connections 2024-05-20T22:08:29.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.478+0000 7fc6376b5640 1 -- 172.21.15.50:0/2781628836 wait complete. 2024-05-20T22:08:29.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.478+0000 7fc6376b5640 1 Processor -- start 2024-05-20T22:08:29.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.478+0000 7fc6376b5640 1 -- start start 2024-05-20T22:08:29.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.478+0000 7fc6376b5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc6301020b0 con 0x7fc630102830 2024-05-20T22:08:29.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.478+0000 7fc6376b5640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc6301022c0 con 0x7fc63010a640 2024-05-20T22:08:29.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.478+0000 7fc6376b5640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc6301ab090 con 0x7fc63010e150 2024-05-20T22:08:29.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.478+0000 7fc635451640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc630102830 0x7fc630100490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33718/0 (socket says 172.21.15.50:33718) 2024-05-20T22:08:29.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.478+0000 7fc635c52640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7fc63010e150 0x7fc6301a7950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:56824/0 (socket says 172.21.15.50:56824) 2024-05-20T22:08:29.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.478+0000 7fc635451640 1 -- 172.21.15.50:0/3405821609 learned_addr learned my addr 172.21.15.50:0/3405821609 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:08:29.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.478+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3868537164 0 0) 0x7fc6301ab090 con 0x7fc63010e150 2024-05-20T22:08:29.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.478+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc61c003520 con 0x7fc63010e150 2024-05-20T22:08:29.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.478+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2453199228 0 0) 0x7fc6301020b0 con 0x7fc630102830 2024-05-20T22:08:29.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.478+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6301ab090 con 0x7fc630102830 2024-05-20T22:08:29.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2330948143 0 0) 0x7fc6301022c0 con 0x7fc63010a640 2024-05-20T22:08:29.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6301020b0 con 0x7fc63010a640 2024-05-20T22:08:29.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1422917487 0 0) 0x7fc61c003520 con 0x7fc63010e150 2024-05-20T22:08:29.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc6301022c0 con 0x7fc63010e150 2024-05-20T22:08:29.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4063752071 0 0) 0x7fc6301ab090 con 0x7fc630102830 2024-05-20T22:08:29.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc61c003520 con 0x7fc630102830 2024-05-20T22:08:29.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fc6280017b0 con 0x7fc63010e150 2024-05-20T22:08:29.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fc62c001870 con 0x7fc630102830 2024-05-20T22:08:29.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3914145485 0 0) 0x7fc6301022c0 con 0x7fc63010e150 2024-05-20T22:08:29.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 >> v1:172.21.15.145:6789/0 conn(0x7fc63010a640 legacy=0x7fc630100ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:29.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 >> v1:172.21.15.50:6789/0 conn(0x7fc630102830 legacy=0x7fc630100490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:29.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6301ac270 con 0x7fc63010e150 2024-05-20T22:08:29.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6376b5640 1 -- 172.21.15.50:0/3405821609 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc6301ab2c0 con 0x7fc63010e150 2024-05-20T22:08:29.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6376b5640 1 -- 172.21.15.50:0/3405821609 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc6301ab780 con 0x7fc63010e150 2024-05-20T22:08:29.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7fc628001ef0 con 0x7fc63010e150 2024-05-20T22:08:29.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fc628005190 con 0x7fc63010e150 2024-05-20T22:08:29.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6376b5640 1 -- 172.21.15.50:0/3405821609 --> v1:172.21.15.50:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc614000f80 con 0x7fc63010e150 2024-05-20T22:08:29.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7fc628005330 con 0x7fc63010e150 2024-05-20T22:08:29.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(74..74 src has 1..74) ==== 6201+0+0 (unknown 2490794606 0 0) 0x7fc628089800 con 0x7fc63010e150 2024-05-20T22:08:29.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 --> v1:172.21.15.145:6812/2864002573 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc61c07d3a0 con 0x7fc61c0796d0 2024-05-20T22:08:29.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.482+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (unknown 3287965567 0 0) 0x7fc628089be0 con 0x7fc63010e150 2024-05-20T22:08:29.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.486+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 <== osd.7 v1:172.21.15.145:6812/2864002573 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fc61c07d3a0 con 0x7fc61c0796d0 2024-05-20T22:08:29.496 INFO:teuthology.orchestra.run.smithi050.stdout:77309411412 2024-05-20T22:08:29.497 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-20T22:08:29.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.502+0000 7fc6376b5640 1 -- 172.21.15.50:0/3405821609 --> v1:172.21.15.145:6812/2864002573 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc614002c50 con 0x7fc61c0796d0 2024-05-20T22:08:29.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.502+0000 7fc6267fc640 1 -- 172.21.15.50:0/3405821609 <== osd.7 v1:172.21.15.145:6812/2864002573 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 333379560) 0x7fc614002c50 con 0x7fc61c0796d0 2024-05-20T22:08:29.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.502+0000 7fc6376b5640 1 -- 172.21.15.50:0/3405821609 >> v1:172.21.15.145:6812/2864002573 conn(0x7fc61c0796d0 legacy=0x7fc61c07bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:29.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.502+0000 7fc6376b5640 1 -- 172.21.15.50:0/3405821609 >> v1:172.21.15.50:6800/3332714287 conn(0x7fc61c06ee60 legacy=0x7fc61c071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:29.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.502+0000 7fc6376b5640 1 -- 172.21.15.50:0/3405821609 >> v1:172.21.15.50:6790/0 conn(0x7fc63010e150 legacy=0x7fc6301a7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:29.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.502+0000 7fc635c52640 1 -- 172.21.15.50:0/3405821609 reap_dead start 2024-05-20T22:08:29.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.502+0000 7fc6376b5640 1 -- 172.21.15.50:0/3405821609 shutdown_connections 2024-05-20T22:08:29.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.502+0000 7fc6376b5640 1 -- 172.21.15.50:0/3405821609 >> 172.21.15.50:0/3405821609 conn(0x7fc6300fc080 msgr2=0x7fc630110580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:29.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.502+0000 7fc6376b5640 1 -- 172.21.15.50:0/3405821609 shutdown_connections 2024-05-20T22:08:29.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:29.502+0000 7fc6376b5640 1 -- 172.21.15.50:0/3405821609 wait complete. 2024-05-20T22:08:29.607 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:08:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:08:29.607 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:29 smithi050 bash[21866]: cluster 2024-05-20T22:08:27.869967+0000 mgr.y (mgr.14592) 81 : cluster 0 pgmap v42: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:29.607 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:29 smithi050 bash[21866]: audit 2024-05-20T22:08:29.049655+0000 mon.a (mon.0) 904 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:08:29.607 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:29 smithi050 bash[28929]: cluster 2024-05-20T22:08:27.869967+0000 mgr.y (mgr.14592) 81 : cluster 0 pgmap v42: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:29.607 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:29 smithi050 bash[28929]: audit 2024-05-20T22:08:29.049655+0000 mon.a (mon.0) 904 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:08:29.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:29 smithi145 bash[23893]: cluster 2024-05-20T22:08:27.869967+0000 mgr.y (mgr.14592) 81 : cluster 0 pgmap v42: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:29.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:29 smithi145 bash[23893]: audit 2024-05-20T22:08:29.049655+0000 mon.a (mon.0) 904 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:08:30.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.454+0000 7ff62e9ef640 1 -- 172.21.15.50:0/3587669743 >> v1:172.21.15.50:6789/0 conn(0x7ff62810d000 legacy=0x7ff62810f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:30.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.454+0000 7ff62e9ef640 1 -- 172.21.15.50:0/3587669743 shutdown_connections 2024-05-20T22:08:30.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.454+0000 7ff62e9ef640 1 -- 172.21.15.50:0/3587669743 >> 172.21.15.50:0/3587669743 conn(0x7ff6280fc0b0 msgr2=0x7ff6280fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:30.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.454+0000 7ff62e9ef640 1 -- 172.21.15.50:0/3587669743 shutdown_connections 2024-05-20T22:08:30.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.454+0000 7ff62e9ef640 1 -- 172.21.15.50:0/3587669743 wait complete. 2024-05-20T22:08:30.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.454+0000 7ff62e9ef640 1 Processor -- start 2024-05-20T22:08:30.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.454+0000 7ff62e9ef640 1 -- start start 2024-05-20T22:08:30.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff62e9ef640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff6280fe060 con 0x7ff628106650 2024-05-20T22:08:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff62e9ef640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff6280fe270 con 0x7ff62810d000 2024-05-20T22:08:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff62e9ef640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff6280fe480 con 0x7ff628109400 2024-05-20T22:08:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff627fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff628106650 0x7ff6280fc560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33738/0 (socket says 172.21.15.50:33738) 2024-05-20T22:08:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff627fff640 1 -- 172.21.15.50:0/3339884943 learned_addr learned my addr 172.21.15.50:0/3339884943 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:08:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1221388277 0 0) 0x7ff6280fe060 con 0x7ff628106650 2024-05-20T22:08:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff610003520 con 0x7ff628106650 2024-05-20T22:08:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1509920175 0 0) 0x7ff6280fe480 con 0x7ff628109400 2024-05-20T22:08:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6280fe060 con 0x7ff628109400 2024-05-20T22:08:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 753639507 0 0) 0x7ff6280fe060 con 0x7ff628109400 2024-05-20T22:08:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff6280fe480 con 0x7ff628109400 2024-05-20T22:08:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7ff61c0017b0 con 0x7ff628109400 2024-05-20T22:08:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2054977834 0 0) 0x7ff610003520 con 0x7ff628106650 2024-05-20T22:08:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff6280fe060 con 0x7ff628106650 2024-05-20T22:08:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7ff618001a30 con 0x7ff628106650 2024-05-20T22:08:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3024944868 0 0) 0x7ff6280fe270 con 0x7ff62810d000 2024-05-20T22:08:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff610003520 con 0x7ff62810d000 2024-05-20T22:08:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1009996551 0 0) 0x7ff6280fe480 con 0x7ff628109400 2024-05-20T22:08:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 >> v1:172.21.15.145:6789/0 conn(0x7ff62810d000 legacy=0x7ff6281a7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 >> v1:172.21.15.50:6789/0 conn(0x7ff628106650 legacy=0x7ff6280fc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6281ac010 con 0x7ff628109400 2024-05-20T22:08:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff62e9ef640 1 -- 172.21.15.50:0/3339884943 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff6281a9000 con 0x7ff628109400 2024-05-20T22:08:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff62e9ef640 1 -- 172.21.15.50:0/3339884943 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff6281a94c0 con 0x7ff628109400 2024-05-20T22:08:30.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7ff61c003aa0 con 0x7ff628109400 2024-05-20T22:08:30.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7ff61c0048d0 con 0x7ff628109400 2024-05-20T22:08:30.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff62e9ef640 1 -- 172.21.15.50:0/3339884943 --> v1:172.21.15.50:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff614000f80 con 0x7ff628109400 2024-05-20T22:08:30.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7ff61c0035f0 con 0x7ff628109400 2024-05-20T22:08:30.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(74..74 src has 1..74) ==== 6201+0+0 (unknown 2490794606 0 0) 0x7ff61c0882b0 con 0x7ff628109400 2024-05-20T22:08:30.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 --> v1:172.21.15.50:6813/3714877290 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff61007d2b0 con 0x7ff6100795e0 2024-05-20T22:08:30.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.458+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (unknown 3287965567 0 0) 0x7ff61c088720 con 0x7ff628109400 2024-05-20T22:08:30.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.462+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 <== osd.3 v1:172.21.15.50:6813/3714877290 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7ff61007d2b0 con 0x7ff6100795e0 2024-05-20T22:08:30.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.474+0000 7ff62e9ef640 1 -- 172.21.15.50:0/3339884943 --> v1:172.21.15.50:6813/3714877290 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff614002c50 con 0x7ff6100795e0 2024-05-20T22:08:30.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.474+0000 7ff6257fa640 1 -- 172.21.15.50:0/3339884943 <== osd.3 v1:172.21.15.50:6813/3714877290 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 2944738622) 0x7ff614002c50 con 0x7ff6100795e0 2024-05-20T22:08:30.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.474+0000 7ff62e9ef640 1 -- 172.21.15.50:0/3339884943 >> v1:172.21.15.50:6813/3714877290 conn(0x7ff6100795e0 legacy=0x7ff61007ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:30.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.474+0000 7ff62e9ef640 1 -- 172.21.15.50:0/3339884943 >> v1:172.21.15.50:6800/3332714287 conn(0x7ff61006ee70 legacy=0x7ff610071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:30.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.474+0000 7ff62e9ef640 1 -- 172.21.15.50:0/3339884943 >> v1:172.21.15.50:6790/0 conn(0x7ff628109400 legacy=0x7ff6280fcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:30.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.478+0000 7ff62cf8c640 1 -- 172.21.15.50:0/3339884943 reap_dead start 2024-05-20T22:08:30.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.478+0000 7ff62e9ef640 1 -- 172.21.15.50:0/3339884943 shutdown_connections 2024-05-20T22:08:30.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.478+0000 7ff62e9ef640 1 -- 172.21.15.50:0/3339884943 >> 172.21.15.50:0/3339884943 conn(0x7ff6280fc0b0 msgr2=0x7ff628110500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:30.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.478+0000 7ff62e9ef640 1 -- 172.21.15.50:0/3339884943 shutdown_connections 2024-05-20T22:08:30.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:30.478+0000 7ff62e9ef640 1 -- 172.21.15.50:0/3339884943 wait complete. 2024-05-20T22:08:30.639 INFO:teuthology.orchestra.run.smithi050.stdout:128849018943 2024-05-20T22:08:30.640 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-20T22:08:31.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:31 smithi050 bash[21866]: cluster 2024-05-20T22:08:29.871385+0000 mgr.y (mgr.14592) 82 : cluster 0 pgmap v43: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:31.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:31 smithi050 bash[28929]: cluster 2024-05-20T22:08:29.871385+0000 mgr.y (mgr.14592) 82 : cluster 0 pgmap v43: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:31.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:31 smithi145 bash[23893]: cluster 2024-05-20T22:08:29.871385+0000 mgr.y (mgr.14592) 82 : cluster 0 pgmap v43: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:31.704 INFO:teuthology.orchestra.run.smithi050.stdout:55834574944 2024-05-20T22:08:31.705 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-20T22:08:32.040 INFO:teuthology.orchestra.run.smithi050.stdout:231928234018 2024-05-20T22:08:32.040 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-20T22:08:32.204 INFO:teuthology.orchestra.run.smithi050.stdout:107374182475 2024-05-20T22:08:32.204 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-20T22:08:33.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:33 smithi145 bash[23893]: cluster 2024-05-20T22:08:31.871998+0000 mgr.y (mgr.14592) 83 : cluster 0 pgmap v44: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:33.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:33 smithi050 bash[21866]: cluster 2024-05-20T22:08:31.871998+0000 mgr.y (mgr.14592) 83 : cluster 0 pgmap v44: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:33.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:33 smithi050 bash[28929]: cluster 2024-05-20T22:08:31.871998+0000 mgr.y (mgr.14592) 83 : cluster 0 pgmap v44: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:35.219 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:08:35.220 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:08:35.220 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:08:35.221 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:08:35.223 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:08:35.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:35 smithi145 bash[23893]: cluster 2024-05-20T22:08:33.872607+0000 mgr.y (mgr.14592) 84 : cluster 0 pgmap v45: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:35.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:35 smithi050 bash[21866]: cluster 2024-05-20T22:08:33.872607+0000 mgr.y (mgr.14592) 84 : cluster 0 pgmap v45: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:35.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:35 smithi050 bash[28929]: cluster 2024-05-20T22:08:33.872607+0000 mgr.y (mgr.14592) 84 : cluster 0 pgmap v45: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:36.238 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:08:36.238 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:08:36.239 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:08:37.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:36 smithi050 bash[21866]: cluster 2024-05-20T22:08:35.873506+0000 mgr.y (mgr.14592) 85 : cluster 0 pgmap v46: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:37.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:36 smithi050 bash[21866]: audit 2024-05-20T22:08:35.917343+0000 mon.a (mon.0) 905 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:37.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:36 smithi050 bash[21866]: audit 2024-05-20T22:08:35.922668+0000 mon.a (mon.0) 906 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:37.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:36 smithi050 bash[21866]: audit 2024-05-20T22:08:36.476470+0000 mon.a (mon.0) 907 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:08:37.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:36 smithi050 bash[21866]: audit 2024-05-20T22:08:36.477408+0000 mon.a (mon.0) 908 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:08:37.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:36 smithi050 bash[21866]: audit 2024-05-20T22:08:36.484339+0000 mon.a (mon.0) 909 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:37.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:36 smithi050 bash[28929]: cluster 2024-05-20T22:08:35.873506+0000 mgr.y (mgr.14592) 85 : cluster 0 pgmap v46: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:37.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:36 smithi050 bash[28929]: audit 2024-05-20T22:08:35.917343+0000 mon.a (mon.0) 905 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:37.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:36 smithi050 bash[28929]: audit 2024-05-20T22:08:35.922668+0000 mon.a (mon.0) 906 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:37.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:36 smithi050 bash[28929]: audit 2024-05-20T22:08:36.476470+0000 mon.a (mon.0) 907 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:08:37.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:36 smithi050 bash[28929]: audit 2024-05-20T22:08:36.477408+0000 mon.a (mon.0) 908 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:08:37.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:36 smithi050 bash[28929]: audit 2024-05-20T22:08:36.484339+0000 mon.a (mon.0) 909 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:37.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:36 smithi145 bash[23893]: cluster 2024-05-20T22:08:35.873506+0000 mgr.y (mgr.14592) 85 : cluster 0 pgmap v46: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:37.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:36 smithi145 bash[23893]: audit 2024-05-20T22:08:35.917343+0000 mon.a (mon.0) 905 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:37.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:36 smithi145 bash[23893]: audit 2024-05-20T22:08:35.922668+0000 mon.a (mon.0) 906 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:37.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:36 smithi145 bash[23893]: audit 2024-05-20T22:08:36.476470+0000 mon.a (mon.0) 907 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:08:37.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:36 smithi145 bash[23893]: audit 2024-05-20T22:08:36.477408+0000 mon.a (mon.0) 908 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:08:37.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:36 smithi145 bash[23893]: audit 2024-05-20T22:08:36.484339+0000 mon.a (mon.0) 909 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:08:37.890 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:08:37 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:08:38.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:37 smithi050 bash[21866]: audit 2024-05-20T22:08:37.478090+0000 mgr.y (mgr.14592) 86 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:08:38.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:38 smithi050 bash[28929]: audit 2024-05-20T22:08:37.478090+0000 mgr.y (mgr.14592) 86 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:08:38.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:37 smithi145 bash[23893]: audit 2024-05-20T22:08:37.478090+0000 mgr.y (mgr.14592) 86 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:08:39.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:38 smithi050 bash[21866]: cluster 2024-05-20T22:08:37.874161+0000 mgr.y (mgr.14592) 87 : cluster 0 pgmap v47: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:39.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:38 smithi050 bash[28929]: cluster 2024-05-20T22:08:37.874161+0000 mgr.y (mgr.14592) 87 : cluster 0 pgmap v47: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:39.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:38 smithi145 bash[23893]: cluster 2024-05-20T22:08:37.874161+0000 mgr.y (mgr.14592) 87 : cluster 0 pgmap v47: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:39.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:08:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:08:41.236 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:40 smithi050 bash[21866]: cluster 2024-05-20T22:08:39.875105+0000 mgr.y (mgr.14592) 88 : cluster 0 pgmap v48: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:41.237 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:40 smithi050 bash[28929]: cluster 2024-05-20T22:08:39.875105+0000 mgr.y (mgr.14592) 88 : cluster 0 pgmap v48: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:41.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:40 smithi145 bash[23893]: cluster 2024-05-20T22:08:39.875105+0000 mgr.y (mgr.14592) 88 : cluster 0 pgmap v48: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:43.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:42 smithi050 bash[28929]: cluster 2024-05-20T22:08:41.875786+0000 mgr.y (mgr.14592) 89 : cluster 0 pgmap v49: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:43.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:42 smithi050 bash[21866]: cluster 2024-05-20T22:08:41.875786+0000 mgr.y (mgr.14592) 89 : cluster 0 pgmap v49: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:43.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:42 smithi145 bash[23893]: cluster 2024-05-20T22:08:41.875786+0000 mgr.y (mgr.14592) 89 : cluster 0 pgmap v49: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:45.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:44 smithi050 bash[21866]: cluster 2024-05-20T22:08:43.876260+0000 mgr.y (mgr.14592) 90 : cluster 0 pgmap v50: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-20T22:08:45.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:44 smithi050 bash[21866]: audit 2024-05-20T22:08:44.077704+0000 mon.a (mon.0) 910 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:08:45.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:44 smithi050 bash[28929]: cluster 2024-05-20T22:08:43.876260+0000 mgr.y (mgr.14592) 90 : cluster 0 pgmap v50: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-20T22:08:45.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:44 smithi050 bash[28929]: audit 2024-05-20T22:08:44.077704+0000 mon.a (mon.0) 910 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:08:45.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:44 smithi145 bash[23893]: cluster 2024-05-20T22:08:43.876260+0000 mgr.y (mgr.14592) 90 : cluster 0 pgmap v50: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-20T22:08:45.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:44 smithi145 bash[23893]: audit 2024-05-20T22:08:44.077704+0000 mon.a (mon.0) 910 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:08:46.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.270+0000 7f0234b28640 1 -- 172.21.15.50:0/713521546 >> v1:172.21.15.50:6790/0 conn(0x7f023010e160 legacy=0x7f02301105d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:46.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.270+0000 7f0234b28640 1 -- 172.21.15.50:0/713521546 shutdown_connections 2024-05-20T22:08:46.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.270+0000 7f0234b28640 1 -- 172.21.15.50:0/713521546 >> 172.21.15.50:0/713521546 conn(0x7f02300fc0b0 msgr2=0x7f02300fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:46.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.270+0000 7f0234b28640 1 -- 172.21.15.50:0/713521546 shutdown_connections 2024-05-20T22:08:46.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.270+0000 7f0234b28640 1 -- 172.21.15.50:0/713521546 wait complete. 2024-05-20T22:08:46.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.270+0000 7f0234b28640 1 Processor -- start 2024-05-20T22:08:46.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.270+0000 7f0234b28640 1 -- start start 2024-05-20T22:08:46.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.270+0000 7f0234b28640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f023010a260 con 0x7f023010e160 2024-05-20T22:08:46.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.270+0000 7f0234b28640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f02301a7ca0 con 0x7f023010a650 2024-05-20T22:08:46.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.270+0000 7f0234b28640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f02301a8e80 con 0x7f0230102840 2024-05-20T22:08:46.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.270+0000 7f022e59c640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7f0230102840 0x7f02301070f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:38858/0 (socket says 172.21.15.50:38858) 2024-05-20T22:08:46.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.270+0000 7f022e59c640 1 -- 172.21.15.50:0/640333049 learned_addr learned my addr 172.21.15.50:0/640333049 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:08:46.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f021f7fe640 1 -- 172.21.15.50:0/640333049 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3171229527 0 0) 0x7f023010a260 con 0x7f023010e160 2024-05-20T22:08:46.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f021f7fe640 1 -- 172.21.15.50:0/640333049 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0218003520 con 0x7f023010e160 2024-05-20T22:08:46.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f021f7fe640 1 -- 172.21.15.50:0/640333049 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3826481103 0 0) 0x7f02301a8e80 con 0x7f0230102840 2024-05-20T22:08:46.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f021f7fe640 1 -- 172.21.15.50:0/640333049 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f023010a260 con 0x7f0230102840 2024-05-20T22:08:46.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f021f7fe640 1 -- 172.21.15.50:0/640333049 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 59824334 0 0) 0x7f0218003520 con 0x7f023010e160 2024-05-20T22:08:46.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f021f7fe640 1 -- 172.21.15.50:0/640333049 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02301a8e80 con 0x7f023010e160 2024-05-20T22:08:46.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f021f7fe640 1 -- 172.21.15.50:0/640333049 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f0228001cd0 con 0x7f023010e160 2024-05-20T22:08:46.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f021f7fe640 1 -- 172.21.15.50:0/640333049 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2550837401 0 0) 0x7f023010a260 con 0x7f0230102840 2024-05-20T22:08:46.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f021f7fe640 1 -- 172.21.15.50:0/640333049 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0218003520 con 0x7f0230102840 2024-05-20T22:08:46.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f021f7fe640 1 -- 172.21.15.50:0/640333049 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f02200018d0 con 0x7f0230102840 2024-05-20T22:08:46.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f021f7fe640 1 -- 172.21.15.50:0/640333049 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4036795066 0 0) 0x7f02301a8e80 con 0x7f023010e160 2024-05-20T22:08:46.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f021f7fe640 1 -- 172.21.15.50:0/640333049 >> v1:172.21.15.50:6790/0 conn(0x7f0230102840 legacy=0x7f02301070f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:46.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f021f7fe640 1 -- 172.21.15.50:0/640333049 >> v1:172.21.15.145:6789/0 conn(0x7f023010a650 legacy=0x7f0230107800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:46.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f021f7fe640 1 -- 172.21.15.50:0/640333049 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02301aa060 con 0x7f023010e160 2024-05-20T22:08:46.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f0234b28640 1 -- 172.21.15.50:0/640333049 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f02301a90b0 con 0x7f023010e160 2024-05-20T22:08:46.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f0234b28640 1 -- 172.21.15.50:0/640333049 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f02301a9570 con 0x7f023010e160 2024-05-20T22:08:46.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f021f7fe640 1 -- 172.21.15.50:0/640333049 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f0228001470 con 0x7f023010e160 2024-05-20T22:08:46.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f021f7fe640 1 -- 172.21.15.50:0/640333049 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f02280050c0 con 0x7f023010e160 2024-05-20T22:08:46.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f0234b28640 1 -- 172.21.15.50:0/640333049 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0210005080 con 0x7f023010e160 2024-05-20T22:08:46.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f021f7fe640 1 -- 172.21.15.50:0/640333049 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f0228003a70 con 0x7f023010e160 2024-05-20T22:08:46.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.274+0000 7f021f7fe640 1 -- 172.21.15.50:0/640333049 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(74..74 src has 1..74) ==== 6201+0+0 (unknown 2490794606 0 0) 0x7f0228088790 con 0x7f023010e160 2024-05-20T22:08:46.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.278+0000 7f021f7fe640 1 -- 172.21.15.50:0/640333049 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f0228056030 con 0x7f023010e160 2024-05-20T22:08:46.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.474+0000 7f0234b28640 1 -- 172.21.15.50:0/640333049 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f0210005370 con 0x7f023010e160 2024-05-20T22:08:46.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.478+0000 7f021f7fe640 1 -- 172.21.15.50:0/640333049 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (unknown 2131975755 0 3006875556) 0x7f0228059ce0 con 0x7f023010e160 2024-05-20T22:08:46.474 INFO:teuthology.orchestra.run.smithi050.stdout:163208757307 2024-05-20T22:08:46.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.478+0000 7f0234b28640 1 -- 172.21.15.50:0/640333049 >> v1:172.21.15.50:6800/3332714287 conn(0x7f021806ec80 legacy=0x7f0218071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:46.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.478+0000 7f0234b28640 1 -- 172.21.15.50:0/640333049 >> v1:172.21.15.50:6789/0 conn(0x7f023010e160 legacy=0x7f02301a5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:46.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.478+0000 7f0234b28640 1 -- 172.21.15.50:0/640333049 shutdown_connections 2024-05-20T22:08:46.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.478+0000 7f0234b28640 1 -- 172.21.15.50:0/640333049 >> 172.21.15.50:0/640333049 conn(0x7f02300fc0b0 msgr2=0x7f0230110590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:46.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.478+0000 7f0234b28640 1 -- 172.21.15.50:0/640333049 shutdown_connections 2024-05-20T22:08:46.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:46.478+0000 7f0234b28640 1 -- 172.21.15.50:0/640333049 wait complete. 2024-05-20T22:08:47.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:46 smithi050 bash[21866]: cluster 2024-05-20T22:08:45.877656+0000 mgr.y (mgr.14592) 91 : cluster 0 pgmap v51: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:47.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:46 smithi050 bash[21866]: audit 2024-05-20T22:08:46.479912+0000 mon.a (mon.0) 911 : audit 0 from='client.? v1:172.21.15.50:0/640333049' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-20T22:08:47.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:46 smithi050 bash[28929]: cluster 2024-05-20T22:08:45.877656+0000 mgr.y (mgr.14592) 91 : cluster 0 pgmap v51: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:47.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:46 smithi050 bash[28929]: audit 2024-05-20T22:08:46.479912+0000 mon.a (mon.0) 911 : audit 0 from='client.? v1:172.21.15.50:0/640333049' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-20T22:08:47.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:46 smithi145 bash[23893]: cluster 2024-05-20T22:08:45.877656+0000 mgr.y (mgr.14592) 91 : cluster 0 pgmap v51: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:47.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:46 smithi145 bash[23893]: audit 2024-05-20T22:08:46.479912+0000 mon.a (mon.0) 911 : audit 0 from='client.? v1:172.21.15.50:0/640333049' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-20T22:08:47.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.798+0000 7f8cd4b23640 1 -- 172.21.15.50:0/328416548 >> v1:172.21.15.50:6790/0 conn(0x7f8cd010a720 legacy=0x7f8cd010cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:47.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.798+0000 7f8cd4b23640 1 -- 172.21.15.50:0/328416548 shutdown_connections 2024-05-20T22:08:47.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.798+0000 7f8cd4b23640 1 -- 172.21.15.50:0/328416548 >> 172.21.15.50:0/328416548 conn(0x7f8cd00fc080 msgr2=0x7f8cd00fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:47.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.798+0000 7f8cd4b23640 1 -- 172.21.15.50:0/328416548 shutdown_connections 2024-05-20T22:08:47.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.798+0000 7f8cd4b23640 1 -- 172.21.15.50:0/328416548 wait complete. 2024-05-20T22:08:47.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.798+0000 7f8cd4b23640 1 Processor -- start 2024-05-20T22:08:47.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cd4b23640 1 -- start start 2024-05-20T22:08:47.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cd4b23640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f8cd010dab0 con 0x7f8cd010a720 2024-05-20T22:08:47.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cd4b23640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f8cd01a9b80 con 0x7f8cd010e230 2024-05-20T22:08:47.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cd4b23640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f8cd01aad60 con 0x7f8cd0102910 2024-05-20T22:08:47.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8ccdd9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8cd010a720 0x7f8cd01a3d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52720/0 (socket says 172.21.15.50:52720) 2024-05-20T22:08:47.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8ccdd9b640 1 -- 172.21.15.50:0/2168244180 learned_addr learned my addr 172.21.15.50:0/2168244180 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:08:47.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1188706557 0 0) 0x7f8cd010dab0 con 0x7f8cd010a720 2024-05-20T22:08:47.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cb8003160 con 0x7f8cd010a720 2024-05-20T22:08:47.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3155108774 0 0) 0x7f8cd01aad60 con 0x7f8cd0102910 2024-05-20T22:08:47.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cd010dab0 con 0x7f8cd0102910 2024-05-20T22:08:47.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3105037040 0 0) 0x7f8cb8003160 con 0x7f8cd010a720 2024-05-20T22:08:47.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8cd01aad60 con 0x7f8cd010a720 2024-05-20T22:08:47.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f8cc4004590 con 0x7f8cd010a720 2024-05-20T22:08:47.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 864138416 0 0) 0x7f8cd01a9b80 con 0x7f8cd010e230 2024-05-20T22:08:47.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cb8003160 con 0x7f8cd010e230 2024-05-20T22:08:47.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1843280238 0 0) 0x7f8cd010dab0 con 0x7f8cd0102910 2024-05-20T22:08:47.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8cd01a9b80 con 0x7f8cd0102910 2024-05-20T22:08:47.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f8cc00018d0 con 0x7f8cd0102910 2024-05-20T22:08:47.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1806990518 0 0) 0x7f8cd01aad60 con 0x7f8cd010a720 2024-05-20T22:08:47.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 >> v1:172.21.15.50:6790/0 conn(0x7f8cd0102910 legacy=0x7f8cd010ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:47.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 >> v1:172.21.15.145:6789/0 conn(0x7f8cd010e230 legacy=0x7f8cd01a7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:47.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd01abfa0 con 0x7f8cd010a720 2024-05-20T22:08:47.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cd4b23640 1 -- 172.21.15.50:0/2168244180 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd01aaf90 con 0x7f8cd010a720 2024-05-20T22:08:47.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cd4b23640 1 -- 172.21.15.50:0/2168244180 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8cd01ab450 con 0x7f8cd010a720 2024-05-20T22:08:47.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f8cc4001bb0 con 0x7f8cd010a720 2024-05-20T22:08:47.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f8cc4004d10 con 0x7f8cd010a720 2024-05-20T22:08:47.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cd4b23640 1 -- 172.21.15.50:0/2168244180 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb0005080 con 0x7f8cd010a720 2024-05-20T22:08:47.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.802+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f8cc4004f50 con 0x7f8cd010a720 2024-05-20T22:08:47.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.806+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(74..74 src has 1..74) ==== 6201+0+0 (unknown 2490794606 0 0) 0x7f8cc4089480 con 0x7f8cd010a720 2024-05-20T22:08:47.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:47.810+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f8cc4056d00 con 0x7f8cd010a720 2024-05-20T22:08:47.890 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:08:47 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:08:48.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:48.006+0000 7f8cd4b23640 1 -- 172.21.15.50:0/2168244180 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8cb0005370 con 0x7f8cd010a720 2024-05-20T22:08:48.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:48.006+0000 7f8cbf7fe640 1 -- 172.21.15.50:0/2168244180 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 3196048998) 0x7f8cc405a9b0 con 0x7f8cd010a720 2024-05-20T22:08:48.003 INFO:teuthology.orchestra.run.smithi050.stdout:34359738478 2024-05-20T22:08:48.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:48.006+0000 7f8cd4b23640 1 -- 172.21.15.50:0/2168244180 >> v1:172.21.15.50:6800/3332714287 conn(0x7f8cb806ef40 legacy=0x7f8cb8071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:48.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:48.006+0000 7f8cd4b23640 1 -- 172.21.15.50:0/2168244180 >> v1:172.21.15.50:6789/0 conn(0x7f8cd010a720 legacy=0x7f8cd01a3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:48.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:48.006+0000 7f8cd4b23640 1 -- 172.21.15.50:0/2168244180 shutdown_connections 2024-05-20T22:08:48.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:48.006+0000 7f8cd4b23640 1 -- 172.21.15.50:0/2168244180 >> 172.21.15.50:0/2168244180 conn(0x7f8cd00fc080 msgr2=0x7f8cd0110620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:48.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:48.010+0000 7f8cd4b23640 1 -- 172.21.15.50:0/2168244180 shutdown_connections 2024-05-20T22:08:48.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:48.010+0000 7f8cd4b23640 1 -- 172.21.15.50:0/2168244180 wait complete. 2024-05-20T22:08:48.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:47 smithi145 bash[23893]: audit 2024-05-20T22:08:47.489557+0000 mgr.y (mgr.14592) 92 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:08:48.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:47 smithi050 bash[21866]: audit 2024-05-20T22:08:47.489557+0000 mgr.y (mgr.14592) 92 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:08:48.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:47 smithi050 bash[28929]: audit 2024-05-20T22:08:47.489557+0000 mgr.y (mgr.14592) 92 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:08:48.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:48.998+0000 7fc166337640 1 -- 172.21.15.50:0/1653155339 >> v1:172.21.15.50:6789/0 conn(0x7fc1601098e0 legacy=0x7fc160109cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:48.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:48.998+0000 7fc166337640 1 -- 172.21.15.50:0/1653155339 shutdown_connections 2024-05-20T22:08:48.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:48.998+0000 7fc166337640 1 -- 172.21.15.50:0/1653155339 >> 172.21.15.50:0/1653155339 conn(0x7fc1600ff3d0 msgr2=0x7fc1601017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:48.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:48.998+0000 7fc166337640 1 -- 172.21.15.50:0/1653155339 shutdown_connections 2024-05-20T22:08:48.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:48.998+0000 7fc166337640 1 -- 172.21.15.50:0/1653155339 wait complete. 2024-05-20T22:08:48.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:48.998+0000 7fc166337640 1 Processor -- start 2024-05-20T22:08:48.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:48.998+0000 7fc166337640 1 -- start start 2024-05-20T22:08:48.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:48.998+0000 7fc166337640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc1601a88a0 con 0x7fc1601098e0 2024-05-20T22:08:48.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:48.998+0000 7fc166337640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc1601a9ae0 con 0x7fc16010c790 2024-05-20T22:08:48.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:48.998+0000 7fc166337640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc1601aad20 con 0x7fc160110330 2024-05-20T22:08:48.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:48.998+0000 7fc15ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc1601098e0 0x7fc16010fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52736/0 (socket says 172.21.15.50:52736) 2024-05-20T22:08:48.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:48.998+0000 7fc15ffff640 1 -- 172.21.15.50:0/637197947 learned_addr learned my addr 172.21.15.50:0/637197947 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:08:48.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2812632710 0 0) 0x7fc1601a88a0 con 0x7fc1601098e0 2024-05-20T22:08:48.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc148003160 con 0x7fc1601098e0 2024-05-20T22:08:48.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3657672501 0 0) 0x7fc1601aad20 con 0x7fc160110330 2024-05-20T22:08:48.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1601a88a0 con 0x7fc160110330 2024-05-20T22:08:48.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 327880207 0 0) 0x7fc148003160 con 0x7fc1601098e0 2024-05-20T22:08:48.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1601aad20 con 0x7fc1601098e0 2024-05-20T22:08:48.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fc150004480 con 0x7fc1601098e0 2024-05-20T22:08:48.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1411749299 0 0) 0x7fc1601a9ae0 con 0x7fc16010c790 2024-05-20T22:08:48.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc148003160 con 0x7fc16010c790 2024-05-20T22:08:48.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3749035047 0 0) 0x7fc1601a88a0 con 0x7fc160110330 2024-05-20T22:08:49.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1601a9ae0 con 0x7fc160110330 2024-05-20T22:08:49.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fc158001af0 con 0x7fc160110330 2024-05-20T22:08:49.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4245029738 0 0) 0x7fc1601aad20 con 0x7fc1601098e0 2024-05-20T22:08:49.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 >> v1:172.21.15.50:6790/0 conn(0x7fc160110330 legacy=0x7fc1601a6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:49.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 >> v1:172.21.15.145:6789/0 conn(0x7fc16010c790 legacy=0x7fc1601a37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:49.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1601abf60 con 0x7fc1601098e0 2024-05-20T22:08:49.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc166337640 1 -- 172.21.15.50:0/637197947 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc1601aaf50 con 0x7fc1601098e0 2024-05-20T22:08:49.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc166337640 1 -- 172.21.15.50:0/637197947 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc1601ab410 con 0x7fc1601098e0 2024-05-20T22:08:49.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7fc150001b50 con 0x7fc1601098e0 2024-05-20T22:08:49.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fc150004d00 con 0x7fc1601098e0 2024-05-20T22:08:49.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc166337640 1 -- 172.21.15.50:0/637197947 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc14c005080 con 0x7fc1601098e0 2024-05-20T22:08:49.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7fc150004ea0 con 0x7fc1601098e0 2024-05-20T22:08:49.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.002+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(74..74 src has 1..74) ==== 6201+0+0 (unknown 2490794606 0 0) 0x7fc150089800 con 0x7fc1601098e0 2024-05-20T22:08:49.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.006+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7fc150056f40 con 0x7fc1601098e0 2024-05-20T22:08:49.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:48 smithi050 bash[21866]: cluster 2024-05-20T22:08:47.878441+0000 mgr.y (mgr.14592) 93 : cluster 0 pgmap v52: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:49.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:48 smithi050 bash[21866]: audit 2024-05-20T22:08:48.008784+0000 mon.a (mon.0) 912 : audit 0 from='client.? v1:172.21.15.50:0/2168244180' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-20T22:08:49.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:48 smithi050 bash[28929]: cluster 2024-05-20T22:08:47.878441+0000 mgr.y (mgr.14592) 93 : cluster 0 pgmap v52: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:49.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:48 smithi050 bash[28929]: audit 2024-05-20T22:08:48.008784+0000 mon.a (mon.0) 912 : audit 0 from='client.? v1:172.21.15.50:0/2168244180' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-20T22:08:49.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.206+0000 7fc166337640 1 -- 172.21.15.50:0/637197947 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc14c005370 con 0x7fc1601098e0 2024-05-20T22:08:49.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.206+0000 7fc15d7fa640 1 -- 172.21.15.50:0/637197947 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 1453467988) 0x7fc15005abf0 con 0x7fc1601098e0 2024-05-20T22:08:49.204 INFO:teuthology.orchestra.run.smithi050.stdout:77309411416 2024-05-20T22:08:49.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.210+0000 7fc166337640 1 -- 172.21.15.50:0/637197947 >> v1:172.21.15.50:6800/3332714287 conn(0x7fc14806eea0 legacy=0x7fc148071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:49.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.210+0000 7fc166337640 1 -- 172.21.15.50:0/637197947 >> v1:172.21.15.50:6789/0 conn(0x7fc1601098e0 legacy=0x7fc16010fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:49.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.210+0000 7fc166337640 1 -- 172.21.15.50:0/637197947 shutdown_connections 2024-05-20T22:08:49.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.210+0000 7fc166337640 1 -- 172.21.15.50:0/637197947 >> 172.21.15.50:0/637197947 conn(0x7fc1600ff3d0 msgr2=0x7fc1601038e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:49.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.210+0000 7fc166337640 1 -- 172.21.15.50:0/637197947 shutdown_connections 2024-05-20T22:08:49.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.210+0000 7fc166337640 1 -- 172.21.15.50:0/637197947 wait complete. 2024-05-20T22:08:49.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:48 smithi145 bash[23893]: cluster 2024-05-20T22:08:47.878441+0000 mgr.y (mgr.14592) 93 : cluster 0 pgmap v52: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:49.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:48 smithi145 bash[23893]: audit 2024-05-20T22:08:48.008784+0000 mon.a (mon.0) 912 : audit 0 from='client.? v1:172.21.15.50:0/2168244180' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-20T22:08:49.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:08:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:08:49.734 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757303 got 163208757307 for osd.5 2024-05-20T22:08:49.734 DEBUG:teuthology.parallel:result is None 2024-05-20T22:08:49.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafc15b9640 1 -- 172.21.15.50:0/4139095911 >> v1:172.21.15.50:6790/0 conn(0x7fafbc10e160 legacy=0x7fafbc1105d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:49.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafc15b9640 1 -- 172.21.15.50:0/4139095911 shutdown_connections 2024-05-20T22:08:49.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafc15b9640 1 -- 172.21.15.50:0/4139095911 >> 172.21.15.50:0/4139095911 conn(0x7fafbc0fc0b0 msgr2=0x7fafbc0fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:49.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafc15b9640 1 -- 172.21.15.50:0/4139095911 shutdown_connections 2024-05-20T22:08:49.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafc15b9640 1 -- 172.21.15.50:0/4139095911 wait complete. 2024-05-20T22:08:49.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafc15b9640 1 Processor -- start 2024-05-20T22:08:49.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafc15b9640 1 -- start start 2024-05-20T22:08:49.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafc15b9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fafbc10a350 con 0x7fafbc102840 2024-05-20T22:08:49.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafc15b9640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fafbc1a7ca0 con 0x7fafbc10e160 2024-05-20T22:08:49.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafc15b9640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fafbc1a8e80 con 0x7fafbc10a650 2024-05-20T22:08:49.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafba7fc640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7fafbc10a650 0x7fafbc1078f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:59918/0 (socket says 172.21.15.50:59918) 2024-05-20T22:08:49.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafba7fc640 1 -- 172.21.15.50:0/2920654458 learned_addr learned my addr 172.21.15.50:0/2920654458 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:08:49.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4089114120 0 0) 0x7fafbc1a8e80 con 0x7fafbc10a650 2024-05-20T22:08:49.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafa4003520 con 0x7fafbc10a650 2024-05-20T22:08:49.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1048347279 0 0) 0x7fafbc10a350 con 0x7fafbc102840 2024-05-20T22:08:49.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafbc1a8e80 con 0x7fafbc102840 2024-05-20T22:08:49.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 297512452 0 0) 0x7fafa4003520 con 0x7fafbc10a650 2024-05-20T22:08:49.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fafbc10a350 con 0x7fafbc10a650 2024-05-20T22:08:49.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fafb0001970 con 0x7fafbc10a650 2024-05-20T22:08:49.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2036569137 0 0) 0x7fafbc1a8e80 con 0x7fafbc102840 2024-05-20T22:08:49.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fafa4003520 con 0x7fafbc102840 2024-05-20T22:08:49.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1601127283 0 0) 0x7fafbc1a7ca0 con 0x7fafbc10e160 2024-05-20T22:08:49.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafbc1a8e80 con 0x7fafbc10e160 2024-05-20T22:08:49.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fafac001aa0 con 0x7fafbc102840 2024-05-20T22:08:49.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3866916561 0 0) 0x7fafbc10a350 con 0x7fafbc10a650 2024-05-20T22:08:49.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.878+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 >> v1:172.21.15.145:6789/0 conn(0x7fafbc10e160 legacy=0x7fafbc1a5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:49.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.882+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 >> v1:172.21.15.50:6789/0 conn(0x7fafbc102840 legacy=0x7fafbc1071e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:49.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.882+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafbc1aa060 con 0x7fafbc10a650 2024-05-20T22:08:49.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.882+0000 7fafc15b9640 1 -- 172.21.15.50:0/2920654458 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fafbc1a6cf0 con 0x7fafbc10a650 2024-05-20T22:08:49.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.882+0000 7fafc15b9640 1 -- 172.21.15.50:0/2920654458 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fafbc1a71b0 con 0x7fafbc10a650 2024-05-20T22:08:49.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.882+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7fafb0003aa0 con 0x7fafbc10a650 2024-05-20T22:08:49.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.882+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fafb0005c80 con 0x7fafbc10a650 2024-05-20T22:08:49.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.882+0000 7fafc15b9640 1 -- 172.21.15.50:0/2920654458 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafa8005080 con 0x7fafbc10a650 2024-05-20T22:08:49.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.882+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7fafb00035f0 con 0x7fafbc10a650 2024-05-20T22:08:49.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.882+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(74..74 src has 1..74) ==== 6201+0+0 (unknown 2490794606 0 0) 0x7fafb0089550 con 0x7fafbc10a650 2024-05-20T22:08:49.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:49.886+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7fafb0056cf0 con 0x7fafbc10a650 2024-05-20T22:08:50.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.090+0000 7fafc15b9640 1 -- 172.21.15.50:0/2920654458 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fafa8005370 con 0x7fafbc10a650 2024-05-20T22:08:50.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.090+0000 7fafa3fff640 1 -- 172.21.15.50:0/2920654458 <== mon.2 v1:172.21.15.50:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (unknown 1823589948 0 3595740432) 0x7fafb005a9a0 con 0x7fafbc10a650 2024-05-20T22:08:50.088 INFO:teuthology.orchestra.run.smithi050.stdout:128849018948 2024-05-20T22:08:50.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.094+0000 7fafc15b9640 1 -- 172.21.15.50:0/2920654458 >> v1:172.21.15.50:6800/3332714287 conn(0x7fafa4073250 legacy=0x7fafa4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:50.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.094+0000 7fafc15b9640 1 -- 172.21.15.50:0/2920654458 >> v1:172.21.15.50:6790/0 conn(0x7fafbc10a650 legacy=0x7fafbc1078f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:50.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.094+0000 7fafc15b9640 1 -- 172.21.15.50:0/2920654458 shutdown_connections 2024-05-20T22:08:50.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.094+0000 7fafc15b9640 1 -- 172.21.15.50:0/2920654458 >> 172.21.15.50:0/2920654458 conn(0x7fafbc0fc0b0 msgr2=0x7fafbc110590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:50.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.094+0000 7fafc15b9640 1 -- 172.21.15.50:0/2920654458 shutdown_connections 2024-05-20T22:08:50.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.094+0000 7fafc15b9640 1 -- 172.21.15.50:0/2920654458 wait complete. 2024-05-20T22:08:50.118 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:49 smithi050 bash[21866]: audit 2024-05-20T22:08:49.209944+0000 mon.a (mon.0) 913 : audit 0 from='client.? v1:172.21.15.50:0/637197947' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-20T22:08:50.118 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:49 smithi050 bash[28929]: audit 2024-05-20T22:08:49.209944+0000 mon.a (mon.0) 913 : audit 0 from='client.? v1:172.21.15.50:0/637197947' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-20T22:08:50.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:49 smithi145 bash[23893]: audit 2024-05-20T22:08:49.209944+0000 mon.a (mon.0) 913 : audit 0 from='client.? v1:172.21.15.50:0/637197947' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-20T22:08:50.774 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738473 got 34359738478 for osd.0 2024-05-20T22:08:50.775 DEBUG:teuthology.parallel:result is None 2024-05-20T22:08:50.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.810+0000 7f1335ccb640 1 -- 172.21.15.50:0/1891511167 >> v1:172.21.15.50:6789/0 conn(0x7f1330076850 legacy=0x7f1330113030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:50.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.810+0000 7f1335ccb640 1 -- 172.21.15.50:0/1891511167 shutdown_connections 2024-05-20T22:08:50.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.810+0000 7f1335ccb640 1 -- 172.21.15.50:0/1891511167 >> 172.21.15.50:0/1891511167 conn(0x7f13300ff370 msgr2=0x7f1330101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:50.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.810+0000 7f1335ccb640 1 -- 172.21.15.50:0/1891511167 shutdown_connections 2024-05-20T22:08:50.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.810+0000 7f1335ccb640 1 -- 172.21.15.50:0/1891511167 wait complete. 2024-05-20T22:08:50.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.810+0000 7f1335ccb640 1 Processor -- start 2024-05-20T22:08:50.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.810+0000 7f1335ccb640 1 -- start start 2024-05-20T22:08:50.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.810+0000 7f1335ccb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f13301acdc0 con 0x7f1330075d60 2024-05-20T22:08:50.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.810+0000 7f1335ccb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f13301ae000 con 0x7f1330076850 2024-05-20T22:08:50.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.810+0000 7f1335ccb640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f13301af240 con 0x7f1330114750 2024-05-20T22:08:50.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.810+0000 7f132f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1330075d60 0x7f1330114010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52768/0 (socket says 172.21.15.50:52768) 2024-05-20T22:08:50.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.810+0000 7f132f7fe640 1 -- 172.21.15.50:0/2116022380 learned_addr learned my addr 172.21.15.50:0/2116022380 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:08:50.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1031286040 0 0) 0x7f13301acdc0 con 0x7f1330075d60 2024-05-20T22:08:50.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1318003520 con 0x7f1330075d60 2024-05-20T22:08:50.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 280293091 0 0) 0x7f13301af240 con 0x7f1330114750 2024-05-20T22:08:50.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13301acdc0 con 0x7f1330114750 2024-05-20T22:08:50.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3641523495 0 0) 0x7f1318003520 con 0x7f1330075d60 2024-05-20T22:08:50.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13301af240 con 0x7f1330075d60 2024-05-20T22:08:50.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f1320001930 con 0x7f1330075d60 2024-05-20T22:08:50.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2131847875 0 0) 0x7f13301ae000 con 0x7f1330076850 2024-05-20T22:08:50.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1318003520 con 0x7f1330076850 2024-05-20T22:08:50.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3393856433 0 0) 0x7f13301acdc0 con 0x7f1330114750 2024-05-20T22:08:50.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13301ae000 con 0x7f1330114750 2024-05-20T22:08:50.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f1328001bd0 con 0x7f1330114750 2024-05-20T22:08:50.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3124812479 0 0) 0x7f13301af240 con 0x7f1330075d60 2024-05-20T22:08:50.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 >> v1:172.21.15.50:6790/0 conn(0x7f1330114750 legacy=0x7f13301ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:50.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 >> v1:172.21.15.145:6789/0 conn(0x7f1330076850 legacy=0x7f13301a7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:50.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13301b0480 con 0x7f1330075d60 2024-05-20T22:08:50.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f1335ccb640 1 -- 172.21.15.50:0/2116022380 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f13301af470 con 0x7f1330075d60 2024-05-20T22:08:50.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f1335ccb640 1 -- 172.21.15.50:0/2116022380 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f13301af930 con 0x7f1330075d60 2024-05-20T22:08:50.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f1320003aa0 con 0x7f1330075d60 2024-05-20T22:08:50.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f1320005c90 con 0x7f1330075d60 2024-05-20T22:08:50.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f1335ccb640 1 -- 172.21.15.50:0/2116022380 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f131c0050b0 con 0x7f1330075d60 2024-05-20T22:08:50.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f1320005f60 con 0x7f1330075d60 2024-05-20T22:08:50.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.814+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(74..74 src has 1..74) ==== 6201+0+0 (unknown 2490794606 0 0) 0x7f1320089710 con 0x7f1330075d60 2024-05-20T22:08:50.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:50.818+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f1320056eb0 con 0x7f1330075d60 2024-05-20T22:08:51.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.018+0000 7f1335ccb640 1 -- 172.21.15.50:0/2116022380 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f131c0053a0 con 0x7f1330075d60 2024-05-20T22:08:51.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.022+0000 7f132cff9640 1 -- 172.21.15.50:0/2116022380 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (unknown 1274345170 0 3415501099) 0x7f132005ab60 con 0x7f1330075d60 2024-05-20T22:08:51.018 INFO:teuthology.orchestra.run.smithi050.stdout:197568495666 2024-05-20T22:08:51.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.022+0000 7f1335ccb640 1 -- 172.21.15.50:0/2116022380 >> v1:172.21.15.50:6800/3332714287 conn(0x7f131806ee70 legacy=0x7f1318071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:51.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.022+0000 7f1335ccb640 1 -- 172.21.15.50:0/2116022380 >> v1:172.21.15.50:6789/0 conn(0x7f1330075d60 legacy=0x7f1330114010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:51.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.022+0000 7f1335ccb640 1 -- 172.21.15.50:0/2116022380 shutdown_connections 2024-05-20T22:08:51.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.022+0000 7f1335ccb640 1 -- 172.21.15.50:0/2116022380 >> 172.21.15.50:0/2116022380 conn(0x7f13300ff370 msgr2=0x7f1330078220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:51.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.022+0000 7f1335ccb640 1 -- 172.21.15.50:0/2116022380 shutdown_connections 2024-05-20T22:08:51.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.022+0000 7f1335ccb640 1 -- 172.21.15.50:0/2116022380 wait complete. 2024-05-20T22:08:51.027 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:50 smithi050 bash[21866]: cluster 2024-05-20T22:08:49.879817+0000 mgr.y (mgr.14592) 94 : cluster 0 pgmap v53: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:51.027 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:50 smithi050 bash[21866]: audit 2024-05-20T22:08:50.094212+0000 mon.c (mon.2) 19 : audit 0 from='client.? v1:172.21.15.50:0/2920654458' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-20T22:08:51.027 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:50 smithi050 bash[28929]: cluster 2024-05-20T22:08:49.879817+0000 mgr.y (mgr.14592) 94 : cluster 0 pgmap v53: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:51.027 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:50 smithi050 bash[28929]: audit 2024-05-20T22:08:50.094212+0000 mon.c (mon.2) 19 : audit 0 from='client.? v1:172.21.15.50:0/2920654458' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-20T22:08:51.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.130+0000 7effc84d1640 1 -- 172.21.15.50:0/4273228579 >> v1:172.21.15.50:6790/0 conn(0x7effc010a570 legacy=0x7effc010c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:51.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.130+0000 7effc84d1640 1 -- 172.21.15.50:0/4273228579 shutdown_connections 2024-05-20T22:08:51.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.130+0000 7effc84d1640 1 -- 172.21.15.50:0/4273228579 >> 172.21.15.50:0/4273228579 conn(0x7effc00fd1d0 msgr2=0x7effc00ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:51.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.130+0000 7effc84d1640 1 -- 172.21.15.50:0/4273228579 shutdown_connections 2024-05-20T22:08:51.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.130+0000 7effc84d1640 1 -- 172.21.15.50:0/4273228579 wait complete. 2024-05-20T22:08:51.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effc84d1640 1 Processor -- start 2024-05-20T22:08:51.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effc84d1640 1 -- start start 2024-05-20T22:08:51.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effc84d1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7effc01a6740 con 0x7effc01076c0 2024-05-20T22:08:51.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effc84d1640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7effc01a7980 con 0x7effc010e110 2024-05-20T22:08:51.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effc84d1640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7effc01a8bc0 con 0x7effc010a570 2024-05-20T22:08:51.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effc626d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7effc01076c0 0x7effc010d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52794/0 (socket says 172.21.15.50:52794) 2024-05-20T22:08:51.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effc626d640 1 -- 172.21.15.50:0/2011463010 learned_addr learned my addr 172.21.15.50:0/2011463010 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:08:51.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1709124106 0 0) 0x7effc01a8bc0 con 0x7effc010a570 2024-05-20T22:08:51.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effac003520 con 0x7effc010a570 2024-05-20T22:08:51.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 832202641 0 0) 0x7effc01a6740 con 0x7effc01076c0 2024-05-20T22:08:51.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effc01a8bc0 con 0x7effc01076c0 2024-05-20T22:08:51.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2526228970 0 0) 0x7effac003520 con 0x7effc010a570 2024-05-20T22:08:51.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7effc01a6740 con 0x7effc010a570 2024-05-20T22:08:51.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7effb00044f0 con 0x7effc010a570 2024-05-20T22:08:51.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2917320107 0 0) 0x7effc01a8bc0 con 0x7effc01076c0 2024-05-20T22:08:51.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7effac003520 con 0x7effc01076c0 2024-05-20T22:08:51.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7effbc001a30 con 0x7effc01076c0 2024-05-20T22:08:51.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 783962772 0 0) 0x7effc01a7980 con 0x7effc010e110 2024-05-20T22:08:51.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effc01a8bc0 con 0x7effc010e110 2024-05-20T22:08:51.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1765408945 0 0) 0x7effc01a6740 con 0x7effc010a570 2024-05-20T22:08:51.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 >> v1:172.21.15.145:6789/0 conn(0x7effc010e110 legacy=0x7effc01a4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:51.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 >> v1:172.21.15.50:6789/0 conn(0x7effc01076c0 legacy=0x7effc010d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:51.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc01a9e00 con 0x7effc010a570 2024-05-20T22:08:51.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effc84d1640 1 -- 172.21.15.50:0/2011463010 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7effc01a6970 con 0x7effc010a570 2024-05-20T22:08:51.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effc84d1640 1 -- 172.21.15.50:0/2011463010 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7effc01a6e30 con 0x7effc010a570 2024-05-20T22:08:51.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7effb0003b80 con 0x7effc010a570 2024-05-20T22:08:51.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7effb0004d10 con 0x7effc010a570 2024-05-20T22:08:51.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effc84d1640 1 -- 172.21.15.50:0/2011463010 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa4005080 con 0x7effc010a570 2024-05-20T22:08:51.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7effb00036f0 con 0x7effc010a570 2024-05-20T22:08:51.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.134+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(74..74 src has 1..74) ==== 6201+0+0 (unknown 2490794606 0 0) 0x7effb00883f0 con 0x7effc010a570 2024-05-20T22:08:51.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.142+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7effb0055c70 con 0x7effc010a570 2024-05-20T22:08:51.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.330+0000 7effc84d1640 1 -- 172.21.15.50:0/2011463010 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7effa4005370 con 0x7effc010a570 2024-05-20T22:08:51.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.330+0000 7effb77fe640 1 -- 172.21.15.50:0/2011463010 <== mon.2 v1:172.21.15.50:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (unknown 1482059429 0 1103473992) 0x7effb0059920 con 0x7effc010a570 2024-05-20T22:08:51.329 INFO:teuthology.orchestra.run.smithi050.stdout:231928234023 2024-05-20T22:08:51.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.334+0000 7effc84d1640 1 -- 172.21.15.50:0/2011463010 >> v1:172.21.15.50:6800/3332714287 conn(0x7effac06efc0 legacy=0x7effac071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:51.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.334+0000 7effc84d1640 1 -- 172.21.15.50:0/2011463010 >> v1:172.21.15.50:6790/0 conn(0x7effc010a570 legacy=0x7effc01a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:51.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.334+0000 7effc84d1640 1 -- 172.21.15.50:0/2011463010 shutdown_connections 2024-05-20T22:08:51.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.334+0000 7effc84d1640 1 -- 172.21.15.50:0/2011463010 >> 172.21.15.50:0/2011463010 conn(0x7effc00fd1d0 msgr2=0x7effc0111420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:51.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.334+0000 7effc84d1640 1 -- 172.21.15.50:0/2011463010 shutdown_connections 2024-05-20T22:08:51.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:51.334+0000 7effc84d1640 1 -- 172.21.15.50:0/2011463010 wait complete. 2024-05-20T22:08:51.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:50 smithi145 bash[23893]: cluster 2024-05-20T22:08:49.879817+0000 mgr.y (mgr.14592) 94 : cluster 0 pgmap v53: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:51.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:50 smithi145 bash[23893]: audit 2024-05-20T22:08:50.094212+0000 mon.c (mon.2) 19 : audit 0 from='client.? v1:172.21.15.50:0/2920654458' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-20T22:08:52.075 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:51 smithi050 bash[21866]: audit 2024-05-20T22:08:51.024036+0000 mon.a (mon.0) 914 : audit 0 from='client.? v1:172.21.15.50:0/2116022380' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-20T22:08:52.075 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:51 smithi050 bash[21866]: audit 2024-05-20T22:08:51.335285+0000 mon.c (mon.2) 20 : audit 0 from='client.? v1:172.21.15.50:0/2011463010' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-20T22:08:52.075 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:51 smithi050 bash[28929]: audit 2024-05-20T22:08:51.024036+0000 mon.a (mon.0) 914 : audit 0 from='client.? v1:172.21.15.50:0/2116022380' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-20T22:08:52.076 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:51 smithi050 bash[28929]: audit 2024-05-20T22:08:51.335285+0000 mon.c (mon.2) 20 : audit 0 from='client.? v1:172.21.15.50:0/2011463010' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-20T22:08:52.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f608ef23640 1 -- 172.21.15.50:0/2185421578 >> v1:172.21.15.50:6790/0 conn(0x7f6088074750 legacy=0x7f608810e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f608ef23640 1 -- 172.21.15.50:0/2185421578 shutdown_connections 2024-05-20T22:08:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f608ef23640 1 -- 172.21.15.50:0/2185421578 >> 172.21.15.50:0/2185421578 conn(0x7f60880fd1e0 msgr2=0x7f60880ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f608ef23640 1 -- 172.21.15.50:0/2185421578 shutdown_connections 2024-05-20T22:08:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f608ef23640 1 -- 172.21.15.50:0/2185421578 wait complete. 2024-05-20T22:08:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f608ef23640 1 Processor -- start 2024-05-20T22:08:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f608ef23640 1 -- start start 2024-05-20T22:08:52.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f608ef23640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f60881a8890 con 0x7f6088074750 2024-05-20T22:08:52.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f608ef23640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f60881a9a90 con 0x7f6088073c60 2024-05-20T22:08:52.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f608ef23640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f60881aacd0 con 0x7f6088110330 2024-05-20T22:08:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f6087fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6088074750 0x7f60881a3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52804/0 (socket says 172.21.15.50:52804) 2024-05-20T22:08:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f608d4c0640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7f6088110330 0x7f60881a6f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:59974/0 (socket says 172.21.15.50:59974) 2024-05-20T22:08:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f6087fff640 1 -- 172.21.15.50:0/3070612986 learned_addr learned my addr 172.21.15.50:0/3070612986 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:08:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2234461520 0 0) 0x7f60881aacd0 con 0x7f6088110330 2024-05-20T22:08:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6074003160 con 0x7f6088110330 2024-05-20T22:08:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1260043632 0 0) 0x7f60881a8890 con 0x7f6088074750 2024-05-20T22:08:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60881aacd0 con 0x7f6088074750 2024-05-20T22:08:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1280738468 0 0) 0x7f6074003160 con 0x7f6088110330 2024-05-20T22:08:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f60881a8890 con 0x7f6088110330 2024-05-20T22:08:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2763726968 0 0) 0x7f60881aacd0 con 0x7f6088074750 2024-05-20T22:08:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6074003160 con 0x7f6088074750 2024-05-20T22:08:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f6080001b30 con 0x7f6088110330 2024-05-20T22:08:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2100013412 0 0) 0x7f60881a9a90 con 0x7f6088073c60 2024-05-20T22:08:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60881aacd0 con 0x7f6088073c60 2024-05-20T22:08:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f60700044b0 con 0x7f6088074750 2024-05-20T22:08:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 953691977 0 0) 0x7f60881a8890 con 0x7f6088110330 2024-05-20T22:08:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 >> v1:172.21.15.145:6789/0 conn(0x7f6088073c60 legacy=0x7f608810e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 >> v1:172.21.15.50:6789/0 conn(0x7f6088074750 legacy=0x7f60881a3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60881abf10 con 0x7f6088110330 2024-05-20T22:08:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f608ef23640 1 -- 172.21.15.50:0/3070612986 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f60881aaf00 con 0x7f6088110330 2024-05-20T22:08:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f608ef23640 1 -- 172.21.15.50:0/3070612986 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f60881ab3c0 con 0x7f6088110330 2024-05-20T22:08:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f6080003e20 con 0x7f6088110330 2024-05-20T22:08:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f6080005e50 con 0x7f6088110330 2024-05-20T22:08:52.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.190+0000 7f608ef23640 1 -- 172.21.15.50:0/3070612986 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6068005080 con 0x7f6088110330 2024-05-20T22:08:52.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.194+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f6080003990 con 0x7f6088110330 2024-05-20T22:08:52.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.194+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(74..74 src has 1..74) ==== 6201+0+0 (unknown 2490794606 0 0) 0x7f6080089870 con 0x7f6088110330 2024-05-20T22:08:52.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.198+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f6080056fb0 con 0x7f6088110330 2024-05-20T22:08:52.359 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411412 got 77309411416 for osd.2 2024-05-20T22:08:52.359 DEBUG:teuthology.parallel:result is None 2024-05-20T22:08:52.387 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018943 got 128849018948 for osd.4 2024-05-20T22:08:52.387 DEBUG:teuthology.parallel:result is None 2024-05-20T22:08:52.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:51 smithi145 bash[23893]: audit 2024-05-20T22:08:51.024036+0000 mon.a (mon.0) 914 : audit 0 from='client.? v1:172.21.15.50:0/2116022380' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-20T22:08:52.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:51 smithi145 bash[23893]: audit 2024-05-20T22:08:51.335285+0000 mon.c (mon.2) 20 : audit 0 from='client.? v1:172.21.15.50:0/2011463010' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-20T22:08:52.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.414+0000 7f608ef23640 1 -- 172.21.15.50:0/3070612986 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6068005370 con 0x7f6088110330 2024-05-20T22:08:52.410 INFO:teuthology.orchestra.run.smithi050.stdout:55834574949 2024-05-20T22:08:52.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.414+0000 7f6085ffb640 1 -- 172.21.15.50:0/3070612986 <== mon.2 v1:172.21.15.50:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 1742491834) 0x7f608005ac60 con 0x7f6088110330 2024-05-20T22:08:52.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.414+0000 7f608ef23640 1 -- 172.21.15.50:0/3070612986 >> v1:172.21.15.50:6800/3332714287 conn(0x7f607406eea0 legacy=0x7f6074071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.414+0000 7f608ef23640 1 -- 172.21.15.50:0/3070612986 >> v1:172.21.15.50:6790/0 conn(0x7f6088110330 legacy=0x7f60881a6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.414+0000 7f608ef23640 1 -- 172.21.15.50:0/3070612986 shutdown_connections 2024-05-20T22:08:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.414+0000 7f608ef23640 1 -- 172.21.15.50:0/3070612986 >> 172.21.15.50:0/3070612986 conn(0x7f60880fd1e0 msgr2=0x7f60881127f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.414+0000 7f608ef23640 1 -- 172.21.15.50:0/3070612986 shutdown_connections 2024-05-20T22:08:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.414+0000 7f608ef23640 1 -- 172.21.15.50:0/3070612986 wait complete. 2024-05-20T22:08:52.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c1e4cc640 1 -- 172.21.15.50:0/438683881 >> v1:172.21.15.50:6790/0 conn(0x7f7c180746c0 legacy=0x7f7c181131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:52.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c1e4cc640 1 -- 172.21.15.50:0/438683881 shutdown_connections 2024-05-20T22:08:52.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c1e4cc640 1 -- 172.21.15.50:0/438683881 >> 172.21.15.50:0/438683881 conn(0x7f7c180fd1e0 msgr2=0x7f7c180ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:52.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c1e4cc640 1 -- 172.21.15.50:0/438683881 shutdown_connections 2024-05-20T22:08:52.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c1e4cc640 1 -- 172.21.15.50:0/438683881 wait complete. 2024-05-20T22:08:52.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c1e4cc640 1 Processor -- start 2024-05-20T22:08:52.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c1e4cc640 1 -- start start 2024-05-20T22:08:52.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c1e4cc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f7c18114480 con 0x7f7c18073bd0 2024-05-20T22:08:52.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c1e4cc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f7c181146b0 con 0x7f7c180746c0 2024-05-20T22:08:52.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c1e4cc640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f7c181af340 con 0x7f7c181148d0 2024-05-20T22:08:52.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c17fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7c18073bd0 0x7f7c181113b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52814/0 (socket says 172.21.15.50:52814) 2024-05-20T22:08:52.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c17fff640 1 -- 172.21.15.50:0/4151330867 learned_addr learned my addr 172.21.15.50:0/4151330867 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:08:52.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1835841236 0 0) 0x7f7c181af340 con 0x7f7c181148d0 2024-05-20T22:08:52.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c04003520 con 0x7f7c181148d0 2024-05-20T22:08:52.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2788994208 0 0) 0x7f7c18114480 con 0x7f7c18073bd0 2024-05-20T22:08:52.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c181af340 con 0x7f7c18073bd0 2024-05-20T22:08:52.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1546459746 0 0) 0x7f7c181146b0 con 0x7f7c180746c0 2024-05-20T22:08:52.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c18114480 con 0x7f7c180746c0 2024-05-20T22:08:52.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 562268009 0 0) 0x7f7c04003520 con 0x7f7c181148d0 2024-05-20T22:08:52.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7c181146b0 con 0x7f7c181148d0 2024-05-20T22:08:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f7c08001c30 con 0x7f7c181148d0 2024-05-20T22:08:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2117086262 0 0) 0x7f7c181af340 con 0x7f7c18073bd0 2024-05-20T22:08:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7c04003520 con 0x7f7c18073bd0 2024-05-20T22:08:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f7c100018d0 con 0x7f7c18073bd0 2024-05-20T22:08:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 445832915 0 0) 0x7f7c181146b0 con 0x7f7c181148d0 2024-05-20T22:08:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 >> v1:172.21.15.145:6789/0 conn(0x7f7c180746c0 legacy=0x7f7c18111ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 >> v1:172.21.15.50:6789/0 conn(0x7f7c18073bd0 legacy=0x7f7c181113b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c181b0560 con 0x7f7c181148d0 2024-05-20T22:08:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c1e4cc640 1 -- 172.21.15.50:0/4151330867 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7c181af570 con 0x7f7c181148d0 2024-05-20T22:08:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c1e4cc640 1 -- 172.21.15.50:0/4151330867 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7c181afa30 con 0x7f7c181148d0 2024-05-20T22:08:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f7c08003e20 con 0x7f7c181148d0 2024-05-20T22:08:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.462+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f7c08004ca0 con 0x7f7c181148d0 2024-05-20T22:08:52.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.466+0000 7f7c1e4cc640 1 -- 172.21.15.50:0/4151330867 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bf8005080 con 0x7f7c181148d0 2024-05-20T22:08:52.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.466+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f7c08003990 con 0x7f7c181148d0 2024-05-20T22:08:52.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.466+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(74..74 src has 1..74) ==== 6201+0+0 (unknown 2490794606 0 0) 0x7f7c080885c0 con 0x7f7c181148d0 2024-05-20T22:08:52.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.470+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f7c08055d60 con 0x7f7c181148d0 2024-05-20T22:08:52.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.654+0000 7f7c1e4cc640 1 -- 172.21.15.50:0/4151330867 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7bf8005370 con 0x7f7c181148d0 2024-05-20T22:08:52.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.654+0000 7f7c157fa640 1 -- 172.21.15.50:0/4151330867 <== mon.2 v1:172.21.15.50:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (unknown 383520633 0 608762351) 0x7f7c08059a10 con 0x7f7c181148d0 2024-05-20T22:08:52.653 INFO:teuthology.orchestra.run.smithi050.stdout:107374182479 2024-05-20T22:08:52.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.658+0000 7f7c1e4cc640 1 -- 172.21.15.50:0/4151330867 >> v1:172.21.15.50:6800/3332714287 conn(0x7f7c0406ee80 legacy=0x7f7c04071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:52.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.658+0000 7f7c1e4cc640 1 -- 172.21.15.50:0/4151330867 >> v1:172.21.15.50:6790/0 conn(0x7f7c181148d0 legacy=0x7f7c181abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:08:52.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.658+0000 7f7c1e4cc640 1 -- 172.21.15.50:0/4151330867 shutdown_connections 2024-05-20T22:08:52.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.658+0000 7f7c1e4cc640 1 -- 172.21.15.50:0/4151330867 >> 172.21.15.50:0/4151330867 conn(0x7f7c180fd1e0 msgr2=0x7f7c18116cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:08:52.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.658+0000 7f7c1e4cc640 1 -- 172.21.15.50:0/4151330867 shutdown_connections 2024-05-20T22:08:52.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:08:52.658+0000 7f7c1e4cc640 1 -- 172.21.15.50:0/4151330867 wait complete. 2024-05-20T22:08:53.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:52 smithi145 bash[23893]: cluster 2024-05-20T22:08:51.880648+0000 mgr.y (mgr.14592) 95 : cluster 0 pgmap v54: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:53.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:52 smithi145 bash[23893]: audit 2024-05-20T22:08:52.416398+0000 mon.c (mon.2) 21 : audit 0 from='client.? v1:172.21.15.50:0/3070612986' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-20T22:08:53.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:52 smithi145 bash[23893]: audit 2024-05-20T22:08:52.658860+0000 mon.c (mon.2) 22 : audit 0 from='client.? v1:172.21.15.50:0/4151330867' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-20T22:08:53.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:52 smithi050 bash[21866]: cluster 2024-05-20T22:08:51.880648+0000 mgr.y (mgr.14592) 95 : cluster 0 pgmap v54: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:53.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:52 smithi050 bash[21866]: audit 2024-05-20T22:08:52.416398+0000 mon.c (mon.2) 21 : audit 0 from='client.? v1:172.21.15.50:0/3070612986' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-20T22:08:53.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:52 smithi050 bash[21866]: audit 2024-05-20T22:08:52.658860+0000 mon.c (mon.2) 22 : audit 0 from='client.? v1:172.21.15.50:0/4151330867' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-20T22:08:53.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:52 smithi050 bash[28929]: cluster 2024-05-20T22:08:51.880648+0000 mgr.y (mgr.14592) 95 : cluster 0 pgmap v54: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:53.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:52 smithi050 bash[28929]: audit 2024-05-20T22:08:52.416398+0000 mon.c (mon.2) 21 : audit 0 from='client.? v1:172.21.15.50:0/3070612986' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-20T22:08:53.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:52 smithi050 bash[28929]: audit 2024-05-20T22:08:52.658860+0000 mon.c (mon.2) 22 : audit 0 from='client.? v1:172.21.15.50:0/4151330867' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-20T22:08:54.005 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495661 got 197568495666 for osd.6 2024-05-20T22:08:54.005 DEBUG:teuthology.parallel:result is None 2024-05-20T22:08:54.027 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234018 got 231928234023 for osd.7 2024-05-20T22:08:54.028 DEBUG:teuthology.parallel:result is None 2024-05-20T22:08:54.444 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574944 got 55834574949 for osd.1 2024-05-20T22:08:54.444 DEBUG:teuthology.parallel:result is None 2024-05-20T22:08:54.509 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182475 got 107374182479 for osd.3 2024-05-20T22:08:54.509 DEBUG:teuthology.parallel:result is None 2024-05-20T22:08:54.509 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-20T22:08:54.509 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph pg dump --format=json 2024-05-20T22:08:55.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:54 smithi145 bash[23893]: cluster 2024-05-20T22:08:53.881365+0000 mgr.y (mgr.14592) 96 : cluster 0 pgmap v55: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:55.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:54 smithi050 bash[28929]: cluster 2024-05-20T22:08:53.881365+0000 mgr.y (mgr.14592) 96 : cluster 0 pgmap v55: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:55.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:54 smithi050 bash[21866]: cluster 2024-05-20T22:08:53.881365+0000 mgr.y (mgr.14592) 96 : cluster 0 pgmap v55: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:57.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:56 smithi145 bash[23893]: cluster 2024-05-20T22:08:55.882858+0000 mgr.y (mgr.14592) 97 : cluster 0 pgmap v56: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:57.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:56 smithi050 bash[21866]: cluster 2024-05-20T22:08:55.882858+0000 mgr.y (mgr.14592) 97 : cluster 0 pgmap v56: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:57.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:56 smithi050 bash[28929]: cluster 2024-05-20T22:08:55.882858+0000 mgr.y (mgr.14592) 97 : cluster 0 pgmap v56: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:08:57.890 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:08:57 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:08:58.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:57 smithi145 bash[23893]: audit 2024-05-20T22:08:57.501064+0000 mgr.y (mgr.14592) 98 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:08:58.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:57 smithi050 bash[21866]: audit 2024-05-20T22:08:57.501064+0000 mgr.y (mgr.14592) 98 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:08:58.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:57 smithi050 bash[28929]: audit 2024-05-20T22:08:57.501064+0000 mgr.y (mgr.14592) 98 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:08:59.302 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:08:59.325 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:08:58 smithi050 bash[21866]: cluster 2024-05-20T22:08:57.883550+0000 mgr.y (mgr.14592) 99 : cluster 0 pgmap v57: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:59.325 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:08:58 smithi050 bash[28929]: cluster 2024-05-20T22:08:57.883550+0000 mgr.y (mgr.14592) 99 : cluster 0 pgmap v57: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:59.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:08:58 smithi145 bash[23893]: cluster 2024-05-20T22:08:57.883550+0000 mgr.y (mgr.14592) 99 : cluster 0 pgmap v57: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:08:59.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:08:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:08:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:09:00.254 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:00 smithi050 bash[21866]: audit 2024-05-20T22:08:59.106511+0000 mon.a (mon.0) 915 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:09:00.254 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:00 smithi050 bash[28929]: audit 2024-05-20T22:08:59.106511+0000 mon.a (mon.0) 915 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:09:00.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:00 smithi145 bash[23893]: audit 2024-05-20T22:08:59.106511+0000 mon.a (mon.0) 915 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:09:01.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:01 smithi145 bash[23893]: cluster 2024-05-20T22:08:59.884970+0000 mgr.y (mgr.14592) 100 : cluster 0 pgmap v58: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:01.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:01 smithi050 bash[21866]: cluster 2024-05-20T22:08:59.884970+0000 mgr.y (mgr.14592) 100 : cluster 0 pgmap v58: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:01.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:01 smithi050 bash[28929]: cluster 2024-05-20T22:08:59.884970+0000 mgr.y (mgr.14592) 100 : cluster 0 pgmap v58: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:01.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.853+0000 7effccd40640 1 -- 172.21.15.50:0/149927618 >> v1:172.21.15.50:6790/0 conn(0x7effc810e170 legacy=0x7effc81105c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:09:01.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.853+0000 7effccd40640 1 -- 172.21.15.50:0/149927618 shutdown_connections 2024-05-20T22:09:01.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.853+0000 7effccd40640 1 -- 172.21.15.50:0/149927618 >> 172.21.15.50:0/149927618 conn(0x7effc80fc060 msgr2=0x7effc80fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:09:01.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.853+0000 7effccd40640 1 -- 172.21.15.50:0/149927618 shutdown_connections 2024-05-20T22:09:01.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.853+0000 7effccd40640 1 -- 172.21.15.50:0/149927618 wait complete. 2024-05-20T22:09:01.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.853+0000 7effccd40640 1 Processor -- start 2024-05-20T22:09:01.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.853+0000 7effccd40640 1 -- start start 2024-05-20T22:09:01.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.853+0000 7effccd40640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7effc81a6770 con 0x7effc810e170 2024-05-20T22:09:01.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.853+0000 7effccd40640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7effc81a79b0 con 0x7effc8102850 2024-05-20T22:09:01.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.853+0000 7effccd40640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7effc81a8bf0 con 0x7effc810a660 2024-05-20T22:09:01.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.853+0000 7effc5d9b640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7effc810a660 0x7effc81a1570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:51606/0 (socket says 172.21.15.50:51606) 2024-05-20T22:09:01.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.853+0000 7effc5d9b640 1 -- 172.21.15.50:0/3374108987 learned_addr learned my addr 172.21.15.50:0/3374108987 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:09:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.853+0000 7effc6d9d640 1 --1- 172.21.15.50:0/3374108987 >> v1:172.21.15.50:6789/0 conn(0x7effc810e170 0x7effc81a4e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49888/0 (socket says 172.21.15.50:49888) 2024-05-20T22:09:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4073280021 0 0) 0x7effc81a8bf0 con 0x7effc810a660 2024-05-20T22:09:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effb0003520 con 0x7effc810a660 2024-05-20T22:09:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3331696599 0 0) 0x7effc81a6770 con 0x7effc810e170 2024-05-20T22:09:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effc81a8bf0 con 0x7effc810e170 2024-05-20T22:09:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3719280886 0 0) 0x7effc81a79b0 con 0x7effc8102850 2024-05-20T22:09:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effc81a6770 con 0x7effc8102850 2024-05-20T22:09:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1736001614 0 0) 0x7effb0003520 con 0x7effc810a660 2024-05-20T22:09:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7effc81a79b0 con 0x7effc810a660 2024-05-20T22:09:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7effbc001870 con 0x7effc810a660 2024-05-20T22:09:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 802543038 0 0) 0x7effc81a8bf0 con 0x7effc810e170 2024-05-20T22:09:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7effb0003520 con 0x7effc810e170 2024-05-20T22:09:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7effc0001510 con 0x7effc810e170 2024-05-20T22:09:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4292388329 0 0) 0x7effc81a79b0 con 0x7effc810a660 2024-05-20T22:09:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 >> v1:172.21.15.145:6789/0 conn(0x7effc8102850 legacy=0x7effc8109ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:09:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 >> v1:172.21.15.50:6789/0 conn(0x7effc810e170 legacy=0x7effc81a4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:09:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc81a9e30 con 0x7effc810a660 2024-05-20T22:09:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effccd40640 1 -- 172.21.15.50:0/3374108987 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7effc81a8e20 con 0x7effc810a660 2024-05-20T22:09:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effccd40640 1 -- 172.21.15.50:0/3374108987 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7effc81a92e0 con 0x7effc810a660 2024-05-20T22:09:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7effbc003aa0 con 0x7effc810a660 2024-05-20T22:09:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7effbc005bc0 con 0x7effc810a660 2024-05-20T22:09:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effccd40640 1 -- 172.21.15.50:0/3374108987 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa80050b0 con 0x7effc810a660 2024-05-20T22:09:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7effbc003610 con 0x7effc810a660 2024-05-20T22:09:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.857+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(74..74 src has 1..74) ==== 6201+0+0 (unknown 2490794606 0 0) 0x7effbc089630 con 0x7effc810a660 2024-05-20T22:09:01.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:01.861+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7effbc056dd0 con 0x7effc810a660 2024-05-20T22:09:02.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:02.049+0000 7effccd40640 1 -- 172.21.15.50:0/3374108987 --> v1:172.21.15.50:6800/3332714287 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7effa8000bc0 con 0x7effb006ee80 2024-05-20T22:09:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:02.061+0000 7effb77fe640 1 -- 172.21.15.50:0/3374108987 <== mgr.14592 v1:172.21.15.50:6800/3332714287 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+346497 (unknown 2965378022 0 68523613) 0x7effa8000bc0 con 0x7effb006ee80 2024-05-20T22:09:02.060 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-20T22:09:02.061 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-05-20T22:09:02.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:02.065+0000 7effccd40640 1 -- 172.21.15.50:0/3374108987 >> v1:172.21.15.50:6800/3332714287 conn(0x7effb006ee80 legacy=0x7effb0071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:09:02.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:02.065+0000 7effccd40640 1 -- 172.21.15.50:0/3374108987 >> v1:172.21.15.50:6790/0 conn(0x7effc810a660 legacy=0x7effc81a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:09:02.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:02.065+0000 7effccd40640 1 -- 172.21.15.50:0/3374108987 shutdown_connections 2024-05-20T22:09:02.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:02.065+0000 7effccd40640 1 -- 172.21.15.50:0/3374108987 >> 172.21.15.50:0/3374108987 conn(0x7effc80fc060 msgr2=0x7effc80fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:09:02.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:02.065+0000 7effccd40640 1 -- 172.21.15.50:0/3374108987 shutdown_connections 2024-05-20T22:09:02.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:02.065+0000 7effccd40640 1 -- 172.21.15.50:0/3374108987 wait complete. 2024-05-20T22:09:02.736 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-05-20T22:09:01.885213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596507,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":1088,"num_read_kb":934,"num_write":615,"num_write_kb":2461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":626,"ondisk_log_size":626,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":240404,"kb_used_data":7580,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":749720812,"statfs":{"total":767960285184,"available":767714111488,"internally_reserved":0,"allocated":7761920,"data_stored":4130329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006465"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468748+0000","last_change":"2024-05-20T22:06:29.569266+0000","last_active":"2024-05-20T22:08:15.468748+0000","last_peered":"2024-05-20T22:08:15.468748+0000","last_clean":"2024-05-20T22:08:15.468748+0000","last_became_active":"2024-05-20T22:06:29.568443+0000","last_became_peered":"2024-05-20T22:06:29.568443+0000","last_unstale":"2024-05-20T22:08:15.468748+0000","last_undegraded":"2024-05-20T22:08:15.468748+0000","last_fullsized":"2024-05-20T22:08:15.468748+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:01:11.637445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.087454+0000","last_change":"2024-05-20T22:06:23.011076+0000","last_active":"2024-05-20T22:08:16.087454+0000","last_peered":"2024-05-20T22:08:16.087454+0000","last_clean":"2024-05-20T22:08:16.087454+0000","last_became_active":"2024-05-20T22:06:23.010346+0000","last_became_peered":"2024-05-20T22:06:23.010346+0000","last_unstale":"2024-05-20T22:08:16.087454+0000","last_undegraded":"2024-05-20T22:08:16.087454+0000","last_fullsized":"2024-05-20T22:08:16.087454+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:37:40.669467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469013+0000","last_change":"2024-05-20T22:06:25.058848+0000","last_active":"2024-05-20T22:08:15.469013+0000","last_peered":"2024-05-20T22:08:15.469013+0000","last_clean":"2024-05-20T22:08:15.469013+0000","last_became_active":"2024-05-20T22:06:25.058477+0000","last_became_peered":"2024-05-20T22:06:25.058477+0000","last_unstale":"2024-05-20T22:08:15.469013+0000","last_undegraded":"2024-05-20T22:08:15.469013+0000","last_fullsized":"2024-05-20T22:08:15.469013+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:17:25.646588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469778+0000","last_change":"2024-05-20T22:06:27.409275+0000","last_active":"2024-05-20T22:08:15.469778+0000","last_peered":"2024-05-20T22:08:15.469778+0000","last_clean":"2024-05-20T22:08:15.469778+0000","last_became_active":"2024-05-20T22:06:27.390168+0000","last_became_peered":"2024-05-20T22:06:27.390168+0000","last_unstale":"2024-05-20T22:08:15.469778+0000","last_undegraded":"2024-05-20T22:08:15.469778+0000","last_fullsized":"2024-05-20T22:08:15.469778+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:26:29.783703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469182+0000","last_change":"2024-05-20T22:06:23.008801+0000","last_active":"2024-05-20T22:08:15.469182+0000","last_peered":"2024-05-20T22:08:15.469182+0000","last_clean":"2024-05-20T22:08:15.469182+0000","last_became_active":"2024-05-20T22:06:23.007832+0000","last_became_peered":"2024-05-20T22:06:23.007832+0000","last_unstale":"2024-05-20T22:08:15.469182+0000","last_undegraded":"2024-05-20T22:08:15.469182+0000","last_fullsized":"2024-05-20T22:08:15.469182+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:46:14.534726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.087236+0000","last_change":"2024-05-20T22:06:25.056910+0000","last_active":"2024-05-20T22:08:16.087236+0000","last_peered":"2024-05-20T22:08:16.087236+0000","last_clean":"2024-05-20T22:08:16.087236+0000","last_became_active":"2024-05-20T22:06:25.055878+0000","last_became_peered":"2024-05-20T22:06:25.055878+0000","last_unstale":"2024-05-20T22:08:16.087236+0000","last_undegraded":"2024-05-20T22:08:16.087236+0000","last_fullsized":"2024-05-20T22:08:16.087236+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:28:08.322507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.751401+0000","last_change":"2024-05-20T22:06:27.407822+0000","last_active":"2024-05-20T22:08:15.751401+0000","last_peered":"2024-05-20T22:08:15.751401+0000","last_clean":"2024-05-20T22:08:15.751401+0000","last_became_active":"2024-05-20T22:06:27.407565+0000","last_became_peered":"2024-05-20T22:06:27.407565+0000","last_unstale":"2024-05-20T22:08:15.751401+0000","last_undegraded":"2024-05-20T22:08:15.751401+0000","last_fullsized":"2024-05-20T22:08:15.751401+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:00:08.440373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.470308+0000","last_change":"2024-05-20T22:06:29.457283+0000","last_active":"2024-05-20T22:08:15.470308+0000","last_peered":"2024-05-20T22:08:15.470308+0000","last_clean":"2024-05-20T22:08:15.470308+0000","last_became_active":"2024-05-20T22:06:29.456404+0000","last_became_peered":"2024-05-20T22:06:29.456404+0000","last_unstale":"2024-05-20T22:08:15.470308+0000","last_undegraded":"2024-05-20T22:08:15.470308+0000","last_fullsized":"2024-05-20T22:08:15.470308+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:47:49.670722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.630832+0000","last_change":"2024-05-20T22:06:22.999516+0000","last_active":"2024-05-20T22:08:15.630832+0000","last_peered":"2024-05-20T22:08:15.630832+0000","last_clean":"2024-05-20T22:08:15.630832+0000","last_became_active":"2024-05-20T22:06:22.999153+0000","last_became_peered":"2024-05-20T22:06:22.999153+0000","last_unstale":"2024-05-20T22:08:15.630832+0000","last_undegraded":"2024-05-20T22:08:15.630832+0000","last_fullsized":"2024-05-20T22:08:15.630832+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:30:14.323734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.473349+0000","last_change":"2024-05-20T22:06:25.064164+0000","last_active":"2024-05-20T22:08:15.473349+0000","last_peered":"2024-05-20T22:08:15.473349+0000","last_clean":"2024-05-20T22:08:15.473349+0000","last_became_active":"2024-05-20T22:06:25.063756+0000","last_became_peered":"2024-05-20T22:06:25.063756+0000","last_unstale":"2024-05-20T22:08:15.473349+0000","last_undegraded":"2024-05-20T22:08:15.473349+0000","last_fullsized":"2024-05-20T22:08:15.473349+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:53:31.010294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.628802+0000","last_change":"2024-05-20T22:06:27.424280+0000","last_active":"2024-05-20T22:08:15.628802+0000","last_peered":"2024-05-20T22:08:15.628802+0000","last_clean":"2024-05-20T22:08:15.628802+0000","last_became_active":"2024-05-20T22:06:27.423774+0000","last_became_peered":"2024-05-20T22:06:27.423774+0000","last_unstale":"2024-05-20T22:08:15.628802+0000","last_undegraded":"2024-05-20T22:08:15.628802+0000","last_fullsized":"2024-05-20T22:08:15.628802+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:29:02.425267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.472471+0000","last_change":"2024-05-20T22:06:29.456102+0000","last_active":"2024-05-20T22:08:15.472471+0000","last_peered":"2024-05-20T22:08:15.472471+0000","last_clean":"2024-05-20T22:08:15.472471+0000","last_became_active":"2024-05-20T22:06:29.455748+0000","last_became_peered":"2024-05-20T22:06:29.455748+0000","last_unstale":"2024-05-20T22:08:15.472471+0000","last_undegraded":"2024-05-20T22:08:15.472471+0000","last_fullsized":"2024-05-20T22:08:15.472471+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:07:04.541125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.630309+0000","last_change":"2024-05-20T22:06:23.004191+0000","last_active":"2024-05-20T22:08:15.630309+0000","last_peered":"2024-05-20T22:08:15.630309+0000","last_clean":"2024-05-20T22:08:15.630309+0000","last_became_active":"2024-05-20T22:06:23.003871+0000","last_became_peered":"2024-05-20T22:06:23.003871+0000","last_unstale":"2024-05-20T22:08:15.630309+0000","last_undegraded":"2024-05-20T22:08:15.630309+0000","last_fullsized":"2024-05-20T22:08:15.630309+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:08:25.414677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"67'12","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.473676+0000","last_change":"2024-05-20T22:06:25.064439+0000","last_active":"2024-05-20T22:08:15.473676+0000","last_peered":"2024-05-20T22:08:15.473676+0000","last_clean":"2024-05-20T22:08:15.473676+0000","last_became_active":"2024-05-20T22:06:25.063714+0000","last_became_peered":"2024-05-20T22:06:25.063714+0000","last_unstale":"2024-05-20T22:08:15.473676+0000","last_undegraded":"2024-05-20T22:08:15.473676+0000","last_fullsized":"2024-05-20T22:08:15.473676+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:22.549017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.472324+0000","last_change":"2024-05-20T22:06:27.412264+0000","last_active":"2024-05-20T22:08:15.472324+0000","last_peered":"2024-05-20T22:08:15.472324+0000","last_clean":"2024-05-20T22:08:15.472324+0000","last_became_active":"2024-05-20T22:06:27.411288+0000","last_became_peered":"2024-05-20T22:06:27.411288+0000","last_unstale":"2024-05-20T22:08:15.472324+0000","last_undegraded":"2024-05-20T22:08:15.472324+0000","last_fullsized":"2024-05-20T22:08:15.472324+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:06:30.907398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085350+0000","last_change":"2024-05-20T22:06:29.453017+0000","last_active":"2024-05-20T22:08:16.085350+0000","last_peered":"2024-05-20T22:08:16.085350+0000","last_clean":"2024-05-20T22:08:16.085350+0000","last_became_active":"2024-05-20T22:06:29.452186+0000","last_became_peered":"2024-05-20T22:06:29.452186+0000","last_unstale":"2024-05-20T22:08:16.085350+0000","last_undegraded":"2024-05-20T22:08:16.085350+0000","last_fullsized":"2024-05-20T22:08:16.085350+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:09:49.979770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"67'19","reported_seq":67,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085642+0000","last_change":"2024-05-20T22:06:25.070573+0000","last_active":"2024-05-20T22:08:16.085642+0000","last_peered":"2024-05-20T22:08:16.085642+0000","last_clean":"2024-05-20T22:08:16.085642+0000","last_became_active":"2024-05-20T22:06:25.070274+0000","last_became_peered":"2024-05-20T22:06:25.070274+0000","last_unstale":"2024-05-20T22:08:16.085642+0000","last_undegraded":"2024-05-20T22:08:16.085642+0000","last_fullsized":"2024-05-20T22:08:16.085642+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:44:52.225326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.630590+0000","last_change":"2024-05-20T22:06:23.000750+0000","last_active":"2024-05-20T22:08:15.630590+0000","last_peered":"2024-05-20T22:08:15.630590+0000","last_clean":"2024-05-20T22:08:15.630590+0000","last_became_active":"2024-05-20T22:06:23.000420+0000","last_became_peered":"2024-05-20T22:06:23.000420+0000","last_unstale":"2024-05-20T22:08:15.630590+0000","last_undegraded":"2024-05-20T22:08:15.630590+0000","last_fullsized":"2024-05-20T22:08:15.630590+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:30:30.364363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.752260+0000","last_change":"2024-05-20T22:06:27.409519+0000","last_active":"2024-05-20T22:08:15.752260+0000","last_peered":"2024-05-20T22:08:15.752260+0000","last_clean":"2024-05-20T22:08:15.752260+0000","last_became_active":"2024-05-20T22:06:27.409040+0000","last_became_peered":"2024-05-20T22:06:27.409040+0000","last_unstale":"2024-05-20T22:08:15.752260+0000","last_undegraded":"2024-05-20T22:08:15.752260+0000","last_fullsized":"2024-05-20T22:08:15.752260+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:09:14.656813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468984+0000","last_change":"2024-05-20T22:06:29.444862+0000","last_active":"2024-05-20T22:08:15.468984+0000","last_peered":"2024-05-20T22:08:15.468984+0000","last_clean":"2024-05-20T22:08:15.468984+0000","last_became_active":"2024-05-20T22:06:29.443915+0000","last_became_peered":"2024-05-20T22:06:29.443915+0000","last_unstale":"2024-05-20T22:08:15.468984+0000","last_undegraded":"2024-05-20T22:08:15.468984+0000","last_fullsized":"2024-05-20T22:08:15.468984+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:26:18.626054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.470084+0000","last_change":"2024-05-20T22:06:25.072604+0000","last_active":"2024-05-20T22:08:15.470084+0000","last_peered":"2024-05-20T22:08:15.470084+0000","last_clean":"2024-05-20T22:08:15.470084+0000","last_became_active":"2024-05-20T22:06:25.071552+0000","last_became_peered":"2024-05-20T22:06:25.071552+0000","last_unstale":"2024-05-20T22:08:15.470084+0000","last_undegraded":"2024-05-20T22:08:15.470084+0000","last_fullsized":"2024-05-20T22:08:15.470084+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:09:18.471592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.752367+0000","last_change":"2024-05-20T22:06:23.003446+0000","last_active":"2024-05-20T22:08:15.752367+0000","last_peered":"2024-05-20T22:08:15.752367+0000","last_clean":"2024-05-20T22:08:15.752367+0000","last_became_active":"2024-05-20T22:06:23.002664+0000","last_became_peered":"2024-05-20T22:06:23.002664+0000","last_unstale":"2024-05-20T22:08:15.752367+0000","last_undegraded":"2024-05-20T22:08:15.752367+0000","last_fullsized":"2024-05-20T22:08:15.752367+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:18:12.215939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"67'11","reported_seq":74,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:53.181024+0000","last_change":"2024-05-20T22:06:27.405747+0000","last_active":"2024-05-20T22:08:53.181024+0000","last_peered":"2024-05-20T22:08:53.181024+0000","last_clean":"2024-05-20T22:08:53.181024+0000","last_became_active":"2024-05-20T22:06:27.404839+0000","last_became_peered":"2024-05-20T22:06:27.404839+0000","last_unstale":"2024-05-20T22:08:53.181024+0000","last_undegraded":"2024-05-20T22:08:53.181024+0000","last_fullsized":"2024-05-20T22:08:53.181024+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:11:55.001721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.471033+0000","last_change":"2024-05-20T22:06:29.456454+0000","last_active":"2024-05-20T22:08:15.471033+0000","last_peered":"2024-05-20T22:08:15.471033+0000","last_clean":"2024-05-20T22:08:15.471033+0000","last_became_active":"2024-05-20T22:06:29.456126+0000","last_became_peered":"2024-05-20T22:06:29.456126+0000","last_unstale":"2024-05-20T22:08:15.471033+0000","last_undegraded":"2024-05-20T22:08:15.471033+0000","last_fullsized":"2024-05-20T22:08:15.471033+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:54:08.779234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468562+0000","last_change":"2024-05-20T22:06:25.057264+0000","last_active":"2024-05-20T22:08:15.468562+0000","last_peered":"2024-05-20T22:08:15.468562+0000","last_clean":"2024-05-20T22:08:15.468562+0000","last_became_active":"2024-05-20T22:06:25.056430+0000","last_became_peered":"2024-05-20T22:06:25.056430+0000","last_unstale":"2024-05-20T22:08:15.468562+0000","last_undegraded":"2024-05-20T22:08:15.468562+0000","last_fullsized":"2024-05-20T22:08:15.468562+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:10.336499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.751891+0000","last_change":"2024-05-20T22:06:23.004804+0000","last_active":"2024-05-20T22:08:15.751891+0000","last_peered":"2024-05-20T22:08:15.751891+0000","last_clean":"2024-05-20T22:08:15.751891+0000","last_became_active":"2024-05-20T22:06:23.004385+0000","last_became_peered":"2024-05-20T22:06:23.004385+0000","last_unstale":"2024-05-20T22:08:15.751891+0000","last_undegraded":"2024-05-20T22:08:15.751891+0000","last_fullsized":"2024-05-20T22:08:15.751891+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:09:59.092587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"67'11","reported_seq":74,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:53.180240+0000","last_change":"2024-05-20T22:06:27.416342+0000","last_active":"2024-05-20T22:08:53.180240+0000","last_peered":"2024-05-20T22:08:53.180240+0000","last_clean":"2024-05-20T22:08:53.180240+0000","last_became_active":"2024-05-20T22:06:27.415494+0000","last_became_peered":"2024-05-20T22:06:27.415494+0000","last_unstale":"2024-05-20T22:08:53.180240+0000","last_undegraded":"2024-05-20T22:08:53.180240+0000","last_fullsized":"2024-05-20T22:08:53.180240+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:07:02.105064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.472501+0000","last_change":"2024-05-20T22:06:29.439655+0000","last_active":"2024-05-20T22:08:15.472501+0000","last_peered":"2024-05-20T22:08:15.472501+0000","last_clean":"2024-05-20T22:08:15.472501+0000","last_became_active":"2024-05-20T22:06:29.438901+0000","last_became_peered":"2024-05-20T22:06:29.438901+0000","last_unstale":"2024-05-20T22:08:15.472501+0000","last_undegraded":"2024-05-20T22:08:15.472501+0000","last_fullsized":"2024-05-20T22:08:15.472501+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:43:53.975207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"67'12","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.470526+0000","last_change":"2024-05-20T22:06:25.067979+0000","last_active":"2024-05-20T22:08:15.470526+0000","last_peered":"2024-05-20T22:08:15.470526+0000","last_clean":"2024-05-20T22:08:15.470526+0000","last_became_active":"2024-05-20T22:06:25.067658+0000","last_became_peered":"2024-05-20T22:06:25.067658+0000","last_unstale":"2024-05-20T22:08:15.470526+0000","last_undegraded":"2024-05-20T22:08:15.470526+0000","last_fullsized":"2024-05-20T22:08:15.470526+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:56:05.556337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.628562+0000","last_change":"2024-05-20T22:06:23.012267+0000","last_active":"2024-05-20T22:08:15.628562+0000","last_peered":"2024-05-20T22:08:15.628562+0000","last_clean":"2024-05-20T22:08:15.628562+0000","last_became_active":"2024-05-20T22:06:23.011997+0000","last_became_peered":"2024-05-20T22:06:23.011997+0000","last_unstale":"2024-05-20T22:08:15.628562+0000","last_undegraded":"2024-05-20T22:08:15.628562+0000","last_fullsized":"2024-05-20T22:08:15.628562+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:35:13.511729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.475337+0000","last_change":"2024-05-20T22:06:27.414114+0000","last_active":"2024-05-20T22:08:15.475337+0000","last_peered":"2024-05-20T22:08:15.475337+0000","last_clean":"2024-05-20T22:08:15.475337+0000","last_became_active":"2024-05-20T22:06:27.412997+0000","last_became_peered":"2024-05-20T22:06:27.412997+0000","last_unstale":"2024-05-20T22:08:15.475337+0000","last_undegraded":"2024-05-20T22:08:15.475337+0000","last_fullsized":"2024-05-20T22:08:15.475337+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:26:09.004178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468207+0000","last_change":"2024-05-20T22:06:29.564384+0000","last_active":"2024-05-20T22:08:15.468207+0000","last_peered":"2024-05-20T22:08:15.468207+0000","last_clean":"2024-05-20T22:08:15.468207+0000","last_became_active":"2024-05-20T22:06:29.563420+0000","last_became_peered":"2024-05-20T22:06:29.563420+0000","last_unstale":"2024-05-20T22:08:15.468207+0000","last_undegraded":"2024-05-20T22:08:15.468207+0000","last_fullsized":"2024-05-20T22:08:15.468207+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:50:26.991491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"67'12","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.087015+0000","last_change":"2024-05-20T22:06:25.071363+0000","last_active":"2024-05-20T22:08:16.087015+0000","last_peered":"2024-05-20T22:08:16.087015+0000","last_clean":"2024-05-20T22:08:16.087015+0000","last_became_active":"2024-05-20T22:06:25.070887+0000","last_became_peered":"2024-05-20T22:06:25.070887+0000","last_unstale":"2024-05-20T22:08:16.087015+0000","last_undegraded":"2024-05-20T22:08:16.087015+0000","last_fullsized":"2024-05-20T22:08:16.087015+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:16:56.842927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085947+0000","last_change":"2024-05-20T22:06:23.004029+0000","last_active":"2024-05-20T22:08:16.085947+0000","last_peered":"2024-05-20T22:08:16.085947+0000","last_clean":"2024-05-20T22:08:16.085947+0000","last_became_active":"2024-05-20T22:06:23.003722+0000","last_became_peered":"2024-05-20T22:06:23.003722+0000","last_unstale":"2024-05-20T22:08:16.085947+0000","last_undegraded":"2024-05-20T22:08:16.085947+0000","last_fullsized":"2024-05-20T22:08:16.085947+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:58:01.357660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.470215+0000","last_change":"2024-05-20T22:06:35.121191+0000","last_active":"2024-05-20T22:08:15.470215+0000","last_peered":"2024-05-20T22:08:15.470215+0000","last_clean":"2024-05-20T22:08:15.470215+0000","last_became_active":"2024-05-20T22:06:26.390871+0000","last_became_peered":"2024-05-20T22:06:26.390871+0000","last_unstale":"2024-05-20T22:08:15.470215+0000","last_undegraded":"2024-05-20T22:08:15.470215+0000","last_fullsized":"2024-05-20T22:08:15.470215+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:25.031588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:25.031588+0000","last_clean_scrub_stamp":"2024-05-20T22:06:25.031588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:57:36.080011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011120049999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"67'11","reported_seq":74,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:53.181190+0000","last_change":"2024-05-20T22:06:27.419227+0000","last_active":"2024-05-20T22:08:53.181190+0000","last_peered":"2024-05-20T22:08:53.181190+0000","last_clean":"2024-05-20T22:08:53.181190+0000","last_became_active":"2024-05-20T22:06:27.417894+0000","last_became_peered":"2024-05-20T22:06:27.417894+0000","last_unstale":"2024-05-20T22:08:53.181190+0000","last_undegraded":"2024-05-20T22:08:53.181190+0000","last_fullsized":"2024-05-20T22:08:53.181190+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:39:12.785933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.629494+0000","last_change":"2024-05-20T22:06:29.570597+0000","last_active":"2024-05-20T22:08:15.629494+0000","last_peered":"2024-05-20T22:08:15.629494+0000","last_clean":"2024-05-20T22:08:15.629494+0000","last_became_active":"2024-05-20T22:06:29.569420+0000","last_became_peered":"2024-05-20T22:06:29.569420+0000","last_unstale":"2024-05-20T22:08:15.629494+0000","last_undegraded":"2024-05-20T22:08:15.629494+0000","last_fullsized":"2024-05-20T22:08:15.629494+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:30:32.409973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"67'13","reported_seq":63,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469208+0000","last_change":"2024-05-20T22:06:25.055706+0000","last_active":"2024-05-20T22:08:15.469208+0000","last_peered":"2024-05-20T22:08:15.469208+0000","last_clean":"2024-05-20T22:08:15.469208+0000","last_became_active":"2024-05-20T22:06:25.055456+0000","last_became_peered":"2024-05-20T22:06:25.055456+0000","last_unstale":"2024-05-20T22:08:15.469208+0000","last_undegraded":"2024-05-20T22:08:15.469208+0000","last_fullsized":"2024-05-20T22:08:15.469208+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:58:49.157482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"60'1","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.753094+0000","last_change":"2024-05-20T22:06:23.007769+0000","last_active":"2024-05-20T22:08:15.753094+0000","last_peered":"2024-05-20T22:08:15.753094+0000","last_clean":"2024-05-20T22:08:15.753094+0000","last_became_active":"2024-05-20T22:06:23.007399+0000","last_became_peered":"2024-05-20T22:06:23.007399+0000","last_unstale":"2024-05-20T22:08:15.753094+0000","last_undegraded":"2024-05-20T22:08:15.753094+0000","last_fullsized":"2024-05-20T22:08:15.753094+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:14:41.743809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"71'5","reported_seq":182,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:58.657032+0000","last_change":"2024-05-20T22:06:35.767411+0000","last_active":"2024-05-20T22:08:58.657032+0000","last_peered":"2024-05-20T22:08:58.657032+0000","last_clean":"2024-05-20T22:08:58.657032+0000","last_became_active":"2024-05-20T22:06:26.384280+0000","last_became_peered":"2024-05-20T22:06:26.384280+0000","last_unstale":"2024-05-20T22:08:58.657032+0000","last_undegraded":"2024-05-20T22:08:58.657032+0000","last_fullsized":"2024-05-20T22:08:58.657032+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:25.031588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:25.031588+0000","last_clean_scrub_stamp":"2024-05-20T22:06:25.031588+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:57:39.372545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001190296,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":138,"num_read_kb":133,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469942+0000","last_change":"2024-05-20T22:06:27.419020+0000","last_active":"2024-05-20T22:08:15.469942+0000","last_peered":"2024-05-20T22:08:15.469942+0000","last_clean":"2024-05-20T22:08:15.469942+0000","last_became_active":"2024-05-20T22:06:27.418318+0000","last_became_peered":"2024-05-20T22:06:27.418318+0000","last_unstale":"2024-05-20T22:08:15.469942+0000","last_undegraded":"2024-05-20T22:08:15.469942+0000","last_fullsized":"2024-05-20T22:08:15.469942+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:52:40.762246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.470112+0000","last_change":"2024-05-20T22:06:29.443016+0000","last_active":"2024-05-20T22:08:15.470112+0000","last_peered":"2024-05-20T22:08:15.470112+0000","last_clean":"2024-05-20T22:08:15.470112+0000","last_became_active":"2024-05-20T22:06:29.442254+0000","last_became_peered":"2024-05-20T22:06:29.442254+0000","last_unstale":"2024-05-20T22:08:15.470112+0000","last_undegraded":"2024-05-20T22:08:15.470112+0000","last_fullsized":"2024-05-20T22:08:15.470112+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:12:24.540459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"67'30","reported_seq":118,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:53.180913+0000","last_change":"2024-05-20T22:06:25.053652+0000","last_active":"2024-05-20T22:08:53.180913+0000","last_peered":"2024-05-20T22:08:53.180913+0000","last_clean":"2024-05-20T22:08:53.180913+0000","last_became_active":"2024-05-20T22:06:25.053373+0000","last_became_peered":"2024-05-20T22:06:25.053373+0000","last_unstale":"2024-05-20T22:08:53.180913+0000","last_undegraded":"2024-05-20T22:08:53.180913+0000","last_fullsized":"2024-05-20T22:08:53.180913+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:22:57.962713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"60'1","reported_seq":48,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.630989+0000","last_change":"2024-05-20T22:06:22.998757+0000","last_active":"2024-05-20T22:08:15.630989+0000","last_peered":"2024-05-20T22:08:15.630989+0000","last_clean":"2024-05-20T22:08:15.630989+0000","last_became_active":"2024-05-20T22:06:22.998401+0000","last_became_peered":"2024-05-20T22:06:22.998401+0000","last_unstale":"2024-05-20T22:08:15.630989+0000","last_undegraded":"2024-05-20T22:08:15.630989+0000","last_fullsized":"2024-05-20T22:08:15.630989+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:11:49.578238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.084609+0000","last_change":"2024-05-20T22:06:27.397503+0000","last_active":"2024-05-20T22:08:16.084609+0000","last_peered":"2024-05-20T22:08:16.084609+0000","last_clean":"2024-05-20T22:08:16.084609+0000","last_became_active":"2024-05-20T22:06:27.396612+0000","last_became_peered":"2024-05-20T22:06:27.396612+0000","last_unstale":"2024-05-20T22:08:16.084609+0000","last_undegraded":"2024-05-20T22:08:16.084609+0000","last_fullsized":"2024-05-20T22:08:16.084609+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:58:25.201042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.751295+0000","last_change":"2024-05-20T22:06:29.564464+0000","last_active":"2024-05-20T22:08:15.751295+0000","last_peered":"2024-05-20T22:08:15.751295+0000","last_clean":"2024-05-20T22:08:15.751295+0000","last_became_active":"2024-05-20T22:06:29.563124+0000","last_became_peered":"2024-05-20T22:06:29.563124+0000","last_unstale":"2024-05-20T22:08:15.751295+0000","last_undegraded":"2024-05-20T22:08:15.751295+0000","last_fullsized":"2024-05-20T22:08:15.751295+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:19.502293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"67'16","reported_seq":90,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:53.180516+0000","last_change":"2024-05-20T22:06:25.059991+0000","last_active":"2024-05-20T22:08:53.180516+0000","last_peered":"2024-05-20T22:08:53.180516+0000","last_clean":"2024-05-20T22:08:53.180516+0000","last_became_active":"2024-05-20T22:06:25.059017+0000","last_became_peered":"2024-05-20T22:06:25.059017+0000","last_unstale":"2024-05-20T22:08:53.180516+0000","last_undegraded":"2024-05-20T22:08:53.180516+0000","last_fullsized":"2024-05-20T22:08:53.180516+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:16:56.730419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.752553+0000","last_change":"2024-05-20T22:06:23.013107+0000","last_active":"2024-05-20T22:08:15.752553+0000","last_peered":"2024-05-20T22:08:15.752553+0000","last_clean":"2024-05-20T22:08:15.752553+0000","last_became_active":"2024-05-20T22:06:23.012632+0000","last_became_peered":"2024-05-20T22:06:23.012632+0000","last_unstale":"2024-05-20T22:08:15.752553+0000","last_undegraded":"2024-05-20T22:08:15.752553+0000","last_fullsized":"2024-05-20T22:08:15.752553+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:22:20.105817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"70'2","reported_seq":43,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.752094+0000","last_change":"2024-05-20T22:06:35.118369+0000","last_active":"2024-05-20T22:08:15.752094+0000","last_peered":"2024-05-20T22:08:15.752094+0000","last_clean":"2024-05-20T22:08:15.752094+0000","last_became_active":"2024-05-20T22:06:26.395513+0000","last_became_peered":"2024-05-20T22:06:26.395513+0000","last_unstale":"2024-05-20T22:08:15.752094+0000","last_undegraded":"2024-05-20T22:08:15.752094+0000","last_fullsized":"2024-05-20T22:08:15.752094+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:25.031588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:25.031588+0000","last_clean_scrub_stamp":"2024-05-20T22:06:25.031588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:51:31.494591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017936919999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"67'11","reported_seq":74,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:53.180915+0000","last_change":"2024-05-20T22:06:27.413033+0000","last_active":"2024-05-20T22:08:53.180915+0000","last_peered":"2024-05-20T22:08:53.180915+0000","last_clean":"2024-05-20T22:08:53.180915+0000","last_became_active":"2024-05-20T22:06:27.412760+0000","last_became_peered":"2024-05-20T22:06:27.412760+0000","last_unstale":"2024-05-20T22:08:53.180915+0000","last_undegraded":"2024-05-20T22:08:53.180915+0000","last_fullsized":"2024-05-20T22:08:53.180915+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:40:58.300011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085652+0000","last_change":"2024-05-20T22:06:29.450760+0000","last_active":"2024-05-20T22:08:16.085652+0000","last_peered":"2024-05-20T22:08:16.085652+0000","last_clean":"2024-05-20T22:08:16.085652+0000","last_became_active":"2024-05-20T22:06:29.449802+0000","last_became_peered":"2024-05-20T22:06:29.449802+0000","last_unstale":"2024-05-20T22:08:16.085652+0000","last_undegraded":"2024-05-20T22:08:16.085652+0000","last_fullsized":"2024-05-20T22:08:16.085652+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:51:46.791145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"67'19","reported_seq":72,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.470957+0000","last_change":"2024-05-20T22:06:25.071052+0000","last_active":"2024-05-20T22:08:15.470957+0000","last_peered":"2024-05-20T22:08:15.470957+0000","last_clean":"2024-05-20T22:08:15.470957+0000","last_became_active":"2024-05-20T22:06:25.070000+0000","last_became_peered":"2024-05-20T22:06:25.070000+0000","last_unstale":"2024-05-20T22:08:15.470957+0000","last_undegraded":"2024-05-20T22:08:15.470957+0000","last_fullsized":"2024-05-20T22:08:15.470957+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:40:41.531901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.474308+0000","last_change":"2024-05-20T22:06:23.005590+0000","last_active":"2024-05-20T22:08:15.474308+0000","last_peered":"2024-05-20T22:08:15.474308+0000","last_clean":"2024-05-20T22:08:15.474308+0000","last_became_active":"2024-05-20T22:06:23.005213+0000","last_became_peered":"2024-05-20T22:06:23.005213+0000","last_unstale":"2024-05-20T22:08:15.474308+0000","last_undegraded":"2024-05-20T22:08:15.474308+0000","last_fullsized":"2024-05-20T22:08:15.474308+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:03:52.353796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.086636+0000","last_change":"2024-05-20T22:06:27.416729+0000","last_active":"2024-05-20T22:08:16.086636+0000","last_peered":"2024-05-20T22:08:16.086636+0000","last_clean":"2024-05-20T22:08:16.086636+0000","last_became_active":"2024-05-20T22:06:27.416420+0000","last_became_peered":"2024-05-20T22:06:27.416420+0000","last_unstale":"2024-05-20T22:08:16.086636+0000","last_undegraded":"2024-05-20T22:08:16.086636+0000","last_fullsized":"2024-05-20T22:08:16.086636+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:15:52.797982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468752+0000","last_change":"2024-05-20T22:06:29.442365+0000","last_active":"2024-05-20T22:08:15.468752+0000","last_peered":"2024-05-20T22:08:15.468752+0000","last_clean":"2024-05-20T22:08:15.468752+0000","last_became_active":"2024-05-20T22:06:29.441540+0000","last_became_peered":"2024-05-20T22:06:29.441540+0000","last_unstale":"2024-05-20T22:08:15.468752+0000","last_undegraded":"2024-05-20T22:08:15.468752+0000","last_fullsized":"2024-05-20T22:08:15.468752+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:33:02.812062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"67'18","reported_seq":68,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.751554+0000","last_change":"2024-05-20T22:06:25.052587+0000","last_active":"2024-05-20T22:08:15.751554+0000","last_peered":"2024-05-20T22:08:15.751554+0000","last_clean":"2024-05-20T22:08:15.751554+0000","last_became_active":"2024-05-20T22:06:25.052295+0000","last_became_peered":"2024-05-20T22:06:25.052295+0000","last_unstale":"2024-05-20T22:08:15.751554+0000","last_undegraded":"2024-05-20T22:08:15.751554+0000","last_fullsized":"2024-05-20T22:08:15.751554+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:28:56.193438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468231+0000","last_change":"2024-05-20T22:06:23.013559+0000","last_active":"2024-05-20T22:08:15.468231+0000","last_peered":"2024-05-20T22:08:15.468231+0000","last_clean":"2024-05-20T22:08:15.468231+0000","last_became_active":"2024-05-20T22:06:23.013013+0000","last_became_peered":"2024-05-20T22:06:23.013013+0000","last_unstale":"2024-05-20T22:08:15.468231+0000","last_undegraded":"2024-05-20T22:08:15.468231+0000","last_fullsized":"2024-05-20T22:08:15.468231+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:46:03.028759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468561+0000","last_change":"2024-05-20T22:06:27.401074+0000","last_active":"2024-05-20T22:08:15.468561+0000","last_peered":"2024-05-20T22:08:15.468561+0000","last_clean":"2024-05-20T22:08:15.468561+0000","last_became_active":"2024-05-20T22:06:27.400634+0000","last_became_peered":"2024-05-20T22:06:27.400634+0000","last_unstale":"2024-05-20T22:08:15.468561+0000","last_undegraded":"2024-05-20T22:08:15.468561+0000","last_fullsized":"2024-05-20T22:08:15.468561+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:55:42.212884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.629946+0000","last_change":"2024-05-20T22:06:29.566454+0000","last_active":"2024-05-20T22:08:15.629946+0000","last_peered":"2024-05-20T22:08:15.629946+0000","last_clean":"2024-05-20T22:08:15.629946+0000","last_became_active":"2024-05-20T22:06:29.561912+0000","last_became_peered":"2024-05-20T22:06:29.561912+0000","last_unstale":"2024-05-20T22:08:15.629946+0000","last_undegraded":"2024-05-20T22:08:15.629946+0000","last_fullsized":"2024-05-20T22:08:15.629946+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:00:41.095694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"67'14","reported_seq":57,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085686+0000","last_change":"2024-05-20T22:06:25.060518+0000","last_active":"2024-05-20T22:08:16.085686+0000","last_peered":"2024-05-20T22:08:16.085686+0000","last_clean":"2024-05-20T22:08:16.085686+0000","last_became_active":"2024-05-20T22:06:25.060278+0000","last_became_peered":"2024-05-20T22:06:25.060278+0000","last_unstale":"2024-05-20T22:08:16.085686+0000","last_undegraded":"2024-05-20T22:08:16.085686+0000","last_fullsized":"2024-05-20T22:08:16.085686+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:00:54.637456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.628702+0000","last_change":"2024-05-20T22:06:23.011865+0000","last_active":"2024-05-20T22:08:15.628702+0000","last_peered":"2024-05-20T22:08:15.628702+0000","last_clean":"2024-05-20T22:08:15.628702+0000","last_became_active":"2024-05-20T22:06:23.011566+0000","last_became_peered":"2024-05-20T22:06:23.011566+0000","last_unstale":"2024-05-20T22:08:15.628702+0000","last_undegraded":"2024-05-20T22:08:15.628702+0000","last_fullsized":"2024-05-20T22:08:15.628702+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:56:02.499130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.475504+0000","last_change":"2024-05-20T22:06:27.403563+0000","last_active":"2024-05-20T22:08:15.475504+0000","last_peered":"2024-05-20T22:08:15.475504+0000","last_clean":"2024-05-20T22:08:15.475504+0000","last_became_active":"2024-05-20T22:06:27.402802+0000","last_became_peered":"2024-05-20T22:06:27.402802+0000","last_unstale":"2024-05-20T22:08:15.475504+0000","last_undegraded":"2024-05-20T22:08:15.475504+0000","last_fullsized":"2024-05-20T22:08:15.475504+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:18:33.437485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.751728+0000","last_change":"2024-05-20T22:06:29.457628+0000","last_active":"2024-05-20T22:08:15.751728+0000","last_peered":"2024-05-20T22:08:15.751728+0000","last_clean":"2024-05-20T22:08:15.751728+0000","last_became_active":"2024-05-20T22:06:29.456787+0000","last_became_peered":"2024-05-20T22:06:29.456787+0000","last_unstale":"2024-05-20T22:08:15.751728+0000","last_undegraded":"2024-05-20T22:08:15.751728+0000","last_fullsized":"2024-05-20T22:08:15.751728+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:39:37.964088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469788+0000","last_change":"2024-05-20T22:06:25.061218+0000","last_active":"2024-05-20T22:08:15.469788+0000","last_peered":"2024-05-20T22:08:15.469788+0000","last_clean":"2024-05-20T22:08:15.469788+0000","last_became_active":"2024-05-20T22:06:25.059997+0000","last_became_peered":"2024-05-20T22:06:25.059997+0000","last_unstale":"2024-05-20T22:08:15.469788+0000","last_undegraded":"2024-05-20T22:08:15.469788+0000","last_fullsized":"2024-05-20T22:08:15.469788+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:44:30.445005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.480550+0000","last_change":"2024-05-20T22:08:15.479872+0000","last_active":"2024-05-20T22:08:15.480550+0000","last_peered":"2024-05-20T22:08:15.480550+0000","last_clean":"2024-05-20T22:08:15.480550+0000","last_became_active":"2024-05-20T22:08:15.479153+0000","last_became_peered":"2024-05-20T22:08:15.479153+0000","last_unstale":"2024-05-20T22:08:15.480550+0000","last_undegraded":"2024-05-20T22:08:15.480550+0000","last_fullsized":"2024-05-20T22:08:15.480550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:46:46.558917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":283,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.628872+0000","last_change":"2024-05-20T22:05:46.311106+0000","last_active":"2024-05-20T22:08:15.628872+0000","last_peered":"2024-05-20T22:08:15.628872+0000","last_clean":"2024-05-20T22:08:15.628872+0000","last_became_active":"2024-05-20T22:05:46.309705+0000","last_became_peered":"2024-05-20T22:05:46.309705+0000","last_unstale":"2024-05-20T22:08:15.628872+0000","last_undegraded":"2024-05-20T22:08:15.628872+0000","last_fullsized":"2024-05-20T22:08:15.628872+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:01:30.034667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:01:30.034667+0000","last_clean_scrub_stamp":"2024-05-20T22:01:30.034667+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:59:28.153959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.629845+0000","last_change":"2024-05-20T22:06:27.412998+0000","last_active":"2024-05-20T22:08:15.629845+0000","last_peered":"2024-05-20T22:08:15.629845+0000","last_clean":"2024-05-20T22:08:15.629845+0000","last_became_active":"2024-05-20T22:06:27.412320+0000","last_became_peered":"2024-05-20T22:06:27.412320+0000","last_unstale":"2024-05-20T22:08:15.629845+0000","last_undegraded":"2024-05-20T22:08:15.629845+0000","last_fullsized":"2024-05-20T22:08:15.629845+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:01:24.418456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.475099+0000","last_change":"2024-05-20T22:06:29.443486+0000","last_active":"2024-05-20T22:08:15.475099+0000","last_peered":"2024-05-20T22:08:15.475099+0000","last_clean":"2024-05-20T22:08:15.475099+0000","last_became_active":"2024-05-20T22:06:29.442576+0000","last_became_peered":"2024-05-20T22:06:29.442576+0000","last_unstale":"2024-05-20T22:08:15.475099+0000","last_undegraded":"2024-05-20T22:08:15.475099+0000","last_fullsized":"2024-05-20T22:08:15.475099+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:16:00.579619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"67'17","reported_seq":64,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.630709+0000","last_change":"2024-05-20T22:06:25.065593+0000","last_active":"2024-05-20T22:08:15.630709+0000","last_peered":"2024-05-20T22:08:15.630709+0000","last_clean":"2024-05-20T22:08:15.630709+0000","last_became_active":"2024-05-20T22:06:25.065262+0000","last_became_peered":"2024-05-20T22:06:25.065262+0000","last_unstale":"2024-05-20T22:08:15.630709+0000","last_undegraded":"2024-05-20T22:08:15.630709+0000","last_fullsized":"2024-05-20T22:08:15.630709+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:15:22.550808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469744+0000","last_change":"2024-05-20T22:06:23.014272+0000","last_active":"2024-05-20T22:08:15.469744+0000","last_peered":"2024-05-20T22:08:15.469744+0000","last_clean":"2024-05-20T22:08:15.469744+0000","last_became_active":"2024-05-20T22:06:23.013903+0000","last_became_peered":"2024-05-20T22:06:23.013903+0000","last_unstale":"2024-05-20T22:08:15.469744+0000","last_undegraded":"2024-05-20T22:08:15.469744+0000","last_fullsized":"2024-05-20T22:08:15.469744+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:52:27.784083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468085+0000","last_change":"2024-05-20T22:06:27.410838+0000","last_active":"2024-05-20T22:08:15.468085+0000","last_peered":"2024-05-20T22:08:15.468085+0000","last_clean":"2024-05-20T22:08:15.468085+0000","last_became_active":"2024-05-20T22:06:27.410011+0000","last_became_peered":"2024-05-20T22:06:27.410011+0000","last_unstale":"2024-05-20T22:08:15.468085+0000","last_undegraded":"2024-05-20T22:08:15.468085+0000","last_fullsized":"2024-05-20T22:08:15.468085+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:33:58.172024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.628858+0000","last_change":"2024-05-20T22:06:29.441361+0000","last_active":"2024-05-20T22:08:15.628858+0000","last_peered":"2024-05-20T22:08:15.628858+0000","last_clean":"2024-05-20T22:08:15.628858+0000","last_became_active":"2024-05-20T22:06:29.440591+0000","last_became_peered":"2024-05-20T22:06:29.440591+0000","last_unstale":"2024-05-20T22:08:15.628858+0000","last_undegraded":"2024-05-20T22:08:15.628858+0000","last_fullsized":"2024-05-20T22:08:15.628858+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:01:08.800009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.473785+0000","last_change":"2024-05-20T22:06:25.059981+0000","last_active":"2024-05-20T22:08:15.473785+0000","last_peered":"2024-05-20T22:08:15.473785+0000","last_clean":"2024-05-20T22:08:15.473785+0000","last_became_active":"2024-05-20T22:06:25.059500+0000","last_became_peered":"2024-05-20T22:06:25.059500+0000","last_unstale":"2024-05-20T22:08:15.473785+0000","last_undegraded":"2024-05-20T22:08:15.473785+0000","last_fullsized":"2024-05-20T22:08:15.473785+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:24:57.125210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.752947+0000","last_change":"2024-05-20T22:06:23.008199+0000","last_active":"2024-05-20T22:08:15.752947+0000","last_peered":"2024-05-20T22:08:15.752947+0000","last_clean":"2024-05-20T22:08:15.752947+0000","last_became_active":"2024-05-20T22:06:23.007329+0000","last_became_peered":"2024-05-20T22:06:23.007329+0000","last_unstale":"2024-05-20T22:08:15.752947+0000","last_undegraded":"2024-05-20T22:08:15.752947+0000","last_fullsized":"2024-05-20T22:08:15.752947+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:31:45.511353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469310+0000","last_change":"2024-05-20T22:06:27.390675+0000","last_active":"2024-05-20T22:08:15.469310+0000","last_peered":"2024-05-20T22:08:15.469310+0000","last_clean":"2024-05-20T22:08:15.469310+0000","last_became_active":"2024-05-20T22:06:27.390006+0000","last_became_peered":"2024-05-20T22:06:27.390006+0000","last_unstale":"2024-05-20T22:08:15.469310+0000","last_undegraded":"2024-05-20T22:08:15.469310+0000","last_fullsized":"2024-05-20T22:08:15.469310+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:27:28.168526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"67'1","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085572+0000","last_change":"2024-05-20T22:06:29.454392+0000","last_active":"2024-05-20T22:08:16.085572+0000","last_peered":"2024-05-20T22:08:16.085572+0000","last_clean":"2024-05-20T22:08:16.085572+0000","last_became_active":"2024-05-20T22:06:29.453781+0000","last_became_peered":"2024-05-20T22:06:29.453781+0000","last_unstale":"2024-05-20T22:08:16.085572+0000","last_undegraded":"2024-05-20T22:08:16.085572+0000","last_fullsized":"2024-05-20T22:08:16.085572+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:17:16.808719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.630391+0000","last_change":"2024-05-20T22:06:25.073270+0000","last_active":"2024-05-20T22:08:15.630391+0000","last_peered":"2024-05-20T22:08:15.630391+0000","last_clean":"2024-05-20T22:08:15.630391+0000","last_became_active":"2024-05-20T22:06:25.072442+0000","last_became_peered":"2024-05-20T22:06:25.072442+0000","last_unstale":"2024-05-20T22:08:15.630391+0000","last_undegraded":"2024-05-20T22:08:15.630391+0000","last_fullsized":"2024-05-20T22:08:15.630391+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:14:18.217494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468789+0000","last_change":"2024-05-20T22:06:23.011534+0000","last_active":"2024-05-20T22:08:15.468789+0000","last_peered":"2024-05-20T22:08:15.468789+0000","last_clean":"2024-05-20T22:08:15.468789+0000","last_became_active":"2024-05-20T22:06:23.011199+0000","last_became_peered":"2024-05-20T22:06:23.011199+0000","last_unstale":"2024-05-20T22:08:15.468789+0000","last_undegraded":"2024-05-20T22:08:15.468789+0000","last_fullsized":"2024-05-20T22:08:15.468789+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:03:48.087041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"67'11","reported_seq":77,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:53.180378+0000","last_change":"2024-05-20T22:06:27.420368+0000","last_active":"2024-05-20T22:08:53.180378+0000","last_peered":"2024-05-20T22:08:53.180378+0000","last_clean":"2024-05-20T22:08:53.180378+0000","last_became_active":"2024-05-20T22:06:27.419548+0000","last_became_peered":"2024-05-20T22:06:27.419548+0000","last_unstale":"2024-05-20T22:08:53.180378+0000","last_undegraded":"2024-05-20T22:08:53.180378+0000","last_fullsized":"2024-05-20T22:08:53.180378+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:54:33.572522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.473198+0000","last_change":"2024-05-20T22:06:29.567552+0000","last_active":"2024-05-20T22:08:15.473198+0000","last_peered":"2024-05-20T22:08:15.473198+0000","last_clean":"2024-05-20T22:08:15.473198+0000","last_became_active":"2024-05-20T22:06:29.566659+0000","last_became_peered":"2024-05-20T22:06:29.566659+0000","last_unstale":"2024-05-20T22:08:15.473198+0000","last_undegraded":"2024-05-20T22:08:15.473198+0000","last_fullsized":"2024-05-20T22:08:15.473198+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:28:04.948127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.630856+0000","last_change":"2024-05-20T22:06:25.072607+0000","last_active":"2024-05-20T22:08:15.630856+0000","last_peered":"2024-05-20T22:08:15.630856+0000","last_clean":"2024-05-20T22:08:15.630856+0000","last_became_active":"2024-05-20T22:06:25.072260+0000","last_became_peered":"2024-05-20T22:06:25.072260+0000","last_unstale":"2024-05-20T22:08:15.630856+0000","last_undegraded":"2024-05-20T22:08:15.630856+0000","last_fullsized":"2024-05-20T22:08:15.630856+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:58:26.906845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"60'2","reported_seq":56,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.472117+0000","last_change":"2024-05-20T22:06:23.011778+0000","last_active":"2024-05-20T22:08:15.472117+0000","last_peered":"2024-05-20T22:08:15.472117+0000","last_clean":"2024-05-20T22:08:15.472117+0000","last_became_active":"2024-05-20T22:06:23.011395+0000","last_became_peered":"2024-05-20T22:06:23.011395+0000","last_unstale":"2024-05-20T22:08:15.472117+0000","last_undegraded":"2024-05-20T22:08:15.472117+0000","last_fullsized":"2024-05-20T22:08:15.472117+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:54:21.963250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469437+0000","last_change":"2024-05-20T22:06:27.410190+0000","last_active":"2024-05-20T22:08:15.469437+0000","last_peered":"2024-05-20T22:08:15.469437+0000","last_clean":"2024-05-20T22:08:15.469437+0000","last_became_active":"2024-05-20T22:06:27.409619+0000","last_became_peered":"2024-05-20T22:06:27.409619+0000","last_unstale":"2024-05-20T22:08:15.469437+0000","last_undegraded":"2024-05-20T22:08:15.469437+0000","last_fullsized":"2024-05-20T22:08:15.469437+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:52:20.235947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469247+0000","last_change":"2024-05-20T22:06:29.446420+0000","last_active":"2024-05-20T22:08:15.469247+0000","last_peered":"2024-05-20T22:08:15.469247+0000","last_clean":"2024-05-20T22:08:15.469247+0000","last_became_active":"2024-05-20T22:06:29.445552+0000","last_became_peered":"2024-05-20T22:06:29.445552+0000","last_unstale":"2024-05-20T22:08:15.469247+0000","last_undegraded":"2024-05-20T22:08:15.469247+0000","last_fullsized":"2024-05-20T22:08:15.469247+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:42:31.878796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.629101+0000","last_change":"2024-05-20T22:06:25.061950+0000","last_active":"2024-05-20T22:08:15.629101+0000","last_peered":"2024-05-20T22:08:15.629101+0000","last_clean":"2024-05-20T22:08:15.629101+0000","last_became_active":"2024-05-20T22:06:25.061176+0000","last_became_peered":"2024-05-20T22:06:25.061176+0000","last_unstale":"2024-05-20T22:08:15.629101+0000","last_undegraded":"2024-05-20T22:08:15.629101+0000","last_fullsized":"2024-05-20T22:08:15.629101+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:23:50.474287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.467835+0000","last_change":"2024-05-20T22:06:23.015933+0000","last_active":"2024-05-20T22:08:15.467835+0000","last_peered":"2024-05-20T22:08:15.467835+0000","last_clean":"2024-05-20T22:08:15.467835+0000","last_became_active":"2024-05-20T22:06:23.015168+0000","last_became_peered":"2024-05-20T22:06:23.015168+0000","last_unstale":"2024-05-20T22:08:15.467835+0000","last_undegraded":"2024-05-20T22:08:15.467835+0000","last_fullsized":"2024-05-20T22:08:15.467835+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:32:22.327150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468848+0000","last_change":"2024-05-20T22:06:27.398870+0000","last_active":"2024-05-20T22:08:15.468848+0000","last_peered":"2024-05-20T22:08:15.468848+0000","last_clean":"2024-05-20T22:08:15.468848+0000","last_became_active":"2024-05-20T22:06:27.398393+0000","last_became_peered":"2024-05-20T22:06:27.398393+0000","last_unstale":"2024-05-20T22:08:15.468848+0000","last_undegraded":"2024-05-20T22:08:15.468848+0000","last_fullsized":"2024-05-20T22:08:15.468848+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:07:40.322803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468749+0000","last_change":"2024-05-20T22:06:29.433281+0000","last_active":"2024-05-20T22:08:15.468749+0000","last_peered":"2024-05-20T22:08:15.468749+0000","last_clean":"2024-05-20T22:08:15.468749+0000","last_became_active":"2024-05-20T22:06:29.432293+0000","last_became_peered":"2024-05-20T22:06:29.432293+0000","last_unstale":"2024-05-20T22:08:15.468749+0000","last_undegraded":"2024-05-20T22:08:15.468749+0000","last_fullsized":"2024-05-20T22:08:15.468749+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:19:03.248509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"67'4","reported_seq":42,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.084532+0000","last_change":"2024-05-20T22:06:25.060484+0000","last_active":"2024-05-20T22:08:16.084532+0000","last_peered":"2024-05-20T22:08:16.084532+0000","last_clean":"2024-05-20T22:08:16.084532+0000","last_became_active":"2024-05-20T22:06:25.060201+0000","last_became_peered":"2024-05-20T22:06:25.060201+0000","last_unstale":"2024-05-20T22:08:16.084532+0000","last_undegraded":"2024-05-20T22:08:16.084532+0000","last_fullsized":"2024-05-20T22:08:16.084532+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:35:22.912019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085831+0000","last_change":"2024-05-20T22:06:23.003485+0000","last_active":"2024-05-20T22:08:16.085831+0000","last_peered":"2024-05-20T22:08:16.085831+0000","last_clean":"2024-05-20T22:08:16.085831+0000","last_became_active":"2024-05-20T22:06:23.003080+0000","last_became_peered":"2024-05-20T22:06:23.003080+0000","last_unstale":"2024-05-20T22:08:16.085831+0000","last_undegraded":"2024-05-20T22:08:16.085831+0000","last_fullsized":"2024-05-20T22:08:16.085831+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:23:20.631870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.475380+0000","last_change":"2024-05-20T22:06:27.396098+0000","last_active":"2024-05-20T22:08:15.475380+0000","last_peered":"2024-05-20T22:08:15.475380+0000","last_clean":"2024-05-20T22:08:15.475380+0000","last_became_active":"2024-05-20T22:06:27.395214+0000","last_became_peered":"2024-05-20T22:06:27.395214+0000","last_unstale":"2024-05-20T22:08:15.475380+0000","last_undegraded":"2024-05-20T22:08:15.475380+0000","last_fullsized":"2024-05-20T22:08:15.475380+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:25:43.415911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.629947+0000","last_change":"2024-05-20T22:06:29.568024+0000","last_active":"2024-05-20T22:08:15.629947+0000","last_peered":"2024-05-20T22:08:15.629947+0000","last_clean":"2024-05-20T22:08:15.629947+0000","last_became_active":"2024-05-20T22:06:29.567025+0000","last_became_peered":"2024-05-20T22:06:29.567025+0000","last_unstale":"2024-05-20T22:08:15.629947+0000","last_undegraded":"2024-05-20T22:08:15.629947+0000","last_fullsized":"2024-05-20T22:08:15.629947+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:05:41.436898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.630125+0000","last_change":"2024-05-20T22:06:25.072536+0000","last_active":"2024-05-20T22:08:15.630125+0000","last_peered":"2024-05-20T22:08:15.630125+0000","last_clean":"2024-05-20T22:08:15.630125+0000","last_became_active":"2024-05-20T22:06:25.072138+0000","last_became_peered":"2024-05-20T22:06:25.072138+0000","last_unstale":"2024-05-20T22:08:15.630125+0000","last_undegraded":"2024-05-20T22:08:15.630125+0000","last_fullsized":"2024-05-20T22:08:15.630125+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:09:41.818180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":48,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.473891+0000","last_change":"2024-05-20T22:06:23.005474+0000","last_active":"2024-05-20T22:08:15.473891+0000","last_peered":"2024-05-20T22:08:15.473891+0000","last_clean":"2024-05-20T22:08:15.473891+0000","last_became_active":"2024-05-20T22:06:23.005101+0000","last_became_peered":"2024-05-20T22:06:23.005101+0000","last_unstale":"2024-05-20T22:08:15.473891+0000","last_undegraded":"2024-05-20T22:08:15.473891+0000","last_fullsized":"2024-05-20T22:08:15.473891+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:05:20.568967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"67'11","reported_seq":74,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:53.180447+0000","last_change":"2024-05-20T22:06:27.409996+0000","last_active":"2024-05-20T22:08:53.180447+0000","last_peered":"2024-05-20T22:08:53.180447+0000","last_clean":"2024-05-20T22:08:53.180447+0000","last_became_active":"2024-05-20T22:06:27.409120+0000","last_became_peered":"2024-05-20T22:06:27.409120+0000","last_unstale":"2024-05-20T22:08:53.180447+0000","last_undegraded":"2024-05-20T22:08:53.180447+0000","last_fullsized":"2024-05-20T22:08:53.180447+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:59:30.263012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.086694+0000","last_change":"2024-05-20T22:06:29.454861+0000","last_active":"2024-05-20T22:08:16.086694+0000","last_peered":"2024-05-20T22:08:16.086694+0000","last_clean":"2024-05-20T22:08:16.086694+0000","last_became_active":"2024-05-20T22:06:29.454065+0000","last_became_peered":"2024-05-20T22:06:29.454065+0000","last_unstale":"2024-05-20T22:08:16.086694+0000","last_undegraded":"2024-05-20T22:08:16.086694+0000","last_fullsized":"2024-05-20T22:08:16.086694+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:41:02.740162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085938+0000","last_change":"2024-05-20T22:06:25.052062+0000","last_active":"2024-05-20T22:08:16.085938+0000","last_peered":"2024-05-20T22:08:16.085938+0000","last_clean":"2024-05-20T22:08:16.085938+0000","last_became_active":"2024-05-20T22:06:25.051016+0000","last_became_peered":"2024-05-20T22:06:25.051016+0000","last_unstale":"2024-05-20T22:08:16.085938+0000","last_undegraded":"2024-05-20T22:08:16.085938+0000","last_fullsized":"2024-05-20T22:08:16.085938+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:27:18.198638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.086979+0000","last_change":"2024-05-20T22:06:23.015899+0000","last_active":"2024-05-20T22:08:16.086979+0000","last_peered":"2024-05-20T22:08:16.086979+0000","last_clean":"2024-05-20T22:08:16.086979+0000","last_became_active":"2024-05-20T22:06:23.015523+0000","last_became_peered":"2024-05-20T22:06:23.015523+0000","last_unstale":"2024-05-20T22:08:16.086979+0000","last_undegraded":"2024-05-20T22:08:16.086979+0000","last_fullsized":"2024-05-20T22:08:16.086979+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:13:48.800984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"67'11","reported_seq":74,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:53.181210+0000","last_change":"2024-05-20T22:06:27.398656+0000","last_active":"2024-05-20T22:08:53.181210+0000","last_peered":"2024-05-20T22:08:53.181210+0000","last_clean":"2024-05-20T22:08:53.181210+0000","last_became_active":"2024-05-20T22:06:27.397075+0000","last_became_peered":"2024-05-20T22:06:27.397075+0000","last_unstale":"2024-05-20T22:08:53.181210+0000","last_undegraded":"2024-05-20T22:08:53.181210+0000","last_fullsized":"2024-05-20T22:08:53.181210+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:56:57.321348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.471607+0000","last_change":"2024-05-20T22:06:29.433882+0000","last_active":"2024-05-20T22:08:15.471607+0000","last_peered":"2024-05-20T22:08:15.471607+0000","last_clean":"2024-05-20T22:08:15.471607+0000","last_became_active":"2024-05-20T22:06:29.432608+0000","last_became_peered":"2024-05-20T22:06:29.432608+0000","last_unstale":"2024-05-20T22:08:15.471607+0000","last_undegraded":"2024-05-20T22:08:15.471607+0000","last_fullsized":"2024-05-20T22:08:15.471607+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:46:02.174789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.630423+0000","last_change":"2024-05-20T22:06:25.063833+0000","last_active":"2024-05-20T22:08:15.630423+0000","last_peered":"2024-05-20T22:08:15.630423+0000","last_clean":"2024-05-20T22:08:15.630423+0000","last_became_active":"2024-05-20T22:06:25.063206+0000","last_became_peered":"2024-05-20T22:06:25.063206+0000","last_unstale":"2024-05-20T22:08:15.630423+0000","last_undegraded":"2024-05-20T22:08:15.630423+0000","last_fullsized":"2024-05-20T22:08:15.630423+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:22:36.742603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085479+0000","last_change":"2024-05-20T22:06:23.005947+0000","last_active":"2024-05-20T22:08:16.085479+0000","last_peered":"2024-05-20T22:08:16.085479+0000","last_clean":"2024-05-20T22:08:16.085479+0000","last_became_active":"2024-05-20T22:06:23.005645+0000","last_became_peered":"2024-05-20T22:06:23.005645+0000","last_unstale":"2024-05-20T22:08:16.085479+0000","last_undegraded":"2024-05-20T22:08:16.085479+0000","last_fullsized":"2024-05-20T22:08:16.085479+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:26:03.447814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469490+0000","last_change":"2024-05-20T22:06:27.409615+0000","last_active":"2024-05-20T22:08:15.469490+0000","last_peered":"2024-05-20T22:08:15.469490+0000","last_clean":"2024-05-20T22:08:15.469490+0000","last_became_active":"2024-05-20T22:06:27.409293+0000","last_became_peered":"2024-05-20T22:06:27.409293+0000","last_unstale":"2024-05-20T22:08:15.469490+0000","last_undegraded":"2024-05-20T22:08:15.469490+0000","last_fullsized":"2024-05-20T22:08:15.469490+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:37:45.477864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085197+0000","last_change":"2024-05-20T22:06:29.434869+0000","last_active":"2024-05-20T22:08:16.085197+0000","last_peered":"2024-05-20T22:08:16.085197+0000","last_clean":"2024-05-20T22:08:16.085197+0000","last_became_active":"2024-05-20T22:06:29.433933+0000","last_became_peered":"2024-05-20T22:06:29.433933+0000","last_unstale":"2024-05-20T22:08:16.085197+0000","last_undegraded":"2024-05-20T22:08:16.085197+0000","last_fullsized":"2024-05-20T22:08:16.085197+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:27:49.339468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.471329+0000","last_change":"2024-05-20T22:06:25.067750+0000","last_active":"2024-05-20T22:08:15.471329+0000","last_peered":"2024-05-20T22:08:15.471329+0000","last_clean":"2024-05-20T22:08:15.471329+0000","last_became_active":"2024-05-20T22:06:25.067397+0000","last_became_peered":"2024-05-20T22:06:25.067397+0000","last_unstale":"2024-05-20T22:08:15.471329+0000","last_undegraded":"2024-05-20T22:08:15.471329+0000","last_fullsized":"2024-05-20T22:08:15.471329+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:55:06.295390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.752834+0000","last_change":"2024-05-20T22:06:23.016625+0000","last_active":"2024-05-20T22:08:15.752834+0000","last_peered":"2024-05-20T22:08:15.752834+0000","last_clean":"2024-05-20T22:08:15.752834+0000","last_became_active":"2024-05-20T22:06:23.016246+0000","last_became_peered":"2024-05-20T22:06:23.016246+0000","last_unstale":"2024-05-20T22:08:15.752834+0000","last_undegraded":"2024-05-20T22:08:15.752834+0000","last_fullsized":"2024-05-20T22:08:15.752834+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:50:45.960861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.751761+0000","last_change":"2024-05-20T22:06:27.398470+0000","last_active":"2024-05-20T22:08:15.751761+0000","last_peered":"2024-05-20T22:08:15.751761+0000","last_clean":"2024-05-20T22:08:15.751761+0000","last_became_active":"2024-05-20T22:06:27.397661+0000","last_became_peered":"2024-05-20T22:06:27.397661+0000","last_unstale":"2024-05-20T22:08:15.751761+0000","last_undegraded":"2024-05-20T22:08:15.751761+0000","last_fullsized":"2024-05-20T22:08:15.751761+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:25:48.893862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468002+0000","last_change":"2024-05-20T22:06:29.444483+0000","last_active":"2024-05-20T22:08:15.468002+0000","last_peered":"2024-05-20T22:08:15.468002+0000","last_clean":"2024-05-20T22:08:15.468002+0000","last_became_active":"2024-05-20T22:06:29.443563+0000","last_became_peered":"2024-05-20T22:06:29.443563+0000","last_unstale":"2024-05-20T22:08:15.468002+0000","last_undegraded":"2024-05-20T22:08:15.468002+0000","last_fullsized":"2024-05-20T22:08:15.468002+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:34:57.718609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"67'6","reported_seq":45,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.087332+0000","last_change":"2024-05-20T22:06:25.054084+0000","last_active":"2024-05-20T22:08:16.087332+0000","last_peered":"2024-05-20T22:08:16.087332+0000","last_clean":"2024-05-20T22:08:16.087332+0000","last_became_active":"2024-05-20T22:06:25.053185+0000","last_became_peered":"2024-05-20T22:06:25.053185+0000","last_unstale":"2024-05-20T22:08:16.087332+0000","last_undegraded":"2024-05-20T22:08:16.087332+0000","last_fullsized":"2024-05-20T22:08:16.087332+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:48:38.510173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.475170+0000","last_change":"2024-05-20T22:06:23.005614+0000","last_active":"2024-05-20T22:08:15.475170+0000","last_peered":"2024-05-20T22:08:15.475170+0000","last_clean":"2024-05-20T22:08:15.475170+0000","last_became_active":"2024-05-20T22:06:23.005276+0000","last_became_peered":"2024-05-20T22:06:23.005276+0000","last_unstale":"2024-05-20T22:08:15.475170+0000","last_undegraded":"2024-05-20T22:08:15.475170+0000","last_fullsized":"2024-05-20T22:08:15.475170+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:58:14.712410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.084637+0000","last_change":"2024-05-20T22:06:27.402363+0000","last_active":"2024-05-20T22:08:16.084637+0000","last_peered":"2024-05-20T22:08:16.084637+0000","last_clean":"2024-05-20T22:08:16.084637+0000","last_became_active":"2024-05-20T22:06:27.401495+0000","last_became_peered":"2024-05-20T22:06:27.401495+0000","last_unstale":"2024-05-20T22:08:16.084637+0000","last_undegraded":"2024-05-20T22:08:16.084637+0000","last_fullsized":"2024-05-20T22:08:16.084637+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:07:24.207281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.628572+0000","last_change":"2024-05-20T22:06:29.434021+0000","last_active":"2024-05-20T22:08:15.628572+0000","last_peered":"2024-05-20T22:08:15.628572+0000","last_clean":"2024-05-20T22:08:15.628572+0000","last_became_active":"2024-05-20T22:06:29.433232+0000","last_became_peered":"2024-05-20T22:06:29.433232+0000","last_unstale":"2024-05-20T22:08:15.628572+0000","last_undegraded":"2024-05-20T22:08:15.628572+0000","last_fullsized":"2024-05-20T22:08:15.628572+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:11:43.530457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.474795+0000","last_change":"2024-05-20T22:06:25.054371+0000","last_active":"2024-05-20T22:08:15.474795+0000","last_peered":"2024-05-20T22:08:15.474795+0000","last_clean":"2024-05-20T22:08:15.474795+0000","last_became_active":"2024-05-20T22:06:25.053456+0000","last_became_peered":"2024-05-20T22:06:25.053456+0000","last_unstale":"2024-05-20T22:08:15.474795+0000","last_undegraded":"2024-05-20T22:08:15.474795+0000","last_fullsized":"2024-05-20T22:08:15.474795+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:06:36.584357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085906+0000","last_change":"2024-05-20T22:06:23.006199+0000","last_active":"2024-05-20T22:08:16.085906+0000","last_peered":"2024-05-20T22:08:16.085906+0000","last_clean":"2024-05-20T22:08:16.085906+0000","last_became_active":"2024-05-20T22:06:23.005417+0000","last_became_peered":"2024-05-20T22:06:23.005417+0000","last_unstale":"2024-05-20T22:08:16.085906+0000","last_undegraded":"2024-05-20T22:08:16.085906+0000","last_fullsized":"2024-05-20T22:08:16.085906+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:30:04.985982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.628112+0000","last_change":"2024-05-20T22:06:27.418299+0000","last_active":"2024-05-20T22:08:15.628112+0000","last_peered":"2024-05-20T22:08:15.628112+0000","last_clean":"2024-05-20T22:08:15.628112+0000","last_became_active":"2024-05-20T22:06:27.417489+0000","last_became_peered":"2024-05-20T22:06:27.417489+0000","last_unstale":"2024-05-20T22:08:15.628112+0000","last_undegraded":"2024-05-20T22:08:15.628112+0000","last_fullsized":"2024-05-20T22:08:15.628112+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:14:28.360270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469787+0000","last_change":"2024-05-20T22:06:29.567009+0000","last_active":"2024-05-20T22:08:15.469787+0000","last_peered":"2024-05-20T22:08:15.469787+0000","last_clean":"2024-05-20T22:08:15.469787+0000","last_became_active":"2024-05-20T22:06:29.566124+0000","last_became_peered":"2024-05-20T22:06:29.566124+0000","last_unstale":"2024-05-20T22:08:15.469787+0000","last_undegraded":"2024-05-20T22:08:15.469787+0000","last_fullsized":"2024-05-20T22:08:15.469787+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:55:09.789062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"67'1","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.629511+0000","last_change":"2024-05-20T22:06:29.434336+0000","last_active":"2024-05-20T22:08:15.629511+0000","last_peered":"2024-05-20T22:08:15.629511+0000","last_clean":"2024-05-20T22:08:15.629511+0000","last_became_active":"2024-05-20T22:06:29.433354+0000","last_became_peered":"2024-05-20T22:06:29.433354+0000","last_unstale":"2024-05-20T22:08:15.629511+0000","last_undegraded":"2024-05-20T22:08:15.629511+0000","last_fullsized":"2024-05-20T22:08:15.629511+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:04:59.087963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.751958+0000","last_change":"2024-05-20T22:06:25.067494+0000","last_active":"2024-05-20T22:08:15.751958+0000","last_peered":"2024-05-20T22:08:15.751958+0000","last_clean":"2024-05-20T22:08:15.751958+0000","last_became_active":"2024-05-20T22:06:25.066858+0000","last_became_peered":"2024-05-20T22:06:25.066858+0000","last_unstale":"2024-05-20T22:08:15.751958+0000","last_undegraded":"2024-05-20T22:08:15.751958+0000","last_fullsized":"2024-05-20T22:08:15.751958+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:16.810958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.474350+0000","last_change":"2024-05-20T22:06:22.998500+0000","last_active":"2024-05-20T22:08:15.474350+0000","last_peered":"2024-05-20T22:08:15.474350+0000","last_clean":"2024-05-20T22:08:15.474350+0000","last_became_active":"2024-05-20T22:06:22.998174+0000","last_became_peered":"2024-05-20T22:06:22.998174+0000","last_unstale":"2024-05-20T22:08:15.474350+0000","last_undegraded":"2024-05-20T22:08:15.474350+0000","last_fullsized":"2024-05-20T22:08:15.474350+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:39:04.834712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"67'11","reported_seq":77,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:53.180336+0000","last_change":"2024-05-20T22:06:27.404695+0000","last_active":"2024-05-20T22:08:53.180336+0000","last_peered":"2024-05-20T22:08:53.180336+0000","last_clean":"2024-05-20T22:08:53.180336+0000","last_became_active":"2024-05-20T22:06:27.403755+0000","last_became_peered":"2024-05-20T22:06:27.403755+0000","last_unstale":"2024-05-20T22:08:53.180336+0000","last_undegraded":"2024-05-20T22:08:53.180336+0000","last_fullsized":"2024-05-20T22:08:53.180336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:18:06.574456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.752244+0000","last_change":"2024-05-20T22:06:29.456103+0000","last_active":"2024-05-20T22:08:15.752244+0000","last_peered":"2024-05-20T22:08:15.752244+0000","last_clean":"2024-05-20T22:08:15.752244+0000","last_became_active":"2024-05-20T22:06:29.451490+0000","last_became_peered":"2024-05-20T22:06:29.451490+0000","last_unstale":"2024-05-20T22:08:15.752244+0000","last_undegraded":"2024-05-20T22:08:15.752244+0000","last_fullsized":"2024-05-20T22:08:15.752244+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:22:44.498154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468257+0000","last_change":"2024-05-20T22:06:25.054115+0000","last_active":"2024-05-20T22:08:15.468257+0000","last_peered":"2024-05-20T22:08:15.468257+0000","last_clean":"2024-05-20T22:08:15.468257+0000","last_became_active":"2024-05-20T22:06:25.053321+0000","last_became_peered":"2024-05-20T22:06:25.053321+0000","last_unstale":"2024-05-20T22:08:15.468257+0000","last_undegraded":"2024-05-20T22:08:15.468257+0000","last_fullsized":"2024-05-20T22:08:15.468257+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:17:18.968946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"60'1","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468695+0000","last_change":"2024-05-20T22:06:23.012126+0000","last_active":"2024-05-20T22:08:15.468695+0000","last_peered":"2024-05-20T22:08:15.468695+0000","last_clean":"2024-05-20T22:08:15.468695+0000","last_became_active":"2024-05-20T22:06:23.011322+0000","last_became_peered":"2024-05-20T22:06:23.011322+0000","last_unstale":"2024-05-20T22:08:15.468695+0000","last_undegraded":"2024-05-20T22:08:15.468695+0000","last_fullsized":"2024-05-20T22:08:15.468695+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:19:32.638672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.086639+0000","last_change":"2024-05-20T22:06:27.413645+0000","last_active":"2024-05-20T22:08:16.086639+0000","last_peered":"2024-05-20T22:08:16.086639+0000","last_clean":"2024-05-20T22:08:16.086639+0000","last_became_active":"2024-05-20T22:06:27.413311+0000","last_became_peered":"2024-05-20T22:06:27.413311+0000","last_unstale":"2024-05-20T22:08:16.086639+0000","last_undegraded":"2024-05-20T22:08:16.086639+0000","last_fullsized":"2024-05-20T22:08:16.086639+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:47:34.332110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.471269+0000","last_change":"2024-05-20T22:06:29.565464+0000","last_active":"2024-05-20T22:08:15.471269+0000","last_peered":"2024-05-20T22:08:15.471269+0000","last_clean":"2024-05-20T22:08:15.471269+0000","last_became_active":"2024-05-20T22:06:29.564315+0000","last_became_peered":"2024-05-20T22:06:29.564315+0000","last_unstale":"2024-05-20T22:08:15.471269+0000","last_undegraded":"2024-05-20T22:08:15.471269+0000","last_fullsized":"2024-05-20T22:08:15.471269+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:15:47.525801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085832+0000","last_change":"2024-05-20T22:06:23.000141+0000","last_active":"2024-05-20T22:08:16.085832+0000","last_peered":"2024-05-20T22:08:16.085832+0000","last_clean":"2024-05-20T22:08:16.085832+0000","last_became_active":"2024-05-20T22:06:22.999306+0000","last_became_peered":"2024-05-20T22:06:22.999306+0000","last_unstale":"2024-05-20T22:08:16.085832+0000","last_undegraded":"2024-05-20T22:08:16.085832+0000","last_fullsized":"2024-05-20T22:08:16.085832+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:18:02.296474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"67'5","reported_seq":46,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.086710+0000","last_change":"2024-05-20T22:06:25.071313+0000","last_active":"2024-05-20T22:08:16.086710+0000","last_peered":"2024-05-20T22:08:16.086710+0000","last_clean":"2024-05-20T22:08:16.086710+0000","last_became_active":"2024-05-20T22:06:25.070997+0000","last_became_peered":"2024-05-20T22:06:25.070997+0000","last_unstale":"2024-05-20T22:08:16.086710+0000","last_undegraded":"2024-05-20T22:08:16.086710+0000","last_fullsized":"2024-05-20T22:08:16.086710+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:40:21.164473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.752782+0000","last_change":"2024-05-20T22:06:27.417403+0000","last_active":"2024-05-20T22:08:15.752782+0000","last_peered":"2024-05-20T22:08:15.752782+0000","last_clean":"2024-05-20T22:08:15.752782+0000","last_became_active":"2024-05-20T22:06:27.416713+0000","last_became_peered":"2024-05-20T22:06:27.416713+0000","last_unstale":"2024-05-20T22:08:15.752782+0000","last_undegraded":"2024-05-20T22:08:15.752782+0000","last_fullsized":"2024-05-20T22:08:15.752782+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:24:33.954556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468380+0000","last_change":"2024-05-20T22:06:29.566461+0000","last_active":"2024-05-20T22:08:15.468380+0000","last_peered":"2024-05-20T22:08:15.468380+0000","last_clean":"2024-05-20T22:08:15.468380+0000","last_became_active":"2024-05-20T22:06:29.565554+0000","last_became_peered":"2024-05-20T22:06:29.565554+0000","last_unstale":"2024-05-20T22:08:15.468380+0000","last_undegraded":"2024-05-20T22:08:15.468380+0000","last_fullsized":"2024-05-20T22:08:15.468380+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:25:54.718622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.470234+0000","last_change":"2024-05-20T22:06:23.003088+0000","last_active":"2024-05-20T22:08:15.470234+0000","last_peered":"2024-05-20T22:08:15.470234+0000","last_clean":"2024-05-20T22:08:15.470234+0000","last_became_active":"2024-05-20T22:06:23.000924+0000","last_became_peered":"2024-05-20T22:06:23.000924+0000","last_unstale":"2024-05-20T22:08:15.470234+0000","last_undegraded":"2024-05-20T22:08:15.470234+0000","last_fullsized":"2024-05-20T22:08:15.470234+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:46:53.388003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.470701+0000","last_change":"2024-05-20T22:06:25.069717+0000","last_active":"2024-05-20T22:08:15.470701+0000","last_peered":"2024-05-20T22:08:15.470701+0000","last_clean":"2024-05-20T22:08:15.470701+0000","last_became_active":"2024-05-20T22:06:25.069299+0000","last_became_peered":"2024-05-20T22:06:25.069299+0000","last_unstale":"2024-05-20T22:08:15.470701+0000","last_undegraded":"2024-05-20T22:08:15.470701+0000","last_fullsized":"2024-05-20T22:08:15.470701+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:03:55.491591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.470749+0000","last_change":"2024-05-20T22:06:27.396189+0000","last_active":"2024-05-20T22:08:15.470749+0000","last_peered":"2024-05-20T22:08:15.470749+0000","last_clean":"2024-05-20T22:08:15.470749+0000","last_became_active":"2024-05-20T22:06:27.394128+0000","last_became_peered":"2024-05-20T22:06:27.394128+0000","last_unstale":"2024-05-20T22:08:15.470749+0000","last_undegraded":"2024-05-20T22:08:15.470749+0000","last_fullsized":"2024-05-20T22:08:15.470749+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:47:16.328682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":416,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":133,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":9,"acting":9,"num_store_stats":7},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":701,"num_read_kb":458,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":395,"ondisk_log_size":395,"up":96,"acting":96,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234025,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28356,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716796,"statfs":{"total":95995035648,"available":95965999104,"internally_reserved":0,"allocated":1363968,"data_stored":886945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495668,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28316,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716836,"statfs":{"total":95995035648,"available":95966040064,"internally_reserved":0,"allocated":1323008,"data_stored":884161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757310,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717412,"statfs":{"total":95995035648,"available":95966629888,"internally_reserved":0,"allocated":737280,"data_stored":294631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717372,"statfs":{"total":95995035648,"available":95966588928,"internally_reserved":0,"allocated":774144,"data_stored":295731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182481,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36060,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709092,"statfs":{"total":95995035648,"available":95958110208,"internally_reserved":0,"allocated":733184,"data_stored":294616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411419,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27744,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717408,"statfs":{"total":95995035648,"available":95966625792,"internally_reserved":0,"allocated":737280,"data_stored":294299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27748,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717404,"statfs":{"total":95995035648,"available":95966621696,"internally_reserved":0,"allocated":745472,"data_stored":294124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738481,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36660,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708492,"statfs":{"total":95995035648,"available":95957495808,"internally_reserved":0,"allocated":1347584,"data_stored":885822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T22:09:02.742 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph pg dump --format=json 2024-05-20T22:09:03.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:03 smithi145 bash[23893]: cluster 2024-05-20T22:09:01.885403+0000 mgr.y (mgr.14592) 101 : cluster 0 pgmap v59: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:03.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:03 smithi145 bash[23893]: audit 2024-05-20T22:09:02.053639+0000 mgr.y (mgr.14592) 102 : audit 0 from='client.24644 v1:172.21.15.50:0/3374108987' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T22:09:03.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:03 smithi050 bash[28929]: cluster 2024-05-20T22:09:01.885403+0000 mgr.y (mgr.14592) 101 : cluster 0 pgmap v59: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:03.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:03 smithi050 bash[28929]: audit 2024-05-20T22:09:02.053639+0000 mgr.y (mgr.14592) 102 : audit 0 from='client.24644 v1:172.21.15.50:0/3374108987' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T22:09:03.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:03 smithi050 bash[21866]: cluster 2024-05-20T22:09:01.885403+0000 mgr.y (mgr.14592) 101 : cluster 0 pgmap v59: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:03.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:03 smithi050 bash[21866]: audit 2024-05-20T22:09:02.053639+0000 mgr.y (mgr.14592) 102 : audit 0 from='client.24644 v1:172.21.15.50:0/3374108987' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T22:09:05.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:05 smithi145 bash[23893]: cluster 2024-05-20T22:09:03.886041+0000 mgr.y (mgr.14592) 103 : cluster 0 pgmap v60: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:05.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:05 smithi050 bash[28929]: cluster 2024-05-20T22:09:03.886041+0000 mgr.y (mgr.14592) 103 : cluster 0 pgmap v60: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:05.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:05 smithi050 bash[21866]: cluster 2024-05-20T22:09:03.886041+0000 mgr.y (mgr.14592) 103 : cluster 0 pgmap v60: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:07.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:07 smithi145 bash[23893]: cluster 2024-05-20T22:09:05.887620+0000 mgr.y (mgr.14592) 104 : cluster 0 pgmap v61: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:07.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:07 smithi050 bash[21866]: cluster 2024-05-20T22:09:05.887620+0000 mgr.y (mgr.14592) 104 : cluster 0 pgmap v61: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:07.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:07 smithi050 bash[28929]: cluster 2024-05-20T22:09:05.887620+0000 mgr.y (mgr.14592) 104 : cluster 0 pgmap v61: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:09:07.890 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:09:07 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:09:08.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:08 smithi145 bash[23893]: audit 2024-05-20T22:09:07.512535+0000 mgr.y (mgr.14592) 105 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:09:08.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:08 smithi050 bash[21866]: audit 2024-05-20T22:09:07.512535+0000 mgr.y (mgr.14592) 105 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:09:08.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:08 smithi050 bash[28929]: audit 2024-05-20T22:09:07.512535+0000 mgr.y (mgr.14592) 105 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:09:09.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:09 smithi050 bash[21866]: cluster 2024-05-20T22:09:07.888375+0000 mgr.y (mgr.14592) 106 : cluster 0 pgmap v62: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:09.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:09 smithi050 bash[28929]: cluster 2024-05-20T22:09:07.888375+0000 mgr.y (mgr.14592) 106 : cluster 0 pgmap v62: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:09.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:09 smithi145 bash[23893]: cluster 2024-05-20T22:09:07.888375+0000 mgr.y (mgr.14592) 106 : cluster 0 pgmap v62: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:09.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:09:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:09:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:09:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8aa84ed640 1 -- 172.21.15.50:0/1455160601 >> v1:172.21.15.50:6789/0 conn(0x7f8aa0109410 legacy=0x7f8aa010b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:09:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8aa84ed640 1 -- 172.21.15.50:0/1455160601 shutdown_connections 2024-05-20T22:09:10.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8aa84ed640 1 -- 172.21.15.50:0/1455160601 >> 172.21.15.50:0/1455160601 conn(0x7f8aa00fc060 msgr2=0x7f8aa00fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:09:10.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8aa84ed640 1 -- 172.21.15.50:0/1455160601 shutdown_connections 2024-05-20T22:09:10.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8aa84ed640 1 -- 172.21.15.50:0/1455160601 wait complete. 2024-05-20T22:09:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8aa84ed640 1 Processor -- start 2024-05-20T22:09:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8aa84ed640 1 -- start start 2024-05-20T22:09:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8aa84ed640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f8aa0105df0 con 0x7f8aa010d010 2024-05-20T22:09:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8aa84ed640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f8aa01a7bd0 con 0x7f8aa0109410 2024-05-20T22:09:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8aa84ed640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f8aa01a8db0 con 0x7f8aa0106660 2024-05-20T22:09:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8aa6289640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7f8aa0106660 0x7f8aa0103c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:58820/0 (socket says 172.21.15.50:58820) 2024-05-20T22:09:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8aa6289640 1 -- 172.21.15.50:0/2690609206 learned_addr learned my addr 172.21.15.50:0/2690609206 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:09:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3317494662 0 0) 0x7f8aa0105df0 con 0x7f8aa010d010 2024-05-20T22:09:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a8c003520 con 0x7f8aa010d010 2024-05-20T22:09:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1545192848 0 0) 0x7f8aa01a8db0 con 0x7f8aa0106660 2024-05-20T22:09:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8aa0105df0 con 0x7f8aa0106660 2024-05-20T22:09:10.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 717148584 0 0) 0x7f8aa01a7bd0 con 0x7f8aa0109410 2024-05-20T22:09:10.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8aa01a8db0 con 0x7f8aa0109410 2024-05-20T22:09:10.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2562201328 0 0) 0x7f8a8c003520 con 0x7f8aa010d010 2024-05-20T22:09:10.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8aa01a7bd0 con 0x7f8aa010d010 2024-05-20T22:09:10.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2152452285 0 0) 0x7f8aa0105df0 con 0x7f8aa0106660 2024-05-20T22:09:10.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a8c003520 con 0x7f8aa0106660 2024-05-20T22:09:10.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f8a98001b30 con 0x7f8aa010d010 2024-05-20T22:09:10.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f8a9c0013d0 con 0x7f8aa0106660 2024-05-20T22:09:10.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3130188002 0 0) 0x7f8a8c003520 con 0x7f8aa0106660 2024-05-20T22:09:10.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 >> v1:172.21.15.145:6789/0 conn(0x7f8aa0109410 legacy=0x7f8aa0104330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:09:10.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 >> v1:172.21.15.50:6789/0 conn(0x7f8aa010d010 legacy=0x7f8aa01a54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:09:10.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa01a9f90 con 0x7f8aa0106660 2024-05-20T22:09:10.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8aa84ed640 1 -- 172.21.15.50:0/2690609206 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8aa01a6c20 con 0x7f8aa0106660 2024-05-20T22:09:10.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8aa84ed640 1 -- 172.21.15.50:0/2690609206 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f8aa01a70e0 con 0x7f8aa0106660 2024-05-20T22:09:10.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f8a9c0015b0 con 0x7f8aa0106660 2024-05-20T22:09:10.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.281+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f8a9c005b80 con 0x7f8aa0106660 2024-05-20T22:09:10.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.285+0000 7f8aa84ed640 1 -- 172.21.15.50:0/2690609206 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a84005080 con 0x7f8aa0106660 2024-05-20T22:09:10.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.285+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f8a9c0038a0 con 0x7f8aa0106660 2024-05-20T22:09:10.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.285+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(74..74 src has 1..74) ==== 6201+0+0 (unknown 2490794606 0 0) 0x7f8a9c089500 con 0x7f8aa0106660 2024-05-20T22:09:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.289+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f8a9c056ca0 con 0x7f8aa0106660 2024-05-20T22:09:10.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.477+0000 7f8aa84ed640 1 -- 172.21.15.50:0/2690609206 --> v1:172.21.15.50:6800/3332714287 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8a84000b90 con 0x7f8a8c06edd0 2024-05-20T22:09:10.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.497+0000 7f8a977fe640 1 -- 172.21.15.50:0/2690609206 <== mgr.14592 v1:172.21.15.50:6800/3332714287 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+346497 (unknown 2965378022 0 2541544966) 0x7f8a84000b90 con 0x7f8a8c06edd0 2024-05-20T22:09:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-20T22:09:10.499 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-05-20T22:09:10.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.501+0000 7f8aa84ed640 1 -- 172.21.15.50:0/2690609206 >> v1:172.21.15.50:6800/3332714287 conn(0x7f8a8c06edd0 legacy=0x7f8a8c071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:09:10.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.501+0000 7f8aa84ed640 1 -- 172.21.15.50:0/2690609206 >> v1:172.21.15.50:6790/0 conn(0x7f8aa0106660 legacy=0x7f8aa0103c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:09:10.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.501+0000 7f8aa84ed640 1 -- 172.21.15.50:0/2690609206 shutdown_connections 2024-05-20T22:09:10.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.501+0000 7f8aa84ed640 1 -- 172.21.15.50:0/2690609206 >> 172.21.15.50:0/2690609206 conn(0x7f8aa00fc060 msgr2=0x7f8aa010fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:09:10.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.501+0000 7f8aa84ed640 1 -- 172.21.15.50:0/2690609206 shutdown_connections 2024-05-20T22:09:10.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:10.501+0000 7f8aa84ed640 1 -- 172.21.15.50:0/2690609206 wait complete. 2024-05-20T22:09:11.207 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-05-20T22:09:09.888611+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596507,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":1098,"num_read_kb":944,"num_write":615,"num_write_kb":2461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":626,"ondisk_log_size":626,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":240404,"kb_used_data":7580,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":749720812,"statfs":{"total":767960285184,"available":767714111488,"internally_reserved":0,"allocated":7761920,"data_stored":4130329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005442"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468876+0000","last_change":"2024-05-20T22:06:29.569266+0000","last_active":"2024-05-20T22:08:15.468876+0000","last_peered":"2024-05-20T22:08:15.468876+0000","last_clean":"2024-05-20T22:08:15.468876+0000","last_became_active":"2024-05-20T22:06:29.568443+0000","last_became_peered":"2024-05-20T22:06:29.568443+0000","last_unstale":"2024-05-20T22:08:15.468876+0000","last_undegraded":"2024-05-20T22:08:15.468876+0000","last_fullsized":"2024-05-20T22:08:15.468876+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:01:11.637445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.087454+0000","last_change":"2024-05-20T22:06:23.011076+0000","last_active":"2024-05-20T22:08:16.087454+0000","last_peered":"2024-05-20T22:08:16.087454+0000","last_clean":"2024-05-20T22:08:16.087454+0000","last_became_active":"2024-05-20T22:06:23.010346+0000","last_became_peered":"2024-05-20T22:06:23.010346+0000","last_unstale":"2024-05-20T22:08:16.087454+0000","last_undegraded":"2024-05-20T22:08:16.087454+0000","last_fullsized":"2024-05-20T22:08:16.087454+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:37:40.669467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469013+0000","last_change":"2024-05-20T22:06:25.058848+0000","last_active":"2024-05-20T22:08:15.469013+0000","last_peered":"2024-05-20T22:08:15.469013+0000","last_clean":"2024-05-20T22:08:15.469013+0000","last_became_active":"2024-05-20T22:06:25.058477+0000","last_became_peered":"2024-05-20T22:06:25.058477+0000","last_unstale":"2024-05-20T22:08:15.469013+0000","last_undegraded":"2024-05-20T22:08:15.469013+0000","last_fullsized":"2024-05-20T22:08:15.469013+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:17:25.646588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469778+0000","last_change":"2024-05-20T22:06:27.409275+0000","last_active":"2024-05-20T22:08:15.469778+0000","last_peered":"2024-05-20T22:08:15.469778+0000","last_clean":"2024-05-20T22:08:15.469778+0000","last_became_active":"2024-05-20T22:06:27.390168+0000","last_became_peered":"2024-05-20T22:06:27.390168+0000","last_unstale":"2024-05-20T22:08:15.469778+0000","last_undegraded":"2024-05-20T22:08:15.469778+0000","last_fullsized":"2024-05-20T22:08:15.469778+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:26:29.783703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469182+0000","last_change":"2024-05-20T22:06:23.008801+0000","last_active":"2024-05-20T22:08:15.469182+0000","last_peered":"2024-05-20T22:08:15.469182+0000","last_clean":"2024-05-20T22:08:15.469182+0000","last_became_active":"2024-05-20T22:06:23.007832+0000","last_became_peered":"2024-05-20T22:06:23.007832+0000","last_unstale":"2024-05-20T22:08:15.469182+0000","last_undegraded":"2024-05-20T22:08:15.469182+0000","last_fullsized":"2024-05-20T22:08:15.469182+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:46:14.534726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.087236+0000","last_change":"2024-05-20T22:06:25.056910+0000","last_active":"2024-05-20T22:08:16.087236+0000","last_peered":"2024-05-20T22:08:16.087236+0000","last_clean":"2024-05-20T22:08:16.087236+0000","last_became_active":"2024-05-20T22:06:25.055878+0000","last_became_peered":"2024-05-20T22:06:25.055878+0000","last_unstale":"2024-05-20T22:08:16.087236+0000","last_undegraded":"2024-05-20T22:08:16.087236+0000","last_fullsized":"2024-05-20T22:08:16.087236+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:28:08.322507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.751401+0000","last_change":"2024-05-20T22:06:27.407822+0000","last_active":"2024-05-20T22:08:15.751401+0000","last_peered":"2024-05-20T22:08:15.751401+0000","last_clean":"2024-05-20T22:08:15.751401+0000","last_became_active":"2024-05-20T22:06:27.407565+0000","last_became_peered":"2024-05-20T22:06:27.407565+0000","last_unstale":"2024-05-20T22:08:15.751401+0000","last_undegraded":"2024-05-20T22:08:15.751401+0000","last_fullsized":"2024-05-20T22:08:15.751401+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:00:08.440373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.470308+0000","last_change":"2024-05-20T22:06:29.457283+0000","last_active":"2024-05-20T22:08:15.470308+0000","last_peered":"2024-05-20T22:08:15.470308+0000","last_clean":"2024-05-20T22:08:15.470308+0000","last_became_active":"2024-05-20T22:06:29.456404+0000","last_became_peered":"2024-05-20T22:06:29.456404+0000","last_unstale":"2024-05-20T22:08:15.470308+0000","last_undegraded":"2024-05-20T22:08:15.470308+0000","last_fullsized":"2024-05-20T22:08:15.470308+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:47:49.670722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.630832+0000","last_change":"2024-05-20T22:06:22.999516+0000","last_active":"2024-05-20T22:08:15.630832+0000","last_peered":"2024-05-20T22:08:15.630832+0000","last_clean":"2024-05-20T22:08:15.630832+0000","last_became_active":"2024-05-20T22:06:22.999153+0000","last_became_peered":"2024-05-20T22:06:22.999153+0000","last_unstale":"2024-05-20T22:08:15.630832+0000","last_undegraded":"2024-05-20T22:08:15.630832+0000","last_fullsized":"2024-05-20T22:08:15.630832+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:30:14.323734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.473349+0000","last_change":"2024-05-20T22:06:25.064164+0000","last_active":"2024-05-20T22:08:15.473349+0000","last_peered":"2024-05-20T22:08:15.473349+0000","last_clean":"2024-05-20T22:08:15.473349+0000","last_became_active":"2024-05-20T22:06:25.063756+0000","last_became_peered":"2024-05-20T22:06:25.063756+0000","last_unstale":"2024-05-20T22:08:15.473349+0000","last_undegraded":"2024-05-20T22:08:15.473349+0000","last_fullsized":"2024-05-20T22:08:15.473349+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:53:31.010294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.628802+0000","last_change":"2024-05-20T22:06:27.424280+0000","last_active":"2024-05-20T22:08:15.628802+0000","last_peered":"2024-05-20T22:08:15.628802+0000","last_clean":"2024-05-20T22:08:15.628802+0000","last_became_active":"2024-05-20T22:06:27.423774+0000","last_became_peered":"2024-05-20T22:06:27.423774+0000","last_unstale":"2024-05-20T22:08:15.628802+0000","last_undegraded":"2024-05-20T22:08:15.628802+0000","last_fullsized":"2024-05-20T22:08:15.628802+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:29:02.425267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.472471+0000","last_change":"2024-05-20T22:06:29.456102+0000","last_active":"2024-05-20T22:08:15.472471+0000","last_peered":"2024-05-20T22:08:15.472471+0000","last_clean":"2024-05-20T22:08:15.472471+0000","last_became_active":"2024-05-20T22:06:29.455748+0000","last_became_peered":"2024-05-20T22:06:29.455748+0000","last_unstale":"2024-05-20T22:08:15.472471+0000","last_undegraded":"2024-05-20T22:08:15.472471+0000","last_fullsized":"2024-05-20T22:08:15.472471+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:07:04.541125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.630309+0000","last_change":"2024-05-20T22:06:23.004191+0000","last_active":"2024-05-20T22:08:15.630309+0000","last_peered":"2024-05-20T22:08:15.630309+0000","last_clean":"2024-05-20T22:08:15.630309+0000","last_became_active":"2024-05-20T22:06:23.003871+0000","last_became_peered":"2024-05-20T22:06:23.003871+0000","last_unstale":"2024-05-20T22:08:15.630309+0000","last_undegraded":"2024-05-20T22:08:15.630309+0000","last_fullsized":"2024-05-20T22:08:15.630309+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:08:25.414677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"67'12","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.473676+0000","last_change":"2024-05-20T22:06:25.064439+0000","last_active":"2024-05-20T22:08:15.473676+0000","last_peered":"2024-05-20T22:08:15.473676+0000","last_clean":"2024-05-20T22:08:15.473676+0000","last_became_active":"2024-05-20T22:06:25.063714+0000","last_became_peered":"2024-05-20T22:06:25.063714+0000","last_unstale":"2024-05-20T22:08:15.473676+0000","last_undegraded":"2024-05-20T22:08:15.473676+0000","last_fullsized":"2024-05-20T22:08:15.473676+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:22.549017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.472324+0000","last_change":"2024-05-20T22:06:27.412264+0000","last_active":"2024-05-20T22:08:15.472324+0000","last_peered":"2024-05-20T22:08:15.472324+0000","last_clean":"2024-05-20T22:08:15.472324+0000","last_became_active":"2024-05-20T22:06:27.411288+0000","last_became_peered":"2024-05-20T22:06:27.411288+0000","last_unstale":"2024-05-20T22:08:15.472324+0000","last_undegraded":"2024-05-20T22:08:15.472324+0000","last_fullsized":"2024-05-20T22:08:15.472324+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:06:30.907398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085350+0000","last_change":"2024-05-20T22:06:29.453017+0000","last_active":"2024-05-20T22:08:16.085350+0000","last_peered":"2024-05-20T22:08:16.085350+0000","last_clean":"2024-05-20T22:08:16.085350+0000","last_became_active":"2024-05-20T22:06:29.452186+0000","last_became_peered":"2024-05-20T22:06:29.452186+0000","last_unstale":"2024-05-20T22:08:16.085350+0000","last_undegraded":"2024-05-20T22:08:16.085350+0000","last_fullsized":"2024-05-20T22:08:16.085350+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:09:49.979770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"67'19","reported_seq":67,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085642+0000","last_change":"2024-05-20T22:06:25.070573+0000","last_active":"2024-05-20T22:08:16.085642+0000","last_peered":"2024-05-20T22:08:16.085642+0000","last_clean":"2024-05-20T22:08:16.085642+0000","last_became_active":"2024-05-20T22:06:25.070274+0000","last_became_peered":"2024-05-20T22:06:25.070274+0000","last_unstale":"2024-05-20T22:08:16.085642+0000","last_undegraded":"2024-05-20T22:08:16.085642+0000","last_fullsized":"2024-05-20T22:08:16.085642+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:44:52.225326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.630590+0000","last_change":"2024-05-20T22:06:23.000750+0000","last_active":"2024-05-20T22:08:15.630590+0000","last_peered":"2024-05-20T22:08:15.630590+0000","last_clean":"2024-05-20T22:08:15.630590+0000","last_became_active":"2024-05-20T22:06:23.000420+0000","last_became_peered":"2024-05-20T22:06:23.000420+0000","last_unstale":"2024-05-20T22:08:15.630590+0000","last_undegraded":"2024-05-20T22:08:15.630590+0000","last_fullsized":"2024-05-20T22:08:15.630590+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:30:30.364363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.752260+0000","last_change":"2024-05-20T22:06:27.409519+0000","last_active":"2024-05-20T22:08:15.752260+0000","last_peered":"2024-05-20T22:08:15.752260+0000","last_clean":"2024-05-20T22:08:15.752260+0000","last_became_active":"2024-05-20T22:06:27.409040+0000","last_became_peered":"2024-05-20T22:06:27.409040+0000","last_unstale":"2024-05-20T22:08:15.752260+0000","last_undegraded":"2024-05-20T22:08:15.752260+0000","last_fullsized":"2024-05-20T22:08:15.752260+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:09:14.656813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468984+0000","last_change":"2024-05-20T22:06:29.444862+0000","last_active":"2024-05-20T22:08:15.468984+0000","last_peered":"2024-05-20T22:08:15.468984+0000","last_clean":"2024-05-20T22:08:15.468984+0000","last_became_active":"2024-05-20T22:06:29.443915+0000","last_became_peered":"2024-05-20T22:06:29.443915+0000","last_unstale":"2024-05-20T22:08:15.468984+0000","last_undegraded":"2024-05-20T22:08:15.468984+0000","last_fullsized":"2024-05-20T22:08:15.468984+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:26:18.626054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.470084+0000","last_change":"2024-05-20T22:06:25.072604+0000","last_active":"2024-05-20T22:08:15.470084+0000","last_peered":"2024-05-20T22:08:15.470084+0000","last_clean":"2024-05-20T22:08:15.470084+0000","last_became_active":"2024-05-20T22:06:25.071552+0000","last_became_peered":"2024-05-20T22:06:25.071552+0000","last_unstale":"2024-05-20T22:08:15.470084+0000","last_undegraded":"2024-05-20T22:08:15.470084+0000","last_fullsized":"2024-05-20T22:08:15.470084+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:09:18.471592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.752367+0000","last_change":"2024-05-20T22:06:23.003446+0000","last_active":"2024-05-20T22:08:15.752367+0000","last_peered":"2024-05-20T22:08:15.752367+0000","last_clean":"2024-05-20T22:08:15.752367+0000","last_became_active":"2024-05-20T22:06:23.002664+0000","last_became_peered":"2024-05-20T22:06:23.002664+0000","last_unstale":"2024-05-20T22:08:15.752367+0000","last_undegraded":"2024-05-20T22:08:15.752367+0000","last_fullsized":"2024-05-20T22:08:15.752367+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:18:12.215939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"67'11","reported_seq":76,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:09:03.188974+0000","last_change":"2024-05-20T22:06:27.405747+0000","last_active":"2024-05-20T22:09:03.188974+0000","last_peered":"2024-05-20T22:09:03.188974+0000","last_clean":"2024-05-20T22:09:03.188974+0000","last_became_active":"2024-05-20T22:06:27.404839+0000","last_became_peered":"2024-05-20T22:06:27.404839+0000","last_unstale":"2024-05-20T22:09:03.188974+0000","last_undegraded":"2024-05-20T22:09:03.188974+0000","last_fullsized":"2024-05-20T22:09:03.188974+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:11:55.001721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.471033+0000","last_change":"2024-05-20T22:06:29.456454+0000","last_active":"2024-05-20T22:08:15.471033+0000","last_peered":"2024-05-20T22:08:15.471033+0000","last_clean":"2024-05-20T22:08:15.471033+0000","last_became_active":"2024-05-20T22:06:29.456126+0000","last_became_peered":"2024-05-20T22:06:29.456126+0000","last_unstale":"2024-05-20T22:08:15.471033+0000","last_undegraded":"2024-05-20T22:08:15.471033+0000","last_fullsized":"2024-05-20T22:08:15.471033+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:54:08.779234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468562+0000","last_change":"2024-05-20T22:06:25.057264+0000","last_active":"2024-05-20T22:08:15.468562+0000","last_peered":"2024-05-20T22:08:15.468562+0000","last_clean":"2024-05-20T22:08:15.468562+0000","last_became_active":"2024-05-20T22:06:25.056430+0000","last_became_peered":"2024-05-20T22:06:25.056430+0000","last_unstale":"2024-05-20T22:08:15.468562+0000","last_undegraded":"2024-05-20T22:08:15.468562+0000","last_fullsized":"2024-05-20T22:08:15.468562+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:10.336499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.751891+0000","last_change":"2024-05-20T22:06:23.004804+0000","last_active":"2024-05-20T22:08:15.751891+0000","last_peered":"2024-05-20T22:08:15.751891+0000","last_clean":"2024-05-20T22:08:15.751891+0000","last_became_active":"2024-05-20T22:06:23.004385+0000","last_became_peered":"2024-05-20T22:06:23.004385+0000","last_unstale":"2024-05-20T22:08:15.751891+0000","last_undegraded":"2024-05-20T22:08:15.751891+0000","last_fullsized":"2024-05-20T22:08:15.751891+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:09:59.092587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"67'11","reported_seq":76,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:09:03.188172+0000","last_change":"2024-05-20T22:06:27.416342+0000","last_active":"2024-05-20T22:09:03.188172+0000","last_peered":"2024-05-20T22:09:03.188172+0000","last_clean":"2024-05-20T22:09:03.188172+0000","last_became_active":"2024-05-20T22:06:27.415494+0000","last_became_peered":"2024-05-20T22:06:27.415494+0000","last_unstale":"2024-05-20T22:09:03.188172+0000","last_undegraded":"2024-05-20T22:09:03.188172+0000","last_fullsized":"2024-05-20T22:09:03.188172+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:07:02.105064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.472501+0000","last_change":"2024-05-20T22:06:29.439655+0000","last_active":"2024-05-20T22:08:15.472501+0000","last_peered":"2024-05-20T22:08:15.472501+0000","last_clean":"2024-05-20T22:08:15.472501+0000","last_became_active":"2024-05-20T22:06:29.438901+0000","last_became_peered":"2024-05-20T22:06:29.438901+0000","last_unstale":"2024-05-20T22:08:15.472501+0000","last_undegraded":"2024-05-20T22:08:15.472501+0000","last_fullsized":"2024-05-20T22:08:15.472501+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:43:53.975207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"67'12","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.470526+0000","last_change":"2024-05-20T22:06:25.067979+0000","last_active":"2024-05-20T22:08:15.470526+0000","last_peered":"2024-05-20T22:08:15.470526+0000","last_clean":"2024-05-20T22:08:15.470526+0000","last_became_active":"2024-05-20T22:06:25.067658+0000","last_became_peered":"2024-05-20T22:06:25.067658+0000","last_unstale":"2024-05-20T22:08:15.470526+0000","last_undegraded":"2024-05-20T22:08:15.470526+0000","last_fullsized":"2024-05-20T22:08:15.470526+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:56:05.556337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.628562+0000","last_change":"2024-05-20T22:06:23.012267+0000","last_active":"2024-05-20T22:08:15.628562+0000","last_peered":"2024-05-20T22:08:15.628562+0000","last_clean":"2024-05-20T22:08:15.628562+0000","last_became_active":"2024-05-20T22:06:23.011997+0000","last_became_peered":"2024-05-20T22:06:23.011997+0000","last_unstale":"2024-05-20T22:08:15.628562+0000","last_undegraded":"2024-05-20T22:08:15.628562+0000","last_fullsized":"2024-05-20T22:08:15.628562+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:35:13.511729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.475337+0000","last_change":"2024-05-20T22:06:27.414114+0000","last_active":"2024-05-20T22:08:15.475337+0000","last_peered":"2024-05-20T22:08:15.475337+0000","last_clean":"2024-05-20T22:08:15.475337+0000","last_became_active":"2024-05-20T22:06:27.412997+0000","last_became_peered":"2024-05-20T22:06:27.412997+0000","last_unstale":"2024-05-20T22:08:15.475337+0000","last_undegraded":"2024-05-20T22:08:15.475337+0000","last_fullsized":"2024-05-20T22:08:15.475337+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:26:09.004178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468207+0000","last_change":"2024-05-20T22:06:29.564384+0000","last_active":"2024-05-20T22:08:15.468207+0000","last_peered":"2024-05-20T22:08:15.468207+0000","last_clean":"2024-05-20T22:08:15.468207+0000","last_became_active":"2024-05-20T22:06:29.563420+0000","last_became_peered":"2024-05-20T22:06:29.563420+0000","last_unstale":"2024-05-20T22:08:15.468207+0000","last_undegraded":"2024-05-20T22:08:15.468207+0000","last_fullsized":"2024-05-20T22:08:15.468207+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:50:26.991491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"67'12","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.087015+0000","last_change":"2024-05-20T22:06:25.071363+0000","last_active":"2024-05-20T22:08:16.087015+0000","last_peered":"2024-05-20T22:08:16.087015+0000","last_clean":"2024-05-20T22:08:16.087015+0000","last_became_active":"2024-05-20T22:06:25.070887+0000","last_became_peered":"2024-05-20T22:06:25.070887+0000","last_unstale":"2024-05-20T22:08:16.087015+0000","last_undegraded":"2024-05-20T22:08:16.087015+0000","last_fullsized":"2024-05-20T22:08:16.087015+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:16:56.842927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085947+0000","last_change":"2024-05-20T22:06:23.004029+0000","last_active":"2024-05-20T22:08:16.085947+0000","last_peered":"2024-05-20T22:08:16.085947+0000","last_clean":"2024-05-20T22:08:16.085947+0000","last_became_active":"2024-05-20T22:06:23.003722+0000","last_became_peered":"2024-05-20T22:06:23.003722+0000","last_unstale":"2024-05-20T22:08:16.085947+0000","last_undegraded":"2024-05-20T22:08:16.085947+0000","last_fullsized":"2024-05-20T22:08:16.085947+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:58:01.357660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.470215+0000","last_change":"2024-05-20T22:06:35.121191+0000","last_active":"2024-05-20T22:08:15.470215+0000","last_peered":"2024-05-20T22:08:15.470215+0000","last_clean":"2024-05-20T22:08:15.470215+0000","last_became_active":"2024-05-20T22:06:26.390871+0000","last_became_peered":"2024-05-20T22:06:26.390871+0000","last_unstale":"2024-05-20T22:08:15.470215+0000","last_undegraded":"2024-05-20T22:08:15.470215+0000","last_fullsized":"2024-05-20T22:08:15.470215+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:25.031588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:25.031588+0000","last_clean_scrub_stamp":"2024-05-20T22:06:25.031588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:57:36.080011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011120049999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"67'11","reported_seq":76,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:09:03.189193+0000","last_change":"2024-05-20T22:06:27.419227+0000","last_active":"2024-05-20T22:09:03.189193+0000","last_peered":"2024-05-20T22:09:03.189193+0000","last_clean":"2024-05-20T22:09:03.189193+0000","last_became_active":"2024-05-20T22:06:27.417894+0000","last_became_peered":"2024-05-20T22:06:27.417894+0000","last_unstale":"2024-05-20T22:09:03.189193+0000","last_undegraded":"2024-05-20T22:09:03.189193+0000","last_fullsized":"2024-05-20T22:09:03.189193+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:39:12.785933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.629494+0000","last_change":"2024-05-20T22:06:29.570597+0000","last_active":"2024-05-20T22:08:15.629494+0000","last_peered":"2024-05-20T22:08:15.629494+0000","last_clean":"2024-05-20T22:08:15.629494+0000","last_became_active":"2024-05-20T22:06:29.569420+0000","last_became_peered":"2024-05-20T22:06:29.569420+0000","last_unstale":"2024-05-20T22:08:15.629494+0000","last_undegraded":"2024-05-20T22:08:15.629494+0000","last_fullsized":"2024-05-20T22:08:15.629494+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:30:32.409973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"67'13","reported_seq":63,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469208+0000","last_change":"2024-05-20T22:06:25.055706+0000","last_active":"2024-05-20T22:08:15.469208+0000","last_peered":"2024-05-20T22:08:15.469208+0000","last_clean":"2024-05-20T22:08:15.469208+0000","last_became_active":"2024-05-20T22:06:25.055456+0000","last_became_peered":"2024-05-20T22:06:25.055456+0000","last_unstale":"2024-05-20T22:08:15.469208+0000","last_undegraded":"2024-05-20T22:08:15.469208+0000","last_fullsized":"2024-05-20T22:08:15.469208+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:58:49.157482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"60'1","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.753094+0000","last_change":"2024-05-20T22:06:23.007769+0000","last_active":"2024-05-20T22:08:15.753094+0000","last_peered":"2024-05-20T22:08:15.753094+0000","last_clean":"2024-05-20T22:08:15.753094+0000","last_became_active":"2024-05-20T22:06:23.007399+0000","last_became_peered":"2024-05-20T22:06:23.007399+0000","last_unstale":"2024-05-20T22:08:15.753094+0000","last_undegraded":"2024-05-20T22:08:15.753094+0000","last_fullsized":"2024-05-20T22:08:15.753094+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:14:41.743809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"71'5","reported_seq":192,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:09:08.680228+0000","last_change":"2024-05-20T22:06:35.767411+0000","last_active":"2024-05-20T22:09:08.680228+0000","last_peered":"2024-05-20T22:09:08.680228+0000","last_clean":"2024-05-20T22:09:08.680228+0000","last_became_active":"2024-05-20T22:06:26.384280+0000","last_became_peered":"2024-05-20T22:06:26.384280+0000","last_unstale":"2024-05-20T22:09:08.680228+0000","last_undegraded":"2024-05-20T22:09:08.680228+0000","last_fullsized":"2024-05-20T22:09:08.680228+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:25.031588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:25.031588+0000","last_clean_scrub_stamp":"2024-05-20T22:06:25.031588+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:57:39.372545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001190296,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":148,"num_read_kb":143,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469942+0000","last_change":"2024-05-20T22:06:27.419020+0000","last_active":"2024-05-20T22:08:15.469942+0000","last_peered":"2024-05-20T22:08:15.469942+0000","last_clean":"2024-05-20T22:08:15.469942+0000","last_became_active":"2024-05-20T22:06:27.418318+0000","last_became_peered":"2024-05-20T22:06:27.418318+0000","last_unstale":"2024-05-20T22:08:15.469942+0000","last_undegraded":"2024-05-20T22:08:15.469942+0000","last_fullsized":"2024-05-20T22:08:15.469942+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:52:40.762246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.470112+0000","last_change":"2024-05-20T22:06:29.443016+0000","last_active":"2024-05-20T22:08:15.470112+0000","last_peered":"2024-05-20T22:08:15.470112+0000","last_clean":"2024-05-20T22:08:15.470112+0000","last_became_active":"2024-05-20T22:06:29.442254+0000","last_became_peered":"2024-05-20T22:06:29.442254+0000","last_unstale":"2024-05-20T22:08:15.470112+0000","last_undegraded":"2024-05-20T22:08:15.470112+0000","last_fullsized":"2024-05-20T22:08:15.470112+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:12:24.540459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"67'30","reported_seq":120,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:09:03.189034+0000","last_change":"2024-05-20T22:06:25.053652+0000","last_active":"2024-05-20T22:09:03.189034+0000","last_peered":"2024-05-20T22:09:03.189034+0000","last_clean":"2024-05-20T22:09:03.189034+0000","last_became_active":"2024-05-20T22:06:25.053373+0000","last_became_peered":"2024-05-20T22:06:25.053373+0000","last_unstale":"2024-05-20T22:09:03.189034+0000","last_undegraded":"2024-05-20T22:09:03.189034+0000","last_fullsized":"2024-05-20T22:09:03.189034+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:22:57.962713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"60'1","reported_seq":48,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.630989+0000","last_change":"2024-05-20T22:06:22.998757+0000","last_active":"2024-05-20T22:08:15.630989+0000","last_peered":"2024-05-20T22:08:15.630989+0000","last_clean":"2024-05-20T22:08:15.630989+0000","last_became_active":"2024-05-20T22:06:22.998401+0000","last_became_peered":"2024-05-20T22:06:22.998401+0000","last_unstale":"2024-05-20T22:08:15.630989+0000","last_undegraded":"2024-05-20T22:08:15.630989+0000","last_fullsized":"2024-05-20T22:08:15.630989+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:11:49.578238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.084609+0000","last_change":"2024-05-20T22:06:27.397503+0000","last_active":"2024-05-20T22:08:16.084609+0000","last_peered":"2024-05-20T22:08:16.084609+0000","last_clean":"2024-05-20T22:08:16.084609+0000","last_became_active":"2024-05-20T22:06:27.396612+0000","last_became_peered":"2024-05-20T22:06:27.396612+0000","last_unstale":"2024-05-20T22:08:16.084609+0000","last_undegraded":"2024-05-20T22:08:16.084609+0000","last_fullsized":"2024-05-20T22:08:16.084609+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:58:25.201042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.751295+0000","last_change":"2024-05-20T22:06:29.564464+0000","last_active":"2024-05-20T22:08:15.751295+0000","last_peered":"2024-05-20T22:08:15.751295+0000","last_clean":"2024-05-20T22:08:15.751295+0000","last_became_active":"2024-05-20T22:06:29.563124+0000","last_became_peered":"2024-05-20T22:06:29.563124+0000","last_unstale":"2024-05-20T22:08:15.751295+0000","last_undegraded":"2024-05-20T22:08:15.751295+0000","last_fullsized":"2024-05-20T22:08:15.751295+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:19.502293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"67'16","reported_seq":92,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:09:03.188786+0000","last_change":"2024-05-20T22:06:25.059991+0000","last_active":"2024-05-20T22:09:03.188786+0000","last_peered":"2024-05-20T22:09:03.188786+0000","last_clean":"2024-05-20T22:09:03.188786+0000","last_became_active":"2024-05-20T22:06:25.059017+0000","last_became_peered":"2024-05-20T22:06:25.059017+0000","last_unstale":"2024-05-20T22:09:03.188786+0000","last_undegraded":"2024-05-20T22:09:03.188786+0000","last_fullsized":"2024-05-20T22:09:03.188786+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:16:56.730419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.752553+0000","last_change":"2024-05-20T22:06:23.013107+0000","last_active":"2024-05-20T22:08:15.752553+0000","last_peered":"2024-05-20T22:08:15.752553+0000","last_clean":"2024-05-20T22:08:15.752553+0000","last_became_active":"2024-05-20T22:06:23.012632+0000","last_became_peered":"2024-05-20T22:06:23.012632+0000","last_unstale":"2024-05-20T22:08:15.752553+0000","last_undegraded":"2024-05-20T22:08:15.752553+0000","last_fullsized":"2024-05-20T22:08:15.752553+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:22:20.105817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"70'2","reported_seq":43,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.752094+0000","last_change":"2024-05-20T22:06:35.118369+0000","last_active":"2024-05-20T22:08:15.752094+0000","last_peered":"2024-05-20T22:08:15.752094+0000","last_clean":"2024-05-20T22:08:15.752094+0000","last_became_active":"2024-05-20T22:06:26.395513+0000","last_became_peered":"2024-05-20T22:06:26.395513+0000","last_unstale":"2024-05-20T22:08:15.752094+0000","last_undegraded":"2024-05-20T22:08:15.752094+0000","last_fullsized":"2024-05-20T22:08:15.752094+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:25.031588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:25.031588+0000","last_clean_scrub_stamp":"2024-05-20T22:06:25.031588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:51:31.494591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017936919999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"67'11","reported_seq":76,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:09:03.189138+0000","last_change":"2024-05-20T22:06:27.413033+0000","last_active":"2024-05-20T22:09:03.189138+0000","last_peered":"2024-05-20T22:09:03.189138+0000","last_clean":"2024-05-20T22:09:03.189138+0000","last_became_active":"2024-05-20T22:06:27.412760+0000","last_became_peered":"2024-05-20T22:06:27.412760+0000","last_unstale":"2024-05-20T22:09:03.189138+0000","last_undegraded":"2024-05-20T22:09:03.189138+0000","last_fullsized":"2024-05-20T22:09:03.189138+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:40:58.300011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085652+0000","last_change":"2024-05-20T22:06:29.450760+0000","last_active":"2024-05-20T22:08:16.085652+0000","last_peered":"2024-05-20T22:08:16.085652+0000","last_clean":"2024-05-20T22:08:16.085652+0000","last_became_active":"2024-05-20T22:06:29.449802+0000","last_became_peered":"2024-05-20T22:06:29.449802+0000","last_unstale":"2024-05-20T22:08:16.085652+0000","last_undegraded":"2024-05-20T22:08:16.085652+0000","last_fullsized":"2024-05-20T22:08:16.085652+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:51:46.791145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"67'19","reported_seq":72,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.470957+0000","last_change":"2024-05-20T22:06:25.071052+0000","last_active":"2024-05-20T22:08:15.470957+0000","last_peered":"2024-05-20T22:08:15.470957+0000","last_clean":"2024-05-20T22:08:15.470957+0000","last_became_active":"2024-05-20T22:06:25.070000+0000","last_became_peered":"2024-05-20T22:06:25.070000+0000","last_unstale":"2024-05-20T22:08:15.470957+0000","last_undegraded":"2024-05-20T22:08:15.470957+0000","last_fullsized":"2024-05-20T22:08:15.470957+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:40:41.531901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.474308+0000","last_change":"2024-05-20T22:06:23.005590+0000","last_active":"2024-05-20T22:08:15.474308+0000","last_peered":"2024-05-20T22:08:15.474308+0000","last_clean":"2024-05-20T22:08:15.474308+0000","last_became_active":"2024-05-20T22:06:23.005213+0000","last_became_peered":"2024-05-20T22:06:23.005213+0000","last_unstale":"2024-05-20T22:08:15.474308+0000","last_undegraded":"2024-05-20T22:08:15.474308+0000","last_fullsized":"2024-05-20T22:08:15.474308+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:03:52.353796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.086636+0000","last_change":"2024-05-20T22:06:27.416729+0000","last_active":"2024-05-20T22:08:16.086636+0000","last_peered":"2024-05-20T22:08:16.086636+0000","last_clean":"2024-05-20T22:08:16.086636+0000","last_became_active":"2024-05-20T22:06:27.416420+0000","last_became_peered":"2024-05-20T22:06:27.416420+0000","last_unstale":"2024-05-20T22:08:16.086636+0000","last_undegraded":"2024-05-20T22:08:16.086636+0000","last_fullsized":"2024-05-20T22:08:16.086636+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:15:52.797982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468752+0000","last_change":"2024-05-20T22:06:29.442365+0000","last_active":"2024-05-20T22:08:15.468752+0000","last_peered":"2024-05-20T22:08:15.468752+0000","last_clean":"2024-05-20T22:08:15.468752+0000","last_became_active":"2024-05-20T22:06:29.441540+0000","last_became_peered":"2024-05-20T22:06:29.441540+0000","last_unstale":"2024-05-20T22:08:15.468752+0000","last_undegraded":"2024-05-20T22:08:15.468752+0000","last_fullsized":"2024-05-20T22:08:15.468752+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:33:02.812062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"67'18","reported_seq":68,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.751554+0000","last_change":"2024-05-20T22:06:25.052587+0000","last_active":"2024-05-20T22:08:15.751554+0000","last_peered":"2024-05-20T22:08:15.751554+0000","last_clean":"2024-05-20T22:08:15.751554+0000","last_became_active":"2024-05-20T22:06:25.052295+0000","last_became_peered":"2024-05-20T22:06:25.052295+0000","last_unstale":"2024-05-20T22:08:15.751554+0000","last_undegraded":"2024-05-20T22:08:15.751554+0000","last_fullsized":"2024-05-20T22:08:15.751554+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:28:56.193438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468231+0000","last_change":"2024-05-20T22:06:23.013559+0000","last_active":"2024-05-20T22:08:15.468231+0000","last_peered":"2024-05-20T22:08:15.468231+0000","last_clean":"2024-05-20T22:08:15.468231+0000","last_became_active":"2024-05-20T22:06:23.013013+0000","last_became_peered":"2024-05-20T22:06:23.013013+0000","last_unstale":"2024-05-20T22:08:15.468231+0000","last_undegraded":"2024-05-20T22:08:15.468231+0000","last_fullsized":"2024-05-20T22:08:15.468231+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:46:03.028759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468561+0000","last_change":"2024-05-20T22:06:27.401074+0000","last_active":"2024-05-20T22:08:15.468561+0000","last_peered":"2024-05-20T22:08:15.468561+0000","last_clean":"2024-05-20T22:08:15.468561+0000","last_became_active":"2024-05-20T22:06:27.400634+0000","last_became_peered":"2024-05-20T22:06:27.400634+0000","last_unstale":"2024-05-20T22:08:15.468561+0000","last_undegraded":"2024-05-20T22:08:15.468561+0000","last_fullsized":"2024-05-20T22:08:15.468561+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:55:42.212884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.629946+0000","last_change":"2024-05-20T22:06:29.566454+0000","last_active":"2024-05-20T22:08:15.629946+0000","last_peered":"2024-05-20T22:08:15.629946+0000","last_clean":"2024-05-20T22:08:15.629946+0000","last_became_active":"2024-05-20T22:06:29.561912+0000","last_became_peered":"2024-05-20T22:06:29.561912+0000","last_unstale":"2024-05-20T22:08:15.629946+0000","last_undegraded":"2024-05-20T22:08:15.629946+0000","last_fullsized":"2024-05-20T22:08:15.629946+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:00:41.095694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"67'14","reported_seq":57,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085686+0000","last_change":"2024-05-20T22:06:25.060518+0000","last_active":"2024-05-20T22:08:16.085686+0000","last_peered":"2024-05-20T22:08:16.085686+0000","last_clean":"2024-05-20T22:08:16.085686+0000","last_became_active":"2024-05-20T22:06:25.060278+0000","last_became_peered":"2024-05-20T22:06:25.060278+0000","last_unstale":"2024-05-20T22:08:16.085686+0000","last_undegraded":"2024-05-20T22:08:16.085686+0000","last_fullsized":"2024-05-20T22:08:16.085686+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:00:54.637456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.628702+0000","last_change":"2024-05-20T22:06:23.011865+0000","last_active":"2024-05-20T22:08:15.628702+0000","last_peered":"2024-05-20T22:08:15.628702+0000","last_clean":"2024-05-20T22:08:15.628702+0000","last_became_active":"2024-05-20T22:06:23.011566+0000","last_became_peered":"2024-05-20T22:06:23.011566+0000","last_unstale":"2024-05-20T22:08:15.628702+0000","last_undegraded":"2024-05-20T22:08:15.628702+0000","last_fullsized":"2024-05-20T22:08:15.628702+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:56:02.499130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.475504+0000","last_change":"2024-05-20T22:06:27.403563+0000","last_active":"2024-05-20T22:08:15.475504+0000","last_peered":"2024-05-20T22:08:15.475504+0000","last_clean":"2024-05-20T22:08:15.475504+0000","last_became_active":"2024-05-20T22:06:27.402802+0000","last_became_peered":"2024-05-20T22:06:27.402802+0000","last_unstale":"2024-05-20T22:08:15.475504+0000","last_undegraded":"2024-05-20T22:08:15.475504+0000","last_fullsized":"2024-05-20T22:08:15.475504+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:18:33.437485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.751728+0000","last_change":"2024-05-20T22:06:29.457628+0000","last_active":"2024-05-20T22:08:15.751728+0000","last_peered":"2024-05-20T22:08:15.751728+0000","last_clean":"2024-05-20T22:08:15.751728+0000","last_became_active":"2024-05-20T22:06:29.456787+0000","last_became_peered":"2024-05-20T22:06:29.456787+0000","last_unstale":"2024-05-20T22:08:15.751728+0000","last_undegraded":"2024-05-20T22:08:15.751728+0000","last_fullsized":"2024-05-20T22:08:15.751728+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:39:37.964088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469788+0000","last_change":"2024-05-20T22:06:25.061218+0000","last_active":"2024-05-20T22:08:15.469788+0000","last_peered":"2024-05-20T22:08:15.469788+0000","last_clean":"2024-05-20T22:08:15.469788+0000","last_became_active":"2024-05-20T22:06:25.059997+0000","last_became_peered":"2024-05-20T22:06:25.059997+0000","last_unstale":"2024-05-20T22:08:15.469788+0000","last_undegraded":"2024-05-20T22:08:15.469788+0000","last_fullsized":"2024-05-20T22:08:15.469788+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:44:30.445005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.480550+0000","last_change":"2024-05-20T22:08:15.479872+0000","last_active":"2024-05-20T22:08:15.480550+0000","last_peered":"2024-05-20T22:08:15.480550+0000","last_clean":"2024-05-20T22:08:15.480550+0000","last_became_active":"2024-05-20T22:08:15.479153+0000","last_became_peered":"2024-05-20T22:08:15.479153+0000","last_unstale":"2024-05-20T22:08:15.480550+0000","last_undegraded":"2024-05-20T22:08:15.480550+0000","last_fullsized":"2024-05-20T22:08:15.480550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:46:46.558917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":283,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.628872+0000","last_change":"2024-05-20T22:05:46.311106+0000","last_active":"2024-05-20T22:08:15.628872+0000","last_peered":"2024-05-20T22:08:15.628872+0000","last_clean":"2024-05-20T22:08:15.628872+0000","last_became_active":"2024-05-20T22:05:46.309705+0000","last_became_peered":"2024-05-20T22:05:46.309705+0000","last_unstale":"2024-05-20T22:08:15.628872+0000","last_undegraded":"2024-05-20T22:08:15.628872+0000","last_fullsized":"2024-05-20T22:08:15.628872+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:01:30.034667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:01:30.034667+0000","last_clean_scrub_stamp":"2024-05-20T22:01:30.034667+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:59:28.153959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.629845+0000","last_change":"2024-05-20T22:06:27.412998+0000","last_active":"2024-05-20T22:08:15.629845+0000","last_peered":"2024-05-20T22:08:15.629845+0000","last_clean":"2024-05-20T22:08:15.629845+0000","last_became_active":"2024-05-20T22:06:27.412320+0000","last_became_peered":"2024-05-20T22:06:27.412320+0000","last_unstale":"2024-05-20T22:08:15.629845+0000","last_undegraded":"2024-05-20T22:08:15.629845+0000","last_fullsized":"2024-05-20T22:08:15.629845+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:01:24.418456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.475099+0000","last_change":"2024-05-20T22:06:29.443486+0000","last_active":"2024-05-20T22:08:15.475099+0000","last_peered":"2024-05-20T22:08:15.475099+0000","last_clean":"2024-05-20T22:08:15.475099+0000","last_became_active":"2024-05-20T22:06:29.442576+0000","last_became_peered":"2024-05-20T22:06:29.442576+0000","last_unstale":"2024-05-20T22:08:15.475099+0000","last_undegraded":"2024-05-20T22:08:15.475099+0000","last_fullsized":"2024-05-20T22:08:15.475099+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:16:00.579619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"67'17","reported_seq":64,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.630709+0000","last_change":"2024-05-20T22:06:25.065593+0000","last_active":"2024-05-20T22:08:15.630709+0000","last_peered":"2024-05-20T22:08:15.630709+0000","last_clean":"2024-05-20T22:08:15.630709+0000","last_became_active":"2024-05-20T22:06:25.065262+0000","last_became_peered":"2024-05-20T22:06:25.065262+0000","last_unstale":"2024-05-20T22:08:15.630709+0000","last_undegraded":"2024-05-20T22:08:15.630709+0000","last_fullsized":"2024-05-20T22:08:15.630709+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:15:22.550808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469744+0000","last_change":"2024-05-20T22:06:23.014272+0000","last_active":"2024-05-20T22:08:15.469744+0000","last_peered":"2024-05-20T22:08:15.469744+0000","last_clean":"2024-05-20T22:08:15.469744+0000","last_became_active":"2024-05-20T22:06:23.013903+0000","last_became_peered":"2024-05-20T22:06:23.013903+0000","last_unstale":"2024-05-20T22:08:15.469744+0000","last_undegraded":"2024-05-20T22:08:15.469744+0000","last_fullsized":"2024-05-20T22:08:15.469744+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:52:27.784083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468085+0000","last_change":"2024-05-20T22:06:27.410838+0000","last_active":"2024-05-20T22:08:15.468085+0000","last_peered":"2024-05-20T22:08:15.468085+0000","last_clean":"2024-05-20T22:08:15.468085+0000","last_became_active":"2024-05-20T22:06:27.410011+0000","last_became_peered":"2024-05-20T22:06:27.410011+0000","last_unstale":"2024-05-20T22:08:15.468085+0000","last_undegraded":"2024-05-20T22:08:15.468085+0000","last_fullsized":"2024-05-20T22:08:15.468085+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:33:58.172024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.628858+0000","last_change":"2024-05-20T22:06:29.441361+0000","last_active":"2024-05-20T22:08:15.628858+0000","last_peered":"2024-05-20T22:08:15.628858+0000","last_clean":"2024-05-20T22:08:15.628858+0000","last_became_active":"2024-05-20T22:06:29.440591+0000","last_became_peered":"2024-05-20T22:06:29.440591+0000","last_unstale":"2024-05-20T22:08:15.628858+0000","last_undegraded":"2024-05-20T22:08:15.628858+0000","last_fullsized":"2024-05-20T22:08:15.628858+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:01:08.800009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.473785+0000","last_change":"2024-05-20T22:06:25.059981+0000","last_active":"2024-05-20T22:08:15.473785+0000","last_peered":"2024-05-20T22:08:15.473785+0000","last_clean":"2024-05-20T22:08:15.473785+0000","last_became_active":"2024-05-20T22:06:25.059500+0000","last_became_peered":"2024-05-20T22:06:25.059500+0000","last_unstale":"2024-05-20T22:08:15.473785+0000","last_undegraded":"2024-05-20T22:08:15.473785+0000","last_fullsized":"2024-05-20T22:08:15.473785+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:24:57.125210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.752947+0000","last_change":"2024-05-20T22:06:23.008199+0000","last_active":"2024-05-20T22:08:15.752947+0000","last_peered":"2024-05-20T22:08:15.752947+0000","last_clean":"2024-05-20T22:08:15.752947+0000","last_became_active":"2024-05-20T22:06:23.007329+0000","last_became_peered":"2024-05-20T22:06:23.007329+0000","last_unstale":"2024-05-20T22:08:15.752947+0000","last_undegraded":"2024-05-20T22:08:15.752947+0000","last_fullsized":"2024-05-20T22:08:15.752947+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:31:45.511353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469310+0000","last_change":"2024-05-20T22:06:27.390675+0000","last_active":"2024-05-20T22:08:15.469310+0000","last_peered":"2024-05-20T22:08:15.469310+0000","last_clean":"2024-05-20T22:08:15.469310+0000","last_became_active":"2024-05-20T22:06:27.390006+0000","last_became_peered":"2024-05-20T22:06:27.390006+0000","last_unstale":"2024-05-20T22:08:15.469310+0000","last_undegraded":"2024-05-20T22:08:15.469310+0000","last_fullsized":"2024-05-20T22:08:15.469310+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:27:28.168526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"67'1","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085572+0000","last_change":"2024-05-20T22:06:29.454392+0000","last_active":"2024-05-20T22:08:16.085572+0000","last_peered":"2024-05-20T22:08:16.085572+0000","last_clean":"2024-05-20T22:08:16.085572+0000","last_became_active":"2024-05-20T22:06:29.453781+0000","last_became_peered":"2024-05-20T22:06:29.453781+0000","last_unstale":"2024-05-20T22:08:16.085572+0000","last_undegraded":"2024-05-20T22:08:16.085572+0000","last_fullsized":"2024-05-20T22:08:16.085572+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:17:16.808719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.630391+0000","last_change":"2024-05-20T22:06:25.073270+0000","last_active":"2024-05-20T22:08:15.630391+0000","last_peered":"2024-05-20T22:08:15.630391+0000","last_clean":"2024-05-20T22:08:15.630391+0000","last_became_active":"2024-05-20T22:06:25.072442+0000","last_became_peered":"2024-05-20T22:06:25.072442+0000","last_unstale":"2024-05-20T22:08:15.630391+0000","last_undegraded":"2024-05-20T22:08:15.630391+0000","last_fullsized":"2024-05-20T22:08:15.630391+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:14:18.217494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468789+0000","last_change":"2024-05-20T22:06:23.011534+0000","last_active":"2024-05-20T22:08:15.468789+0000","last_peered":"2024-05-20T22:08:15.468789+0000","last_clean":"2024-05-20T22:08:15.468789+0000","last_became_active":"2024-05-20T22:06:23.011199+0000","last_became_peered":"2024-05-20T22:06:23.011199+0000","last_unstale":"2024-05-20T22:08:15.468789+0000","last_undegraded":"2024-05-20T22:08:15.468789+0000","last_fullsized":"2024-05-20T22:08:15.468789+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:03:48.087041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"67'11","reported_seq":79,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:09:03.188200+0000","last_change":"2024-05-20T22:06:27.420368+0000","last_active":"2024-05-20T22:09:03.188200+0000","last_peered":"2024-05-20T22:09:03.188200+0000","last_clean":"2024-05-20T22:09:03.188200+0000","last_became_active":"2024-05-20T22:06:27.419548+0000","last_became_peered":"2024-05-20T22:06:27.419548+0000","last_unstale":"2024-05-20T22:09:03.188200+0000","last_undegraded":"2024-05-20T22:09:03.188200+0000","last_fullsized":"2024-05-20T22:09:03.188200+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:54:33.572522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.473198+0000","last_change":"2024-05-20T22:06:29.567552+0000","last_active":"2024-05-20T22:08:15.473198+0000","last_peered":"2024-05-20T22:08:15.473198+0000","last_clean":"2024-05-20T22:08:15.473198+0000","last_became_active":"2024-05-20T22:06:29.566659+0000","last_became_peered":"2024-05-20T22:06:29.566659+0000","last_unstale":"2024-05-20T22:08:15.473198+0000","last_undegraded":"2024-05-20T22:08:15.473198+0000","last_fullsized":"2024-05-20T22:08:15.473198+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:28:04.948127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.630856+0000","last_change":"2024-05-20T22:06:25.072607+0000","last_active":"2024-05-20T22:08:15.630856+0000","last_peered":"2024-05-20T22:08:15.630856+0000","last_clean":"2024-05-20T22:08:15.630856+0000","last_became_active":"2024-05-20T22:06:25.072260+0000","last_became_peered":"2024-05-20T22:06:25.072260+0000","last_unstale":"2024-05-20T22:08:15.630856+0000","last_undegraded":"2024-05-20T22:08:15.630856+0000","last_fullsized":"2024-05-20T22:08:15.630856+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:58:26.906845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"60'2","reported_seq":56,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.472117+0000","last_change":"2024-05-20T22:06:23.011778+0000","last_active":"2024-05-20T22:08:15.472117+0000","last_peered":"2024-05-20T22:08:15.472117+0000","last_clean":"2024-05-20T22:08:15.472117+0000","last_became_active":"2024-05-20T22:06:23.011395+0000","last_became_peered":"2024-05-20T22:06:23.011395+0000","last_unstale":"2024-05-20T22:08:15.472117+0000","last_undegraded":"2024-05-20T22:08:15.472117+0000","last_fullsized":"2024-05-20T22:08:15.472117+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:54:21.963250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469437+0000","last_change":"2024-05-20T22:06:27.410190+0000","last_active":"2024-05-20T22:08:15.469437+0000","last_peered":"2024-05-20T22:08:15.469437+0000","last_clean":"2024-05-20T22:08:15.469437+0000","last_became_active":"2024-05-20T22:06:27.409619+0000","last_became_peered":"2024-05-20T22:06:27.409619+0000","last_unstale":"2024-05-20T22:08:15.469437+0000","last_undegraded":"2024-05-20T22:08:15.469437+0000","last_fullsized":"2024-05-20T22:08:15.469437+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:52:20.235947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469247+0000","last_change":"2024-05-20T22:06:29.446420+0000","last_active":"2024-05-20T22:08:15.469247+0000","last_peered":"2024-05-20T22:08:15.469247+0000","last_clean":"2024-05-20T22:08:15.469247+0000","last_became_active":"2024-05-20T22:06:29.445552+0000","last_became_peered":"2024-05-20T22:06:29.445552+0000","last_unstale":"2024-05-20T22:08:15.469247+0000","last_undegraded":"2024-05-20T22:08:15.469247+0000","last_fullsized":"2024-05-20T22:08:15.469247+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:42:31.878796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.629101+0000","last_change":"2024-05-20T22:06:25.061950+0000","last_active":"2024-05-20T22:08:15.629101+0000","last_peered":"2024-05-20T22:08:15.629101+0000","last_clean":"2024-05-20T22:08:15.629101+0000","last_became_active":"2024-05-20T22:06:25.061176+0000","last_became_peered":"2024-05-20T22:06:25.061176+0000","last_unstale":"2024-05-20T22:08:15.629101+0000","last_undegraded":"2024-05-20T22:08:15.629101+0000","last_fullsized":"2024-05-20T22:08:15.629101+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:23:50.474287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.467835+0000","last_change":"2024-05-20T22:06:23.015933+0000","last_active":"2024-05-20T22:08:15.467835+0000","last_peered":"2024-05-20T22:08:15.467835+0000","last_clean":"2024-05-20T22:08:15.467835+0000","last_became_active":"2024-05-20T22:06:23.015168+0000","last_became_peered":"2024-05-20T22:06:23.015168+0000","last_unstale":"2024-05-20T22:08:15.467835+0000","last_undegraded":"2024-05-20T22:08:15.467835+0000","last_fullsized":"2024-05-20T22:08:15.467835+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:32:22.327150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468848+0000","last_change":"2024-05-20T22:06:27.398870+0000","last_active":"2024-05-20T22:08:15.468848+0000","last_peered":"2024-05-20T22:08:15.468848+0000","last_clean":"2024-05-20T22:08:15.468848+0000","last_became_active":"2024-05-20T22:06:27.398393+0000","last_became_peered":"2024-05-20T22:06:27.398393+0000","last_unstale":"2024-05-20T22:08:15.468848+0000","last_undegraded":"2024-05-20T22:08:15.468848+0000","last_fullsized":"2024-05-20T22:08:15.468848+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:07:40.322803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468749+0000","last_change":"2024-05-20T22:06:29.433281+0000","last_active":"2024-05-20T22:08:15.468749+0000","last_peered":"2024-05-20T22:08:15.468749+0000","last_clean":"2024-05-20T22:08:15.468749+0000","last_became_active":"2024-05-20T22:06:29.432293+0000","last_became_peered":"2024-05-20T22:06:29.432293+0000","last_unstale":"2024-05-20T22:08:15.468749+0000","last_undegraded":"2024-05-20T22:08:15.468749+0000","last_fullsized":"2024-05-20T22:08:15.468749+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:19:03.248509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"67'4","reported_seq":42,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.084532+0000","last_change":"2024-05-20T22:06:25.060484+0000","last_active":"2024-05-20T22:08:16.084532+0000","last_peered":"2024-05-20T22:08:16.084532+0000","last_clean":"2024-05-20T22:08:16.084532+0000","last_became_active":"2024-05-20T22:06:25.060201+0000","last_became_peered":"2024-05-20T22:06:25.060201+0000","last_unstale":"2024-05-20T22:08:16.084532+0000","last_undegraded":"2024-05-20T22:08:16.084532+0000","last_fullsized":"2024-05-20T22:08:16.084532+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:35:22.912019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085831+0000","last_change":"2024-05-20T22:06:23.003485+0000","last_active":"2024-05-20T22:08:16.085831+0000","last_peered":"2024-05-20T22:08:16.085831+0000","last_clean":"2024-05-20T22:08:16.085831+0000","last_became_active":"2024-05-20T22:06:23.003080+0000","last_became_peered":"2024-05-20T22:06:23.003080+0000","last_unstale":"2024-05-20T22:08:16.085831+0000","last_undegraded":"2024-05-20T22:08:16.085831+0000","last_fullsized":"2024-05-20T22:08:16.085831+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:23:20.631870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.475380+0000","last_change":"2024-05-20T22:06:27.396098+0000","last_active":"2024-05-20T22:08:15.475380+0000","last_peered":"2024-05-20T22:08:15.475380+0000","last_clean":"2024-05-20T22:08:15.475380+0000","last_became_active":"2024-05-20T22:06:27.395214+0000","last_became_peered":"2024-05-20T22:06:27.395214+0000","last_unstale":"2024-05-20T22:08:15.475380+0000","last_undegraded":"2024-05-20T22:08:15.475380+0000","last_fullsized":"2024-05-20T22:08:15.475380+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:25:43.415911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.629947+0000","last_change":"2024-05-20T22:06:29.568024+0000","last_active":"2024-05-20T22:08:15.629947+0000","last_peered":"2024-05-20T22:08:15.629947+0000","last_clean":"2024-05-20T22:08:15.629947+0000","last_became_active":"2024-05-20T22:06:29.567025+0000","last_became_peered":"2024-05-20T22:06:29.567025+0000","last_unstale":"2024-05-20T22:08:15.629947+0000","last_undegraded":"2024-05-20T22:08:15.629947+0000","last_fullsized":"2024-05-20T22:08:15.629947+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:05:41.436898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.630125+0000","last_change":"2024-05-20T22:06:25.072536+0000","last_active":"2024-05-20T22:08:15.630125+0000","last_peered":"2024-05-20T22:08:15.630125+0000","last_clean":"2024-05-20T22:08:15.630125+0000","last_became_active":"2024-05-20T22:06:25.072138+0000","last_became_peered":"2024-05-20T22:06:25.072138+0000","last_unstale":"2024-05-20T22:08:15.630125+0000","last_undegraded":"2024-05-20T22:08:15.630125+0000","last_fullsized":"2024-05-20T22:08:15.630125+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:09:41.818180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":48,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.473891+0000","last_change":"2024-05-20T22:06:23.005474+0000","last_active":"2024-05-20T22:08:15.473891+0000","last_peered":"2024-05-20T22:08:15.473891+0000","last_clean":"2024-05-20T22:08:15.473891+0000","last_became_active":"2024-05-20T22:06:23.005101+0000","last_became_peered":"2024-05-20T22:06:23.005101+0000","last_unstale":"2024-05-20T22:08:15.473891+0000","last_undegraded":"2024-05-20T22:08:15.473891+0000","last_fullsized":"2024-05-20T22:08:15.473891+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:05:20.568967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"67'11","reported_seq":76,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:09:03.188162+0000","last_change":"2024-05-20T22:06:27.409996+0000","last_active":"2024-05-20T22:09:03.188162+0000","last_peered":"2024-05-20T22:09:03.188162+0000","last_clean":"2024-05-20T22:09:03.188162+0000","last_became_active":"2024-05-20T22:06:27.409120+0000","last_became_peered":"2024-05-20T22:06:27.409120+0000","last_unstale":"2024-05-20T22:09:03.188162+0000","last_undegraded":"2024-05-20T22:09:03.188162+0000","last_fullsized":"2024-05-20T22:09:03.188162+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:59:30.263012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.086694+0000","last_change":"2024-05-20T22:06:29.454861+0000","last_active":"2024-05-20T22:08:16.086694+0000","last_peered":"2024-05-20T22:08:16.086694+0000","last_clean":"2024-05-20T22:08:16.086694+0000","last_became_active":"2024-05-20T22:06:29.454065+0000","last_became_peered":"2024-05-20T22:06:29.454065+0000","last_unstale":"2024-05-20T22:08:16.086694+0000","last_undegraded":"2024-05-20T22:08:16.086694+0000","last_fullsized":"2024-05-20T22:08:16.086694+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:41:02.740162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085938+0000","last_change":"2024-05-20T22:06:25.052062+0000","last_active":"2024-05-20T22:08:16.085938+0000","last_peered":"2024-05-20T22:08:16.085938+0000","last_clean":"2024-05-20T22:08:16.085938+0000","last_became_active":"2024-05-20T22:06:25.051016+0000","last_became_peered":"2024-05-20T22:06:25.051016+0000","last_unstale":"2024-05-20T22:08:16.085938+0000","last_undegraded":"2024-05-20T22:08:16.085938+0000","last_fullsized":"2024-05-20T22:08:16.085938+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:27:18.198638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.086979+0000","last_change":"2024-05-20T22:06:23.015899+0000","last_active":"2024-05-20T22:08:16.086979+0000","last_peered":"2024-05-20T22:08:16.086979+0000","last_clean":"2024-05-20T22:08:16.086979+0000","last_became_active":"2024-05-20T22:06:23.015523+0000","last_became_peered":"2024-05-20T22:06:23.015523+0000","last_unstale":"2024-05-20T22:08:16.086979+0000","last_undegraded":"2024-05-20T22:08:16.086979+0000","last_fullsized":"2024-05-20T22:08:16.086979+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:13:48.800984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"67'11","reported_seq":76,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:09:03.189270+0000","last_change":"2024-05-20T22:06:27.398656+0000","last_active":"2024-05-20T22:09:03.189270+0000","last_peered":"2024-05-20T22:09:03.189270+0000","last_clean":"2024-05-20T22:09:03.189270+0000","last_became_active":"2024-05-20T22:06:27.397075+0000","last_became_peered":"2024-05-20T22:06:27.397075+0000","last_unstale":"2024-05-20T22:09:03.189270+0000","last_undegraded":"2024-05-20T22:09:03.189270+0000","last_fullsized":"2024-05-20T22:09:03.189270+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:56:57.321348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.471607+0000","last_change":"2024-05-20T22:06:29.433882+0000","last_active":"2024-05-20T22:08:15.471607+0000","last_peered":"2024-05-20T22:08:15.471607+0000","last_clean":"2024-05-20T22:08:15.471607+0000","last_became_active":"2024-05-20T22:06:29.432608+0000","last_became_peered":"2024-05-20T22:06:29.432608+0000","last_unstale":"2024-05-20T22:08:15.471607+0000","last_undegraded":"2024-05-20T22:08:15.471607+0000","last_fullsized":"2024-05-20T22:08:15.471607+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:46:02.174789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.630423+0000","last_change":"2024-05-20T22:06:25.063833+0000","last_active":"2024-05-20T22:08:15.630423+0000","last_peered":"2024-05-20T22:08:15.630423+0000","last_clean":"2024-05-20T22:08:15.630423+0000","last_became_active":"2024-05-20T22:06:25.063206+0000","last_became_peered":"2024-05-20T22:06:25.063206+0000","last_unstale":"2024-05-20T22:08:15.630423+0000","last_undegraded":"2024-05-20T22:08:15.630423+0000","last_fullsized":"2024-05-20T22:08:15.630423+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:22:36.742603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085479+0000","last_change":"2024-05-20T22:06:23.005947+0000","last_active":"2024-05-20T22:08:16.085479+0000","last_peered":"2024-05-20T22:08:16.085479+0000","last_clean":"2024-05-20T22:08:16.085479+0000","last_became_active":"2024-05-20T22:06:23.005645+0000","last_became_peered":"2024-05-20T22:06:23.005645+0000","last_unstale":"2024-05-20T22:08:16.085479+0000","last_undegraded":"2024-05-20T22:08:16.085479+0000","last_fullsized":"2024-05-20T22:08:16.085479+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:26:03.447814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469490+0000","last_change":"2024-05-20T22:06:27.409615+0000","last_active":"2024-05-20T22:08:15.469490+0000","last_peered":"2024-05-20T22:08:15.469490+0000","last_clean":"2024-05-20T22:08:15.469490+0000","last_became_active":"2024-05-20T22:06:27.409293+0000","last_became_peered":"2024-05-20T22:06:27.409293+0000","last_unstale":"2024-05-20T22:08:15.469490+0000","last_undegraded":"2024-05-20T22:08:15.469490+0000","last_fullsized":"2024-05-20T22:08:15.469490+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:37:45.477864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085197+0000","last_change":"2024-05-20T22:06:29.434869+0000","last_active":"2024-05-20T22:08:16.085197+0000","last_peered":"2024-05-20T22:08:16.085197+0000","last_clean":"2024-05-20T22:08:16.085197+0000","last_became_active":"2024-05-20T22:06:29.433933+0000","last_became_peered":"2024-05-20T22:06:29.433933+0000","last_unstale":"2024-05-20T22:08:16.085197+0000","last_undegraded":"2024-05-20T22:08:16.085197+0000","last_fullsized":"2024-05-20T22:08:16.085197+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:27:49.339468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.471329+0000","last_change":"2024-05-20T22:06:25.067750+0000","last_active":"2024-05-20T22:08:15.471329+0000","last_peered":"2024-05-20T22:08:15.471329+0000","last_clean":"2024-05-20T22:08:15.471329+0000","last_became_active":"2024-05-20T22:06:25.067397+0000","last_became_peered":"2024-05-20T22:06:25.067397+0000","last_unstale":"2024-05-20T22:08:15.471329+0000","last_undegraded":"2024-05-20T22:08:15.471329+0000","last_fullsized":"2024-05-20T22:08:15.471329+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:55:06.295390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.752834+0000","last_change":"2024-05-20T22:06:23.016625+0000","last_active":"2024-05-20T22:08:15.752834+0000","last_peered":"2024-05-20T22:08:15.752834+0000","last_clean":"2024-05-20T22:08:15.752834+0000","last_became_active":"2024-05-20T22:06:23.016246+0000","last_became_peered":"2024-05-20T22:06:23.016246+0000","last_unstale":"2024-05-20T22:08:15.752834+0000","last_undegraded":"2024-05-20T22:08:15.752834+0000","last_fullsized":"2024-05-20T22:08:15.752834+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:50:45.960861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.751761+0000","last_change":"2024-05-20T22:06:27.398470+0000","last_active":"2024-05-20T22:08:15.751761+0000","last_peered":"2024-05-20T22:08:15.751761+0000","last_clean":"2024-05-20T22:08:15.751761+0000","last_became_active":"2024-05-20T22:06:27.397661+0000","last_became_peered":"2024-05-20T22:06:27.397661+0000","last_unstale":"2024-05-20T22:08:15.751761+0000","last_undegraded":"2024-05-20T22:08:15.751761+0000","last_fullsized":"2024-05-20T22:08:15.751761+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:25:48.893862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468002+0000","last_change":"2024-05-20T22:06:29.444483+0000","last_active":"2024-05-20T22:08:15.468002+0000","last_peered":"2024-05-20T22:08:15.468002+0000","last_clean":"2024-05-20T22:08:15.468002+0000","last_became_active":"2024-05-20T22:06:29.443563+0000","last_became_peered":"2024-05-20T22:06:29.443563+0000","last_unstale":"2024-05-20T22:08:15.468002+0000","last_undegraded":"2024-05-20T22:08:15.468002+0000","last_fullsized":"2024-05-20T22:08:15.468002+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:34:57.718609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"67'6","reported_seq":45,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.087332+0000","last_change":"2024-05-20T22:06:25.054084+0000","last_active":"2024-05-20T22:08:16.087332+0000","last_peered":"2024-05-20T22:08:16.087332+0000","last_clean":"2024-05-20T22:08:16.087332+0000","last_became_active":"2024-05-20T22:06:25.053185+0000","last_became_peered":"2024-05-20T22:06:25.053185+0000","last_unstale":"2024-05-20T22:08:16.087332+0000","last_undegraded":"2024-05-20T22:08:16.087332+0000","last_fullsized":"2024-05-20T22:08:16.087332+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:48:38.510173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.475170+0000","last_change":"2024-05-20T22:06:23.005614+0000","last_active":"2024-05-20T22:08:15.475170+0000","last_peered":"2024-05-20T22:08:15.475170+0000","last_clean":"2024-05-20T22:08:15.475170+0000","last_became_active":"2024-05-20T22:06:23.005276+0000","last_became_peered":"2024-05-20T22:06:23.005276+0000","last_unstale":"2024-05-20T22:08:15.475170+0000","last_undegraded":"2024-05-20T22:08:15.475170+0000","last_fullsized":"2024-05-20T22:08:15.475170+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:58:14.712410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.084637+0000","last_change":"2024-05-20T22:06:27.402363+0000","last_active":"2024-05-20T22:08:16.084637+0000","last_peered":"2024-05-20T22:08:16.084637+0000","last_clean":"2024-05-20T22:08:16.084637+0000","last_became_active":"2024-05-20T22:06:27.401495+0000","last_became_peered":"2024-05-20T22:06:27.401495+0000","last_unstale":"2024-05-20T22:08:16.084637+0000","last_undegraded":"2024-05-20T22:08:16.084637+0000","last_fullsized":"2024-05-20T22:08:16.084637+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:07:24.207281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.628572+0000","last_change":"2024-05-20T22:06:29.434021+0000","last_active":"2024-05-20T22:08:15.628572+0000","last_peered":"2024-05-20T22:08:15.628572+0000","last_clean":"2024-05-20T22:08:15.628572+0000","last_became_active":"2024-05-20T22:06:29.433232+0000","last_became_peered":"2024-05-20T22:06:29.433232+0000","last_unstale":"2024-05-20T22:08:15.628572+0000","last_undegraded":"2024-05-20T22:08:15.628572+0000","last_fullsized":"2024-05-20T22:08:15.628572+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:11:43.530457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.474795+0000","last_change":"2024-05-20T22:06:25.054371+0000","last_active":"2024-05-20T22:08:15.474795+0000","last_peered":"2024-05-20T22:08:15.474795+0000","last_clean":"2024-05-20T22:08:15.474795+0000","last_became_active":"2024-05-20T22:06:25.053456+0000","last_became_peered":"2024-05-20T22:06:25.053456+0000","last_unstale":"2024-05-20T22:08:15.474795+0000","last_undegraded":"2024-05-20T22:08:15.474795+0000","last_fullsized":"2024-05-20T22:08:15.474795+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:06:36.584357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085906+0000","last_change":"2024-05-20T22:06:23.006199+0000","last_active":"2024-05-20T22:08:16.085906+0000","last_peered":"2024-05-20T22:08:16.085906+0000","last_clean":"2024-05-20T22:08:16.085906+0000","last_became_active":"2024-05-20T22:06:23.005417+0000","last_became_peered":"2024-05-20T22:06:23.005417+0000","last_unstale":"2024-05-20T22:08:16.085906+0000","last_undegraded":"2024-05-20T22:08:16.085906+0000","last_fullsized":"2024-05-20T22:08:16.085906+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:30:04.985982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.628112+0000","last_change":"2024-05-20T22:06:27.418299+0000","last_active":"2024-05-20T22:08:15.628112+0000","last_peered":"2024-05-20T22:08:15.628112+0000","last_clean":"2024-05-20T22:08:15.628112+0000","last_became_active":"2024-05-20T22:06:27.417489+0000","last_became_peered":"2024-05-20T22:06:27.417489+0000","last_unstale":"2024-05-20T22:08:15.628112+0000","last_undegraded":"2024-05-20T22:08:15.628112+0000","last_fullsized":"2024-05-20T22:08:15.628112+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:14:28.360270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.469787+0000","last_change":"2024-05-20T22:06:29.567009+0000","last_active":"2024-05-20T22:08:15.469787+0000","last_peered":"2024-05-20T22:08:15.469787+0000","last_clean":"2024-05-20T22:08:15.469787+0000","last_became_active":"2024-05-20T22:06:29.566124+0000","last_became_peered":"2024-05-20T22:06:29.566124+0000","last_unstale":"2024-05-20T22:08:15.469787+0000","last_undegraded":"2024-05-20T22:08:15.469787+0000","last_fullsized":"2024-05-20T22:08:15.469787+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:55:09.789062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"67'1","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.629657+0000","last_change":"2024-05-20T22:06:29.434336+0000","last_active":"2024-05-20T22:08:15.629657+0000","last_peered":"2024-05-20T22:08:15.629657+0000","last_clean":"2024-05-20T22:08:15.629657+0000","last_became_active":"2024-05-20T22:06:29.433354+0000","last_became_peered":"2024-05-20T22:06:29.433354+0000","last_unstale":"2024-05-20T22:08:15.629657+0000","last_undegraded":"2024-05-20T22:08:15.629657+0000","last_fullsized":"2024-05-20T22:08:15.629657+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:04:59.087963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.751958+0000","last_change":"2024-05-20T22:06:25.067494+0000","last_active":"2024-05-20T22:08:15.751958+0000","last_peered":"2024-05-20T22:08:15.751958+0000","last_clean":"2024-05-20T22:08:15.751958+0000","last_became_active":"2024-05-20T22:06:25.066858+0000","last_became_peered":"2024-05-20T22:06:25.066858+0000","last_unstale":"2024-05-20T22:08:15.751958+0000","last_undegraded":"2024-05-20T22:08:15.751958+0000","last_fullsized":"2024-05-20T22:08:15.751958+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:16.810958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.474350+0000","last_change":"2024-05-20T22:06:22.998500+0000","last_active":"2024-05-20T22:08:15.474350+0000","last_peered":"2024-05-20T22:08:15.474350+0000","last_clean":"2024-05-20T22:08:15.474350+0000","last_became_active":"2024-05-20T22:06:22.998174+0000","last_became_peered":"2024-05-20T22:06:22.998174+0000","last_unstale":"2024-05-20T22:08:15.474350+0000","last_undegraded":"2024-05-20T22:08:15.474350+0000","last_fullsized":"2024-05-20T22:08:15.474350+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:39:04.834712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"67'11","reported_seq":79,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:09:03.188220+0000","last_change":"2024-05-20T22:06:27.404695+0000","last_active":"2024-05-20T22:09:03.188220+0000","last_peered":"2024-05-20T22:09:03.188220+0000","last_clean":"2024-05-20T22:09:03.188220+0000","last_became_active":"2024-05-20T22:06:27.403755+0000","last_became_peered":"2024-05-20T22:06:27.403755+0000","last_unstale":"2024-05-20T22:09:03.188220+0000","last_undegraded":"2024-05-20T22:09:03.188220+0000","last_fullsized":"2024-05-20T22:09:03.188220+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:18:06.574456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.752340+0000","last_change":"2024-05-20T22:06:29.456103+0000","last_active":"2024-05-20T22:08:15.752340+0000","last_peered":"2024-05-20T22:08:15.752340+0000","last_clean":"2024-05-20T22:08:15.752340+0000","last_became_active":"2024-05-20T22:06:29.451490+0000","last_became_peered":"2024-05-20T22:06:29.451490+0000","last_unstale":"2024-05-20T22:08:15.752340+0000","last_undegraded":"2024-05-20T22:08:15.752340+0000","last_fullsized":"2024-05-20T22:08:15.752340+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:22:44.498154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468257+0000","last_change":"2024-05-20T22:06:25.054115+0000","last_active":"2024-05-20T22:08:15.468257+0000","last_peered":"2024-05-20T22:08:15.468257+0000","last_clean":"2024-05-20T22:08:15.468257+0000","last_became_active":"2024-05-20T22:06:25.053321+0000","last_became_peered":"2024-05-20T22:06:25.053321+0000","last_unstale":"2024-05-20T22:08:15.468257+0000","last_undegraded":"2024-05-20T22:08:15.468257+0000","last_fullsized":"2024-05-20T22:08:15.468257+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:17:18.968946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"60'1","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468695+0000","last_change":"2024-05-20T22:06:23.012126+0000","last_active":"2024-05-20T22:08:15.468695+0000","last_peered":"2024-05-20T22:08:15.468695+0000","last_clean":"2024-05-20T22:08:15.468695+0000","last_became_active":"2024-05-20T22:06:23.011322+0000","last_became_peered":"2024-05-20T22:06:23.011322+0000","last_unstale":"2024-05-20T22:08:15.468695+0000","last_undegraded":"2024-05-20T22:08:15.468695+0000","last_fullsized":"2024-05-20T22:08:15.468695+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:19:32.638672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.086639+0000","last_change":"2024-05-20T22:06:27.413645+0000","last_active":"2024-05-20T22:08:16.086639+0000","last_peered":"2024-05-20T22:08:16.086639+0000","last_clean":"2024-05-20T22:08:16.086639+0000","last_became_active":"2024-05-20T22:06:27.413311+0000","last_became_peered":"2024-05-20T22:06:27.413311+0000","last_unstale":"2024-05-20T22:08:16.086639+0000","last_undegraded":"2024-05-20T22:08:16.086639+0000","last_fullsized":"2024-05-20T22:08:16.086639+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:47:34.332110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.471269+0000","last_change":"2024-05-20T22:06:29.565464+0000","last_active":"2024-05-20T22:08:15.471269+0000","last_peered":"2024-05-20T22:08:15.471269+0000","last_clean":"2024-05-20T22:08:15.471269+0000","last_became_active":"2024-05-20T22:06:29.564315+0000","last_became_peered":"2024-05-20T22:06:29.564315+0000","last_unstale":"2024-05-20T22:08:15.471269+0000","last_undegraded":"2024-05-20T22:08:15.471269+0000","last_fullsized":"2024-05-20T22:08:15.471269+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:15:47.525801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.085832+0000","last_change":"2024-05-20T22:06:23.000141+0000","last_active":"2024-05-20T22:08:16.085832+0000","last_peered":"2024-05-20T22:08:16.085832+0000","last_clean":"2024-05-20T22:08:16.085832+0000","last_became_active":"2024-05-20T22:06:22.999306+0000","last_became_peered":"2024-05-20T22:06:22.999306+0000","last_unstale":"2024-05-20T22:08:16.085832+0000","last_undegraded":"2024-05-20T22:08:16.085832+0000","last_fullsized":"2024-05-20T22:08:16.085832+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:18:02.296474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"67'5","reported_seq":46,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:16.086710+0000","last_change":"2024-05-20T22:06:25.071313+0000","last_active":"2024-05-20T22:08:16.086710+0000","last_peered":"2024-05-20T22:08:16.086710+0000","last_clean":"2024-05-20T22:08:16.086710+0000","last_became_active":"2024-05-20T22:06:25.070997+0000","last_became_peered":"2024-05-20T22:06:25.070997+0000","last_unstale":"2024-05-20T22:08:16.086710+0000","last_undegraded":"2024-05-20T22:08:16.086710+0000","last_fullsized":"2024-05-20T22:08:16.086710+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:40:21.164473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.752782+0000","last_change":"2024-05-20T22:06:27.417403+0000","last_active":"2024-05-20T22:08:15.752782+0000","last_peered":"2024-05-20T22:08:15.752782+0000","last_clean":"2024-05-20T22:08:15.752782+0000","last_became_active":"2024-05-20T22:06:27.416713+0000","last_became_peered":"2024-05-20T22:06:27.416713+0000","last_unstale":"2024-05-20T22:08:15.752782+0000","last_undegraded":"2024-05-20T22:08:15.752782+0000","last_fullsized":"2024-05-20T22:08:15.752782+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:24:33.954556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.468380+0000","last_change":"2024-05-20T22:06:29.566461+0000","last_active":"2024-05-20T22:08:15.468380+0000","last_peered":"2024-05-20T22:08:15.468380+0000","last_clean":"2024-05-20T22:08:15.468380+0000","last_became_active":"2024-05-20T22:06:29.565554+0000","last_became_peered":"2024-05-20T22:06:29.565554+0000","last_unstale":"2024-05-20T22:08:15.468380+0000","last_undegraded":"2024-05-20T22:08:15.468380+0000","last_fullsized":"2024-05-20T22:08:15.468380+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:28.393450+0000","last_clean_scrub_stamp":"2024-05-20T22:06:28.393450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:25:54.718622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.470234+0000","last_change":"2024-05-20T22:06:23.003088+0000","last_active":"2024-05-20T22:08:15.470234+0000","last_peered":"2024-05-20T22:08:15.470234+0000","last_clean":"2024-05-20T22:08:15.470234+0000","last_became_active":"2024-05-20T22:06:23.000924+0000","last_became_peered":"2024-05-20T22:06:23.000924+0000","last_unstale":"2024-05-20T22:08:15.470234+0000","last_undegraded":"2024-05-20T22:08:15.470234+0000","last_fullsized":"2024-05-20T22:08:15.470234+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:21.972015+0000","last_clean_scrub_stamp":"2024-05-20T22:06:21.972015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:46:53.388003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.470701+0000","last_change":"2024-05-20T22:06:25.069717+0000","last_active":"2024-05-20T22:08:15.470701+0000","last_peered":"2024-05-20T22:08:15.470701+0000","last_clean":"2024-05-20T22:08:15.470701+0000","last_became_active":"2024-05-20T22:06:25.069299+0000","last_became_peered":"2024-05-20T22:06:25.069299+0000","last_unstale":"2024-05-20T22:08:15.470701+0000","last_undegraded":"2024-05-20T22:08:15.470701+0000","last_fullsized":"2024-05-20T22:08:15.470701+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:23.983651+0000","last_clean_scrub_stamp":"2024-05-20T22:06:23.983651+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:03:55.491591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-20T22:08:15.470749+0000","last_change":"2024-05-20T22:06:27.396189+0000","last_active":"2024-05-20T22:08:15.470749+0000","last_peered":"2024-05-20T22:08:15.470749+0000","last_clean":"2024-05-20T22:08:15.470749+0000","last_became_active":"2024-05-20T22:06:27.394128+0000","last_became_peered":"2024-05-20T22:06:27.394128+0000","last_unstale":"2024-05-20T22:08:15.470749+0000","last_undegraded":"2024-05-20T22:08:15.470749+0000","last_fullsized":"2024-05-20T22:08:15.470749+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T22:06:26.363357+0000","last_clean_scrub_stamp":"2024-05-20T22:06:26.363357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:47:16.328682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":416,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":148,"num_read_kb":143,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":9,"acting":9,"num_store_stats":7},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":701,"num_read_kb":458,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":395,"ondisk_log_size":395,"up":96,"acting":96,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234027,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28356,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716796,"statfs":{"total":95995035648,"available":95965999104,"internally_reserved":0,"allocated":1363968,"data_stored":886945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495670,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28316,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716836,"statfs":{"total":95995035648,"available":95966040064,"internally_reserved":0,"allocated":1323008,"data_stored":884161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757312,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717412,"statfs":{"total":95995035648,"available":95966629888,"internally_reserved":0,"allocated":737280,"data_stored":294631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018952,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717372,"statfs":{"total":95995035648,"available":95966588928,"internally_reserved":0,"allocated":774144,"data_stored":295731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182483,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36060,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709092,"statfs":{"total":95995035648,"available":95958110208,"internally_reserved":0,"allocated":733184,"data_stored":294616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411421,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27744,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717408,"statfs":{"total":95995035648,"available":95966625792,"internally_reserved":0,"allocated":737280,"data_stored":294299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574953,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27748,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717404,"statfs":{"total":95995035648,"available":95966621696,"internally_reserved":0,"allocated":745472,"data_stored":294124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738483,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36660,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708492,"statfs":{"total":95995035648,"available":95957495808,"internally_reserved":0,"allocated":1347584,"data_stored":885822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T22:09:11.213 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-20T22:09:11.213 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-20T22:09:11.213 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-20T22:09:11.213 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:200b27799814c89893ec6700f852fc40163e03d5-centos9 shell --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 -- ceph health --format=json 2024-05-20T22:09:11.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:11 smithi145 bash[23893]: cluster 2024-05-20T22:09:09.889819+0000 mgr.y (mgr.14592) 107 : cluster 0 pgmap v63: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:11.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:11 smithi145 bash[23893]: audit 2024-05-20T22:09:10.484146+0000 mgr.y (mgr.14592) 108 : audit 0 from='client.24650 v1:172.21.15.50:0/2690609206' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T22:09:11.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:11 smithi050 bash[21866]: cluster 2024-05-20T22:09:09.889819+0000 mgr.y (mgr.14592) 107 : cluster 0 pgmap v63: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:11.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:11 smithi050 bash[21866]: audit 2024-05-20T22:09:10.484146+0000 mgr.y (mgr.14592) 108 : audit 0 from='client.24650 v1:172.21.15.50:0/2690609206' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T22:09:11.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:11 smithi050 bash[28929]: cluster 2024-05-20T22:09:09.889819+0000 mgr.y (mgr.14592) 107 : cluster 0 pgmap v63: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:11.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:11 smithi050 bash[28929]: audit 2024-05-20T22:09:10.484146+0000 mgr.y (mgr.14592) 108 : audit 0 from='client.24650 v1:172.21.15.50:0/2690609206' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T22:09:13.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:13 smithi145 bash[23893]: cluster 2024-05-20T22:09:11.890508+0000 mgr.y (mgr.14592) 109 : cluster 0 pgmap v64: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:13.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:13 smithi050 bash[28929]: cluster 2024-05-20T22:09:11.890508+0000 mgr.y (mgr.14592) 109 : cluster 0 pgmap v64: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:13.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:13 smithi050 bash[21866]: cluster 2024-05-20T22:09:11.890508+0000 mgr.y (mgr.14592) 109 : cluster 0 pgmap v64: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:15.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:15 smithi145 bash[23893]: cluster 2024-05-20T22:09:13.891201+0000 mgr.y (mgr.14592) 110 : cluster 0 pgmap v65: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:15.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:15 smithi145 bash[23893]: audit 2024-05-20T22:09:14.134709+0000 mon.a (mon.0) 916 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:09:15.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:15 smithi050 bash[21866]: cluster 2024-05-20T22:09:13.891201+0000 mgr.y (mgr.14592) 110 : cluster 0 pgmap v65: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:15.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:15 smithi050 bash[21866]: audit 2024-05-20T22:09:14.134709+0000 mon.a (mon.0) 916 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:09:15.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:15 smithi050 bash[28929]: cluster 2024-05-20T22:09:13.891201+0000 mgr.y (mgr.14592) 110 : cluster 0 pgmap v65: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:15.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:15 smithi050 bash[28929]: audit 2024-05-20T22:09:14.134709+0000 mon.a (mon.0) 916 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:09:16.009 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T22:09:17.333 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:17 smithi050 bash[28929]: cluster 2024-05-20T22:09:15.892701+0000 mgr.y (mgr.14592) 111 : cluster 0 pgmap v66: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:17.333 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:17 smithi050 bash[21866]: cluster 2024-05-20T22:09:15.892701+0000 mgr.y (mgr.14592) 111 : cluster 0 pgmap v66: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:17.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:17 smithi145 bash[23893]: cluster 2024-05-20T22:09:15.892701+0000 mgr.y (mgr.14592) 111 : cluster 0 pgmap v66: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:17.890 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:09:17 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:09:18.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:18 smithi050 bash[28929]: audit 2024-05-20T22:09:17.524107+0000 mgr.y (mgr.14592) 112 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:09:18.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:18 smithi050 bash[21866]: audit 2024-05-20T22:09:17.524107+0000 mgr.y (mgr.14592) 112 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:09:18.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:18 smithi145 bash[23893]: audit 2024-05-20T22:09:17.524107+0000 mgr.y (mgr.14592) 112 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:09:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b9c003640 1 -- 172.21.15.50:0/3517838103 >> v1:172.21.15.50:6790/0 conn(0x7f5b94110bf0 legacy=0x7f5b94112fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:09:18.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b9c003640 1 -- 172.21.15.50:0/3517838103 shutdown_connections 2024-05-20T22:09:18.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b9c003640 1 -- 172.21.15.50:0/3517838103 >> 172.21.15.50:0/3517838103 conn(0x7f5b94077400 msgr2=0x7f5b94079820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:09:18.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b9c003640 1 -- 172.21.15.50:0/3517838103 shutdown_connections 2024-05-20T22:09:18.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b9c003640 1 -- 172.21.15.50:0/3517838103 wait complete. 2024-05-20T22:09:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b9c003640 1 Processor -- start 2024-05-20T22:09:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b9c003640 1 -- start start 2024-05-20T22:09:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b9c003640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f5b941ad120 con 0x7f5b94107f60 2024-05-20T22:09:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b9c003640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f5b941ae360 con 0x7f5b941a9360 2024-05-20T22:09:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b9c003640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f5b941af5a0 con 0x7f5b94114760 2024-05-20T22:09:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b99d9f640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5b94107f60 0x7f5b9410d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51754/0 (socket says 172.21.15.50:51754) 2024-05-20T22:09:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b99d9f640 1 -- 172.21.15.50:0/1532546455 learned_addr learned my addr 172.21.15.50:0/1532546455 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:09:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 8748199 0 0) 0x7f5b941ad120 con 0x7f5b94107f60 2024-05-20T22:09:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b80003520 con 0x7f5b94107f60 2024-05-20T22:09:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2266260477 0 0) 0x7f5b941af5a0 con 0x7f5b94114760 2024-05-20T22:09:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b941ad120 con 0x7f5b94114760 2024-05-20T22:09:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3858148337 0 0) 0x7f5b80003520 con 0x7f5b94107f60 2024-05-20T22:09:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b941af5a0 con 0x7f5b94107f60 2024-05-20T22:09:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1006574022 0 0) 0x7f5b941ae360 con 0x7f5b941a9360 2024-05-20T22:09:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b80003520 con 0x7f5b941a9360 2024-05-20T22:09:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f5b84001a30 con 0x7f5b94107f60 2024-05-20T22:09:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 261190700 0 0) 0x7f5b941ad120 con 0x7f5b94114760 2024-05-20T22:09:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b941ae360 con 0x7f5b94114760 2024-05-20T22:09:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f5b90004370 con 0x7f5b94114760 2024-05-20T22:09:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3092691419 0 0) 0x7f5b941af5a0 con 0x7f5b94107f60 2024-05-20T22:09:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 >> v1:172.21.15.50:6790/0 conn(0x7f5b94114760 legacy=0x7f5b941a7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:09:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 >> v1:172.21.15.145:6789/0 conn(0x7f5b941a9360 legacy=0x7f5b941ab820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:09:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b941b07e0 con 0x7f5b94107f60 2024-05-20T22:09:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b9c003640 1 -- 172.21.15.50:0/1532546455 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5b941af7d0 con 0x7f5b94107f60 2024-05-20T22:09:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b9c003640 1 -- 172.21.15.50:0/1532546455 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5b941afc90 con 0x7f5b94107f60 2024-05-20T22:09:18.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f5b84001ce0 con 0x7f5b94107f60 2024-05-20T22:09:18.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.705+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f5b84005c80 con 0x7f5b94107f60 2024-05-20T22:09:18.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.709+0000 7f5b9c003640 1 -- 172.21.15.50:0/1532546455 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b78005080 con 0x7f5b94107f60 2024-05-20T22:09:18.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.709+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f5b840038a0 con 0x7f5b94107f60 2024-05-20T22:09:18.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.709+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(74..74 src has 1..74) ==== 6201+0+0 (unknown 2490794606 0 0) 0x7f5b84089650 con 0x7f5b94107f60 2024-05-20T22:09:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.713+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f5b84056df0 con 0x7f5b94107f60 2024-05-20T22:09:18.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.941+0000 7f5b9c003640 1 -- 172.21.15.50:0/1532546455 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5b78005370 con 0x7f5b94107f60 2024-05-20T22:09:18.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.941+0000 7f5b8affd640 1 -- 172.21.15.50:0/1532546455 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7f5b8405aaa0 con 0x7f5b94107f60 2024-05-20T22:09:18.940 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-20T22:09:18.940 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-20T22:09:18.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.945+0000 7f5b9c003640 1 -- 172.21.15.50:0/1532546455 >> v1:172.21.15.50:6800/3332714287 conn(0x7f5b8006edb0 legacy=0x7f5b80071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:09:18.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.945+0000 7f5b9c003640 1 -- 172.21.15.50:0/1532546455 >> v1:172.21.15.50:6789/0 conn(0x7f5b94107f60 legacy=0x7f5b9410d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:09:18.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.945+0000 7f5b9c003640 1 -- 172.21.15.50:0/1532546455 shutdown_connections 2024-05-20T22:09:18.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.945+0000 7f5b9c003640 1 -- 172.21.15.50:0/1532546455 >> 172.21.15.50:0/1532546455 conn(0x7f5b94077400 msgr2=0x7f5b941178f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:09:18.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.945+0000 7f5b9c003640 1 -- 172.21.15.50:0/1532546455 shutdown_connections 2024-05-20T22:09:18.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-20T22:09:18.945+0000 7f5b9c003640 1 -- 172.21.15.50:0/1532546455 wait complete. 2024-05-20T22:09:19.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:19 smithi145 bash[23893]: cluster 2024-05-20T22:09:17.893280+0000 mgr.y (mgr.14592) 113 : cluster 0 pgmap v67: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:19.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:19 smithi145 bash[23893]: audit 2024-05-20T22:09:18.946328+0000 mon.a (mon.0) 917 : audit 0 from='client.? v1:172.21.15.50:0/1532546455' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-20T22:09:19.391 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:19 smithi050 bash[21866]: cluster 2024-05-20T22:09:17.893280+0000 mgr.y (mgr.14592) 113 : cluster 0 pgmap v67: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:19.391 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:19 smithi050 bash[21866]: audit 2024-05-20T22:09:18.946328+0000 mon.a (mon.0) 917 : audit 0 from='client.? v1:172.21.15.50:0/1532546455' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-20T22:09:19.391 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:19 smithi050 bash[28929]: cluster 2024-05-20T22:09:17.893280+0000 mgr.y (mgr.14592) 113 : cluster 0 pgmap v67: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:19.392 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:19 smithi050 bash[28929]: audit 2024-05-20T22:09:18.946328+0000 mon.a (mon.0) 917 : audit 0 from='client.? v1:172.21.15.50:0/1532546455' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-20T22:09:19.647 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:09:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:09:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:09:19.648 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-20T22:09:19.648 INFO:tasks.cephadm:Setup complete, yielding 2024-05-20T22:09:19.649 INFO:teuthology.run_tasks:Running task workunit... 2024-05-20T22:09:19.663 INFO:tasks.workunit:Pulling workunits from ref 200b27799814c89893ec6700f852fc40163e03d5 2024-05-20T22:09:19.663 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-20T22:09:19.663 DEBUG:teuthology.orchestra.run.smithi050:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-20T22:09:19.669 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T22:09:19.670 INFO:teuthology.orchestra.run.smithi050.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-05-20T22:09:19.670 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-05-20T22:09:19.718 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-05-20T22:09:19.719 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-05-20T22:09:19.770 INFO:tasks.workunit:timeout=3h 2024-05-20T22:09:19.770 INFO:tasks.workunit:cleanup=True 2024-05-20T22:09:19.771 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 200b27799814c89893ec6700f852fc40163e03d5 2024-05-20T22:09:19.820 INFO:tasks.workunit.client.0.smithi050.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-20T22:09:21.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:21 smithi145 bash[23893]: cluster 2024-05-20T22:09:19.894687+0000 mgr.y (mgr.14592) 114 : cluster 0 pgmap v68: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:21.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:21 smithi050 bash[21866]: cluster 2024-05-20T22:09:19.894687+0000 mgr.y (mgr.14592) 114 : cluster 0 pgmap v68: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:21.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:21 smithi050 bash[28929]: cluster 2024-05-20T22:09:19.894687+0000 mgr.y (mgr.14592) 114 : cluster 0 pgmap v68: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:23.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:23 smithi145 bash[23893]: cluster 2024-05-20T22:09:21.895679+0000 mgr.y (mgr.14592) 115 : cluster 0 pgmap v69: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:23.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:23 smithi050 bash[21866]: cluster 2024-05-20T22:09:21.895679+0000 mgr.y (mgr.14592) 115 : cluster 0 pgmap v69: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:23.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:23 smithi050 bash[28929]: cluster 2024-05-20T22:09:21.895679+0000 mgr.y (mgr.14592) 115 : cluster 0 pgmap v69: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:25.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:25 smithi145 bash[23893]: cluster 2024-05-20T22:09:23.896379+0000 mgr.y (mgr.14592) 116 : cluster 0 pgmap v70: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:25.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:25 smithi050 bash[21866]: cluster 2024-05-20T22:09:23.896379+0000 mgr.y (mgr.14592) 116 : cluster 0 pgmap v70: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:25.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:25 smithi050 bash[28929]: cluster 2024-05-20T22:09:23.896379+0000 mgr.y (mgr.14592) 116 : cluster 0 pgmap v70: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:27.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:27 smithi145 bash[23893]: cluster 2024-05-20T22:09:25.897788+0000 mgr.y (mgr.14592) 117 : cluster 0 pgmap v71: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:27.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:27 smithi050 bash[21866]: cluster 2024-05-20T22:09:25.897788+0000 mgr.y (mgr.14592) 117 : cluster 0 pgmap v71: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:27.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:27 smithi050 bash[28929]: cluster 2024-05-20T22:09:25.897788+0000 mgr.y (mgr.14592) 117 : cluster 0 pgmap v71: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:27.890 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:09:27 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:09:28.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:28 smithi145 bash[23893]: audit 2024-05-20T22:09:27.534696+0000 mgr.y (mgr.14592) 118 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:09:28.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:28 smithi050 bash[21866]: audit 2024-05-20T22:09:27.534696+0000 mgr.y (mgr.14592) 118 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:09:28.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:28 smithi050 bash[28929]: audit 2024-05-20T22:09:27.534696+0000 mgr.y (mgr.14592) 118 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:09:29.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:29 smithi145 bash[23893]: cluster 2024-05-20T22:09:27.898460+0000 mgr.y (mgr.14592) 119 : cluster 0 pgmap v72: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:29.391 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:29 smithi050 bash[21866]: cluster 2024-05-20T22:09:27.898460+0000 mgr.y (mgr.14592) 119 : cluster 0 pgmap v72: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:29.391 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:29 smithi050 bash[28929]: cluster 2024-05-20T22:09:27.898460+0000 mgr.y (mgr.14592) 119 : cluster 0 pgmap v72: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:29.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:09:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:09:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:09:30.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:30 smithi145 bash[23893]: audit 2024-05-20T22:09:29.162604+0000 mon.a (mon.0) 918 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:09:30.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:30 smithi050 bash[21866]: audit 2024-05-20T22:09:29.162604+0000 mon.a (mon.0) 918 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:09:30.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:30 smithi050 bash[28929]: audit 2024-05-20T22:09:29.162604+0000 mon.a (mon.0) 918 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:09:31.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:31 smithi145 bash[23893]: cluster 2024-05-20T22:09:29.899982+0000 mgr.y (mgr.14592) 120 : cluster 0 pgmap v73: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:31.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:31 smithi050 bash[21866]: cluster 2024-05-20T22:09:29.899982+0000 mgr.y (mgr.14592) 120 : cluster 0 pgmap v73: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:31.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:31 smithi050 bash[28929]: cluster 2024-05-20T22:09:29.899982+0000 mgr.y (mgr.14592) 120 : cluster 0 pgmap v73: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:33.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:33 smithi145 bash[23893]: cluster 2024-05-20T22:09:31.900679+0000 mgr.y (mgr.14592) 121 : cluster 0 pgmap v74: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:33.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:33 smithi050 bash[21866]: cluster 2024-05-20T22:09:31.900679+0000 mgr.y (mgr.14592) 121 : cluster 0 pgmap v74: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:33.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:33 smithi050 bash[28929]: cluster 2024-05-20T22:09:31.900679+0000 mgr.y (mgr.14592) 121 : cluster 0 pgmap v74: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:35.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:35 smithi145 bash[23893]: cluster 2024-05-20T22:09:33.901341+0000 mgr.y (mgr.14592) 122 : cluster 0 pgmap v75: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:35.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:35 smithi050 bash[21866]: cluster 2024-05-20T22:09:33.901341+0000 mgr.y (mgr.14592) 122 : cluster 0 pgmap v75: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:35.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:35 smithi050 bash[28929]: cluster 2024-05-20T22:09:33.901341+0000 mgr.y (mgr.14592) 122 : cluster 0 pgmap v75: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:37.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:37 smithi145 bash[23893]: cluster 2024-05-20T22:09:35.902785+0000 mgr.y (mgr.14592) 123 : cluster 0 pgmap v76: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:37.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:37 smithi145 bash[23893]: audit 2024-05-20T22:09:36.562475+0000 mon.a (mon.0) 919 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:09:37.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:37 smithi050 bash[21866]: cluster 2024-05-20T22:09:35.902785+0000 mgr.y (mgr.14592) 123 : cluster 0 pgmap v76: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:37.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:37 smithi050 bash[21866]: audit 2024-05-20T22:09:36.562475+0000 mon.a (mon.0) 919 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:09:37.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:37 smithi050 bash[28929]: cluster 2024-05-20T22:09:35.902785+0000 mgr.y (mgr.14592) 123 : cluster 0 pgmap v76: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:37.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:37 smithi050 bash[28929]: audit 2024-05-20T22:09:36.562475+0000 mon.a (mon.0) 919 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:09:37.890 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:09:37 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:09:38.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:38 smithi145 bash[23893]: audit 2024-05-20T22:09:37.247225+0000 mon.a (mon.0) 920 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:09:38.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:38 smithi145 bash[23893]: audit 2024-05-20T22:09:37.248472+0000 mon.a (mon.0) 921 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:09:38.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:38 smithi145 bash[23893]: audit 2024-05-20T22:09:37.257256+0000 mon.a (mon.0) 922 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:09:38.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:38 smithi145 bash[23893]: audit 2024-05-20T22:09:37.546213+0000 mgr.y (mgr.14592) 124 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:09:38.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:38 smithi050 bash[21866]: audit 2024-05-20T22:09:37.247225+0000 mon.a (mon.0) 920 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:09:38.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:38 smithi050 bash[21866]: audit 2024-05-20T22:09:37.248472+0000 mon.a (mon.0) 921 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:09:38.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:38 smithi050 bash[21866]: audit 2024-05-20T22:09:37.257256+0000 mon.a (mon.0) 922 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:09:38.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:38 smithi050 bash[21866]: audit 2024-05-20T22:09:37.546213+0000 mgr.y (mgr.14592) 124 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:09:38.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:38 smithi050 bash[28929]: audit 2024-05-20T22:09:37.247225+0000 mon.a (mon.0) 920 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:09:38.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:38 smithi050 bash[28929]: audit 2024-05-20T22:09:37.248472+0000 mon.a (mon.0) 921 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:09:38.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:38 smithi050 bash[28929]: audit 2024-05-20T22:09:37.257256+0000 mon.a (mon.0) 922 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:09:38.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:38 smithi050 bash[28929]: audit 2024-05-20T22:09:37.546213+0000 mgr.y (mgr.14592) 124 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:09:39.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:39 smithi145 bash[23893]: cluster 2024-05-20T22:09:37.903403+0000 mgr.y (mgr.14592) 125 : cluster 0 pgmap v77: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:39.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:39 smithi050 bash[21866]: cluster 2024-05-20T22:09:37.903403+0000 mgr.y (mgr.14592) 125 : cluster 0 pgmap v77: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:39.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:09:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:09:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:09:39.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:39 smithi050 bash[28929]: cluster 2024-05-20T22:09:37.903403+0000 mgr.y (mgr.14592) 125 : cluster 0 pgmap v77: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:41.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:41 smithi145 bash[23893]: cluster 2024-05-20T22:09:39.904913+0000 mgr.y (mgr.14592) 126 : cluster 0 pgmap v78: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:41.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:41 smithi050 bash[21866]: cluster 2024-05-20T22:09:39.904913+0000 mgr.y (mgr.14592) 126 : cluster 0 pgmap v78: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:41.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:41 smithi050 bash[28929]: cluster 2024-05-20T22:09:39.904913+0000 mgr.y (mgr.14592) 126 : cluster 0 pgmap v78: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:43.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:43 smithi145 bash[23893]: cluster 2024-05-20T22:09:41.905722+0000 mgr.y (mgr.14592) 127 : cluster 0 pgmap v79: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:43.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:43 smithi050 bash[21866]: cluster 2024-05-20T22:09:41.905722+0000 mgr.y (mgr.14592) 127 : cluster 0 pgmap v79: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:43.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:43 smithi050 bash[28929]: cluster 2024-05-20T22:09:41.905722+0000 mgr.y (mgr.14592) 127 : cluster 0 pgmap v79: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:44.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:44 smithi145 bash[23893]: audit 2024-05-20T22:09:44.190372+0000 mon.a (mon.0) 923 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:09:44.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:44 smithi050 bash[21866]: audit 2024-05-20T22:09:44.190372+0000 mon.a (mon.0) 923 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:09:44.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:44 smithi050 bash[28929]: audit 2024-05-20T22:09:44.190372+0000 mon.a (mon.0) 923 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:09:45.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:45 smithi145 bash[23893]: cluster 2024-05-20T22:09:43.906424+0000 mgr.y (mgr.14592) 128 : cluster 0 pgmap v80: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:45.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:45 smithi050 bash[21866]: cluster 2024-05-20T22:09:43.906424+0000 mgr.y (mgr.14592) 128 : cluster 0 pgmap v80: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:45.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:45 smithi050 bash[28929]: cluster 2024-05-20T22:09:43.906424+0000 mgr.y (mgr.14592) 128 : cluster 0 pgmap v80: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:47.552 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:47 smithi145 bash[23893]: cluster 2024-05-20T22:09:45.907885+0000 mgr.y (mgr.14592) 129 : cluster 0 pgmap v81: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:47.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:47 smithi050 bash[21866]: cluster 2024-05-20T22:09:45.907885+0000 mgr.y (mgr.14592) 129 : cluster 0 pgmap v81: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:47.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:47 smithi050 bash[28929]: cluster 2024-05-20T22:09:45.907885+0000 mgr.y (mgr.14592) 129 : cluster 0 pgmap v81: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:47.890 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:09:47 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:09:48.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:48 smithi145 bash[23893]: audit 2024-05-20T22:09:47.557695+0000 mgr.y (mgr.14592) 130 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:09:48.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:48 smithi050 bash[21866]: audit 2024-05-20T22:09:47.557695+0000 mgr.y (mgr.14592) 130 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:09:48.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:48 smithi050 bash[28929]: audit 2024-05-20T22:09:47.557695+0000 mgr.y (mgr.14592) 130 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:09:49.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:49 smithi145 bash[23893]: cluster 2024-05-20T22:09:47.908506+0000 mgr.y (mgr.14592) 131 : cluster 0 pgmap v82: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:49.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:49 smithi050 bash[21866]: cluster 2024-05-20T22:09:47.908506+0000 mgr.y (mgr.14592) 131 : cluster 0 pgmap v82: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:49.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:09:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:09:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:09:49.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:49 smithi050 bash[28929]: cluster 2024-05-20T22:09:47.908506+0000 mgr.y (mgr.14592) 131 : cluster 0 pgmap v82: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:51.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:51 smithi145 bash[23893]: cluster 2024-05-20T22:09:49.909914+0000 mgr.y (mgr.14592) 132 : cluster 0 pgmap v83: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:51.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:51 smithi050 bash[21866]: cluster 2024-05-20T22:09:49.909914+0000 mgr.y (mgr.14592) 132 : cluster 0 pgmap v83: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:51.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:51 smithi050 bash[28929]: cluster 2024-05-20T22:09:49.909914+0000 mgr.y (mgr.14592) 132 : cluster 0 pgmap v83: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:53.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:53 smithi145 bash[23893]: cluster 2024-05-20T22:09:51.910589+0000 mgr.y (mgr.14592) 133 : cluster 0 pgmap v84: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:53.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:53 smithi050 bash[21866]: cluster 2024-05-20T22:09:51.910589+0000 mgr.y (mgr.14592) 133 : cluster 0 pgmap v84: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:53.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:53 smithi050 bash[28929]: cluster 2024-05-20T22:09:51.910589+0000 mgr.y (mgr.14592) 133 : cluster 0 pgmap v84: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:55.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:55 smithi145 bash[23893]: cluster 2024-05-20T22:09:53.911278+0000 mgr.y (mgr.14592) 134 : cluster 0 pgmap v85: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:55.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:55 smithi050 bash[21866]: cluster 2024-05-20T22:09:53.911278+0000 mgr.y (mgr.14592) 134 : cluster 0 pgmap v85: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:55.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:55 smithi050 bash[28929]: cluster 2024-05-20T22:09:53.911278+0000 mgr.y (mgr.14592) 134 : cluster 0 pgmap v85: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:57.564 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:57 smithi145 bash[23893]: cluster 2024-05-20T22:09:55.912744+0000 mgr.y (mgr.14592) 135 : cluster 0 pgmap v86: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:57.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:57 smithi050 bash[21866]: cluster 2024-05-20T22:09:55.912744+0000 mgr.y (mgr.14592) 135 : cluster 0 pgmap v86: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:57.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:57 smithi050 bash[28929]: cluster 2024-05-20T22:09:55.912744+0000 mgr.y (mgr.14592) 135 : cluster 0 pgmap v86: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:09:57.890 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:09:57 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:09:58.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:58 smithi145 bash[23893]: audit 2024-05-20T22:09:57.569210+0000 mgr.y (mgr.14592) 136 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:09:58.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:58 smithi050 bash[21866]: audit 2024-05-20T22:09:57.569210+0000 mgr.y (mgr.14592) 136 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:09:58.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:58 smithi050 bash[28929]: audit 2024-05-20T22:09:57.569210+0000 mgr.y (mgr.14592) 136 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:09:59.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:59 smithi145 bash[23893]: cluster 2024-05-20T22:09:57.913398+0000 mgr.y (mgr.14592) 137 : cluster 0 pgmap v87: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:59.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:09:59 smithi145 bash[23893]: audit 2024-05-20T22:09:59.218239+0000 mon.a (mon.0) 924 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:09:59.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:09:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:09:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:09:59.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:59 smithi050 bash[21866]: cluster 2024-05-20T22:09:57.913398+0000 mgr.y (mgr.14592) 137 : cluster 0 pgmap v87: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:59.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:09:59 smithi050 bash[21866]: audit 2024-05-20T22:09:59.218239+0000 mon.a (mon.0) 924 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:09:59.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:59 smithi050 bash[28929]: cluster 2024-05-20T22:09:57.913398+0000 mgr.y (mgr.14592) 137 : cluster 0 pgmap v87: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:09:59.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:09:59 smithi050 bash[28929]: audit 2024-05-20T22:09:59.218239+0000 mon.a (mon.0) 924 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:10:00.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:00 smithi145 bash[23893]: cluster 2024-05-20T22:10:00.000124+0000 mon.a (mon.0) 925 : cluster 1 overall HEALTH_OK 2024-05-20T22:10:00.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:00 smithi050 bash[21866]: cluster 2024-05-20T22:10:00.000124+0000 mon.a (mon.0) 925 : cluster 1 overall HEALTH_OK 2024-05-20T22:10:00.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:00 smithi050 bash[28929]: cluster 2024-05-20T22:10:00.000124+0000 mon.a (mon.0) 925 : cluster 1 overall HEALTH_OK 2024-05-20T22:10:01.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:01 smithi145 bash[23893]: cluster 2024-05-20T22:09:59.914887+0000 mgr.y (mgr.14592) 138 : cluster 0 pgmap v88: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:01.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:01 smithi050 bash[21866]: cluster 2024-05-20T22:09:59.914887+0000 mgr.y (mgr.14592) 138 : cluster 0 pgmap v88: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:01.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:01 smithi050 bash[28929]: cluster 2024-05-20T22:09:59.914887+0000 mgr.y (mgr.14592) 138 : cluster 0 pgmap v88: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:03.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:03 smithi145 bash[23893]: cluster 2024-05-20T22:10:01.915515+0000 mgr.y (mgr.14592) 139 : cluster 0 pgmap v89: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:03.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:03 smithi050 bash[21866]: cluster 2024-05-20T22:10:01.915515+0000 mgr.y (mgr.14592) 139 : cluster 0 pgmap v89: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:03.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:03 smithi050 bash[28929]: cluster 2024-05-20T22:10:01.915515+0000 mgr.y (mgr.14592) 139 : cluster 0 pgmap v89: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:05.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:05 smithi145 bash[23893]: cluster 2024-05-20T22:10:03.916245+0000 mgr.y (mgr.14592) 140 : cluster 0 pgmap v90: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:05.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:05 smithi050 bash[21866]: cluster 2024-05-20T22:10:03.916245+0000 mgr.y (mgr.14592) 140 : cluster 0 pgmap v90: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:05.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:05 smithi050 bash[28929]: cluster 2024-05-20T22:10:03.916245+0000 mgr.y (mgr.14592) 140 : cluster 0 pgmap v90: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:07.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:07 smithi145 bash[23893]: cluster 2024-05-20T22:10:05.917603+0000 mgr.y (mgr.14592) 141 : cluster 0 pgmap v91: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:07.640 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:10:07 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:10:07.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:07 smithi050 bash[21866]: cluster 2024-05-20T22:10:05.917603+0000 mgr.y (mgr.14592) 141 : cluster 0 pgmap v91: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:07.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:07 smithi050 bash[28929]: cluster 2024-05-20T22:10:05.917603+0000 mgr.y (mgr.14592) 141 : cluster 0 pgmap v91: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:08.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:08 smithi145 bash[23893]: audit 2024-05-20T22:10:07.579093+0000 mgr.y (mgr.14592) 142 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:10:08.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:08 smithi050 bash[28929]: audit 2024-05-20T22:10:07.579093+0000 mgr.y (mgr.14592) 142 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:10:08.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:08 smithi050 bash[21866]: audit 2024-05-20T22:10:07.579093+0000 mgr.y (mgr.14592) 142 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:10:09.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:09 smithi145 bash[23893]: cluster 2024-05-20T22:10:07.918335+0000 mgr.y (mgr.14592) 143 : cluster 0 pgmap v92: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:09.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:10:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:10:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:10:09.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:09 smithi050 bash[21866]: cluster 2024-05-20T22:10:07.918335+0000 mgr.y (mgr.14592) 143 : cluster 0 pgmap v92: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:09.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:09 smithi050 bash[28929]: cluster 2024-05-20T22:10:07.918335+0000 mgr.y (mgr.14592) 143 : cluster 0 pgmap v92: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:11.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:11 smithi145 bash[23893]: cluster 2024-05-20T22:10:09.919688+0000 mgr.y (mgr.14592) 144 : cluster 0 pgmap v93: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:11.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:11 smithi050 bash[21866]: cluster 2024-05-20T22:10:09.919688+0000 mgr.y (mgr.14592) 144 : cluster 0 pgmap v93: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:11.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:11 smithi050 bash[28929]: cluster 2024-05-20T22:10:09.919688+0000 mgr.y (mgr.14592) 144 : cluster 0 pgmap v93: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:13.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:13 smithi145 bash[23893]: cluster 2024-05-20T22:10:11.920363+0000 mgr.y (mgr.14592) 145 : cluster 0 pgmap v94: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:13.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:13 smithi050 bash[21866]: cluster 2024-05-20T22:10:11.920363+0000 mgr.y (mgr.14592) 145 : cluster 0 pgmap v94: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:13.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:13 smithi050 bash[28929]: cluster 2024-05-20T22:10:11.920363+0000 mgr.y (mgr.14592) 145 : cluster 0 pgmap v94: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:14.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:14 smithi145 bash[23893]: audit 2024-05-20T22:10:14.246752+0000 mon.a (mon.0) 926 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:10:14.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:14 smithi050 bash[21866]: audit 2024-05-20T22:10:14.246752+0000 mon.a (mon.0) 926 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:10:14.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:14 smithi050 bash[28929]: audit 2024-05-20T22:10:14.246752+0000 mon.a (mon.0) 926 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:10:15.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:15 smithi145 bash[23893]: cluster 2024-05-20T22:10:13.920980+0000 mgr.y (mgr.14592) 146 : cluster 0 pgmap v95: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:15.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:15 smithi050 bash[21866]: cluster 2024-05-20T22:10:13.920980+0000 mgr.y (mgr.14592) 146 : cluster 0 pgmap v95: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:15.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:15 smithi050 bash[28929]: cluster 2024-05-20T22:10:13.920980+0000 mgr.y (mgr.14592) 146 : cluster 0 pgmap v95: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:17.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:17 smithi145 bash[23893]: cluster 2024-05-20T22:10:15.922323+0000 mgr.y (mgr.14592) 147 : cluster 0 pgmap v96: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:17.640 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:10:17 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:10:17.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:17 smithi050 bash[21866]: cluster 2024-05-20T22:10:15.922323+0000 mgr.y (mgr.14592) 147 : cluster 0 pgmap v96: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:17.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:17 smithi050 bash[28929]: cluster 2024-05-20T22:10:15.922323+0000 mgr.y (mgr.14592) 147 : cluster 0 pgmap v96: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:18.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:18 smithi050 bash[21866]: audit 2024-05-20T22:10:17.590447+0000 mgr.y (mgr.14592) 148 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:10:18.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:18 smithi050 bash[28929]: audit 2024-05-20T22:10:17.590447+0000 mgr.y (mgr.14592) 148 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:10:18.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:18 smithi145 bash[23893]: audit 2024-05-20T22:10:17.590447+0000 mgr.y (mgr.14592) 148 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:10:19.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:19 smithi050 bash[21866]: cluster 2024-05-20T22:10:17.922786+0000 mgr.y (mgr.14592) 149 : cluster 0 pgmap v97: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:19.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:19 smithi050 bash[28929]: cluster 2024-05-20T22:10:17.922786+0000 mgr.y (mgr.14592) 149 : cluster 0 pgmap v97: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:19.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:10:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:10:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:10:19.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:19 smithi145 bash[23893]: cluster 2024-05-20T22:10:17.922786+0000 mgr.y (mgr.14592) 149 : cluster 0 pgmap v97: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:21.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:21 smithi050 bash[21866]: cluster 2024-05-20T22:10:19.923408+0000 mgr.y (mgr.14592) 150 : cluster 0 pgmap v98: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:21.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:21 smithi050 bash[28929]: cluster 2024-05-20T22:10:19.923408+0000 mgr.y (mgr.14592) 150 : cluster 0 pgmap v98: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:21.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:21 smithi145 bash[23893]: cluster 2024-05-20T22:10:19.923408+0000 mgr.y (mgr.14592) 150 : cluster 0 pgmap v98: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:23.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:23 smithi050 bash[21866]: cluster 2024-05-20T22:10:21.923784+0000 mgr.y (mgr.14592) 151 : cluster 0 pgmap v99: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:23.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:23 smithi050 bash[28929]: cluster 2024-05-20T22:10:21.923784+0000 mgr.y (mgr.14592) 151 : cluster 0 pgmap v99: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:23.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:23 smithi145 bash[23893]: cluster 2024-05-20T22:10:21.923784+0000 mgr.y (mgr.14592) 151 : cluster 0 pgmap v99: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:10:25.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:25 smithi050 bash[21866]: cluster 2024-05-20T22:10:23.924158+0000 mgr.y (mgr.14592) 152 : cluster 0 pgmap v100: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-20T22:10:25.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:25 smithi050 bash[28929]: cluster 2024-05-20T22:10:23.924158+0000 mgr.y (mgr.14592) 152 : cluster 0 pgmap v100: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-20T22:10:25.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:25 smithi145 bash[23893]: cluster 2024-05-20T22:10:23.924158+0000 mgr.y (mgr.14592) 152 : cluster 0 pgmap v100: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-20T22:10:27.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:27 smithi050 bash[21866]: cluster 2024-05-20T22:10:25.924936+0000 mgr.y (mgr.14592) 153 : cluster 0 pgmap v101: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:27.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:27 smithi050 bash[28929]: cluster 2024-05-20T22:10:25.924936+0000 mgr.y (mgr.14592) 153 : cluster 0 pgmap v101: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:27.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:27 smithi145 bash[23893]: cluster 2024-05-20T22:10:25.924936+0000 mgr.y (mgr.14592) 153 : cluster 0 pgmap v101: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:27.891 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:10:27 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:10:28.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:28 smithi050 bash[21866]: audit 2024-05-20T22:10:27.601587+0000 mgr.y (mgr.14592) 154 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:10:28.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:28 smithi050 bash[28929]: audit 2024-05-20T22:10:27.601587+0000 mgr.y (mgr.14592) 154 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:10:28.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:28 smithi145 bash[23893]: audit 2024-05-20T22:10:27.601587+0000 mgr.y (mgr.14592) 154 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:10:29.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:29 smithi050 bash[21866]: cluster 2024-05-20T22:10:27.925340+0000 mgr.y (mgr.14592) 155 : cluster 0 pgmap v102: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-20T22:10:29.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:29 smithi050 bash[21866]: audit 2024-05-20T22:10:29.274057+0000 mon.a (mon.0) 927 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:10:29.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:29 smithi050 bash[28929]: cluster 2024-05-20T22:10:27.925340+0000 mgr.y (mgr.14592) 155 : cluster 0 pgmap v102: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-20T22:10:29.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:29 smithi050 bash[28929]: audit 2024-05-20T22:10:29.274057+0000 mon.a (mon.0) 927 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:10:29.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:10:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:10:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:10:29.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:29 smithi145 bash[23893]: cluster 2024-05-20T22:10:27.925340+0000 mgr.y (mgr.14592) 155 : cluster 0 pgmap v102: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-20T22:10:29.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:29 smithi145 bash[23893]: audit 2024-05-20T22:10:29.274057+0000 mon.a (mon.0) 927 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:10:31.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:31 smithi050 bash[21866]: cluster 2024-05-20T22:10:29.926128+0000 mgr.y (mgr.14592) 156 : cluster 0 pgmap v103: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:31.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:31 smithi050 bash[28929]: cluster 2024-05-20T22:10:29.926128+0000 mgr.y (mgr.14592) 156 : cluster 0 pgmap v103: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:31.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:31 smithi145 bash[23893]: cluster 2024-05-20T22:10:29.926128+0000 mgr.y (mgr.14592) 156 : cluster 0 pgmap v103: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:33.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:33 smithi050 bash[21866]: cluster 2024-05-20T22:10:31.926543+0000 mgr.y (mgr.14592) 157 : cluster 0 pgmap v104: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-20T22:10:33.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:33 smithi050 bash[28929]: cluster 2024-05-20T22:10:31.926543+0000 mgr.y (mgr.14592) 157 : cluster 0 pgmap v104: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-20T22:10:33.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:33 smithi145 bash[23893]: cluster 2024-05-20T22:10:31.926543+0000 mgr.y (mgr.14592) 157 : cluster 0 pgmap v104: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-20T22:10:35.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:35 smithi050 bash[21866]: cluster 2024-05-20T22:10:33.926944+0000 mgr.y (mgr.14592) 158 : cluster 0 pgmap v105: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-20T22:10:35.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:35 smithi050 bash[28929]: cluster 2024-05-20T22:10:33.926944+0000 mgr.y (mgr.14592) 158 : cluster 0 pgmap v105: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-20T22:10:35.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:35 smithi145 bash[23893]: cluster 2024-05-20T22:10:33.926944+0000 mgr.y (mgr.14592) 158 : cluster 0 pgmap v105: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-20T22:10:37.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:37 smithi050 bash[21866]: cluster 2024-05-20T22:10:35.927725+0000 mgr.y (mgr.14592) 159 : cluster 0 pgmap v106: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:37.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:37 smithi050 bash[21866]: audit 2024-05-20T22:10:37.387975+0000 mon.a (mon.0) 928 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:10:37.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:37 smithi050 bash[28929]: cluster 2024-05-20T22:10:35.927725+0000 mgr.y (mgr.14592) 159 : cluster 0 pgmap v106: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:37.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:37 smithi050 bash[28929]: audit 2024-05-20T22:10:37.387975+0000 mon.a (mon.0) 928 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:10:37.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:37 smithi145 bash[23893]: cluster 2024-05-20T22:10:35.927725+0000 mgr.y (mgr.14592) 159 : cluster 0 pgmap v106: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:37.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:37 smithi145 bash[23893]: audit 2024-05-20T22:10:37.387975+0000 mon.a (mon.0) 928 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:10:37.890 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:10:37 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:10:38.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:38 smithi050 bash[21866]: audit 2024-05-20T22:10:37.612799+0000 mgr.y (mgr.14592) 160 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:10:38.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:38 smithi050 bash[21866]: audit 2024-05-20T22:10:38.261582+0000 mon.a (mon.0) 929 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:10:38.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:38 smithi050 bash[21866]: audit 2024-05-20T22:10:38.262414+0000 mon.a (mon.0) 930 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:10:38.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:38 smithi050 bash[21866]: audit 2024-05-20T22:10:38.268916+0000 mon.a (mon.0) 931 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:10:38.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:38 smithi050 bash[28929]: audit 2024-05-20T22:10:37.612799+0000 mgr.y (mgr.14592) 160 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:10:38.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:38 smithi050 bash[28929]: audit 2024-05-20T22:10:38.261582+0000 mon.a (mon.0) 929 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:10:38.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:38 smithi050 bash[28929]: audit 2024-05-20T22:10:38.262414+0000 mon.a (mon.0) 930 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:10:38.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:38 smithi050 bash[28929]: audit 2024-05-20T22:10:38.268916+0000 mon.a (mon.0) 931 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:10:38.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:38 smithi145 bash[23893]: audit 2024-05-20T22:10:37.612799+0000 mgr.y (mgr.14592) 160 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:10:38.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:38 smithi145 bash[23893]: audit 2024-05-20T22:10:38.261582+0000 mon.a (mon.0) 929 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:10:38.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:38 smithi145 bash[23893]: audit 2024-05-20T22:10:38.262414+0000 mon.a (mon.0) 930 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:10:38.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:38 smithi145 bash[23893]: audit 2024-05-20T22:10:38.268916+0000 mon.a (mon.0) 931 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:10:39.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:39 smithi050 bash[21866]: cluster 2024-05-20T22:10:37.928144+0000 mgr.y (mgr.14592) 161 : cluster 0 pgmap v107: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:10:39.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:10:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:10:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:10:39.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:39 smithi050 bash[28929]: cluster 2024-05-20T22:10:37.928144+0000 mgr.y (mgr.14592) 161 : cluster 0 pgmap v107: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:10:39.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:39 smithi145 bash[23893]: cluster 2024-05-20T22:10:37.928144+0000 mgr.y (mgr.14592) 161 : cluster 0 pgmap v107: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:10:41.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:41 smithi050 bash[21866]: cluster 2024-05-20T22:10:39.928919+0000 mgr.y (mgr.14592) 162 : cluster 0 pgmap v108: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:41.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:41 smithi050 bash[28929]: cluster 2024-05-20T22:10:39.928919+0000 mgr.y (mgr.14592) 162 : cluster 0 pgmap v108: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:41.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:41 smithi145 bash[23893]: cluster 2024-05-20T22:10:39.928919+0000 mgr.y (mgr.14592) 162 : cluster 0 pgmap v108: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:43.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:43 smithi050 bash[21866]: cluster 2024-05-20T22:10:41.929343+0000 mgr.y (mgr.14592) 163 : cluster 0 pgmap v109: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:10:43.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:43 smithi050 bash[28929]: cluster 2024-05-20T22:10:41.929343+0000 mgr.y (mgr.14592) 163 : cluster 0 pgmap v109: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:10:43.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:43 smithi145 bash[23893]: cluster 2024-05-20T22:10:41.929343+0000 mgr.y (mgr.14592) 163 : cluster 0 pgmap v109: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:10:44.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:44 smithi145 bash[23893]: audit 2024-05-20T22:10:44.290462+0000 mon.a (mon.0) 932 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:10:44.942 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:44 smithi050 bash[28929]: audit 2024-05-20T22:10:44.290462+0000 mon.a (mon.0) 932 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:10:44.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:44 smithi050 bash[21866]: audit 2024-05-20T22:10:44.290462+0000 mon.a (mon.0) 932 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:10:45.124 INFO:tasks.workunit.client.0.smithi050.stderr:Updating files: 95% (11659/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-20T22:10:45.459 INFO:tasks.workunit.client.0.smithi050.stderr:Note: switching to '200b27799814c89893ec6700f852fc40163e03d5'. 2024-05-20T22:10:45.459 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-05-20T22:10:45.460 INFO:tasks.workunit.client.0.smithi050.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-20T22:10:45.460 INFO:tasks.workunit.client.0.smithi050.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-20T22:10:45.460 INFO:tasks.workunit.client.0.smithi050.stderr:state without impacting any branches by switching back to a branch. 2024-05-20T22:10:45.460 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-05-20T22:10:45.460 INFO:tasks.workunit.client.0.smithi050.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-20T22:10:45.460 INFO:tasks.workunit.client.0.smithi050.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-20T22:10:45.460 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-05-20T22:10:45.461 INFO:tasks.workunit.client.0.smithi050.stderr: git switch -c 2024-05-20T22:10:45.461 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-05-20T22:10:45.461 INFO:tasks.workunit.client.0.smithi050.stderr:Or undo this operation with: 2024-05-20T22:10:45.461 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-05-20T22:10:45.461 INFO:tasks.workunit.client.0.smithi050.stderr: git switch - 2024-05-20T22:10:45.461 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-05-20T22:10:45.461 INFO:tasks.workunit.client.0.smithi050.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-20T22:10:45.461 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-05-20T22:10:45.462 INFO:tasks.workunit.client.0.smithi050.stderr:HEAD is now at 200b2779981 mgr/k8sevents: update V1Events to CoreV1Events 2024-05-20T22:10:45.467 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-20T22:10:45.517 INFO:tasks.workunit.client.0.smithi050.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-20T22:10:45.521 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-20T22:10:45.521 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-20T22:10:45.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:45 smithi145 bash[23893]: cluster 2024-05-20T22:10:43.929947+0000 mgr.y (mgr.14592) 164 : cluster 0 pgmap v110: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:10:45.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:45 smithi050 bash[21866]: cluster 2024-05-20T22:10:43.929947+0000 mgr.y (mgr.14592) 164 : cluster 0 pgmap v110: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:10:45.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:45 smithi050 bash[28929]: cluster 2024-05-20T22:10:43.929947+0000 mgr.y (mgr.14592) 164 : cluster 0 pgmap v110: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:10:46.393 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-20T22:10:46.479 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-20T22:10:46.539 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-20T22:10:46.540 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-20T22:10:46.540 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-20T22:10:46.586 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-20T22:10:46.590 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-20T22:10:46.590 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-20T22:10:46.637 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-05-20T22:10:46.639 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-05-20T22:10:46.639 DEBUG:teuthology.orchestra.run.smithi050:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=200b27799814c89893ec6700f852fc40163e03d5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2024-05-20T22:10:46.691 INFO:tasks.workunit.client.0.smithi050.stderr:+ parallel=1 2024-05-20T22:10:46.692 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' '' = --serial ']' 2024-05-20T22:10:46.692 INFO:tasks.workunit.client.0.smithi050.stderr:+ crimson=0 2024-05-20T22:10:46.692 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' '' = --crimson ']' 2024-05-20T22:10:46.692 INFO:tasks.workunit.client.0.smithi050.stderr:+ color= 2024-05-20T22:10:46.692 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -t 1 ']' 2024-05-20T22:10:46.692 INFO:tasks.workunit.client.0.smithi050.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-05-20T22:10:46.692 INFO:tasks.workunit.client.0.smithi050.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-05-20T22:10:46.692 INFO:tasks.workunit.client.0.smithi050.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-05-20T22:10:46.693 INFO:tasks.workunit.client.0.smithi050.stderr:+ declare -A pids 2024-05-20T22:10:46.693 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.693 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.693 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_aio 2024-05-20T22:10:46.693 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_aio' 2024-05-20T22:10:46.694 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.694 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_aio 2024-05-20T22:10:46.695 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_aio 2024-05-20T22:10:46.695 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=63931 2024-05-20T22:10:46.696 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_aio on pid 63931' 2024-05-20T22:10:46.696 INFO:tasks.workunit.client.0.smithi050.stdout:test api_aio on pid 63931 2024-05-20T22:10:46.697 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=63931 2024-05-20T22:10:46.697 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.698 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.698 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2024-05-20T22:10:46.698 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_aio_pp 2024-05-20T22:10:46.698 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_aio_pp' 2024-05-20T22:10:46.698 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.698 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.698 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.698 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.698 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.698 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_aio_pp 2024-05-20T22:10:46.698 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2024-05-20T22:10:46.698 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_aio.log 2024-05-20T22:10:46.699 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_aio: /' 2024-05-20T22:10:46.699 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_aio_pp 2024-05-20T22:10:46.699 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=63939 2024-05-20T22:10:46.699 INFO:tasks.workunit.client.0.smithi050.stdout:test api_aio_pp on pid 63939 2024-05-20T22:10:46.701 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_aio_pp on pid 63939' 2024-05-20T22:10:46.701 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=63939 2024-05-20T22:10:46.702 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.702 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.702 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2024-05-20T22:10:46.702 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_io 2024-05-20T22:10:46.702 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_io' 2024-05-20T22:10:46.702 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.702 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.702 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_io 2024-05-20T22:10:46.702 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.702 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.702 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.702 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2024-05-20T22:10:46.703 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_aio_pp.log 2024-05-20T22:10:46.703 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_aio_pp: /' 2024-05-20T22:10:46.703 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_io 2024-05-20T22:10:46.703 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=63947 2024-05-20T22:10:46.703 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_io on pid 63947' 2024-05-20T22:10:46.703 INFO:tasks.workunit.client.0.smithi050.stdout:test api_io on pid 63947 2024-05-20T22:10:46.705 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=63947 2024-05-20T22:10:46.705 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.705 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.705 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2024-05-20T22:10:46.705 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_io_pp 2024-05-20T22:10:46.705 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_io_pp' 2024-05-20T22:10:46.705 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_io_pp 2024-05-20T22:10:46.705 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.705 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.705 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.705 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.705 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.706 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2024-05-20T22:10:46.706 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_io.log 2024-05-20T22:10:46.706 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_io: /' 2024-05-20T22:10:46.706 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_io_pp 2024-05-20T22:10:46.706 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=63955 2024-05-20T22:10:46.706 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_io_pp on pid 63955' 2024-05-20T22:10:46.706 INFO:tasks.workunit.client.0.smithi050.stdout:test api_io_pp on pid 63955 2024-05-20T22:10:46.708 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=63955 2024-05-20T22:10:46.708 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.708 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.708 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2024-05-20T22:10:46.708 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_asio 2024-05-20T22:10:46.708 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_asio' 2024-05-20T22:10:46.708 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.708 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.708 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.708 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.709 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_asio 2024-05-20T22:10:46.709 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.709 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2024-05-20T22:10:46.709 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_io_pp: /' 2024-05-20T22:10:46.709 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_io_pp.log 2024-05-20T22:10:46.709 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_asio 2024-05-20T22:10:46.709 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=63963 2024-05-20T22:10:46.709 INFO:tasks.workunit.client.0.smithi050.stdout:test api_asio on pid 63963 2024-05-20T22:10:46.710 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_asio on pid 63963' 2024-05-20T22:10:46.711 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=63963 2024-05-20T22:10:46.711 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.711 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.711 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2024-05-20T22:10:46.711 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_list 2024-05-20T22:10:46.711 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_list' 2024-05-20T22:10:46.711 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_list 2024-05-20T22:10:46.711 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.711 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.711 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.711 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.711 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.711 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2024-05-20T22:10:46.712 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_asio.log 2024-05-20T22:10:46.712 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_asio: /' 2024-05-20T22:10:46.712 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_list 2024-05-20T22:10:46.712 INFO:tasks.workunit.client.0.smithi050.stdout:test api_list on pid 63971 2024-05-20T22:10:46.713 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=63971 2024-05-20T22:10:46.713 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_list on pid 63971' 2024-05-20T22:10:46.713 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=63971 2024-05-20T22:10:46.713 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.713 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2024-05-20T22:10:46.713 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.714 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_lock 2024-05-20T22:10:46.714 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_lock' 2024-05-20T22:10:46.714 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.714 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.714 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.714 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.714 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.714 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_lock 2024-05-20T22:10:46.715 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_list.log 2024-05-20T22:10:46.715 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_lock 2024-05-20T22:10:46.716 INFO:tasks.workunit.client.0.smithi050.stdout:test api_lock on pid 63979 2024-05-20T22:10:46.716 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=63979 2024-05-20T22:10:46.716 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_lock on pid 63979' 2024-05-20T22:10:46.716 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=63979 2024-05-20T22:10:46.716 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.716 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2024-05-20T22:10:46.716 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.717 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2024-05-20T22:10:46.717 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_lock_pp 2024-05-20T22:10:46.718 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_lock_pp' 2024-05-20T22:10:46.718 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.718 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.718 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.718 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.718 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_list: /' 2024-05-20T22:10:46.718 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2024-05-20T22:10:46.719 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_lock: /' 2024-05-20T22:10:46.721 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.734 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_lock.log 2024-05-20T22:10:46.735 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_lock_pp 2024-05-20T22:10:46.736 INFO:tasks.workunit.client.0.smithi050.stdout:test api_lock_pp on pid 63987 2024-05-20T22:10:46.737 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_lock_pp 2024-05-20T22:10:46.737 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=63987 2024-05-20T22:10:46.737 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_lock_pp on pid 63987' 2024-05-20T22:10:46.737 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=63987 2024-05-20T22:10:46.737 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.737 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.738 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_misc 2024-05-20T22:10:46.738 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_misc' 2024-05-20T22:10:46.738 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2024-05-20T22:10:46.739 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.739 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.739 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.739 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.740 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_lock_pp.log 2024-05-20T22:10:46.741 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_lock_pp: /' 2024-05-20T22:10:46.741 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.741 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2024-05-20T22:10:46.743 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_misc 2024-05-20T22:10:46.745 INFO:tasks.workunit.client.0.smithi050.stdout:test api_misc on pid 64030 2024-05-20T22:10:46.745 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_misc 2024-05-20T22:10:46.745 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64030 2024-05-20T22:10:46.745 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_misc on pid 64030' 2024-05-20T22:10:46.746 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64030 2024-05-20T22:10:46.746 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.746 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.746 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_misc_pp 2024-05-20T22:10:46.746 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_misc_pp' 2024-05-20T22:10:46.746 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_misc_pp 2024-05-20T22:10:46.747 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2024-05-20T22:10:46.749 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.749 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.749 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.749 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.749 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2024-05-20T22:10:46.750 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_misc: /' 2024-05-20T22:10:46.750 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.751 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_misc.log 2024-05-20T22:10:46.753 INFO:tasks.workunit.client.0.smithi050.stdout:test api_misc_pp on pid 64058 2024-05-20T22:10:46.753 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_misc_pp 2024-05-20T22:10:46.753 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64058 2024-05-20T22:10:46.753 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_misc_pp on pid 64058' 2024-05-20T22:10:46.753 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64058 2024-05-20T22:10:46.753 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.753 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.753 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2024-05-20T22:10:46.754 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.754 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.754 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.754 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.755 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2024-05-20T22:10:46.761 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_tier_pp 2024-05-20T22:10:46.761 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_tier_pp' 2024-05-20T22:10:46.767 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.769 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_misc_pp: /' 2024-05-20T22:10:46.769 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_misc_pp.log 2024-05-20T22:10:46.773 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_tier_pp 2024-05-20T22:10:46.774 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_tier_pp 2024-05-20T22:10:46.775 INFO:tasks.workunit.client.0.smithi050.stdout:test api_tier_pp on pid 64107 2024-05-20T22:10:46.776 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64107 2024-05-20T22:10:46.776 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_tier_pp on pid 64107' 2024-05-20T22:10:46.776 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_tier_pp.xml 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2024-05-20T22:10:46.776 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64107 2024-05-20T22:10:46.776 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.776 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.777 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_pool 2024-05-20T22:10:46.777 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.777 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.777 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_pool' 2024-05-20T22:10:46.777 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.777 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.777 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_tier_pp.xml 2024-05-20T22:10:46.777 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_tier_pp: /' 2024-05-20T22:10:46.778 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_pool 2024-05-20T22:10:46.778 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.782 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_pool 2024-05-20T22:10:46.783 INFO:tasks.workunit.client.0.smithi050.stdout:test api_pool on pid 64130 2024-05-20T22:10:46.784 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64130 2024-05-20T22:10:46.784 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_pool on pid 64130' 2024-05-20T22:10:46.784 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64130 2024-05-20T22:10:46.784 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.784 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.784 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2024-05-20T22:10:46.784 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_snapshots 2024-05-20T22:10:46.784 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_snapshots' 2024-05-20T22:10:46.784 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_snapshots 2024-05-20T22:10:46.784 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.785 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.785 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.785 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.785 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.786 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_pool: /' 2024-05-20T22:10:46.786 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_pool.log 2024-05-20T22:10:46.787 INFO:tasks.workunit.client.0.smithi050.stdout:test api_snapshots on pid 64141 2024-05-20T22:10:46.788 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_snapshots 2024-05-20T22:10:46.788 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64141 2024-05-20T22:10:46.788 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_snapshots on pid 64141' 2024-05-20T22:10:46.788 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64141 2024-05-20T22:10:46.788 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.788 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.788 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2024-05-20T22:10:46.788 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_snapshots_pp 2024-05-20T22:10:46.788 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_snapshots_pp' 2024-05-20T22:10:46.789 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_snapshots_pp 2024-05-20T22:10:46.789 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.789 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2024-05-20T22:10:46.789 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.789 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.789 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.790 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.790 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_snapshots: /' 2024-05-20T22:10:46.790 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_snapshots.log 2024-05-20T22:10:46.792 INFO:tasks.workunit.client.0.smithi050.stdout:test api_snapshots_pp on pid 64153 2024-05-20T22:10:46.792 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_snapshots_pp 2024-05-20T22:10:46.792 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64153 2024-05-20T22:10:46.792 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_snapshots_pp on pid 64153' 2024-05-20T22:10:46.792 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64153 2024-05-20T22:10:46.793 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.793 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.793 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2024-05-20T22:10:46.793 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_stat 2024-05-20T22:10:46.793 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_stat' 2024-05-20T22:10:46.795 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.795 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.795 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.795 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.795 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2024-05-20T22:10:46.795 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2024-05-20T22:10:46.796 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_tier_pp.log 2024-05-20T22:10:46.799 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2024-05-20T22:10:46.800 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_snapshots_pp: /' 2024-05-20T22:10:46.807 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_stat 2024-05-20T22:10:46.808 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.811 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_stat 2024-05-20T22:10:46.812 INFO:tasks.workunit.client.0.smithi050.stdout:test api_stat on pid 64177 2024-05-20T22:10:46.812 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64177 2024-05-20T22:10:46.812 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_stat on pid 64177' 2024-05-20T22:10:46.812 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64177 2024-05-20T22:10:46.812 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.812 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.812 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2024-05-20T22:10:46.813 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.813 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.813 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.813 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.814 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_stat.log 2024-05-20T22:10:46.815 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_stat: /' 2024-05-20T22:10:46.816 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2024-05-20T22:10:46.816 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_stat_pp 2024-05-20T22:10:46.817 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_stat_pp' 2024-05-20T22:10:46.818 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_stat_pp 2024-05-20T22:10:46.818 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.822 INFO:tasks.workunit.client.0.smithi050.stdout:test api_stat_pp on pid 64198 2024-05-20T22:10:46.822 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_stat_pp 2024-05-20T22:10:46.822 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64198 2024-05-20T22:10:46.823 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_stat_pp on pid 64198' 2024-05-20T22:10:46.823 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64198 2024-05-20T22:10:46.823 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.823 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.823 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2024-05-20T22:10:46.823 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.823 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.823 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.823 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.823 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_stat_pp: /' 2024-05-20T22:10:46.824 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_stat_pp.log 2024-05-20T22:10:46.824 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2024-05-20T22:10:46.825 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_watch_notify 2024-05-20T22:10:46.826 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_watch_notify' 2024-05-20T22:10:46.826 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_watch_notify 2024-05-20T22:10:46.827 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.829 INFO:tasks.workunit.client.0.smithi050.stdout:test api_watch_notify on pid 64225 2024-05-20T22:10:46.830 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_watch_notify 2024-05-20T22:10:46.830 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64225 2024-05-20T22:10:46.830 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_watch_notify on pid 64225' 2024-05-20T22:10:46.830 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64225 2024-05-20T22:10:46.830 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.830 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.830 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2024-05-20T22:10:46.834 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.835 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.835 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.835 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.835 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2024-05-20T22:10:46.837 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_watch_notify_pp 2024-05-20T22:10:46.837 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_watch_notify_pp' 2024-05-20T22:10:46.838 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.840 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_watch_notify_pp 2024-05-20T22:10:46.842 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_watch_notify_pp 2024-05-20T22:10:46.843 INFO:tasks.workunit.client.0.smithi050.stdout:test api_watch_notify_pp on pid 64258 2024-05-20T22:10:46.843 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64258 2024-05-20T22:10:46.843 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_watch_notify_pp on pid 64258' 2024-05-20T22:10:46.843 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_watch_notify: /' 2024-05-20T22:10:46.843 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64258 2024-05-20T22:10:46.843 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_watch_notify.log 2024-05-20T22:10:46.844 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.844 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.844 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2024-05-20T22:10:46.848 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_cmd 2024-05-20T22:10:46.849 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_cmd' 2024-05-20T22:10:46.849 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.850 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.850 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.850 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.853 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_cmd 2024-05-20T22:10:46.853 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.857 INFO:tasks.workunit.client.0.smithi050.stdout:test api_cmd on pid 64292 2024-05-20T22:10:46.858 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_cmd 2024-05-20T22:10:46.858 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64292 2024-05-20T22:10:46.858 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_cmd on pid 64292' 2024-05-20T22:10:46.858 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64292 2024-05-20T22:10:46.858 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.858 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.858 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2024-05-20T22:10:46.858 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2024-05-20T22:10:46.858 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2024-05-20T22:10:46.858 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2024-05-20T22:10:46.859 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_cmd_pp 2024-05-20T22:10:46.859 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_cmd_pp' 2024-05-20T22:10:46.860 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.860 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.860 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.861 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.861 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_cmd: /' 2024-05-20T22:10:46.861 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_cmd.log 2024-05-20T22:10:46.862 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_cmd_pp 2024-05-20T22:10:46.862 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2024-05-20T22:10:46.863 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.868 INFO:tasks.workunit.client.0.smithi050.stdout:test api_cmd_pp on pid 64321 2024-05-20T22:10:46.869 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_cmd_pp 2024-05-20T22:10:46.869 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64321 2024-05-20T22:10:46.869 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_cmd_pp on pid 64321' 2024-05-20T22:10:46.869 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64321 2024-05-20T22:10:46.869 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.869 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.869 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2024-05-20T22:10:46.870 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.870 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.871 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.871 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.871 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2024-05-20T22:10:46.871 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2024-05-20T22:10:46.871 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_cmd_pp: /' 2024-05-20T22:10:46.872 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_service 2024-05-20T22:10:46.873 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_service' 2024-05-20T22:10:46.877 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_service 2024-05-20T22:10:46.877 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.879 INFO:tasks.workunit.client.0.smithi050.stdout:test api_service on pid 64344 2024-05-20T22:10:46.880 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_service 2024-05-20T22:10:46.880 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64344 2024-05-20T22:10:46.880 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_service on pid 64344' 2024-05-20T22:10:46.880 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64344 2024-05-20T22:10:46.880 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.880 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.880 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2024-05-20T22:10:46.881 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.881 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.881 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.881 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.882 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_service.log 2024-05-20T22:10:46.882 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_service: /' 2024-05-20T22:10:46.884 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2024-05-20T22:10:46.884 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_service_pp 2024-05-20T22:10:46.885 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_service_pp' 2024-05-20T22:10:46.886 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.886 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_service_pp 2024-05-20T22:10:46.888 INFO:tasks.workunit.client.0.smithi050.stdout:test api_service_pp on pid 64359 2024-05-20T22:10:46.889 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_service_pp 2024-05-20T22:10:46.889 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64359 2024-05-20T22:10:46.889 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_service_pp on pid 64359' 2024-05-20T22:10:46.889 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64359 2024-05-20T22:10:46.889 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.889 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.891 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_c_write_operations 2024-05-20T22:10:46.891 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_c_write_operations' 2024-05-20T22:10:46.892 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_c_write_operations 2024-05-20T22:10:46.892 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.892 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2024-05-20T22:10:46.894 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.894 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.894 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.894 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.895 INFO:tasks.workunit.client.0.smithi050.stdout:test api_c_write_operations on pid 64372 2024-05-20T22:10:46.895 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_c_write_operations 2024-05-20T22:10:46.895 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_service_pp.log 2024-05-20T22:10:46.895 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64372 2024-05-20T22:10:46.895 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2024-05-20T22:10:46.895 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_c_write_operations on pid 64372' 2024-05-20T22:10:46.895 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64372 2024-05-20T22:10:46.895 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.896 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.896 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_c_read_operations 2024-05-20T22:10:46.896 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_c_read_operations' 2024-05-20T22:10:46.896 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_c_read_operations 2024-05-20T22:10:46.896 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.897 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_service_pp: /' 2024-05-20T22:10:46.899 INFO:tasks.workunit.client.0.smithi050.stdout:test api_c_read_operations on pid 64377 2024-05-20T22:10:46.899 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_c_read_operations 2024-05-20T22:10:46.899 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2024-05-20T22:10:46.899 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64377 2024-05-20T22:10:46.899 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_c_read_operations on pid 64377' 2024-05-20T22:10:46.900 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64377 2024-05-20T22:10:46.900 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.900 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.900 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_cls_remote_reads 2024-05-20T22:10:46.900 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_cls_remote_reads' 2024-05-20T22:10:46.901 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_cls_remote_reads 2024-05-20T22:10:46.901 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.901 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.901 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.901 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.901 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.902 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2024-05-20T22:10:46.902 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2024-05-20T22:10:46.902 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_cls_remote_reads 2024-05-20T22:10:46.902 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64389 2024-05-20T22:10:46.903 INFO:tasks.workunit.client.0.smithi050.stdout:test api_cls_remote_reads on pid 64389 2024-05-20T22:10:46.904 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_cls_remote_reads on pid 64389' 2024-05-20T22:10:46.904 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64389 2024-05-20T22:10:46.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.905 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s list_parallel 2024-05-20T22:10:46.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' list_parallel' 2024-05-20T22:10:46.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_c_write_operations: /' 2024-05-20T22:10:46.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2024-05-20T22:10:46.905 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2024-05-20T22:10:46.906 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo list_parallel 2024-05-20T22:10:46.907 INFO:tasks.workunit.client.0.smithi050.stdout:test list_parallel on pid 64409 2024-05-20T22:10:46.907 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=list_parallel 2024-05-20T22:10:46.907 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cls_remote_reads.xml 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2024-05-20T22:10:46.907 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64409 2024-05-20T22:10:46.907 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test list_parallel on pid 64409' 2024-05-20T22:10:46.908 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64409 2024-05-20T22:10:46.908 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.908 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.908 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2024-05-20T22:10:46.908 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s open_pools_parallel 2024-05-20T22:10:46.908 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' open_pools_parallel' 2024-05-20T22:10:46.908 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.909 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.909 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.909 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.909 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2024-05-20T22:10:46.910 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_c_read_operations: /' 2024-05-20T22:10:46.913 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo open_pools_parallel 2024-05-20T22:10:46.913 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.914 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.914 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.914 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.914 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.916 INFO:tasks.workunit.client.0.smithi050.stdout:test open_pools_parallel on pid 64436 2024-05-20T22:10:46.916 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=open_pools_parallel 2024-05-20T22:10:46.916 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64436 2024-05-20T22:10:46.917 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test open_pools_parallel on pid 64436' 2024-05-20T22:10:46.917 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64436 2024-05-20T22:10:46.917 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-20T22:10:46.917 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.917 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2024-05-20T22:10:46.918 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2024-05-20T22:10:46.918 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ list_parallel: /' 2024-05-20T22:10:46.920 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cls_remote_reads.xml 2024-05-20T22:10:46.921 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_list_parallel.log 2024-05-20T22:10:46.924 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2024-05-20T22:10:46.929 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s delete_pools_parallel 2024-05-20T22:10:46.929 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2024-05-20T22:10:46.929 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' delete_pools_parallel' 2024-05-20T22:10:46.938 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.942 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.942 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.943 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.943 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.943 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2024-05-20T22:10:46.949 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ open_pools_parallel: /' 2024-05-20T22:10:46.951 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2024-05-20T22:10:46.958 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo delete_pools_parallel 2024-05-20T22:10:46.959 INFO:tasks.workunit.client.0.smithi050.stdout:test delete_pools_parallel on pid 64501 2024-05-20T22:10:46.959 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=delete_pools_parallel 2024-05-20T22:10:46.959 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64501 2024-05-20T22:10:46.960 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test delete_pools_parallel on pid 64501' 2024-05-20T22:10:46.960 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64501 2024-05-20T22:10:46.960 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-20T22:10:46.960 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.960 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s cls 2024-05-20T22:10:46.960 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' cls' 2024-05-20T22:10:46.962 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.966 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo cls 2024-05-20T22:10:46.966 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2024-05-20T22:10:46.967 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.967 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.970 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.970 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.970 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2024-05-20T22:10:46.970 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2024-05-20T22:10:46.974 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ delete_pools_parallel: /' 2024-05-20T22:10:46.975 INFO:tasks.workunit.client.0.smithi050.stdout:test cls on pid 64550 2024-05-20T22:10:46.975 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=cls 2024-05-20T22:10:46.975 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64550 2024-05-20T22:10:46.975 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test cls on pid 64550' 2024-05-20T22:10:46.975 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64550 2024-05-20T22:10:46.975 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-20T22:10:46.975 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.976 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s cmd 2024-05-20T22:10:46.976 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' cmd' 2024-05-20T22:10:46.978 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo cmd 2024-05-20T22:10:46.980 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.984 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2024-05-20T22:10:46.986 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=cmd 2024-05-20T22:10:46.986 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64590 2024-05-20T22:10:46.986 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test cmd on pid 64590' 2024-05-20T22:10:46.986 INFO:tasks.workunit.client.0.smithi050.stdout:test cmd on pid 64590 2024-05-20T22:10:46.987 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64590 2024-05-20T22:10:46.987 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-20T22:10:46.987 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:46.987 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2024-05-20T22:10:46.987 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s handler_error 2024-05-20T22:10:46.988 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' handler_error' 2024-05-20T22:10:46.988 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.988 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.988 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.988 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.989 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_neorados_cls 2024-05-20T22:10:46.989 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:46.989 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:46.989 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.989 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:46.989 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:46.990 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_neorados_cmd.log 2024-05-20T22:10:46.992 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ cmd: /' 2024-05-20T22:10:46.996 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_neorados_cmd 2024-05-20T22:10:46.997 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ cls: /' 2024-05-20T22:10:46.997 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_neorados_cls.log 2024-05-20T22:10:47.004 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo handler_error 2024-05-20T22:10:47.005 INFO:tasks.workunit.client.0.smithi050.stdout:test handler_error on pid 64630 2024-05-20T22:10:47.005 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=handler_error 2024-05-20T22:10:47.005 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64630 2024-05-20T22:10:47.005 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test handler_error on pid 64630' 2024-05-20T22:10:47.005 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64630 2024-05-20T22:10:47.005 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-20T22:10:47.006 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:47.017 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2024-05-20T22:10:47.017 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s io 2024-05-20T22:10:47.018 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' io' 2024-05-20T22:10:47.019 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:47.021 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:47.021 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.021 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:47.021 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.022 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo io 2024-05-20T22:10:47.023 INFO:tasks.workunit.client.0.smithi050.stdout:test io on pid 64662 2024-05-20T22:10:47.024 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=io 2024-05-20T22:10:47.024 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64662 2024-05-20T22:10:47.024 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test io on pid 64662' 2024-05-20T22:10:47.024 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64662 2024-05-20T22:10:47.025 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-20T22:10:47.025 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:47.025 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s ec_io 2024-05-20T22:10:47.025 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' ec_io' 2024-05-20T22:10:47.026 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_neorados_handler_error 2024-05-20T22:10:47.028 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2024-05-20T22:10:47.028 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:47.030 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:47.030 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ handler_error: /' 2024-05-20T22:10:47.030 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.031 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:47.032 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.032 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_neorados_handler_error.log 2024-05-20T22:10:47.033 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo ec_io 2024-05-20T22:10:47.034 INFO:tasks.workunit.client.0.smithi050.stdout:test ec_io on pid 64716 2024-05-20T22:10:47.035 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=ec_io 2024-05-20T22:10:47.035 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_neorados_io 2024-05-20T22:10:47.035 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64716 2024-05-20T22:10:47.035 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test ec_io on pid 64716' 2024-05-20T22:10:47.036 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64716 2024-05-20T22:10:47.036 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-20T22:10:47.036 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:47.036 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2024-05-20T22:10:47.036 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ io: /' 2024-05-20T22:10:47.038 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:47.038 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.038 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:47.038 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.038 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_neorados_io.log 2024-05-20T22:10:47.038 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_neorados_ec_io 2024-05-20T22:10:47.038 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_neorados_ec_io.log 2024-05-20T22:10:47.045 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s list 2024-05-20T22:10:47.045 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' list' 2024-05-20T22:10:47.045 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ ec_io: /' 2024-05-20T22:10:47.054 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo list 2024-05-20T22:10:47.054 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:47.057 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=list 2024-05-20T22:10:47.057 INFO:tasks.workunit.client.0.smithi050.stdout:test list on pid 64766 2024-05-20T22:10:47.057 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64766 2024-05-20T22:10:47.057 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test list on pid 64766' 2024-05-20T22:10:47.057 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64766 2024-05-20T22:10:47.058 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-20T22:10:47.058 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:47.058 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2024-05-20T22:10:47.058 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s ec_list 2024-05-20T22:10:47.059 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' ec_list' 2024-05-20T22:10:47.059 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:47.059 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.060 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:47.060 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.060 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_neorados_list 2024-05-20T22:10:47.060 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:47.060 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_neorados_list.log 2024-05-20T22:10:47.063 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo ec_list 2024-05-20T22:10:47.065 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ list: /' 2024-05-20T22:10:47.068 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=ec_list 2024-05-20T22:10:47.069 INFO:tasks.workunit.client.0.smithi050.stdout:test ec_list on pid 64811 2024-05-20T22:10:47.069 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64811 2024-05-20T22:10:47.069 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test ec_list on pid 64811' 2024-05-20T22:10:47.070 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64811 2024-05-20T22:10:47.070 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-20T22:10:47.070 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2024-05-20T22:10:47.070 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:47.070 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s misc 2024-05-20T22:10:47.070 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' misc' 2024-05-20T22:10:47.070 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:47.071 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo misc 2024-05-20T22:10:47.073 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:47.073 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.073 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:47.073 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.073 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_neorados_ec_list 2024-05-20T22:10:47.073 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_neorados_ec_list.log 2024-05-20T22:10:47.073 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ ec_list: /' 2024-05-20T22:10:47.074 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=misc 2024-05-20T22:10:47.074 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64827 2024-05-20T22:10:47.074 INFO:tasks.workunit.client.0.smithi050.stdout:test misc on pid 64827 2024-05-20T22:10:47.075 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test misc on pid 64827' 2024-05-20T22:10:47.075 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64827 2024-05-20T22:10:47.075 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-20T22:10:47.075 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:47.075 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2024-05-20T22:10:47.075 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s pool 2024-05-20T22:10:47.076 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' pool' 2024-05-20T22:10:47.076 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo pool 2024-05-20T22:10:47.077 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:47.077 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.077 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:47.077 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.077 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_neorados_misc 2024-05-20T22:10:47.077 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:47.077 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_neorados_misc.log 2024-05-20T22:10:47.078 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ misc: /' 2024-05-20T22:10:47.081 INFO:tasks.workunit.client.0.smithi050.stdout:test pool on pid 64842 2024-05-20T22:10:47.082 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=pool 2024-05-20T22:10:47.082 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64842 2024-05-20T22:10:47.082 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test pool on pid 64842' 2024-05-20T22:10:47.083 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64842 2024-05-20T22:10:47.083 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-20T22:10:47.083 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:47.083 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2024-05-20T22:10:47.083 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s read_operations 2024-05-20T22:10:47.083 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' read_operations' 2024-05-20T22:10:47.084 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo read_operations 2024-05-20T22:10:47.084 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:47.085 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:47.085 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.085 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:47.085 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.085 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_neorados_pool 2024-05-20T22:10:47.086 INFO:tasks.workunit.client.0.smithi050.stdout:test read_operations on pid 64850 2024-05-20T22:10:47.087 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=read_operations 2024-05-20T22:10:47.087 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64850 2024-05-20T22:10:47.087 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test read_operations on pid 64850' 2024-05-20T22:10:47.087 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64850 2024-05-20T22:10:47.088 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-20T22:10:47.088 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:47.088 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2024-05-20T22:10:47.088 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s snapshots 2024-05-20T22:10:47.088 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_neorados_pool.log 2024-05-20T22:10:47.088 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' snapshots' 2024-05-20T22:10:47.088 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo snapshots 2024-05-20T22:10:47.088 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:47.088 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:47.088 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.088 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:47.088 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.088 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_neorados_read_operations 2024-05-20T22:10:47.089 INFO:tasks.workunit.client.0.smithi050.stdout:test snapshots on pid 64858 2024-05-20T22:10:47.090 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=snapshots 2024-05-20T22:10:47.090 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64858 2024-05-20T22:10:47.090 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test snapshots on pid 64858' 2024-05-20T22:10:47.090 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64858 2024-05-20T22:10:47.091 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-20T22:10:47.091 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:47.091 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2024-05-20T22:10:47.091 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ read_operations: /' 2024-05-20T22:10:47.091 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s watch_notify 2024-05-20T22:10:47.091 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' watch_notify' 2024-05-20T22:10:47.091 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:47.091 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.091 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:47.091 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.091 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_neorados_snapshots 2024-05-20T22:10:47.092 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_neorados_snapshots.log 2024-05-20T22:10:47.092 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_neorados_read_operations.log 2024-05-20T22:10:47.097 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ pool: /' 2024-05-20T22:10:47.097 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ snapshots: /' 2024-05-20T22:10:47.098 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo watch_notify 2024-05-20T22:10:47.098 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:47.105 INFO:tasks.workunit.client.0.smithi050.stdout:test watch_notify on pid 64891 2024-05-20T22:10:47.105 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=watch_notify 2024-05-20T22:10:47.105 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64891 2024-05-20T22:10:47.105 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test watch_notify on pid 64891' 2024-05-20T22:10:47.106 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2024-05-20T22:10:47.106 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64891 2024-05-20T22:10:47.106 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-20T22:10:47.106 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:47.106 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s write_operations 2024-05-20T22:10:47.106 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' write_operations' 2024-05-20T22:10:47.106 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:47.106 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.106 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:47.106 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.107 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2024-05-20T22:10:47.107 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_neorados_watch_notify.log 2024-05-20T22:10:47.107 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo write_operations 2024-05-20T22:10:47.107 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_neorados_watch_notify 2024-05-20T22:10:47.108 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=write_operations 2024-05-20T22:10:47.109 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64911 2024-05-20T22:10:47.109 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test write_operations on pid 64911' 2024-05-20T22:10:47.109 INFO:tasks.workunit.client.0.smithi050.stdout:test write_operations on pid 64911 2024-05-20T22:10:47.110 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=64911 2024-05-20T22:10:47.110 INFO:tasks.workunit.client.0.smithi050.stderr:+ ret=0 2024-05-20T22:10:47.110 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2024-05-20T22:10:47.110 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2024-05-20T22:10:47.110 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:10:47.110 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64107 2024-05-20T22:10:47.111 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64107 2024-05-20T22:10:47.111 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ watch_notify: /' 2024-05-20T22:10:47.111 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z '' ']' 2024-05-20T22:10:47.111 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.111 INFO:tasks.workunit.client.0.smithi050.stderr:+ case $- in 2024-05-20T22:10:47.111 INFO:tasks.workunit.client.0.smithi050.stderr:+ return 2024-05-20T22:10:47.111 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_neorados_write_operations 2024-05-20T22:10:47.111 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_neorados_write_operations.log 2024-05-20T22:10:47.114 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ write_operations: /' 2024-05-20T22:10:47.890 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:10:47 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:10:47.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:47 smithi145 bash[23893]: cluster 2024-05-20T22:10:45.930811+0000 mgr.y (mgr.14592) 165 : cluster 0 pgmap v111: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:47.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:47 smithi145 bash[23893]: audit 2024-05-20T22:10:46.922796+0000 mon.c (mon.2) 23 : audit 1 from='client.? v1:172.21.15.50:0/1506626568' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:10:47.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:47 smithi145 bash[23893]: audit 2024-05-20T22:10:46.964972+0000 mon.b (mon.1) 30 : audit 0 from='client.? v1:172.21.15.50:0/3015015183' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-05-20T22:10:47.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:47 smithi145 bash[23893]: audit 2024-05-20T22:10:47.089828+0000 mon.b (mon.1) 31 : audit 1 from='client.? v1:172.21.15.50:0/294761569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi050-64724-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:10:47.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:47 smithi145 bash[23893]: audit 2024-05-20T22:10:47.120690+0000 mon.c (mon.2) 24 : audit 1 from='client.? v1:172.21.15.50:0/1346369038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi050-64823-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:10:47.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:47 smithi050 bash[21866]: cluster 2024-05-20T22:10:45.930811+0000 mgr.y (mgr.14592) 165 : cluster 0 pgmap v111: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:47.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:47 smithi050 bash[21866]: audit 2024-05-20T22:10:46.922796+0000 mon.c (mon.2) 23 : audit 1 from='client.? v1:172.21.15.50:0/1506626568' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:10:47.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:47 smithi050 bash[21866]: audit 2024-05-20T22:10:46.964972+0000 mon.b (mon.1) 30 : audit 0 from='client.? v1:172.21.15.50:0/3015015183' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-05-20T22:10:47.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:47 smithi050 bash[21866]: audit 2024-05-20T22:10:47.089828+0000 mon.b (mon.1) 31 : audit 1 from='client.? v1:172.21.15.50:0/294761569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi050-64724-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:10:47.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:47 smithi050 bash[21866]: audit 2024-05-20T22:10:47.120690+0000 mon.c (mon.2) 24 : audit 1 from='client.? v1:172.21.15.50:0/1346369038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi050-64823-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:10:47.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:47 smithi050 bash[28929]: cluster 2024-05-20T22:10:45.930811+0000 mgr.y (mgr.14592) 165 : cluster 0 pgmap v111: 132 pgs: 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:10:47.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:47 smithi050 bash[28929]: audit 2024-05-20T22:10:46.922796+0000 mon.c (mon.2) 23 : audit 1 from='client.? v1:172.21.15.50:0/1506626568' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:10:47.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:47 smithi050 bash[28929]: audit 2024-05-20T22:10:46.964972+0000 mon.b (mon.1) 30 : audit 0 from='client.? v1:172.21.15.50:0/3015015183' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-05-20T22:10:47.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:47 smithi050 bash[28929]: audit 2024-05-20T22:10:47.089828+0000 mon.b (mon.1) 31 : audit 1 from='client.? v1:172.21.15.50:0/294761569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi050-64724-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:10:47.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:47 smithi050 bash[28929]: audit 2024-05-20T22:10:47.120690+0000 mon.c (mon.2) 24 : audit 1 from='client.? v1:172.21.15.50:0/1346369038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi050-64823-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:10:49.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:10:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:10:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:10:52.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:52 smithi145 bash[23893]: audit 2024-05-20T22:10:47.623973+0000 mgr.y (mgr.14592) 166 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:10:52.442 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:52 smithi050 bash[21866]: audit 2024-05-20T22:10:47.623973+0000 mgr.y (mgr.14592) 166 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:10:52.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:52 smithi050 bash[28929]: audit 2024-05-20T22:10:47.623973+0000 mgr.y (mgr.14592) 166 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:10:57.890 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:10:57 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:10:57.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:57 smithi145 bash[23893]: audit 2024-05-20T22:10:47.718008+0000 mon.c (mon.2) 25 : audit 1 from='client.? v1:172.21.15.50:0/2777362406' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi050-63936-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:10:57.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:57 smithi145 bash[23893]: audit 2024-05-20T22:10:47.719403+0000 mon.c (mon.2) 26 : audit 1 from='client.? v1:172.21.15.50:0/3301368275' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi050-63952-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:10:57.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:57 smithi145 bash[23893]: cluster 2024-05-20T22:10:47.931582+0000 mgr.y (mgr.14592) 167 : cluster 0 pgmap v113: 196 pgs: 64 unknown, 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:10:57.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:57 smithi145 bash[23893]: cluster 2024-05-20T22:10:49.933196+0000 mgr.y (mgr.14592) 168 : cluster 0 pgmap v114: 196 pgs: 33 creating+peering, 31 unknown, 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:10:57.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:57 smithi145 bash[23893]: cluster 2024-05-20T22:10:51.663325+0000 mon.a (mon.0) 933 : cluster 0 osdmap e75: 8 total, 8 up, 8 in 2024-05-20T22:10:57.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:57 smithi145 bash[23893]: audit 2024-05-20T22:10:52.143967+0000 mon.a (mon.0) 934 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:10:57.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:10:57 smithi145 bash[23893]: audit 2024-05-20T22:10:52.144692+0000 mon.a (mon.0) 935 : audit 1 from='client.24922 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi050-64724-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:10:57.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:57 smithi050 bash[21866]: audit 2024-05-20T22:10:47.718008+0000 mon.c (mon.2) 25 : audit 1 from='client.? v1:172.21.15.50:0/2777362406' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi050-63936-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:10:57.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:57 smithi050 bash[21866]: audit 2024-05-20T22:10:47.719403+0000 mon.c (mon.2) 26 : audit 1 from='client.? v1:172.21.15.50:0/3301368275' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi050-63952-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:10:57.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:57 smithi050 bash[21866]: cluster 2024-05-20T22:10:47.931582+0000 mgr.y (mgr.14592) 167 : cluster 0 pgmap v113: 196 pgs: 64 unknown, 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:10:57.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:57 smithi050 bash[21866]: cluster 2024-05-20T22:10:49.933196+0000 mgr.y (mgr.14592) 168 : cluster 0 pgmap v114: 196 pgs: 33 creating+peering, 31 unknown, 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:10:57.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:57 smithi050 bash[21866]: cluster 2024-05-20T22:10:51.663325+0000 mon.a (mon.0) 933 : cluster 0 osdmap e75: 8 total, 8 up, 8 in 2024-05-20T22:10:57.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:57 smithi050 bash[21866]: audit 2024-05-20T22:10:52.143967+0000 mon.a (mon.0) 934 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:10:57.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:10:57 smithi050 bash[21866]: audit 2024-05-20T22:10:52.144692+0000 mon.a (mon.0) 935 : audit 1 from='client.24922 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi050-64724-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:10:57.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:57 smithi050 bash[28929]: audit 2024-05-20T22:10:47.718008+0000 mon.c (mon.2) 25 : audit 1 from='client.? v1:172.21.15.50:0/2777362406' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi050-63936-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:10:57.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:57 smithi050 bash[28929]: audit 2024-05-20T22:10:47.719403+0000 mon.c (mon.2) 26 : audit 1 from='client.? v1:172.21.15.50:0/3301368275' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi050-63952-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:10:57.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:57 smithi050 bash[28929]: cluster 2024-05-20T22:10:47.931582+0000 mgr.y (mgr.14592) 167 : cluster 0 pgmap v113: 196 pgs: 64 unknown, 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:10:57.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:57 smithi050 bash[28929]: cluster 2024-05-20T22:10:49.933196+0000 mgr.y (mgr.14592) 168 : cluster 0 pgmap v114: 196 pgs: 33 creating+peering, 31 unknown, 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:10:57.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:57 smithi050 bash[28929]: cluster 2024-05-20T22:10:51.663325+0000 mon.a (mon.0) 933 : cluster 0 osdmap e75: 8 total, 8 up, 8 in 2024-05-20T22:10:57.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:57 smithi050 bash[28929]: audit 2024-05-20T22:10:52.143967+0000 mon.a (mon.0) 934 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:10:57.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:10:57 smithi050 bash[28929]: audit 2024-05-20T22:10:52.144692+0000 mon.a (mon.0) 935 : audit 1 from='client.24922 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi050-64724-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:10:58.326 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2024-05-20T22:10:58.326 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [----------] Global test environment set-up. 2024-05-20T22:10:58.326 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [----------] 4 tests from LibRadosService 2024-05-20T22:10:58.326 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2024-05-20T22:10:58.326 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5065 ms) 2024-05-20T22:10:58.326 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2024-05-20T22:10:58.326 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ OK ] LibRadosService.RegisterLate (30 ms) 2024-05-20T22:10:58.326 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2024-05-20T22:10:58.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: cluster: 2024-05-20T22:10:58.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: id: 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T22:10:58.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: health: HEALTH_OK 2024-05-20T22:10:58.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:10:58.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: services: 2024-05-20T22:10:58.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-05-20T22:10:58.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-05-20T22:10:58.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-05-20T22:10:58.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-05-20T22:10:58.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:10:58.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: data: 2024-05-20T22:10:58.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pools: 6 pools, 132 pgs 2024-05-20T22:10:58.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: objects: 198 objects, 583 KiB 2024-05-20T22:10:58.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: usage: 235 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:10:58.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pgs: 132 active+clean 2024-05-20T22:10:58.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:10:58.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: io: 2024-05-20T22:10:58.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-05-20T22:10:58.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:10:58.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:10:58.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: cluster: 2024-05-20T22:10:58.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: id: 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T22:10:58.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: health: HEALTH_OK 2024-05-20T22:10:58.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:10:58.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: services: 2024-05-20T22:10:58.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-05-20T22:10:58.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-05-20T22:10:58.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-05-20T22:10:58.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-05-20T22:10:58.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:10:58.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: data: 2024-05-20T22:10:58.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pools: 6 pools, 132 pgs 2024-05-20T22:10:58.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: objects: 198 objects, 583 KiB 2024-05-20T22:10:58.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: usage: 235 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:10:58.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pgs: 132 active+clean 2024-05-20T22:10:58.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:10:58.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: io: 2024-05-20T22:10:58.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-05-20T22:10:58.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:10:58.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:10:58.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: cluster: 2024-05-20T22:10:58.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: id: 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T22:10:58.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: health: HEALTH_OK 2024-05-20T22:10:58.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:10:58.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: services: 2024-05-20T22:10:58.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-05-20T22:10:58.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-05-20T22:10:58.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-05-20T22:10:58.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-05-20T22:10:58.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:10:58.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: data: 2024-05-20T22:10:58.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pools: 6 pools, 132 pgs 2024-05-20T22:10:58.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: objects: 198 objects, 583 KiB 2024-05-20T22:10:58.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: usage: 235 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:10:58.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pgs: 132 active+clean 2024-05-20T22:10:58.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:10:58.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: io: 2024-05-20T22:10:58.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-05-20T22:10:58.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:10:58.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:10:58.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: cluster: 2024-05-20T22:10:58.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: id: 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T22:10:58.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: health: HEALTH_WARN 2024-05-20T22:10:58.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2 pool(s) do not have an application enabled 2024-05-20T22:10:58.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:10:58.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: services: 2024-05-20T22:10:58.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-05-20T22:10:59.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:10:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:10:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:11:03.162 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mgr api_asio: [==========] Running 12 tests from 1 test suite. 2024-05-20T22:11:03.162 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [----------] Global test environment set-up. 2024-05-20T22:11:03.162 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [----------] 12 tests from AsioRados 2024-05-20T22:11:03.162 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2024-05-20T22:11:03.162 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (1 ms) 2024-05-20T22:11:03.162 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2024-05-20T22:11:03.162 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (0 ms) 2024-05-20T22:11:03.162 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2024-05-20T22:11:03.162 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (2 ms) 2024-05-20T22:11:03.162 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2024-05-20T22:11:03.163 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (4 ms) 2024-05-20T22:11:03.163 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2024-05-20T22:11:03.163 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (2 ms) 2024-05-20T22:11:03.163 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2024-05-20T22:11:03.163 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (1 ms) 2024-05-20T22:11:03.163 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2024-05-20T22:11:03.163 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (0 ms) 2024-05-20T22:11:03.163 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2024-05-20T22:11:03.163 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (1 ms) 2024-05-20T22:11:03.163 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2024-05-20T22:11:03.163 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (0 ms) 2024-05-20T22:11:03.163 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2024-05-20T22:11:03.163 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (2 ms) 2024-05-20T22:11:03.163 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2024-05-20T22:11:03.163 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (1 ms) 2024-05-20T22:11:03.164 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2024-05-20T22:11:03.164 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (1 ms) 2024-05-20T22:11:03.164 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [----------] 12 tests from AsioRados (15 ms total) 2024-05-20T22:11:03.164 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2024-05-20T22:11:03.164 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [----------] Global test environment tear-down 2024-05-20T22:11:03.164 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (16410 ms total) 2024-05-20T22:11:03.164 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ PASSED ] 12 tests. 2024-05-20T22:11:03.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: cluster 2024-05-20T22:10:51.933988+0000 mgr.y (mgr.14592) 169 : cluster 0 pgmap v115: 196 pgs: 33 creating+peering, 31 unknown, 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:11:03.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:52.152462+0000 mon.c (mon.2) 27 : audit 1 from='client.? v1:172.21.15.50:0/110868113' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi050-64001-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:52.153890+0000 mon.c (mon.2) 28 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:52.155340+0000 mon.c (mon.2) 29 : audit 1 from='client.? v1:172.21.15.50:0/1742718049' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi050-63982-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:52.156813+0000 mon.c (mon.2) 30 : audit 1 from='client.? v1:172.21.15.50:0/1112947882' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi050-63960-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:52.161665+0000 mon.b (mon.1) 32 : audit 1 from='client.? v1:172.21.15.50:0/1851238567' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi050-64146-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:52.163020+0000 mon.b (mon.1) 33 : audit 1 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi050-63976-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:52.164481+0000 mon.b (mon.1) 34 : audit 1 from='client.? v1:172.21.15.50:0/994459237' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi050-63944-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:52.165491+0000 mon.b (mon.1) 35 : audit 1 from='client.? v1:172.21.15.50:0/759541608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:52.231485+0000 mon.c (mon.2) 31 : audit 0 from='client.? v1:172.21.15.50:0/1074123380' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:03.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: cluster 2024-05-20T22:10:53.935241+0000 mgr.y (mgr.14592) 170 : cluster 0 pgmap v117: 516 pgs: 33 creating+peering, 351 unknown, 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:11:03.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:54.268721+0000 mon.c (mon.2) 32 : audit 0 from='client.? v1:172.21.15.50:0/3739275273' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:03.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: cluster 2024-05-20T22:10:55.938409+0000 mgr.y (mgr.14592) 171 : cluster 0 pgmap v118: 516 pgs: 256 creating+peering, 128 unknown, 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:11:03.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:56.303091+0000 mon.c (mon.2) 33 : audit 0 from='client.? v1:172.21.15.50:0/3714032013' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:03.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: cluster 2024-05-20T22:10:51.933988+0000 mgr.y (mgr.14592) 169 : cluster 0 pgmap v115: 196 pgs: 33 creating+peering, 31 unknown, 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:11:03.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:52.152462+0000 mon.c (mon.2) 27 : audit 1 from='client.? v1:172.21.15.50:0/110868113' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi050-64001-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:52.153890+0000 mon.c (mon.2) 28 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:52.155340+0000 mon.c (mon.2) 29 : audit 1 from='client.? v1:172.21.15.50:0/1742718049' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi050-63982-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:52.156813+0000 mon.c (mon.2) 30 : audit 1 from='client.? v1:172.21.15.50:0/1112947882' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi050-63960-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:52.161665+0000 mon.b (mon.1) 32 : audit 1 from='client.? v1:172.21.15.50:0/1851238567' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi050-64146-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:52.163020+0000 mon.b (mon.1) 33 : audit 1 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi050-63976-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:52.164481+0000 mon.b (mon.1) 34 : audit 1 from='client.? v1:172.21.15.50:0/994459237' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi050-63944-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:52.165491+0000 mon.b (mon.1) 35 : audit 1 from='client.? v1:172.21.15.50:0/759541608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:52.231485+0000 mon.c (mon.2) 31 : audit 0 from='client.? v1:172.21.15.50:0/1074123380' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:03.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: cluster 2024-05-20T22:10:53.935241+0000 mgr.y (mgr.14592) 170 : cluster 0 pgmap v117: 516 pgs: 33 creating+peering, 351 unknown, 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:11:03.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:54.268721+0000 mon.c (mon.2) 32 : audit 0 from='client.? v1:172.21.15.50:0/3739275273' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:03.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: cluster 2024-05-20T22:10:55.938409+0000 mgr.y (mgr.14592) 171 : cluster 0 pgmap v118: 516 pgs: 256 creating+peering, 128 unknown, 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:11:03.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:56.303091+0000 mon.c (mon.2) 33 : audit 0 from='client.? v1:172.21.15.50:0/3714032013' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:03.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:57.014416+0000 mon.c (mon.2) 34 : audit 1 from='client.? v1:172.21.15.50:0/1506626568' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:03.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: cluster 2024-05-20T22:10:57.456202+0000 mon.a (mon.0) 936 : cluster 0 osdmap e76: 8 total, 8 up, 8 in 2024-05-20T22:11:03.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: cluster 2024-05-20T22:10:57.457824+0000 mon.a (mon.0) 937 : cluster 3 Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:03.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:57.488648+0000 mon.a (mon.0) 938 : audit 1 from='client.24775 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi050-64146-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:57.488866+0000 mon.a (mon.0) 939 : audit 1 from='client.24742 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi050-63976-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:57.488984+0000 mon.a (mon.0) 940 : audit 1 from='client.24875 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi050-64823-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:03.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:57.489165+0000 mon.a (mon.0) 941 : audit 1 from='client.24712 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi050-63944-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:57.489362+0000 mon.a (mon.0) 942 : audit 1 from='client.24844 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:57.490807+0000 mon.a (mon.0) 943 : audit 1 from='client.24665 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi050-63936-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:57.490961+0000 mon.a (mon.0) 944 : audit 1 from='client.24677 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi050-63952-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:57.491166+0000 mon.a (mon.0) 945 : audit 1 from='client.24701 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi050-64001-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:57.491308+0000 mon.a (mon.0) 946 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:57.491497+0000 mon.a (mon.0) 947 : audit 1 from='client.24695 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi050-63982-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:57.491705+0000 mon.a (mon.0) 948 : audit 1 from='client.24689 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi050-63960-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:02 smithi050 bash[21866]: audit 2024-05-20T22:10:57.491916+0000 mon.a (mon.0) 949 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:03.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:57.014416+0000 mon.c (mon.2) 34 : audit 1 from='client.? v1:172.21.15.50:0/1506626568' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:03.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: cluster 2024-05-20T22:10:57.456202+0000 mon.a (mon.0) 936 : cluster 0 osdmap e76: 8 total, 8 up, 8 in 2024-05-20T22:11:03.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: cluster 2024-05-20T22:10:57.457824+0000 mon.a (mon.0) 937 : cluster 3 Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:03.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:57.488648+0000 mon.a (mon.0) 938 : audit 1 from='client.24775 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi050-64146-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:57.488866+0000 mon.a (mon.0) 939 : audit 1 from='client.24742 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi050-63976-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:57.488984+0000 mon.a (mon.0) 940 : audit 1 from='client.24875 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi050-64823-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:03.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:57.489165+0000 mon.a (mon.0) 941 : audit 1 from='client.24712 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi050-63944-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:57.489362+0000 mon.a (mon.0) 942 : audit 1 from='client.24844 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:57.490807+0000 mon.a (mon.0) 943 : audit 1 from='client.24665 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi050-63936-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:57.490961+0000 mon.a (mon.0) 944 : audit 1 from='client.24677 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi050-63952-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:57.491166+0000 mon.a (mon.0) 945 : audit 1 from='client.24701 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi050-64001-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:57.491308+0000 mon.a (mon.0) 946 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:57.491497+0000 mon.a (mon.0) 947 : audit 1 from='client.24695 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi050-63982-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:57.491705+0000 mon.a (mon.0) 948 : audit 1 from='client.24689 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi050-63960-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:02 smithi050 bash[28929]: audit 2024-05-20T22:10:57.491916+0000 mon.a (mon.0) 949 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:03.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: cluster 2024-05-20T22:10:51.933988+0000 mgr.y (mgr.14592) 169 : cluster 0 pgmap v115: 196 pgs: 33 creating+peering, 31 unknown, 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:11:03.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:52.152462+0000 mon.c (mon.2) 27 : audit 1 from='client.? v1:172.21.15.50:0/110868113' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi050-64001-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:52.153890+0000 mon.c (mon.2) 28 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:52.155340+0000 mon.c (mon.2) 29 : audit 1 from='client.? v1:172.21.15.50:0/1742718049' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi050-63982-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:52.156813+0000 mon.c (mon.2) 30 : audit 1 from='client.? v1:172.21.15.50:0/1112947882' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi050-63960-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:52.161665+0000 mon.b (mon.1) 32 : audit 1 from='client.? v1:172.21.15.50:0/1851238567' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi050-64146-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:52.163020+0000 mon.b (mon.1) 33 : audit 1 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi050-63976-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:52.164481+0000 mon.b (mon.1) 34 : audit 1 from='client.? v1:172.21.15.50:0/994459237' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi050-63944-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:52.165491+0000 mon.b (mon.1) 35 : audit 1 from='client.? v1:172.21.15.50:0/759541608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:52.231485+0000 mon.c (mon.2) 31 : audit 0 from='client.? v1:172.21.15.50:0/1074123380' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:03.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: cluster 2024-05-20T22:10:53.935241+0000 mgr.y (mgr.14592) 170 : cluster 0 pgmap v117: 516 pgs: 33 creating+peering, 351 unknown, 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:11:03.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:54.268721+0000 mon.c (mon.2) 32 : audit 0 from='client.? v1:172.21.15.50:0/3739275273' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:03.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: cluster 2024-05-20T22:10:55.938409+0000 mgr.y (mgr.14592) 171 : cluster 0 pgmap v118: 516 pgs: 256 creating+peering, 128 unknown, 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:11:03.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:56.303091+0000 mon.c (mon.2) 33 : audit 0 from='client.? v1:172.21.15.50:0/3714032013' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:03.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:57.014416+0000 mon.c (mon.2) 34 : audit 1 from='client.? v1:172.21.15.50:0/1506626568' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:03.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: cluster 2024-05-20T22:10:57.456202+0000 mon.a (mon.0) 936 : cluster 0 osdmap e76: 8 total, 8 up, 8 in 2024-05-20T22:11:03.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: cluster 2024-05-20T22:10:57.457824+0000 mon.a (mon.0) 937 : cluster 3 Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:03.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:57.488648+0000 mon.a (mon.0) 938 : audit 1 from='client.24775 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi050-64146-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:57.488866+0000 mon.a (mon.0) 939 : audit 1 from='client.24742 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi050-63976-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:57.488984+0000 mon.a (mon.0) 940 : audit 1 from='client.24875 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi050-64823-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:03.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:57.489165+0000 mon.a (mon.0) 941 : audit 1 from='client.24712 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi050-63944-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:57.489362+0000 mon.a (mon.0) 942 : audit 1 from='client.24844 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:57.490807+0000 mon.a (mon.0) 943 : audit 1 from='client.24665 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi050-63936-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:57.490961+0000 mon.a (mon.0) 944 : audit 1 from='client.24677 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi050-63952-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:57.491166+0000 mon.a (mon.0) 945 : audit 1 from='client.24701 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi050-64001-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:57.491308+0000 mon.a (mon.0) 946 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:57.491497+0000 mon.a (mon.0) 947 : audit 1 from='client.24695 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi050-63982-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:57.491705+0000 mon.a (mon.0) 948 : audit 1 from='client.24689 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi050-63960-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:03.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:02 smithi145 bash[23893]: audit 2024-05-20T22:10:57.491916+0000 mon.a (mon.0) 949 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:04.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:10:57.513346+0000 mon.a (mon.0) 950 : audit 1 from='client.24922 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi050-64724-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:04.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:10:57.523320+0000 mon.b (mon.1) 36 : audit 1 from='client.? v1:172.21.15.50:0/294761569' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi050-64724-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi050-64724-1"}]: dispatch 2024-05-20T22:11:04.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:10:57.524900+0000 mon.c (mon.2) 35 : audit 1 from='client.? v1:172.21.15.50:0/4064438627' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi050-64159-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:10:57.524989+0000 mon.b (mon.1) 37 : audit 1 from='client.? v1:172.21.15.50:0/236198188' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64323-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:10:57.525747+0000 mon.b (mon.1) 38 : audit 1 from='client.? v1:172.21.15.50:0/3082446445' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64416-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:10:57.527227+0000 mon.c (mon.2) 36 : audit 1 from='client.? v1:172.21.15.50:0/1722369777' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi050-64185-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:10:57.529416+0000 mon.c (mon.2) 37 : audit 1 from='client.? v1:172.21.15.50:0/1679462118' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi050-64235-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:10:57.529714+0000 mon.c (mon.2) 38 : audit 1 from='client.? v1:172.21.15.50:0/4058789773' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:10:57.530014+0000 mon.c (mon.2) 39 : audit 1 from='client.? v1:172.21.15.50:0/3127707880' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi050-64207-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:10:57.531442+0000 mon.c (mon.2) 40 : audit 1 from='client.? v1:172.21.15.50:0/1142587826' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi050-64110-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:10:57.635008+0000 mgr.y (mgr.14592) 172 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:04.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: cluster 2024-05-20T22:10:57.940125+0000 mgr.y (mgr.14592) 173 : cluster 0 pgmap v120: 900 pgs: 256 creating+peering, 512 unknown, 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:11:04.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:10:58.331242+0000 mon.c (mon.2) 41 : audit 0 from='client.? v1:172.21.15.50:0/331589583' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:04.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:10:57.513346+0000 mon.a (mon.0) 950 : audit 1 from='client.24922 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi050-64724-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:04.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:10:57.523320+0000 mon.b (mon.1) 36 : audit 1 from='client.? v1:172.21.15.50:0/294761569' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi050-64724-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi050-64724-1"}]: dispatch 2024-05-20T22:11:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:10:57.524900+0000 mon.c (mon.2) 35 : audit 1 from='client.? v1:172.21.15.50:0/4064438627' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi050-64159-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:10:57.524989+0000 mon.b (mon.1) 37 : audit 1 from='client.? v1:172.21.15.50:0/236198188' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64323-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:10:57.525747+0000 mon.b (mon.1) 38 : audit 1 from='client.? v1:172.21.15.50:0/3082446445' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64416-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:10:57.527227+0000 mon.c (mon.2) 36 : audit 1 from='client.? v1:172.21.15.50:0/1722369777' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi050-64185-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:10:57.529416+0000 mon.c (mon.2) 37 : audit 1 from='client.? v1:172.21.15.50:0/1679462118' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi050-64235-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:10:57.529714+0000 mon.c (mon.2) 38 : audit 1 from='client.? v1:172.21.15.50:0/4058789773' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:10:57.530014+0000 mon.c (mon.2) 39 : audit 1 from='client.? v1:172.21.15.50:0/3127707880' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi050-64207-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:10:57.531442+0000 mon.c (mon.2) 40 : audit 1 from='client.? v1:172.21.15.50:0/1142587826' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi050-64110-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:10:57.635008+0000 mgr.y (mgr.14592) 172 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: cluster 2024-05-20T22:10:57.940125+0000 mgr.y (mgr.14592) 173 : cluster 0 pgmap v120: 900 pgs: 256 creating+peering, 512 unknown, 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:11:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:10:58.331242+0000 mon.c (mon.2) 41 : audit 0 from='client.? v1:172.21.15.50:0/331589583' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:04.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: cluster 2024-05-20T22:10:59.946210+0000 mgr.y (mgr.14592) 174 : cluster 0 pgmap v121: 900 pgs: 582 creating+peering, 155 unknown, 163 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:11:04.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:00.369215+0000 mon.c (mon.2) 42 : audit 0 from='client.? v1:172.21.15.50:0/4027976911' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:04.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: cluster 2024-05-20T22:11:01.947718+0000 mgr.y (mgr.14592) 175 : cluster 0 pgmap v122: 900 pgs: 582 creating+peering, 155 unknown, 163 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-20T22:11:04.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:02.407273+0000 mon.c (mon.2) 43 : audit 0 from='client.? v1:172.21.15.50:0/2639732658' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:04.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: cluster 2024-05-20T22:11:02.915898+0000 mon.a (mon.0) 951 : cluster 0 osdmap e77: 8 total, 8 up, 8 in 2024-05-20T22:11:04.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: cluster 2024-05-20T22:11:02.918455+0000 mon.a (mon.0) 952 : cluster 3 Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:04.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:02.932282+0000 mon.a (mon.0) 953 : audit 1 from='client.24922 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi050-64724-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi050-64724-1"}]: dispatch 2024-05-20T22:11:04.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:02.932774+0000 mon.a (mon.0) 954 : audit 1 from='client.24734 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi050-64159-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:02.933050+0000 mon.a (mon.0) 955 : audit 1 from='client.24874 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64323-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:02.933149+0000 mon.a (mon.0) 956 : audit 1 from='client.24743 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi050-64185-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:02.933274+0000 mon.a (mon.0) 957 : audit 1 from='client.24892 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64416-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:02.933734+0000 mon.a (mon.0) 958 : audit 1 from='client.24764 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi050-64235-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:02.935132+0000 mon.a (mon.0) 959 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:02.936275+0000 mon.a (mon.0) 960 : audit 1 from='client.24749 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi050-64207-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:02.967064+0000 mon.a (mon.0) 961 : audit 1 from='client.24728 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi050-64110-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: cluster 2024-05-20T22:10:59.946210+0000 mgr.y (mgr.14592) 174 : cluster 0 pgmap v121: 900 pgs: 582 creating+peering, 155 unknown, 163 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:11:04.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:00.369215+0000 mon.c (mon.2) 42 : audit 0 from='client.? v1:172.21.15.50:0/4027976911' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:04.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: cluster 2024-05-20T22:11:01.947718+0000 mgr.y (mgr.14592) 175 : cluster 0 pgmap v122: 900 pgs: 582 creating+peering, 155 unknown, 163 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-20T22:11:04.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:02.407273+0000 mon.c (mon.2) 43 : audit 0 from='client.? v1:172.21.15.50:0/2639732658' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:04.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: cluster 2024-05-20T22:11:02.915898+0000 mon.a (mon.0) 951 : cluster 0 osdmap e77: 8 total, 8 up, 8 in 2024-05-20T22:11:04.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: cluster 2024-05-20T22:11:02.918455+0000 mon.a (mon.0) 952 : cluster 3 Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:04.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:02.932282+0000 mon.a (mon.0) 953 : audit 1 from='client.24922 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi050-64724-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi050-64724-1"}]: dispatch 2024-05-20T22:11:04.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:02.932774+0000 mon.a (mon.0) 954 : audit 1 from='client.24734 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi050-64159-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:02.933050+0000 mon.a (mon.0) 955 : audit 1 from='client.24874 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64323-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:02.933149+0000 mon.a (mon.0) 956 : audit 1 from='client.24743 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi050-64185-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:02.933274+0000 mon.a (mon.0) 957 : audit 1 from='client.24892 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64416-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:02.933734+0000 mon.a (mon.0) 958 : audit 1 from='client.24764 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi050-64235-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:02.935132+0000 mon.a (mon.0) 959 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:02.936275+0000 mon.a (mon.0) 960 : audit 1 from='client.24749 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi050-64207-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:02.967064+0000 mon.a (mon.0) 961 : audit 1 from='client.24728 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi050-64110-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:02.974323+0000 mon.a (mon.0) 962 : audit 1 from='client.24775 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi050-64146-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:04.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:02.974417+0000 mon.a (mon.0) 963 : audit 1 from='client.24742 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi050-63976-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:04.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:02.974498+0000 mon.a (mon.0) 964 : audit 1 from='client.24875 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi050-64823-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:04.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:02.974620+0000 mon.a (mon.0) 965 : audit 1 from='client.24712 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi050-63944-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:04.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:02.974680+0000 mon.a (mon.0) 966 : audit 1 from='client.24844 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:04.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:02.974744+0000 mon.a (mon.0) 967 : audit 1 from='client.24665 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi050-63936-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:04.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:02.974868+0000 mon.a (mon.0) 968 : audit 1 from='client.24677 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi050-63952-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:04.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:02.980642+0000 mon.a (mon.0) 969 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:11:04.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: cluster 2024-05-20T22:11:02.997416+0000 mon.a (mon.0) 970 : cluster 0 osdmap e78: 8 total, 8 up, 8 in 2024-05-20T22:11:04.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:02.999827+0000 mon.a (mon.0) 971 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:11:04.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:03.003817+0000 mon.c (mon.2) 44 : audit 1 from='client.? v1:172.21.15.50:0/1346369038' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi050-64823-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi050-64823-1"}]: dispatch 2024-05-20T22:11:04.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:03.004855+0000 mon.c (mon.2) 45 : audit 1 from='client.? v1:172.21.15.50:0/1506626568' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:04.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:03.007748+0000 mon.c (mon.2) 46 : audit 1 from='client.? v1:172.21.15.50:0/4168733357' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64299-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:03.008064+0000 mon.c (mon.2) 47 : audit 1 from='client.? v1:172.21.15.50:0/4137974017' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi050-64391-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:03.011265+0000 mon.a (mon.0) 972 : audit 1 from='client.24875 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi050-64823-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi050-64823-1"}]: dispatch 2024-05-20T22:11:04.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:03.011586+0000 mon.a (mon.0) 973 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:04.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:03.012134+0000 mon.a (mon.0) 974 : audit 1 from='client.24848 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64299-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:03 smithi050 bash[21866]: audit 2024-05-20T22:11:03.012332+0000 mon.a (mon.0) 975 : audit 1 from='client.24776 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi050-64391-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:02.974323+0000 mon.a (mon.0) 962 : audit 1 from='client.24775 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi050-64146-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:04.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:02.974417+0000 mon.a (mon.0) 963 : audit 1 from='client.24742 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi050-63976-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:04.201 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:02.974498+0000 mon.a (mon.0) 964 : audit 1 from='client.24875 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi050-64823-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:04.201 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:02.974620+0000 mon.a (mon.0) 965 : audit 1 from='client.24712 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi050-63944-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:04.201 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:02.974680+0000 mon.a (mon.0) 966 : audit 1 from='client.24844 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:04.201 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:02.974744+0000 mon.a (mon.0) 967 : audit 1 from='client.24665 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi050-63936-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:04.201 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:02.974868+0000 mon.a (mon.0) 968 : audit 1 from='client.24677 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi050-63952-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:04.201 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:02.980642+0000 mon.a (mon.0) 969 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:11:04.201 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: cluster 2024-05-20T22:11:02.997416+0000 mon.a (mon.0) 970 : cluster 0 osdmap e78: 8 total, 8 up, 8 in 2024-05-20T22:11:04.201 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:02.999827+0000 mon.a (mon.0) 971 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:11:04.201 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:03.003817+0000 mon.c (mon.2) 44 : audit 1 from='client.? v1:172.21.15.50:0/1346369038' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi050-64823-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi050-64823-1"}]: dispatch 2024-05-20T22:11:04.201 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:03.004855+0000 mon.c (mon.2) 45 : audit 1 from='client.? v1:172.21.15.50:0/1506626568' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:04.201 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:03.007748+0000 mon.c (mon.2) 46 : audit 1 from='client.? v1:172.21.15.50:0/4168733357' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64299-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.201 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:03.008064+0000 mon.c (mon.2) 47 : audit 1 from='client.? v1:172.21.15.50:0/4137974017' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi050-64391-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.201 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:03.011265+0000 mon.a (mon.0) 972 : audit 1 from='client.24875 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi050-64823-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi050-64823-1"}]: dispatch 2024-05-20T22:11:04.202 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:03.011586+0000 mon.a (mon.0) 973 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:04.202 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:03.012134+0000 mon.a (mon.0) 974 : audit 1 from='client.24848 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64299-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.202 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:03 smithi050 bash[28929]: audit 2024-05-20T22:11:03.012332+0000 mon.a (mon.0) 975 : audit 1 from='client.24776 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi050-64391-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:10:57.513346+0000 mon.a (mon.0) 950 : audit 1 from='client.24922 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi050-64724-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:04.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:10:57.523320+0000 mon.b (mon.1) 36 : audit 1 from='client.? v1:172.21.15.50:0/294761569' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi050-64724-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi050-64724-1"}]: dispatch 2024-05-20T22:11:04.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:10:57.524900+0000 mon.c (mon.2) 35 : audit 1 from='client.? v1:172.21.15.50:0/4064438627' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi050-64159-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:10:57.524989+0000 mon.b (mon.1) 37 : audit 1 from='client.? v1:172.21.15.50:0/236198188' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64323-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:10:57.525747+0000 mon.b (mon.1) 38 : audit 1 from='client.? v1:172.21.15.50:0/3082446445' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64416-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:10:57.527227+0000 mon.c (mon.2) 36 : audit 1 from='client.? v1:172.21.15.50:0/1722369777' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi050-64185-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:10:57.529416+0000 mon.c (mon.2) 37 : audit 1 from='client.? v1:172.21.15.50:0/1679462118' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi050-64235-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:10:57.529714+0000 mon.c (mon.2) 38 : audit 1 from='client.? v1:172.21.15.50:0/4058789773' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:10:57.530014+0000 mon.c (mon.2) 39 : audit 1 from='client.? v1:172.21.15.50:0/3127707880' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi050-64207-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:10:57.531442+0000 mon.c (mon.2) 40 : audit 1 from='client.? v1:172.21.15.50:0/1142587826' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi050-64110-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:10:57.635008+0000 mgr.y (mgr.14592) 172 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:04.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: cluster 2024-05-20T22:10:57.940125+0000 mgr.y (mgr.14592) 173 : cluster 0 pgmap v120: 900 pgs: 256 creating+peering, 512 unknown, 132 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:11:04.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:10:58.331242+0000 mon.c (mon.2) 41 : audit 0 from='client.? v1:172.21.15.50:0/331589583' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:04.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: cluster 2024-05-20T22:10:59.946210+0000 mgr.y (mgr.14592) 174 : cluster 0 pgmap v121: 900 pgs: 582 creating+peering, 155 unknown, 163 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:11:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:00.369215+0000 mon.c (mon.2) 42 : audit 0 from='client.? v1:172.21.15.50:0/4027976911' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: cluster 2024-05-20T22:11:01.947718+0000 mgr.y (mgr.14592) 175 : cluster 0 pgmap v122: 900 pgs: 582 creating+peering, 155 unknown, 163 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-20T22:11:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:02.407273+0000 mon.c (mon.2) 43 : audit 0 from='client.? v1:172.21.15.50:0/2639732658' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: cluster 2024-05-20T22:11:02.915898+0000 mon.a (mon.0) 951 : cluster 0 osdmap e77: 8 total, 8 up, 8 in 2024-05-20T22:11:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: cluster 2024-05-20T22:11:02.918455+0000 mon.a (mon.0) 952 : cluster 3 Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:02.932282+0000 mon.a (mon.0) 953 : audit 1 from='client.24922 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi050-64724-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi050-64724-1"}]: dispatch 2024-05-20T22:11:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:02.932774+0000 mon.a (mon.0) 954 : audit 1 from='client.24734 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi050-64159-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:02.933050+0000 mon.a (mon.0) 955 : audit 1 from='client.24874 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64323-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:02.933149+0000 mon.a (mon.0) 956 : audit 1 from='client.24743 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi050-64185-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:02.933274+0000 mon.a (mon.0) 957 : audit 1 from='client.24892 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64416-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:02.933734+0000 mon.a (mon.0) 958 : audit 1 from='client.24764 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi050-64235-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:02.935132+0000 mon.a (mon.0) 959 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:02.936275+0000 mon.a (mon.0) 960 : audit 1 from='client.24749 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi050-64207-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:02.967064+0000 mon.a (mon.0) 961 : audit 1 from='client.24728 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi050-64110-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:02.974323+0000 mon.a (mon.0) 962 : audit 1 from='client.24775 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi050-64146-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:04.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:02.974417+0000 mon.a (mon.0) 963 : audit 1 from='client.24742 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi050-63976-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:04.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:02.974498+0000 mon.a (mon.0) 964 : audit 1 from='client.24875 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi050-64823-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:04.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:02.974620+0000 mon.a (mon.0) 965 : audit 1 from='client.24712 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi050-63944-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:04.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:02.974680+0000 mon.a (mon.0) 966 : audit 1 from='client.24844 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:04.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:02.974744+0000 mon.a (mon.0) 967 : audit 1 from='client.24665 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi050-63936-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:04.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:02.974868+0000 mon.a (mon.0) 968 : audit 1 from='client.24677 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi050-63952-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:04.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:02.980642+0000 mon.a (mon.0) 969 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:11:04.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: cluster 2024-05-20T22:11:02.997416+0000 mon.a (mon.0) 970 : cluster 0 osdmap e78: 8 total, 8 up, 8 in 2024-05-20T22:11:04.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:02.999827+0000 mon.a (mon.0) 971 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:11:04.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:03.003817+0000 mon.c (mon.2) 44 : audit 1 from='client.? v1:172.21.15.50:0/1346369038' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi050-64823-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi050-64823-1"}]: dispatch 2024-05-20T22:11:04.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:03.004855+0000 mon.c (mon.2) 45 : audit 1 from='client.? v1:172.21.15.50:0/1506626568' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:04.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:03.007748+0000 mon.c (mon.2) 46 : audit 1 from='client.? v1:172.21.15.50:0/4168733357' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64299-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:03.008064+0000 mon.c (mon.2) 47 : audit 1 from='client.? v1:172.21.15.50:0/4137974017' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi050-64391-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:03.011265+0000 mon.a (mon.0) 972 : audit 1 from='client.24875 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi050-64823-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi050-64823-1"}]: dispatch 2024-05-20T22:11:04.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:03.011586+0000 mon.a (mon.0) 973 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:04.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:03.012134+0000 mon.a (mon.0) 974 : audit 1 from='client.24848 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64299-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:03 smithi145 bash[23893]: audit 2024-05-20T22:11:03.012332+0000 mon.a (mon.0) 975 : audit 1 from='client.24776 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi050-64391-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:04.443 INFO:tasks.workunit.client.0.smithi050.stdout:: y(active, since 3m), standbys: x 2024-05-20T22:11:04.443 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-05-20T22:11:04.443 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: laundry: 2 daemons active (1 hosts) 2024-05-20T22:11:04.443 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-05-20T22:11:04.443 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:11:04.443 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: data: 2024-05-20T22:11:04.444 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pools: 8 pools, 196 pgs 2024-05-20T22:11:04.444 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: objects: 198 objects, 583 KiB 2024-05-20T22:11:04.444 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: usage: 235 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:11:04.444 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pgs: 15.816% pgs unknown 2024-05-20T22:11:04.444 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 16.837% pgs not active 2024-05-20T22:11:04.444 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 132 active+clean 2024-05-20T22:11:04.444 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 33 creating+peering 2024-05-20T22:11:04.444 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 31 unknown 2024-05-20T22:11:04.444 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:11:04.444 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: io: 2024-05-20T22:11:04.444 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: client: 1023 B/s rd, 0 op/s rd, 0 op/s wr 2024-05-20T22:11:04.444 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:11:04.444 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:11:04.445 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: cluster: 2024-05-20T22:11:04.445 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: id: 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T22:11:04.445 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: health: HEALTH_WARN 2024-05-20T22:11:04.445 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2 pool(s) do not have an application enabled 2024-05-20T22:11:04.445 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:11:04.445 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: services: 2024-05-20T22:11:04.445 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-05-20T22:11:04.445 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-05-20T22:11:04.445 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-05-20T22:11:04.445 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: laundry: 2 daemons active (1 hosts) 2024-05-20T22:11:04.445 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-05-20T22:11:04.445 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:11:04.445 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: data: 2024-05-20T22:11:04.445 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pools: 8 pools, 196 pgs 2024-05-20T22:11:04.446 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: objects: 198 objects, 583 KiB 2024-05-20T22:11:04.446 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: usage: 235 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:11:04.446 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pgs: 15.816% pgs unknown 2024-05-20T22:11:04.446 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 16.837% pgs not active 2024-05-20T22:11:04.446 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 132 active+clean 2024-05-20T22:11:04.446 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 33 creating+peering 2024-05-20T22:11:04.446 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 31 unknown 2024-05-20T22:11:04.446 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:11:04.446 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: io: 2024-05-20T22:11:04.446 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: client: 1023 B/s rd, 0 op/s rd, 0 op/s wr 2024-05-20T22:11:04.446 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:11:04.446 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:11:04.446 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: cluster: 2024-05-20T22:11:04.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: id: 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T22:11:04.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: health: HEALTH_WARN 2024-05-20T22:11:04.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2 pool(s) do not have an application enabled 2024-05-20T22:11:04.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:11:04.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: services: 2024-05-20T22:11:04.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-05-20T22:11:04.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-05-20T22:11:04.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-05-20T22:11:04.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: laundry: 2 daemons active (1 hosts) 2024-05-20T22:11:04.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-05-20T22:11:04.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:11:04.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: data: 2024-05-20T22:11:04.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pools: 8 pools, 196 pgs 2024-05-20T22:11:04.448 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: objects: 198 objects, 583 KiB 2024-05-20T22:11:04.448 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: usage: 235 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:11:04.448 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pgs: 15.816% pgs unknown 2024-05-20T22:11:04.448 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 16.837% pgs not active 2024-05-20T22:11:04.448 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 132 active+clean 2024-05-20T22:11:04.448 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 33 creating+peering 2024-05-20T22:11:04.448 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 31 unknown 2024-05-20T22:11:04.448 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:11:04.449 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: io: 2024-05-20T22:11:04.449 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: client: 1023 B/s rd, 0 op/s rd, 0 op/s wr 2024-05-20T22:11:04.449 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:11:04.449 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:11:04.449 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: cluster: 2024-05-20T22:11:04.449 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: id: 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T22:11:04.450 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: health: HEALTH_WARN 2024-05-20T22:11:04.794 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 30 pool(s) do n api_list: [==========] Running 11 tests from 3 test suites. 2024-05-20T22:11:04.794 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [----------] Global test environment set-up. 2024-05-20T22:11:04.794 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [----------] 7 tests from LibRadosList 2024-05-20T22:11:04.794 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2024-05-20T22:11:04.794 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ OK ] LibRadosList.ListObjects (1466 ms) 2024-05-20T22:11:04.795 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2024-05-20T22:11:04.795 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (60 ms) 2024-05-20T22:11:04.795 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2024-05-20T22:11:04.795 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: myset foo1,foo2,foo3 2024-05-20T22:11:04.795 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: foo1 2024-05-20T22:11:04.795 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: foo2 2024-05-20T22:11:04.795 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: foo3 2024-05-20T22:11:04.795 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: myset foo1,foo4,foo5 2024-05-20T22:11:04.795 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: foo4 2024-05-20T22:11:04.795 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: foo5 2024-05-20T22:11:04.795 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: foo1 2024-05-20T22:11:04.795 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: myset foo6,foo7 2024-05-20T22:11:04.795 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: foo7 2024-05-20T22:11:04.796 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: foo6 2024-05-20T22:11:04.796 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-05-20T22:11:04.796 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: ns1:foo4 2024-05-20T22:11:04.796 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: ns1:foo5 2024-05-20T22:11:04.796 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: ns2:foo7 2024-05-20T22:11:04.796 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: ns2:foo6 2024-05-20T22:11:04.796 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: ns1:foo1 2024-05-20T22:11:04.796 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: :foo1 2024-05-20T22:11:04.796 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: :foo2 2024-05-20T22:11:04.796 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: :foo3 2024-05-20T22:11:04.796 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (114 ms) 2024-05-20T22:11:04.796 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2024-05-20T22:11:04.796 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 1 0 2024-05-20T22:11:04.796 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 10 0 2024-05-20T22:11:04.797 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 13 0 2024-05-20T22:11:04.797 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 7 0 2024-05-20T22:11:04.797 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 14 0 2024-05-20T22:11:04.797 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 0 0 2024-05-20T22:11:04.797 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 15 0 2024-05-20T22:11:04.797 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 11 0 2024-05-20T22:11:04.797 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 5 0 2024-05-20T22:11:04.797 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 8 0 2024-05-20T22:11:04.797 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 6 0 2024-05-20T22:11:04.797 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 3 0 2024-05-20T22:11:04.797 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 4 0 2024-05-20T22:11:04.797 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 12 0 2024-05-20T22:11:04.797 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 9 0 2024-05-20T22:11:04.797 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 2 0 2024-05-20T22:11:04.798 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-05-20T22:11:04.798 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (74 ms) 2024-05-20T22:11:04.798 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2024-05-20T22:11:04.798 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: x cursor=MIN 2024-05-20T22:11:04.798 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > oid=1 cursor=11:02547ec2:::1:head 2024-05-20T22:11:04.798 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > oid=10 cursor=11:52ea6a34:::10:head 2024-05-20T22:11:04.798 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > oid=13 cursor=11:566253c9:::13:head 2024-05-20T22:11:04.798 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > oid=7 cursor=11:5c6b0b28:::7:head 2024-05-20T22:11:04.798 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > oid=14 cursor=11:62a1935d:::14:head 2024-05-20T22:11:04.798 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > oid=0 cursor=11:6cac518f:::0:head 2024-05-20T22:11:04.798 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > oid=15 cursor=11:863748b0:::15:head 2024-05-20T22:11:04.798 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > oid=11 cursor=11:89d3ae78:::11:head 2024-05-20T22:11:04.798 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > oid=5 cursor=11:b29083e3:::5:head 2024-05-20T22:11:04.799 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > oid=8 cursor=11:bd63b0f1:::8:head 2024-05-20T22:11:04.799 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > oid=6 cursor=11:c4fdafeb:::6:head 2024-05-20T22:11:04.799 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > oid=3 cursor=11:cfc208b3:::3:head 2024-05-20T22:11:04.799 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > oid=4 cursor=11:d83876eb:::4:head 2024-05-20T22:11:04.799 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > oid=12 cursor=11:de5d7c5f:::12:head 2024-05-20T22:11:04.799 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > oid=9 cursor=11:e960b815:::9:head 2024-05-20T22:11:04.799 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > oid=2 cursor=11:f905c69b:::2:head 2024-05-20T22:11:04.799 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: FIRST> seek to MIN oid=1 2024-05-20T22:11:04.799 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : oid=1 cursor=11:02547ec2:::1:head 2024-05-20T22:11:04.799 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:02547ec2:::1:head 2024-05-20T22:11:04.799 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:02547ec2:::1:head -> 1 2024-05-20T22:11:04.799 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : oid=10 cursor=11:52ea6a34:::10:head 2024-05-20T22:11:04.799 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:52ea6a34:::10:head 2024-05-20T22:11:04.799 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:52ea6a34:::10:head -> 10 2024-05-20T22:11:04.799 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : oid=13 cursor=11:566253c9:::13:head 2024-05-20T22:11:04.800 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:566253c9:::13:head 2024-05-20T22:11:04.800 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:566253c9:::13:head -> 13 2024-05-20T22:11:04.800 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : oid=7 cursor=11:5c6b0b28:::7:head 2024-05-20T22:11:04.800 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:5c6b0b28:::7:head 2024-05-20T22:11:04.800 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:5c6b0b28:::7:head -> 7 2024-05-20T22:11:04.878 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : oid=14 cursor=11:62a1935d:::14:head 2024-05-20T22:11:04.878 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:62a1935d:::14:head 2024-05-20T22:11:04.878 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:62a1935d:::14:head -> 14 2024-05-20T22:11:04.878 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : oid=0 cursor=11:6cac518f:::0:head 2024-05-20T22:11:04.879 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:6cac518f:::0:head 2024-05-20T22:11:04.879 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:6cac518f:::0:head -> 0 2024-05-20T22:11:04.879 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : oid=15 cursor=11:863748b0:::15:head 2024-05-20T22:11:04.879 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:863748b0:::15:head 2024-05-20T22:11:04.879 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:863748b0:::15:head -> 15 2024-05-20T22:11:04.879 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : oid=11 cursor=11:89d3ae78:::11:head 2024-05-20T22:11:04.879 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:89d3ae78:::11:head 2024-05-20T22:11:04.879 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:89d3ae78:::11:head -> 11 2024-05-20T22:11:04.879 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : oid=5 cursor=11:b29083e3:::5:head 2024-05-20T22:11:04.879 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:b29083e3:::5:head 2024-05-20T22:11:04.879 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:b29083e3:::5:head -> 5 2024-05-20T22:11:04.879 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : oid=8 cursor=11:bd63b0f1:::8:head 2024-05-20T22:11:04.879 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:bd63b0f1:::8:head 2024-05-20T22:11:04.880 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:bd63b0f1:::8:head -> 8 2024-05-20T22:11:04.880 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : oid=6 cursor=11:c4fdafeb:::6:head 2024-05-20T22:11:04.880 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:c4fdafeb:::6:head 2024-05-20T22:11:04.880 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:c4fdafeb:::6:head -> 6 2024-05-20T22:11:04.880 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : oid=3 cursor=11:cfc208b3:::3:head 2024-05-20T22:11:04.880 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:cfc208b3:::3:head 2024-05-20T22:11:04.880 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:cfc208b3:::3:head -> 3 2024-05-20T22:11:04.880 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : oid=4 cursor=11:d83876eb:::4:head 2024-05-20T22:11:04.880 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:d83876eb:::4:head 2024-05-20T22:11:04.880 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:d83876eb:::4:head -> 4 2024-05-20T22:11:04.880 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : oid=12 cursor=11:de5d7c5f:::12:head 2024-05-20T22:11:04.880 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:de5d7c5f:::12:head 2024-05-20T22:11:04.880 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:de5d7c5f:::12:head -> 12 2024-05-20T22:11:04.880 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : oid=9 cursor=11:e960b815:::9:head 2024-05-20T22:11:04.881 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:e960b815:::9:head 2024-05-20T22:11:04.881 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:e960b815:::9:head -> 9 2024-05-20T22:11:04.881 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : oid=2 cursor=11:f905c69b:::2:head 2024-05-20T22:11:04.881 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:f905c69b:::2:head 2024-05-20T22:11:04.881 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:f905c69b:::2:head -> 2 2024-05-20T22:11:04.881 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:566253c9:::13:head 2024-05-20T22:11:04.881 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : cursor()=11:566253c9:::13:head expected=11:566253c9:::13:head 2024-05-20T22:11:04.881 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:566253c9:::13:head -> 13 2024-05-20T22:11:04.881 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : entry=13 expected=13 2024-05-20T22:11:04.881 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:f905c69b:::2:head 2024-05-20T22:11:04.881 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : cursor()=11:f905c69b:::2:head expected=11:f905c69b:::2:head 2024-05-20T22:11:04.881 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:f905c69b:::2:head -> 2 2024-05-20T22:11:04.881 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : entry=2 expected=2 2024-05-20T22:11:04.881 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:e960b815:::9:head 2024-05-20T22:11:04.882 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : cursor()=11:e960b815:::9:head expected=11:e960b815:::9:head 2024-05-20T22:11:04.882 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:e960b815:::9:head -> 9 2024-05-20T22:11:04.882 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : entry=9 expected=9 2024-05-20T22:11:04.882 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:b29083e3:::5:head 2024-05-20T22:11:04.882 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : cursor()=11:b29083e3:::5:head expected=11:b29083e3:::5:head 2024-05-20T22:11:04.882 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:b29083e3:::5:head -> 5 2024-05-20T22:11:04.882 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : entry=5 expected=5 2024-05-20T22:11:04.882 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:89d3ae78:::11:head 2024-05-20T22:11:04.882 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : cursor()=11:89d3ae78:::11:head expected=11:89d3ae78:::11:head 2024-05-20T22:11:04.882 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:89d3ae78:::11:head -> 11 2024-05-20T22:11:04.882 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : entry=11 expected=11 2024-05-20T22:11:04.882 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:863748b0:::15:head 2024-05-20T22:11:04.882 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : cursor()=11:863748b0:::15:head expected=11:863748b0:::15:head 2024-05-20T22:11:04.882 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:863748b0:::15:head -> 15 2024-05-20T22:11:04.883 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : entry=15 expected=15 2024-05-20T22:11:04.883 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:6cac518f:::0:head 2024-05-20T22:11:04.883 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : cursor()=11:6cac518f:::0:head expected=11:6cac518f:::0:head 2024-05-20T22:11:04.883 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:6cac518f:::0:head -> 0 2024-05-20T22:11:04.883 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : entry=0 expected=0 2024-05-20T22:11:04.883 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:62a1935d:::14:head 2024-05-20T22:11:04.883 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : cursor()=11:62a1935d:::14:head expected=11:62a1935d:::14:head 2024-05-20T22:11:04.883 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:62a1935d:::14:head -> 14 2024-05-20T22:11:04.967 INFO:tasks.workunit.client.0.smithi050.stdout: api_li list_parallel: process_1_[64467]: starting. 2024-05-20T22:11:04.967 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_1_[64467]: creating pool ceph_test_rados_list_parallel.smithi050-64432 2024-05-20T22:11:04.967 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_1_[64467]: created object 0... 2024-05-20T22:11:04.967 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_1_[64467]: created object 25... 2024-05-20T22:11:04.967 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_1_[64467]: created object 49... 2024-05-20T22:11:04.967 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_1_[64467]: finishing. 2024-05-20T22:11:04.967 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_1_[64467]: shutting down. 2024-05-20T22:11:04.968 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_2_[64468]: starting. 2024-05-20T22:11:04.968 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_2_[64468]: listing objects. 2024-05-20T22:11:04.968 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_2_[64468]: listed object 0... 2024-05-20T22:11:04.968 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_2_[64468]: listed object 25... 2024-05-20T22:11:04.968 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_2_[64468]: saw 50 objects 2024-05-20T22:11:04.968 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_2_[64468]: shutting down. 2024-05-20T22:11:04.968 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:04.968 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_3_[65540]: starting. 2024-05-20T22:11:04.968 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_3_[65540]: creating pool ceph_test_rados_list_parallel.smithi050-64432 2024-05-20T22:11:04.968 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_3_[65540]: created object 0... 2024-05-20T22:11:04.968 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_3_[65540]: created object 25... 2024-05-20T22:11:04.968 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_3_[65540]: created object 49... 2024-05-20T22:11:04.968 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_3_[65540]: finishing. 2024-05-20T22:11:04.969 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_3_[65540]: shutting down. 2024-05-20T22:11:04.969 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:04.969 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_4_[65541]: starting. 2024-05-20T22:11:04.969 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_4_[65541]: listing objects. 2024-05-20T22:11:04.969 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_4_[65541]: listed object 0... 2024-05-20T22:11:04.969 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_4_[65541]: listed object 25... 2024-05-20T22:11:04.969 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_4_[65541]: saw 43 objects 2024-05-20T22:11:04.969 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_4_[65541]: shutting down. 2024-05-20T22:11:04.969 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:04.969 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_5_[65542]: starting. 2024-05-20T22:11:04.969 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_5_[65542]: removed 25 objects... 2024-05-20T22:11:04.969 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_5_[65542]: removed half of the objects 2024-05-20T22:11:04.969 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_5_[65542]: removed 50 objects... 2024-05-20T22:11:04.970 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_5_[65542]: removed 50 objects 2024-05-20T22:11:04.970 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_5_[65542]: shutting down. 2024-05-20T22:11:04.970 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:04.970 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:04.970 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_6_[65620]: starting. 2024-05-20T22:11:04.970 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_6_[65620]: creating pool ceph_test_rados_list_parallel.smithi050-64432 2024-05-20T22:11:04.970 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_6_[65620]: created object 0... 2024-05-20T22:11:04.970 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_6_[65620]: created object 25... 2024-05-20T22:11:04.970 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_6_[65620]: created object 49... 2024-05-20T22:11:04.970 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_6_[65620]: finishing. 2024-05-20T22:11:04.970 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_6_[65620]: shutting down. 2024-05-20T22:11:04.970 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:04.970 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:04.971 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_7_[65621]: starting. 2024-05-20T22:11:04.971 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_7_[65621]: listing objects. 2024-05-20T22:11:04.971 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_7_[65621]: listed object 0... 2024-05-20T22:11:04.971 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_7_[65621]: listed object 25... 2024-05-20T22:11:04.971 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_7_[65621]: listed object 50... 2024-05-20T22:11:04.971 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_7_[65621]: saw 56 objects 2024-05-20T22:11:04.971 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_7_[65621]: shutting down. 2024-05-20T22:11:04.971 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:04.971 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:04.971 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_8_[65622]: starting. 2024-05-20T22:11:04.971 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_8_[65622]: added 25 objects... 2024-05-20T22:11:04.971 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_8_[65622]: added half of the objects 2024-05-20T22:11:04.971 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_8_[65622]: added 50 objects... 2024-05-20T22:11:04.971 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_8_[65622]: added 50 objects 2024-05-20T22:11:04.972 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_8_[65622]: shutting down. 2024-05-20T22:11:04.972 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:04.972 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.303 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.303 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_9_[65668]: starting. 2024-05-20T22:11:05.303 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_9_[65668]: creating pool ceph_test_rados_list_parallel.smithi050-64432 2024-05-20T22:11:05.303 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_9_[65668]: created object 0... 2024-05-20T22:11:05.303 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_9_[65668]: created object 25... 2024-05-20T22:11:05.303 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_9_[65668]: created object 49... 2024-05-20T22:11:05.303 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_9_[65668]: finishing. 2024-05-20T22:11:05.303 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_9_[65668]: shutting down. 2024-05-20T22:11:05.304 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.304 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.304 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.304 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_10_[65669]: starting. 2024-05-20T22:11:05.304 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_10_[65669]: listing objects. 2024-05-20T22:11:05.304 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_10_[65669]: listed object 0... 2024-05-20T22:11:05.304 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_10_[65669]: listed object 25... 2024-05-20T22:11:05.304 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_10_[65669]: listed object 50... 2024-05-20T22:11:05.304 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_10_[65669]: listed object 75... 2024-05-20T22:11:05.304 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_10_[65669]: saw 98 objects 2024-05-20T22:11:05.304 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_10_[65669]: shutting down. 2024-05-20T22:11:05.304 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.304 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.304 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.305 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_13_[65672]: starting. 2024-05-20T22:11:05.305 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_13_[65672]: removed 25 objects... 2024-05-20T22:11:05.305 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_13_[65672]: removed half of the objects 2024-05-20T22:11:05.305 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_13_[65672]: removed 50 objects... 2024-05-20T22:11:05.305 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_13_[65672]: removed 50 objects 2024-05-20T22:11:05.305 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_13_[65672]: shutting down. 2024-05-20T22:11:05.305 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.305 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.305 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.305 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_12_[65671]: starting. 2024-05-20T22:11:05.305 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_12_[65671]: added 25 objects... 2024-05-20T22:11:05.305 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_12_[65671]: added half of the objects 2024-05-20T22:11:05.306 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_12_[65671]: added 50 objects... 2024-05-20T22:11:05.306 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_12_[65671]: added 50 objects 2024-05-20T22:11:05.306 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_12_[65671]: shutting down. 2024-05-20T22:11:05.306 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.306 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.306 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.306 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_11_[65670]: starting. 2024-05-20T22:11:05.306 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_11_[65670]: added 25 objects... 2024-05-20T22:11:05.306 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_11_[65670]: added half of the objects 2024-05-20T22:11:05.306 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_11_[65670]: added 50 objects... 2024-05-20T22:11:05.306 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_11_[65670]: added 50 objects 2024-05-20T22:11:05.306 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_11_[65670]: shutting down. 2024-05-20T22:11:05.306 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.306 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.307 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.307 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.307 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_14_[65834]: starting. 2024-05-20T22:11:05.307 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_14_[65834]: creating pool ceph_test_rados_list_parallel.smithi050-64432 2024-05-20T22:11:05.307 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_14_[65834]: created object 0... 2024-05-20T22:11:05.307 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_14_[65834]: created object 25... 2024-05-20T22:11:05.307 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_14_[65834]: created object 49... 2024-05-20T22:11:05.307 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_14_[65834]: finishing. 2024-05-20T22:11:05.307 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_14_[65834]: shutting down. 2024-05-20T22:11:05.307 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.307 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.307 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.308 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:05.308 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_15_[65835]: starting. 2024-05-20T22:11:05.308 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_15_[65835]: listing objects. 2024-05-20T22:11:05.308 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_15_[65835]: listed object 0... 2024-05-20T22:11:05.574 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: cluster 2024-05-20T22:11:03.949895+0000 mgr.y (mgr.14592) 176 : cluster 0 pgmap v124: 1284 pgs: 582 creating+peering, 539 unknown, 163 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:11:05.574 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: audit 2024-05-20T22:11:03.995584+0000 mon.a (mon.0) 976 : audit 1 from='client.24734 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi050-64159-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.574 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: audit 2024-05-20T22:11:03.995765+0000 mon.a (mon.0) 977 : audit 1 from='client.24874 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64323-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.575 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: audit 2024-05-20T22:11:03.995958+0000 mon.a (mon.0) 978 : audit 1 from='client.24743 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi050-64185-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.575 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: audit 2024-05-20T22:11:03.996148+0000 mon.a (mon.0) 979 : audit 1 from='client.24892 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64416-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.575 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: audit 2024-05-20T22:11:03.996322+0000 mon.a (mon.0) 980 : audit 1 from='client.24764 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi050-64235-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.575 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: audit 2024-05-20T22:11:03.996463+0000 mon.a (mon.0) 981 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.575 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: audit 2024-05-20T22:11:03.996670+0000 mon.a (mon.0) 982 : audit 1 from='client.24749 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi050-64207-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.575 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: audit 2024-05-20T22:11:03.996879+0000 mon.a (mon.0) 983 : audit 1 from='client.24701 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi050-64001-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.575 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: audit 2024-05-20T22:11:03.997064+0000 mon.a (mon.0) 984 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.575 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: audit 2024-05-20T22:11:03.997253+0000 mon.a (mon.0) 985 : audit 1 from='client.24695 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi050-63982-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.575 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: audit 2024-05-20T22:11:03.997439+0000 mon.a (mon.0) 986 : audit 1 from='client.24689 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi050-63960-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.575 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: audit 2024-05-20T22:11:03.997642+0000 mon.a (mon.0) 987 : audit 1 from='client.24728 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi050-64110-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: audit 2024-05-20T22:11:03.997825+0000 mon.a (mon.0) 988 : audit 1 from='client.24761 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:05.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: audit 2024-05-20T22:11:03.998010+0000 mon.a (mon.0) 989 : audit 1 from='client.24848 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64299-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: audit 2024-05-20T22:11:03.998195+0000 mon.a (mon.0) 990 : audit 1 from='client.24776 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi050-64391-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: audit 2024-05-20T22:11:04.012764+0000 mon.c (mon.2) 48 : audit 1 from='client.? v1:172.21.15.50:0/1506626568' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi050-64274-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:05.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: audit 2024-05-20T22:11:04.441806+0000 mon.b (mon.1) 39 : audit 0 from='client.? v1:172.21.15.50:0/1567180607' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:05.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: audit 2024-05-20T22:11:05.006491+0000 mon.b (mon.1) 40 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:05.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: cluster 2024-05-20T22:11:05.034785+0000 mon.a (mon.0) 991 : cluster 0 osdmap e79: 8 total, 8 up, 8 in 2024-05-20T22:11:05.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:05 smithi145 bash[23893]: audit 2024-05-20T22:11:05.037087+0000 mon.a (mon.0) 992 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi050-64274-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:05.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: cluster 2024-05-20T22:11:03.949895+0000 mgr.y (mgr.14592) 176 : cluster 0 pgmap v124: 1284 pgs: 582 creating+peering, 539 unknown, 163 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:11:05.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: audit 2024-05-20T22:11:03.995584+0000 mon.a (mon.0) 976 : audit 1 from='client.24734 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi050-64159-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: audit 2024-05-20T22:11:03.995765+0000 mon.a (mon.0) 977 : audit 1 from='client.24874 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64323-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: audit 2024-05-20T22:11:03.995958+0000 mon.a (mon.0) 978 : audit 1 from='client.24743 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi050-64185-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: audit 2024-05-20T22:11:03.996148+0000 mon.a (mon.0) 979 : audit 1 from='client.24892 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64416-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: audit 2024-05-20T22:11:03.996322+0000 mon.a (mon.0) 980 : audit 1 from='client.24764 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi050-64235-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: audit 2024-05-20T22:11:03.996463+0000 mon.a (mon.0) 981 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: audit 2024-05-20T22:11:03.996670+0000 mon.a (mon.0) 982 : audit 1 from='client.24749 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi050-64207-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: audit 2024-05-20T22:11:03.996879+0000 mon.a (mon.0) 983 : audit 1 from='client.24701 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi050-64001-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: audit 2024-05-20T22:11:03.997064+0000 mon.a (mon.0) 984 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: audit 2024-05-20T22:11:03.997253+0000 mon.a (mon.0) 985 : audit 1 from='client.24695 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi050-63982-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: audit 2024-05-20T22:11:03.997439+0000 mon.a (mon.0) 986 : audit 1 from='client.24689 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi050-63960-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: audit 2024-05-20T22:11:03.997642+0000 mon.a (mon.0) 987 : audit 1 from='client.24728 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi050-64110-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: cluster 2024-05-20T22:11:03.949895+0000 mgr.y (mgr.14592) 176 : cluster 0 pgmap v124: 1284 pgs: 582 creating+peering, 539 unknown, 163 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:11:05.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: audit 2024-05-20T22:11:03.995584+0000 mon.a (mon.0) 976 : audit 1 from='client.24734 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi050-64159-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: audit 2024-05-20T22:11:03.995765+0000 mon.a (mon.0) 977 : audit 1 from='client.24874 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64323-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: audit 2024-05-20T22:11:03.995958+0000 mon.a (mon.0) 978 : audit 1 from='client.24743 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi050-64185-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: audit 2024-05-20T22:11:03.996148+0000 mon.a (mon.0) 979 : audit 1 from='client.24892 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64416-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: audit 2024-05-20T22:11:03.996322+0000 mon.a (mon.0) 980 : audit 1 from='client.24764 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi050-64235-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: audit 2024-05-20T22:11:03.996463+0000 mon.a (mon.0) 981 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: audit 2024-05-20T22:11:03.996670+0000 mon.a (mon.0) 982 : audit 1 from='client.24749 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi050-64207-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: audit 2024-05-20T22:11:03.996879+0000 mon.a (mon.0) 983 : audit 1 from='client.24701 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi050-64001-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: audit 2024-05-20T22:11:03.997064+0000 mon.a (mon.0) 984 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: audit 2024-05-20T22:11:03.997253+0000 mon.a (mon.0) 985 : audit 1 from='client.24695 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi050-63982-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: audit 2024-05-20T22:11:03.997439+0000 mon.a (mon.0) 986 : audit 1 from='client.24689 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi050-63960-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: audit 2024-05-20T22:11:03.997642+0000 mon.a (mon.0) 987 : audit 1 from='client.24728 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi050-64110-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: audit 2024-05-20T22:11:03.997825+0000 mon.a (mon.0) 988 : audit 1 from='client.24761 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:05.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: audit 2024-05-20T22:11:03.998010+0000 mon.a (mon.0) 989 : audit 1 from='client.24848 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64299-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: audit 2024-05-20T22:11:03.998195+0000 mon.a (mon.0) 990 : audit 1 from='client.24776 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi050-64391-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: audit 2024-05-20T22:11:04.012764+0000 mon.c (mon.2) 48 : audit 1 from='client.? v1:172.21.15.50:0/1506626568' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi050-64274-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:05.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: audit 2024-05-20T22:11:04.441806+0000 mon.b (mon.1) 39 : audit 0 from='client.? v1:172.21.15.50:0/1567180607' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:05.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: audit 2024-05-20T22:11:05.006491+0000 mon.b (mon.1) 40 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:05.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: cluster 2024-05-20T22:11:05.034785+0000 mon.a (mon.0) 991 : cluster 0 osdmap e79: 8 total, 8 up, 8 in 2024-05-20T22:11:05.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:05 smithi050 bash[21866]: audit 2024-05-20T22:11:05.037087+0000 mon.a (mon.0) 992 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi050-64274-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:05.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: audit 2024-05-20T22:11:03.997825+0000 mon.a (mon.0) 988 : audit 1 from='client.24761 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:05.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: audit 2024-05-20T22:11:03.998010+0000 mon.a (mon.0) 989 : audit 1 from='client.24848 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64299-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: audit 2024-05-20T22:11:03.998195+0000 mon.a (mon.0) 990 : audit 1 from='client.24776 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi050-64391-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:05.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: audit 2024-05-20T22:11:04.012764+0000 mon.c (mon.2) 48 : audit 1 from='client.? v1:172.21.15.50:0/1506626568' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi050-64274-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:05.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: audit 2024-05-20T22:11:04.441806+0000 mon.b (mon.1) 39 : audit 0 from='client.? v1:172.21.15.50:0/1567180607' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-05-20T22:11:05.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: audit 2024-05-20T22:11:05.006491+0000 mon.b (mon.1) 40 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:05.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: cluster 2024-05-20T22:11:05.034785+0000 mon.a (mon.0) 991 : cluster 0 osdmap e79: 8 total, 8 up, 8 in 2024-05-20T22:11:05.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:05 smithi050 bash[28929]: audit 2024-05-20T22:11:05.037087+0000 mon.a (mon.0) 992 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi050-64274-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:06.522 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_15_[65835]: listed object 2 api_c_read_operations: Running main() from gmock_main.cc 2024-05-20T22:11:06.523 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2024-05-20T22:11:06.523 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [----------] Global test environment set-up. 2024-05-20T22:11:06.523 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2024-05-20T22:11:06.523 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2024-05-20T22:11:06.523 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2024-05-20T22:11:06.523 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2024-05-20T22:11:06.523 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (211 ms) 2024-05-20T22:11:06.523 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2024-05-20T22:11:06.523 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (20 ms) 2024-05-20T22:11:06.523 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2024-05-20T22:11:06.523 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (61 ms) 2024-05-20T22:11:06.524 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2024-05-20T22:11:06.524 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (19 ms) 2024-05-20T22:11:06.524 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2024-05-20T22:11:06.524 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (6 ms) 2024-05-20T22:11:06.524 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2024-05-20T22:11:06.524 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (16 ms) 2024-05-20T22:11:06.524 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2024-05-20T22:11:06.524 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (7 ms) 2024-05-20T22:11:06.524 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2024-05-20T22:11:06.524 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (13 ms) 2024-05-20T22:11:06.524 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2024-05-20T22:11:06.524 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (28 ms) 2024-05-20T22:11:06.524 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2024-05-20T22:11:06.524 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (13 ms) 2024-05-20T22:11:06.525 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2024-05-20T22:11:06.525 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (5 ms) 2024-05-20T22:11:06.525 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2024-05-20T22:11:06.525 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (13 ms) 2024-05-20T22:11:06.525 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2024-05-20T22:11:06.525 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (16 ms) 2024-05-20T22:11:06.525 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2024-05-20T22:11:06.525 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (29 ms) 2024-05-20T22:11:06.525 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2024-05-20T22:11:06.525 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (24 ms) 2024-05-20T22:11:06.525 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2024-05-20T22:11:06.525 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (5 ms) 2024-05-20T22:11:06.525 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (486 ms total) 2024-05-20T22:11:06.525 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: 2024-05-20T22:11:06.526 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [----------] Global test environment tear-down 2024-05-20T22:11:06.526 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (19598 ms total) 2024-05-20T22:11:06.526 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2024-05-20T22:11:06.638 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: Running main() from gmock_main.cc 2024-05-20T22:11:06.638 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2024-05-20T22:11:06.638 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [----------] Global test environment set-up. 2024-05-20T22:11:06.638 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2024-05-20T22:11:06.638 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2024-05-20T22:11:06.638 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (85 ms) 2024-05-20T22:11:06.638 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2024-05-20T22:11:06.638 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (68 ms) 2024-05-20T22:11:06.639 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2024-05-20T22:11:06.639 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (19501 ms) 2024-05-20T22:11:06.639 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2024-05-20T22:11:06.639 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:03.995584+0000 mon.a [INF] from='client.24734 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi050-64159-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:06.639 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:03.995765+0000 mon.a [INF] from='client.24874 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64323-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:06.639 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:03.995958+0000 mon.a [INF] from='client.24743 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi050-64185-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:06.639 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:03.996148+0000 mon.a [INF] from='client.24892 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64416-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:06.639 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:03.996322+0000 mon.a [INF] from='client.24764 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi050-64235-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:06.639 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:03.996463+0000 mon.a [INF] from='client.24725 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:06.639 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:03.996670+0000 mon.a [INF] from='client.24749 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi050-64207-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:06.639 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:03.996879+0000 mon.a [INF] from='client.24701 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi050-64001-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:06.639 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:03.997064+0000 mon.a [INF] from='client.24707 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:06.639 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:03.997253+0000 mon.a [INF] from='client.24695 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi050-63982-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:06.639 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:03.997439+0000 mon.a [INF] from='client.24689 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi050-63960-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:06.640 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:03.997642+0000 mon.a [INF] from='client.24728 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi050-64110-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:07.890 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:11:07 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:11:08.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:07 smithi145 bash[23893]: audit 2024-05-20T22:11:05.094572+0000 mon.a (mon.0) 993 : audit 1 from='client.24922 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi050-64724-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi050-64724-1"}]': finished 2024-05-20T22:11:08.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:07 smithi145 bash[23893]: audit 2024-05-20T22:11:05.094662+0000 mon.a (mon.0) 994 : audit 1 from='client.24875 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi050-64823-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi050-64823-1"}]': finished 2024-05-20T22:11:08.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:07 smithi145 bash[23893]: audit 2024-05-20T22:11:05.146222+0000 mon.b (mon.1) 41 : audit 1 from='client.? v1:172.21.15.50:0/1699601029' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:08.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:07 smithi145 bash[23893]: cluster 2024-05-20T22:11:05.577554+0000 mon.a (mon.0) 995 : cluster 0 osdmap e80: 8 total, 8 up, 8 in 2024-05-20T22:11:08.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:07 smithi145 bash[23893]: audit 2024-05-20T22:11:06.008580+0000 mon.b (mon.1) 42 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:08.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:07 smithi050 bash[21866]: audit 2024-05-20T22:11:05.094572+0000 mon.a (mon.0) 993 : audit 1 from='client.24922 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi050-64724-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi050-64724-1"}]': finished 2024-05-20T22:11:08.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:07 smithi050 bash[21866]: audit 2024-05-20T22:11:05.094662+0000 mon.a (mon.0) 994 : audit 1 from='client.24875 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi050-64823-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi050-64823-1"}]': finished 2024-05-20T22:11:08.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:07 smithi050 bash[21866]: audit 2024-05-20T22:11:05.146222+0000 mon.b (mon.1) 41 : audit 1 from='client.? v1:172.21.15.50:0/1699601029' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:08.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:07 smithi050 bash[21866]: cluster 2024-05-20T22:11:05.577554+0000 mon.a (mon.0) 995 : cluster 0 osdmap e80: 8 total, 8 up, 8 in 2024-05-20T22:11:08.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:07 smithi050 bash[21866]: audit 2024-05-20T22:11:06.008580+0000 mon.b (mon.1) 42 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:08.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:07 smithi050 bash[28929]: audit 2024-05-20T22:11:05.094572+0000 mon.a (mon.0) 993 : audit 1 from='client.24922 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi050-64724-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi050-64724-1"}]': finished 2024-05-20T22:11:08.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:07 smithi050 bash[28929]: audit 2024-05-20T22:11:05.094662+0000 mon.a (mon.0) 994 : audit 1 from='client.24875 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi050-64823-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi050-64823-1"}]': finished 2024-05-20T22:11:08.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:07 smithi050 bash[28929]: audit 2024-05-20T22:11:05.146222+0000 mon.b (mon.1) 41 : audit 1 from='client.? v1:172.21.15.50:0/1699601029' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:08.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:07 smithi050 bash[28929]: cluster 2024-05-20T22:11:05.577554+0000 mon.a (mon.0) 995 : cluster 0 osdmap e80: 8 total, 8 up, 8 in 2024-05-20T22:11:08.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:07 smithi050 bash[28929]: audit 2024-05-20T22:11:06.008580+0000 mon.b (mon.1) 42 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:09.363 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:03.997825+0000 mon.a [INF] from='client.24761 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:09.363 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:03.998010+0000 mon.a [INF] from='client.24848 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64299-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:09.363 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:03.998195+0000 mon.a [INF] from='client.24776 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi050-64391-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:09.363 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:04.012764+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/1506626568' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi050-64274-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:09.363 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:05.037087+0000 mon.a [INF] from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi050-64274-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:09.363 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:05.094572+0000 mon.a [INF] from='client.24922 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi050-64724-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi050-64724-1"}]': finished 2024-05-20T22:11:09.364 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:05.094662+0000 mon.a [INF] from='client.24875 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi050-64823-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi050-64823-1"}]': finished 2024-05-20T22:11:09.364 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:05.146222+0000 mon.b [INF] from='client.? v1:172.21.15.50:0/1699601029' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:09.364 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:06.507477+0000 mon.a [INF] from='client.24761 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi050-64274-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]': finished 2024-05-20T22:11:09.364 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:06.541434+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/387366744' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:09.364 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:06.541786+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:09.364 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:06.582841+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/1294638237' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:09.364 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:06.596134+0000 mon.b [INF] from='client.? v1:172.21.15.50:0/3704587449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:09.364 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:06.629230+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/2002456243' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:09.386 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:06.643459+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/4115332521' entity='cli5... 2024-05-20T22:11:09.386 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_15_[65835]: listed object 50... 2024-05-20T22:11:09.386 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_15_[65835]: listed object 75... 2024-05-20T22:11:09.386 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_15_[65835]: listed object 100... 2024-05-20T22:11:09.387 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_15_[65835]: listed object 125... 2024-05-20T22:11:09.387 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_15_[65835]: saw 150 objects 2024-05-20T22:11:09.387 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_15_[65835]: shutting down. 2024-05-20T22:11:09.387 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:09.387 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:09.387 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:09.387 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:09.387 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_16_[65836]: starting. 2024-05-20T22:11:09.387 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_16_[65836]: added 25 objects... 2024-05-20T22:11:09.387 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_16_[65836]: added half of the objects 2024-05-20T22:11:09.388 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_16_[65836]: added 50 objects... 2024-05-20T22:11:09.388 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_16_[65836]: added 50 objects 2024-05-20T22:11:09.388 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: process_16_[65836]: shutting down. 2024-05-20T22:11:09.388 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:09.388 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:09.388 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:09.388 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:09.388 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******************************* 2024-05-20T22:11:09.389 INFO:tasks.workunit.client.0.smithi050.stdout: list_parallel: ******* SUCCESS ********** 2024-05-20T22:11:09.422 INFO:tasks.workunit.client.0.smithi050.stdout: handler_error: Running main() from gmock_main.cc 2024-05-20T22:11:09.422 INFO:tasks.workunit.client.0.smithi050.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2024-05-20T22:11:09.422 INFO:tasks.workunit.client.0.smithi050.stdout: handler_error: [----------] Global test environment set-up. 2024-05-20T22:11:09.422 INFO:tasks.workunit.client.0.smithi050.stdout: handler_error: [----------] 1 test from neocls_handler_error 2024-05-20T22:11:09.423 INFO:tasks.workunit.client.0.smithi050.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2024-05-20T22:11:09.423 INFO:tasks.workunit.client.0.smithi050.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (22368 ms) 2024-05-20T22:11:09.423 INFO:tasks.workunit.client.0.smithi050.stdout: handler_error: [----------] 1 test from neocls_handler_error (22368 ms total) 2024-05-20T22:11:09.423 INFO:tasks.workunit.client.0.smithi050.stdout: handler_error: 2024-05-20T22:11:09.423 INFO:tasks.workunit.client.0.smithi050.stdout: handler_error: [----------] Global test environment tear-down 2024-05-20T22:11:09.423 INFO:tasks.workunit.client.0.smithi050.stdout: handler_error: [==========] 1 test from 1 test suite ran. (22368 ms total) 2024-05-20T22:11:09.423 INFO:tasks.workunit.client.0.smithi050.stdout: handler_error: [ PASSED ] 1 test. 2024-05-20T22:11:09.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: cluster 2024-05-20T22:11:05.951628+0000 mgr.y (mgr.14592) 177 : cluster 0 pgmap v127: 1076 pgs: 102 creating+peering, 74 unknown, 900 active+clean; 640 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 76 KiB/s wr, 194 op/s 2024-05-20T22:11:09.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:06.507477+0000 mon.a (mon.0) 996 : audit 1 from='client.24761 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi050-64274-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]': finished 2024-05-20T22:11:09.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:06.541434+0000 mon.c (mon.2) 49 : audit 1 from='client.? v1:172.21.15.50:0/387366744' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:09.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:06.541786+0000 mon.c (mon.2) 50 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:09.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:06.582841+0000 mon.c (mon.2) 51 : audit 1 from='client.? v1:172.21.15.50:0/1294638237' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:09.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:06.596134+0000 mon.b (mon.1) 43 : audit 1 from='client.? v1:172.21.15.50:0/3704587449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:09.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:06.629230+0000 mon.c (mon.2) 52 : audit 1 from='client.? v1:172.21.15.50:0/2002456243' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:09.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:06.643459+0000 mon.c (mon.2) 53 : audit 1 from='client.? v1:172.21.15.50:0/4115332521' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-05-20T22:11:09.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: cluster 2024-05-20T22:11:06.643806+0000 client.admin (client.25241) 0 : cluster 1 onexx 2024-05-20T22:11:09.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:07.011875+0000 mon.b (mon.1) 44 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:09.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:07.643619+0000 mgr.y (mgr.14592) 178 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:09.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:07.703357+0000 mon.c (mon.2) 54 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2024-05-20T22:11:09.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:07.704541+0000 mon.c (mon.2) 55 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2024-05-20T22:11:09.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:07.705543+0000 mon.c (mon.2) 56 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2024-05-20T22:11:09.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:07.706447+0000 mon.c (mon.2) 57 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2024-05-20T22:11:09.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:07.707428+0000 mon.c (mon.2) 58 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2024-05-20T22:11:09.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:07.708533+0000 mon.c (mon.2) 59 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2024-05-20T22:11:09.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:07.709562+0000 mon.c (mon.2) 60 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2024-05-20T22:11:09.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:07.710503+0000 mon.c (mon.2) 61 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2024-05-20T22:11:09.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:07.711551+0000 mon.c (mon.2) 62 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2024-05-20T22:11:09.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:07.712615+0000 mon.c (mon.2) 63 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2024-05-20T22:11:09.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: cluster 2024-05-20T22:11:07.950849+0000 mon.a (mon.0) 997 : cluster 0 osdmap e81: 8 total, 8 up, 8 in 2024-05-20T22:11:09.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: cluster 2024-05-20T22:11:07.952430+0000 mon.a (mon.0) 998 : cluster 3 Health check update: 16 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:09.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:07.968652+0000 mon.a (mon.0) 999 : audit 1 from='client.25109 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:09.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:07.968958+0000 mon.a (mon.0) 1000 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:09.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:07.969372+0000 mon.a (mon.0) 1001 : audit 1 from='client.25223 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:09.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:07.969973+0000 mon.a (mon.0) 1002 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:09.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:09 smithi145 bash[23893]: audit 2024-05-20T22:11:07.970340+0000 mon.a (mon.0) 1003 : audit 1 from='client.25241 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-05-20T22:11:09.692 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:11:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:11:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:11:09.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: cluster 2024-05-20T22:11:05.951628+0000 mgr.y (mgr.14592) 177 : cluster 0 pgmap v127: 1076 pgs: 102 creating+peering, 74 unknown, 900 active+clean; 640 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 76 KiB/s wr, 194 op/s 2024-05-20T22:11:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:06.507477+0000 mon.a (mon.0) 996 : audit 1 from='client.24761 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi050-64274-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]': finished 2024-05-20T22:11:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:06.541434+0000 mon.c (mon.2) 49 : audit 1 from='client.? v1:172.21.15.50:0/387366744' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:06.541786+0000 mon.c (mon.2) 50 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:06.582841+0000 mon.c (mon.2) 51 : audit 1 from='client.? v1:172.21.15.50:0/1294638237' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:06.596134+0000 mon.b (mon.1) 43 : audit 1 from='client.? v1:172.21.15.50:0/3704587449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:06.629230+0000 mon.c (mon.2) 52 : audit 1 from='client.? v1:172.21.15.50:0/2002456243' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:06.643459+0000 mon.c (mon.2) 53 : audit 1 from='client.? v1:172.21.15.50:0/4115332521' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-05-20T22:11:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: cluster 2024-05-20T22:11:06.643806+0000 client.admin (client.25241) 0 : cluster 1 onexx 2024-05-20T22:11:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:07.011875+0000 mon.b (mon.1) 44 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:07.643619+0000 mgr.y (mgr.14592) 178 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:07.703357+0000 mon.c (mon.2) 54 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2024-05-20T22:11:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:07.704541+0000 mon.c (mon.2) 55 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2024-05-20T22:11:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:07.705543+0000 mon.c (mon.2) 56 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2024-05-20T22:11:09.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:07.706447+0000 mon.c (mon.2) 57 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2024-05-20T22:11:09.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: cluster 2024-05-20T22:11:05.951628+0000 mgr.y (mgr.14592) 177 : cluster 0 pgmap v127: 1076 pgs: 102 creating+peering, 74 unknown, 900 active+clean; 640 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 76 KiB/s wr, 194 op/s 2024-05-20T22:11:09.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:06.507477+0000 mon.a (mon.0) 996 : audit 1 from='client.24761 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi050-64274-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]': finished 2024-05-20T22:11:09.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:06.541434+0000 mon.c (mon.2) 49 : audit 1 from='client.? v1:172.21.15.50:0/387366744' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:09.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:06.541786+0000 mon.c (mon.2) 50 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:09.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:06.582841+0000 mon.c (mon.2) 51 : audit 1 from='client.? v1:172.21.15.50:0/1294638237' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:09.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:06.596134+0000 mon.b (mon.1) 43 : audit 1 from='client.? v1:172.21.15.50:0/3704587449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:09.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:06.629230+0000 mon.c (mon.2) 52 : audit 1 from='client.? v1:172.21.15.50:0/2002456243' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:09.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:06.643459+0000 mon.c (mon.2) 53 : audit 1 from='client.? v1:172.21.15.50:0/4115332521' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-05-20T22:11:09.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: cluster 2024-05-20T22:11:06.643806+0000 client.admin (client.25241) 0 : cluster 1 onexx 2024-05-20T22:11:09.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:07.011875+0000 mon.b (mon.1) 44 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:09.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:07.643619+0000 mgr.y (mgr.14592) 178 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:09.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:07.703357+0000 mon.c (mon.2) 54 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2024-05-20T22:11:09.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:07.704541+0000 mon.c (mon.2) 55 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2024-05-20T22:11:09.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:07.705543+0000 mon.c (mon.2) 56 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2024-05-20T22:11:09.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:07.706447+0000 mon.c (mon.2) 57 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2024-05-20T22:11:09.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:07.707428+0000 mon.c (mon.2) 58 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2024-05-20T22:11:09.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:07.708533+0000 mon.c (mon.2) 59 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2024-05-20T22:11:09.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:07.709562+0000 mon.c (mon.2) 60 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2024-05-20T22:11:09.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:07.710503+0000 mon.c (mon.2) 61 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2024-05-20T22:11:09.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:07.711551+0000 mon.c (mon.2) 62 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2024-05-20T22:11:09.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:07.712615+0000 mon.c (mon.2) 63 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2024-05-20T22:11:09.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: cluster 2024-05-20T22:11:07.950849+0000 mon.a (mon.0) 997 : cluster 0 osdmap e81: 8 total, 8 up, 8 in 2024-05-20T22:11:09.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: cluster 2024-05-20T22:11:07.952430+0000 mon.a (mon.0) 998 : cluster 3 Health check update: 16 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:09.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:07.968652+0000 mon.a (mon.0) 999 : audit 1 from='client.25109 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:09.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:07.968958+0000 mon.a (mon.0) 1000 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:09.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:07.969372+0000 mon.a (mon.0) 1001 : audit 1 from='client.25223 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:09.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:07.969973+0000 mon.a (mon.0) 1002 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:09.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:09 smithi050 bash[21866]: audit 2024-05-20T22:11:07.970340+0000 mon.a (mon.0) 1003 : audit 1 from='client.25241 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-05-20T22:11:09.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:07.707428+0000 mon.c (mon.2) 58 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2024-05-20T22:11:09.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:07.708533+0000 mon.c (mon.2) 59 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2024-05-20T22:11:09.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:07.709562+0000 mon.c (mon.2) 60 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2024-05-20T22:11:09.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:07.710503+0000 mon.c (mon.2) 61 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2024-05-20T22:11:09.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:07.711551+0000 mon.c (mon.2) 62 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2024-05-20T22:11:09.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:07.712615+0000 mon.c (mon.2) 63 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2024-05-20T22:11:09.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: cluster 2024-05-20T22:11:07.950849+0000 mon.a (mon.0) 997 : cluster 0 osdmap e81: 8 total, 8 up, 8 in 2024-05-20T22:11:09.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: cluster 2024-05-20T22:11:07.952430+0000 mon.a (mon.0) 998 : cluster 3 Health check update: 16 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:09.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:07.968652+0000 mon.a (mon.0) 999 : audit 1 from='client.25109 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:09.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:07.968958+0000 mon.a (mon.0) 1000 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:09.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:07.969372+0000 mon.a (mon.0) 1001 : audit 1 from='client.25223 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:09.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:07.969973+0000 mon.a (mon.0) 1002 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:09.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:09 smithi050 bash[28929]: audit 2024-05-20T22:11:07.970340+0000 mon.a (mon.0) 1003 : audit 1 from='client.25241 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-05-20T22:11:10.796 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2024-05-20T22:11:10.796 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2024-05-20T22:11:10.796 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2024-05-20T22:11:10.796 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2024-05-20T22:11:10.797 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [ OK ] ClsTestRemoteReads.TestGather (23803 ms) 2024-05-20T22:11:10.797 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (23803 ms total) 2024-05-20T22:11:10.797 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: 2024-05-20T22:11:10.797 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2024-05-20T22:11:10.797 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (23803 ms total) 2024-05-20T22:11:10.797 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [ PASSED ] 1 test. 2024-05-20T22:11:10.802 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: Running main() from gmock_main.cc 2024-05-20T22:11:10.802 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2024-05-20T22:11:10.802 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [----------] Global test environment set-up. 2024-05-20T22:11:10.802 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2024-05-20T22:11:10.802 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2024-05-20T22:11:10.802 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (54 ms) 2024-05-20T22:11:10.802 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2024-05-20T22:11:10.802 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (55 ms) 2024-05-20T22:11:10.803 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2024-05-20T22:11:10.803 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (23801 ms) 2024-05-20T22:11:10.803 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (23911 ms total) 2024-05-20T22:11:10.803 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: 2024-05-20T22:11:10.803 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [----------] Global test environment tear-down 2024-05-20T22:11:10.803 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (23911 ms total) 2024-05-20T22:11:10.803 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2024-05-20T22:11:11.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:07.703675+0000 mgr.y (mgr.14592) 179 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2024-05-20T22:11:11.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:07.704790+0000 mgr.y (mgr.14592) 180 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2024-05-20T22:11:11.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:07.705761+0000 mgr.y (mgr.14592) 181 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2024-05-20T22:11:11.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:07.706659+0000 mgr.y (mgr.14592) 182 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2024-05-20T22:11:11.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:07.707704+0000 mgr.y (mgr.14592) 183 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2024-05-20T22:11:11.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:07.708783+0000 mgr.y (mgr.14592) 184 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2024-05-20T22:11:11.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:07.709802+0000 mgr.y (mgr.14592) 185 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2024-05-20T22:11:11.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:07.710757+0000 mgr.y (mgr.14592) 186 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2024-05-20T22:11:11.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:07.711797+0000 mgr.y (mgr.14592) 187 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2024-05-20T22:11:11.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:07.712851+0000 mgr.y (mgr.14592) 188 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2024-05-20T22:11:11.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: cluster 2024-05-20T22:11:07.875460+0000 osd.1 (osd.1) 3 : cluster 0 18.3 deep-scrub starts 2024-05-20T22:11:11.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: cluster 2024-05-20T22:11:07.878137+0000 osd.1 (osd.1) 4 : cluster 0 18.3 deep-scrub ok 2024-05-20T22:11:11.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: cluster 2024-05-20T22:11:07.953583+0000 mgr.y (mgr.14592) 189 : cluster 0 pgmap v129: 924 pgs: 102 creating+peering, 146 unknown, 676 active+clean; 637 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 80 KiB/s wr, 192 op/s 2024-05-20T22:11:11.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:07.987809+0000 mon.c (mon.2) 64 : audit 1 from='client.? v1:172.21.15.50:0/2650810856' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:11.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:08.021499+0000 mon.b (mon.1) 45 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:11.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: cluster 2024-05-20T22:11:08.398210+0000 osd.2 (osd.2) 3 : cluster 0 18.7 deep-scrub starts 2024-05-20T22:11:11.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: cluster 2024-05-20T22:11:08.443020+0000 osd.2 (osd.2) 4 : cluster 0 18.7 deep-scrub ok 2024-05-20T22:11:11.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: cluster 2024-05-20T22:11:08.494775+0000 osd.0 (osd.0) 3 : cluster 0 18.0 deep-scrub starts 2024-05-20T22:11:11.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: cluster 2024-05-20T22:11:08.498981+0000 osd.0 (osd.0) 4 : cluster 0 18.0 deep-scrub ok 2024-05-20T22:11:11.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: cluster 2024-05-20T22:11:08.529610+0000 osd.3 (osd.3) 3 : cluster 0 18.9 deep-scrub starts 2024-05-20T22:11:11.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: cluster 2024-05-20T22:11:08.531943+0000 osd.3 (osd.3) 4 : cluster 0 18.9 deep-scrub ok 2024-05-20T22:11:11.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:08.887301+0000 mon.c (mon.2) 65 : audit 1 from='client.? v1:172.21.15.50:0/1294638237' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:11.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: cluster 2024-05-20T22:11:08.913716+0000 osd.1 (osd.1) 5 : cluster 0 18.5 deep-scrub starts 2024-05-20T22:11:11.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: cluster 2024-05-20T22:11:08.956112+0000 osd.1 (osd.1) 6 : cluster 0 18.5 deep-scrub ok 2024-05-20T22:11:11.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:09.023552+0000 mon.b (mon.1) 46 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:11.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:09.351032+0000 mon.c (mon.2) 66 : audit 1 from='client.? v1:172.21.15.50:0/2002456243' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:11.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: cluster 2024-05-20T22:11:09.353853+0000 mon.a (mon.0) 1004 : cluster 0 osdmap e82: 8 total, 8 up, 8 in 2024-05-20T22:11:11.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:09.364760+0000 mon.a (mon.0) 1005 : audit 1 from='client.25175 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:11.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:09.365864+0000 mon.a (mon.0) 1006 : audit 1 from='client.25223 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:11.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:09.366312+0000 mon.a (mon.0) 1007 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:11.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:09.368249+0000 mon.a (mon.0) 1008 : audit 1 from='client.25241 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-05-20T22:11:11.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:09.373787+0000 mon.c (mon.2) 67 : audit 1 from='client.? v1:172.21.15.50:0/4115332521' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-05-20T22:11:11.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: cluster 2024-05-20T22:11:09.377986+0000 client.admin (client.25241) 0 : cluster 1 twoxx 2024-05-20T22:11:11.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:09.379263+0000 mon.a (mon.0) 1009 : audit 1 from='client.25241 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-05-20T22:11:11.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:09.381389+0000 mon.a (mon.0) 1010 : audit 1 from='client.25109 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:11.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:09.381478+0000 mon.a (mon.0) 1011 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:11.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: cluster 2024-05-20T22:11:09.387873+0000 mon.a (mon.0) 1012 : cluster 0 osdmap e83: 8 total, 8 up, 8 in 2024-05-20T22:11:11.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:09.391568+0000 mon.c (mon.2) 68 : audit 1 from='client.? v1:172.21.15.50:0/3992385586' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:11.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:09.392008+0000 mon.c (mon.2) 69 : audit 1 from='client.? v1:172.21.15.50:0/1294638237' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:11.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:09.392226+0000 mon.c (mon.2) 70 : audit 1 from='client.? v1:172.21.15.50:0/2002456243' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi050-64185-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:11.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:09.413911+0000 mon.a (mon.0) 1013 : audit 1 from='client.25205 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:11.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:09.414268+0000 mon.a (mon.0) 1014 : audit 1 from='client.25223 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:11.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:09.414670+0000 mon.a (mon.0) 1015 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi050-64185-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:11.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:09.442836+0000 mon.b (mon.1) 47 : audit 1 from='client.? v1:172.21.15.50:0/1491560482' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:11.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:09.493371+0000 mon.c (mon.2) 71 : audit 1 from='client.? v1:172.21.15.50:0/3217909031' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:11.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: cluster 2024-05-20T22:11:09.534578+0000 osd.0 (osd.0) 5 : cluster 0 18.4 deep-scrub starts 2024-05-20T22:11:11.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: cluster 2024-05-20T22:11:09.535845+0000 osd.0 (osd.0) 6 : cluster 0 18.4 deep-scrub ok 2024-05-20T22:11:11.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: cluster 2024-05-20T22:11:09.553491+0000 osd.3 (osd.3) 5 : cluster 0 18.1 deep-scrub starts 2024-05-20T22:11:11.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: cluster 2024-05-20T22:11:09.556484+0000 osd.3 (osd.3) 6 : cluster 0 18.1 deep-scrub ok 2024-05-20T22:11:11.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:10.025463+0000 mon.b (mon.1) 48 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:11.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:10.319368+0000 mon.a (mon.0) 1016 : audit 1 from='client.25250 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:11.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:10.320454+0000 mon.c (mon.2) 72 : audit 1 from='client.? v1:172.21.15.50:0/3217909031' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:11.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:10.320918+0000 mon.a (mon.0) 1017 : audit 1 from='client.25250 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:11.146 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:10.321679+0000 mon.c (mon.2) 73 : audit 1 from='client.? v1:172.21.15.50:0/3217909031' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:11.146 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:10 smithi145 bash[23893]: audit 2024-05-20T22:11:10.322075+0000 mon.a (mon.0) 1018 : audit 1 from='client.25250 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:11.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:07.703675+0000 mgr.y (mgr.14592) 179 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2024-05-20T22:11:11.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:07.704790+0000 mgr.y (mgr.14592) 180 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2024-05-20T22:11:11.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:07.705761+0000 mgr.y (mgr.14592) 181 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2024-05-20T22:11:11.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:07.706659+0000 mgr.y (mgr.14592) 182 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2024-05-20T22:11:11.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:07.707704+0000 mgr.y (mgr.14592) 183 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2024-05-20T22:11:11.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:07.708783+0000 mgr.y (mgr.14592) 184 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2024-05-20T22:11:11.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:07.709802+0000 mgr.y (mgr.14592) 185 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2024-05-20T22:11:11.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:07.710757+0000 mgr.y (mgr.14592) 186 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2024-05-20T22:11:11.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:07.711797+0000 mgr.y (mgr.14592) 187 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2024-05-20T22:11:11.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:07.712851+0000 mgr.y (mgr.14592) 188 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2024-05-20T22:11:11.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: cluster 2024-05-20T22:11:07.875460+0000 osd.1 (osd.1) 3 : cluster 0 18.3 deep-scrub starts 2024-05-20T22:11:11.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: cluster 2024-05-20T22:11:07.878137+0000 osd.1 (osd.1) 4 : cluster 0 18.3 deep-scrub ok 2024-05-20T22:11:11.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: cluster 2024-05-20T22:11:07.953583+0000 mgr.y (mgr.14592) 189 : cluster 0 pgmap v129: 924 pgs: 102 creating+peering, 146 unknown, 676 active+clean; 637 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 80 KiB/s wr, 192 op/s 2024-05-20T22:11:11.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:07.987809+0000 mon.c (mon.2) 64 : audit 1 from='client.? v1:172.21.15.50:0/2650810856' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:11.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:08.021499+0000 mon.b (mon.1) 45 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:11.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: cluster 2024-05-20T22:11:08.398210+0000 osd.2 (osd.2) 3 : cluster 0 18.7 deep-scrub starts 2024-05-20T22:11:11.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: cluster 2024-05-20T22:11:08.443020+0000 osd.2 (osd.2) 4 : cluster 0 18.7 deep-scrub ok 2024-05-20T22:11:11.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: cluster 2024-05-20T22:11:08.494775+0000 osd.0 (osd.0) 3 : cluster 0 18.0 deep-scrub starts 2024-05-20T22:11:11.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: cluster 2024-05-20T22:11:08.498981+0000 osd.0 (osd.0) 4 : cluster 0 18.0 deep-scrub ok 2024-05-20T22:11:11.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: cluster 2024-05-20T22:11:08.529610+0000 osd.3 (osd.3) 3 : cluster 0 18.9 deep-scrub starts 2024-05-20T22:11:11.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: cluster 2024-05-20T22:11:08.531943+0000 osd.3 (osd.3) 4 : cluster 0 18.9 deep-scrub ok 2024-05-20T22:11:11.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:07.703675+0000 mgr.y (mgr.14592) 179 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2024-05-20T22:11:11.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:07.704790+0000 mgr.y (mgr.14592) 180 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2024-05-20T22:11:11.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:07.705761+0000 mgr.y (mgr.14592) 181 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2024-05-20T22:11:11.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:07.706659+0000 mgr.y (mgr.14592) 182 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2024-05-20T22:11:11.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:07.707704+0000 mgr.y (mgr.14592) 183 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2024-05-20T22:11:11.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:07.708783+0000 mgr.y (mgr.14592) 184 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2024-05-20T22:11:11.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:07.709802+0000 mgr.y (mgr.14592) 185 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2024-05-20T22:11:11.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:07.710757+0000 mgr.y (mgr.14592) 186 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2024-05-20T22:11:11.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:07.711797+0000 mgr.y (mgr.14592) 187 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2024-05-20T22:11:11.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:07.712851+0000 mgr.y (mgr.14592) 188 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2024-05-20T22:11:11.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: cluster 2024-05-20T22:11:07.875460+0000 osd.1 (osd.1) 3 : cluster 0 18.3 deep-scrub starts 2024-05-20T22:11:11.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: cluster 2024-05-20T22:11:07.878137+0000 osd.1 (osd.1) 4 : cluster 0 18.3 deep-scrub ok 2024-05-20T22:11:11.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: cluster 2024-05-20T22:11:07.953583+0000 mgr.y (mgr.14592) 189 : cluster 0 pgmap v129: 924 pgs: 102 creating+peering, 146 unknown, 676 active+clean; 637 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 80 KiB/s wr, 192 op/s 2024-05-20T22:11:11.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:07.987809+0000 mon.c (mon.2) 64 : audit 1 from='client.? v1:172.21.15.50:0/2650810856' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:11.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:08.021499+0000 mon.b (mon.1) 45 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:11.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: cluster 2024-05-20T22:11:08.398210+0000 osd.2 (osd.2) 3 : cluster 0 18.7 deep-scrub starts 2024-05-20T22:11:11.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: cluster 2024-05-20T22:11:08.443020+0000 osd.2 (osd.2) 4 : cluster 0 18.7 deep-scrub ok 2024-05-20T22:11:11.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: cluster 2024-05-20T22:11:08.494775+0000 osd.0 (osd.0) 3 : cluster 0 18.0 deep-scrub starts 2024-05-20T22:11:11.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: cluster 2024-05-20T22:11:08.498981+0000 osd.0 (osd.0) 4 : cluster 0 18.0 deep-scrub ok 2024-05-20T22:11:11.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: cluster 2024-05-20T22:11:08.529610+0000 osd.3 (osd.3) 3 : cluster 0 18.9 deep-scrub starts 2024-05-20T22:11:11.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: cluster 2024-05-20T22:11:08.531943+0000 osd.3 (osd.3) 4 : cluster 0 18.9 deep-scrub ok 2024-05-20T22:11:11.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:08.887301+0000 mon.c (mon.2) 65 : audit 1 from='client.? v1:172.21.15.50:0/1294638237' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:11.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: cluster 2024-05-20T22:11:08.913716+0000 osd.1 (osd.1) 5 : cluster 0 18.5 deep-scrub starts 2024-05-20T22:11:11.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: cluster 2024-05-20T22:11:08.956112+0000 osd.1 (osd.1) 6 : cluster 0 18.5 deep-scrub ok 2024-05-20T22:11:11.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:09.023552+0000 mon.b (mon.1) 46 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:11.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:09.351032+0000 mon.c (mon.2) 66 : audit 1 from='client.? v1:172.21.15.50:0/2002456243' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:11.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: cluster 2024-05-20T22:11:09.353853+0000 mon.a (mon.0) 1004 : cluster 0 osdmap e82: 8 total, 8 up, 8 in 2024-05-20T22:11:11.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:09.364760+0000 mon.a (mon.0) 1005 : audit 1 from='client.25175 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:11.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:09.365864+0000 mon.a (mon.0) 1006 : audit 1 from='client.25223 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:11.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:09.366312+0000 mon.a (mon.0) 1007 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:11.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:09.368249+0000 mon.a (mon.0) 1008 : audit 1 from='client.25241 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-05-20T22:11:11.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:09.373787+0000 mon.c (mon.2) 67 : audit 1 from='client.? v1:172.21.15.50:0/4115332521' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-05-20T22:11:11.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: cluster 2024-05-20T22:11:09.377986+0000 client.admin (client.25241) 0 : cluster 1 twoxx 2024-05-20T22:11:11.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:09.379263+0000 mon.a (mon.0) 1009 : audit 1 from='client.25241 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-05-20T22:11:11.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:09.381389+0000 mon.a (mon.0) 1010 : audit 1 from='client.25109 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:11.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:09.381478+0000 mon.a (mon.0) 1011 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:11.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: cluster 2024-05-20T22:11:09.387873+0000 mon.a (mon.0) 1012 : cluster 0 osdmap e83: 8 total, 8 up, 8 in 2024-05-20T22:11:11.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:09.391568+0000 mon.c (mon.2) 68 : audit 1 from='client.? v1:172.21.15.50:0/3992385586' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:11.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:09.392008+0000 mon.c (mon.2) 69 : audit 1 from='client.? v1:172.21.15.50:0/1294638237' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:11.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:08.887301+0000 mon.c (mon.2) 65 : audit 1 from='client.? v1:172.21.15.50:0/1294638237' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:11.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: cluster 2024-05-20T22:11:08.913716+0000 osd.1 (osd.1) 5 : cluster 0 18.5 deep-scrub starts 2024-05-20T22:11:11.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: cluster 2024-05-20T22:11:08.956112+0000 osd.1 (osd.1) 6 : cluster 0 18.5 deep-scrub ok 2024-05-20T22:11:11.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:09.023552+0000 mon.b (mon.1) 46 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:11.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:09.351032+0000 mon.c (mon.2) 66 : audit 1 from='client.? v1:172.21.15.50:0/2002456243' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:11.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: cluster 2024-05-20T22:11:09.353853+0000 mon.a (mon.0) 1004 : cluster 0 osdmap e82: 8 total, 8 up, 8 in 2024-05-20T22:11:11.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:09.364760+0000 mon.a (mon.0) 1005 : audit 1 from='client.25175 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:11.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:09.365864+0000 mon.a (mon.0) 1006 : audit 1 from='client.25223 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:11.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:09.366312+0000 mon.a (mon.0) 1007 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:11.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:09.368249+0000 mon.a (mon.0) 1008 : audit 1 from='client.25241 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-05-20T22:11:11.199 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:09.373787+0000 mon.c (mon.2) 67 : audit 1 from='client.? v1:172.21.15.50:0/4115332521' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-05-20T22:11:11.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: cluster 2024-05-20T22:11:09.377986+0000 client.admin (client.25241) 0 : cluster 1 twoxx 2024-05-20T22:11:11.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:09.379263+0000 mon.a (mon.0) 1009 : audit 1 from='client.25241 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-05-20T22:11:11.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:09.381389+0000 mon.a (mon.0) 1010 : audit 1 from='client.25109 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:11.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:09.381478+0000 mon.a (mon.0) 1011 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:11.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: cluster 2024-05-20T22:11:09.387873+0000 mon.a (mon.0) 1012 : cluster 0 osdmap e83: 8 total, 8 up, 8 in 2024-05-20T22:11:11.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:09.391568+0000 mon.c (mon.2) 68 : audit 1 from='client.? v1:172.21.15.50:0/3992385586' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:11.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:09.392008+0000 mon.c (mon.2) 69 : audit 1 from='client.? v1:172.21.15.50:0/1294638237' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:11.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:09.392226+0000 mon.c (mon.2) 70 : audit 1 from='client.? v1:172.21.15.50:0/2002456243' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi050-64185-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:11.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:09.413911+0000 mon.a (mon.0) 1013 : audit 1 from='client.25205 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:11.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:09.414268+0000 mon.a (mon.0) 1014 : audit 1 from='client.25223 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:11.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:09.414670+0000 mon.a (mon.0) 1015 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi050-64185-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:11.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:09.442836+0000 mon.b (mon.1) 47 : audit 1 from='client.? v1:172.21.15.50:0/1491560482' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:11.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:09.493371+0000 mon.c (mon.2) 71 : audit 1 from='client.? v1:172.21.15.50:0/3217909031' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:11.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: cluster 2024-05-20T22:11:09.534578+0000 osd.0 (osd.0) 5 : cluster 0 18.4 deep-scrub starts 2024-05-20T22:11:11.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: cluster 2024-05-20T22:11:09.535845+0000 osd.0 (osd.0) 6 : cluster 0 18.4 deep-scrub ok 2024-05-20T22:11:11.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: cluster 2024-05-20T22:11:09.553491+0000 osd.3 (osd.3) 5 : cluster 0 18.1 deep-scrub starts 2024-05-20T22:11:11.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: cluster 2024-05-20T22:11:09.556484+0000 osd.3 (osd.3) 6 : cluster 0 18.1 deep-scrub ok 2024-05-20T22:11:11.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:10.025463+0000 mon.b (mon.1) 48 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:11.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:10.319368+0000 mon.a (mon.0) 1016 : audit 1 from='client.25250 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:11.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:10.320454+0000 mon.c (mon.2) 72 : audit 1 from='client.? v1:172.21.15.50:0/3217909031' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:11.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:10.320918+0000 mon.a (mon.0) 1017 : audit 1 from='client.25250 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:11.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:10.321679+0000 mon.c (mon.2) 73 : audit 1 from='client.? v1:172.21.15.50:0/3217909031' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:11.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:10 smithi050 bash[21866]: audit 2024-05-20T22:11:10.322075+0000 mon.a (mon.0) 1018 : audit 1 from='client.25250 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:11.202 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:09.392226+0000 mon.c (mon.2) 70 : audit 1 from='client.? v1:172.21.15.50:0/2002456243' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi050-64185-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:11.202 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:09.413911+0000 mon.a (mon.0) 1013 : audit 1 from='client.25205 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:11.202 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:09.414268+0000 mon.a (mon.0) 1014 : audit 1 from='client.25223 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:11.202 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:09.414670+0000 mon.a (mon.0) 1015 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi050-64185-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:11.202 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:09.442836+0000 mon.b (mon.1) 47 : audit 1 from='client.? v1:172.21.15.50:0/1491560482' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:11.202 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:09.493371+0000 mon.c (mon.2) 71 : audit 1 from='client.? v1:172.21.15.50:0/3217909031' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:11.202 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: cluster 2024-05-20T22:11:09.534578+0000 osd.0 (osd.0) 5 : cluster 0 18.4 deep-scrub starts 2024-05-20T22:11:11.202 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: cluster 2024-05-20T22:11:09.535845+0000 osd.0 (osd.0) 6 : cluster 0 18.4 deep-scrub ok 2024-05-20T22:11:11.202 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: cluster 2024-05-20T22:11:09.553491+0000 osd.3 (osd.3) 5 : cluster 0 18.1 deep-scrub starts 2024-05-20T22:11:11.203 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: cluster 2024-05-20T22:11:09.556484+0000 osd.3 (osd.3) 6 : cluster 0 18.1 deep-scrub ok 2024-05-20T22:11:11.203 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:10.025463+0000 mon.b (mon.1) 48 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:11.203 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:10.319368+0000 mon.a (mon.0) 1016 : audit 1 from='client.25250 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:11.203 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:10.320454+0000 mon.c (mon.2) 72 : audit 1 from='client.? v1:172.21.15.50:0/3217909031' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:11.203 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:10.320918+0000 mon.a (mon.0) 1017 : audit 1 from='client.25250 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:11.203 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:10.321679+0000 mon.c (mon.2) 73 : audit 1 from='client.? v1:172.21.15.50:0/3217909031' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:11.203 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:10 smithi050 bash[28929]: audit 2024-05-20T22:11:10.322075+0000 mon.a (mon.0) 1018 : audit 1 from='client.25250 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:12.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: cluster 2024-05-20T22:11:09.959071+0000 mgr.y (mgr.14592) 190 : cluster 0 pgmap v132: 988 pgs: 235 creating+peering, 753 active+clean; 145 MiB data, 700 MiB used, 715 GiB / 715 GiB avail; 9.9 MiB/s rd, 31 MiB/s wr, 234 op/s 2024-05-20T22:11:12.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: audit 2024-05-20T22:11:10.761944+0000 mon.a (mon.0) 1019 : audit 1 from='client.25241 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-05-20T22:11:12.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: audit 2024-05-20T22:11:10.782379+0000 mon.a (mon.0) 1020 : audit 1 from='client.25180 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:12.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: audit 2024-05-20T22:11:10.782819+0000 mon.a (mon.0) 1021 : audit 1 from='client.25175 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:12.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: audit 2024-05-20T22:11:10.783010+0000 mon.a (mon.0) 1022 : audit 1 from='client.25205 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:12.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: audit 2024-05-20T22:11:10.783243+0000 mon.a (mon.0) 1023 : audit 1 from='client.25223 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:12.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: audit 2024-05-20T22:11:10.783428+0000 mon.a (mon.0) 1024 : audit 1 from='client.25238 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi050-64185-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:12.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: audit 2024-05-20T22:11:10.783607+0000 mon.a (mon.0) 1025 : audit 1 from='client.25250 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:12.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: audit 2024-05-20T22:11:10.786908+0000 mon.c (mon.2) 74 : audit 1 from='client.? v1:172.21.15.50:0/1294638237' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi050-63960-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:12.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: audit 2024-05-20T22:11:10.787174+0000 mon.c (mon.2) 75 : audit 1 from='client.? v1:172.21.15.50:0/2002456243' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi050-64185-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:12.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: audit 2024-05-20T22:11:10.787360+0000 mon.c (mon.2) 76 : audit 1 from='client.? v1:172.21.15.50:0/3217909031' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi050-64001-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:12.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: audit 2024-05-20T22:11:10.791944+0000 mon.c (mon.2) 77 : audit 1 from='client.? v1:172.21.15.50:0/387366744' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:12.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: audit 2024-05-20T22:11:10.792204+0000 mon.c (mon.2) 78 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:12.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: audit 2024-05-20T22:11:11.027032+0000 mon.b (mon.1) 49 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:12.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: audit 2024-05-20T22:11:11.290216+0000 mon.b (mon.1) 50 : audit 1 from='client.? v1:172.21.15.50:0/1699601029' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:12.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: cluster 2024-05-20T22:11:11.290655+0000 mon.a (mon.0) 1026 : cluster 0 osdmap e84: 8 total, 8 up, 8 in 2024-05-20T22:11:12.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: audit 2024-05-20T22:11:11.293997+0000 mon.a (mon.0) 1027 : audit 1 from='client.25223 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi050-63960-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:12.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: audit 2024-05-20T22:11:11.296922+0000 mon.a (mon.0) 1028 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi050-64185-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:12.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: audit 2024-05-20T22:11:11.298360+0000 mon.a (mon.0) 1029 : audit 1 from='client.25250 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi050-64001-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:12.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: audit 2024-05-20T22:11:11.300422+0000 mon.a (mon.0) 1030 : audit 1 from='client.25109 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:12.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:12 smithi145 bash[23893]: audit 2024-05-20T22:11:11.301607+0000 mon.a (mon.0) 1031 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:12.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: cluster 2024-05-20T22:11:09.959071+0000 mgr.y (mgr.14592) 190 : cluster 0 pgmap v132: 988 pgs: 235 creating+peering, 753 active+clean; 145 MiB data, 700 MiB used, 715 GiB / 715 GiB avail; 9.9 MiB/s rd, 31 MiB/s wr, 234 op/s 2024-05-20T22:11:12.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: audit 2024-05-20T22:11:10.761944+0000 mon.a (mon.0) 1019 : audit 1 from='client.25241 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-05-20T22:11:12.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: audit 2024-05-20T22:11:10.782379+0000 mon.a (mon.0) 1020 : audit 1 from='client.25180 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:12.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: audit 2024-05-20T22:11:10.782819+0000 mon.a (mon.0) 1021 : audit 1 from='client.25175 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:12.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: audit 2024-05-20T22:11:10.783010+0000 mon.a (mon.0) 1022 : audit 1 from='client.25205 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:12.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: audit 2024-05-20T22:11:10.783243+0000 mon.a (mon.0) 1023 : audit 1 from='client.25223 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:12.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: audit 2024-05-20T22:11:10.783428+0000 mon.a (mon.0) 1024 : audit 1 from='client.25238 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi050-64185-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:12.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: audit 2024-05-20T22:11:10.783607+0000 mon.a (mon.0) 1025 : audit 1 from='client.25250 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:12.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: audit 2024-05-20T22:11:10.786908+0000 mon.c (mon.2) 74 : audit 1 from='client.? v1:172.21.15.50:0/1294638237' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi050-63960-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:12.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: audit 2024-05-20T22:11:10.787174+0000 mon.c (mon.2) 75 : audit 1 from='client.? v1:172.21.15.50:0/2002456243' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi050-64185-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:12.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: audit 2024-05-20T22:11:10.787360+0000 mon.c (mon.2) 76 : audit 1 from='client.? v1:172.21.15.50:0/3217909031' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi050-64001-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:12.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: audit 2024-05-20T22:11:10.791944+0000 mon.c (mon.2) 77 : audit 1 from='client.? v1:172.21.15.50:0/387366744' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:12.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: audit 2024-05-20T22:11:10.792204+0000 mon.c (mon.2) 78 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:12.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: cluster 2024-05-20T22:11:09.959071+0000 mgr.y (mgr.14592) 190 : cluster 0 pgmap v132: 988 pgs: 235 creating+peering, 753 active+clean; 145 MiB data, 700 MiB used, 715 GiB / 715 GiB avail; 9.9 MiB/s rd, 31 MiB/s wr, 234 op/s 2024-05-20T22:11:12.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: audit 2024-05-20T22:11:10.761944+0000 mon.a (mon.0) 1019 : audit 1 from='client.25241 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-05-20T22:11:12.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: audit 2024-05-20T22:11:10.782379+0000 mon.a (mon.0) 1020 : audit 1 from='client.25180 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:12.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: audit 2024-05-20T22:11:10.782819+0000 mon.a (mon.0) 1021 : audit 1 from='client.25175 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:12.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: audit 2024-05-20T22:11:10.783010+0000 mon.a (mon.0) 1022 : audit 1 from='client.25205 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:12.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: audit 2024-05-20T22:11:10.783243+0000 mon.a (mon.0) 1023 : audit 1 from='client.25223 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:12.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: audit 2024-05-20T22:11:10.783428+0000 mon.a (mon.0) 1024 : audit 1 from='client.25238 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi050-64185-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:12.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: audit 2024-05-20T22:11:10.783607+0000 mon.a (mon.0) 1025 : audit 1 from='client.25250 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:12.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: audit 2024-05-20T22:11:10.786908+0000 mon.c (mon.2) 74 : audit 1 from='client.? v1:172.21.15.50:0/1294638237' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi050-63960-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:12.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: audit 2024-05-20T22:11:10.787174+0000 mon.c (mon.2) 75 : audit 1 from='client.? v1:172.21.15.50:0/2002456243' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi050-64185-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:12.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: audit 2024-05-20T22:11:10.787360+0000 mon.c (mon.2) 76 : audit 1 from='client.? v1:172.21.15.50:0/3217909031' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi050-64001-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:12.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: audit 2024-05-20T22:11:10.791944+0000 mon.c (mon.2) 77 : audit 1 from='client.? v1:172.21.15.50:0/387366744' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:12.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: audit 2024-05-20T22:11:10.792204+0000 mon.c (mon.2) 78 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:12.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: audit 2024-05-20T22:11:11.027032+0000 mon.b (mon.1) 49 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:12.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: audit 2024-05-20T22:11:11.290216+0000 mon.b (mon.1) 50 : audit 1 from='client.? v1:172.21.15.50:0/1699601029' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:12.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: cluster 2024-05-20T22:11:11.290655+0000 mon.a (mon.0) 1026 : cluster 0 osdmap e84: 8 total, 8 up, 8 in 2024-05-20T22:11:12.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: audit 2024-05-20T22:11:11.293997+0000 mon.a (mon.0) 1027 : audit 1 from='client.25223 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi050-63960-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:12.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: audit 2024-05-20T22:11:11.296922+0000 mon.a (mon.0) 1028 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi050-64185-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:12.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: audit 2024-05-20T22:11:11.298360+0000 mon.a (mon.0) 1029 : audit 1 from='client.25250 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi050-64001-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:12.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: audit 2024-05-20T22:11:11.300422+0000 mon.a (mon.0) 1030 : audit 1 from='client.25109 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:12.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:12 smithi050 bash[21866]: audit 2024-05-20T22:11:11.301607+0000 mon.a (mon.0) 1031 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:12.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: audit 2024-05-20T22:11:11.027032+0000 mon.b (mon.1) 49 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:12.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: audit 2024-05-20T22:11:11.290216+0000 mon.b (mon.1) 50 : audit 1 from='client.? v1:172.21.15.50:0/1699601029' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:12.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: cluster 2024-05-20T22:11:11.290655+0000 mon.a (mon.0) 1026 : cluster 0 osdmap e84: 8 total, 8 up, 8 in 2024-05-20T22:11:12.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: audit 2024-05-20T22:11:11.293997+0000 mon.a (mon.0) 1027 : audit 1 from='client.25223 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi050-63960-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:12.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: audit 2024-05-20T22:11:11.296922+0000 mon.a (mon.0) 1028 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi050-64185-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:12.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: audit 2024-05-20T22:11:11.298360+0000 mon.a (mon.0) 1029 : audit 1 from='client.25250 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi050-64001-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:12.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: audit 2024-05-20T22:11:11.300422+0000 mon.a (mon.0) 1030 : audit 1 from='client.25109 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:12.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:12 smithi050 bash[28929]: audit 2024-05-20T22:11:11.301607+0000 mon.a (mon.0) 1031 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:12.760 INFO:tasks.workunit.client.0.smithi050.stdout:ent.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-05-20T22:11:12.760 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:06.643806+0000 client.admin [INF] onexx 2024-05-20T22:11:12.760 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:07.703357+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2024-05-20T22:11:12.760 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:07.704541+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2024-05-20T22:11:12.761 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:07.705543+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2024-05-20T22:11:12.761 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:07.706447+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2024-05-20T22:11:12.761 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:07.707428+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2024-05-20T22:11:12.761 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:07.708533+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2024-05-20T22:11:12.761 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:07.709562+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2024-05-20T22:11:12.761 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:07.710503+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2024-05-20T22:11:12.761 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:07.711551+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2024-05-20T22:11:12.761 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:07.712615+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2024-05-20T22:11:12.761 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:07.952430+0000 mon.a [WRN] Health check update: 16 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:12.761 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:07.968652+0000 mon.a [INF] from='client.25109 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:12.761 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:07.968958+0000 mon.a [INF] from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:12.761 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:07.969372+0000 mon.a [INF] from='client.25223 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:12.761 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:07.969973+0000 mon.a [INF] from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:12.762 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:07.970340+0000 mon.a [INF] from='client.25241 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-05-20T22:11:12.762 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:10.761944+0000 mon.a [INF] from='client.25241 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-05-20T22:11:12.762 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:10.782379+0000 mon.a [INF] from='client.25180 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:12.762 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:10.782819+0000 mon.a [INF] from='client.25175 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:12.762 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:10.783010+0000 mon.a [INF] from='client.25205 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:12.762 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:10.783243+0000 mon.a [INF] from='client.25223 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:12.762 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:10.783428+0000 mon.a [INF] from='client.25238 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi050-64185-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:12.762 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:10.783607+0000 mon.a [INF] from='client.25250 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:12.762 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:10.786908+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/1294638237' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi050-63960-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:12.762 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:10.787174+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/2002456243' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi050-64185-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:12.762 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:10.787360+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/3217909031' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi050-64001-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:12.762 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:10.791944+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/387366744' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:12.763 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:10.792204+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:12.763 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:11.290216+0000 mon.b [INF] from='client.? v1:172.21.15.50:0/1699601029' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:12.763 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:11.293997+0000 mon.a [INF] from='client.25223 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi050-63960-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:12.763 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:11.296922+0000 mon.a [INF] from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi050-64185-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:12.763 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:11.298360+0000 mon.a [INF] from='client.25250 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi050-64001-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:14.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:14 smithi145 bash[23893]: audit 2024-05-20T22:11:12.028345+0000 mon.b (mon.1) 51 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:14.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:14 smithi050 bash[21866]: audit 2024-05-20T22:11:12.028345+0000 mon.b (mon.1) 51 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:14.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:14 smithi050 bash[28929]: audit 2024-05-20T22:11:12.028345+0000 mon.b (mon.1) 51 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:15.446 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:11.300422+0000 mon.a [INF] from='client.25109 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:15.446 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:11.301607+0000 mon.a [INF] from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:15.446 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:12.246109+0000 mon.a [INF] from='client.25109 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:15.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:12.246285+0000 mon.a [INF] from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:15.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:12.259969+0000 mon.b [INF] from='client.? v1:172.21.15.50:0/520189697' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi050-63936-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:15.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:12.261003+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-4", "tierpool": "test-rados-api-smithi050-64110-4-cache"}]: dispatch 2024-05-20T22:11:15.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:12.261490+0000 mon.b [INF] from='client.? v1:172.21.15.50:0/294761569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi050-64724-1"}]: dispatch 2024-05-20T22:11:15.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:12.265657+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/387366744' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi050-63944-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-05-20T22:11:15.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:12.767054+0000 mon.c [INF] from='client.? v1:172.21.15.50:0/4115332521' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-05-20T22:11:15.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:12.767397+0000 client.admin [INF] threexx 2024-05-20T22:11:15.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:14.067549+0000 mon.a [WRN] Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:15.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:14.088926+0000 mon.a [INF] from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-4", "tierpool": "test-rados-api-smithi050-64110-4-cache"}]: dispatch 2024-05-20T22:11:15.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:14.089388+0000 mon.a [INF] from='client.25109 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi050-63944-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-05-20T22:11:15.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:14.091920+0000 mon.a [INF] from='client.25223 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi050-63960-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi050-63960-22"}]': finished 2024-05-20T22:11:15.447 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:14.091976+0000 mon.a [INF] from='client.25238 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi050-64185-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi050-64185-7"}]': finished 2024-05-20T22:11:15.648 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:14.092016+0000 mon.a [INF] from='client.25250 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi050-64001-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi050-64001 api_io_pp: Running main() from gmock_main.cc 2024-05-20T22:11:15.648 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2024-05-20T22:11:15.648 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [----------] Global test environment set-up. 2024-05-20T22:11:15.649 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2024-05-20T22:11:15.649 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: seed 63960 2024-05-20T22:11:15.649 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2024-05-20T22:11:15.649 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-05-20T22:11:15.649 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2024-05-20T22:11:15.649 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (358 ms) 2024-05-20T22:11:15.649 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2024-05-20T22:11:15.650 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (9 ms) 2024-05-20T22:11:15.650 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2024-05-20T22:11:15.650 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (5 ms) 2024-05-20T22:11:15.650 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2024-05-20T22:11:15.650 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (3 ms) 2024-05-20T22:11:15.650 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2024-05-20T22:11:15.650 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (5 ms) 2024-05-20T22:11:15.650 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2024-05-20T22:11:15.650 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (3 ms) 2024-05-20T22:11:15.650 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-05-20T22:11:15.650 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (10 ms) 2024-05-20T22:11:15.650 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-05-20T22:11:15.651 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (8 ms) 2024-05-20T22:11:15.651 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-05-20T22:11:15.651 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (6 ms) 2024-05-20T22:11:15.651 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-05-20T22:11:15.651 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (7 ms) 2024-05-20T22:11:15.651 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-05-20T22:11:15.651 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (13 ms) 2024-05-20T22:11:15.651 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2024-05-20T22:11:15.651 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (7 ms) 2024-05-20T22:11:15.651 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2024-05-20T22:11:15.651 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (7 ms) 2024-05-20T22:11:15.651 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-05-20T22:11:15.651 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (6 ms) 2024-05-20T22:11:15.652 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2024-05-20T22:11:15.652 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (27 ms) 2024-05-20T22:11:15.652 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-05-20T22:11:15.652 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (5 ms) 2024-05-20T22:11:15.652 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2024-05-20T22:11:15.652 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (9 ms) 2024-05-20T22:11:15.652 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-05-20T22:11:15.653 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (4 ms) 2024-05-20T22:11:15.653 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-05-20T22:11:15.653 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (5 ms) 2024-05-20T22:11:15.653 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (498 ms total) 2024-05-20T22:11:15.653 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: 2024-05-20T22:11:15.653 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2024-05-20T22:11:15.653 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2024-05-20T22:11:15.653 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (1524 ms) 2024-05-20T22:11:15.653 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2024-05-20T22:11:15.653 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (19 ms) 2024-05-20T22:11:15.653 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-05-20T22:11:15.653 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (2 ms) 2024-05-20T22:11:15.654 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2024-05-20T22:11:15.654 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (5 ms) 2024-05-20T22:11:15.654 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2024-05-20T22:11:15.654 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (4 ms) 2024-05-20T22:11:15.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: cluster 2024-05-20T22:11:08.601798+0000 osd.7 (osd.7) 3 : cluster 0 18.2 deep-scrub starts 2024-05-20T22:11:15.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: cluster 2024-05-20T22:11:08.603937+0000 osd.7 (osd.7) 4 : cluster 0 18.2 deep-scrub ok 2024-05-20T22:11:15.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: cluster 2024-05-20T22:11:09.562246+0000 osd.7 (osd.7) 5 : cluster 0 18.6 deep-scrub starts 2024-05-20T22:11:15.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: cluster 2024-05-20T22:11:09.563162+0000 osd.7 (osd.7) 6 : cluster 0 18.6 deep-scrub ok 2024-05-20T22:11:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: cluster 2024-05-20T22:11:10.556243+0000 osd.0 (osd.0) 7 : cluster 0 18.8 deep-scrub starts 2024-05-20T22:11:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: cluster 2024-05-20T22:11:10.604785+0000 osd.0 (osd.0) 8 : cluster 0 18.8 deep-scrub ok 2024-05-20T22:11:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: cluster 2024-05-20T22:11:11.960473+0000 mgr.y (mgr.14592) 191 : cluster 0 pgmap v134: 828 pgs: 96 unknown, 171 creating+peering, 561 active+clean; 145 MiB data, 700 MiB used, 715 GiB / 715 GiB avail; 8.8 MiB/s rd, 27 MiB/s wr, 227 op/s 2024-05-20T22:11:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: audit 2024-05-20T22:11:12.246109+0000 mon.a (mon.0) 1032 : audit 1 from='client.25109 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: audit 2024-05-20T22:11:12.246285+0000 mon.a (mon.0) 1033 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: audit 2024-05-20T22:11:12.259969+0000 mon.b (mon.1) 52 : audit 1 from='client.? v1:172.21.15.50:0/520189697' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi050-63936-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: audit 2024-05-20T22:11:12.261003+0000 mon.c (mon.2) 79 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-4", "tierpool": "test-rados-api-smithi050-64110-4-cache"}]: dispatch 2024-05-20T22:11:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: audit 2024-05-20T22:11:12.261490+0000 mon.b (mon.1) 53 : audit 1 from='client.? v1:172.21.15.50:0/294761569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi050-64724-1"}]: dispatch 2024-05-20T22:11:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: audit 2024-05-20T22:11:12.265657+0000 mon.c (mon.2) 80 : audit 1 from='client.? v1:172.21.15.50:0/387366744' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi050-63944-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-05-20T22:11:15.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: audit 2024-05-20T22:11:12.767054+0000 mon.c (mon.2) 81 : audit 1 from='client.? v1:172.21.15.50:0/4115332521' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-05-20T22:11:15.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: cluster 2024-05-20T22:11:12.767397+0000 client.admin (client.25241) 0 : cluster 1 threexx 2024-05-20T22:11:15.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: audit 2024-05-20T22:11:13.030210+0000 mon.b (mon.1) 54 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:15.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: audit 2024-05-20T22:11:14.032109+0000 mon.b (mon.1) 55 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:15.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: cluster 2024-05-20T22:11:14.066911+0000 mon.a (mon.0) 1034 : cluster 0 osdmap e85: 8 total, 8 up, 8 in 2024-05-20T22:11:15.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: cluster 2024-05-20T22:11:14.067549+0000 mon.a (mon.0) 1035 : cluster 3 Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:15.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: audit 2024-05-20T22:11:14.088926+0000 mon.a (mon.0) 1036 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-4", "tierpool": "test-rados-api-smithi050-64110-4-cache"}]: dispatch 2024-05-20T22:11:15.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: audit 2024-05-20T22:11:14.089388+0000 mon.a (mon.0) 1037 : audit 1 from='client.25109 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi050-63944-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-05-20T22:11:15.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: audit 2024-05-20T22:11:14.091920+0000 mon.a (mon.0) 1038 : audit 1 from='client.25223 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi050-63960-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi050-63960-22"}]': finished 2024-05-20T22:11:15.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: audit 2024-05-20T22:11:14.091976+0000 mon.a (mon.0) 1039 : audit 1 from='client.25238 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi050-64185-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi050-64185-7"}]': finished 2024-05-20T22:11:15.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: audit 2024-05-20T22:11:14.092016+0000 mon.a (mon.0) 1040 : audit 1 from='client.25250 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi050-64001-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi050-64001-10"}]': finished 2024-05-20T22:11:15.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: cluster 2024-05-20T22:11:14.100471+0000 mon.a (mon.0) 1041 : cluster 0 osdmap e86: 8 total, 8 up, 8 in 2024-05-20T22:11:15.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: audit 2024-05-20T22:11:14.132940+0000 mon.b (mon.1) 56 : audit 1 from='client.? v1:172.21.15.50:0/3704587449' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:15.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: audit 2024-05-20T22:11:14.132981+0000 mon.a (mon.0) 1042 : audit 1 from='client.25241 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-05-20T22:11:15.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: audit 2024-05-20T22:11:14.133597+0000 mon.a (mon.0) 1043 : audit 1 from='client.25225 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:15.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: audit 2024-05-20T22:11:14.567580+0000 mon.b (mon.1) 57 : audit 1 from='client.? v1:172.21.15.50:0/1491560482' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:15.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:15 smithi050 bash[21866]: audit 2024-05-20T22:11:14.568236+0000 mon.a (mon.0) 1044 : audit 1 from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:15.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: cluster 2024-05-20T22:11:08.601798+0000 osd.7 (osd.7) 3 : cluster 0 18.2 deep-scrub starts 2024-05-20T22:11:15.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: cluster 2024-05-20T22:11:08.603937+0000 osd.7 (osd.7) 4 : cluster 0 18.2 deep-scrub ok 2024-05-20T22:11:15.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: cluster 2024-05-20T22:11:09.562246+0000 osd.7 (osd.7) 5 : cluster 0 18.6 deep-scrub starts 2024-05-20T22:11:15.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: cluster 2024-05-20T22:11:09.563162+0000 osd.7 (osd.7) 6 : cluster 0 18.6 deep-scrub ok 2024-05-20T22:11:15.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: cluster 2024-05-20T22:11:10.556243+0000 osd.0 (osd.0) 7 : cluster 0 18.8 deep-scrub starts 2024-05-20T22:11:15.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: cluster 2024-05-20T22:11:10.604785+0000 osd.0 (osd.0) 8 : cluster 0 18.8 deep-scrub ok 2024-05-20T22:11:15.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: cluster 2024-05-20T22:11:11.960473+0000 mgr.y (mgr.14592) 191 : cluster 0 pgmap v134: 828 pgs: 96 unknown, 171 creating+peering, 561 active+clean; 145 MiB data, 700 MiB used, 715 GiB / 715 GiB avail; 8.8 MiB/s rd, 27 MiB/s wr, 227 op/s 2024-05-20T22:11:15.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: audit 2024-05-20T22:11:12.246109+0000 mon.a (mon.0) 1032 : audit 1 from='client.25109 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:15.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: audit 2024-05-20T22:11:12.246285+0000 mon.a (mon.0) 1033 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:15.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: audit 2024-05-20T22:11:12.259969+0000 mon.b (mon.1) 52 : audit 1 from='client.? v1:172.21.15.50:0/520189697' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi050-63936-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:15.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: audit 2024-05-20T22:11:12.261003+0000 mon.c (mon.2) 79 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-4", "tierpool": "test-rados-api-smithi050-64110-4-cache"}]: dispatch 2024-05-20T22:11:15.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: audit 2024-05-20T22:11:12.261490+0000 mon.b (mon.1) 53 : audit 1 from='client.? v1:172.21.15.50:0/294761569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi050-64724-1"}]: dispatch 2024-05-20T22:11:15.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: audit 2024-05-20T22:11:12.265657+0000 mon.c (mon.2) 80 : audit 1 from='client.? v1:172.21.15.50:0/387366744' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi050-63944-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-05-20T22:11:15.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: audit 2024-05-20T22:11:12.767054+0000 mon.c (mon.2) 81 : audit 1 from='client.? v1:172.21.15.50:0/4115332521' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-05-20T22:11:15.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: cluster 2024-05-20T22:11:12.767397+0000 client.admin (client.25241) 0 : cluster 1 threexx 2024-05-20T22:11:15.701 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: audit 2024-05-20T22:11:13.030210+0000 mon.b (mon.1) 54 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:15.701 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: audit 2024-05-20T22:11:14.032109+0000 mon.b (mon.1) 55 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:15.701 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: cluster 2024-05-20T22:11:14.066911+0000 mon.a (mon.0) 1034 : cluster 0 osdmap e85: 8 total, 8 up, 8 in 2024-05-20T22:11:15.701 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: cluster 2024-05-20T22:11:14.067549+0000 mon.a (mon.0) 1035 : cluster 3 Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:15.701 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: audit 2024-05-20T22:11:14.088926+0000 mon.a (mon.0) 1036 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-4", "tierpool": "test-rados-api-smithi050-64110-4-cache"}]: dispatch 2024-05-20T22:11:15.702 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: audit 2024-05-20T22:11:14.089388+0000 mon.a (mon.0) 1037 : audit 1 from='client.25109 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi050-63944-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-05-20T22:11:15.702 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: audit 2024-05-20T22:11:14.091920+0000 mon.a (mon.0) 1038 : audit 1 from='client.25223 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi050-63960-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi050-63960-22"}]': finished 2024-05-20T22:11:15.702 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: audit 2024-05-20T22:11:14.091976+0000 mon.a (mon.0) 1039 : audit 1 from='client.25238 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi050-64185-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi050-64185-7"}]': finished 2024-05-20T22:11:15.702 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: audit 2024-05-20T22:11:14.092016+0000 mon.a (mon.0) 1040 : audit 1 from='client.25250 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi050-64001-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi050-64001-10"}]': finished 2024-05-20T22:11:15.702 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: cluster 2024-05-20T22:11:14.100471+0000 mon.a (mon.0) 1041 : cluster 0 osdmap e86: 8 total, 8 up, 8 in 2024-05-20T22:11:15.703 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: audit 2024-05-20T22:11:14.132940+0000 mon.b (mon.1) 56 : audit 1 from='client.? v1:172.21.15.50:0/3704587449' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:15.703 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: audit 2024-05-20T22:11:14.132981+0000 mon.a (mon.0) 1042 : audit 1 from='client.25241 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-05-20T22:11:15.703 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: audit 2024-05-20T22:11:14.133597+0000 mon.a (mon.0) 1043 : audit 1 from='client.25225 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:15.703 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: audit 2024-05-20T22:11:14.567580+0000 mon.b (mon.1) 57 : audit 1 from='client.? v1:172.21.15.50:0/1491560482' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:15.703 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:15 smithi050 bash[28929]: audit 2024-05-20T22:11:14.568236+0000 mon.a (mon.0) 1044 : audit 1 from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:15.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: cluster 2024-05-20T22:11:08.601798+0000 osd.7 (osd.7) 3 : cluster 0 18.2 deep-scrub starts 2024-05-20T22:11:15.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: cluster 2024-05-20T22:11:08.603937+0000 osd.7 (osd.7) 4 : cluster 0 18.2 deep-scrub ok 2024-05-20T22:11:15.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: cluster 2024-05-20T22:11:09.562246+0000 osd.7 (osd.7) 5 : cluster 0 18.6 deep-scrub starts 2024-05-20T22:11:15.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: cluster 2024-05-20T22:11:09.563162+0000 osd.7 (osd.7) 6 : cluster 0 18.6 deep-scrub ok 2024-05-20T22:11:15.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: cluster 2024-05-20T22:11:10.556243+0000 osd.0 (osd.0) 7 : cluster 0 18.8 deep-scrub starts 2024-05-20T22:11:15.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: cluster 2024-05-20T22:11:10.604785+0000 osd.0 (osd.0) 8 : cluster 0 18.8 deep-scrub ok 2024-05-20T22:11:15.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: cluster 2024-05-20T22:11:11.960473+0000 mgr.y (mgr.14592) 191 : cluster 0 pgmap v134: 828 pgs: 96 unknown, 171 creating+peering, 561 active+clean; 145 MiB data, 700 MiB used, 715 GiB / 715 GiB avail; 8.8 MiB/s rd, 27 MiB/s wr, 227 op/s 2024-05-20T22:11:15.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: audit 2024-05-20T22:11:12.246109+0000 mon.a (mon.0) 1032 : audit 1 from='client.25109 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi050-63944-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:15.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: audit 2024-05-20T22:11:12.246285+0000 mon.a (mon.0) 1033 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:15.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: audit 2024-05-20T22:11:12.259969+0000 mon.b (mon.1) 52 : audit 1 from='client.? v1:172.21.15.50:0/520189697' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi050-63936-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:15.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: audit 2024-05-20T22:11:12.261003+0000 mon.c (mon.2) 79 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-4", "tierpool": "test-rados-api-smithi050-64110-4-cache"}]: dispatch 2024-05-20T22:11:15.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: audit 2024-05-20T22:11:12.261490+0000 mon.b (mon.1) 53 : audit 1 from='client.? v1:172.21.15.50:0/294761569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi050-64724-1"}]: dispatch 2024-05-20T22:11:15.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: audit 2024-05-20T22:11:12.265657+0000 mon.c (mon.2) 80 : audit 1 from='client.? v1:172.21.15.50:0/387366744' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi050-63944-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-05-20T22:11:15.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: audit 2024-05-20T22:11:12.767054+0000 mon.c (mon.2) 81 : audit 1 from='client.? v1:172.21.15.50:0/4115332521' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-05-20T22:11:15.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: cluster 2024-05-20T22:11:12.767397+0000 client.admin (client.25241) 0 : cluster 1 threexx 2024-05-20T22:11:15.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: audit 2024-05-20T22:11:13.030210+0000 mon.b (mon.1) 54 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:15.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: audit 2024-05-20T22:11:14.032109+0000 mon.b (mon.1) 55 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:15.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: cluster 2024-05-20T22:11:14.066911+0000 mon.a (mon.0) 1034 : cluster 0 osdmap e85: 8 total, 8 up, 8 in 2024-05-20T22:11:15.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: cluster 2024-05-20T22:11:14.067549+0000 mon.a (mon.0) 1035 : cluster 3 Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:15.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: audit 2024-05-20T22:11:14.088926+0000 mon.a (mon.0) 1036 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-4", "tierpool": "test-rados-api-smithi050-64110-4-cache"}]: dispatch 2024-05-20T22:11:15.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: audit 2024-05-20T22:11:14.089388+0000 mon.a (mon.0) 1037 : audit 1 from='client.25109 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi050-63944-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-05-20T22:11:15.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: audit 2024-05-20T22:11:14.091920+0000 mon.a (mon.0) 1038 : audit 1 from='client.25223 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi050-63960-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi050-63960-22"}]': finished 2024-05-20T22:11:15.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: audit 2024-05-20T22:11:14.091976+0000 mon.a (mon.0) 1039 : audit 1 from='client.25238 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi050-64185-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi050-64185-7"}]': finished 2024-05-20T22:11:15.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: audit 2024-05-20T22:11:14.092016+0000 mon.a (mon.0) 1040 : audit 1 from='client.25250 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi050-64001-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi050-64001-10"}]': finished 2024-05-20T22:11:15.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: cluster 2024-05-20T22:11:14.100471+0000 mon.a (mon.0) 1041 : cluster 0 osdmap e86: 8 total, 8 up, 8 in 2024-05-20T22:11:15.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: audit 2024-05-20T22:11:14.132940+0000 mon.b (mon.1) 56 : audit 1 from='client.? v1:172.21.15.50:0/3704587449' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:15.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: audit 2024-05-20T22:11:14.132981+0000 mon.a (mon.0) 1042 : audit 1 from='client.25241 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-05-20T22:11:15.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: audit 2024-05-20T22:11:14.133597+0000 mon.a (mon.0) 1043 : audit 1 from='client.25225 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:15.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: audit 2024-05-20T22:11:14.567580+0000 mon.b (mon.1) 57 : audit 1 from='client.? v1:172.21.15.50:0/1491560482' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:15.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:15 smithi145 bash[23893]: audit 2024-05-20T22:11:14.568236+0000 mon.a (mon.0) 1044 : audit 1 from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:17.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: cluster 2024-05-20T22:11:13.961863+0000 mgr.y (mgr.14592) 192 : cluster 0 pgmap v136: 884 pgs: 192 unknown, 135 creating+peering, 557 active+clean; 145 MiB data, 700 MiB used, 715 GiB / 715 GiB avail; 8.0 MiB/s rd, 25 MiB/s wr, 207 op/s 2024-05-20T22:11:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.033993+0000 mon.b (mon.1) 58 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.444029+0000 mon.a (mon.0) 1045 : audit 1 from='client.25180 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.444510+0000 mon.a (mon.0) 1046 : audit 1 from='client.25162 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi050-63936-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.444923+0000 mon.a (mon.0) 1047 : audit 1 from='client.24922 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi050-64724-1"}]: dispatch 2024-05-20T22:11:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.446327+0000 mon.a (mon.0) 1048 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-4", "tierpool": "test-rados-api-smithi050-64110-4-cache"}]': finished 2024-05-20T22:11:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.446462+0000 mon.a (mon.0) 1049 : audit 1 from='client.25109 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi050-63944-3", "field": "max_bytes", "val": "4096"}]': finished 2024-05-20T22:11:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.448138+0000 mon.a (mon.0) 1050 : audit 1 from='client.25241 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-05-20T22:11:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.460894+0000 mon.c (mon.2) 82 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-4", "overlaypool": "test-rados-api-smithi050-64110-4-cache"}]: dispatch 2024-05-20T22:11:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.461573+0000 mon.c (mon.2) 83 : audit 1 from='client.? v1:172.21.15.50:0/4115332521' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-05-20T22:11:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: cluster 2024-05-20T22:11:15.480004+0000 client.admin (client.25241) 0 : cluster 1 fourxx 2024-05-20T22:11:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.481779+0000 mon.c (mon.2) 84 : audit 1 from='client.? v1:172.21.15.50:0/1346369038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi050-64823-1"}]: dispatch 2024-05-20T22:11:17.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.482108+0000 mon.c (mon.2) 85 : audit 1 from='client.? v1:172.21.15.50:0/3783176029' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:17.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.544324+0000 mon.c (mon.2) 86 : audit 1 from='client.? v1:172.21.15.50:0/630108127' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:17.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.941933+0000 mon.b (mon.1) 59 : audit 1 from='client.? v1:172.21.15.50:0/1699601029' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi050-63952-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:17.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: cluster 2024-05-20T22:11:15.942954+0000 mon.a (mon.0) 1051 : cluster 0 osdmap e87: 8 total, 8 up, 8 in 2024-05-20T22:11:17.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.946887+0000 mon.b (mon.1) 60 : audit 1 from='client.? v1:172.21.15.50:0/3704587449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:17.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.947107+0000 mon.a (mon.0) 1052 : audit 1 from='client.25225 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:17.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.947789+0000 mon.a (mon.0) 1053 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-4", "overlaypool": "test-rados-api-smithi050-64110-4-cache"}]: dispatch 2024-05-20T22:11:17.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.949979+0000 mon.a (mon.0) 1054 : audit 1 from='client.25241 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-05-20T22:11:17.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.950667+0000 mon.b (mon.1) 61 : audit 1 from='client.? v1:172.21.15.50:0/1491560482' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi050-63982-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:17.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.950893+0000 mon.a (mon.0) 1055 : audit 1 from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:17.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.951754+0000 mon.a (mon.0) 1056 : audit 1 from='client.24875 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi050-64823-1"}]: dispatch 2024-05-20T22:11:17.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.953306+0000 mon.a (mon.0) 1057 : audit 1 from='client.25301 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:17.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.954926+0000 mon.a (mon.0) 1058 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:17.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:15.956291+0000 mon.c (mon.2) 87 : audit 1 from='client.? v1:172.21.15.50:0/630108127' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:17.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:16.035798+0000 mon.b (mon.1) 62 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:17.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:16.419540+0000 mon.a (mon.0) 1059 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:17.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:16 smithi145 bash[23893]: audit 2024-05-20T22:11:16.420456+0000 mon.c (mon.2) 88 : audit 1 from='client.? v1:172.21.15.50:0/630108127' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:17.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: cluster 2024-05-20T22:11:13.961863+0000 mgr.y (mgr.14592) 192 : cluster 0 pgmap v136: 884 pgs: 192 unknown, 135 creating+peering, 557 active+clean; 145 MiB data, 700 MiB used, 715 GiB / 715 GiB avail; 8.0 MiB/s rd, 25 MiB/s wr, 207 op/s 2024-05-20T22:11:17.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.033993+0000 mon.b (mon.1) 58 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:17.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.444029+0000 mon.a (mon.0) 1045 : audit 1 from='client.25180 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.444510+0000 mon.a (mon.0) 1046 : audit 1 from='client.25162 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi050-63936-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.444923+0000 mon.a (mon.0) 1047 : audit 1 from='client.24922 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi050-64724-1"}]: dispatch 2024-05-20T22:11:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.446327+0000 mon.a (mon.0) 1048 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-4", "tierpool": "test-rados-api-smithi050-64110-4-cache"}]': finished 2024-05-20T22:11:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.446462+0000 mon.a (mon.0) 1049 : audit 1 from='client.25109 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi050-63944-3", "field": "max_bytes", "val": "4096"}]': finished 2024-05-20T22:11:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.448138+0000 mon.a (mon.0) 1050 : audit 1 from='client.25241 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-05-20T22:11:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.460894+0000 mon.c (mon.2) 82 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-4", "overlaypool": "test-rados-api-smithi050-64110-4-cache"}]: dispatch 2024-05-20T22:11:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.461573+0000 mon.c (mon.2) 83 : audit 1 from='client.? v1:172.21.15.50:0/4115332521' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-05-20T22:11:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: cluster 2024-05-20T22:11:15.480004+0000 client.admin (client.25241) 0 : cluster 1 fourxx 2024-05-20T22:11:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.481779+0000 mon.c (mon.2) 84 : audit 1 from='client.? v1:172.21.15.50:0/1346369038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi050-64823-1"}]: dispatch 2024-05-20T22:11:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.482108+0000 mon.c (mon.2) 85 : audit 1 from='client.? v1:172.21.15.50:0/3783176029' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.544324+0000 mon.c (mon.2) 86 : audit 1 from='client.? v1:172.21.15.50:0/630108127' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.941933+0000 mon.b (mon.1) 59 : audit 1 from='client.? v1:172.21.15.50:0/1699601029' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi050-63952-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:17.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: cluster 2024-05-20T22:11:13.961863+0000 mgr.y (mgr.14592) 192 : cluster 0 pgmap v136: 884 pgs: 192 unknown, 135 creating+peering, 557 active+clean; 145 MiB data, 700 MiB used, 715 GiB / 715 GiB avail; 8.0 MiB/s rd, 25 MiB/s wr, 207 op/s 2024-05-20T22:11:17.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.033993+0000 mon.b (mon.1) 58 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:17.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.444029+0000 mon.a (mon.0) 1045 : audit 1 from='client.25180 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:17.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.444510+0000 mon.a (mon.0) 1046 : audit 1 from='client.25162 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi050-63936-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:17.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.444923+0000 mon.a (mon.0) 1047 : audit 1 from='client.24922 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi050-64724-1"}]: dispatch 2024-05-20T22:11:17.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.446327+0000 mon.a (mon.0) 1048 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-4", "tierpool": "test-rados-api-smithi050-64110-4-cache"}]': finished 2024-05-20T22:11:17.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.446462+0000 mon.a (mon.0) 1049 : audit 1 from='client.25109 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi050-63944-3", "field": "max_bytes", "val": "4096"}]': finished 2024-05-20T22:11:17.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.448138+0000 mon.a (mon.0) 1050 : audit 1 from='client.25241 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-05-20T22:11:17.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.460894+0000 mon.c (mon.2) 82 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-4", "overlaypool": "test-rados-api-smithi050-64110-4-cache"}]: dispatch 2024-05-20T22:11:17.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.461573+0000 mon.c (mon.2) 83 : audit 1 from='client.? v1:172.21.15.50:0/4115332521' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-05-20T22:11:17.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: cluster 2024-05-20T22:11:15.480004+0000 client.admin (client.25241) 0 : cluster 1 fourxx 2024-05-20T22:11:17.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.481779+0000 mon.c (mon.2) 84 : audit 1 from='client.? v1:172.21.15.50:0/1346369038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi050-64823-1"}]: dispatch 2024-05-20T22:11:17.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.482108+0000 mon.c (mon.2) 85 : audit 1 from='client.? v1:172.21.15.50:0/3783176029' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:17.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.544324+0000 mon.c (mon.2) 86 : audit 1 from='client.? v1:172.21.15.50:0/630108127' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:17.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.941933+0000 mon.b (mon.1) 59 : audit 1 from='client.? v1:172.21.15.50:0/1699601029' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi050-63952-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:17.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: cluster 2024-05-20T22:11:15.942954+0000 mon.a (mon.0) 1051 : cluster 0 osdmap e87: 8 total, 8 up, 8 in 2024-05-20T22:11:17.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.946887+0000 mon.b (mon.1) 60 : audit 1 from='client.? v1:172.21.15.50:0/3704587449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:17.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.947107+0000 mon.a (mon.0) 1052 : audit 1 from='client.25225 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:17.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.947789+0000 mon.a (mon.0) 1053 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-4", "overlaypool": "test-rados-api-smithi050-64110-4-cache"}]: dispatch 2024-05-20T22:11:17.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.949979+0000 mon.a (mon.0) 1054 : audit 1 from='client.25241 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-05-20T22:11:17.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.950667+0000 mon.b (mon.1) 61 : audit 1 from='client.? v1:172.21.15.50:0/1491560482' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi050-63982-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:17.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.950893+0000 mon.a (mon.0) 1055 : audit 1 from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:17.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.951754+0000 mon.a (mon.0) 1056 : audit 1 from='client.24875 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi050-64823-1"}]: dispatch 2024-05-20T22:11:17.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.953306+0000 mon.a (mon.0) 1057 : audit 1 from='client.25301 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:17.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.954926+0000 mon.a (mon.0) 1058 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:17.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:15.956291+0000 mon.c (mon.2) 87 : audit 1 from='client.? v1:172.21.15.50:0/630108127' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:17.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:16.035798+0000 mon.b (mon.1) 62 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:17.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:16.419540+0000 mon.a (mon.0) 1059 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:17.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:16 smithi050 bash[28929]: audit 2024-05-20T22:11:16.420456+0000 mon.c (mon.2) 88 : audit 1 from='client.? v1:172.21.15.50:0/630108127' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:17.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: cluster 2024-05-20T22:11:15.942954+0000 mon.a (mon.0) 1051 : cluster 0 osdmap e87: 8 total, 8 up, 8 in 2024-05-20T22:11:17.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.946887+0000 mon.b (mon.1) 60 : audit 1 from='client.? v1:172.21.15.50:0/3704587449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:17.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.947107+0000 mon.a (mon.0) 1052 : audit 1 from='client.25225 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:17.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.947789+0000 mon.a (mon.0) 1053 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-4", "overlaypool": "test-rados-api-smithi050-64110-4-cache"}]: dispatch 2024-05-20T22:11:17.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.949979+0000 mon.a (mon.0) 1054 : audit 1 from='client.25241 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-05-20T22:11:17.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.950667+0000 mon.b (mon.1) 61 : audit 1 from='client.? v1:172.21.15.50:0/1491560482' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi050-63982-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:17.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.950893+0000 mon.a (mon.0) 1055 : audit 1 from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:17.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.951754+0000 mon.a (mon.0) 1056 : audit 1 from='client.24875 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi050-64823-1"}]: dispatch 2024-05-20T22:11:17.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.953306+0000 mon.a (mon.0) 1057 : audit 1 from='client.25301 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:17.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.954926+0000 mon.a (mon.0) 1058 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:17.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:15.956291+0000 mon.c (mon.2) 87 : audit 1 from='client.? v1:172.21.15.50:0/630108127' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:17.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:16.035798+0000 mon.b (mon.1) 62 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:17.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:16.419540+0000 mon.a (mon.0) 1059 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:17.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:16 smithi050 bash[21866]: audit 2024-05-20T22:11:16.420456+0000 mon.c (mon.2) 88 : audit 1 from='client.? v1:172.21.15.50:0/630108127' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:17.321 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN api_service_pp: [==========] Running 4 tests from 1 test suite. 2024-05-20T22:11:17.321 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [----------] Global test environment set-up. 2024-05-20T22:11:17.321 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2024-05-20T22:11:17.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2024-05-20T22:11:17.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5039 ms) 2024-05-20T22:11:17.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2024-05-20T22:11:17.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (40 ms) 2024-05-20T22:11:17.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2024-05-20T22:11:17.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20030 ms) 2024-05-20T22:11:17.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2024-05-20T22:11:17.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: attempt 0 of 20 2024-05-20T22:11:17.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (5276 ms) 2024-05-20T22:11:17.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (30385 ms total) 2024-05-20T22:11:17.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: 2024-05-20T22:11:17.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [----------] Global test environment tear-down 2024-05-20T22:11:17.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (30386 ms total) 2024-05-20T22:11:17.323 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ PASSED ] 4 tests. 2024-05-20T22:11:17.914 INFO:tasks.workunit.client.0.smithi050.stdout: cmd: Running main() from gmock_main.cc 2024-05-20T22:11:17.914 INFO:tasks.workunit.client.0.smithi050.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2024-05-20T22:11:17.914 INFO:tasks.workunit.client.0.smithi050.stdout: cmd: [----------] Global test environment set-up. 2024-05-20T22:11:17.915 INFO:tasks.workunit.client.0.smithi050.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2024-05-20T22:11:17.915 INFO:tasks.workunit.client.0.smithi050.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2024-05-20T22:11:17.915 INFO:tasks.workunit.client.0.smithi050.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (18018 ms) 2024-05-20T22:11:17.915 INFO:tasks.workunit.client.0.smithi050.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2024-05-20T22:11:17.915 INFO:tasks.workunit.client.0.smithi050.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (5755 ms) 2024-05-20T22:11:17.915 INFO:tasks.workunit.client.0.smithi050.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2024-05-20T22:11:17.915 INFO:tasks.workunit.client.0.smithi050.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (7126 ms) 2024-05-20T22:11:17.915 INFO:tasks.workunit.client.0.smithi050.stdout: cmd: [----------] 3 tests from NeoRadosCmd (30899 ms total) 2024-05-20T22:11:17.915 INFO:tasks.workunit.client.0.smithi050.stdout: cmd: 2024-05-20T22:11:17.915 INFO:tasks.workunit.client.0.smithi050.stdout: cmd: [----------] Global test environment tear-down 2024-05-20T22:11:17.915 INFO:tasks.workunit.client.0.smithi050.stdout: cmd: [==========] 3 tests from 1 test suite ran. (30899 ms total) 2024-05-20T22:11:17.915 INFO:tasks.workunit.client.0.smithi050.stdout: cmd: [ PASSED ] 3 tests. 2024-05-20T22:11:17.917 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_1_[64496]: starting. 2024-05-20T22:11:17.917 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_1_[64496]: creating pool ceph_test_rados_open_pools_parallel.smithi050-64471 2024-05-20T22:11:17.917 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_1_[64496]: created object 0... 2024-05-20T22:11:17.917 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_1_[64496]: created object 25... 2024-05-20T22:11:17.917 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_1_[64496]: created object 49... 2024-05-20T22:11:17.917 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_1_[64496]: finishing. 2024-05-20T22:11:17.917 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_1_[64496]: shutting down. 2024-05-20T22:11:17.917 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_2_[64500]: starting. 2024-05-20T22:11:17.917 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_2_[64500]: rados_pool_create. 2024-05-20T22:11:17.917 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_2_[64500]: rados_ioctx_create. 2024-05-20T22:11:17.917 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_2_[64500]: shutting down. 2024-05-20T22:11:17.917 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: ******************************* 2024-05-20T22:11:17.918 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_3_[66061]: starting. 2024-05-20T22:11:17.918 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_3_[66061]: creating pool ceph_test_rados_open_pools_parallel.smithi050-64471 2024-05-20T22:11:17.918 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_3_[66061]: created object 0... 2024-05-20T22:11:17.918 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_3_[66061]: created object 25... 2024-05-20T22:11:17.918 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_3_[66061]: created object 49... 2024-05-20T22:11:17.918 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_3_[66061]: finishing. 2024-05-20T22:11:17.918 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_3_[66061]: shutting down. 2024-05-20T22:11:17.918 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: ******************************* 2024-05-20T22:11:17.918 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_4_[66062]: starting. 2024-05-20T22:11:17.918 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_4_[66062]: rados_pool_create. 2024-05-20T22:11:17.918 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_4_[66062]: rados_ioctx_create. 2024-05-20T22:11:17.918 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_4_[66062]: shutting down. 2024-05-20T22:11:17.918 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: ******************************* 2024-05-20T22:11:17.918 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: ******************************* 2024-05-20T22:11:17.919 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: ******* SUCCESS ********** 2024-05-20T22:11:17.921 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_1_[64608]: starting. 2024-05-20T22:11:17.921 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_1_[64608]: creating pool ceph_test_rados_delete_pools_parallel.smithi050-64540 2024-05-20T22:11:17.921 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_1_[64608]: created object 0... 2024-05-20T22:11:17.921 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_1_[64608]: created object 25... 2024-05-20T22:11:17.922 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_1_[64608]: created object 49... 2024-05-20T22:11:17.922 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_1_[64608]: finishing. 2024-05-20T22:11:17.922 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_1_[64608]: shutting down. 2024-05-20T22:11:17.922 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_2_[64609]: starting. 2024-05-20T22:11:17.922 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_2_[64609]: deleting pool ceph_test_rados_delete_pools_parallel.smithi050-64540 2024-05-20T22:11:17.922 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_2_[64609]: shutting down. 2024-05-20T22:11:17.922 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: ******************************* 2024-05-20T22:11:17.922 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_3_[66052]: starting. 2024-05-20T22:11:17.922 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_3_[66052]: creating pool ceph_test_rados_delete_pools_parallel.smithi050-64540 2024-05-20T22:11:17.922 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_3_[66052]: created object 0... 2024-05-20T22:11:17.922 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_3_[66052]: created object 25... 2024-05-20T22:11:17.922 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_3_[66052]: created object 49... 2024-05-20T22:11:17.922 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_3_[66052]: finishing. 2024-05-20T22:11:17.922 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_3_[66052]: shutting down. 2024-05-20T22:11:17.923 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: ******************************* 2024-05-20T22:11:17.923 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_5_[66054]: starting. 2024-05-20T22:11:17.923 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_5_[66054]: listing objects. 2024-05-20T22:11:17.923 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_5_[66054]: listed object 0... 2024-05-20T22:11:17.923 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_5_[66054]: listed object 25... 2024-05-20T22:11:17.923 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_5_[66054]: saw 50 objects 2024-05-20T22:11:17.923 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_5_[66054]: shutting down. 2024-05-20T22:11:17.923 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: ******************************* 2024-05-20T22:11:17.923 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_4_[66053]: starting. 2024-05-20T22:11:17.923 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_4_[66053]: deleting pool ceph_test_rados_delete_pools_parallel.smithi050-64540 2024-05-20T22:11:17.923 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_4_[66053]: shutting down. 2024-05-20T22:11:17.923 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: ******************************* 2024-05-20T22:11:17.923 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: ******************************* 2024-05-20T22:11:17.923 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: ******* SUCCESS ********** 2024-05-20T22:11:17.941 INFO:tasks.workunit.client.0.smithi050.stdout: cls: Running main() from gmock_main.cc 2024-05-20T22:11:17.941 INFO:tasks.workunit.client.0.smithi050.stdout: cls: [==========] Running 2 tests from 1 test suite. 2024-05-20T22:11:17.941 INFO:tasks.workunit.client.0.smithi050.stdout: cls: [----------] Global test environment set-up. 2024-05-20T22:11:17.941 INFO:tasks.workunit.client.0.smithi050.stdout: cls: [----------] 2 tests from NeoRadosCls 2024-05-20T22:11:17.941 INFO:tasks.workunit.client.0.smithi050.stdout: cls: [ RUN ] NeoRadosCls.DNE 2024-05-20T22:11:17.941 INFO:tasks.workunit.client.0.smithi050.stdout: cls: [ OK ] NeoRadosCls.DNE (23787 ms) 2024-05-20T22:11:17.941 INFO:tasks.workunit.client.0.smithi050.stdout: cls: [ RUN ] NeoRadosCls.RemoteReads 2024-05-20T22:11:17.941 INFO:tasks.workunit.client.0.smithi050.stdout: cls: [ OK ] NeoRadosCls.RemoteReads (7138 ms) 2024-05-20T22:11:17.941 INFO:tasks.workunit.client.0.smithi050.stdout: cls: [----------] 2 tests from NeoRadosCls (30925 ms total) 2024-05-20T22:11:17.942 INFO:tasks.workunit.client.0.smithi050.stdout: cls: 2024-05-20T22:11:17.942 INFO:tasks.workunit.client.0.smithi050.stdout: cls: [----------] Global test environment tear-down 2024-05-20T22:11:17.942 INFO:tasks.workunit.client.0.smithi050.stdout: cls: [==========] 2 tests from 1 test suite ran. (30925 ms total) 2024-05-20T22:11:17.942 INFO:tasks.workunit.client.0.smithi050.stdout: cls: [ PASSED ] 2 tests. 2024-05-20T22:11:18.140 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:11:17 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:11:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: cluster 2024-05-20T22:11:15.962999+0000 mgr.y (mgr.14592) 193 : cluster 0 pgmap v139: 932 pgs: 96 unknown, 269 creating+peering, 567 active+clean; 145 MiB data, 699 MiB used, 715 GiB / 715 GiB avail; 989 B/s rd, 0 op/s 2024-05-20T22:11:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.868707+0000 mon.a (mon.0) 1060 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.869337+0000 mon.a (mon.0) 1061 : audit 1 from='client.25241 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-05-20T22:11:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.880400+0000 mon.a (mon.0) 1062 : audit 1 from='client.25162 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi050-63936-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.880525+0000 mon.a (mon.0) 1063 : audit 1 from='client.24922 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi050-64724-1"}]': finished 2024-05-20T22:11:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.880601+0000 mon.a (mon.0) 1064 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-4", "overlaypool": "test-rados-api-smithi050-64110-4-cache"}]': finished 2024-05-20T22:11:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.880664+0000 mon.a (mon.0) 1065 : audit 1 from='client.24875 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi050-64823-1"}]': finished 2024-05-20T22:11:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.880749+0000 mon.a (mon.0) 1066 : audit 1 from='client.25301 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: cluster 2024-05-20T22:11:16.886349+0000 mon.a (mon.0) 1067 : cluster 0 osdmap e88: 8 total, 8 up, 8 in 2024-05-20T22:11:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.891041+0000 mon.c (mon.2) 89 : audit 1 from='client.? v1:172.21.15.50:0/1346369038' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi050-64823-1"}]: dispatch 2024-05-20T22:11:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.894182+0000 mon.b (mon.1) 63 : audit 1 from='client.? v1:172.21.15.50:0/294761569' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi050-64724-1"}]: dispatch 2024-05-20T22:11:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.896040+0000 mon.c (mon.2) 90 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-4-cache", "mode": "writeback"}]: dispatch 2024-05-20T22:11:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.897237+0000 mon.c (mon.2) 91 : audit 1 from='client.? v1:172.21.15.50:0/1506626568' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.902248+0000 mon.a (mon.0) 1068 : audit 1 from='client.24875 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi050-64823-1"}]: dispatch 2024-05-20T22:11:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.902886+0000 mon.a (mon.0) 1069 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-4-cache", "mode": "writeback"}]: dispatch 2024-05-20T22:11:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.903275+0000 mon.a (mon.0) 1070 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.904166+0000 mon.c (mon.2) 92 : audit 1 from='client.? v1:172.21.15.50:0/1294638237' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.906020+0000 mon.a (mon.0) 1071 : audit 1 from='client.25223 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.907443+0000 mon.a (mon.0) 1072 : audit 1 from='client.25180 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi050-63952-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.907873+0000 mon.a (mon.0) 1073 : audit 1 from='client.25225 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.908324+0000 mon.a (mon.0) 1074 : audit 1 from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi050-63982-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:18.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.909474+0000 mon.a (mon.0) 1075 : audit 1 from='client.24922 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi050-64724-1"}]: dispatch 2024-05-20T22:11:18.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.910933+0000 mon.b (mon.1) 64 : audit 1 from='client.? v1:172.21.15.50:0/3706127633' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:18.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:16.913346+0000 mon.a (mon.0) 1076 : audit 1 from='client.25321 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:18.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:17.038341+0000 mon.b (mon.1) 65 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:18.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:17.322555+0000 mon.c (mon.2) 93 : audit 0 from='client.? v1:172.21.15.50:0/1890814084' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-05-20T22:11:18.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:17.322739+0000 mgr.y (mgr.14592) 194 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-05-20T22:11:18.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:17 smithi145 bash[23893]: audit 2024-05-20T22:11:17.651118+0000 mgr.y (mgr.14592) 195 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:18.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: cluster 2024-05-20T22:11:15.962999+0000 mgr.y (mgr.14592) 193 : cluster 0 pgmap v139: 932 pgs: 96 unknown, 269 creating+peering, 567 active+clean; 145 MiB data, 699 MiB used, 715 GiB / 715 GiB avail; 989 B/s rd, 0 op/s 2024-05-20T22:11:18.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.868707+0000 mon.a (mon.0) 1060 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:18.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.869337+0000 mon.a (mon.0) 1061 : audit 1 from='client.25241 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-05-20T22:11:18.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.880400+0000 mon.a (mon.0) 1062 : audit 1 from='client.25162 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi050-63936-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:18.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.880525+0000 mon.a (mon.0) 1063 : audit 1 from='client.24922 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi050-64724-1"}]': finished 2024-05-20T22:11:18.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.880601+0000 mon.a (mon.0) 1064 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-4", "overlaypool": "test-rados-api-smithi050-64110-4-cache"}]': finished 2024-05-20T22:11:18.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.880664+0000 mon.a (mon.0) 1065 : audit 1 from='client.24875 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi050-64823-1"}]': finished 2024-05-20T22:11:18.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.880749+0000 mon.a (mon.0) 1066 : audit 1 from='client.25301 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:18.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: cluster 2024-05-20T22:11:16.886349+0000 mon.a (mon.0) 1067 : cluster 0 osdmap e88: 8 total, 8 up, 8 in 2024-05-20T22:11:18.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.891041+0000 mon.c (mon.2) 89 : audit 1 from='client.? v1:172.21.15.50:0/1346369038' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi050-64823-1"}]: dispatch 2024-05-20T22:11:18.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.894182+0000 mon.b (mon.1) 63 : audit 1 from='client.? v1:172.21.15.50:0/294761569' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi050-64724-1"}]: dispatch 2024-05-20T22:11:18.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.896040+0000 mon.c (mon.2) 90 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-4-cache", "mode": "writeback"}]: dispatch 2024-05-20T22:11:18.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.897237+0000 mon.c (mon.2) 91 : audit 1 from='client.? v1:172.21.15.50:0/1506626568' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:18.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.902248+0000 mon.a (mon.0) 1068 : audit 1 from='client.24875 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi050-64823-1"}]: dispatch 2024-05-20T22:11:18.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.902886+0000 mon.a (mon.0) 1069 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-4-cache", "mode": "writeback"}]: dispatch 2024-05-20T22:11:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: cluster 2024-05-20T22:11:15.962999+0000 mgr.y (mgr.14592) 193 : cluster 0 pgmap v139: 932 pgs: 96 unknown, 269 creating+peering, 567 active+clean; 145 MiB data, 699 MiB used, 715 GiB / 715 GiB avail; 989 B/s rd, 0 op/s 2024-05-20T22:11:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.868707+0000 mon.a (mon.0) 1060 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.869337+0000 mon.a (mon.0) 1061 : audit 1 from='client.25241 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-05-20T22:11:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.880400+0000 mon.a (mon.0) 1062 : audit 1 from='client.25162 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi050-63936-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.880525+0000 mon.a (mon.0) 1063 : audit 1 from='client.24922 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi050-64724-1"}]': finished 2024-05-20T22:11:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.880601+0000 mon.a (mon.0) 1064 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-4", "overlaypool": "test-rados-api-smithi050-64110-4-cache"}]': finished 2024-05-20T22:11:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.880664+0000 mon.a (mon.0) 1065 : audit 1 from='client.24875 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi050-64823-1"}]': finished 2024-05-20T22:11:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.880749+0000 mon.a (mon.0) 1066 : audit 1 from='client.25301 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: cluster 2024-05-20T22:11:16.886349+0000 mon.a (mon.0) 1067 : cluster 0 osdmap e88: 8 total, 8 up, 8 in 2024-05-20T22:11:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.891041+0000 mon.c (mon.2) 89 : audit 1 from='client.? v1:172.21.15.50:0/1346369038' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi050-64823-1"}]: dispatch 2024-05-20T22:11:18.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.894182+0000 mon.b (mon.1) 63 : audit 1 from='client.? v1:172.21.15.50:0/294761569' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi050-64724-1"}]: dispatch 2024-05-20T22:11:18.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.896040+0000 mon.c (mon.2) 90 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-4-cache", "mode": "writeback"}]: dispatch 2024-05-20T22:11:18.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.897237+0000 mon.c (mon.2) 91 : audit 1 from='client.? v1:172.21.15.50:0/1506626568' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:18.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.902248+0000 mon.a (mon.0) 1068 : audit 1 from='client.24875 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi050-64823-1"}]: dispatch 2024-05-20T22:11:18.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.902886+0000 mon.a (mon.0) 1069 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-4-cache", "mode": "writeback"}]: dispatch 2024-05-20T22:11:18.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.903275+0000 mon.a (mon.0) 1070 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:18.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.904166+0000 mon.c (mon.2) 92 : audit 1 from='client.? v1:172.21.15.50:0/1294638237' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:18.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.906020+0000 mon.a (mon.0) 1071 : audit 1 from='client.25223 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:18.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.907443+0000 mon.a (mon.0) 1072 : audit 1 from='client.25180 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi050-63952-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:18.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.907873+0000 mon.a (mon.0) 1073 : audit 1 from='client.25225 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:18.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.908324+0000 mon.a (mon.0) 1074 : audit 1 from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi050-63982-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:18.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.909474+0000 mon.a (mon.0) 1075 : audit 1 from='client.24922 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi050-64724-1"}]: dispatch 2024-05-20T22:11:18.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.910933+0000 mon.b (mon.1) 64 : audit 1 from='client.? v1:172.21.15.50:0/3706127633' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:18.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:16.913346+0000 mon.a (mon.0) 1076 : audit 1 from='client.25321 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:18.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:17.038341+0000 mon.b (mon.1) 65 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:18.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:17.322555+0000 mon.c (mon.2) 93 : audit 0 from='client.? v1:172.21.15.50:0/1890814084' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-05-20T22:11:18.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:17.322739+0000 mgr.y (mgr.14592) 194 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-05-20T22:11:18.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:17 smithi050 bash[21866]: audit 2024-05-20T22:11:17.651118+0000 mgr.y (mgr.14592) 195 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:18.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.903275+0000 mon.a (mon.0) 1070 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:18.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.904166+0000 mon.c (mon.2) 92 : audit 1 from='client.? v1:172.21.15.50:0/1294638237' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:18.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.906020+0000 mon.a (mon.0) 1071 : audit 1 from='client.25223 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:18.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.907443+0000 mon.a (mon.0) 1072 : audit 1 from='client.25180 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi050-63952-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:18.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.907873+0000 mon.a (mon.0) 1073 : audit 1 from='client.25225 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:18.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.908324+0000 mon.a (mon.0) 1074 : audit 1 from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi050-63982-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:18.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.909474+0000 mon.a (mon.0) 1075 : audit 1 from='client.24922 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi050-64724-1"}]: dispatch 2024-05-20T22:11:18.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.910933+0000 mon.b (mon.1) 64 : audit 1 from='client.? v1:172.21.15.50:0/3706127633' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:18.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:16.913346+0000 mon.a (mon.0) 1076 : audit 1 from='client.25321 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:18.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:17.038341+0000 mon.b (mon.1) 65 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:18.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:17.322555+0000 mon.c (mon.2) 93 : audit 0 from='client.? v1:172.21.15.50:0/1890814084' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-05-20T22:11:18.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:17.322739+0000 mgr.y (mgr.14592) 194 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-05-20T22:11:18.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:17 smithi050 bash[28929]: audit 2024-05-20T22:11:17.651118+0000 mgr.y (mgr.14592) 195 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:18.875 INFO:tasks.workunit.client.0.smithi050.stdout:-10"}]': finished 2024-05-20T22:11:18.875 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:14.132940+0000 mon.b [INF] from='client.? v1:172.21.15.50:0/3704587449' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:18.876 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:14.132981+0000 mon.a [INF] from='client.25241 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-05-20T22:11:18.876 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:14.133597+0000 mon.a [INF] from='client.25225 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:18.876 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:14.567580+0000 mon.b [INF] from='client.? v1:172.21.15.50:0/1491560482' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:18.876 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2024-05-20T22:11:14.568236+0000 mon.a [INF] from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:18.876 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (12341 ms) 2024-05-20T22:11:18.876 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (31995 ms total) 2024-05-20T22:11:18.876 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: 2024-05-20T22:11:18.876 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [----------] Global test environment tear-down 2024-05-20T22:11:18.876 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (31995 ms total) 2024-05-20T22:11:18.876 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [ PASSED ] 4 tests. 2024-05-20T22:11:19.352 INFO:tasks.workunit.client.0.smithi050.stdout:] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-05-20T22:11:19.352 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (3 ms) 2024-05-20T22:11:19.352 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-05-20T22:11:19.352 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (8 ms) 2024-05-20T22:11:19.352 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-05-20T22:11:19.353 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (2 ms) 2024-05-20T22:11:19.353 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-05-20T22:11:19.353 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (7 ms) 2024-05-20T22:11:19.353 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2024-05-20T22:11:19.353 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (5 ms) 2024-05-20T22:11:19.353 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2024-05-20T22:11:19.354 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (3 ms) 2024-05-20T22:11:19.354 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-05-20T22:11:19.354 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (3 ms) 2024-05-20T22:11:19.354 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2024-05-20T22:11:19.354 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (9 ms) 2024-05-20T22:11:19.354 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2024-05-20T22:11:19.355 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (5 ms) 2024-05-20T22:11:19.355 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2024-05-20T22:11:19.355 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (5 ms) 2024-05-20T22:11:19.355 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-05-20T22:11:19.355 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (3 ms) 2024-05-20T22:11:19.355 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-05-20T22:11:19.356 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (4 ms) 2024-05-20T22:11:19.356 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (1612 ms total) 2024-05-20T22:11:19.356 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: 2024-05-20T22:11:19.356 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [----------] Global test environment tear-down 2024-05-20T22:11:19.356 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (32622 ms total) 2024-05-20T22:11:19.356 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ PASSED ] 37 tests. 2024-05-20T22:11:19.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: cluster 2024-05-20T22:11:17.884513+0000 mon.a (mon.0) 1077 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:11:19.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.887181+0000 mon.a (mon.0) 1078 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:19.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.887349+0000 mon.a (mon.0) 1079 : audit 1 from='client.24875 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi050-64823-1"}]': finished 2024-05-20T22:11:19.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.887481+0000 mon.a (mon.0) 1080 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-4-cache", "mode": "writeback"}]': finished 2024-05-20T22:11:19.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.887592+0000 mon.a (mon.0) 1081 : audit 1 from='client.24761 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]': finished 2024-05-20T22:11:19.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.887690+0000 mon.a (mon.0) 1082 : audit 1 from='client.25223 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22"}]': finished 2024-05-20T22:11:19.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.887806+0000 mon.a (mon.0) 1083 : audit 1 from='client.25180 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi050-63952-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:19.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.887971+0000 mon.a (mon.0) 1084 : audit 1 from='client.25225 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:19.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.888106+0000 mon.a (mon.0) 1085 : audit 1 from='client.25240 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi050-63982-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:19.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.888244+0000 mon.a (mon.0) 1086 : audit 1 from='client.24922 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi050-64724-1"}]': finished 2024-05-20T22:11:19.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.888381+0000 mon.a (mon.0) 1087 : audit 1 from='client.25321 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:19.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.895254+0000 mon.b (mon.1) 66 : audit 1 from='client.? v1:172.21.15.50:0/1699601029' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi050-63952-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:19.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.896948+0000 mon.c (mon.2) 94 : audit 1 from='client.? v1:172.21.15.50:0/1294638237' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:19.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.897231+0000 mon.c (mon.2) 95 : audit 1 from='client.? v1:172.21.15.50:0/630108127' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi050-64235-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:19.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.897436+0000 mon.c (mon.2) 96 : audit 1 from='client.? v1:172.21.15.50:0/1506626568' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:19.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.897494+0000 mon.b (mon.1) 67 : audit 1 from='client.? v1:172.21.15.50:0/1491560482' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi050-63982-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.900249+0000 mon.b (mon.1) 68 : audit 1 from='client.? v1:172.21.15.50:0/3704587449' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi050-64207-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: cluster 2024-05-20T22:11:17.901189+0000 mon.a (mon.0) 1088 : cluster 0 osdmap e89: 8 total, 8 up, 8 in 2024-05-20T22:11:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.906820+0000 mon.c (mon.2) 97 : audit 1 from='client.? v1:172.21.15.50:0/2002456243' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.910593+0000 mon.a (mon.0) 1089 : audit 1 from='client.25180 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi050-63952-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.911171+0000 mon.a (mon.0) 1090 : audit 1 from='client.25223 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.911777+0000 mon.a (mon.0) 1091 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi050-64235-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.912313+0000 mon.a (mon.0) 1092 : audit 1 from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi050-63982-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.912803+0000 mon.a (mon.0) 1093 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.913410+0000 mon.a (mon.0) 1094 : audit 1 from='client.25225 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi050-64207-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.916222+0000 mon.a (mon.0) 1095 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.917297+0000 mon.c (mon.2) 98 : audit 1 from='client.? v1:172.21.15.50:0/3217909031' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.920089+0000 mon.a (mon.0) 1096 : audit 1 from='client.25250 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:19.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:17.944177+0000 mon.c (mon.2) 99 : audit 1 from='client.? v1:172.21.15.50:0/3008487581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi050-64823-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:19.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: cluster 2024-05-20T22:11:17.964118+0000 mgr.y (mgr.14592) 196 : cluster 0 pgmap v142: 740 pgs: 128 unknown, 83 creating+peering, 529 active+clean; 145 MiB data, 699 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:11:19.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:18.023600+0000 mon.b (mon.1) 69 : audit 1 from='client.? v1:172.21.15.50:0/2670616373' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi050-64724-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:19.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:18.040421+0000 mon.b (mon.1) 70 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:19.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:18.078695+0000 mon.c (mon.2) 100 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-4"}]: dispatch 2024-05-20T22:11:19.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:18.416868+0000 mon.a (mon.0) 1097 : audit 1 from='client.25346 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi050-64823-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:19.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:18.868632+0000 mon.a (mon.0) 1098 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:11:19.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:18.870764+0000 mon.a (mon.0) 1099 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:11:19.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:19 smithi145 bash[23893]: audit 2024-05-20T22:11:19.044646+0000 mon.b (mon.1) 71 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:19.692 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:11:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:11:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:11:19.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: cluster 2024-05-20T22:11:17.884513+0000 mon.a (mon.0) 1077 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:11:19.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.887181+0000 mon.a (mon.0) 1078 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:19.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.887349+0000 mon.a (mon.0) 1079 : audit 1 from='client.24875 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi050-64823-1"}]': finished 2024-05-20T22:11:19.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.887481+0000 mon.a (mon.0) 1080 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-4-cache", "mode": "writeback"}]': finished 2024-05-20T22:11:19.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.887592+0000 mon.a (mon.0) 1081 : audit 1 from='client.24761 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]': finished 2024-05-20T22:11:19.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.887690+0000 mon.a (mon.0) 1082 : audit 1 from='client.25223 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22"}]': finished 2024-05-20T22:11:19.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.887806+0000 mon.a (mon.0) 1083 : audit 1 from='client.25180 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi050-63952-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:19.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.887971+0000 mon.a (mon.0) 1084 : audit 1 from='client.25225 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:19.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.888106+0000 mon.a (mon.0) 1085 : audit 1 from='client.25240 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi050-63982-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:19.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.888244+0000 mon.a (mon.0) 1086 : audit 1 from='client.24922 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi050-64724-1"}]': finished 2024-05-20T22:11:19.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.888381+0000 mon.a (mon.0) 1087 : audit 1 from='client.25321 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:19.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.895254+0000 mon.b (mon.1) 66 : audit 1 from='client.? v1:172.21.15.50:0/1699601029' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi050-63952-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:19.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.896948+0000 mon.c (mon.2) 94 : audit 1 from='client.? v1:172.21.15.50:0/1294638237' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:19.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: cluster 2024-05-20T22:11:17.884513+0000 mon.a (mon.0) 1077 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:11:19.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.887181+0000 mon.a (mon.0) 1078 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:19.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.887349+0000 mon.a (mon.0) 1079 : audit 1 from='client.24875 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi050-64823-1"}]': finished 2024-05-20T22:11:19.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.887481+0000 mon.a (mon.0) 1080 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-4-cache", "mode": "writeback"}]': finished 2024-05-20T22:11:19.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.887592+0000 mon.a (mon.0) 1081 : audit 1 from='client.24761 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi050-64274-1"}]': finished 2024-05-20T22:11:19.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.887690+0000 mon.a (mon.0) 1082 : audit 1 from='client.25223 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi050-63960-22"}]': finished 2024-05-20T22:11:19.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.887806+0000 mon.a (mon.0) 1083 : audit 1 from='client.25180 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi050-63952-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:19.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.887971+0000 mon.a (mon.0) 1084 : audit 1 from='client.25225 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:19.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.888106+0000 mon.a (mon.0) 1085 : audit 1 from='client.25240 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi050-63982-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:19.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.888244+0000 mon.a (mon.0) 1086 : audit 1 from='client.24922 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi050-64724-1"}]': finished 2024-05-20T22:11:19.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.888381+0000 mon.a (mon.0) 1087 : audit 1 from='client.25321 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:19.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.895254+0000 mon.b (mon.1) 66 : audit 1 from='client.? v1:172.21.15.50:0/1699601029' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi050-63952-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:19.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.896948+0000 mon.c (mon.2) 94 : audit 1 from='client.? v1:172.21.15.50:0/1294638237' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:19.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.897231+0000 mon.c (mon.2) 95 : audit 1 from='client.? v1:172.21.15.50:0/630108127' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi050-64235-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:19.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.897436+0000 mon.c (mon.2) 96 : audit 1 from='client.? v1:172.21.15.50:0/1506626568' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:19.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.897494+0000 mon.b (mon.1) 67 : audit 1 from='client.? v1:172.21.15.50:0/1491560482' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi050-63982-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:19.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.900249+0000 mon.b (mon.1) 68 : audit 1 from='client.? v1:172.21.15.50:0/3704587449' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi050-64207-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:19.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: cluster 2024-05-20T22:11:17.901189+0000 mon.a (mon.0) 1088 : cluster 0 osdmap e89: 8 total, 8 up, 8 in 2024-05-20T22:11:19.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.906820+0000 mon.c (mon.2) 97 : audit 1 from='client.? v1:172.21.15.50:0/2002456243' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:19.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.910593+0000 mon.a (mon.0) 1089 : audit 1 from='client.25180 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi050-63952-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:19.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.911171+0000 mon.a (mon.0) 1090 : audit 1 from='client.25223 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:19.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.911777+0000 mon.a (mon.0) 1091 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi050-64235-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:19.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.912313+0000 mon.a (mon.0) 1092 : audit 1 from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi050-63982-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:19.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.912803+0000 mon.a (mon.0) 1093 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:19.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.913410+0000 mon.a (mon.0) 1094 : audit 1 from='client.25225 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi050-64207-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:19.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.916222+0000 mon.a (mon.0) 1095 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:19.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.917297+0000 mon.c (mon.2) 98 : audit 1 from='client.? v1:172.21.15.50:0/3217909031' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:19.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.897231+0000 mon.c (mon.2) 95 : audit 1 from='client.? v1:172.21.15.50:0/630108127' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi050-64235-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:19.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.897436+0000 mon.c (mon.2) 96 : audit 1 from='client.? v1:172.21.15.50:0/1506626568' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:19.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.897494+0000 mon.b (mon.1) 67 : audit 1 from='client.? v1:172.21.15.50:0/1491560482' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi050-63982-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:19.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.900249+0000 mon.b (mon.1) 68 : audit 1 from='client.? v1:172.21.15.50:0/3704587449' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi050-64207-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:19.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: cluster 2024-05-20T22:11:17.901189+0000 mon.a (mon.0) 1088 : cluster 0 osdmap e89: 8 total, 8 up, 8 in 2024-05-20T22:11:19.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.906820+0000 mon.c (mon.2) 97 : audit 1 from='client.? v1:172.21.15.50:0/2002456243' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:19.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.910593+0000 mon.a (mon.0) 1089 : audit 1 from='client.25180 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi050-63952-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:19.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.911171+0000 mon.a (mon.0) 1090 : audit 1 from='client.25223 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi050-63960-22"}]: dispatch 2024-05-20T22:11:19.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.911777+0000 mon.a (mon.0) 1091 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi050-64235-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:19.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.912313+0000 mon.a (mon.0) 1092 : audit 1 from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi050-63982-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:19.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.912803+0000 mon.a (mon.0) 1093 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi050-64274-1"}]: dispatch 2024-05-20T22:11:19.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.913410+0000 mon.a (mon.0) 1094 : audit 1 from='client.25225 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi050-64207-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:19.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.916222+0000 mon.a (mon.0) 1095 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:19.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.917297+0000 mon.c (mon.2) 98 : audit 1 from='client.? v1:172.21.15.50:0/3217909031' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:19.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.920089+0000 mon.a (mon.0) 1096 : audit 1 from='client.25250 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:19.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:17.944177+0000 mon.c (mon.2) 99 : audit 1 from='client.? v1:172.21.15.50:0/3008487581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi050-64823-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:19.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: cluster 2024-05-20T22:11:17.964118+0000 mgr.y (mgr.14592) 196 : cluster 0 pgmap v142: 740 pgs: 128 unknown, 83 creating+peering, 529 active+clean; 145 MiB data, 699 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:11:19.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:18.023600+0000 mon.b (mon.1) 69 : audit 1 from='client.? v1:172.21.15.50:0/2670616373' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi050-64724-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:19.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:18.040421+0000 mon.b (mon.1) 70 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:19.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:18.078695+0000 mon.c (mon.2) 100 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-4"}]: dispatch 2024-05-20T22:11:19.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:18.416868+0000 mon.a (mon.0) 1097 : audit 1 from='client.25346 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi050-64823-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:19.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:18.868632+0000 mon.a (mon.0) 1098 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:11:19.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:18.870764+0000 mon.a (mon.0) 1099 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:11:19.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:19 smithi050 bash[28929]: audit 2024-05-20T22:11:19.044646+0000 mon.b (mon.1) 71 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:19.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.920089+0000 mon.a (mon.0) 1096 : audit 1 from='client.25250 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:19.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:17.944177+0000 mon.c (mon.2) 99 : audit 1 from='client.? v1:172.21.15.50:0/3008487581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi050-64823-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:19.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: cluster 2024-05-20T22:11:17.964118+0000 mgr.y (mgr.14592) 196 : cluster 0 pgmap v142: 740 pgs: 128 unknown, 83 creating+peering, 529 active+clean; 145 MiB data, 699 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:11:19.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:18.023600+0000 mon.b (mon.1) 69 : audit 1 from='client.? v1:172.21.15.50:0/2670616373' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi050-64724-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:19.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:18.040421+0000 mon.b (mon.1) 70 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:19.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:18.078695+0000 mon.c (mon.2) 100 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-4"}]: dispatch 2024-05-20T22:11:19.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:18.416868+0000 mon.a (mon.0) 1097 : audit 1 from='client.25346 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi050-64823-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:19.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:18.868632+0000 mon.a (mon.0) 1098 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:11:19.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:18.870764+0000 mon.a (mon.0) 1099 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:11:19.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:19 smithi050 bash[21866]: audit 2024-05-20T22:11:19.044646+0000 mon.b (mon.1) 71 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:21.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:21 smithi050 bash[21866]: cluster 2024-05-20T22:11:19.314844+0000 mon.a (mon.0) 1100 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:21.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:21 smithi050 bash[21866]: audit 2024-05-20T22:11:19.336951+0000 mon.a (mon.0) 1101 : audit 1 from='client.25223 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi050-63960-22"}]': finished 2024-05-20T22:11:21.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:21 smithi050 bash[28929]: cluster 2024-05-20T22:11:19.314844+0000 mon.a (mon.0) 1100 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:21.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:21 smithi050 bash[28929]: audit 2024-05-20T22:11:19.336951+0000 mon.a (mon.0) 1101 : audit 1 from='client.25223 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi050-63960-22"}]': finished 2024-05-20T22:11:21.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:21 smithi145 bash[23893]: cluster 2024-05-20T22:11:19.314844+0000 mon.a (mon.0) 1100 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:21.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:21 smithi145 bash[23893]: audit 2024-05-20T22:11:19.336951+0000 mon.a (mon.0) 1101 : audit 1 from='client.25223 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi050-63960-22"}]': finished 2024-05-20T22:11:22.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: Running main() from gmock_main.cc 2024-05-20T22:11:22.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2024-05-20T22:11:22.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [----------] Global test environment set-up. 2024-05-20T22:11:22.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [----------] 5 tests from LibRadosStat 2024-05-20T22:11:22.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2024-05-20T22:11:22.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ OK ] LibRadosStat.Stat (282 ms) 2024-05-20T22:11:22.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2024-05-20T22:11:22.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (15 ms) 2024-05-20T22:11:22.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2024-05-20T22:11:22.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ OK ] LibRadosStat.StatNS (43 ms) 2024-05-20T22:11:22.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2024-05-20T22:11:22.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (0 ms) 2024-05-20T22:11:22.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2024-05-20T22:11:22.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (20 ms) 2024-05-20T22:11:22.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [----------] 5 tests from LibRadosStat (360 ms total) 2024-05-20T22:11:22.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: 2024-05-20T22:11:22.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2024-05-20T22:11:22.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2024-05-20T22:11:22.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (2926 ms) 2024-05-20T22:11:22.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2024-05-20T22:11:22.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (20 ms) 2024-05-20T22:11:22.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2024-05-20T22:11:22.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (1 ms) 2024-05-20T22:11:22.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2024-05-20T22:11:22.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (3 ms) 2024-05-20T22:11:22.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (2950 ms total) 2024-05-20T22:11:22.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: 2024-05-20T22:11:22.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [----------] Global test environment tear-down 2024-05-20T22:11:22.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (35390 ms total) 2024-05-20T22:11:22.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ PASSED ] 9 tests. 2024-05-20T22:11:22.238 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: Running main() from gmock_main.cc 2024-05-20T22:11:22.238 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2024-05-20T22:11:22.238 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [----------] Global test environment set-up. 2024-05-20T22:11:22.238 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2024-05-20T22:11:22.238 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: seed 64001 2024-05-20T22:11:22.238 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2024-05-20T22:11:22.238 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (247 ms) 2024-05-20T22:11:22.238 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2024-05-20T22:11:22.239 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (89 ms) 2024-05-20T22:11:22.239 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-05-20T22:11:22.239 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1019 ms) 2024-05-20T22:11:22.239 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2024-05-20T22:11:22.239 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1007 ms) 2024-05-20T22:11:22.239 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2024-05-20T22:11:22.239 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (8 ms) 2024-05-20T22:11:22.239 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2024-05-20T22:11:22.239 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (8 ms) 2024-05-20T22:11:22.239 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2024-05-20T22:11:22.239 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (9 ms) 2024-05-20T22:11:22.239 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2024-05-20T22:11:22.239 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (7 ms) 2024-05-20T22:11:22.239 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (2394 ms total) 2024-05-20T22:11:22.240 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: 2024-05-20T22:11:22.240 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2024-05-20T22:11:22.240 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2024-05-20T22:11:22.240 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (1510 ms) 2024-05-20T22:11:22.240 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2024-05-20T22:11:22.240 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (3 ms) 2024-05-20T22:11:22.240 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-05-20T22:11:22.240 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1008 ms) 2024-05-20T22:11:22.240 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-05-20T22:11:22.240 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1009 ms) 2024-05-20T22:11:22.240 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-05-20T22:11:22.240 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (9 ms) 2024-05-20T22:11:22.240 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2024-05-20T22:11:22.240 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (8 ms) 2024-05-20T22:11:22.241 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2024-05-20T22:11:22.241 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (11 ms) 2024-05-20T22:11:22.241 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2024-05-20T22:11:22.241 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (7 ms) 2024-05-20T22:11:22.241 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (3565 ms total) 2024-05-20T22:11:22.241 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: 2024-05-20T22:11:22.241 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [----------] Global test environment tear-down 2024-05-20T22:11:22.241 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (35470 ms total) 2024-05-20T22:11:22.241 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ PASSED ] 16 tests. 2024-05-20T22:11:22.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:19.337065+0000 mon.a (mon.0) 1102 : audit 1 from='client.24761 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi050-64274-1"}]': finished 2024-05-20T22:11:22.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:19.337162+0000 mon.a (mon.0) 1103 : audit 1 from='client.25238 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi050-64185-7"}]': finished 2024-05-20T22:11:22.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:19.337257+0000 mon.a (mon.0) 1104 : audit 1 from='client.25250 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10"}]': finished 2024-05-20T22:11:22.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:19.337347+0000 mon.a (mon.0) 1105 : audit 1 from='client.25346 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi050-64823-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:22.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:19.345802+0000 mon.c (mon.2) 101 : audit 1 from='client.? v1:172.21.15.50:0/2002456243' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:22.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:19.346309+0000 mon.c (mon.2) 102 : audit 1 from='client.? v1:172.21.15.50:0/3217909031' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:22.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:19.346892+0000 mon.c (mon.2) 103 : audit 1 from='client.? v1:172.21.15.50:0/3008487581' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi050-64823-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi050-64823-2"}]: dispatch 2024-05-20T22:11:22.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: cluster 2024-05-20T22:11:19.969721+0000 mgr.y (mgr.14592) 197 : cluster 0 pgmap v144: 836 pgs: 68 creating+peering, 33 unknown, 735 active+clean; 145 MiB data, 729 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 6.9 KiB/s wr, 6 op/s 2024-05-20T22:11:22.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:20.046085+0000 mon.b (mon.1) 72 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:22.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:21.047907+0000 mon.b (mon.1) 73 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:22.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: cluster 2024-05-20T22:11:21.178911+0000 mon.a (mon.0) 1106 : cluster 0 osdmap e90: 8 total, 8 up, 8 in 2024-05-20T22:11:22.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:21.179980+0000 mon.c (mon.2) 104 : audit 1 from='client.? v1:172.21.15.50:0/1344003204' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:22.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:21.201979+0000 mon.a (mon.0) 1107 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-4"}]: dispatch 2024-05-20T22:11:22.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:21.202292+0000 mon.a (mon.0) 1108 : audit 1 from='client.25180 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi050-63952-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi050-63952-16"}]': finished 2024-05-20T22:11:22.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:19.337065+0000 mon.a (mon.0) 1102 : audit 1 from='client.24761 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi050-64274-1"}]': finished 2024-05-20T22:11:22.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:19.337162+0000 mon.a (mon.0) 1103 : audit 1 from='client.25238 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi050-64185-7"}]': finished 2024-05-20T22:11:22.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:19.337257+0000 mon.a (mon.0) 1104 : audit 1 from='client.25250 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10"}]': finished 2024-05-20T22:11:22.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:19.337347+0000 mon.a (mon.0) 1105 : audit 1 from='client.25346 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi050-64823-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:22.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:19.345802+0000 mon.c (mon.2) 101 : audit 1 from='client.? v1:172.21.15.50:0/2002456243' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:22.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:19.346309+0000 mon.c (mon.2) 102 : audit 1 from='client.? v1:172.21.15.50:0/3217909031' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:22.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:19.346892+0000 mon.c (mon.2) 103 : audit 1 from='client.? v1:172.21.15.50:0/3008487581' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi050-64823-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi050-64823-2"}]: dispatch 2024-05-20T22:11:22.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: cluster 2024-05-20T22:11:19.969721+0000 mgr.y (mgr.14592) 197 : cluster 0 pgmap v144: 836 pgs: 68 creating+peering, 33 unknown, 735 active+clean; 145 MiB data, 729 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 6.9 KiB/s wr, 6 op/s 2024-05-20T22:11:22.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:20.046085+0000 mon.b (mon.1) 72 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:22.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:21.047907+0000 mon.b (mon.1) 73 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:22.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: cluster 2024-05-20T22:11:21.178911+0000 mon.a (mon.0) 1106 : cluster 0 osdmap e90: 8 total, 8 up, 8 in 2024-05-20T22:11:22.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:21.179980+0000 mon.c (mon.2) 104 : audit 1 from='client.? v1:172.21.15.50:0/1344003204' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:22.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:21.201979+0000 mon.a (mon.0) 1107 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-4"}]: dispatch 2024-05-20T22:11:22.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:21.202292+0000 mon.a (mon.0) 1108 : audit 1 from='client.25180 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi050-63952-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi050-63952-16"}]': finished 2024-05-20T22:11:22.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:21.202472+0000 mon.a (mon.0) 1109 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi050-64235-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]': finished 2024-05-20T22:11:22.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:21.202612+0000 mon.a (mon.0) 1110 : audit 1 from='client.25240 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi050-63982-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi050-63982-10"}]': finished 2024-05-20T22:11:22.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:21.202714+0000 mon.a (mon.0) 1111 : audit 1 from='client.25225 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi050-64207-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi050-64207-7"}]': finished 2024-05-20T22:11:22.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: cluster 2024-05-20T22:11:21.208747+0000 mon.a (mon.0) 1112 : cluster 0 osdmap e91: 8 total, 8 up, 8 in 2024-05-20T22:11:22.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:21.214841+0000 mon.a (mon.0) 1113 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:22.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:21.220228+0000 mon.a (mon.0) 1114 : audit 1 from='client.25250 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:22.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:21.220953+0000 mon.a (mon.0) 1115 : audit 1 from='client.25346 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi050-64823-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi050-64823-2"}]: dispatch 2024-05-20T22:11:22.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:22.049925+0000 mon.b (mon.1) 74 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:22.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:22.139099+0000 mon.a (mon.0) 1116 : audit 1 from='client.25370 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:22.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:22 smithi050 bash[21866]: audit 2024-05-20T22:11:22.140514+0000 mon.a (mon.0) 1117 : audit 1 from='client.25372 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi050-64724-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:22.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:21.202472+0000 mon.a (mon.0) 1109 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi050-64235-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]': finished 2024-05-20T22:11:22.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:21.202612+0000 mon.a (mon.0) 1110 : audit 1 from='client.25240 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi050-63982-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi050-63982-10"}]': finished 2024-05-20T22:11:22.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:21.202714+0000 mon.a (mon.0) 1111 : audit 1 from='client.25225 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi050-64207-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi050-64207-7"}]': finished 2024-05-20T22:11:22.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: cluster 2024-05-20T22:11:21.208747+0000 mon.a (mon.0) 1112 : cluster 0 osdmap e91: 8 total, 8 up, 8 in 2024-05-20T22:11:22.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:21.214841+0000 mon.a (mon.0) 1113 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:22.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:21.220228+0000 mon.a (mon.0) 1114 : audit 1 from='client.25250 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:22.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:21.220953+0000 mon.a (mon.0) 1115 : audit 1 from='client.25346 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi050-64823-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi050-64823-2"}]: dispatch 2024-05-20T22:11:22.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:22.049925+0000 mon.b (mon.1) 74 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:22.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:22.139099+0000 mon.a (mon.0) 1116 : audit 1 from='client.25370 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:22.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:22 smithi050 bash[28929]: audit 2024-05-20T22:11:22.140514+0000 mon.a (mon.0) 1117 : audit 1 from='client.25372 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi050-64724-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:22.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:19.337065+0000 mon.a (mon.0) 1102 : audit 1 from='client.24761 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi050-64274-1"}]': finished 2024-05-20T22:11:22.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:19.337162+0000 mon.a (mon.0) 1103 : audit 1 from='client.25238 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi050-64185-7"}]': finished 2024-05-20T22:11:22.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:19.337257+0000 mon.a (mon.0) 1104 : audit 1 from='client.25250 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi050-64001-10"}]': finished 2024-05-20T22:11:22.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:19.337347+0000 mon.a (mon.0) 1105 : audit 1 from='client.25346 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi050-64823-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:22.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:19.345802+0000 mon.c (mon.2) 101 : audit 1 from='client.? v1:172.21.15.50:0/2002456243' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:22.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:19.346309+0000 mon.c (mon.2) 102 : audit 1 from='client.? v1:172.21.15.50:0/3217909031' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:22.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:19.346892+0000 mon.c (mon.2) 103 : audit 1 from='client.? v1:172.21.15.50:0/3008487581' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi050-64823-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi050-64823-2"}]: dispatch 2024-05-20T22:11:22.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: cluster 2024-05-20T22:11:19.969721+0000 mgr.y (mgr.14592) 197 : cluster 0 pgmap v144: 836 pgs: 68 creating+peering, 33 unknown, 735 active+clean; 145 MiB data, 729 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 6.9 KiB/s wr, 6 op/s 2024-05-20T22:11:22.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:20.046085+0000 mon.b (mon.1) 72 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:22.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:21.047907+0000 mon.b (mon.1) 73 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:22.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: cluster 2024-05-20T22:11:21.178911+0000 mon.a (mon.0) 1106 : cluster 0 osdmap e90: 8 total, 8 up, 8 in 2024-05-20T22:11:22.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:21.179980+0000 mon.c (mon.2) 104 : audit 1 from='client.? v1:172.21.15.50:0/1344003204' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:22.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:21.201979+0000 mon.a (mon.0) 1107 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-4"}]: dispatch 2024-05-20T22:11:22.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:21.202292+0000 mon.a (mon.0) 1108 : audit 1 from='client.25180 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi050-63952-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi050-63952-16"}]': finished 2024-05-20T22:11:22.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:21.202472+0000 mon.a (mon.0) 1109 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi050-64235-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]': finished 2024-05-20T22:11:22.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:21.202612+0000 mon.a (mon.0) 1110 : audit 1 from='client.25240 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi050-63982-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi050-63982-10"}]': finished 2024-05-20T22:11:22.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:21.202714+0000 mon.a (mon.0) 1111 : audit 1 from='client.25225 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi050-64207-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi050-64207-7"}]': finished 2024-05-20T22:11:22.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: cluster 2024-05-20T22:11:21.208747+0000 mon.a (mon.0) 1112 : cluster 0 osdmap e91: 8 total, 8 up, 8 in 2024-05-20T22:11:22.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:21.214841+0000 mon.a (mon.0) 1113 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi050-64185-7"}]: dispatch 2024-05-20T22:11:22.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:21.220228+0000 mon.a (mon.0) 1114 : audit 1 from='client.25250 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi050-64001-10"}]: dispatch 2024-05-20T22:11:22.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:21.220953+0000 mon.a (mon.0) 1115 : audit 1 from='client.25346 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi050-64823-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi050-64823-2"}]: dispatch 2024-05-20T22:11:22.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:22.049925+0000 mon.b (mon.1) 74 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:22.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:22.139099+0000 mon.a (mon.0) 1116 : audit 1 from='client.25370 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:22.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:22 smithi145 bash[23893]: audit 2024-05-20T22:11:22.140514+0000 mon.a (mon.0) 1117 : audit 1 from='client.25372 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi050-64724-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:23.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:23 smithi145 bash[23893]: cluster 2024-05-20T22:11:21.971137+0000 mgr.y (mgr.14592) 198 : cluster 0 pgmap v146: 868 pgs: 68 creating+peering, 65 unknown, 735 active+clean; 145 MiB data, 729 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 6.3 KiB/s wr, 5 op/s 2024-05-20T22:11:23.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:23 smithi145 bash[23893]: audit 2024-05-20T22:11:22.220788+0000 mon.a (mon.0) 1118 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-4"}]': finished 2024-05-20T22:11:23.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:23 smithi145 bash[23893]: audit 2024-05-20T22:11:22.220907+0000 mon.a (mon.0) 1119 : audit 1 from='client.25238 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi050-64185-7"}]': finished 2024-05-20T22:11:23.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:23 smithi145 bash[23893]: audit 2024-05-20T22:11:22.221028+0000 mon.a (mon.0) 1120 : audit 1 from='client.25250 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi050-64001-10"}]': finished 2024-05-20T22:11:23.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:23 smithi145 bash[23893]: audit 2024-05-20T22:11:22.221207+0000 mon.a (mon.0) 1121 : audit 1 from='client.25370 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:23.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:23 smithi145 bash[23893]: audit 2024-05-20T22:11:22.221422+0000 mon.a (mon.0) 1122 : audit 1 from='client.25372 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi050-64724-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:23.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:23 smithi145 bash[23893]: audit 2024-05-20T22:11:22.227792+0000 mon.b (mon.1) 75 : audit 1 from='client.? v1:172.21.15.50:0/2670616373' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi050-64724-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi050-64724-2"}]: dispatch 2024-05-20T22:11:23.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:23 smithi145 bash[23893]: audit 2024-05-20T22:11:22.231422+0000 mon.c (mon.2) 105 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-4", "tierpool": "test-rados-api-smithi050-64110-4-cache"}]: dispatch 2024-05-20T22:11:23.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:23 smithi145 bash[23893]: audit 2024-05-20T22:11:22.706485+0000 mon.b (mon.1) 76 : audit 1 from='client.? v1:172.21.15.50:0/1558959858' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi050-63936-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:23.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:23 smithi145 bash[23893]: cluster 2024-05-20T22:11:22.707283+0000 mon.a (mon.0) 1123 : cluster 0 osdmap e92: 8 total, 8 up, 8 in 2024-05-20T22:11:23.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:23 smithi145 bash[23893]: audit 2024-05-20T22:11:22.708493+0000 mon.c (mon.2) 106 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:23.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:23 smithi145 bash[23893]: audit 2024-05-20T22:11:22.710058+0000 mon.a (mon.0) 1124 : audit 1 from='client.25372 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi050-64724-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi050-64724-2"}]: dispatch 2024-05-20T22:11:23.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:23 smithi145 bash[23893]: audit 2024-05-20T22:11:22.710489+0000 mon.a (mon.0) 1125 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-4", "tierpool": "test-rados-api-smithi050-64110-4-cache"}]: dispatch 2024-05-20T22:11:23.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:23 smithi145 bash[23893]: audit 2024-05-20T22:11:23.051534+0000 mon.b (mon.1) 77 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:23.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:23 smithi145 bash[23893]: audit 2024-05-20T22:11:23.162631+0000 mon.a (mon.0) 1126 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:23 smithi050 bash[21866]: cluster 2024-05-20T22:11:21.971137+0000 mgr.y (mgr.14592) 198 : cluster 0 pgmap v146: 868 pgs: 68 creating+peering, 65 unknown, 735 active+clean; 145 MiB data, 729 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 6.3 KiB/s wr, 5 op/s 2024-05-20T22:11:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:23 smithi050 bash[21866]: audit 2024-05-20T22:11:22.220788+0000 mon.a (mon.0) 1118 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-4"}]': finished 2024-05-20T22:11:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:23 smithi050 bash[21866]: audit 2024-05-20T22:11:22.220907+0000 mon.a (mon.0) 1119 : audit 1 from='client.25238 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi050-64185-7"}]': finished 2024-05-20T22:11:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:23 smithi050 bash[21866]: audit 2024-05-20T22:11:22.221028+0000 mon.a (mon.0) 1120 : audit 1 from='client.25250 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi050-64001-10"}]': finished 2024-05-20T22:11:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:23 smithi050 bash[21866]: audit 2024-05-20T22:11:22.221207+0000 mon.a (mon.0) 1121 : audit 1 from='client.25370 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:23 smithi050 bash[21866]: audit 2024-05-20T22:11:22.221422+0000 mon.a (mon.0) 1122 : audit 1 from='client.25372 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi050-64724-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:23 smithi050 bash[21866]: audit 2024-05-20T22:11:22.227792+0000 mon.b (mon.1) 75 : audit 1 from='client.? v1:172.21.15.50:0/2670616373' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi050-64724-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi050-64724-2"}]: dispatch 2024-05-20T22:11:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:23 smithi050 bash[21866]: audit 2024-05-20T22:11:22.231422+0000 mon.c (mon.2) 105 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-4", "tierpool": "test-rados-api-smithi050-64110-4-cache"}]: dispatch 2024-05-20T22:11:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:23 smithi050 bash[21866]: audit 2024-05-20T22:11:22.706485+0000 mon.b (mon.1) 76 : audit 1 from='client.? v1:172.21.15.50:0/1558959858' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi050-63936-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:23.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:23 smithi050 bash[21866]: cluster 2024-05-20T22:11:22.707283+0000 mon.a (mon.0) 1123 : cluster 0 osdmap e92: 8 total, 8 up, 8 in 2024-05-20T22:11:23.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:23 smithi050 bash[21866]: audit 2024-05-20T22:11:22.708493+0000 mon.c (mon.2) 106 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:23.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:23 smithi050 bash[21866]: audit 2024-05-20T22:11:22.710058+0000 mon.a (mon.0) 1124 : audit 1 from='client.25372 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi050-64724-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi050-64724-2"}]: dispatch 2024-05-20T22:11:23.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:23 smithi050 bash[21866]: audit 2024-05-20T22:11:22.710489+0000 mon.a (mon.0) 1125 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-4", "tierpool": "test-rados-api-smithi050-64110-4-cache"}]: dispatch 2024-05-20T22:11:23.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:23 smithi050 bash[21866]: audit 2024-05-20T22:11:23.051534+0000 mon.b (mon.1) 77 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:23.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:23 smithi050 bash[21866]: audit 2024-05-20T22:11:23.162631+0000 mon.a (mon.0) 1126 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:23.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:23 smithi050 bash[28929]: cluster 2024-05-20T22:11:21.971137+0000 mgr.y (mgr.14592) 198 : cluster 0 pgmap v146: 868 pgs: 68 creating+peering, 65 unknown, 735 active+clean; 145 MiB data, 729 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 6.3 KiB/s wr, 5 op/s 2024-05-20T22:11:23.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:23 smithi050 bash[28929]: audit 2024-05-20T22:11:22.220788+0000 mon.a (mon.0) 1118 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-4"}]': finished 2024-05-20T22:11:23.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:23 smithi050 bash[28929]: audit 2024-05-20T22:11:22.220907+0000 mon.a (mon.0) 1119 : audit 1 from='client.25238 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi050-64185-7"}]': finished 2024-05-20T22:11:23.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:23 smithi050 bash[28929]: audit 2024-05-20T22:11:22.221028+0000 mon.a (mon.0) 1120 : audit 1 from='client.25250 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi050-64001-10"}]': finished 2024-05-20T22:11:23.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:23 smithi050 bash[28929]: audit 2024-05-20T22:11:22.221207+0000 mon.a (mon.0) 1121 : audit 1 from='client.25370 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:23.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:23 smithi050 bash[28929]: audit 2024-05-20T22:11:22.221422+0000 mon.a (mon.0) 1122 : audit 1 from='client.25372 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi050-64724-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:23.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:23 smithi050 bash[28929]: audit 2024-05-20T22:11:22.227792+0000 mon.b (mon.1) 75 : audit 1 from='client.? v1:172.21.15.50:0/2670616373' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi050-64724-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi050-64724-2"}]: dispatch 2024-05-20T22:11:23.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:23 smithi050 bash[28929]: audit 2024-05-20T22:11:22.231422+0000 mon.c (mon.2) 105 : audit 1 from='client.? v1:172.21.15.50:0/2954049645' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-4", "tierpool": "test-rados-api-smithi050-64110-4-cache"}]: dispatch 2024-05-20T22:11:23.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:23 smithi050 bash[28929]: audit 2024-05-20T22:11:22.706485+0000 mon.b (mon.1) 76 : audit 1 from='client.? v1:172.21.15.50:0/1558959858' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi050-63936-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:23.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:23 smithi050 bash[28929]: cluster 2024-05-20T22:11:22.707283+0000 mon.a (mon.0) 1123 : cluster 0 osdmap e92: 8 total, 8 up, 8 in 2024-05-20T22:11:23.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:23 smithi050 bash[28929]: audit 2024-05-20T22:11:22.708493+0000 mon.c (mon.2) 106 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:23.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:23 smithi050 bash[28929]: audit 2024-05-20T22:11:22.710058+0000 mon.a (mon.0) 1124 : audit 1 from='client.25372 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi050-64724-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi050-64724-2"}]: dispatch 2024-05-20T22:11:23.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:23 smithi050 bash[28929]: audit 2024-05-20T22:11:22.710489+0000 mon.a (mon.0) 1125 : audit 1 from='client.25076 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-4", "tierpool": "test-rados-api-smithi050-64110-4-cache"}]: dispatch 2024-05-20T22:11:23.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:23 smithi050 bash[28929]: audit 2024-05-20T22:11:23.051534+0000 mon.b (mon.1) 77 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:23.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:23 smithi050 bash[28929]: audit 2024-05-20T22:11:23.162631+0000 mon.a (mon.0) 1126 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:24.567 INFO:tasks.workunit.client.0.smithi050.stdout:ot have an application enabled 2024-05-20T22:11:24.567 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:11:24.567 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: services: 2024-05-20T22:11:24.567 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-05-20T22:11:24.567 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-05-20T22:11:24.568 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-05-20T22:11:24.568 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2024-05-20T22:11:24.568 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-05-20T22:11:24.568 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-05-20T22:11:24.568 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:11:24.568 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: data: 2024-05-20T22:11:24.568 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pools: 42 pools, 1284 pgs 2024-05-20T22:11:24.568 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: objects: 198 objects, 583 KiB 2024-05-20T22:11:24.568 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: usage: 235 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:11:24.568 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pgs: 41.978% pgs unknown 2024-05-20T22:11:24.568 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 45.327% pgs not active 2024-05-20T22:11:24.568 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 582 creating+peering 2024-05-20T22:11:24.568 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 539 unknown 2024-05-20T22:11:24.568 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 163 active+clean 2024-05-20T22:11:24.568 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:11:24.569 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: io: 2024-05-20T22:11:24.569 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: client: 639 B/s rd, 0 op/s rd, 0 op/s wr 2024-05-20T22:11:24.569 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:11:24.569 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:11:24.569 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ OK ] LibRadosService.StatusFormat (12492 ms) 2024-05-20T22:11:24.569 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ RUN ] LibRadosService.Status 2024-05-20T22:11:24.569 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ OK ] LibRadosService.Status (20051 ms) 2024-05-20T22:11:24.569 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [----------] 4 tests from LibRadosService (37639 ms total) 2024-05-20T22:11:24.569 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2024-05-20T22:11:24.569 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [----------] Global test environment tear-down 2024-05-20T22:11:24.569 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [==========] 4 tests from 1 test suite ran. (37639 ms total) 2024-05-20T22:11:24.569 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ PASSED ] 4 tests. 2024-05-20T22:11:24.999 INFO:tasks.workunit.client.0.smithi050.stdout: list: Running main() from gmock_main.cc 2024-05-20T22:11:24.999 INFO:tasks.workunit.client.0.smithi050.stdout: list: [==========] Running 3 tests from 1 test suite. 2024-05-20T22:11:24.999 INFO:tasks.workunit.client.0.smithi050.stdout: list: [----------] Global test environment set-up. 2024-05-20T22:11:24.999 INFO:tasks.workunit.client.0.smithi050.stdout: list: [----------] 3 tests from NeoradosList 2024-05-20T22:11:24.999 INFO:tasks.workunit.client.0.smithi050.stdout: list: [ RUN ] NeoradosList.ListObjects 2024-05-20T22:11:24.999 INFO:tasks.workunit.client.0.smithi050.stdout: list: [ OK ] NeoradosList.ListObjects (19441 ms) 2024-05-20T22:11:24.999 INFO:tasks.workunit.client.0.smithi050.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2024-05-20T22:11:25.000 INFO:tasks.workunit.client.0.smithi050.stdout: list: [ OK ] NeoradosList.ListObjectsNS (10381 ms) 2024-05-20T22:11:25.000 INFO:tasks.workunit.client.0.smithi050.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2024-05-20T22:11:25.000 INFO:tasks.workunit.client.0.smithi050.stdout: list: [ OK ] NeoradosList.ListObjectsMany (8098 ms) 2024-05-20T22:11:25.000 INFO:tasks.workunit.client.0.smithi050.stdout: list: [----------] 3 tests from NeoradosList (37920 ms total) 2024-05-20T22:11:25.000 INFO:tasks.workunit.client.0.smithi050.stdout: list: 2024-05-20T22:11:25.000 INFO:tasks.workunit.client.0.smithi050.stdout: list: [----------] Global test environment tear-down 2024-05-20T22:11:25.000 INFO:tasks.workunit.client.0.smithi050.stdout: list: [==========] 3 tests from 1 test suite ran. (37920 ms total) 2024-05-20T22:11:25.000 INFO:tasks.workunit.client.0.smithi050.stdout: list: [ PASSED ] 3 tests. 2024-05-20T22:11:25.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:25 smithi145 bash[23893]: cluster 2024-05-20T22:11:23.620135+0000 mon.a (mon.0) 1127 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:11:25.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:25 smithi050 bash[21866]: cluster 2024-05-20T22:11:23.620135+0000 mon.a (mon.0) 1127 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:11:25.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:25 smithi050 bash[28929]: cluster 2024-05-20T22:11:23.620135+0000 mon.a (mon.0) 1127 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:11:26.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:26 smithi145 bash[23893]: audit 2024-05-20T22:11:23.632591+0000 mon.a (mon.0) 1128 : audit 1 from='client.25346 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi050-64823-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi050-64823-2"}]': finished 2024-05-20T22:11:26.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:26 smithi145 bash[23893]: audit 2024-05-20T22:11:23.632775+0000 mon.a (mon.0) 1129 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-4", "tierpool": "test-rados-api-smithi050-64110-4-cache"}]': finished 2024-05-20T22:11:26.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:26 smithi145 bash[23893]: audit 2024-05-20T22:11:23.632897+0000 mon.a (mon.0) 1130 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:26.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:26 smithi145 bash[23893]: audit 2024-05-20T22:11:23.737709+0000 mon.c (mon.2) 107 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64274-6", "pg_num": 4}]: dispatch 2024-05-20T22:11:26.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:26 smithi145 bash[23893]: cluster 2024-05-20T22:11:23.972538+0000 mgr.y (mgr.14592) 199 : cluster 0 pgmap v149: 836 pgs: 22 creating+peering, 174 unknown, 640 active+clean; 145 MiB data, 729 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 6.0 KiB/s wr, 4 op/s 2024-05-20T22:11:26.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:26 smithi145 bash[23893]: audit 2024-05-20T22:11:24.053070+0000 mon.b (mon.1) 78 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:26.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:26 smithi145 bash[23893]: audit 2024-05-20T22:11:24.091327+0000 mon.c (mon.2) 108 : audit 1 from='client.? v1:172.21.15.50:0/630108127' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:26.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:26 smithi145 bash[23893]: cluster 2024-05-20T22:11:24.983244+0000 mon.a (mon.0) 1131 : cluster 0 osdmap e93: 8 total, 8 up, 8 in 2024-05-20T22:11:26.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:26 smithi145 bash[23893]: cluster 2024-05-20T22:11:24.983766+0000 mon.a (mon.0) 1132 : cluster 3 Health check update: 16 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:26.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:26 smithi145 bash[23893]: cluster 2024-05-20T22:11:24.984131+0000 mon.a (mon.0) 1133 : cluster 3 pool 'PoolQuotaPP_smithi050-63944-3' is full (reached quota's max_bytes: 4 KiB) 2024-05-20T22:11:26.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:26 smithi145 bash[23893]: cluster 2024-05-20T22:11:24.985378+0000 mon.a (mon.0) 1134 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-05-20T22:11:26.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:26 smithi145 bash[23893]: audit 2024-05-20T22:11:24.987889+0000 mon.a (mon.0) 1135 : audit 1 from='client.25372 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi050-64724-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi050-64724-2"}]': finished 2024-05-20T22:11:26.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:26 smithi145 bash[23893]: cluster 2024-05-20T22:11:24.993213+0000 mon.a (mon.0) 1136 : cluster 0 osdmap e94: 8 total, 8 up, 8 in 2024-05-20T22:11:26.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:26 smithi145 bash[23893]: audit 2024-05-20T22:11:25.002488+0000 mon.c (mon.2) 109 : audit 1 from='client.? v1:172.21.15.50:0/3043021140' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:26.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:26 smithi145 bash[23893]: audit 2024-05-20T22:11:25.020738+0000 mon.a (mon.0) 1137 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64274-6", "pg_num": 4}]: dispatch 2024-05-20T22:11:26.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:26 smithi145 bash[23893]: audit 2024-05-20T22:11:25.054613+0000 mon.b (mon.1) 79 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:26.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:26 smithi145 bash[23893]: audit 2024-05-20T22:11:25.463030+0000 mon.a (mon.0) 1138 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:26.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:26 smithi145 bash[23893]: audit 2024-05-20T22:11:25.898127+0000 mon.a (mon.0) 1139 : audit 1 from='client.25394 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:26.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:26 smithi145 bash[23893]: audit 2024-05-20T22:11:25.899547+0000 mon.a (mon.0) 1140 : audit 1 from='client.25366 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi050-63936-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:26.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:26 smithi145 bash[23893]: audit 2024-05-20T22:11:25.993347+0000 mon.a (mon.0) 1141 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64274-6", "pg_num": 4}]': finished 2024-05-20T22:11:26.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:26 smithi050 bash[21866]: audit 2024-05-20T22:11:23.632591+0000 mon.a (mon.0) 1128 : audit 1 from='client.25346 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi050-64823-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi050-64823-2"}]': finished 2024-05-20T22:11:26.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:26 smithi050 bash[21866]: audit 2024-05-20T22:11:23.632775+0000 mon.a (mon.0) 1129 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-4", "tierpool": "test-rados-api-smithi050-64110-4-cache"}]': finished 2024-05-20T22:11:26.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:26 smithi050 bash[21866]: audit 2024-05-20T22:11:23.632897+0000 mon.a (mon.0) 1130 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:26.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:26 smithi050 bash[21866]: audit 2024-05-20T22:11:23.737709+0000 mon.c (mon.2) 107 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64274-6", "pg_num": 4}]: dispatch 2024-05-20T22:11:26.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:26 smithi050 bash[21866]: cluster 2024-05-20T22:11:23.972538+0000 mgr.y (mgr.14592) 199 : cluster 0 pgmap v149: 836 pgs: 22 creating+peering, 174 unknown, 640 active+clean; 145 MiB data, 729 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 6.0 KiB/s wr, 4 op/s 2024-05-20T22:11:26.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:26 smithi050 bash[21866]: audit 2024-05-20T22:11:24.053070+0000 mon.b (mon.1) 78 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:26.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:26 smithi050 bash[21866]: audit 2024-05-20T22:11:24.091327+0000 mon.c (mon.2) 108 : audit 1 from='client.? v1:172.21.15.50:0/630108127' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:26.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:26 smithi050 bash[21866]: cluster 2024-05-20T22:11:24.983244+0000 mon.a (mon.0) 1131 : cluster 0 osdmap e93: 8 total, 8 up, 8 in 2024-05-20T22:11:26.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:26 smithi050 bash[21866]: cluster 2024-05-20T22:11:24.983766+0000 mon.a (mon.0) 1132 : cluster 3 Health check update: 16 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:26.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:26 smithi050 bash[21866]: cluster 2024-05-20T22:11:24.984131+0000 mon.a (mon.0) 1133 : cluster 3 pool 'PoolQuotaPP_smithi050-63944-3' is full (reached quota's max_bytes: 4 KiB) 2024-05-20T22:11:26.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:26 smithi050 bash[21866]: cluster 2024-05-20T22:11:24.985378+0000 mon.a (mon.0) 1134 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-05-20T22:11:26.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:26 smithi050 bash[21866]: audit 2024-05-20T22:11:24.987889+0000 mon.a (mon.0) 1135 : audit 1 from='client.25372 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi050-64724-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi050-64724-2"}]': finished 2024-05-20T22:11:26.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:26 smithi050 bash[21866]: cluster 2024-05-20T22:11:24.993213+0000 mon.a (mon.0) 1136 : cluster 0 osdmap e94: 8 total, 8 up, 8 in 2024-05-20T22:11:26.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:26 smithi050 bash[21866]: audit 2024-05-20T22:11:25.002488+0000 mon.c (mon.2) 109 : audit 1 from='client.? v1:172.21.15.50:0/3043021140' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:26.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:26 smithi050 bash[21866]: audit 2024-05-20T22:11:25.020738+0000 mon.a (mon.0) 1137 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64274-6", "pg_num": 4}]: dispatch 2024-05-20T22:11:26.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:26 smithi050 bash[21866]: audit 2024-05-20T22:11:25.054613+0000 mon.b (mon.1) 79 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:26.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:26 smithi050 bash[21866]: audit 2024-05-20T22:11:25.463030+0000 mon.a (mon.0) 1138 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:26.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:26 smithi050 bash[21866]: audit 2024-05-20T22:11:25.898127+0000 mon.a (mon.0) 1139 : audit 1 from='client.25394 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:26.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:26 smithi050 bash[21866]: audit 2024-05-20T22:11:25.899547+0000 mon.a (mon.0) 1140 : audit 1 from='client.25366 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi050-63936-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:26.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:26 smithi050 bash[21866]: audit 2024-05-20T22:11:25.993347+0000 mon.a (mon.0) 1141 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64274-6", "pg_num": 4}]': finished 2024-05-20T22:11:26.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:26 smithi050 bash[28929]: audit 2024-05-20T22:11:23.632591+0000 mon.a (mon.0) 1128 : audit 1 from='client.25346 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi050-64823-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi050-64823-2"}]': finished 2024-05-20T22:11:26.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:26 smithi050 bash[28929]: audit 2024-05-20T22:11:23.632775+0000 mon.a (mon.0) 1129 : audit 1 from='client.25076 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-4", "tierpool": "test-rados-api-smithi050-64110-4-cache"}]': finished 2024-05-20T22:11:26.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:26 smithi050 bash[28929]: audit 2024-05-20T22:11:23.632897+0000 mon.a (mon.0) 1130 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:26.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:26 smithi050 bash[28929]: audit 2024-05-20T22:11:23.737709+0000 mon.c (mon.2) 107 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64274-6", "pg_num": 4}]: dispatch 2024-05-20T22:11:26.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:26 smithi050 bash[28929]: cluster 2024-05-20T22:11:23.972538+0000 mgr.y (mgr.14592) 199 : cluster 0 pgmap v149: 836 pgs: 22 creating+peering, 174 unknown, 640 active+clean; 145 MiB data, 729 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 6.0 KiB/s wr, 4 op/s 2024-05-20T22:11:26.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:26 smithi050 bash[28929]: audit 2024-05-20T22:11:24.053070+0000 mon.b (mon.1) 78 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:26.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:26 smithi050 bash[28929]: audit 2024-05-20T22:11:24.091327+0000 mon.c (mon.2) 108 : audit 1 from='client.? v1:172.21.15.50:0/630108127' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:26.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:26 smithi050 bash[28929]: cluster 2024-05-20T22:11:24.983244+0000 mon.a (mon.0) 1131 : cluster 0 osdmap e93: 8 total, 8 up, 8 in 2024-05-20T22:11:26.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:26 smithi050 bash[28929]: cluster 2024-05-20T22:11:24.983766+0000 mon.a (mon.0) 1132 : cluster 3 Health check update: 16 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:26.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:26 smithi050 bash[28929]: cluster 2024-05-20T22:11:24.984131+0000 mon.a (mon.0) 1133 : cluster 3 pool 'PoolQuotaPP_smithi050-63944-3' is full (reached quota's max_bytes: 4 KiB) 2024-05-20T22:11:26.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:26 smithi050 bash[28929]: cluster 2024-05-20T22:11:24.985378+0000 mon.a (mon.0) 1134 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-05-20T22:11:26.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:26 smithi050 bash[28929]: audit 2024-05-20T22:11:24.987889+0000 mon.a (mon.0) 1135 : audit 1 from='client.25372 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi050-64724-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi050-64724-2"}]': finished 2024-05-20T22:11:26.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:26 smithi050 bash[28929]: cluster 2024-05-20T22:11:24.993213+0000 mon.a (mon.0) 1136 : cluster 0 osdmap e94: 8 total, 8 up, 8 in 2024-05-20T22:11:26.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:26 smithi050 bash[28929]: audit 2024-05-20T22:11:25.002488+0000 mon.c (mon.2) 109 : audit 1 from='client.? v1:172.21.15.50:0/3043021140' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:26.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:26 smithi050 bash[28929]: audit 2024-05-20T22:11:25.020738+0000 mon.a (mon.0) 1137 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64274-6", "pg_num": 4}]: dispatch 2024-05-20T22:11:26.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:26 smithi050 bash[28929]: audit 2024-05-20T22:11:25.054613+0000 mon.b (mon.1) 79 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:26.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:26 smithi050 bash[28929]: audit 2024-05-20T22:11:25.463030+0000 mon.a (mon.0) 1138 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:26.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:26 smithi050 bash[28929]: audit 2024-05-20T22:11:25.898127+0000 mon.a (mon.0) 1139 : audit 1 from='client.25394 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:26.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:26 smithi050 bash[28929]: audit 2024-05-20T22:11:25.899547+0000 mon.a (mon.0) 1140 : audit 1 from='client.25366 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi050-63936-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:26.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:26 smithi050 bash[28929]: audit 2024-05-20T22:11:25.993347+0000 mon.a (mon.0) 1141 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64274-6", "pg_num": 4}]': finished 2024-05-20T22:11:27.009 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: Running main() from gmock_main.cc 2024-05-20T22:11:27.009 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2024-05-20T22:11:27.009 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [----------] Global test environment set-up. 2024-05-20T22:11:27.009 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2024-05-20T22:11:27.009 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2024-05-20T22:11:27.009 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify_test_cb 2024-05-20T22:11:27.009 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (340 ms) 2024-05-20T22:11:27.009 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2024-05-20T22:11:27.009 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94774540281952 err -107 2024-05-20T22:11:27.009 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-05-20T22:11:27.009 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (7 ms) 2024-05-20T22:11:27.010 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-05-20T22:11:27.010 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94774540283216 err -107 2024-05-20T22:11:27.010 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-05-20T22:11:27.010 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (5 ms) 2024-05-20T22:11:27.010 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2024-05-20T22:11:27.010 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_cb from 24764 notify_id 339302416384 cookie 94774540287600 2024-05-20T22:11:27.010 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (20 ms) 2024-05-20T22:11:27.010 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-05-20T22:11:27.010 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_cb from 24764 notify_id 339302416385 cookie 94774540293568 2024-05-20T22:11:27.011 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (11 ms) 2024-05-20T22:11:27.011 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2024-05-20T22:11:27.011 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_cb from 24764 notify_id 339302416384 cookie 94774540293568 2024-05-20T22:11:27.011 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (19 ms) 2024-05-20T22:11:27.011 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-05-20T22:11:27.011 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_cb from 24764 notify_id 339302416384 cookie 94774540313520 2024-05-20T22:11:27.011 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_cb from 24764 notify_id 339302416384 cookie 94774540321728 2024-05-20T22:11:27.011 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (21 ms) 2024-05-20T22:11:27.011 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-05-20T22:11:27.011 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_cb from 24764 notify_id 339302416384 cookie 94774540339088 2024-05-20T22:11:27.011 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_cb from 24764 notify_id 343597383681 cookie 94774540339088 2024-05-20T22:11:27.011 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3068 ms) 2024-05-20T22:11:27.011 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-05-20T22:11:27.012 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2024-05-20T22:11:27.012 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94774540355712 err -107 2024-05-20T22:11:27.012 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_cb from 24764 notify_id 365072220162 cookie 94774540355712 2024-05-20T22:11:27.012 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5033 ms) 2024-05-20T22:11:27.012 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-05-20T22:11:27.012 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2024-05-20T22:11:27.012 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94774540321728 err -107 2024-05-20T22:11:27.012 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1010 ms) 2024-05-20T22:11:27.012 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (9534 ms total) 2024-05-20T22:11:27.012 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: 2024-05-20T22:11:27.012 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2024-05-20T22:11:27.012 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-05-20T22:11:27.012 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify_test_cb 2024-05-20T22:11:27.012 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (1154 ms) 2024-05-20T22:11:27.012 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (1154 ms total) 2024-05-20T22:11:27.013 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: 2024-05-20T22:11:27.013 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [----------] Global test environment tear-down 2024-05-20T22:11:27.013 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (40146 ms total) 2024-05-20T22:11:27.013 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ PASSED ] 11 tests. 2024-05-20T22:11:27.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: cluster 2024-05-20T22:11:25.974016+0000 mgr.y (mgr.14592) 200 : cluster 0 pgmap v151: 876 pgs: 44 creating+peering, 102 unknown, 730 active+clean; 145 MiB data, 734 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-05-20T22:11:27.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:25.993536+0000 mon.a (mon.0) 1142 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]': finished 2024-05-20T22:11:27.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:25.993679+0000 mon.a (mon.0) 1143 : audit 1 from='client.25394 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:27.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:25.993816+0000 mon.a (mon.0) 1144 : audit 1 from='client.25366 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi050-63936-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:27.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:26.001950+0000 mon.c (mon.2) 110 : audit 1 from='client.? v1:172.21.15.50:0/630108127' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:27.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:26.002538+0000 mon.c (mon.2) 111 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "tierpool": "test-rados-api-smithi050-64274-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:11:27.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: cluster 2024-05-20T22:11:26.008676+0000 mon.a (mon.0) 1145 : cluster 0 osdmap e95: 8 total, 8 up, 8 in 2024-05-20T22:11:27.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:26.010624+0000 mon.b (mon.1) 80 : audit 1 from='client.? v1:172.21.15.50:0/1699601029' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:27.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:26.012460+0000 mon.c (mon.2) 112 : audit 1 from='client.? v1:172.21.15.50:0/2642595230' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:27.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:26.013124+0000 mon.b (mon.1) 81 : audit 1 from='client.? v1:172.21.15.50:0/1491560482' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:27.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:26.013684+0000 mon.b (mon.1) 82 : audit 1 from='client.? v1:172.21.15.50:0/3704587449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:27.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:26.037870+0000 mon.a (mon.0) 1146 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:27.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:26.038280+0000 mon.a (mon.0) 1147 : audit 1 from='client.25180 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:27.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:26.038482+0000 mon.a (mon.0) 1148 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "tierpool": "test-rados-api-smithi050-64274-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:11:27.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:26.039554+0000 mon.a (mon.0) 1149 : audit 1 from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:27.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:26.039903+0000 mon.a (mon.0) 1150 : audit 1 from='client.25225 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:27.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:26.040319+0000 mon.a (mon.0) 1151 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:27.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:26.056863+0000 mon.b (mon.1) 83 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:27.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:26.998191+0000 mon.a (mon.0) 1152 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi050-64235-12"}]': finished 2024-05-20T22:11:27.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:26.998257+0000 mon.a (mon.0) 1153 : audit 1 from='client.25180 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi050-63952-16"}]': finished 2024-05-20T22:11:27.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:26.998326+0000 mon.a (mon.0) 1154 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "tierpool": "test-rados-api-smithi050-64274-6", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:11:27.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:26.998393+0000 mon.a (mon.0) 1155 : audit 1 from='client.25240 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi050-63982-10"}]': finished 2024-05-20T22:11:27.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:26.998446+0000 mon.a (mon.0) 1156 : audit 1 from='client.25225 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7"}]': finished 2024-05-20T22:11:27.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:26.998497+0000 mon.a (mon.0) 1157 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:27.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: cluster 2024-05-20T22:11:27.003735+0000 mon.a (mon.0) 1158 : cluster 0 osdmap e96: 8 total, 8 up, 8 in 2024-05-20T22:11:27.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:27.016215+0000 mon.c (mon.2) 113 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "overlaypool": "test-rados-api-smithi050-64274-6"}]: dispatch 2024-05-20T22:11:27.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:27.025284+0000 mon.b (mon.1) 84 : audit 1 from='client.? v1:172.21.15.50:0/1699601029' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:27.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:27.025786+0000 mon.b (mon.1) 85 : audit 1 from='client.? v1:172.21.15.50:0/3704587449' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:27.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:27.026252+0000 mon.b (mon.1) 86 : audit 1 from='client.? v1:172.21.15.50:0/1491560482' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:27.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:27.034014+0000 mon.a (mon.0) 1159 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "overlaypool": "test-rados-api-smithi050-64274-6"}]: dispatch 2024-05-20T22:11:27.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:27.036304+0000 mon.a (mon.0) 1160 : audit 1 from='client.25180 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:27.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:27.036590+0000 mon.a (mon.0) 1161 : audit 1 from='client.25225 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:27.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:27 smithi145 bash[23893]: audit 2024-05-20T22:11:27.036860+0000 mon.a (mon.0) 1162 : audit 1 from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:27.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: cluster 2024-05-20T22:11:25.974016+0000 mgr.y (mgr.14592) 200 : cluster 0 pgmap v151: 876 pgs: 44 creating+peering, 102 unknown, 730 active+clean; 145 MiB data, 734 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-05-20T22:11:27.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:25.993536+0000 mon.a (mon.0) 1142 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]': finished 2024-05-20T22:11:27.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:25.993679+0000 mon.a (mon.0) 1143 : audit 1 from='client.25394 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:27.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:25.993816+0000 mon.a (mon.0) 1144 : audit 1 from='client.25366 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi050-63936-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:27.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:26.001950+0000 mon.c (mon.2) 110 : audit 1 from='client.? v1:172.21.15.50:0/630108127' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:27.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:26.002538+0000 mon.c (mon.2) 111 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "tierpool": "test-rados-api-smithi050-64274-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:11:27.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: cluster 2024-05-20T22:11:26.008676+0000 mon.a (mon.0) 1145 : cluster 0 osdmap e95: 8 total, 8 up, 8 in 2024-05-20T22:11:27.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:26.010624+0000 mon.b (mon.1) 80 : audit 1 from='client.? v1:172.21.15.50:0/1699601029' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:27.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:26.012460+0000 mon.c (mon.2) 112 : audit 1 from='client.? v1:172.21.15.50:0/2642595230' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:27.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:26.013124+0000 mon.b (mon.1) 81 : audit 1 from='client.? v1:172.21.15.50:0/1491560482' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:27.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:26.013684+0000 mon.b (mon.1) 82 : audit 1 from='client.? v1:172.21.15.50:0/3704587449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:27.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:26.037870+0000 mon.a (mon.0) 1146 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:27.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:26.038280+0000 mon.a (mon.0) 1147 : audit 1 from='client.25180 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:27.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:26.038482+0000 mon.a (mon.0) 1148 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "tierpool": "test-rados-api-smithi050-64274-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:11:27.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: cluster 2024-05-20T22:11:25.974016+0000 mgr.y (mgr.14592) 200 : cluster 0 pgmap v151: 876 pgs: 44 creating+peering, 102 unknown, 730 active+clean; 145 MiB data, 734 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-05-20T22:11:27.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:25.993536+0000 mon.a (mon.0) 1142 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi050-64235-12"}]': finished 2024-05-20T22:11:27.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:25.993679+0000 mon.a (mon.0) 1143 : audit 1 from='client.25394 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:27.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:25.993816+0000 mon.a (mon.0) 1144 : audit 1 from='client.25366 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi050-63936-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:27.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:26.001950+0000 mon.c (mon.2) 110 : audit 1 from='client.? v1:172.21.15.50:0/630108127' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:27.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:26.002538+0000 mon.c (mon.2) 111 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "tierpool": "test-rados-api-smithi050-64274-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:11:27.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: cluster 2024-05-20T22:11:26.008676+0000 mon.a (mon.0) 1145 : cluster 0 osdmap e95: 8 total, 8 up, 8 in 2024-05-20T22:11:27.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:26.010624+0000 mon.b (mon.1) 80 : audit 1 from='client.? v1:172.21.15.50:0/1699601029' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:27.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:26.012460+0000 mon.c (mon.2) 112 : audit 1 from='client.? v1:172.21.15.50:0/2642595230' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:27.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:26.013124+0000 mon.b (mon.1) 81 : audit 1 from='client.? v1:172.21.15.50:0/1491560482' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:27.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:26.013684+0000 mon.b (mon.1) 82 : audit 1 from='client.? v1:172.21.15.50:0/3704587449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:27.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:26.037870+0000 mon.a (mon.0) 1146 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi050-64235-12"}]: dispatch 2024-05-20T22:11:27.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:26.038280+0000 mon.a (mon.0) 1147 : audit 1 from='client.25180 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:27.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:26.038482+0000 mon.a (mon.0) 1148 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "tierpool": "test-rados-api-smithi050-64274-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:11:27.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:26.039554+0000 mon.a (mon.0) 1149 : audit 1 from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:27.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:26.039903+0000 mon.a (mon.0) 1150 : audit 1 from='client.25225 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:27.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:26.040319+0000 mon.a (mon.0) 1151 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:27.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:26.056863+0000 mon.b (mon.1) 83 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:27.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:26.998191+0000 mon.a (mon.0) 1152 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi050-64235-12"}]': finished 2024-05-20T22:11:27.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:26.998257+0000 mon.a (mon.0) 1153 : audit 1 from='client.25180 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi050-63952-16"}]': finished 2024-05-20T22:11:27.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:26.998326+0000 mon.a (mon.0) 1154 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "tierpool": "test-rados-api-smithi050-64274-6", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:11:27.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:26.998393+0000 mon.a (mon.0) 1155 : audit 1 from='client.25240 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi050-63982-10"}]': finished 2024-05-20T22:11:27.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:26.998446+0000 mon.a (mon.0) 1156 : audit 1 from='client.25225 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7"}]': finished 2024-05-20T22:11:27.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:26.998497+0000 mon.a (mon.0) 1157 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:27.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: cluster 2024-05-20T22:11:27.003735+0000 mon.a (mon.0) 1158 : cluster 0 osdmap e96: 8 total, 8 up, 8 in 2024-05-20T22:11:27.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:27.016215+0000 mon.c (mon.2) 113 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "overlaypool": "test-rados-api-smithi050-64274-6"}]: dispatch 2024-05-20T22:11:27.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:27.025284+0000 mon.b (mon.1) 84 : audit 1 from='client.? v1:172.21.15.50:0/1699601029' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:27.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:27.025786+0000 mon.b (mon.1) 85 : audit 1 from='client.? v1:172.21.15.50:0/3704587449' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:27.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:27.026252+0000 mon.b (mon.1) 86 : audit 1 from='client.? v1:172.21.15.50:0/1491560482' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:27.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:26.039554+0000 mon.a (mon.0) 1149 : audit 1 from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:27.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:26.039903+0000 mon.a (mon.0) 1150 : audit 1 from='client.25225 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:27.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:26.040319+0000 mon.a (mon.0) 1151 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:27.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:26.056863+0000 mon.b (mon.1) 83 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:27.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:26.998191+0000 mon.a (mon.0) 1152 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi050-64235-12"}]': finished 2024-05-20T22:11:27.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:26.998257+0000 mon.a (mon.0) 1153 : audit 1 from='client.25180 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi050-63952-16"}]': finished 2024-05-20T22:11:27.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:26.998326+0000 mon.a (mon.0) 1154 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "tierpool": "test-rados-api-smithi050-64274-6", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:11:27.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:26.998393+0000 mon.a (mon.0) 1155 : audit 1 from='client.25240 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi050-63982-10"}]': finished 2024-05-20T22:11:27.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:26.998446+0000 mon.a (mon.0) 1156 : audit 1 from='client.25225 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi050-64207-7"}]': finished 2024-05-20T22:11:27.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:26.998497+0000 mon.a (mon.0) 1157 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:27.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: cluster 2024-05-20T22:11:27.003735+0000 mon.a (mon.0) 1158 : cluster 0 osdmap e96: 8 total, 8 up, 8 in 2024-05-20T22:11:27.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:27.016215+0000 mon.c (mon.2) 113 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "overlaypool": "test-rados-api-smithi050-64274-6"}]: dispatch 2024-05-20T22:11:27.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:27.025284+0000 mon.b (mon.1) 84 : audit 1 from='client.? v1:172.21.15.50:0/1699601029' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:27.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:27.025786+0000 mon.b (mon.1) 85 : audit 1 from='client.? v1:172.21.15.50:0/3704587449' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:27.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:27.026252+0000 mon.b (mon.1) 86 : audit 1 from='client.? v1:172.21.15.50:0/1491560482' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:27.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:27.034014+0000 mon.a (mon.0) 1159 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "overlaypool": "test-rados-api-smithi050-64274-6"}]: dispatch 2024-05-20T22:11:27.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:27.036304+0000 mon.a (mon.0) 1160 : audit 1 from='client.25180 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:27.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:27.036590+0000 mon.a (mon.0) 1161 : audit 1 from='client.25225 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:27.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:27 smithi050 bash[21866]: audit 2024-05-20T22:11:27.036860+0000 mon.a (mon.0) 1162 : audit 1 from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:27.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:27.034014+0000 mon.a (mon.0) 1159 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "overlaypool": "test-rados-api-smithi050-64274-6"}]: dispatch 2024-05-20T22:11:27.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:27.036304+0000 mon.a (mon.0) 1160 : audit 1 from='client.25180 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi050-63952-16"}]: dispatch 2024-05-20T22:11:27.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:27.036590+0000 mon.a (mon.0) 1161 : audit 1 from='client.25225 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi050-64207-7"}]: dispatch 2024-05-20T22:11:27.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:27 smithi050 bash[28929]: audit 2024-05-20T22:11:27.036860+0000 mon.a (mon.0) 1162 : audit 1 from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi050-63982-10"}]: dispatch 2024-05-20T22:11:28.014 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Running main() from gmock_main.cc 2024-05-20T22:11:28.015 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2024-05-20T22:11:28.015 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [----------] Global test environment set-up. 2024-05-20T22:11:28.015 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [----------] 14 tests from LibRadosIo 2024-05-20T22:11:28.015 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2024-05-20T22:11:28.015 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (151 ms) 2024-05-20T22:11:28.015 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2024-05-20T22:11:28.015 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2024-05-20T22:11:28.015 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2024-05-20T22:11:28.015 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: no timeout :/ 2024-05-20T22:11:28.015 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: no timeout :/ 2024-05-20T22:11:28.015 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: no timeout :/ 2024-05-20T22:11:28.016 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: no timeout :/ 2024-05-20T22:11:28.016 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: no timeout :/ 2024-05-20T22:11:28.016 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (22 ms) 2024-05-20T22:11:28.016 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2024-05-20T22:11:28.016 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (5 ms) 2024-05-20T22:11:28.016 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2024-05-20T22:11:28.016 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.Checksum (1 ms) 2024-05-20T22:11:28.016 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-05-20T22:11:28.016 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (5 ms) 2024-05-20T22:11:28.016 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2024-05-20T22:11:28.016 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (3 ms) 2024-05-20T22:11:28.016 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2024-05-20T22:11:28.016 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (4 ms) 2024-05-20T22:11:28.016 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2024-05-20T22:11:28.017 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (2 ms) 2024-05-20T22:11:28.017 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2024-05-20T22:11:28.017 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.TruncTest (2 ms) 2024-05-20T22:11:28.017 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2024-05-20T22:11:28.017 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (3 ms) 2024-05-20T22:11:28.017 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2024-05-20T22:11:28.017 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (2 ms) 2024-05-20T22:11:28.017 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2024-05-20T22:11:28.017 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.RmXattr (8 ms) 2024-05-20T22:11:28.017 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2024-05-20T22:11:28.017 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.XattrIter (3 ms) 2024-05-20T22:11:28.017 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [----------] 14 tests from LibRadosIo (211 ms total) 2024-05-20T22:11:28.017 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: 2024-05-20T22:11:28.017 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2024-05-20T22:11:28.018 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2024-05-20T22:11:28.018 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (1145 ms) 2024-05-20T22:11:28.018 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2024-05-20T22:11:28.018 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (15 ms) 2024-05-20T22:11:28.018 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-05-20T22:11:28.018 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (5 ms) 2024-05-20T22:11:28.018 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-05-20T22:11:28.018 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (3 ms) 2024-05-20T22:11:28.018 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2024-05-20T22:11:28.018 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (12 ms) 2024-05-20T22:11:28.018 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2024-05-20T22:11:28.018 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (4 ms) 2024-05-20T22:11:28.018 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2024-05-20T22:11:28.018 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (3 ms) 2024-05-20T22:11:28.019 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-05-20T22:11:28.019 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (3 ms) 2024-05-20T22:11:28.019 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2024-05-20T22:11:28.019 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (12 ms) 2024-05-20T22:11:28.019 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2024-05-20T22:11:28.019 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (6 ms) 2024-05-20T22:11:28.019 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [----------] 10 tests from LibRadosIoEC (1208 ms total) 2024-05-20T22:11:28.019 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: 2024-05-20T22:11:28.020 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [----- api_lock: Running main() from gmock_main.cc 2024-05-20T22:11:28.020 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2024-05-20T22:11:28.020 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [----------] Global test environment set-up. 2024-05-20T22:11:28.020 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [----------] 8 tests from LibRadosLock 2024-05-20T22:11:28.020 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2024-05-20T22:11:28.020 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (328 ms) 2024-05-20T22:11:28.020 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2024-05-20T22:11:28.020 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLock.LockShared (5 ms) 2024-05-20T22:11:28.020 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2024-05-20T22:11:28.020 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1009 ms) 2024-05-20T22:11:28.020 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2024-05-20T22:11:28.020 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1007 ms) 2024-05-20T22:11:28.020 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2024-05-20T22:11:28.021 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (9 ms) 2024-05-20T22:11:28.021 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2024-05-20T22:11:28.021 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLock.Unlock (8 ms) 2024-05-20T22:11:28.021 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2024-05-20T22:11:28.021 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (11 ms) 2024-05-20T22:11:28.021 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2024-05-20T22:11:28.021 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (8 ms) 2024-05-20T22:11:28.021 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [----------] 8 tests from LibRadosLock (2385 ms total) 2024-05-20T22:11:28.021 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: 2024-05-20T22:11:28.021 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2024-05-20T22:11:28.021 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2024-05-20T22:11:28.021 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (1149 ms) 2024-05-20T22:11:28.021 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2024-05-20T22:11:28.022 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (7 ms) 2024-05-20T22:11:28.022 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2024-05-20T22:11:28.022 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1009 ms) 2024-05-20T22:11:28.022 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2024-05-20T22:11:28.022 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1009 ms) 2024-05-20T22:11:28.022 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2024-05-20T22:11:28.022 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (9 ms) 2024-05-20T22:11:28.022 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2024-05-20T22:11:28.022 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (9 ms) 2024-05-20T22:11:28.022 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2024-05-20T22:11:28.022 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (11 ms) 2024-05-20T22:11:28.022 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2024-05-20T22:11:28.022 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (6 ms) 2024-05-20T22:11:28.022 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (3210 ms total) 2024-05-20T22:11:28.023 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: 2024-05-20T22:11:28.023 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [----------] Global test environment tear-down 2024-05-20T22:11:28.023 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (41280 ms total) 2024-05-20T22:11:28.023 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ PASSED ] 16 tests. 2024-05-20T22:11:28.023 INFO:tasks.workunit.client.0.smithi050.stdout:-----] Global test environment tear-down 2024-05-20T22:11:28.023 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [==========] 24 tests from 2 test suites ran. (41295 ms total) 2024-05-20T22:11:28.023 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ PASSED ] 24 tests. 2024-05-20T22:11:28.023 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: Running main() from gmock_main.cc 2024-05-20T22:11:28.023 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2024-05-20T22:11:28.023 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [----------] Global test environment set-up. 2024-05-20T22:11:28.023 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2024-05-20T22:11:28.023 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: seed 64207 2024-05-20T22:11:28.023 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2024-05-20T22:11:28.023 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (250 ms) 2024-05-20T22:11:28.024 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-05-20T22:11:28.024 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (95 ms) 2024-05-20T22:11:28.024 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2024-05-20T22:11:28.024 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2024-05-20T22:11:28.024 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2024-05-20T22:11:28.024 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (4 ms) 2024-05-20T22:11:28.024 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2024-05-20T22:11:28.024 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (34 ms) 2024-05-20T22:11:28.024 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (383 ms total) 2024-05-20T22:11:28.024 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: 2024-05-20T22:11:28.024 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2024-05-20T22:11:28.024 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2024-05-20T22:11:28.024 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1150 ms) 2024-05-20T22:11:28.024 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2024-05-20T22:11:28.024 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (0 ms) 2024-05-20T22:11:28.025 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2024-05-20T22:11:28.025 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (6 ms) 2024-05-20T22:11:28.025 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2024-05-20T22:11:28.025 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (8 ms) 2024-05-20T22:11:28.025 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (1164 ms total) 2024-05-20T22:11:28.025 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: 2024-05-20T22:11:28.025 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [----------] Global test environment tear-down 2024-05-20T22:11:28.025 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (41158 ms total) 2024-05-20T22:11:28.025 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ PASSED ] 9 tests. 2024-05-20T22:11:28.064 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:11:27 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:11:28.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:28 smithi145 bash[23893]: audit 2024-05-20T22:11:27.067253+0000 mon.b (mon.1) 87 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:28.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:28 smithi145 bash[23893]: audit 2024-05-20T22:11:27.662654+0000 mgr.y (mgr.14592) 201 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:28.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:28 smithi145 bash[23893]: audit 2024-05-20T22:11:28.003153+0000 mon.a (mon.0) 1163 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "overlaypool": "test-rados-api-smithi050-64274-6"}]': finished 2024-05-20T22:11:28.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:28 smithi145 bash[23893]: audit 2024-05-20T22:11:28.003370+0000 mon.a (mon.0) 1164 : audit 1 from='client.25180 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi050-63952-16"}]': finished 2024-05-20T22:11:28.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:28 smithi145 bash[23893]: audit 2024-05-20T22:11:28.003554+0000 mon.a (mon.0) 1165 : audit 1 from='client.25225 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi050-64207-7"}]': finished 2024-05-20T22:11:28.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:28 smithi145 bash[23893]: audit 2024-05-20T22:11:28.003724+0000 mon.a (mon.0) 1166 : audit 1 from='client.25240 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi050-63982-10"}]': finished 2024-05-20T22:11:28.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:28 smithi145 bash[23893]: cluster 2024-05-20T22:11:28.014058+0000 mon.a (mon.0) 1167 : cluster 0 osdmap e97: 8 total, 8 up, 8 in 2024-05-20T22:11:28.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:28 smithi145 bash[23893]: audit 2024-05-20T22:11:28.017306+0000 mon.b (mon.1) 88 : audit 1 from='client.? v1:172.21.15.50:0/2670616373' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi050-64724-2"}]: dispatch 2024-05-20T22:11:28.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:28 smithi145 bash[23893]: audit 2024-05-20T22:11:28.020445+0000 mon.c (mon.2) 114 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64274-6", "mode": "writeback"}]: dispatch 2024-05-20T22:11:28.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:28 smithi145 bash[23893]: audit 2024-05-20T22:11:28.021690+0000 mon.a (mon.0) 1168 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64274-6", "mode": "writeback"}]: dispatch 2024-05-20T22:11:28.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:28 smithi145 bash[23893]: audit 2024-05-20T22:11:28.027171+0000 mon.a (mon.0) 1169 : audit 1 from='client.25372 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi050-64724-2"}]: dispatch 2024-05-20T22:11:28.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:28 smithi145 bash[23893]: audit 2024-05-20T22:11:28.027884+0000 mon.c (mon.2) 115 : audit 1 from='client.? v1:172.21.15.50:0/3008487581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi050-64823-2"}]: dispatch 2024-05-20T22:11:28.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:28 smithi145 bash[23893]: audit 2024-05-20T22:11:28.028682+0000 mon.a (mon.0) 1170 : audit 1 from='client.25346 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi050-64823-2"}]: dispatch 2024-05-20T22:11:28.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:28 smithi050 bash[21866]: audit 2024-05-20T22:11:27.067253+0000 mon.b (mon.1) 87 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:28.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:28 smithi050 bash[21866]: audit 2024-05-20T22:11:27.662654+0000 mgr.y (mgr.14592) 201 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:28.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:28 smithi050 bash[21866]: audit 2024-05-20T22:11:28.003153+0000 mon.a (mon.0) 1163 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "overlaypool": "test-rados-api-smithi050-64274-6"}]': finished 2024-05-20T22:11:28.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:28 smithi050 bash[21866]: audit 2024-05-20T22:11:28.003370+0000 mon.a (mon.0) 1164 : audit 1 from='client.25180 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi050-63952-16"}]': finished 2024-05-20T22:11:28.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:28 smithi050 bash[21866]: audit 2024-05-20T22:11:28.003554+0000 mon.a (mon.0) 1165 : audit 1 from='client.25225 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi050-64207-7"}]': finished 2024-05-20T22:11:28.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:28 smithi050 bash[21866]: audit 2024-05-20T22:11:28.003724+0000 mon.a (mon.0) 1166 : audit 1 from='client.25240 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi050-63982-10"}]': finished 2024-05-20T22:11:28.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:28 smithi050 bash[21866]: cluster 2024-05-20T22:11:28.014058+0000 mon.a (mon.0) 1167 : cluster 0 osdmap e97: 8 total, 8 up, 8 in 2024-05-20T22:11:28.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:28 smithi050 bash[21866]: audit 2024-05-20T22:11:28.017306+0000 mon.b (mon.1) 88 : audit 1 from='client.? v1:172.21.15.50:0/2670616373' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi050-64724-2"}]: dispatch 2024-05-20T22:11:28.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:28 smithi050 bash[21866]: audit 2024-05-20T22:11:28.020445+0000 mon.c (mon.2) 114 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64274-6", "mode": "writeback"}]: dispatch 2024-05-20T22:11:28.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:28 smithi050 bash[21866]: audit 2024-05-20T22:11:28.021690+0000 mon.a (mon.0) 1168 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64274-6", "mode": "writeback"}]: dispatch 2024-05-20T22:11:28.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:28 smithi050 bash[21866]: audit 2024-05-20T22:11:28.027171+0000 mon.a (mon.0) 1169 : audit 1 from='client.25372 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi050-64724-2"}]: dispatch 2024-05-20T22:11:28.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:28 smithi050 bash[21866]: audit 2024-05-20T22:11:28.027884+0000 mon.c (mon.2) 115 : audit 1 from='client.? v1:172.21.15.50:0/3008487581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi050-64823-2"}]: dispatch 2024-05-20T22:11:28.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:28 smithi050 bash[21866]: audit 2024-05-20T22:11:28.028682+0000 mon.a (mon.0) 1170 : audit 1 from='client.25346 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi050-64823-2"}]: dispatch 2024-05-20T22:11:28.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:28 smithi050 bash[28929]: audit 2024-05-20T22:11:27.067253+0000 mon.b (mon.1) 87 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:28.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:28 smithi050 bash[28929]: audit 2024-05-20T22:11:27.662654+0000 mgr.y (mgr.14592) 201 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:28.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:28 smithi050 bash[28929]: audit 2024-05-20T22:11:28.003153+0000 mon.a (mon.0) 1163 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "overlaypool": "test-rados-api-smithi050-64274-6"}]': finished 2024-05-20T22:11:28.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:28 smithi050 bash[28929]: audit 2024-05-20T22:11:28.003370+0000 mon.a (mon.0) 1164 : audit 1 from='client.25180 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi050-63952-16"}]': finished 2024-05-20T22:11:28.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:28 smithi050 bash[28929]: audit 2024-05-20T22:11:28.003554+0000 mon.a (mon.0) 1165 : audit 1 from='client.25225 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi050-64207-7"}]': finished 2024-05-20T22:11:28.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:28 smithi050 bash[28929]: audit 2024-05-20T22:11:28.003724+0000 mon.a (mon.0) 1166 : audit 1 from='client.25240 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi050-63982-10"}]': finished 2024-05-20T22:11:28.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:28 smithi050 bash[28929]: cluster 2024-05-20T22:11:28.014058+0000 mon.a (mon.0) 1167 : cluster 0 osdmap e97: 8 total, 8 up, 8 in 2024-05-20T22:11:28.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:28 smithi050 bash[28929]: audit 2024-05-20T22:11:28.017306+0000 mon.b (mon.1) 88 : audit 1 from='client.? v1:172.21.15.50:0/2670616373' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi050-64724-2"}]: dispatch 2024-05-20T22:11:28.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:28 smithi050 bash[28929]: audit 2024-05-20T22:11:28.020445+0000 mon.c (mon.2) 114 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64274-6", "mode": "writeback"}]: dispatch 2024-05-20T22:11:28.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:28 smithi050 bash[28929]: audit 2024-05-20T22:11:28.021690+0000 mon.a (mon.0) 1168 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64274-6", "mode": "writeback"}]: dispatch 2024-05-20T22:11:28.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:28 smithi050 bash[28929]: audit 2024-05-20T22:11:28.027171+0000 mon.a (mon.0) 1169 : audit 1 from='client.25372 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi050-64724-2"}]: dispatch 2024-05-20T22:11:28.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:28 smithi050 bash[28929]: audit 2024-05-20T22:11:28.027884+0000 mon.c (mon.2) 115 : audit 1 from='client.? v1:172.21.15.50:0/3008487581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi050-64823-2"}]: dispatch 2024-05-20T22:11:28.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:28 smithi050 bash[28929]: audit 2024-05-20T22:11:28.028682+0000 mon.a (mon.0) 1170 : audit 1 from='client.25346 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi050-64823-2"}]: dispatch 2024-05-20T22:11:29.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:11:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:11:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:11:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:29 smithi050 bash[21866]: cluster 2024-05-20T22:11:27.975369+0000 mgr.y (mgr.14592) 202 : cluster 0 pgmap v154: 824 pgs: 24 creating+peering, 190 unknown, 610 active+clean; 145 MiB data, 734 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 4.1 KiB/s wr, 2 op/s 2024-05-20T22:11:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:29 smithi050 bash[21866]: audit 2024-05-20T22:11:28.075868+0000 mon.b (mon.1) 89 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:30.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:29 smithi050 bash[28929]: cluster 2024-05-20T22:11:27.975369+0000 mgr.y (mgr.14592) 202 : cluster 0 pgmap v154: 824 pgs: 24 creating+peering, 190 unknown, 610 active+clean; 145 MiB data, 734 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 4.1 KiB/s wr, 2 op/s 2024-05-20T22:11:30.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:29 smithi050 bash[28929]: audit 2024-05-20T22:11:28.075868+0000 mon.b (mon.1) 89 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:30.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:29 smithi145 bash[23893]: cluster 2024-05-20T22:11:27.975369+0000 mgr.y (mgr.14592) 202 : cluster 0 pgmap v154: 824 pgs: 24 creating+peering, 190 unknown, 610 active+clean; 145 MiB data, 734 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 4.1 KiB/s wr, 2 op/s 2024-05-20T22:11:30.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:29 smithi145 bash[23893]: audit 2024-05-20T22:11:28.075868+0000 mon.b (mon.1) 89 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:32.227 INFO:tasks.workunit.client.0.smithi050.stdout: pool: Running main() from gmock_main.cc 2024-05-20T22:11:32.227 INFO:tasks.workunit.client.0.smithi050.stdout: pool: [==========] Running 6 tests from 1 test suite. 2024-05-20T22:11:32.228 INFO:tasks.workunit.client.0.smithi050.stdout: pool: [----------] Global test environment set-up. 2024-05-20T22:11:32.228 INFO:tasks.workunit.client.0.smithi050.stdout: pool: [----------] 6 tests from NeoRadosPools 2024-05-20T22:11:32.228 INFO:tasks.workunit.client.0.smithi050.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2024-05-20T22:11:32.228 INFO:tasks.workunit.client.0.smithi050.stdout: pool: [ OK ] NeoRadosPools.PoolList (17934 ms) 2024-05-20T22:11:32.228 INFO:tasks.workunit.client.0.smithi050.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2024-05-20T22:11:32.228 INFO:tasks.workunit.client.0.smithi050.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (10426 ms) 2024-05-20T22:11:32.228 INFO:tasks.workunit.client.0.smithi050.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-05-20T22:11:32.228 INFO:tasks.workunit.client.0.smithi050.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (2441 ms) 2024-05-20T22:11:32.228 INFO:tasks.workunit.client.0.smithi050.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2024-05-20T22:11:32.228 INFO:tasks.workunit.client.0.smithi050.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (8106 ms) 2024-05-20T22:11:32.228 INFO:tasks.workunit.client.0.smithi050.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2024-05-20T22:11:32.228 INFO:tasks.workunit.client.0.smithi050.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (2034 ms) 2024-05-20T22:11:32.228 INFO:tasks.workunit.client.0.smithi050.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-05-20T22:11:32.229 INFO:tasks.workunit.client.0.smithi050.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (4185 ms) 2024-05-20T22:11:32.229 INFO:tasks.workunit.client.0.smithi050.stdout: pool: [----------] 6 tests from NeoRadosPools (45126 ms total) 2024-05-20T22:11:32.229 INFO:tasks.workunit.client.0.smithi050.stdout: pool: 2024-05-20T22:11:32.229 INFO:tasks.workunit.client.0.smithi050.stdout: pool: [----------] Global test environment tear-down 2024-05-20T22:11:32.229 INFO:tasks.workunit.client.0.smithi050.stdout: pool: [==========] 6 tests from 1 test suite ran. (45126 ms total) 2024-05-20T22:11:32.229 INFO:tasks.workunit.client.0.smithi050.stdout: pool: [ PASSED ] 6 tests. 2024-05-20T22:11:32.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:32 smithi050 bash[21866]: audit 2024-05-20T22:11:29.077202+0000 mon.b (mon.1) 90 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:32.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:32 smithi050 bash[21866]: cluster 2024-05-20T22:11:29.435091+0000 mon.a (mon.0) 1171 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:11:32.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:32 smithi050 bash[21866]: audit 2024-05-20T22:11:29.438104+0000 mon.a (mon.0) 1172 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64274-6", "mode": "writeback"}]': finished 2024-05-20T22:11:32.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:32 smithi050 bash[21866]: audit 2024-05-20T22:11:29.438280+0000 mon.a (mon.0) 1173 : audit 1 from='client.25372 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi050-64724-2"}]': finished 2024-05-20T22:11:32.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:32 smithi050 bash[21866]: audit 2024-05-20T22:11:29.438415+0000 mon.a (mon.0) 1174 : audit 1 from='client.25346 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi050-64823-2"}]': finished 2024-05-20T22:11:32.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:32 smithi050 bash[21866]: audit 2024-05-20T22:11:29.448593+0000 mon.c (mon.2) 116 : audit 1 from='client.? v1:172.21.15.50:0/3008487581' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi050-64823-2"}]: dispatch 2024-05-20T22:11:32.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:32 smithi050 bash[21866]: audit 2024-05-20T22:11:29.452125+0000 mon.b (mon.1) 91 : audit 1 from='client.? v1:172.21.15.50:0/2670616373' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi050-64724-2"}]: dispatch 2024-05-20T22:11:32.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:32 smithi050 bash[21866]: audit 2024-05-20T22:11:29.461037+0000 mon.c (mon.2) 117 : audit 1 from='client.? v1:172.21.15.50:0/4118317797' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:32.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:32 smithi050 bash[21866]: cluster 2024-05-20T22:11:29.898439+0000 mon.a (mon.0) 1175 : cluster 0 osdmap e98: 8 total, 8 up, 8 in 2024-05-20T22:11:32.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:32 smithi050 bash[21866]: cluster 2024-05-20T22:11:29.980070+0000 mgr.y (mgr.14592) 203 : cluster 0 pgmap v157: 648 pgs: 64 creating+peering, 32 unknown, 552 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:11:32.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:32 smithi050 bash[21866]: audit 2024-05-20T22:11:30.078937+0000 mon.b (mon.1) 92 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:32.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:32 smithi050 bash[21866]: cluster 2024-05-20T22:11:30.340129+0000 mon.a (mon.0) 1176 : cluster 3 Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:32.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:32 smithi050 bash[21866]: audit 2024-05-20T22:11:30.343811+0000 mon.a (mon.0) 1177 : audit 1 from='client.? v1:172.21.15.50:0/2611170750' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi050-63936-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:32.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:32 smithi050 bash[21866]: audit 2024-05-20T22:11:30.344153+0000 mon.a (mon.0) 1178 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:32.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:32 smithi050 bash[21866]: audit 2024-05-20T22:11:30.808447+0000 mon.a (mon.0) 1179 : audit 1 from='client.25346 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi050-64823-2"}]: dispatch 2024-05-20T22:11:32.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:32 smithi050 bash[21866]: audit 2024-05-20T22:11:30.809272+0000 mon.a (mon.0) 1180 : audit 1 from='client.25436 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:32.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:32 smithi050 bash[28929]: audit 2024-05-20T22:11:29.077202+0000 mon.b (mon.1) 90 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:32.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:32 smithi050 bash[28929]: cluster 2024-05-20T22:11:29.435091+0000 mon.a (mon.0) 1171 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:11:32.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:32 smithi050 bash[28929]: audit 2024-05-20T22:11:29.438104+0000 mon.a (mon.0) 1172 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64274-6", "mode": "writeback"}]': finished 2024-05-20T22:11:32.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:32 smithi050 bash[28929]: audit 2024-05-20T22:11:29.438280+0000 mon.a (mon.0) 1173 : audit 1 from='client.25372 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi050-64724-2"}]': finished 2024-05-20T22:11:32.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:32 smithi050 bash[28929]: audit 2024-05-20T22:11:29.438415+0000 mon.a (mon.0) 1174 : audit 1 from='client.25346 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi050-64823-2"}]': finished 2024-05-20T22:11:32.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:32 smithi050 bash[28929]: audit 2024-05-20T22:11:29.448593+0000 mon.c (mon.2) 116 : audit 1 from='client.? v1:172.21.15.50:0/3008487581' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi050-64823-2"}]: dispatch 2024-05-20T22:11:32.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:32 smithi050 bash[28929]: audit 2024-05-20T22:11:29.452125+0000 mon.b (mon.1) 91 : audit 1 from='client.? v1:172.21.15.50:0/2670616373' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi050-64724-2"}]: dispatch 2024-05-20T22:11:32.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:32 smithi050 bash[28929]: audit 2024-05-20T22:11:29.461037+0000 mon.c (mon.2) 117 : audit 1 from='client.? v1:172.21.15.50:0/4118317797' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:32.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:32 smithi050 bash[28929]: cluster 2024-05-20T22:11:29.898439+0000 mon.a (mon.0) 1175 : cluster 0 osdmap e98: 8 total, 8 up, 8 in 2024-05-20T22:11:32.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:32 smithi050 bash[28929]: cluster 2024-05-20T22:11:29.980070+0000 mgr.y (mgr.14592) 203 : cluster 0 pgmap v157: 648 pgs: 64 creating+peering, 32 unknown, 552 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:11:32.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:32 smithi050 bash[28929]: audit 2024-05-20T22:11:30.078937+0000 mon.b (mon.1) 92 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:32.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:32 smithi050 bash[28929]: cluster 2024-05-20T22:11:30.340129+0000 mon.a (mon.0) 1176 : cluster 3 Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:32.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:32 smithi050 bash[28929]: audit 2024-05-20T22:11:30.343811+0000 mon.a (mon.0) 1177 : audit 1 from='client.? v1:172.21.15.50:0/2611170750' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi050-63936-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:32.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:32 smithi050 bash[28929]: audit 2024-05-20T22:11:30.344153+0000 mon.a (mon.0) 1178 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:32.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:32 smithi050 bash[28929]: audit 2024-05-20T22:11:30.808447+0000 mon.a (mon.0) 1179 : audit 1 from='client.25346 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi050-64823-2"}]: dispatch 2024-05-20T22:11:32.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:32 smithi050 bash[28929]: audit 2024-05-20T22:11:30.809272+0000 mon.a (mon.0) 1180 : audit 1 from='client.25436 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:32.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:32 smithi050 bash[21866]: audit 2024-05-20T22:11:30.809612+0000 mon.a (mon.0) 1181 : audit 1 from='client.? v1:172.21.15.50:0/2611170750' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi050-63936-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:32.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:32 smithi050 bash[21866]: audit 2024-05-20T22:11:30.809703+0000 mon.a (mon.0) 1182 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:32.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:32 smithi050 bash[21866]: cluster 2024-05-20T22:11:30.814945+0000 mon.a (mon.0) 1183 : cluster 0 osdmap e99: 8 total, 8 up, 8 in 2024-05-20T22:11:32.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:32 smithi050 bash[28929]: audit 2024-05-20T22:11:30.809612+0000 mon.a (mon.0) 1181 : audit 1 from='client.? v1:172.21.15.50:0/2611170750' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi050-63936-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:32.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:32 smithi050 bash[28929]: audit 2024-05-20T22:11:30.809703+0000 mon.a (mon.0) 1182 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:32.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:32 smithi050 bash[28929]: cluster 2024-05-20T22:11:30.814945+0000 mon.a (mon.0) 1183 : cluster 0 osdmap e99: 8 total, 8 up, 8 in 2024-05-20T22:11:32.560 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2024-05-20T22:11:32.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2024-05-20T22:11:32.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2024-05-20T22:11:32.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2024-05-20T22:11:32.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-05-20T22:11:32.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: notify 2024-05-20T22:11:32.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (9097 ms) 2024-05-20T22:11:32.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-05-20T22:11:32.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (7 ms) 2024-05-20T22:11:32.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (9104 ms total) 2024-05-20T22:11:32.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: 2024-05-20T22:11:32.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-05-20T22:11:32.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-05-20T22:11:32.562 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: notify 2024-05-20T22:11:32.562 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (93 ms) 2024-05-20T22:11:32.562 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-05-20T22:11:32.562 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: notify 2024-05-20T22:11:32.562 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (5769 ms) 2024-05-20T22:11:32.562 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-05-20T22:11:32.562 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (5 ms) 2024-05-20T22:11:32.562 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-05-20T22:11:32.562 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (7 ms) 2024-05-20T22:11:32.562 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-05-20T22:11:32.562 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: handle_notify cookie 94611350764720 notify_id 420906795009 notifier_gid 25376 2024-05-20T22:11:32.562 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (8 ms) 2024-05-20T22:11:32.563 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-05-20T22:11:32.563 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: handle_notify cookie 94611350764720 notify_id 420906795009 notifier_gid 25376 2024-05-20T22:11:32.563 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (7 ms) 2024-05-20T22:11:32.563 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-05-20T22:11:32.563 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: handle_notify cookie 94611352308720 notify_id 420906795010 notifier_gid 25376 2024-05-20T22:11:32.563 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (7 ms) 2024-05-20T22:11:32.563 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-05-20T22:11:32.563 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: handle_notify cookie 94611352308720 notify_id 420906795011 notifier_gid 25376 2024-05-20T22:11:32.563 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (6 ms) 2024-05-20T22:11:32.563 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-05-20T22:11:32.563 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: handle_notify cookie 94611352308720 notify_id 420906795012 notifier_gid 25376 2024-05-20T22:11:32.563 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (8 ms) 2024-05-20T22:11:32.563 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-05-20T22:11:32.563 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: handle_notify cookie 94611352308720 notify_id 420906795013 notifier_gid 25376 2024-05-20T22:11:32.564 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (7 ms) 2024-05-20T22:11:32.564 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-05-20T22:11:32.564 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: trying... 2024-05-20T22:11:32.564 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: handle_notify cookie 94611352308720 notify_id 420906795014 notifier_gid 25376 2024-05-20T22:11:32.564 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: timed out 2024-05-20T22:11:32.564 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: flushing 2024-05-20T22:11:32.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:32 smithi145 bash[23893]: audit 2024-05-20T22:11:29.077202+0000 mon.b (mon.1) 90 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:32.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:32 smithi145 bash[23893]: cluster 2024-05-20T22:11:29.435091+0000 mon.a (mon.0) 1171 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:11:32.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:32 smithi145 bash[23893]: audit 2024-05-20T22:11:29.438104+0000 mon.a (mon.0) 1172 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64274-6", "mode": "writeback"}]': finished 2024-05-20T22:11:32.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:32 smithi145 bash[23893]: audit 2024-05-20T22:11:29.438280+0000 mon.a (mon.0) 1173 : audit 1 from='client.25372 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi050-64724-2"}]': finished 2024-05-20T22:11:32.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:32 smithi145 bash[23893]: audit 2024-05-20T22:11:29.438415+0000 mon.a (mon.0) 1174 : audit 1 from='client.25346 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi050-64823-2"}]': finished 2024-05-20T22:11:32.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:32 smithi145 bash[23893]: audit 2024-05-20T22:11:29.448593+0000 mon.c (mon.2) 116 : audit 1 from='client.? v1:172.21.15.50:0/3008487581' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi050-64823-2"}]: dispatch 2024-05-20T22:11:32.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:32 smithi145 bash[23893]: audit 2024-05-20T22:11:29.452125+0000 mon.b (mon.1) 91 : audit 1 from='client.? v1:172.21.15.50:0/2670616373' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi050-64724-2"}]: dispatch 2024-05-20T22:11:32.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:32 smithi145 bash[23893]: audit 2024-05-20T22:11:29.461037+0000 mon.c (mon.2) 117 : audit 1 from='client.? v1:172.21.15.50:0/4118317797' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:32.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:32 smithi145 bash[23893]: cluster 2024-05-20T22:11:29.898439+0000 mon.a (mon.0) 1175 : cluster 0 osdmap e98: 8 total, 8 up, 8 in 2024-05-20T22:11:32.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:32 smithi145 bash[23893]: cluster 2024-05-20T22:11:29.980070+0000 mgr.y (mgr.14592) 203 : cluster 0 pgmap v157: 648 pgs: 64 creating+peering, 32 unknown, 552 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:11:32.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:32 smithi145 bash[23893]: audit 2024-05-20T22:11:30.078937+0000 mon.b (mon.1) 92 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:32.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:32 smithi145 bash[23893]: cluster 2024-05-20T22:11:30.340129+0000 mon.a (mon.0) 1176 : cluster 3 Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:32.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:32 smithi145 bash[23893]: audit 2024-05-20T22:11:30.343811+0000 mon.a (mon.0) 1177 : audit 1 from='client.? v1:172.21.15.50:0/2611170750' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi050-63936-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:32.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:32 smithi145 bash[23893]: audit 2024-05-20T22:11:30.344153+0000 mon.a (mon.0) 1178 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:32.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:32 smithi145 bash[23893]: audit 2024-05-20T22:11:30.808447+0000 mon.a (mon.0) 1179 : audit 1 from='client.25346 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi050-64823-2"}]: dispatch 2024-05-20T22:11:32.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:32 smithi145 bash[23893]: audit 2024-05-20T22:11:30.809272+0000 mon.a (mon.0) 1180 : audit 1 from='client.25436 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:32.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:32 smithi145 bash[23893]: audit 2024-05-20T22:11:30.809612+0000 mon.a (mon.0) 1181 : audit 1 from='client.? v1:172.21.15.50:0/2611170750' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi050-63936-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:32.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:32 smithi145 bash[23893]: audit 2024-05-20T22:11:30.809703+0000 mon.a (mon.0) 1182 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:32.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:32 smithi145 bash[23893]: cluster 2024-05-20T22:11:30.814945+0000 mon.a (mon.0) 1183 : cluster 0 osdmap e99: 8 total, 8 up, 8 in 2024-05-20T22:11:33.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch ec_io: Running main() from gmock_main.cc 2024-05-20T22:11:33.227 INFO:tasks.workunit.client.0.smithi050.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2024-05-20T22:11:33.227 INFO:tasks.workunit.client.0.smithi050.stdout: ec_io: [----------] Global test environment set-up. 2024-05-20T22:11:33.227 INFO:tasks.workunit.client.0.smithi050.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2024-05-20T22:11:33.227 INFO:tasks.workunit.client.0.smithi050.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2024-05-20T22:11:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (30838 ms) 2024-05-20T22:11:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2024-05-20T22:11:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (15329 ms) 2024-05-20T22:11:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (46167 ms total) 2024-05-20T22:11:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: ec_io: 2024-05-20T22:11:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: ec_io: [----------] Global test environment tear-down 2024-05-20T22:11:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (46167 ms total) 2024-05-20T22:11:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: ec_io: [ PASSED ] 2 tests. 2024-05-20T22:11:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:33 smithi145 bash[23893]: audit 2024-05-20T22:11:30.841440+0000 mon.c (mon.2) 118 : audit 1 from='client.? v1:172.21.15.50:0/2395875366' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi050-64159-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:33 smithi145 bash[23893]: audit 2024-05-20T22:11:31.080775+0000 mon.b (mon.1) 93 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:33 smithi145 bash[23893]: cluster 2024-05-20T22:11:31.981296+0000 mgr.y (mgr.14592) 204 : cluster 0 pgmap v159: 712 pgs: 64 creating+peering, 128 unknown, 520 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 822 B/s rd, 1.0 KiB/s wr, 2 op/s 2024-05-20T22:11:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:33 smithi145 bash[23893]: audit 2024-05-20T22:11:32.082432+0000 mon.b (mon.1) 94 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:33 smithi145 bash[23893]: cluster 2024-05-20T22:11:32.187633+0000 mon.a (mon.0) 1184 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-05-20T22:11:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:33 smithi145 bash[23893]: audit 2024-05-20T22:11:32.188662+0000 mon.a (mon.0) 1185 : audit 1 from='client.25372 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi050-64724-2"}]: dispatch 2024-05-20T22:11:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:33 smithi145 bash[23893]: audit 2024-05-20T22:11:32.200061+0000 mon.a (mon.0) 1186 : audit 1 from='client.25445 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi050-64159-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:33 smithi145 bash[23893]: audit 2024-05-20T22:11:32.204033+0000 mon.a (mon.0) 1187 : audit 1 from='client.25346 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi050-64823-2"}]': finished 2024-05-20T22:11:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:33 smithi145 bash[23893]: audit 2024-05-20T22:11:32.204165+0000 mon.a (mon.0) 1188 : audit 1 from='client.25436 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:33 smithi145 bash[23893]: cluster 2024-05-20T22:11:32.231470+0000 mon.a (mon.0) 1189 : cluster 0 osdmap e100: 8 total, 8 up, 8 in 2024-05-20T22:11:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:33 smithi145 bash[23893]: audit 2024-05-20T22:11:32.234544+0000 mon.b (mon.1) 95 : audit 1 from='client.? v1:172.21.15.50:0/4117530166' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:33.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:33 smithi145 bash[23893]: audit 2024-05-20T22:11:32.275038+0000 mon.c (mon.2) 119 : audit 1 from='client.? v1:172.21.15.50:0/1340744784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi050-64823-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:33.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:33 smithi145 bash[23893]: audit 2024-05-20T22:11:32.690125+0000 mon.a (mon.0) 1190 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:33.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:33 smithi145 bash[23893]: audit 2024-05-20T22:11:32.691756+0000 mon.a (mon.0) 1191 : audit 1 from='client.25426 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:33.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:33 smithi145 bash[23893]: audit 2024-05-20T22:11:32.691936+0000 mon.a (mon.0) 1192 : audit 1 from='client.25457 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi050-64823-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:33.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:33 smithi145 bash[23893]: audit 2024-05-20T22:11:33.084107+0000 mon.b (mon.1) 96 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:33.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:33 smithi050 bash[28929]: audit 2024-05-20T22:11:30.841440+0000 mon.c (mon.2) 118 : audit 1 from='client.? v1:172.21.15.50:0/2395875366' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi050-64159-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:33.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:33 smithi050 bash[28929]: audit 2024-05-20T22:11:31.080775+0000 mon.b (mon.1) 93 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:33.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:33 smithi050 bash[28929]: cluster 2024-05-20T22:11:31.981296+0000 mgr.y (mgr.14592) 204 : cluster 0 pgmap v159: 712 pgs: 64 creating+peering, 128 unknown, 520 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 822 B/s rd, 1.0 KiB/s wr, 2 op/s 2024-05-20T22:11:33.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:33 smithi050 bash[28929]: audit 2024-05-20T22:11:32.082432+0000 mon.b (mon.1) 94 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:33.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:33 smithi050 bash[28929]: cluster 2024-05-20T22:11:32.187633+0000 mon.a (mon.0) 1184 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-05-20T22:11:33.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:33 smithi050 bash[28929]: audit 2024-05-20T22:11:32.188662+0000 mon.a (mon.0) 1185 : audit 1 from='client.25372 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi050-64724-2"}]: dispatch 2024-05-20T22:11:33.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:33 smithi050 bash[28929]: audit 2024-05-20T22:11:32.200061+0000 mon.a (mon.0) 1186 : audit 1 from='client.25445 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi050-64159-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:33.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:33 smithi050 bash[28929]: audit 2024-05-20T22:11:32.204033+0000 mon.a (mon.0) 1187 : audit 1 from='client.25346 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi050-64823-2"}]': finished 2024-05-20T22:11:33.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:33 smithi050 bash[28929]: audit 2024-05-20T22:11:32.204165+0000 mon.a (mon.0) 1188 : audit 1 from='client.25436 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:33.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:33 smithi050 bash[28929]: cluster 2024-05-20T22:11:32.231470+0000 mon.a (mon.0) 1189 : cluster 0 osdmap e100: 8 total, 8 up, 8 in 2024-05-20T22:11:33.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:33 smithi050 bash[28929]: audit 2024-05-20T22:11:32.234544+0000 mon.b (mon.1) 95 : audit 1 from='client.? v1:172.21.15.50:0/4117530166' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:33.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:33 smithi050 bash[28929]: audit 2024-05-20T22:11:32.275038+0000 mon.c (mon.2) 119 : audit 1 from='client.? v1:172.21.15.50:0/1340744784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi050-64823-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:33.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:33 smithi050 bash[28929]: audit 2024-05-20T22:11:32.690125+0000 mon.a (mon.0) 1190 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:33.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:33 smithi050 bash[28929]: audit 2024-05-20T22:11:32.691756+0000 mon.a (mon.0) 1191 : audit 1 from='client.25426 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:33.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:33 smithi050 bash[28929]: audit 2024-05-20T22:11:32.691936+0000 mon.a (mon.0) 1192 : audit 1 from='client.25457 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi050-64823-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:33.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:33 smithi050 bash[28929]: audit 2024-05-20T22:11:33.084107+0000 mon.b (mon.1) 96 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:33.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:33 smithi050 bash[21866]: audit 2024-05-20T22:11:30.841440+0000 mon.c (mon.2) 118 : audit 1 from='client.? v1:172.21.15.50:0/2395875366' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi050-64159-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:33.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:33 smithi050 bash[21866]: audit 2024-05-20T22:11:31.080775+0000 mon.b (mon.1) 93 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:33.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:33 smithi050 bash[21866]: cluster 2024-05-20T22:11:31.981296+0000 mgr.y (mgr.14592) 204 : cluster 0 pgmap v159: 712 pgs: 64 creating+peering, 128 unknown, 520 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 822 B/s rd, 1.0 KiB/s wr, 2 op/s 2024-05-20T22:11:33.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:33 smithi050 bash[21866]: audit 2024-05-20T22:11:32.082432+0000 mon.b (mon.1) 94 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:33.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:33 smithi050 bash[21866]: cluster 2024-05-20T22:11:32.187633+0000 mon.a (mon.0) 1184 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-05-20T22:11:33.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:33 smithi050 bash[21866]: audit 2024-05-20T22:11:32.188662+0000 mon.a (mon.0) 1185 : audit 1 from='client.25372 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi050-64724-2"}]: dispatch 2024-05-20T22:11:33.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:33 smithi050 bash[21866]: audit 2024-05-20T22:11:32.200061+0000 mon.a (mon.0) 1186 : audit 1 from='client.25445 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi050-64159-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:33.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:33 smithi050 bash[21866]: audit 2024-05-20T22:11:32.204033+0000 mon.a (mon.0) 1187 : audit 1 from='client.25346 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi050-64823-2"}]': finished 2024-05-20T22:11:33.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:33 smithi050 bash[21866]: audit 2024-05-20T22:11:32.204165+0000 mon.a (mon.0) 1188 : audit 1 from='client.25436 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:33.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:33 smithi050 bash[21866]: cluster 2024-05-20T22:11:32.231470+0000 mon.a (mon.0) 1189 : cluster 0 osdmap e100: 8 total, 8 up, 8 in 2024-05-20T22:11:33.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:33 smithi050 bash[21866]: audit 2024-05-20T22:11:32.234544+0000 mon.b (mon.1) 95 : audit 1 from='client.? v1:172.21.15.50:0/4117530166' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:33.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:33 smithi050 bash[21866]: audit 2024-05-20T22:11:32.275038+0000 mon.c (mon.2) 119 : audit 1 from='client.? v1:172.21.15.50:0/1340744784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi050-64823-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:33.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:33 smithi050 bash[21866]: audit 2024-05-20T22:11:32.690125+0000 mon.a (mon.0) 1190 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:33.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:33 smithi050 bash[21866]: audit 2024-05-20T22:11:32.691756+0000 mon.a (mon.0) 1191 : audit 1 from='client.25426 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:33.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:33 smithi050 bash[21866]: audit 2024-05-20T22:11:32.691936+0000 mon.a (mon.0) 1192 : audit 1 from='client.25457 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi050-64823-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:33.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:33 smithi050 bash[21866]: audit 2024-05-20T22:11:33.084107+0000 mon.b (mon.1) 96 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:34.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:34 smithi050 bash[21866]: audit 2024-05-20T22:11:33.216944+0000 mon.a (mon.0) 1193 : audit 1 from='client.25372 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi050-64724-2"}]': finished 2024-05-20T22:11:34.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:34 smithi050 bash[21866]: audit 2024-05-20T22:11:33.217180+0000 mon.a (mon.0) 1194 : audit 1 from='client.25445 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi050-64159-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:34.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:34 smithi050 bash[21866]: audit 2024-05-20T22:11:33.217324+0000 mon.a (mon.0) 1195 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:34.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:34 smithi050 bash[21866]: audit 2024-05-20T22:11:33.217467+0000 mon.a (mon.0) 1196 : audit 1 from='client.25426 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:34.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:34 smithi050 bash[21866]: audit 2024-05-20T22:11:33.217629+0000 mon.a (mon.0) 1197 : audit 1 from='client.25457 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi050-64823-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:34.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:34 smithi050 bash[21866]: audit 2024-05-20T22:11:33.228339+0000 mon.c (mon.2) 120 : audit 1 from='client.? v1:172.21.15.50:0/1340744784' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi050-64823-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi050-64823-3"}]: dispatch 2024-05-20T22:11:34.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:34 smithi050 bash[21866]: cluster 2024-05-20T22:11:33.229227+0000 mon.a (mon.0) 1198 : cluster 0 osdmap e101: 8 total, 8 up, 8 in 2024-05-20T22:11:34.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:34 smithi050 bash[21866]: audit 2024-05-20T22:11:33.234450+0000 mon.a (mon.0) 1199 : audit 1 from='client.25457 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi050-64823-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi050-64823-3"}]: dispatch 2024-05-20T22:11:34.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:34 smithi050 bash[21866]: audit 2024-05-20T22:11:33.761993+0000 mon.a (mon.0) 1200 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:11:34.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:34 smithi050 bash[21866]: audit 2024-05-20T22:11:34.085882+0000 mon.b (mon.1) 97 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:34.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:34 smithi050 bash[28929]: audit 2024-05-20T22:11:33.216944+0000 mon.a (mon.0) 1193 : audit 1 from='client.25372 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi050-64724-2"}]': finished 2024-05-20T22:11:34.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:34 smithi050 bash[28929]: audit 2024-05-20T22:11:33.217180+0000 mon.a (mon.0) 1194 : audit 1 from='client.25445 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi050-64159-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:34.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:34 smithi050 bash[28929]: audit 2024-05-20T22:11:33.217324+0000 mon.a (mon.0) 1195 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:34.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:34 smithi050 bash[28929]: audit 2024-05-20T22:11:33.217467+0000 mon.a (mon.0) 1196 : audit 1 from='client.25426 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:34.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:34 smithi050 bash[28929]: audit 2024-05-20T22:11:33.217629+0000 mon.a (mon.0) 1197 : audit 1 from='client.25457 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi050-64823-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:34.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:34 smithi050 bash[28929]: audit 2024-05-20T22:11:33.228339+0000 mon.c (mon.2) 120 : audit 1 from='client.? v1:172.21.15.50:0/1340744784' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi050-64823-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi050-64823-3"}]: dispatch 2024-05-20T22:11:34.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:34 smithi050 bash[28929]: cluster 2024-05-20T22:11:33.229227+0000 mon.a (mon.0) 1198 : cluster 0 osdmap e101: 8 total, 8 up, 8 in 2024-05-20T22:11:34.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:34 smithi050 bash[28929]: audit 2024-05-20T22:11:33.234450+0000 mon.a (mon.0) 1199 : audit 1 from='client.25457 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi050-64823-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi050-64823-3"}]: dispatch 2024-05-20T22:11:34.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:34 smithi050 bash[28929]: audit 2024-05-20T22:11:33.761993+0000 mon.a (mon.0) 1200 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:11:34.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:34 smithi050 bash[28929]: audit 2024-05-20T22:11:34.085882+0000 mon.b (mon.1) 97 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:35.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:34 smithi145 bash[23893]: audit 2024-05-20T22:11:33.216944+0000 mon.a (mon.0) 1193 : audit 1 from='client.25372 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi050-64724-2"}]': finished 2024-05-20T22:11:35.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:34 smithi145 bash[23893]: audit 2024-05-20T22:11:33.217180+0000 mon.a (mon.0) 1194 : audit 1 from='client.25445 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi050-64159-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:35.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:34 smithi145 bash[23893]: audit 2024-05-20T22:11:33.217324+0000 mon.a (mon.0) 1195 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:35.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:34 smithi145 bash[23893]: audit 2024-05-20T22:11:33.217467+0000 mon.a (mon.0) 1196 : audit 1 from='client.25426 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:35.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:34 smithi145 bash[23893]: audit 2024-05-20T22:11:33.217629+0000 mon.a (mon.0) 1197 : audit 1 from='client.25457 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi050-64823-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:35.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:34 smithi145 bash[23893]: audit 2024-05-20T22:11:33.228339+0000 mon.c (mon.2) 120 : audit 1 from='client.? v1:172.21.15.50:0/1340744784' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi050-64823-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi050-64823-3"}]: dispatch 2024-05-20T22:11:35.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:34 smithi145 bash[23893]: cluster 2024-05-20T22:11:33.229227+0000 mon.a (mon.0) 1198 : cluster 0 osdmap e101: 8 total, 8 up, 8 in 2024-05-20T22:11:35.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:34 smithi145 bash[23893]: audit 2024-05-20T22:11:33.234450+0000 mon.a (mon.0) 1199 : audit 1 from='client.25457 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi050-64823-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi050-64823-3"}]: dispatch 2024-05-20T22:11:35.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:34 smithi145 bash[23893]: audit 2024-05-20T22:11:33.761993+0000 mon.a (mon.0) 1200 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:11:35.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:34 smithi145 bash[23893]: audit 2024-05-20T22:11:34.085882+0000 mon.b (mon.1) 97 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:35.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:35 smithi050 bash[21866]: cluster 2024-05-20T22:11:33.982469+0000 mgr.y (mgr.14592) 205 : cluster 0 pgmap v162: 680 pgs: 41 creating+peering, 215 unknown, 424 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 901 B/s rd, 2 op/s 2024-05-20T22:11:35.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:35 smithi050 bash[21866]: audit 2024-05-20T22:11:34.672055+0000 mon.a (mon.0) 1201 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:11:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:35 smithi050 bash[21866]: audit 2024-05-20T22:11:34.680021+0000 mon.a (mon.0) 1202 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-7", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:11:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:35 smithi050 bash[21866]: audit 2024-05-20T22:11:35.087389+0000 mon.b (mon.1) 98 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:35 smithi050 bash[21866]: audit 2024-05-20T22:11:35.135905+0000 mon.b (mon.1) 99 : audit 1 from='client.? v1:172.21.15.50:0/610826112' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi050-64146-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:35 smithi050 bash[21866]: audit 2024-05-20T22:11:35.136635+0000 mon.c (mon.2) 121 : audit 1 from='client.? v1:172.21.15.50:0/1842202727' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi050-63944-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:35 smithi050 bash[21866]: audit 2024-05-20T22:11:35.137035+0000 mon.c (mon.2) 122 : audit 1 from='client.? v1:172.21.15.50:0/1150743327' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi050-63936-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:35 smithi050 bash[21866]: cluster 2024-05-20T22:11:35.138089+0000 mon.a (mon.0) 1203 : cluster 0 osdmap e102: 8 total, 8 up, 8 in 2024-05-20T22:11:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:35 smithi050 bash[21866]: audit 2024-05-20T22:11:35.141200+0000 mon.a (mon.0) 1204 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-7"}]: dispatch 2024-05-20T22:11:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:35 smithi050 bash[21866]: audit 2024-05-20T22:11:35.143832+0000 mon.a (mon.0) 1205 : audit 1 from='client.25469 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi050-63944-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:35 smithi050 bash[21866]: audit 2024-05-20T22:11:35.144236+0000 mon.a (mon.0) 1206 : audit 1 from='client.25475 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi050-63936-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:35 smithi050 bash[21866]: cluster 2024-05-20T22:11:35.603609+0000 mon.a (mon.0) 1207 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:35 smithi050 bash[21866]: audit 2024-05-20T22:11:35.605495+0000 mon.a (mon.0) 1208 : audit 1 from='client.25453 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi050-64146-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:35.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:35 smithi050 bash[28929]: cluster 2024-05-20T22:11:33.982469+0000 mgr.y (mgr.14592) 205 : cluster 0 pgmap v162: 680 pgs: 41 creating+peering, 215 unknown, 424 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 901 B/s rd, 2 op/s 2024-05-20T22:11:35.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:35 smithi050 bash[28929]: audit 2024-05-20T22:11:34.672055+0000 mon.a (mon.0) 1201 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:11:35.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:35 smithi050 bash[28929]: audit 2024-05-20T22:11:34.680021+0000 mon.a (mon.0) 1202 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-7", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:11:35.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:35 smithi050 bash[28929]: audit 2024-05-20T22:11:35.087389+0000 mon.b (mon.1) 98 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:35.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:35 smithi050 bash[28929]: audit 2024-05-20T22:11:35.135905+0000 mon.b (mon.1) 99 : audit 1 from='client.? v1:172.21.15.50:0/610826112' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi050-64146-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:35.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:35 smithi050 bash[28929]: audit 2024-05-20T22:11:35.136635+0000 mon.c (mon.2) 121 : audit 1 from='client.? v1:172.21.15.50:0/1842202727' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi050-63944-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:35.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:35 smithi050 bash[28929]: audit 2024-05-20T22:11:35.137035+0000 mon.c (mon.2) 122 : audit 1 from='client.? v1:172.21.15.50:0/1150743327' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi050-63936-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:35.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:35 smithi050 bash[28929]: cluster 2024-05-20T22:11:35.138089+0000 mon.a (mon.0) 1203 : cluster 0 osdmap e102: 8 total, 8 up, 8 in 2024-05-20T22:11:35.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:35 smithi050 bash[28929]: audit 2024-05-20T22:11:35.141200+0000 mon.a (mon.0) 1204 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-7"}]: dispatch 2024-05-20T22:11:35.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:35 smithi050 bash[28929]: audit 2024-05-20T22:11:35.143832+0000 mon.a (mon.0) 1205 : audit 1 from='client.25469 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi050-63944-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:35.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:35 smithi050 bash[28929]: audit 2024-05-20T22:11:35.144236+0000 mon.a (mon.0) 1206 : audit 1 from='client.25475 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi050-63936-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:35.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:35 smithi050 bash[28929]: cluster 2024-05-20T22:11:35.603609+0000 mon.a (mon.0) 1207 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:35.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:35 smithi050 bash[28929]: audit 2024-05-20T22:11:35.605495+0000 mon.a (mon.0) 1208 : audit 1 from='client.25453 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi050-64146-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:36.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:35 smithi145 bash[23893]: cluster 2024-05-20T22:11:33.982469+0000 mgr.y (mgr.14592) 205 : cluster 0 pgmap v162: 680 pgs: 41 creating+peering, 215 unknown, 424 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 901 B/s rd, 2 op/s 2024-05-20T22:11:36.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:35 smithi145 bash[23893]: audit 2024-05-20T22:11:34.672055+0000 mon.a (mon.0) 1201 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:11:36.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:35 smithi145 bash[23893]: audit 2024-05-20T22:11:34.680021+0000 mon.a (mon.0) 1202 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-7", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:11:36.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:35 smithi145 bash[23893]: audit 2024-05-20T22:11:35.087389+0000 mon.b (mon.1) 98 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:36.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:35 smithi145 bash[23893]: audit 2024-05-20T22:11:35.135905+0000 mon.b (mon.1) 99 : audit 1 from='client.? v1:172.21.15.50:0/610826112' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi050-64146-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:36.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:35 smithi145 bash[23893]: audit 2024-05-20T22:11:35.136635+0000 mon.c (mon.2) 121 : audit 1 from='client.? v1:172.21.15.50:0/1842202727' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi050-63944-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:36.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:35 smithi145 bash[23893]: audit 2024-05-20T22:11:35.137035+0000 mon.c (mon.2) 122 : audit 1 from='client.? v1:172.21.15.50:0/1150743327' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi050-63936-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:36.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:35 smithi145 bash[23893]: cluster 2024-05-20T22:11:35.138089+0000 mon.a (mon.0) 1203 : cluster 0 osdmap e102: 8 total, 8 up, 8 in 2024-05-20T22:11:36.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:35 smithi145 bash[23893]: audit 2024-05-20T22:11:35.141200+0000 mon.a (mon.0) 1204 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-7"}]: dispatch 2024-05-20T22:11:36.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:35 smithi145 bash[23893]: audit 2024-05-20T22:11:35.143832+0000 mon.a (mon.0) 1205 : audit 1 from='client.25469 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi050-63944-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:36.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:35 smithi145 bash[23893]: audit 2024-05-20T22:11:35.144236+0000 mon.a (mon.0) 1206 : audit 1 from='client.25475 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi050-63936-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:36.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:35 smithi145 bash[23893]: cluster 2024-05-20T22:11:35.603609+0000 mon.a (mon.0) 1207 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:36.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:35 smithi145 bash[23893]: audit 2024-05-20T22:11:35.605495+0000 mon.a (mon.0) 1208 : audit 1 from='client.25453 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi050-64146-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:37.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:37 smithi145 bash[23893]: audit 2024-05-20T22:11:35.694694+0000 mon.a (mon.0) 1209 : audit 1 from='client.25457 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi050-64823-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi050-64823-3"}]': finished 2024-05-20T22:11:37.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:37 smithi145 bash[23893]: audit 2024-05-20T22:11:35.694878+0000 mon.a (mon.0) 1210 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-7"}]': finished 2024-05-20T22:11:37.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:37 smithi145 bash[23893]: audit 2024-05-20T22:11:35.695004+0000 mon.a (mon.0) 1211 : audit 1 from='client.25469 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi050-63944-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:37.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:37 smithi145 bash[23893]: audit 2024-05-20T22:11:35.695120+0000 mon.a (mon.0) 1212 : audit 1 from='client.25475 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi050-63936-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:37.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:37 smithi145 bash[23893]: audit 2024-05-20T22:11:35.695307+0000 mon.a (mon.0) 1213 : audit 1 from='client.25453 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi050-64146-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:37.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:37 smithi145 bash[23893]: cluster 2024-05-20T22:11:35.703905+0000 mon.a (mon.0) 1214 : cluster 0 osdmap e103: 8 total, 8 up, 8 in 2024-05-20T22:11:37.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:37 smithi145 bash[23893]: audit 2024-05-20T22:11:36.089036+0000 mon.b (mon.1) 100 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:37.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:37 smithi145 bash[23893]: audit 2024-05-20T22:11:36.206818+0000 mon.a (mon.0) 1215 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:11:37.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:37 smithi050 bash[28929]: audit 2024-05-20T22:11:35.694694+0000 mon.a (mon.0) 1209 : audit 1 from='client.25457 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi050-64823-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi050-64823-3"}]': finished 2024-05-20T22:11:37.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:37 smithi050 bash[28929]: audit 2024-05-20T22:11:35.694878+0000 mon.a (mon.0) 1210 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-7"}]': finished 2024-05-20T22:11:37.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:37 smithi050 bash[28929]: audit 2024-05-20T22:11:35.695004+0000 mon.a (mon.0) 1211 : audit 1 from='client.25469 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi050-63944-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:37.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:37 smithi050 bash[28929]: audit 2024-05-20T22:11:35.695120+0000 mon.a (mon.0) 1212 : audit 1 from='client.25475 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi050-63936-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:37.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:37 smithi050 bash[28929]: audit 2024-05-20T22:11:35.695307+0000 mon.a (mon.0) 1213 : audit 1 from='client.25453 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi050-64146-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:37.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:37 smithi050 bash[28929]: cluster 2024-05-20T22:11:35.703905+0000 mon.a (mon.0) 1214 : cluster 0 osdmap e103: 8 total, 8 up, 8 in 2024-05-20T22:11:37.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:37 smithi050 bash[28929]: audit 2024-05-20T22:11:36.089036+0000 mon.b (mon.1) 100 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:37.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:37 smithi050 bash[28929]: audit 2024-05-20T22:11:36.206818+0000 mon.a (mon.0) 1215 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:11:37.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:37 smithi050 bash[21866]: audit 2024-05-20T22:11:35.694694+0000 mon.a (mon.0) 1209 : audit 1 from='client.25457 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi050-64823-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi050-64823-3"}]': finished 2024-05-20T22:11:37.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:37 smithi050 bash[21866]: audit 2024-05-20T22:11:35.694878+0000 mon.a (mon.0) 1210 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-7"}]': finished 2024-05-20T22:11:37.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:37 smithi050 bash[21866]: audit 2024-05-20T22:11:35.695004+0000 mon.a (mon.0) 1211 : audit 1 from='client.25469 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi050-63944-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:37.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:37 smithi050 bash[21866]: audit 2024-05-20T22:11:35.695120+0000 mon.a (mon.0) 1212 : audit 1 from='client.25475 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi050-63936-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:37.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:37 smithi050 bash[21866]: audit 2024-05-20T22:11:35.695307+0000 mon.a (mon.0) 1213 : audit 1 from='client.25453 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi050-64146-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:37.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:37 smithi050 bash[21866]: cluster 2024-05-20T22:11:35.703905+0000 mon.a (mon.0) 1214 : cluster 0 osdmap e103: 8 total, 8 up, 8 in 2024-05-20T22:11:37.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:37 smithi050 bash[21866]: audit 2024-05-20T22:11:36.089036+0000 mon.b (mon.1) 100 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:37.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:37 smithi050 bash[21866]: audit 2024-05-20T22:11:36.206818+0000 mon.a (mon.0) 1215 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:11:38.139 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:11:37 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:11:38.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:38 smithi145 bash[23893]: cluster 2024-05-20T22:11:35.983658+0000 mgr.y (mgr.14592) 206 : cluster 0 pgmap v165: 656 pgs: 60 creating+peering, 76 unknown, 520 active+clean; 145 MiB data, 759 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-05-20T22:11:38.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:38 smithi145 bash[23893]: audit 2024-05-20T22:11:37.090608+0000 mon.b (mon.1) 101 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:38.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:38 smithi145 bash[23893]: audit 2024-05-20T22:11:37.141913+0000 mon.a (mon.0) 1216 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:11:38.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:38 smithi145 bash[23893]: cluster 2024-05-20T22:11:37.147050+0000 mon.a (mon.0) 1217 : cluster 0 osdmap e104: 8 total, 8 up, 8 in 2024-05-20T22:11:38.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:38 smithi145 bash[23893]: audit 2024-05-20T22:11:37.157599+0000 mon.a (mon.0) 1218 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-7"}]: dispatch 2024-05-20T22:11:38.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:38 smithi145 bash[23893]: audit 2024-05-20T22:11:37.673402+0000 mgr.y (mgr.14592) 207 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:38.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:38 smithi145 bash[23893]: audit 2024-05-20T22:11:37.979414+0000 mon.c (mon.2) 123 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2024-05-20T22:11:38.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:38 smithi145 bash[23893]: audit 2024-05-20T22:11:37.980030+0000 mon.c (mon.2) 124 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2024-05-20T22:11:38.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:38 smithi145 bash[23893]: audit 2024-05-20T22:11:37.980629+0000 mon.c (mon.2) 125 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2024-05-20T22:11:38.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:38 smithi145 bash[23893]: audit 2024-05-20T22:11:37.981193+0000 mon.c (mon.2) 126 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2024-05-20T22:11:38.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:38 smithi145 bash[23893]: audit 2024-05-20T22:11:37.982044+0000 mon.c (mon.2) 127 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2024-05-20T22:11:38.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:38 smithi145 bash[23893]: audit 2024-05-20T22:11:37.982677+0000 mon.c (mon.2) 128 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2024-05-20T22:11:38.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:38 smithi145 bash[23893]: audit 2024-05-20T22:11:37.983275+0000 mon.c (mon.2) 129 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2024-05-20T22:11:38.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:38 smithi145 bash[23893]: audit 2024-05-20T22:11:37.983792+0000 mon.c (mon.2) 130 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2024-05-20T22:11:38.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:38 smithi145 bash[23893]: audit 2024-05-20T22:11:37.985010+0000 mon.c (mon.2) 131 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2024-05-20T22:11:38.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:38 smithi145 bash[23893]: audit 2024-05-20T22:11:37.985666+0000 mon.c (mon.2) 132 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2024-05-20T22:11:38.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:38 smithi145 bash[23893]: audit 2024-05-20T22:11:38.092008+0000 mon.b (mon.1) 102 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:38.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:38 smithi050 bash[28929]: cluster 2024-05-20T22:11:35.983658+0000 mgr.y (mgr.14592) 206 : cluster 0 pgmap v165: 656 pgs: 60 creating+peering, 76 unknown, 520 active+clean; 145 MiB data, 759 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-05-20T22:11:38.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:38 smithi050 bash[28929]: audit 2024-05-20T22:11:37.090608+0000 mon.b (mon.1) 101 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:38.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:38 smithi050 bash[28929]: audit 2024-05-20T22:11:37.141913+0000 mon.a (mon.0) 1216 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:11:38.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:38 smithi050 bash[28929]: cluster 2024-05-20T22:11:37.147050+0000 mon.a (mon.0) 1217 : cluster 0 osdmap e104: 8 total, 8 up, 8 in 2024-05-20T22:11:38.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:38 smithi050 bash[28929]: audit 2024-05-20T22:11:37.157599+0000 mon.a (mon.0) 1218 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-7"}]: dispatch 2024-05-20T22:11:38.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:38 smithi050 bash[28929]: audit 2024-05-20T22:11:37.673402+0000 mgr.y (mgr.14592) 207 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:38.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:38 smithi050 bash[28929]: audit 2024-05-20T22:11:37.979414+0000 mon.c (mon.2) 123 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2024-05-20T22:11:38.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:38 smithi050 bash[28929]: audit 2024-05-20T22:11:37.980030+0000 mon.c (mon.2) 124 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2024-05-20T22:11:38.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:38 smithi050 bash[28929]: audit 2024-05-20T22:11:37.980629+0000 mon.c (mon.2) 125 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2024-05-20T22:11:38.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:38 smithi050 bash[28929]: audit 2024-05-20T22:11:37.981193+0000 mon.c (mon.2) 126 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2024-05-20T22:11:38.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:38 smithi050 bash[28929]: audit 2024-05-20T22:11:37.982044+0000 mon.c (mon.2) 127 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2024-05-20T22:11:38.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:38 smithi050 bash[28929]: audit 2024-05-20T22:11:37.982677+0000 mon.c (mon.2) 128 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2024-05-20T22:11:38.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:38 smithi050 bash[28929]: audit 2024-05-20T22:11:37.983275+0000 mon.c (mon.2) 129 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2024-05-20T22:11:38.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:38 smithi050 bash[28929]: audit 2024-05-20T22:11:37.983792+0000 mon.c (mon.2) 130 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2024-05-20T22:11:38.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:38 smithi050 bash[28929]: audit 2024-05-20T22:11:37.985010+0000 mon.c (mon.2) 131 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2024-05-20T22:11:38.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:38 smithi050 bash[28929]: audit 2024-05-20T22:11:37.985666+0000 mon.c (mon.2) 132 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2024-05-20T22:11:38.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:38 smithi050 bash[28929]: audit 2024-05-20T22:11:38.092008+0000 mon.b (mon.1) 102 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:38.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:38 smithi050 bash[21866]: cluster 2024-05-20T22:11:35.983658+0000 mgr.y (mgr.14592) 206 : cluster 0 pgmap v165: 656 pgs: 60 creating+peering, 76 unknown, 520 active+clean; 145 MiB data, 759 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-05-20T22:11:38.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:38 smithi050 bash[21866]: audit 2024-05-20T22:11:37.090608+0000 mon.b (mon.1) 101 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:38.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:38 smithi050 bash[21866]: audit 2024-05-20T22:11:37.141913+0000 mon.a (mon.0) 1216 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:11:38.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:38 smithi050 bash[21866]: cluster 2024-05-20T22:11:37.147050+0000 mon.a (mon.0) 1217 : cluster 0 osdmap e104: 8 total, 8 up, 8 in 2024-05-20T22:11:38.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:38 smithi050 bash[21866]: audit 2024-05-20T22:11:37.157599+0000 mon.a (mon.0) 1218 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-7"}]: dispatch 2024-05-20T22:11:38.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:38 smithi050 bash[21866]: audit 2024-05-20T22:11:37.673402+0000 mgr.y (mgr.14592) 207 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:38.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:38 smithi050 bash[21866]: audit 2024-05-20T22:11:37.979414+0000 mon.c (mon.2) 123 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2024-05-20T22:11:38.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:38 smithi050 bash[21866]: audit 2024-05-20T22:11:37.980030+0000 mon.c (mon.2) 124 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2024-05-20T22:11:38.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:38 smithi050 bash[21866]: audit 2024-05-20T22:11:37.980629+0000 mon.c (mon.2) 125 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2024-05-20T22:11:38.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:38 smithi050 bash[21866]: audit 2024-05-20T22:11:37.981193+0000 mon.c (mon.2) 126 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2024-05-20T22:11:38.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:38 smithi050 bash[21866]: audit 2024-05-20T22:11:37.982044+0000 mon.c (mon.2) 127 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2024-05-20T22:11:38.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:38 smithi050 bash[21866]: audit 2024-05-20T22:11:37.982677+0000 mon.c (mon.2) 128 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2024-05-20T22:11:38.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:38 smithi050 bash[21866]: audit 2024-05-20T22:11:37.983275+0000 mon.c (mon.2) 129 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2024-05-20T22:11:38.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:38 smithi050 bash[21866]: audit 2024-05-20T22:11:37.983792+0000 mon.c (mon.2) 130 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2024-05-20T22:11:38.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:38 smithi050 bash[21866]: audit 2024-05-20T22:11:37.985010+0000 mon.c (mon.2) 131 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2024-05-20T22:11:38.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:38 smithi050 bash[21866]: audit 2024-05-20T22:11:37.985666+0000 mon.c (mon.2) 132 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2024-05-20T22:11:38.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:38 smithi050 bash[21866]: audit 2024-05-20T22:11:38.092008+0000 mon.b (mon.1) 102 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:39.443 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:11:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:11:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:11:39.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: audit 2024-05-20T22:11:37.979619+0000 mgr.y (mgr.14592) 208 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2024-05-20T22:11:39.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: audit 2024-05-20T22:11:37.980145+0000 mgr.y (mgr.14592) 209 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2024-05-20T22:11:39.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: audit 2024-05-20T22:11:37.980768+0000 mgr.y (mgr.14592) 210 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2024-05-20T22:11:39.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: audit 2024-05-20T22:11:37.981366+0000 mgr.y (mgr.14592) 211 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2024-05-20T22:11:39.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: audit 2024-05-20T22:11:37.982199+0000 mgr.y (mgr.14592) 212 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2024-05-20T22:11:39.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: audit 2024-05-20T22:11:37.982816+0000 mgr.y (mgr.14592) 213 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2024-05-20T22:11:39.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: audit 2024-05-20T22:11:37.983417+0000 mgr.y (mgr.14592) 214 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2024-05-20T22:11:39.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: cluster 2024-05-20T22:11:37.984382+0000 mgr.y (mgr.14592) 215 : cluster 0 pgmap v167: 720 pgs: 60 creating+peering, 140 unknown, 520 active+clean; 145 MiB data, 759 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 644 B/s wr, 1 op/s 2024-05-20T22:11:39.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: audit 2024-05-20T22:11:37.984521+0000 mgr.y (mgr.14592) 216 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2024-05-20T22:11:39.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: audit 2024-05-20T22:11:37.985132+0000 mgr.y (mgr.14592) 217 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2024-05-20T22:11:39.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: audit 2024-05-20T22:11:37.985789+0000 mgr.y (mgr.14592) 218 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2024-05-20T22:11:39.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: audit 2024-05-20T22:11:38.155102+0000 mon.a (mon.0) 1219 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-7"}]': finished 2024-05-20T22:11:39.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: cluster 2024-05-20T22:11:38.168321+0000 mon.a (mon.0) 1220 : cluster 0 osdmap e105: 8 total, 8 up, 8 in 2024-05-20T22:11:39.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: audit 2024-05-20T22:11:38.178409+0000 mon.b (mon.1) 103 : audit 1 from='client.? v1:172.21.15.50:0/750299437' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:39.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: audit 2024-05-20T22:11:38.179108+0000 mon.c (mon.2) 133 : audit 1 from='client.? v1:172.21.15.50:0/1340744784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi050-64823-3"}]: dispatch 2024-05-20T22:11:39.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: audit 2024-05-20T22:11:38.179205+0000 mon.b (mon.1) 104 : audit 1 from='client.? v1:172.21.15.50:0/382634356' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:39.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: audit 2024-05-20T22:11:38.181380+0000 mon.a (mon.0) 1221 : audit 1 from='client.25477 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:39.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: audit 2024-05-20T22:11:38.184975+0000 mon.a (mon.0) 1222 : audit 1 from='client.25457 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi050-64823-3"}]: dispatch 2024-05-20T22:11:39.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: audit 2024-05-20T22:11:38.187002+0000 mon.a (mon.0) 1223 : audit 1 from='client.25483 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:39.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: cluster 2024-05-20T22:11:38.340087+0000 osd.1 (osd.1) 7 : cluster 0 18.3 deep-scrub starts 2024-05-20T22:11:39.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: cluster 2024-05-20T22:11:38.341749+0000 osd.1 (osd.1) 8 : cluster 0 18.3 deep-scrub ok 2024-05-20T22:11:39.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: cluster 2024-05-20T22:11:38.762310+0000 osd.3 (osd.3) 7 : cluster 0 18.9 deep-scrub starts 2024-05-20T22:11:39.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: cluster 2024-05-20T22:11:38.764606+0000 osd.3 (osd.3) 8 : cluster 0 18.9 deep-scrub ok 2024-05-20T22:11:39.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: audit 2024-05-20T22:11:39.093275+0000 mon.b (mon.1) 105 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:39.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:39 smithi050 bash[28929]: audit 2024-05-20T22:11:39.146122+0000 mon.a (mon.0) 1224 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:11:39.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: audit 2024-05-20T22:11:37.979619+0000 mgr.y (mgr.14592) 208 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2024-05-20T22:11:39.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: audit 2024-05-20T22:11:37.980145+0000 mgr.y (mgr.14592) 209 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2024-05-20T22:11:39.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: audit 2024-05-20T22:11:37.980768+0000 mgr.y (mgr.14592) 210 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2024-05-20T22:11:39.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: audit 2024-05-20T22:11:37.981366+0000 mgr.y (mgr.14592) 211 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2024-05-20T22:11:39.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: audit 2024-05-20T22:11:37.982199+0000 mgr.y (mgr.14592) 212 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2024-05-20T22:11:39.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: audit 2024-05-20T22:11:37.982816+0000 mgr.y (mgr.14592) 213 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2024-05-20T22:11:39.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: audit 2024-05-20T22:11:37.983417+0000 mgr.y (mgr.14592) 214 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2024-05-20T22:11:39.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: cluster 2024-05-20T22:11:37.984382+0000 mgr.y (mgr.14592) 215 : cluster 0 pgmap v167: 720 pgs: 60 creating+peering, 140 unknown, 520 active+clean; 145 MiB data, 759 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 644 B/s wr, 1 op/s 2024-05-20T22:11:39.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: audit 2024-05-20T22:11:37.984521+0000 mgr.y (mgr.14592) 216 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2024-05-20T22:11:39.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: audit 2024-05-20T22:11:37.985132+0000 mgr.y (mgr.14592) 217 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2024-05-20T22:11:39.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: audit 2024-05-20T22:11:37.985789+0000 mgr.y (mgr.14592) 218 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2024-05-20T22:11:39.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: audit 2024-05-20T22:11:38.155102+0000 mon.a (mon.0) 1219 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-7"}]': finished 2024-05-20T22:11:39.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: cluster 2024-05-20T22:11:38.168321+0000 mon.a (mon.0) 1220 : cluster 0 osdmap e105: 8 total, 8 up, 8 in 2024-05-20T22:11:39.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: audit 2024-05-20T22:11:38.178409+0000 mon.b (mon.1) 103 : audit 1 from='client.? v1:172.21.15.50:0/750299437' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:39.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: audit 2024-05-20T22:11:38.179108+0000 mon.c (mon.2) 133 : audit 1 from='client.? v1:172.21.15.50:0/1340744784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi050-64823-3"}]: dispatch 2024-05-20T22:11:39.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: audit 2024-05-20T22:11:38.179205+0000 mon.b (mon.1) 104 : audit 1 from='client.? v1:172.21.15.50:0/382634356' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:39.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: audit 2024-05-20T22:11:38.181380+0000 mon.a (mon.0) 1221 : audit 1 from='client.25477 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:39.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: audit 2024-05-20T22:11:38.184975+0000 mon.a (mon.0) 1222 : audit 1 from='client.25457 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi050-64823-3"}]: dispatch 2024-05-20T22:11:39.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: audit 2024-05-20T22:11:38.187002+0000 mon.a (mon.0) 1223 : audit 1 from='client.25483 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:39.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: cluster 2024-05-20T22:11:38.340087+0000 osd.1 (osd.1) 7 : cluster 0 18.3 deep-scrub starts 2024-05-20T22:11:39.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: cluster 2024-05-20T22:11:38.341749+0000 osd.1 (osd.1) 8 : cluster 0 18.3 deep-scrub ok 2024-05-20T22:11:39.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: cluster 2024-05-20T22:11:38.762310+0000 osd.3 (osd.3) 7 : cluster 0 18.9 deep-scrub starts 2024-05-20T22:11:39.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: cluster 2024-05-20T22:11:38.764606+0000 osd.3 (osd.3) 8 : cluster 0 18.9 deep-scrub ok 2024-05-20T22:11:39.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: audit 2024-05-20T22:11:39.093275+0000 mon.b (mon.1) 105 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:39.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:39 smithi050 bash[21866]: audit 2024-05-20T22:11:39.146122+0000 mon.a (mon.0) 1224 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:11:39.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: audit 2024-05-20T22:11:37.979619+0000 mgr.y (mgr.14592) 208 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2024-05-20T22:11:39.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: audit 2024-05-20T22:11:37.980145+0000 mgr.y (mgr.14592) 209 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2024-05-20T22:11:39.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: audit 2024-05-20T22:11:37.980768+0000 mgr.y (mgr.14592) 210 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2024-05-20T22:11:39.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: audit 2024-05-20T22:11:37.981366+0000 mgr.y (mgr.14592) 211 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2024-05-20T22:11:39.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: audit 2024-05-20T22:11:37.982199+0000 mgr.y (mgr.14592) 212 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2024-05-20T22:11:39.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: audit 2024-05-20T22:11:37.982816+0000 mgr.y (mgr.14592) 213 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2024-05-20T22:11:39.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: audit 2024-05-20T22:11:37.983417+0000 mgr.y (mgr.14592) 214 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2024-05-20T22:11:39.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: cluster 2024-05-20T22:11:37.984382+0000 mgr.y (mgr.14592) 215 : cluster 0 pgmap v167: 720 pgs: 60 creating+peering, 140 unknown, 520 active+clean; 145 MiB data, 759 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 644 B/s wr, 1 op/s 2024-05-20T22:11:39.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: audit 2024-05-20T22:11:37.984521+0000 mgr.y (mgr.14592) 216 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2024-05-20T22:11:39.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: audit 2024-05-20T22:11:37.985132+0000 mgr.y (mgr.14592) 217 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2024-05-20T22:11:39.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: audit 2024-05-20T22:11:37.985789+0000 mgr.y (mgr.14592) 218 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2024-05-20T22:11:39.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: audit 2024-05-20T22:11:38.155102+0000 mon.a (mon.0) 1219 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-7"}]': finished 2024-05-20T22:11:39.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: cluster 2024-05-20T22:11:38.168321+0000 mon.a (mon.0) 1220 : cluster 0 osdmap e105: 8 total, 8 up, 8 in 2024-05-20T22:11:39.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: audit 2024-05-20T22:11:38.178409+0000 mon.b (mon.1) 103 : audit 1 from='client.? v1:172.21.15.50:0/750299437' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:39.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: audit 2024-05-20T22:11:38.179108+0000 mon.c (mon.2) 133 : audit 1 from='client.? v1:172.21.15.50:0/1340744784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi050-64823-3"}]: dispatch 2024-05-20T22:11:39.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: audit 2024-05-20T22:11:38.179205+0000 mon.b (mon.1) 104 : audit 1 from='client.? v1:172.21.15.50:0/382634356' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:39.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: audit 2024-05-20T22:11:38.181380+0000 mon.a (mon.0) 1221 : audit 1 from='client.25477 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:39.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: audit 2024-05-20T22:11:38.184975+0000 mon.a (mon.0) 1222 : audit 1 from='client.25457 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi050-64823-3"}]: dispatch 2024-05-20T22:11:39.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: audit 2024-05-20T22:11:38.187002+0000 mon.a (mon.0) 1223 : audit 1 from='client.25483 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:39.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: cluster 2024-05-20T22:11:38.340087+0000 osd.1 (osd.1) 7 : cluster 0 18.3 deep-scrub starts 2024-05-20T22:11:39.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: cluster 2024-05-20T22:11:38.341749+0000 osd.1 (osd.1) 8 : cluster 0 18.3 deep-scrub ok 2024-05-20T22:11:39.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: cluster 2024-05-20T22:11:38.762310+0000 osd.3 (osd.3) 7 : cluster 0 18.9 deep-scrub starts 2024-05-20T22:11:39.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: cluster 2024-05-20T22:11:38.764606+0000 osd.3 (osd.3) 8 : cluster 0 18.9 deep-scrub ok 2024-05-20T22:11:39.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: audit 2024-05-20T22:11:39.093275+0000 mon.b (mon.1) 105 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:39.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:39 smithi145 bash[23893]: audit 2024-05-20T22:11:39.146122+0000 mon.a (mon.0) 1224 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:11:40.591 INFO:tasks.workunit.client.0.smithi050.stdout: ec_list: Running main() from gmock_main.cc 2024-05-20T22:11:40.591 INFO:tasks.workunit.client.0.smithi050.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2024-05-20T22:11:40.591 INFO:tasks.workunit.client.0.smithi050.stdout: ec_list: [----------] Global test environment set-up. 2024-05-20T22:11:40.591 INFO:tasks.workunit.client.0.smithi050.stdout: ec_list: [----------] 3 tests from NeoradosECList 2024-05-20T22:11:40.591 INFO:tasks.workunit.client.0.smithi050.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2024-05-20T22:11:40.591 INFO:tasks.workunit.client.0.smithi050.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (30804 ms) 2024-05-20T22:11:40.591 INFO:tasks.workunit.client.0.smithi050.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2024-05-20T22:11:40.592 INFO:tasks.workunit.client.0.smithi050.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (14319 ms) 2024-05-20T22:11:40.592 INFO:tasks.workunit.client.0.smithi050.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2024-05-20T22:11:40.592 INFO:tasks.workunit.client.0.smithi050.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (8378 ms) 2024-05-20T22:11:40.592 INFO:tasks.workunit.client.0.smithi050.stdout: ec_list: [----------] 3 tests from NeoradosECList (53501 ms total) 2024-05-20T22:11:40.592 INFO:tasks.workunit.client.0.smithi050.stdout: ec_list: 2024-05-20T22:11:40.592 INFO:tasks.workunit.client.0.smithi050.stdout: ec_list: [----------] Global test environment tear-down 2024-05-20T22:11:40.592 INFO:tasks.workunit.client.0.smithi050.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (53501 ms total) 2024-05-20T22:11:40.592 INFO:tasks.workunit.client.0.smithi050.stdout: ec_list: [ PASSED ] 3 tests. 2024-05-20T22:11:40.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:40 smithi145 bash[23893]: cluster 2024-05-20T22:11:38.524982+0000 osd.0 (osd.0) 9 : cluster 0 18.0 deep-scrub starts 2024-05-20T22:11:40.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:40 smithi145 bash[23893]: cluster 2024-05-20T22:11:38.531339+0000 osd.0 (osd.0) 10 : cluster 0 18.0 deep-scrub ok 2024-05-20T22:11:40.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:40 smithi145 bash[23893]: cluster 2024-05-20T22:11:38.645558+0000 osd.2 (osd.2) 5 : cluster 0 18.7 deep-scrub starts 2024-05-20T22:11:40.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:40 smithi145 bash[23893]: cluster 2024-05-20T22:11:38.690990+0000 osd.2 (osd.2) 6 : cluster 0 18.7 deep-scrub ok 2024-05-20T22:11:40.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:40 smithi145 bash[23893]: audit 2024-05-20T22:11:39.168524+0000 mon.a (mon.0) 1225 : audit 1 from='client.25477 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:40.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:40 smithi145 bash[23893]: audit 2024-05-20T22:11:39.168611+0000 mon.a (mon.0) 1226 : audit 1 from='client.25457 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi050-64823-3"}]': finished 2024-05-20T22:11:40.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:40 smithi145 bash[23893]: audit 2024-05-20T22:11:39.168665+0000 mon.a (mon.0) 1227 : audit 1 from='client.25483 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:40.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:40 smithi145 bash[23893]: cluster 2024-05-20T22:11:39.174942+0000 mon.a (mon.0) 1228 : cluster 0 osdmap e106: 8 total, 8 up, 8 in 2024-05-20T22:11:40.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:40 smithi145 bash[23893]: audit 2024-05-20T22:11:39.176584+0000 mon.c (mon.2) 134 : audit 1 from='client.? v1:172.21.15.50:0/1340744784' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi050-64823-3"}]: dispatch 2024-05-20T22:11:40.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:40 smithi145 bash[23893]: audit 2024-05-20T22:11:39.187555+0000 mon.c (mon.2) 135 : audit 1 from='client.? v1:172.21.15.50:0/1515973520' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi050-63936-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:40.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:40 smithi145 bash[23893]: audit 2024-05-20T22:11:39.680505+0000 mon.a (mon.0) 1229 : audit 1 from='client.25457 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi050-64823-3"}]: dispatch 2024-05-20T22:11:40.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:40 smithi145 bash[23893]: audit 2024-05-20T22:11:39.680912+0000 mon.a (mon.0) 1230 : audit 1 from='client.? v1:172.21.15.50:0/2810711937' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi050-63944-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:40.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:40 smithi145 bash[23893]: audit 2024-05-20T22:11:39.681255+0000 mon.a (mon.0) 1231 : audit 1 from='client.25514 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi050-63936-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:40.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:40 smithi145 bash[23893]: audit 2024-05-20T22:11:40.094911+0000 mon.b (mon.1) 106 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:40.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:40 smithi145 bash[23893]: audit 2024-05-20T22:11:40.117738+0000 mon.a (mon.0) 1232 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:11:40.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:40 smithi050 bash[21866]: cluster 2024-05-20T22:11:38.524982+0000 osd.0 (osd.0) 9 : cluster 0 18.0 deep-scrub starts 2024-05-20T22:11:40.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:40 smithi050 bash[21866]: cluster 2024-05-20T22:11:38.531339+0000 osd.0 (osd.0) 10 : cluster 0 18.0 deep-scrub ok 2024-05-20T22:11:40.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:40 smithi050 bash[21866]: cluster 2024-05-20T22:11:38.645558+0000 osd.2 (osd.2) 5 : cluster 0 18.7 deep-scrub starts 2024-05-20T22:11:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:40 smithi050 bash[21866]: cluster 2024-05-20T22:11:38.690990+0000 osd.2 (osd.2) 6 : cluster 0 18.7 deep-scrub ok 2024-05-20T22:11:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:40 smithi050 bash[21866]: audit 2024-05-20T22:11:39.168524+0000 mon.a (mon.0) 1225 : audit 1 from='client.25477 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:40 smithi050 bash[21866]: audit 2024-05-20T22:11:39.168611+0000 mon.a (mon.0) 1226 : audit 1 from='client.25457 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi050-64823-3"}]': finished 2024-05-20T22:11:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:40 smithi050 bash[21866]: audit 2024-05-20T22:11:39.168665+0000 mon.a (mon.0) 1227 : audit 1 from='client.25483 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:40 smithi050 bash[21866]: cluster 2024-05-20T22:11:39.174942+0000 mon.a (mon.0) 1228 : cluster 0 osdmap e106: 8 total, 8 up, 8 in 2024-05-20T22:11:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:40 smithi050 bash[21866]: audit 2024-05-20T22:11:39.176584+0000 mon.c (mon.2) 134 : audit 1 from='client.? v1:172.21.15.50:0/1340744784' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi050-64823-3"}]: dispatch 2024-05-20T22:11:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:40 smithi050 bash[21866]: audit 2024-05-20T22:11:39.187555+0000 mon.c (mon.2) 135 : audit 1 from='client.? v1:172.21.15.50:0/1515973520' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi050-63936-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:40 smithi050 bash[21866]: audit 2024-05-20T22:11:39.680505+0000 mon.a (mon.0) 1229 : audit 1 from='client.25457 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi050-64823-3"}]: dispatch 2024-05-20T22:11:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:40 smithi050 bash[21866]: audit 2024-05-20T22:11:39.680912+0000 mon.a (mon.0) 1230 : audit 1 from='client.? v1:172.21.15.50:0/2810711937' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi050-63944-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:40 smithi050 bash[21866]: audit 2024-05-20T22:11:39.681255+0000 mon.a (mon.0) 1231 : audit 1 from='client.25514 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi050-63936-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:40 smithi050 bash[21866]: audit 2024-05-20T22:11:40.094911+0000 mon.b (mon.1) 106 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:40 smithi050 bash[21866]: audit 2024-05-20T22:11:40.117738+0000 mon.a (mon.0) 1232 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:11:40.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:40 smithi050 bash[28929]: cluster 2024-05-20T22:11:38.524982+0000 osd.0 (osd.0) 9 : cluster 0 18.0 deep-scrub starts 2024-05-20T22:11:40.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:40 smithi050 bash[28929]: cluster 2024-05-20T22:11:38.531339+0000 osd.0 (osd.0) 10 : cluster 0 18.0 deep-scrub ok 2024-05-20T22:11:40.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:40 smithi050 bash[28929]: cluster 2024-05-20T22:11:38.645558+0000 osd.2 (osd.2) 5 : cluster 0 18.7 deep-scrub starts 2024-05-20T22:11:40.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:40 smithi050 bash[28929]: cluster 2024-05-20T22:11:38.690990+0000 osd.2 (osd.2) 6 : cluster 0 18.7 deep-scrub ok 2024-05-20T22:11:40.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:40 smithi050 bash[28929]: audit 2024-05-20T22:11:39.168524+0000 mon.a (mon.0) 1225 : audit 1 from='client.25477 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:40.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:40 smithi050 bash[28929]: audit 2024-05-20T22:11:39.168611+0000 mon.a (mon.0) 1226 : audit 1 from='client.25457 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi050-64823-3"}]': finished 2024-05-20T22:11:40.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:40 smithi050 bash[28929]: audit 2024-05-20T22:11:39.168665+0000 mon.a (mon.0) 1227 : audit 1 from='client.25483 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:40.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:40 smithi050 bash[28929]: cluster 2024-05-20T22:11:39.174942+0000 mon.a (mon.0) 1228 : cluster 0 osdmap e106: 8 total, 8 up, 8 in 2024-05-20T22:11:40.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:40 smithi050 bash[28929]: audit 2024-05-20T22:11:39.176584+0000 mon.c (mon.2) 134 : audit 1 from='client.? v1:172.21.15.50:0/1340744784' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi050-64823-3"}]: dispatch 2024-05-20T22:11:40.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:40 smithi050 bash[28929]: audit 2024-05-20T22:11:39.187555+0000 mon.c (mon.2) 135 : audit 1 from='client.? v1:172.21.15.50:0/1515973520' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi050-63936-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:40.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:40 smithi050 bash[28929]: audit 2024-05-20T22:11:39.680505+0000 mon.a (mon.0) 1229 : audit 1 from='client.25457 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi050-64823-3"}]: dispatch 2024-05-20T22:11:40.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:40 smithi050 bash[28929]: audit 2024-05-20T22:11:39.680912+0000 mon.a (mon.0) 1230 : audit 1 from='client.? v1:172.21.15.50:0/2810711937' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi050-63944-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:40.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:40 smithi050 bash[28929]: audit 2024-05-20T22:11:39.681255+0000 mon.a (mon.0) 1231 : audit 1 from='client.25514 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi050-63936-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:40.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:40 smithi050 bash[28929]: audit 2024-05-20T22:11:40.094911+0000 mon.b (mon.1) 106 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:40.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:40 smithi050 bash[28929]: audit 2024-05-20T22:11:40.117738+0000 mon.a (mon.0) 1232 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:11:41.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: cluster 2024-05-20T22:11:38.444039+0000 osd.7 (osd.7) 7 : cluster 0 18.2 deep-scrub starts 2024-05-20T22:11:41.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: cluster 2024-05-20T22:11:38.497066+0000 osd.7 (osd.7) 8 : cluster 0 18.2 deep-scrub ok 2024-05-20T22:11:41.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: cluster 2024-05-20T22:11:39.377164+0000 osd.1 (osd.1) 9 : cluster 0 18.5 deep-scrub starts 2024-05-20T22:11:41.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: cluster 2024-05-20T22:11:39.423870+0000 osd.1 (osd.1) 10 : cluster 0 18.5 deep-scrub ok 2024-05-20T22:11:41.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: cluster 2024-05-20T22:11:39.425975+0000 osd.7 (osd.7) 9 : cluster 0 18.6 deep-scrub starts 2024-05-20T22:11:41.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: cluster 2024-05-20T22:11:39.428398+0000 osd.7 (osd.7) 10 : cluster 0 18.6 deep-scrub ok 2024-05-20T22:11:41.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: cluster 2024-05-20T22:11:39.559493+0000 osd.0 (osd.0) 11 : cluster 0 18.4 deep-scrub starts 2024-05-20T22:11:41.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: cluster 2024-05-20T22:11:39.564404+0000 osd.0 (osd.0) 12 : cluster 0 18.4 deep-scrub ok 2024-05-20T22:11:41.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: cluster 2024-05-20T22:11:39.785716+0000 osd.3 (osd.3) 9 : cluster 0 18.1 deep-scrub starts 2024-05-20T22:11:41.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: cluster 2024-05-20T22:11:39.791766+0000 osd.3 (osd.3) 10 : cluster 0 18.1 deep-scrub ok 2024-05-20T22:11:41.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: cluster 2024-05-20T22:11:39.988960+0000 mgr.y (mgr.14592) 219 : cluster 0 pgmap v170: 648 pgs: 64 creating+peering, 584 active+clean; 217 MiB data, 1007 MiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 17 MiB/s wr, 5 op/s 2024-05-20T22:11:41.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: cluster 2024-05-20T22:11:40.565091+0000 osd.0 (osd.0) 13 : cluster 0 18.8 deep-scrub starts 2024-05-20T22:11:41.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: audit 2024-05-20T22:11:40.578800+0000 mon.a (mon.0) 1233 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:11:41.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: audit 2024-05-20T22:11:40.580025+0000 mon.a (mon.0) 1234 : audit 1 from='client.25457 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi050-64823-3"}]': finished 2024-05-20T22:11:41.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: audit 2024-05-20T22:11:40.580176+0000 mon.a (mon.0) 1235 : audit 1 from='client.? v1:172.21.15.50:0/2810711937' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi050-63944-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:41.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: audit 2024-05-20T22:11:40.580299+0000 mon.a (mon.0) 1236 : audit 1 from='client.25514 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi050-63936-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:41.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: cluster 2024-05-20T22:11:40.688268+0000 osd.0 (osd.0) 14 : cluster 0 18.8 deep-scrub ok 2024-05-20T22:11:41.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: audit 2024-05-20T22:11:41.096595+0000 mon.b (mon.1) 107 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:41.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: cluster 2024-05-20T22:11:41.498692+0000 mon.a (mon.0) 1237 : cluster 0 osdmap e107: 8 total, 8 up, 8 in 2024-05-20T22:11:41.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: cluster 2024-05-20T22:11:41.499464+0000 mon.a (mon.0) 1238 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:41.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: cluster 2024-05-20T22:11:41.512418+0000 mon.a (mon.0) 1239 : cluster 0 osdmap e108: 8 total, 8 up, 8 in 2024-05-20T22:11:41.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: audit 2024-05-20T22:11:41.518330+0000 mon.a (mon.0) 1240 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:41.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:41 smithi145 bash[23893]: audit 2024-05-20T22:11:41.529651+0000 mon.a (mon.0) 1241 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:11:41.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: cluster 2024-05-20T22:11:38.444039+0000 osd.7 (osd.7) 7 : cluster 0 18.2 deep-scrub starts 2024-05-20T22:11:41.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: cluster 2024-05-20T22:11:38.497066+0000 osd.7 (osd.7) 8 : cluster 0 18.2 deep-scrub ok 2024-05-20T22:11:41.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: cluster 2024-05-20T22:11:39.377164+0000 osd.1 (osd.1) 9 : cluster 0 18.5 deep-scrub starts 2024-05-20T22:11:41.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: cluster 2024-05-20T22:11:39.423870+0000 osd.1 (osd.1) 10 : cluster 0 18.5 deep-scrub ok 2024-05-20T22:11:41.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: cluster 2024-05-20T22:11:39.425975+0000 osd.7 (osd.7) 9 : cluster 0 18.6 deep-scrub starts 2024-05-20T22:11:41.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: cluster 2024-05-20T22:11:39.428398+0000 osd.7 (osd.7) 10 : cluster 0 18.6 deep-scrub ok 2024-05-20T22:11:41.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: cluster 2024-05-20T22:11:39.559493+0000 osd.0 (osd.0) 11 : cluster 0 18.4 deep-scrub starts 2024-05-20T22:11:41.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: cluster 2024-05-20T22:11:39.564404+0000 osd.0 (osd.0) 12 : cluster 0 18.4 deep-scrub ok 2024-05-20T22:11:41.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: cluster 2024-05-20T22:11:39.785716+0000 osd.3 (osd.3) 9 : cluster 0 18.1 deep-scrub starts 2024-05-20T22:11:41.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: cluster 2024-05-20T22:11:39.791766+0000 osd.3 (osd.3) 10 : cluster 0 18.1 deep-scrub ok 2024-05-20T22:11:41.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: cluster 2024-05-20T22:11:39.988960+0000 mgr.y (mgr.14592) 219 : cluster 0 pgmap v170: 648 pgs: 64 creating+peering, 584 active+clean; 217 MiB data, 1007 MiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 17 MiB/s wr, 5 op/s 2024-05-20T22:11:41.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: cluster 2024-05-20T22:11:40.565091+0000 osd.0 (osd.0) 13 : cluster 0 18.8 deep-scrub starts 2024-05-20T22:11:41.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: audit 2024-05-20T22:11:40.578800+0000 mon.a (mon.0) 1233 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:11:41.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: audit 2024-05-20T22:11:40.580025+0000 mon.a (mon.0) 1234 : audit 1 from='client.25457 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi050-64823-3"}]': finished 2024-05-20T22:11:41.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: audit 2024-05-20T22:11:40.580176+0000 mon.a (mon.0) 1235 : audit 1 from='client.? v1:172.21.15.50:0/2810711937' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi050-63944-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:41.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: audit 2024-05-20T22:11:40.580299+0000 mon.a (mon.0) 1236 : audit 1 from='client.25514 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi050-63936-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:41.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: cluster 2024-05-20T22:11:40.688268+0000 osd.0 (osd.0) 14 : cluster 0 18.8 deep-scrub ok 2024-05-20T22:11:41.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: audit 2024-05-20T22:11:41.096595+0000 mon.b (mon.1) 107 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:41.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: cluster 2024-05-20T22:11:41.498692+0000 mon.a (mon.0) 1237 : cluster 0 osdmap e107: 8 total, 8 up, 8 in 2024-05-20T22:11:41.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: cluster 2024-05-20T22:11:41.499464+0000 mon.a (mon.0) 1238 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:41.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: cluster 2024-05-20T22:11:41.512418+0000 mon.a (mon.0) 1239 : cluster 0 osdmap e108: 8 total, 8 up, 8 in 2024-05-20T22:11:41.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: audit 2024-05-20T22:11:41.518330+0000 mon.a (mon.0) 1240 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:41.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:41 smithi050 bash[21866]: audit 2024-05-20T22:11:41.529651+0000 mon.a (mon.0) 1241 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:11:41.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: cluster 2024-05-20T22:11:38.444039+0000 osd.7 (osd.7) 7 : cluster 0 18.2 deep-scrub starts 2024-05-20T22:11:41.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: cluster 2024-05-20T22:11:38.497066+0000 osd.7 (osd.7) 8 : cluster 0 18.2 deep-scrub ok 2024-05-20T22:11:41.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: cluster 2024-05-20T22:11:39.377164+0000 osd.1 (osd.1) 9 : cluster 0 18.5 deep-scrub starts 2024-05-20T22:11:41.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: cluster 2024-05-20T22:11:39.423870+0000 osd.1 (osd.1) 10 : cluster 0 18.5 deep-scrub ok 2024-05-20T22:11:41.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: cluster 2024-05-20T22:11:39.425975+0000 osd.7 (osd.7) 9 : cluster 0 18.6 deep-scrub starts 2024-05-20T22:11:41.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: cluster 2024-05-20T22:11:39.428398+0000 osd.7 (osd.7) 10 : cluster 0 18.6 deep-scrub ok 2024-05-20T22:11:41.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: cluster 2024-05-20T22:11:39.559493+0000 osd.0 (osd.0) 11 : cluster 0 18.4 deep-scrub starts 2024-05-20T22:11:41.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: cluster 2024-05-20T22:11:39.564404+0000 osd.0 (osd.0) 12 : cluster 0 18.4 deep-scrub ok 2024-05-20T22:11:41.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: cluster 2024-05-20T22:11:39.785716+0000 osd.3 (osd.3) 9 : cluster 0 18.1 deep-scrub starts 2024-05-20T22:11:41.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: cluster 2024-05-20T22:11:39.791766+0000 osd.3 (osd.3) 10 : cluster 0 18.1 deep-scrub ok 2024-05-20T22:11:41.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: cluster 2024-05-20T22:11:39.988960+0000 mgr.y (mgr.14592) 219 : cluster 0 pgmap v170: 648 pgs: 64 creating+peering, 584 active+clean; 217 MiB data, 1007 MiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 17 MiB/s wr, 5 op/s 2024-05-20T22:11:41.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: cluster 2024-05-20T22:11:40.565091+0000 osd.0 (osd.0) 13 : cluster 0 18.8 deep-scrub starts 2024-05-20T22:11:41.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: audit 2024-05-20T22:11:40.578800+0000 mon.a (mon.0) 1233 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:11:41.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: audit 2024-05-20T22:11:40.580025+0000 mon.a (mon.0) 1234 : audit 1 from='client.25457 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi050-64823-3"}]': finished 2024-05-20T22:11:41.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: audit 2024-05-20T22:11:40.580176+0000 mon.a (mon.0) 1235 : audit 1 from='client.? v1:172.21.15.50:0/2810711937' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi050-63944-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:41.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: audit 2024-05-20T22:11:40.580299+0000 mon.a (mon.0) 1236 : audit 1 from='client.25514 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi050-63936-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:41.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: cluster 2024-05-20T22:11:40.688268+0000 osd.0 (osd.0) 14 : cluster 0 18.8 deep-scrub ok 2024-05-20T22:11:41.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: audit 2024-05-20T22:11:41.096595+0000 mon.b (mon.1) 107 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:41.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: cluster 2024-05-20T22:11:41.498692+0000 mon.a (mon.0) 1237 : cluster 0 osdmap e107: 8 total, 8 up, 8 in 2024-05-20T22:11:41.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: cluster 2024-05-20T22:11:41.499464+0000 mon.a (mon.0) 1238 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:41.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: cluster 2024-05-20T22:11:41.512418+0000 mon.a (mon.0) 1239 : cluster 0 osdmap e108: 8 total, 8 up, 8 in 2024-05-20T22:11:41.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: audit 2024-05-20T22:11:41.518330+0000 mon.a (mon.0) 1240 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:41.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:41 smithi050 bash[28929]: audit 2024-05-20T22:11:41.529651+0000 mon.a (mon.0) 1241 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:11:42.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:42 smithi145 bash[23893]: audit 2024-05-20T22:11:41.603997+0000 mon.c (mon.2) 136 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4"}]: dispatch 2024-05-20T22:11:42.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:42 smithi145 bash[23893]: audit 2024-05-20T22:11:41.604277+0000 mon.a (mon.0) 1242 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4"}]: dispatch 2024-05-20T22:11:42.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:42 smithi145 bash[23893]: audit 2024-05-20T22:11:42.098339+0000 mon.b (mon.1) 108 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:42.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:42 smithi145 bash[23893]: audit 2024-05-20T22:11:42.511552+0000 mon.a (mon.0) 1243 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:42.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:42 smithi145 bash[23893]: audit 2024-05-20T22:11:42.511744+0000 mon.a (mon.0) 1244 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4"}]': finished 2024-05-20T22:11:42.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:42 smithi145 bash[23893]: cluster 2024-05-20T22:11:42.521405+0000 mon.a (mon.0) 1245 : cluster 0 osdmap e109: 8 total, 8 up, 8 in 2024-05-20T22:11:42.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:42 smithi145 bash[23893]: audit 2024-05-20T22:11:42.524126+0000 mon.c (mon.2) 137 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "tierpool": "test-rados-api-smithi050-64274-6"}]: dispatch 2024-05-20T22:11:42.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:42 smithi145 bash[23893]: audit 2024-05-20T22:11:42.525500+0000 mon.a (mon.0) 1246 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "tierpool": "test-rados-api-smithi050-64274-6"}]: dispatch 2024-05-20T22:11:42.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:42 smithi050 bash[21866]: audit 2024-05-20T22:11:41.603997+0000 mon.c (mon.2) 136 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4"}]: dispatch 2024-05-20T22:11:42.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:42 smithi050 bash[21866]: audit 2024-05-20T22:11:41.604277+0000 mon.a (mon.0) 1242 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4"}]: dispatch 2024-05-20T22:11:42.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:42 smithi050 bash[21866]: audit 2024-05-20T22:11:42.098339+0000 mon.b (mon.1) 108 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:42.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:42 smithi050 bash[21866]: audit 2024-05-20T22:11:42.511552+0000 mon.a (mon.0) 1243 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:42.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:42 smithi050 bash[21866]: audit 2024-05-20T22:11:42.511744+0000 mon.a (mon.0) 1244 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4"}]': finished 2024-05-20T22:11:42.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:42 smithi050 bash[21866]: cluster 2024-05-20T22:11:42.521405+0000 mon.a (mon.0) 1245 : cluster 0 osdmap e109: 8 total, 8 up, 8 in 2024-05-20T22:11:42.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:42 smithi050 bash[21866]: audit 2024-05-20T22:11:42.524126+0000 mon.c (mon.2) 137 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "tierpool": "test-rados-api-smithi050-64274-6"}]: dispatch 2024-05-20T22:11:42.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:42 smithi050 bash[21866]: audit 2024-05-20T22:11:42.525500+0000 mon.a (mon.0) 1246 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "tierpool": "test-rados-api-smithi050-64274-6"}]: dispatch 2024-05-20T22:11:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:42 smithi050 bash[28929]: audit 2024-05-20T22:11:41.603997+0000 mon.c (mon.2) 136 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4"}]: dispatch 2024-05-20T22:11:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:42 smithi050 bash[28929]: audit 2024-05-20T22:11:41.604277+0000 mon.a (mon.0) 1242 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4"}]: dispatch 2024-05-20T22:11:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:42 smithi050 bash[28929]: audit 2024-05-20T22:11:42.098339+0000 mon.b (mon.1) 108 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:42 smithi050 bash[28929]: audit 2024-05-20T22:11:42.511552+0000 mon.a (mon.0) 1243 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:42 smithi050 bash[28929]: audit 2024-05-20T22:11:42.511744+0000 mon.a (mon.0) 1244 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4"}]': finished 2024-05-20T22:11:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:42 smithi050 bash[28929]: cluster 2024-05-20T22:11:42.521405+0000 mon.a (mon.0) 1245 : cluster 0 osdmap e109: 8 total, 8 up, 8 in 2024-05-20T22:11:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:42 smithi050 bash[28929]: audit 2024-05-20T22:11:42.524126+0000 mon.c (mon.2) 137 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "tierpool": "test-rados-api-smithi050-64274-6"}]: dispatch 2024-05-20T22:11:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:42 smithi050 bash[28929]: audit 2024-05-20T22:11:42.525500+0000 mon.a (mon.0) 1246 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "tierpool": "test-rados-api-smithi050-64274-6"}]: dispatch 2024-05-20T22:11:44.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:43 smithi145 bash[23893]: cluster 2024-05-20T22:11:41.990330+0000 mgr.y (mgr.14592) 220 : cluster 0 pgmap v173: 808 pgs: 160 unknown, 64 creating+peering, 584 active+clean; 217 MiB data, 1007 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 18 MiB/s wr, 5 op/s 2024-05-20T22:11:44.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:43 smithi145 bash[23893]: audit 2024-05-20T22:11:43.099882+0000 mon.b (mon.1) 109 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:44.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:43 smithi145 bash[23893]: cluster 2024-05-20T22:11:43.520202+0000 mon.a (mon.0) 1247 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:11:44.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:43 smithi145 bash[23893]: audit 2024-05-20T22:11:43.522308+0000 mon.a (mon.0) 1248 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:11:44.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:43 smithi050 bash[28929]: cluster 2024-05-20T22:11:41.990330+0000 mgr.y (mgr.14592) 220 : cluster 0 pgmap v173: 808 pgs: 160 unknown, 64 creating+peering, 584 active+clean; 217 MiB data, 1007 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 18 MiB/s wr, 5 op/s 2024-05-20T22:11:44.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:43 smithi050 bash[28929]: audit 2024-05-20T22:11:43.099882+0000 mon.b (mon.1) 109 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:44.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:43 smithi050 bash[28929]: cluster 2024-05-20T22:11:43.520202+0000 mon.a (mon.0) 1247 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:11:44.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:43 smithi050 bash[28929]: audit 2024-05-20T22:11:43.522308+0000 mon.a (mon.0) 1248 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:11:44.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:43 smithi050 bash[21866]: cluster 2024-05-20T22:11:41.990330+0000 mgr.y (mgr.14592) 220 : cluster 0 pgmap v173: 808 pgs: 160 unknown, 64 creating+peering, 584 active+clean; 217 MiB data, 1007 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 18 MiB/s wr, 5 op/s 2024-05-20T22:11:44.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:43 smithi050 bash[21866]: audit 2024-05-20T22:11:43.099882+0000 mon.b (mon.1) 109 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:44.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:43 smithi050 bash[21866]: cluster 2024-05-20T22:11:43.520202+0000 mon.a (mon.0) 1247 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:11:44.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:43 smithi050 bash[21866]: audit 2024-05-20T22:11:43.522308+0000 mon.a (mon.0) 1248 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:11:45.554 INFO:tasks.workunit.client.0.smithi050.stdout:_notify_pp: flushed 2024-05-20T22:11:45.554 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3005 ms) 2024-05-20T22:11:45.554 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-05-20T22:11:45.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: trying... 2024-05-20T22:11:45.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: handle_notify cookie 94611352308720 notify_id 429496729601 notifier_gid 25376 2024-05-20T22:11:45.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: timed out 2024-05-20T22:11:45.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: flushing 2024-05-20T22:11:45.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: flushed 2024-05-20T22:11:45.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3009 ms) 2024-05-20T22:11:45.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-05-20T22:11:45.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: List watches 2024-05-20T22:11:45.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: notify2 2024-05-20T22:11:45.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: handle_notify cookie 94611352308720 notify_id 438086664199 notifier_gid 25376 2024-05-20T22:11:45.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: notify2 done 2024-05-20T22:11:45.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: watch_check 2024-05-20T22:11:45.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: unwatch2 2024-05-20T22:11:45.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: flushing 2024-05-20T22:11:45.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: done 2024-05-20T22:11:45.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3015 ms) 2024-05-20T22:11:45.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-05-20T22:11:45.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: List watches 2024-05-20T22:11:45.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: notify2 2024-05-20T22:11:45.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: handle_notify cookie 94611352308720 notify_id 450971566082 notifier_gid 25376 2024-05-20T22:11:45.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: notify2 done 2024-05-20T22:11:45.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: watch_check 2024-05-20T22:11:45.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: unwatch2 2024-05-20T22:11:45.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: flushing 2024-05-20T22:11:45.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: done 2024-05-20T22:11:45.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3012 ms) 2024-05-20T22:11:45.557 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (17959 ms total) 2024-05-20T22:11:45.557 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: 2024-05-20T22:11:45.557 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2024-05-20T22:11:45.557 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (58671 ms total) 2024-05-20T22:11:45.557 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2024-05-20T22:11:45.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:45 smithi145 bash[23893]: audit 2024-05-20T22:11:43.522586+0000 mon.a (mon.0) 1249 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "tierpool": "test-rados-api-smithi050-64274-6"}]': finished 2024-05-20T22:11:45.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:45 smithi145 bash[23893]: audit 2024-05-20T22:11:43.532018+0000 mon.b (mon.1) 110 : audit 1 from='client.? v1:172.21.15.50:0/2496483420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:45 smithi145 bash[23893]: audit 2024-05-20T22:11:43.532482+0000 mon.c (mon.2) 138 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi050-64274-6", "pool2": "test-rados-api-smithi050-64274-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:45 smithi145 bash[23893]: cluster 2024-05-20T22:11:43.988575+0000 mon.a (mon.0) 1250 : cluster 0 osdmap e110: 8 total, 8 up, 8 in 2024-05-20T22:11:45.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:45 smithi145 bash[23893]: audit 2024-05-20T22:11:44.003829+0000 mon.a (mon.0) 1251 : audit 1 from='client.? v1:172.21.15.50:0/2876200164' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi050-63936-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:45 smithi145 bash[23893]: audit 2024-05-20T22:11:44.007232+0000 mon.a (mon.0) 1252 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi050-64274-6", "pool2": "test-rados-api-smithi050-64274-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:45 smithi145 bash[23893]: audit 2024-05-20T22:11:44.101284+0000 mon.b (mon.1) 111 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:45.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:45 smithi145 bash[23893]: audit 2024-05-20T22:11:44.437782+0000 mon.a (mon.0) 1253 : audit 1 from='client.25498 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:45 smithi145 bash[23893]: audit 2024-05-20T22:11:44.528149+0000 mon.a (mon.0) 1254 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-9", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:11:45.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:45 smithi145 bash[23893]: audit 2024-05-20T22:11:44.528326+0000 mon.a (mon.0) 1255 : audit 1 from='client.? v1:172.21.15.50:0/2876200164' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi050-63936-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:45.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:45 smithi145 bash[23893]: audit 2024-05-20T22:11:44.528480+0000 mon.a (mon.0) 1256 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi050-64274-6", "pool2": "test-rados-api-smithi050-64274-6", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T22:11:45.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:45 smithi145 bash[23893]: audit 2024-05-20T22:11:44.528657+0000 mon.a (mon.0) 1257 : audit 1 from='client.25498 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:45.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:45 smithi145 bash[23893]: cluster 2024-05-20T22:11:44.537759+0000 mon.a (mon.0) 1258 : cluster 0 osdmap e111: 8 total, 8 up, 8 in 2024-05-20T22:11:45.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:45 smithi145 bash[23893]: audit 2024-05-20T22:11:44.541600+0000 mon.a (mon.0) 1259 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-9"}]: dispatch 2024-05-20T22:11:45.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:45 smithi145 bash[23893]: audit 2024-05-20T22:11:44.545031+0000 mon.c (mon.2) 139 : audit 1 from='client.? v1:172.21.15.50:0/868578621' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:45 smithi145 bash[23893]: audit 2024-05-20T22:11:44.547731+0000 mon.a (mon.0) 1260 : audit 1 from='client.25547 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:45 smithi145 bash[23893]: audit 2024-05-20T22:11:44.549247+0000 mon.c (mon.2) 140 : audit 1 from='client.? v1:172.21.15.50:0/686378073' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi050-63944-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:45 smithi145 bash[23893]: audit 2024-05-20T22:11:44.549822+0000 mon.a (mon.0) 1261 : audit 1 from='client.25541 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi050-63944-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:45 smithi050 bash[28929]: audit 2024-05-20T22:11:43.522586+0000 mon.a (mon.0) 1249 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "tierpool": "test-rados-api-smithi050-64274-6"}]': finished 2024-05-20T22:11:45.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:45 smithi050 bash[28929]: audit 2024-05-20T22:11:43.532018+0000 mon.b (mon.1) 110 : audit 1 from='client.? v1:172.21.15.50:0/2496483420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:45 smithi050 bash[28929]: audit 2024-05-20T22:11:43.532482+0000 mon.c (mon.2) 138 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi050-64274-6", "pool2": "test-rados-api-smithi050-64274-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:45 smithi050 bash[28929]: cluster 2024-05-20T22:11:43.988575+0000 mon.a (mon.0) 1250 : cluster 0 osdmap e110: 8 total, 8 up, 8 in 2024-05-20T22:11:45.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:45 smithi050 bash[28929]: audit 2024-05-20T22:11:44.003829+0000 mon.a (mon.0) 1251 : audit 1 from='client.? v1:172.21.15.50:0/2876200164' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi050-63936-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:45 smithi050 bash[28929]: audit 2024-05-20T22:11:44.007232+0000 mon.a (mon.0) 1252 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi050-64274-6", "pool2": "test-rados-api-smithi050-64274-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:45 smithi050 bash[28929]: audit 2024-05-20T22:11:44.101284+0000 mon.b (mon.1) 111 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:45.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:45 smithi050 bash[28929]: audit 2024-05-20T22:11:44.437782+0000 mon.a (mon.0) 1253 : audit 1 from='client.25498 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:45 smithi050 bash[28929]: audit 2024-05-20T22:11:44.528149+0000 mon.a (mon.0) 1254 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-9", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:11:45.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:45 smithi050 bash[28929]: audit 2024-05-20T22:11:44.528326+0000 mon.a (mon.0) 1255 : audit 1 from='client.? v1:172.21.15.50:0/2876200164' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi050-63936-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:45.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:45 smithi050 bash[28929]: audit 2024-05-20T22:11:44.528480+0000 mon.a (mon.0) 1256 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi050-64274-6", "pool2": "test-rados-api-smithi050-64274-6", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T22:11:45.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:45 smithi050 bash[28929]: audit 2024-05-20T22:11:44.528657+0000 mon.a (mon.0) 1257 : audit 1 from='client.25498 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:45.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:45 smithi050 bash[28929]: cluster 2024-05-20T22:11:44.537759+0000 mon.a (mon.0) 1258 : cluster 0 osdmap e111: 8 total, 8 up, 8 in 2024-05-20T22:11:45.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:45 smithi050 bash[28929]: audit 2024-05-20T22:11:44.541600+0000 mon.a (mon.0) 1259 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-9"}]: dispatch 2024-05-20T22:11:45.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:45 smithi050 bash[21866]: audit 2024-05-20T22:11:43.522586+0000 mon.a (mon.0) 1249 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi050-64274-4", "tierpool": "test-rados-api-smithi050-64274-6"}]': finished 2024-05-20T22:11:45.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:45 smithi050 bash[21866]: audit 2024-05-20T22:11:43.532018+0000 mon.b (mon.1) 110 : audit 1 from='client.? v1:172.21.15.50:0/2496483420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:45 smithi050 bash[21866]: audit 2024-05-20T22:11:43.532482+0000 mon.c (mon.2) 138 : audit 1 from='client.? v1:172.21.15.50:0/2163592038' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi050-64274-6", "pool2": "test-rados-api-smithi050-64274-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:45 smithi050 bash[21866]: cluster 2024-05-20T22:11:43.988575+0000 mon.a (mon.0) 1250 : cluster 0 osdmap e110: 8 total, 8 up, 8 in 2024-05-20T22:11:45.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:45 smithi050 bash[21866]: audit 2024-05-20T22:11:44.003829+0000 mon.a (mon.0) 1251 : audit 1 from='client.? v1:172.21.15.50:0/2876200164' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi050-63936-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:45 smithi050 bash[21866]: audit 2024-05-20T22:11:44.007232+0000 mon.a (mon.0) 1252 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi050-64274-6", "pool2": "test-rados-api-smithi050-64274-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:45 smithi050 bash[21866]: audit 2024-05-20T22:11:44.101284+0000 mon.b (mon.1) 111 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:45.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:45 smithi050 bash[21866]: audit 2024-05-20T22:11:44.437782+0000 mon.a (mon.0) 1253 : audit 1 from='client.25498 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:45 smithi050 bash[21866]: audit 2024-05-20T22:11:44.528149+0000 mon.a (mon.0) 1254 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-9", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:11:45.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:45 smithi050 bash[21866]: audit 2024-05-20T22:11:44.528326+0000 mon.a (mon.0) 1255 : audit 1 from='client.? v1:172.21.15.50:0/2876200164' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi050-63936-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:45.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:45 smithi050 bash[21866]: audit 2024-05-20T22:11:44.528480+0000 mon.a (mon.0) 1256 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi050-64274-6", "pool2": "test-rados-api-smithi050-64274-6", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T22:11:45.948 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:45 smithi050 bash[21866]: audit 2024-05-20T22:11:44.528657+0000 mon.a (mon.0) 1257 : audit 1 from='client.25498 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64383-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:45.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:45 smithi050 bash[21866]: cluster 2024-05-20T22:11:44.537759+0000 mon.a (mon.0) 1258 : cluster 0 osdmap e111: 8 total, 8 up, 8 in 2024-05-20T22:11:45.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:45 smithi050 bash[21866]: audit 2024-05-20T22:11:44.541600+0000 mon.a (mon.0) 1259 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-9"}]: dispatch 2024-05-20T22:11:45.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:45 smithi050 bash[21866]: audit 2024-05-20T22:11:44.545031+0000 mon.c (mon.2) 139 : audit 1 from='client.? v1:172.21.15.50:0/868578621' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:45 smithi050 bash[21866]: audit 2024-05-20T22:11:44.547731+0000 mon.a (mon.0) 1260 : audit 1 from='client.25547 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:45 smithi050 bash[21866]: audit 2024-05-20T22:11:44.549247+0000 mon.c (mon.2) 140 : audit 1 from='client.? v1:172.21.15.50:0/686378073' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi050-63944-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:45 smithi050 bash[21866]: audit 2024-05-20T22:11:44.549822+0000 mon.a (mon.0) 1261 : audit 1 from='client.25541 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi050-63944-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:45 smithi050 bash[28929]: audit 2024-05-20T22:11:44.545031+0000 mon.c (mon.2) 139 : audit 1 from='client.? v1:172.21.15.50:0/868578621' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:45 smithi050 bash[28929]: audit 2024-05-20T22:11:44.547731+0000 mon.a (mon.0) 1260 : audit 1 from='client.25547 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:45 smithi050 bash[28929]: audit 2024-05-20T22:11:44.549247+0000 mon.c (mon.2) 140 : audit 1 from='client.? v1:172.21.15.50:0/686378073' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi050-63944-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:45.950 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:45 smithi050 bash[28929]: audit 2024-05-20T22:11:44.549822+0000 mon.a (mon.0) 1261 : audit 1 from='client.25541 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi050-63944-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:46.960 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: Running main() from gmock_main.cc 2024-05-20T22:11:46.961 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2024-05-20T22:11:46.961 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [----------] Global test environment set-up. 2024-05-20T22:11:46.961 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2024-05-20T22:11:46.961 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2024-05-20T22:11:46.961 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-05-20T22:11:46.961 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2024-05-20T22:11:46.961 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: 2024-05-20T22:11:46.961 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2024-05-20T22:11:46.961 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2024-05-20T22:11:46.961 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (18128 ms) 2024-05-20T22:11:46.961 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-05-20T22:11:46.962 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (10437 ms) 2024-05-20T22:11:46.962 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2024-05-20T22:11:46.962 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (7220 ms) 2024-05-20T22:11:46.962 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2024-05-20T22:11:46.962 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (5311 ms) 2024-05-20T22:11:46.962 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2024-05-20T22:11:46.963 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (7691 ms) 2024-05-20T22:11:46.963 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2024-05-20T22:11:46.963 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (6820 ms) 2024-05-20T22:11:46.963 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2024-05-20T22:11:46.963 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (4430 ms) 2024-05-20T22:11:46.963 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (60037 ms total) 2024-05-20T22:11:46.963 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: 2024-05-20T22:11:46.964 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [----------] Global test environment tear-down 2024-05-20T22:11:46.964 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (60037 ms total) 2024-05-20T22:11:46.964 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2024-05-20T22:11:47.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:46 smithi050 bash[21866]: cluster 2024-05-20T22:11:43.991020+0000 mgr.y (mgr.14592) 221 : cluster 0 pgmap v176: 712 pgs: 192 unknown, 520 active+clean; 217 MiB data, 1007 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:11:47.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:46 smithi050 bash[21866]: audit 2024-05-20T22:11:45.102605+0000 mon.b (mon.1) 112 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:47.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:46 smithi050 bash[21866]: audit 2024-05-20T22:11:45.539944+0000 mon.a (mon.0) 1262 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-9"}]': finished 2024-05-20T22:11:47.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:46 smithi050 bash[21866]: audit 2024-05-20T22:11:45.540073+0000 mon.a (mon.0) 1263 : audit 1 from='client.25547 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:47.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:46 smithi050 bash[21866]: audit 2024-05-20T22:11:45.540242+0000 mon.a (mon.0) 1264 : audit 1 from='client.25541 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi050-63944-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:47.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:46 smithi050 bash[21866]: cluster 2024-05-20T22:11:46.032110+0000 mon.a (mon.0) 1265 : cluster 0 osdmap e112: 8 total, 8 up, 8 in 2024-05-20T22:11:47.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:46 smithi050 bash[21866]: audit 2024-05-20T22:11:46.103769+0000 mon.b (mon.1) 113 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:47.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:46 smithi050 bash[21866]: audit 2024-05-20T22:11:46.482968+0000 mon.a (mon.0) 1266 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-9", "mode": "writeback"}]: dispatch 2024-05-20T22:11:47.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:46 smithi050 bash[28929]: cluster 2024-05-20T22:11:43.991020+0000 mgr.y (mgr.14592) 221 : cluster 0 pgmap v176: 712 pgs: 192 unknown, 520 active+clean; 217 MiB data, 1007 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:11:47.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:46 smithi050 bash[28929]: audit 2024-05-20T22:11:45.102605+0000 mon.b (mon.1) 112 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:47.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:46 smithi050 bash[28929]: audit 2024-05-20T22:11:45.539944+0000 mon.a (mon.0) 1262 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-9"}]': finished 2024-05-20T22:11:47.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:46 smithi050 bash[28929]: audit 2024-05-20T22:11:45.540073+0000 mon.a (mon.0) 1263 : audit 1 from='client.25547 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:47.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:46 smithi050 bash[28929]: audit 2024-05-20T22:11:45.540242+0000 mon.a (mon.0) 1264 : audit 1 from='client.25541 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi050-63944-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:47.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:46 smithi050 bash[28929]: cluster 2024-05-20T22:11:46.032110+0000 mon.a (mon.0) 1265 : cluster 0 osdmap e112: 8 total, 8 up, 8 in 2024-05-20T22:11:47.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:46 smithi050 bash[28929]: audit 2024-05-20T22:11:46.103769+0000 mon.b (mon.1) 113 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:47.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:46 smithi050 bash[28929]: audit 2024-05-20T22:11:46.482968+0000 mon.a (mon.0) 1266 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-9", "mode": "writeback"}]: dispatch 2024-05-20T22:11:47.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:46 smithi145 bash[23893]: cluster 2024-05-20T22:11:43.991020+0000 mgr.y (mgr.14592) 221 : cluster 0 pgmap v176: 712 pgs: 192 unknown, 520 active+clean; 217 MiB data, 1007 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:11:47.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:46 smithi145 bash[23893]: audit 2024-05-20T22:11:45.102605+0000 mon.b (mon.1) 112 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:47.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:46 smithi145 bash[23893]: audit 2024-05-20T22:11:45.539944+0000 mon.a (mon.0) 1262 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-9"}]': finished 2024-05-20T22:11:47.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:46 smithi145 bash[23893]: audit 2024-05-20T22:11:45.540073+0000 mon.a (mon.0) 1263 : audit 1 from='client.25547 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:47.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:46 smithi145 bash[23893]: audit 2024-05-20T22:11:45.540242+0000 mon.a (mon.0) 1264 : audit 1 from='client.25541 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi050-63944-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:47.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:46 smithi145 bash[23893]: cluster 2024-05-20T22:11:46.032110+0000 mon.a (mon.0) 1265 : cluster 0 osdmap e112: 8 total, 8 up, 8 in 2024-05-20T22:11:47.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:46 smithi145 bash[23893]: audit 2024-05-20T22:11:46.103769+0000 mon.b (mon.1) 113 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:47.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:46 smithi145 bash[23893]: audit 2024-05-20T22:11:46.482968+0000 mon.a (mon.0) 1266 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-9", "mode": "writeback"}]: dispatch 2024-05-20T22:11:47.938 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:11:47 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:11:48.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:47 smithi050 bash[21866]: cluster 2024-05-20T22:11:45.992472+0000 mgr.y (mgr.14592) 222 : cluster 0 pgmap v179: 676 pgs: 64 creating+peering, 64 unknown, 548 active+clean; 217 MiB data, 1004 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 0 op/s 2024-05-20T22:11:48.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:47 smithi050 bash[21866]: cluster 2024-05-20T22:11:46.932885+0000 mon.a (mon.0) 1267 : cluster 3 Health check update: 11 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:48.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:47 smithi050 bash[21866]: cluster 2024-05-20T22:11:46.940083+0000 mon.a (mon.0) 1268 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:11:48.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:47 smithi050 bash[21866]: audit 2024-05-20T22:11:46.950162+0000 mon.a (mon.0) 1269 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-9", "mode": "writeback"}]': finished 2024-05-20T22:11:48.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:47 smithi050 bash[21866]: cluster 2024-05-20T22:11:46.953059+0000 mon.a (mon.0) 1270 : cluster 0 osdmap e113: 8 total, 8 up, 8 in 2024-05-20T22:11:48.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:47 smithi050 bash[21866]: audit 2024-05-20T22:11:46.973668+0000 mon.c (mon.2) 141 : audit 1 from='client.? v1:172.21.15.50:0/2118462490' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi050-63936-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:48.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:47 smithi050 bash[21866]: audit 2024-05-20T22:11:46.990412+0000 mon.a (mon.0) 1271 : audit 1 from='client.25565 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi050-63936-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:48.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:47 smithi050 bash[21866]: audit 2024-05-20T22:11:47.104935+0000 mon.b (mon.1) 114 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:48.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:47 smithi050 bash[21866]: audit 2024-05-20T22:11:47.452127+0000 mon.a (mon.0) 1272 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:11:48.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:47 smithi050 bash[28929]: cluster 2024-05-20T22:11:45.992472+0000 mgr.y (mgr.14592) 222 : cluster 0 pgmap v179: 676 pgs: 64 creating+peering, 64 unknown, 548 active+clean; 217 MiB data, 1004 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 0 op/s 2024-05-20T22:11:48.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:47 smithi050 bash[28929]: cluster 2024-05-20T22:11:46.932885+0000 mon.a (mon.0) 1267 : cluster 3 Health check update: 11 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:48.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:47 smithi050 bash[28929]: cluster 2024-05-20T22:11:46.940083+0000 mon.a (mon.0) 1268 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:11:48.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:47 smithi050 bash[28929]: audit 2024-05-20T22:11:46.950162+0000 mon.a (mon.0) 1269 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-9", "mode": "writeback"}]': finished 2024-05-20T22:11:48.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:47 smithi050 bash[28929]: cluster 2024-05-20T22:11:46.953059+0000 mon.a (mon.0) 1270 : cluster 0 osdmap e113: 8 total, 8 up, 8 in 2024-05-20T22:11:48.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:47 smithi050 bash[28929]: audit 2024-05-20T22:11:46.973668+0000 mon.c (mon.2) 141 : audit 1 from='client.? v1:172.21.15.50:0/2118462490' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi050-63936-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:48.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:47 smithi050 bash[28929]: audit 2024-05-20T22:11:46.990412+0000 mon.a (mon.0) 1271 : audit 1 from='client.25565 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi050-63936-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:48.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:47 smithi050 bash[28929]: audit 2024-05-20T22:11:47.104935+0000 mon.b (mon.1) 114 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:48.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:47 smithi050 bash[28929]: audit 2024-05-20T22:11:47.452127+0000 mon.a (mon.0) 1272 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:11:48.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:47 smithi145 bash[23893]: cluster 2024-05-20T22:11:45.992472+0000 mgr.y (mgr.14592) 222 : cluster 0 pgmap v179: 676 pgs: 64 creating+peering, 64 unknown, 548 active+clean; 217 MiB data, 1004 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 0 op/s 2024-05-20T22:11:48.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:47 smithi145 bash[23893]: cluster 2024-05-20T22:11:46.932885+0000 mon.a (mon.0) 1267 : cluster 3 Health check update: 11 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:48.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:47 smithi145 bash[23893]: cluster 2024-05-20T22:11:46.940083+0000 mon.a (mon.0) 1268 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:11:48.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:47 smithi145 bash[23893]: audit 2024-05-20T22:11:46.950162+0000 mon.a (mon.0) 1269 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-9", "mode": "writeback"}]': finished 2024-05-20T22:11:48.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:47 smithi145 bash[23893]: cluster 2024-05-20T22:11:46.953059+0000 mon.a (mon.0) 1270 : cluster 0 osdmap e113: 8 total, 8 up, 8 in 2024-05-20T22:11:48.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:47 smithi145 bash[23893]: audit 2024-05-20T22:11:46.973668+0000 mon.c (mon.2) 141 : audit 1 from='client.? v1:172.21.15.50:0/2118462490' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi050-63936-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:48.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:47 smithi145 bash[23893]: audit 2024-05-20T22:11:46.990412+0000 mon.a (mon.0) 1271 : audit 1 from='client.25565 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi050-63936-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:48.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:47 smithi145 bash[23893]: audit 2024-05-20T22:11:47.104935+0000 mon.b (mon.1) 114 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:48.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:47 smithi145 bash[23893]: audit 2024-05-20T22:11:47.452127+0000 mon.a (mon.0) 1272 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:11:49.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:48 smithi145 bash[23893]: audit 2024-05-20T22:11:47.684188+0000 mgr.y (mgr.14592) 223 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:49.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:48 smithi145 bash[23893]: audit 2024-05-20T22:11:47.955984+0000 mon.a (mon.0) 1273 : audit 1 from='client.25565 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi050-63936-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:49.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:48 smithi145 bash[23893]: audit 2024-05-20T22:11:47.956139+0000 mon.a (mon.0) 1274 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:11:49.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:48 smithi145 bash[23893]: cluster 2024-05-20T22:11:47.964642+0000 mon.a (mon.0) 1275 : cluster 0 osdmap e114: 8 total, 8 up, 8 in 2024-05-20T22:11:49.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:48 smithi145 bash[23893]: audit 2024-05-20T22:11:47.969355+0000 mon.a (mon.0) 1276 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-9"}]: dispatch 2024-05-20T22:11:49.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:48 smithi145 bash[23893]: cluster 2024-05-20T22:11:47.994573+0000 mgr.y (mgr.14592) 224 : cluster 0 pgmap v182: 644 pgs: 32 creating+peering, 96 unknown, 516 active+clean; 217 MiB data, 1004 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:11:49.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:48 smithi145 bash[23893]: audit 2024-05-20T22:11:47.996768+0000 mon.c (mon.2) 142 : audit 1 from='client.? v1:172.21.15.50:0/2934592329' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi050-63944-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:49.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:48 smithi145 bash[23893]: audit 2024-05-20T22:11:47.997803+0000 mon.a (mon.0) 1277 : audit 1 from='client.25568 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi050-63944-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:49.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:48 smithi145 bash[23893]: audit 2024-05-20T22:11:48.105957+0000 mon.b (mon.1) 115 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:49.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:48 smithi050 bash[21866]: audit 2024-05-20T22:11:47.684188+0000 mgr.y (mgr.14592) 223 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:49.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:48 smithi050 bash[21866]: audit 2024-05-20T22:11:47.955984+0000 mon.a (mon.0) 1273 : audit 1 from='client.25565 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi050-63936-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:49.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:48 smithi050 bash[21866]: audit 2024-05-20T22:11:47.956139+0000 mon.a (mon.0) 1274 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:11:49.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:48 smithi050 bash[21866]: cluster 2024-05-20T22:11:47.964642+0000 mon.a (mon.0) 1275 : cluster 0 osdmap e114: 8 total, 8 up, 8 in 2024-05-20T22:11:49.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:48 smithi050 bash[21866]: audit 2024-05-20T22:11:47.969355+0000 mon.a (mon.0) 1276 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-9"}]: dispatch 2024-05-20T22:11:49.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:48 smithi050 bash[21866]: cluster 2024-05-20T22:11:47.994573+0000 mgr.y (mgr.14592) 224 : cluster 0 pgmap v182: 644 pgs: 32 creating+peering, 96 unknown, 516 active+clean; 217 MiB data, 1004 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:11:49.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:48 smithi050 bash[21866]: audit 2024-05-20T22:11:47.996768+0000 mon.c (mon.2) 142 : audit 1 from='client.? v1:172.21.15.50:0/2934592329' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi050-63944-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:49.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:48 smithi050 bash[21866]: audit 2024-05-20T22:11:47.997803+0000 mon.a (mon.0) 1277 : audit 1 from='client.25568 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi050-63944-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:49.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:48 smithi050 bash[21866]: audit 2024-05-20T22:11:48.105957+0000 mon.b (mon.1) 115 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:49.393 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:48 smithi050 bash[28929]: audit 2024-05-20T22:11:47.684188+0000 mgr.y (mgr.14592) 223 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:49.393 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:48 smithi050 bash[28929]: audit 2024-05-20T22:11:47.955984+0000 mon.a (mon.0) 1273 : audit 1 from='client.25565 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi050-63936-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:49.393 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:48 smithi050 bash[28929]: audit 2024-05-20T22:11:47.956139+0000 mon.a (mon.0) 1274 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:11:49.393 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:48 smithi050 bash[28929]: cluster 2024-05-20T22:11:47.964642+0000 mon.a (mon.0) 1275 : cluster 0 osdmap e114: 8 total, 8 up, 8 in 2024-05-20T22:11:49.393 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:48 smithi050 bash[28929]: audit 2024-05-20T22:11:47.969355+0000 mon.a (mon.0) 1276 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-9"}]: dispatch 2024-05-20T22:11:49.393 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:48 smithi050 bash[28929]: cluster 2024-05-20T22:11:47.994573+0000 mgr.y (mgr.14592) 224 : cluster 0 pgmap v182: 644 pgs: 32 creating+peering, 96 unknown, 516 active+clean; 217 MiB data, 1004 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:11:49.393 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:48 smithi050 bash[28929]: audit 2024-05-20T22:11:47.996768+0000 mon.c (mon.2) 142 : audit 1 from='client.? v1:172.21.15.50:0/2934592329' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi050-63944-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:49.393 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:48 smithi050 bash[28929]: audit 2024-05-20T22:11:47.997803+0000 mon.a (mon.0) 1277 : audit 1 from='client.25568 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi050-63944-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:49.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:48 smithi050 bash[28929]: audit 2024-05-20T22:11:48.105957+0000 mon.b (mon.1) 115 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:49.692 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:11:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:11:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:11:50.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:50 smithi145 bash[23893]: cluster 2024-05-20T22:11:48.958720+0000 mon.a (mon.0) 1278 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:11:50.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:50 smithi145 bash[23893]: audit 2024-05-20T22:11:48.965744+0000 mon.a (mon.0) 1279 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-9"}]': finished 2024-05-20T22:11:50.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:50 smithi145 bash[23893]: audit 2024-05-20T22:11:48.965811+0000 mon.a (mon.0) 1280 : audit 1 from='client.25568 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi050-63944-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:50.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:50 smithi145 bash[23893]: cluster 2024-05-20T22:11:48.970416+0000 mon.a (mon.0) 1281 : cluster 0 osdmap e115: 8 total, 8 up, 8 in 2024-05-20T22:11:50.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:50 smithi145 bash[23893]: audit 2024-05-20T22:11:49.107111+0000 mon.b (mon.1) 116 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:50.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:50 smithi050 bash[21866]: cluster 2024-05-20T22:11:48.958720+0000 mon.a (mon.0) 1278 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:11:50.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:50 smithi050 bash[21866]: audit 2024-05-20T22:11:48.965744+0000 mon.a (mon.0) 1279 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-9"}]': finished 2024-05-20T22:11:50.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:50 smithi050 bash[21866]: audit 2024-05-20T22:11:48.965811+0000 mon.a (mon.0) 1280 : audit 1 from='client.25568 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi050-63944-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:50.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:50 smithi050 bash[21866]: cluster 2024-05-20T22:11:48.970416+0000 mon.a (mon.0) 1281 : cluster 0 osdmap e115: 8 total, 8 up, 8 in 2024-05-20T22:11:50.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:50 smithi050 bash[21866]: audit 2024-05-20T22:11:49.107111+0000 mon.b (mon.1) 116 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:50.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:50 smithi050 bash[28929]: cluster 2024-05-20T22:11:48.958720+0000 mon.a (mon.0) 1278 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:11:50.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:50 smithi050 bash[28929]: audit 2024-05-20T22:11:48.965744+0000 mon.a (mon.0) 1279 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-9"}]': finished 2024-05-20T22:11:50.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:50 smithi050 bash[28929]: audit 2024-05-20T22:11:48.965811+0000 mon.a (mon.0) 1280 : audit 1 from='client.25568 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi050-63944-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:50.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:50 smithi050 bash[28929]: cluster 2024-05-20T22:11:48.970416+0000 mon.a (mon.0) 1281 : cluster 0 osdmap e115: 8 total, 8 up, 8 in 2024-05-20T22:11:50.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:50 smithi050 bash[28929]: audit 2024-05-20T22:11:49.107111+0000 mon.b (mon.1) 116 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:52.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:51 smithi145 bash[23893]: cluster 2024-05-20T22:11:49.999358+0000 mgr.y (mgr.14592) 225 : cluster 0 pgmap v184: 612 pgs: 64 creating+peering, 548 active+clean; 217 MiB data, 993 MiB used, 714 GiB / 715 GiB avail; 919 B/s rd, 3.1 KiB/s wr, 5 op/s 2024-05-20T22:11:52.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:51 smithi145 bash[23893]: audit 2024-05-20T22:11:50.108381+0000 mon.b (mon.1) 117 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:52.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:51 smithi145 bash[23893]: audit 2024-05-20T22:11:50.371019+0000 mon.a (mon.0) 1282 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:11:52.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:51 smithi145 bash[23893]: cluster 2024-05-20T22:11:50.386370+0000 mon.a (mon.0) 1283 : cluster 0 osdmap e116: 8 total, 8 up, 8 in 2024-05-20T22:11:52.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:51 smithi145 bash[23893]: audit 2024-05-20T22:11:50.387108+0000 mon.b (mon.1) 118 : audit 1 from='client.? v1:172.21.15.50:0/3786497111' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi050-63936-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:52.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:51 smithi145 bash[23893]: audit 2024-05-20T22:11:50.388975+0000 mon.a (mon.0) 1284 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:11:52.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:51 smithi145 bash[23893]: audit 2024-05-20T22:11:50.393318+0000 mon.c (mon.2) 143 : audit 1 from='client.? v1:172.21.15.50:0/908802332' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:52.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:51 smithi145 bash[23893]: audit 2024-05-20T22:11:50.393507+0000 mon.a (mon.0) 1285 : audit 1 from='client.25543 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi050-63936-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:52.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:51 smithi145 bash[23893]: audit 2024-05-20T22:11:50.394147+0000 mon.a (mon.0) 1286 : audit 1 from='client.25589 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:52.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:51 smithi145 bash[23893]: audit 2024-05-20T22:11:51.109802+0000 mon.b (mon.1) 119 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:52.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:51 smithi050 bash[21866]: cluster 2024-05-20T22:11:49.999358+0000 mgr.y (mgr.14592) 225 : cluster 0 pgmap v184: 612 pgs: 64 creating+peering, 548 active+clean; 217 MiB data, 993 MiB used, 714 GiB / 715 GiB avail; 919 B/s rd, 3.1 KiB/s wr, 5 op/s 2024-05-20T22:11:52.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:51 smithi050 bash[21866]: audit 2024-05-20T22:11:50.108381+0000 mon.b (mon.1) 117 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:52.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:51 smithi050 bash[21866]: audit 2024-05-20T22:11:50.371019+0000 mon.a (mon.0) 1282 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:11:52.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:51 smithi050 bash[21866]: cluster 2024-05-20T22:11:50.386370+0000 mon.a (mon.0) 1283 : cluster 0 osdmap e116: 8 total, 8 up, 8 in 2024-05-20T22:11:52.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:51 smithi050 bash[21866]: audit 2024-05-20T22:11:50.387108+0000 mon.b (mon.1) 118 : audit 1 from='client.? v1:172.21.15.50:0/3786497111' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi050-63936-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:52.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:51 smithi050 bash[21866]: audit 2024-05-20T22:11:50.388975+0000 mon.a (mon.0) 1284 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:11:52.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:51 smithi050 bash[21866]: audit 2024-05-20T22:11:50.393318+0000 mon.c (mon.2) 143 : audit 1 from='client.? v1:172.21.15.50:0/908802332' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:52.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:51 smithi050 bash[21866]: audit 2024-05-20T22:11:50.393507+0000 mon.a (mon.0) 1285 : audit 1 from='client.25543 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi050-63936-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:52.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:51 smithi050 bash[21866]: audit 2024-05-20T22:11:50.394147+0000 mon.a (mon.0) 1286 : audit 1 from='client.25589 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:52.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:51 smithi050 bash[21866]: audit 2024-05-20T22:11:51.109802+0000 mon.b (mon.1) 119 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:52.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:51 smithi050 bash[28929]: cluster 2024-05-20T22:11:49.999358+0000 mgr.y (mgr.14592) 225 : cluster 0 pgmap v184: 612 pgs: 64 creating+peering, 548 active+clean; 217 MiB data, 993 MiB used, 714 GiB / 715 GiB avail; 919 B/s rd, 3.1 KiB/s wr, 5 op/s 2024-05-20T22:11:52.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:51 smithi050 bash[28929]: audit 2024-05-20T22:11:50.108381+0000 mon.b (mon.1) 117 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:52.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:51 smithi050 bash[28929]: audit 2024-05-20T22:11:50.371019+0000 mon.a (mon.0) 1282 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:11:52.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:51 smithi050 bash[28929]: cluster 2024-05-20T22:11:50.386370+0000 mon.a (mon.0) 1283 : cluster 0 osdmap e116: 8 total, 8 up, 8 in 2024-05-20T22:11:52.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:51 smithi050 bash[28929]: audit 2024-05-20T22:11:50.387108+0000 mon.b (mon.1) 118 : audit 1 from='client.? v1:172.21.15.50:0/3786497111' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi050-63936-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:52.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:51 smithi050 bash[28929]: audit 2024-05-20T22:11:50.388975+0000 mon.a (mon.0) 1284 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:11:52.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:51 smithi050 bash[28929]: audit 2024-05-20T22:11:50.393318+0000 mon.c (mon.2) 143 : audit 1 from='client.? v1:172.21.15.50:0/908802332' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:52.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:51 smithi050 bash[28929]: audit 2024-05-20T22:11:50.393507+0000 mon.a (mon.0) 1285 : audit 1 from='client.25543 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi050-63936-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:52.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:51 smithi050 bash[28929]: audit 2024-05-20T22:11:50.394147+0000 mon.a (mon.0) 1286 : audit 1 from='client.25589 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:52.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:51 smithi050 bash[28929]: audit 2024-05-20T22:11:51.109802+0000 mon.b (mon.1) 119 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:53.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:53 smithi145 bash[23893]: audit 2024-05-20T22:11:51.381827+0000 mon.a (mon.0) 1287 : audit 1 from='client.25543 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi050-63936-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:53.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:53 smithi145 bash[23893]: audit 2024-05-20T22:11:51.381989+0000 mon.a (mon.0) 1288 : audit 1 from='client.25589 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:53.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:53 smithi145 bash[23893]: cluster 2024-05-20T22:11:51.390186+0000 mon.a (mon.0) 1289 : cluster 0 osdmap e117: 8 total, 8 up, 8 in 2024-05-20T22:11:53.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:53 smithi145 bash[23893]: audit 2024-05-20T22:11:51.886028+0000 mon.a (mon.0) 1290 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:53.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:53 smithi145 bash[23893]: audit 2024-05-20T22:11:52.111802+0000 mon.b (mon.1) 120 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:53.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:53 smithi145 bash[23893]: cluster 2024-05-20T22:11:52.349264+0000 mon.a (mon.0) 1291 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:53.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:53 smithi145 bash[23893]: audit 2024-05-20T22:11:52.356701+0000 mon.a (mon.0) 1292 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:53.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:53 smithi050 bash[28929]: audit 2024-05-20T22:11:51.381827+0000 mon.a (mon.0) 1287 : audit 1 from='client.25543 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi050-63936-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:53.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:53 smithi050 bash[28929]: audit 2024-05-20T22:11:51.381989+0000 mon.a (mon.0) 1288 : audit 1 from='client.25589 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:53.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:53 smithi050 bash[28929]: cluster 2024-05-20T22:11:51.390186+0000 mon.a (mon.0) 1289 : cluster 0 osdmap e117: 8 total, 8 up, 8 in 2024-05-20T22:11:53.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:53 smithi050 bash[28929]: audit 2024-05-20T22:11:51.886028+0000 mon.a (mon.0) 1290 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:53.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:53 smithi050 bash[28929]: audit 2024-05-20T22:11:52.111802+0000 mon.b (mon.1) 120 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:53.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:53 smithi050 bash[28929]: cluster 2024-05-20T22:11:52.349264+0000 mon.a (mon.0) 1291 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:53.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:53 smithi050 bash[28929]: audit 2024-05-20T22:11:52.356701+0000 mon.a (mon.0) 1292 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:53.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:53 smithi050 bash[21866]: audit 2024-05-20T22:11:51.381827+0000 mon.a (mon.0) 1287 : audit 1 from='client.25543 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi050-63936-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:53.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:53 smithi050 bash[21866]: audit 2024-05-20T22:11:51.381989+0000 mon.a (mon.0) 1288 : audit 1 from='client.25589 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64136-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:53.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:53 smithi050 bash[21866]: cluster 2024-05-20T22:11:51.390186+0000 mon.a (mon.0) 1289 : cluster 0 osdmap e117: 8 total, 8 up, 8 in 2024-05-20T22:11:53.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:53 smithi050 bash[21866]: audit 2024-05-20T22:11:51.886028+0000 mon.a (mon.0) 1290 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:53.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:53 smithi050 bash[21866]: audit 2024-05-20T22:11:52.111802+0000 mon.b (mon.1) 120 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:53.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:53 smithi050 bash[21866]: cluster 2024-05-20T22:11:52.349264+0000 mon.a (mon.0) 1291 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:53.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:53 smithi050 bash[21866]: audit 2024-05-20T22:11:52.356701+0000 mon.a (mon.0) 1292 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:55.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:54 smithi145 bash[23893]: cluster 2024-05-20T22:11:52.000572+0000 mgr.y (mgr.14592) 226 : cluster 0 pgmap v187: 612 pgs: 128 unknown, 484 active+clean; 217 MiB data, 993 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2024-05-20T22:11:55.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:54 smithi145 bash[23893]: audit 2024-05-20T22:11:52.374265+0000 mon.c (mon.2) 144 : audit 1 from='client.? v1:172.21.15.50:0/908802332' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64136-10", "tierpool":"test-rados-api-smithi050-64136-10-cache", "force_nonempty":""}]: dispatch 2024-05-20T22:11:55.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:54 smithi145 bash[23893]: audit 2024-05-20T22:11:53.113242+0000 mon.b (mon.1) 121 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:55.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:54 smithi145 bash[23893]: cluster 2024-05-20T22:11:53.294212+0000 mon.a (mon.0) 1293 : cluster 0 osdmap e118: 8 total, 8 up, 8 in 2024-05-20T22:11:55.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:54 smithi145 bash[23893]: audit 2024-05-20T22:11:53.297664+0000 mon.a (mon.0) 1294 : audit 1 from='client.25589 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64136-10", "tierpool":"test-rados-api-smithi050-64136-10-cache", "force_nonempty":""}]: dispatch 2024-05-20T22:11:55.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:54 smithi145 bash[23893]: audit 2024-05-20T22:11:53.771376+0000 mon.a (mon.0) 1295 : audit 1 from='client.25589 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64136-10", "tierpool":"test-rados-api-smithi050-64136-10-cache", "force_nonempty":""}]': finished 2024-05-20T22:11:55.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:54 smithi145 bash[23893]: audit 2024-05-20T22:11:53.775259+0000 mon.c (mon.2) 145 : audit 1 from='client.? v1:172.21.15.50:0/908802332' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64136-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:55.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:54 smithi145 bash[23893]: cluster 2024-05-20T22:11:53.782875+0000 mon.a (mon.0) 1296 : cluster 0 osdmap e119: 8 total, 8 up, 8 in 2024-05-20T22:11:55.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:54 smithi145 bash[23893]: audit 2024-05-20T22:11:53.787452+0000 mon.c (mon.2) 146 : audit 1 from='client.? v1:172.21.15.50:0/330593440' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi050-63944-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:55.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:54 smithi145 bash[23893]: audit 2024-05-20T22:11:53.791541+0000 mon.a (mon.0) 1297 : audit 1 from='client.25589 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64136-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:55.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:54 smithi145 bash[23893]: audit 2024-05-20T22:11:53.791792+0000 mon.a (mon.0) 1298 : audit 1 from='client.25613 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi050-63944-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:55.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:54 smithi145 bash[23893]: audit 2024-05-20T22:11:54.115027+0000 mon.b (mon.1) 122 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:55.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:54 smithi145 bash[23893]: audit 2024-05-20T22:11:54.280696+0000 mon.a (mon.0) 1299 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:11:55.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:54 smithi050 bash[21866]: cluster 2024-05-20T22:11:52.000572+0000 mgr.y (mgr.14592) 226 : cluster 0 pgmap v187: 612 pgs: 128 unknown, 484 active+clean; 217 MiB data, 993 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2024-05-20T22:11:55.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:54 smithi050 bash[21866]: audit 2024-05-20T22:11:52.374265+0000 mon.c (mon.2) 144 : audit 1 from='client.? v1:172.21.15.50:0/908802332' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64136-10", "tierpool":"test-rados-api-smithi050-64136-10-cache", "force_nonempty":""}]: dispatch 2024-05-20T22:11:55.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:54 smithi050 bash[21866]: audit 2024-05-20T22:11:53.113242+0000 mon.b (mon.1) 121 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:55.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:54 smithi050 bash[21866]: cluster 2024-05-20T22:11:53.294212+0000 mon.a (mon.0) 1293 : cluster 0 osdmap e118: 8 total, 8 up, 8 in 2024-05-20T22:11:55.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:54 smithi050 bash[21866]: audit 2024-05-20T22:11:53.297664+0000 mon.a (mon.0) 1294 : audit 1 from='client.25589 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64136-10", "tierpool":"test-rados-api-smithi050-64136-10-cache", "force_nonempty":""}]: dispatch 2024-05-20T22:11:55.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:54 smithi050 bash[21866]: audit 2024-05-20T22:11:53.771376+0000 mon.a (mon.0) 1295 : audit 1 from='client.25589 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64136-10", "tierpool":"test-rados-api-smithi050-64136-10-cache", "force_nonempty":""}]': finished 2024-05-20T22:11:55.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:54 smithi050 bash[21866]: audit 2024-05-20T22:11:53.775259+0000 mon.c (mon.2) 145 : audit 1 from='client.? v1:172.21.15.50:0/908802332' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64136-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:55.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:54 smithi050 bash[21866]: cluster 2024-05-20T22:11:53.782875+0000 mon.a (mon.0) 1296 : cluster 0 osdmap e119: 8 total, 8 up, 8 in 2024-05-20T22:11:55.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:54 smithi050 bash[21866]: audit 2024-05-20T22:11:53.787452+0000 mon.c (mon.2) 146 : audit 1 from='client.? v1:172.21.15.50:0/330593440' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi050-63944-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:55.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:54 smithi050 bash[21866]: audit 2024-05-20T22:11:53.791541+0000 mon.a (mon.0) 1297 : audit 1 from='client.25589 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64136-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:55.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:54 smithi050 bash[21866]: audit 2024-05-20T22:11:53.791792+0000 mon.a (mon.0) 1298 : audit 1 from='client.25613 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi050-63944-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:55.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:54 smithi050 bash[21866]: audit 2024-05-20T22:11:54.115027+0000 mon.b (mon.1) 122 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:55.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:54 smithi050 bash[21866]: audit 2024-05-20T22:11:54.280696+0000 mon.a (mon.0) 1299 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:11:55.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:54 smithi050 bash[28929]: cluster 2024-05-20T22:11:52.000572+0000 mgr.y (mgr.14592) 226 : cluster 0 pgmap v187: 612 pgs: 128 unknown, 484 active+clean; 217 MiB data, 993 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2024-05-20T22:11:55.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:54 smithi050 bash[28929]: audit 2024-05-20T22:11:52.374265+0000 mon.c (mon.2) 144 : audit 1 from='client.? v1:172.21.15.50:0/908802332' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64136-10", "tierpool":"test-rados-api-smithi050-64136-10-cache", "force_nonempty":""}]: dispatch 2024-05-20T22:11:55.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:54 smithi050 bash[28929]: audit 2024-05-20T22:11:53.113242+0000 mon.b (mon.1) 121 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:55.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:54 smithi050 bash[28929]: cluster 2024-05-20T22:11:53.294212+0000 mon.a (mon.0) 1293 : cluster 0 osdmap e118: 8 total, 8 up, 8 in 2024-05-20T22:11:55.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:54 smithi050 bash[28929]: audit 2024-05-20T22:11:53.297664+0000 mon.a (mon.0) 1294 : audit 1 from='client.25589 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64136-10", "tierpool":"test-rados-api-smithi050-64136-10-cache", "force_nonempty":""}]: dispatch 2024-05-20T22:11:55.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:54 smithi050 bash[28929]: audit 2024-05-20T22:11:53.771376+0000 mon.a (mon.0) 1295 : audit 1 from='client.25589 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64136-10", "tierpool":"test-rados-api-smithi050-64136-10-cache", "force_nonempty":""}]': finished 2024-05-20T22:11:55.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:54 smithi050 bash[28929]: audit 2024-05-20T22:11:53.775259+0000 mon.c (mon.2) 145 : audit 1 from='client.? v1:172.21.15.50:0/908802332' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64136-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:55.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:54 smithi050 bash[28929]: cluster 2024-05-20T22:11:53.782875+0000 mon.a (mon.0) 1296 : cluster 0 osdmap e119: 8 total, 8 up, 8 in 2024-05-20T22:11:55.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:54 smithi050 bash[28929]: audit 2024-05-20T22:11:53.787452+0000 mon.c (mon.2) 146 : audit 1 from='client.? v1:172.21.15.50:0/330593440' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi050-63944-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:55.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:54 smithi050 bash[28929]: audit 2024-05-20T22:11:53.791541+0000 mon.a (mon.0) 1297 : audit 1 from='client.25589 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64136-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:55.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:54 smithi050 bash[28929]: audit 2024-05-20T22:11:53.791792+0000 mon.a (mon.0) 1298 : audit 1 from='client.25613 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi050-63944-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:55.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:54 smithi050 bash[28929]: audit 2024-05-20T22:11:54.115027+0000 mon.b (mon.1) 122 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:55.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:54 smithi050 bash[28929]: audit 2024-05-20T22:11:54.280696+0000 mon.a (mon.0) 1299 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:11:56.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:55 smithi145 bash[23893]: cluster 2024-05-20T22:11:54.001757+0000 mgr.y (mgr.14592) 227 : cluster 0 pgmap v190: 676 pgs: 192 unknown, 484 active+clean; 217 MiB data, 993 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:11:56.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:55 smithi145 bash[23893]: audit 2024-05-20T22:11:54.776228+0000 mon.a (mon.0) 1300 : audit 1 from='client.25589 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64136-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:56.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:55 smithi145 bash[23893]: audit 2024-05-20T22:11:54.776409+0000 mon.a (mon.0) 1301 : audit 1 from='client.25613 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi050-63944-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:56.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:55 smithi145 bash[23893]: audit 2024-05-20T22:11:54.776614+0000 mon.a (mon.0) 1302 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-11", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:11:56.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:55 smithi145 bash[23893]: cluster 2024-05-20T22:11:54.784357+0000 mon.a (mon.0) 1303 : cluster 0 osdmap e120: 8 total, 8 up, 8 in 2024-05-20T22:11:56.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:55 smithi145 bash[23893]: audit 2024-05-20T22:11:54.786656+0000 mon.a (mon.0) 1304 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-11"}]: dispatch 2024-05-20T22:11:56.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:55 smithi145 bash[23893]: audit 2024-05-20T22:11:54.794252+0000 mon.c (mon.2) 147 : audit 1 from='client.? v1:172.21.15.50:0/908802332' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64136-10", "tierpool":"test-rados-api-smithi050-64136-10-cache"}]: dispatch 2024-05-20T22:11:56.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:55 smithi145 bash[23893]: audit 2024-05-20T22:11:54.794485+0000 mon.c (mon.2) 148 : audit 1 from='client.? v1:172.21.15.50:0/3868363764' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi050-63936-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:56.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:55 smithi145 bash[23893]: audit 2024-05-20T22:11:54.807028+0000 mon.a (mon.0) 1305 : audit 1 from='client.25589 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64136-10", "tierpool":"test-rados-api-smithi050-64136-10-cache"}]: dispatch 2024-05-20T22:11:56.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:55 smithi145 bash[23893]: audit 2024-05-20T22:11:54.807338+0000 mon.a (mon.0) 1306 : audit 1 from='client.25631 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi050-63936-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:56.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:55 smithi145 bash[23893]: audit 2024-05-20T22:11:55.116611+0000 mon.b (mon.1) 123 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:56.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:55 smithi050 bash[28929]: cluster 2024-05-20T22:11:54.001757+0000 mgr.y (mgr.14592) 227 : cluster 0 pgmap v190: 676 pgs: 192 unknown, 484 active+clean; 217 MiB data, 993 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:11:56.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:55 smithi050 bash[28929]: audit 2024-05-20T22:11:54.776228+0000 mon.a (mon.0) 1300 : audit 1 from='client.25589 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64136-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:55 smithi050 bash[28929]: audit 2024-05-20T22:11:54.776409+0000 mon.a (mon.0) 1301 : audit 1 from='client.25613 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi050-63944-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:55 smithi050 bash[28929]: audit 2024-05-20T22:11:54.776614+0000 mon.a (mon.0) 1302 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-11", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:11:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:55 smithi050 bash[28929]: cluster 2024-05-20T22:11:54.784357+0000 mon.a (mon.0) 1303 : cluster 0 osdmap e120: 8 total, 8 up, 8 in 2024-05-20T22:11:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:55 smithi050 bash[28929]: audit 2024-05-20T22:11:54.786656+0000 mon.a (mon.0) 1304 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-11"}]: dispatch 2024-05-20T22:11:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:55 smithi050 bash[28929]: audit 2024-05-20T22:11:54.794252+0000 mon.c (mon.2) 147 : audit 1 from='client.? v1:172.21.15.50:0/908802332' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64136-10", "tierpool":"test-rados-api-smithi050-64136-10-cache"}]: dispatch 2024-05-20T22:11:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:55 smithi050 bash[28929]: audit 2024-05-20T22:11:54.794485+0000 mon.c (mon.2) 148 : audit 1 from='client.? v1:172.21.15.50:0/3868363764' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi050-63936-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:55 smithi050 bash[28929]: audit 2024-05-20T22:11:54.807028+0000 mon.a (mon.0) 1305 : audit 1 from='client.25589 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64136-10", "tierpool":"test-rados-api-smithi050-64136-10-cache"}]: dispatch 2024-05-20T22:11:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:55 smithi050 bash[28929]: audit 2024-05-20T22:11:54.807338+0000 mon.a (mon.0) 1306 : audit 1 from='client.25631 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi050-63936-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:55 smithi050 bash[28929]: audit 2024-05-20T22:11:55.116611+0000 mon.b (mon.1) 123 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:56.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:55 smithi050 bash[21866]: cluster 2024-05-20T22:11:54.001757+0000 mgr.y (mgr.14592) 227 : cluster 0 pgmap v190: 676 pgs: 192 unknown, 484 active+clean; 217 MiB data, 993 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:11:56.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:55 smithi050 bash[21866]: audit 2024-05-20T22:11:54.776228+0000 mon.a (mon.0) 1300 : audit 1 from='client.25589 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64136-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:56.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:55 smithi050 bash[21866]: audit 2024-05-20T22:11:54.776409+0000 mon.a (mon.0) 1301 : audit 1 from='client.25613 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi050-63944-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:56.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:55 smithi050 bash[21866]: audit 2024-05-20T22:11:54.776614+0000 mon.a (mon.0) 1302 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-11", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:11:56.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:55 smithi050 bash[21866]: cluster 2024-05-20T22:11:54.784357+0000 mon.a (mon.0) 1303 : cluster 0 osdmap e120: 8 total, 8 up, 8 in 2024-05-20T22:11:56.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:55 smithi050 bash[21866]: audit 2024-05-20T22:11:54.786656+0000 mon.a (mon.0) 1304 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-11"}]: dispatch 2024-05-20T22:11:56.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:55 smithi050 bash[21866]: audit 2024-05-20T22:11:54.794252+0000 mon.c (mon.2) 147 : audit 1 from='client.? v1:172.21.15.50:0/908802332' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64136-10", "tierpool":"test-rados-api-smithi050-64136-10-cache"}]: dispatch 2024-05-20T22:11:56.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:55 smithi050 bash[21866]: audit 2024-05-20T22:11:54.794485+0000 mon.c (mon.2) 148 : audit 1 from='client.? v1:172.21.15.50:0/3868363764' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi050-63936-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:56.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:55 smithi050 bash[21866]: audit 2024-05-20T22:11:54.807028+0000 mon.a (mon.0) 1305 : audit 1 from='client.25589 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64136-10", "tierpool":"test-rados-api-smithi050-64136-10-cache"}]: dispatch 2024-05-20T22:11:56.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:55 smithi050 bash[21866]: audit 2024-05-20T22:11:54.807338+0000 mon.a (mon.0) 1306 : audit 1 from='client.25631 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi050-63936-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:56.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:55 smithi050 bash[21866]: audit 2024-05-20T22:11:55.116611+0000 mon.b (mon.1) 123 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:57.047 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2024-05-20T22:11:57.047 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] Global test environment set-up. 2024-05-20T22:11:57.047 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2024-05-20T22:11:57.047 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2024-05-20T22:11:57.047 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2024-05-20T22:11:57.047 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-05-20T22:11:57.047 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2024-05-20T22:11:57.047 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2024-05-20T22:11:57.048 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-05-20T22:11:57.048 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2024-05-20T22:11:57.048 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2024-05-20T22:10:46.847+0000 7fca2f798880 -1 failed for service _ceph-mon._tcp 2024-05-20T22:11:57.048 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2024-05-20T22:10:46.847+0000 7fca2f798880 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-05-20T22:11:57.048 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (47 ms) 2024-05-20T22:11:57.048 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-05-20T22:11:57.048 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2020 ms) 2024-05-20T22:11:57.048 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (2067 ms total) 2024-05-20T22:11:57.048 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2024-05-20T22:11:57.048 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2024-05-20T22:11:57.048 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2024-05-20T22:11:57.048 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408510300 2024-05-20T22:11:57.048 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408850ed0 2024-05-20T22:11:57.049 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088554d0 2024-05-20T22:11:57.049 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408855ad0 2024-05-20T22:11:57.049 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408856130 2024-05-20T22:11:57.049 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408856750 2024-05-20T22:11:57.049 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408856640 2024-05-20T22:11:57.049 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408856c60 2024-05-20T22:11:57.049 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088576d0 2024-05-20T22:11:57.049 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408857160 2024-05-20T22:11:57.049 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408857270 2024-05-20T22:11:57.049 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408857380 2024-05-20T22:11:57.049 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088574f0 2024-05-20T22:11:57.049 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408857cf0 2024-05-20T22:11:57.049 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408857840 2024-05-20T22:11:57.049 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408856d70 2024-05-20T22:11:57.050 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408856ea0 2024-05-20T22:11:57.050 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408856fb0 2024-05-20T22:11:57.050 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088582b0 2024-05-20T22:11:57.050 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408857e00 2024-05-20T22:11:57.050 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408857950 2024-05-20T22:11:57.050 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740912f370 2024-05-20T22:11:57.050 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408857a80 2024-05-20T22:11:57.050 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408857b90 2024-05-20T22:11:57.050 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088583c0 2024-05-20T22:11:57.050 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088584d0 2024-05-20T22:11:57.050 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408858a90 2024-05-20T22:11:57.050 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408858630 2024-05-20T22:11:57.050 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408858780 2024-05-20T22:11:57.051 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408858890 2024-05-20T22:11:57.051 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408858ba0 2024-05-20T22:11:57.051 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408859050 2024-05-20T22:11:57.051 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408858cb0 2024-05-20T22:11:57.051 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408858dc0 2024-05-20T22:11:57.051 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408858ef0 2024-05-20T22:11:57.051 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408859610 2024-05-20T22:11:57.051 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408859160 2024-05-20T22:11:57.051 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408857f10 2024-05-20T22:11:57.051 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408858040 2024-05-20T22:11:57.051 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408858150 2024-05-20T22:11:57.051 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408859bd0 2024-05-20T22:11:57.051 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408859720 2024-05-20T22:11:57.051 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408859850 2024-05-20T22:11:57.052 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408859980 2024-05-20T22:11:57.052 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408859ab0 2024-05-20T22:11:57.052 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885a190 2024-05-20T22:11:57.052 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408859ce0 2024-05-20T22:11:57.052 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408859270 2024-05-20T22:11:57.052 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088593c0 2024-05-20T22:11:57.052 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088594d0 2024-05-20T22:11:57.052 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885a7d0 2024-05-20T22:11:57.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started misc: Running main() from gmock_main.cc 2024-05-20T22:11:57.227 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [==========] Running 12 tests from 1 test suite. 2024-05-20T22:11:57.228 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [----------] Global test environment set-up. 2024-05-20T22:11:57.228 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [----------] 12 tests from NeoRadosMisc 2024-05-20T22:11:57.228 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ RUN ] NeoRadosMisc.Version 2024-05-20T22:11:57.228 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ OK ] NeoRadosMisc.Version (17940 ms) 2024-05-20T22:11:57.228 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2024-05-20T22:11:57.228 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (5759 ms) 2024-05-20T22:11:57.228 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2024-05-20T22:11:57.228 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ OK ] NeoRadosMisc.LongName (7140 ms) 2024-05-20T22:11:57.228 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2024-05-20T22:11:57.229 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (8076 ms) 2024-05-20T22:11:57.229 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2024-05-20T22:11:57.229 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (4822 ms) 2024-05-20T22:11:57.229 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2024-05-20T22:11:57.229 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (4873 ms) 2024-05-20T22:11:57.229 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2024-05-20T22:11:57.229 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ OK ] NeoRadosMisc.Exec (3508 ms) 2024-05-20T22:11:57.229 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2024-05-20T22:11:57.229 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (5330 ms) 2024-05-20T22:11:57.229 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2024-05-20T22:11:57.229 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (3428 ms) 2024-05-20T22:11:57.230 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2024-05-20T22:11:57.230 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ OK ] NeoRadosMisc.BigObject (3421 ms) 2024-05-20T22:11:57.230 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2024-05-20T22:11:57.230 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (2394 ms) 2024-05-20T22:11:57.230 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2024-05-20T22:11:57.230 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (3440 ms) 2024-05-20T22:11:57.230 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [----------] 12 tests from NeoRadosMisc (70131 ms total) 2024-05-20T22:11:57.230 INFO:tasks.workunit.client.0.smithi050.stdout: misc: 2024-05-20T22:11:57.230 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [----------] Global test environment tear-down 2024-05-20T22:11:57.230 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [==========] 12 tests from 1 test suite ran. (70131 ms total) 2024-05-20T22:11:57.231 INFO:tasks.workunit.client.0.smithi050.stdout: misc: [ PASSED ] 12 tests. 2024-05-20T22:11:57.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:57 smithi145 bash[23893]: audit 2024-05-20T22:11:55.779754+0000 mon.a (mon.0) 1307 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-11"}]': finished 2024-05-20T22:11:57.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:57 smithi145 bash[23893]: audit 2024-05-20T22:11:55.779937+0000 mon.a (mon.0) 1308 : audit 1 from='client.25589 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64136-10", "tierpool":"test-rados-api-smithi050-64136-10-cache"}]': finished 2024-05-20T22:11:57.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:57 smithi145 bash[23893]: audit 2024-05-20T22:11:55.780163+0000 mon.a (mon.0) 1309 : audit 1 from='client.25631 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi050-63936-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:57.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:57 smithi145 bash[23893]: cluster 2024-05-20T22:11:55.789087+0000 mon.a (mon.0) 1310 : cluster 0 osdmap e121: 8 total, 8 up, 8 in 2024-05-20T22:11:57.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:57 smithi145 bash[23893]: audit 2024-05-20T22:11:55.792035+0000 mon.a (mon.0) 1311 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-11", "mode": "writeback"}]: dispatch 2024-05-20T22:11:57.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:57 smithi145 bash[23893]: cluster 2024-05-20T22:11:56.002901+0000 mgr.y (mgr.14592) 228 : cluster 0 pgmap v193: 644 pgs: 64 creating+peering, 580 active+clean; 218 MiB data, 1003 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 258 KiB/s wr, 3 op/s 2024-05-20T22:11:57.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:57 smithi145 bash[23893]: audit 2024-05-20T22:11:56.118431+0000 mon.b (mon.1) 124 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:57.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:57 smithi050 bash[21866]: audit 2024-05-20T22:11:55.779754+0000 mon.a (mon.0) 1307 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-11"}]': finished 2024-05-20T22:11:57.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:57 smithi050 bash[21866]: audit 2024-05-20T22:11:55.779937+0000 mon.a (mon.0) 1308 : audit 1 from='client.25589 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64136-10", "tierpool":"test-rados-api-smithi050-64136-10-cache"}]': finished 2024-05-20T22:11:57.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:57 smithi050 bash[21866]: audit 2024-05-20T22:11:55.780163+0000 mon.a (mon.0) 1309 : audit 1 from='client.25631 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi050-63936-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:57.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:57 smithi050 bash[21866]: cluster 2024-05-20T22:11:55.789087+0000 mon.a (mon.0) 1310 : cluster 0 osdmap e121: 8 total, 8 up, 8 in 2024-05-20T22:11:57.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:57 smithi050 bash[21866]: audit 2024-05-20T22:11:55.792035+0000 mon.a (mon.0) 1311 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-11", "mode": "writeback"}]: dispatch 2024-05-20T22:11:57.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:57 smithi050 bash[21866]: cluster 2024-05-20T22:11:56.002901+0000 mgr.y (mgr.14592) 228 : cluster 0 pgmap v193: 644 pgs: 64 creating+peering, 580 active+clean; 218 MiB data, 1003 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 258 KiB/s wr, 3 op/s 2024-05-20T22:11:57.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:57 smithi050 bash[21866]: audit 2024-05-20T22:11:56.118431+0000 mon.b (mon.1) 124 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:57.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:57 smithi050 bash[28929]: audit 2024-05-20T22:11:55.779754+0000 mon.a (mon.0) 1307 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-11"}]': finished 2024-05-20T22:11:57.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:57 smithi050 bash[28929]: audit 2024-05-20T22:11:55.779937+0000 mon.a (mon.0) 1308 : audit 1 from='client.25589 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64136-10", "tierpool":"test-rados-api-smithi050-64136-10-cache"}]': finished 2024-05-20T22:11:57.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:57 smithi050 bash[28929]: audit 2024-05-20T22:11:55.780163+0000 mon.a (mon.0) 1309 : audit 1 from='client.25631 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi050-63936-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:57.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:57 smithi050 bash[28929]: cluster 2024-05-20T22:11:55.789087+0000 mon.a (mon.0) 1310 : cluster 0 osdmap e121: 8 total, 8 up, 8 in 2024-05-20T22:11:57.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:57 smithi050 bash[28929]: audit 2024-05-20T22:11:55.792035+0000 mon.a (mon.0) 1311 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-11", "mode": "writeback"}]: dispatch 2024-05-20T22:11:57.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:57 smithi050 bash[28929]: cluster 2024-05-20T22:11:56.002901+0000 mgr.y (mgr.14592) 228 : cluster 0 pgmap v193: 644 pgs: 64 creating+peering, 580 active+clean; 218 MiB data, 1003 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 258 KiB/s wr, 3 op/s 2024-05-20T22:11:57.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:57 smithi050 bash[28929]: audit 2024-05-20T22:11:56.118431+0000 mon.b (mon.1) 124 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:57.751 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: Running main() from gmock_main.cc 2024-05-20T22:11:57.751 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2024-05-20T22:11:57.751 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [----------] Global test environment set-up. 2024-05-20T22:11:57.752 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [----------] 9 tests from LibRadosPools 2024-05-20T22:11:57.752 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2024-05-20T22:11:57.752 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolList (18759 ms) 2024-05-20T22:11:57.752 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2024-05-20T22:11:57.752 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (8033 ms) 2024-05-20T22:11:57.752 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2024-05-20T22:11:57.752 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (4297 ms) 2024-05-20T22:11:57.752 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-05-20T22:11:57.752 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (6192 ms) 2024-05-20T22:11:57.752 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-05-20T22:11:57.752 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3947 ms) 2024-05-20T22:11:57.752 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2024-05-20T22:11:57.752 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (9114 ms) 2024-05-20T22:11:57.753 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2024-05-20T22:11:57.753 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (6379 ms) 2024-05-20T22:11:57.753 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-05-20T22:11:57.753 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5440 ms) 2024-05-20T22:11:57.753 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2024-05-20T22:11:57.753 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (8777 ms) 2024-05-20T22:11:57.753 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [----------] 9 tests from LibRadosPools (70939 ms total) 2024-05-20T22:11:57.753 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: 2024-05-20T22:11:57.753 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [----------] Global test environment tear-down 2024-05-20T22:11:57.753 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (70941 ms total) 2024-05-20T22:11:57.753 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ PASSED ] 9 tests. 2024-05-20T22:11:58.140 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:11:57 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:11:58.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:58 smithi145 bash[23893]: audit 2024-05-20T22:11:57.120087+0000 mon.b (mon.1) 125 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:58.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:58 smithi145 bash[23893]: cluster 2024-05-20T22:11:57.195141+0000 mon.a (mon.0) 1312 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:11:58.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:58 smithi145 bash[23893]: audit 2024-05-20T22:11:57.205551+0000 mon.a (mon.0) 1313 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-11", "mode": "writeback"}]': finished 2024-05-20T22:11:58.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:58 smithi145 bash[23893]: cluster 2024-05-20T22:11:57.217844+0000 mon.a (mon.0) 1314 : cluster 0 osdmap e122: 8 total, 8 up, 8 in 2024-05-20T22:11:58.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:58 smithi145 bash[23893]: audit 2024-05-20T22:11:57.248112+0000 mon.c (mon.2) 149 : audit 1 from='client.? v1:172.21.15.50:0/674415607' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi050-63944-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:58.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:58 smithi145 bash[23893]: audit 2024-05-20T22:11:57.248639+0000 mon.a (mon.0) 1315 : audit 1 from='client.25643 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi050-63944-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:58.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:58 smithi145 bash[23893]: audit 2024-05-20T22:11:57.274289+0000 mon.a (mon.0) 1316 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi050-64146-10"}]: dispatch 2024-05-20T22:11:58.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:58 smithi145 bash[23893]: cluster 2024-05-20T22:11:57.733714+0000 mon.a (mon.0) 1317 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:58.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:58 smithi145 bash[23893]: audit 2024-05-20T22:11:57.738342+0000 mon.a (mon.0) 1318 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi050-64146-10"}]: dispatch 2024-05-20T22:11:58.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:58 smithi145 bash[23893]: audit 2024-05-20T22:11:57.739417+0000 mon.a (mon.0) 1319 : audit 1 from='client.25643 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi050-63944-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:58.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:58 smithi145 bash[23893]: cluster 2024-05-20T22:11:57.750839+0000 mon.a (mon.0) 1320 : cluster 0 osdmap e123: 8 total, 8 up, 8 in 2024-05-20T22:11:58.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:58 smithi145 bash[23893]: audit 2024-05-20T22:11:57.757489+0000 mon.a (mon.0) 1321 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi050-64146-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:58.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:58 smithi145 bash[23893]: audit 2024-05-20T22:11:57.758729+0000 mon.a (mon.0) 1322 : audit 1 from='client.? v1:172.21.15.50:0/3614562753' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi050-63936-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:58.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:58 smithi145 bash[23893]: audit 2024-05-20T22:11:58.121748+0000 mon.b (mon.1) 126 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:58.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:58 smithi050 bash[21866]: audit 2024-05-20T22:11:57.120087+0000 mon.b (mon.1) 125 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:58.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:58 smithi050 bash[21866]: cluster 2024-05-20T22:11:57.195141+0000 mon.a (mon.0) 1312 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:11:58.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:58 smithi050 bash[21866]: audit 2024-05-20T22:11:57.205551+0000 mon.a (mon.0) 1313 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-11", "mode": "writeback"}]': finished 2024-05-20T22:11:58.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:58 smithi050 bash[21866]: cluster 2024-05-20T22:11:57.217844+0000 mon.a (mon.0) 1314 : cluster 0 osdmap e122: 8 total, 8 up, 8 in 2024-05-20T22:11:58.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:58 smithi050 bash[21866]: audit 2024-05-20T22:11:57.248112+0000 mon.c (mon.2) 149 : audit 1 from='client.? v1:172.21.15.50:0/674415607' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi050-63944-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:58.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:58 smithi050 bash[21866]: audit 2024-05-20T22:11:57.248639+0000 mon.a (mon.0) 1315 : audit 1 from='client.25643 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi050-63944-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:58.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:58 smithi050 bash[21866]: audit 2024-05-20T22:11:57.274289+0000 mon.a (mon.0) 1316 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi050-64146-10"}]: dispatch 2024-05-20T22:11:58.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:58 smithi050 bash[21866]: cluster 2024-05-20T22:11:57.733714+0000 mon.a (mon.0) 1317 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:58.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:58 smithi050 bash[21866]: audit 2024-05-20T22:11:57.738342+0000 mon.a (mon.0) 1318 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi050-64146-10"}]: dispatch 2024-05-20T22:11:58.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:58 smithi050 bash[21866]: audit 2024-05-20T22:11:57.739417+0000 mon.a (mon.0) 1319 : audit 1 from='client.25643 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi050-63944-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:58.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:58 smithi050 bash[21866]: cluster 2024-05-20T22:11:57.750839+0000 mon.a (mon.0) 1320 : cluster 0 osdmap e123: 8 total, 8 up, 8 in 2024-05-20T22:11:58.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:58 smithi050 bash[21866]: audit 2024-05-20T22:11:57.757489+0000 mon.a (mon.0) 1321 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi050-64146-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:58.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:58 smithi050 bash[21866]: audit 2024-05-20T22:11:57.758729+0000 mon.a (mon.0) 1322 : audit 1 from='client.? v1:172.21.15.50:0/3614562753' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi050-63936-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:58.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:58 smithi050 bash[21866]: audit 2024-05-20T22:11:58.121748+0000 mon.b (mon.1) 126 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:58.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:58 smithi050 bash[28929]: audit 2024-05-20T22:11:57.120087+0000 mon.b (mon.1) 125 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:58.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:58 smithi050 bash[28929]: cluster 2024-05-20T22:11:57.195141+0000 mon.a (mon.0) 1312 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:11:58.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:58 smithi050 bash[28929]: audit 2024-05-20T22:11:57.205551+0000 mon.a (mon.0) 1313 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-11", "mode": "writeback"}]': finished 2024-05-20T22:11:58.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:58 smithi050 bash[28929]: cluster 2024-05-20T22:11:57.217844+0000 mon.a (mon.0) 1314 : cluster 0 osdmap e122: 8 total, 8 up, 8 in 2024-05-20T22:11:58.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:58 smithi050 bash[28929]: audit 2024-05-20T22:11:57.248112+0000 mon.c (mon.2) 149 : audit 1 from='client.? v1:172.21.15.50:0/674415607' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi050-63944-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:58.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:58 smithi050 bash[28929]: audit 2024-05-20T22:11:57.248639+0000 mon.a (mon.0) 1315 : audit 1 from='client.25643 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi050-63944-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:58.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:58 smithi050 bash[28929]: audit 2024-05-20T22:11:57.274289+0000 mon.a (mon.0) 1316 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi050-64146-10"}]: dispatch 2024-05-20T22:11:58.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:58 smithi050 bash[28929]: cluster 2024-05-20T22:11:57.733714+0000 mon.a (mon.0) 1317 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:11:58.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:58 smithi050 bash[28929]: audit 2024-05-20T22:11:57.738342+0000 mon.a (mon.0) 1318 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi050-64146-10"}]: dispatch 2024-05-20T22:11:58.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:58 smithi050 bash[28929]: audit 2024-05-20T22:11:57.739417+0000 mon.a (mon.0) 1319 : audit 1 from='client.25643 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi050-63944-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:58.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:58 smithi050 bash[28929]: cluster 2024-05-20T22:11:57.750839+0000 mon.a (mon.0) 1320 : cluster 0 osdmap e123: 8 total, 8 up, 8 in 2024-05-20T22:11:58.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:58 smithi050 bash[28929]: audit 2024-05-20T22:11:57.757489+0000 mon.a (mon.0) 1321 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi050-64146-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:11:58.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:58 smithi050 bash[28929]: audit 2024-05-20T22:11:57.758729+0000 mon.a (mon.0) 1322 : audit 1 from='client.? v1:172.21.15.50:0/3614562753' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi050-63936-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:11:58.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:58 smithi050 bash[28929]: audit 2024-05-20T22:11:58.121748+0000 mon.b (mon.1) 126 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:11:59.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:59 smithi145 bash[23893]: audit 2024-05-20T22:11:57.695595+0000 mgr.y (mgr.14592) 229 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:59.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:59 smithi145 bash[23893]: cluster 2024-05-20T22:11:58.004050+0000 mgr.y (mgr.14592) 230 : cluster 0 pgmap v196: 612 pgs: 128 unknown, 484 active+clean; 218 MiB data, 1003 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 256 KiB/s wr, 1 op/s 2024-05-20T22:11:59.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:59 smithi145 bash[23893]: audit 2024-05-20T22:11:58.748990+0000 mon.a (mon.0) 1323 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi050-64146-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:59.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:59 smithi145 bash[23893]: audit 2024-05-20T22:11:58.749135+0000 mon.a (mon.0) 1324 : audit 1 from='client.? v1:172.21.15.50:0/3614562753' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi050-63936-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:59.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:59 smithi145 bash[23893]: cluster 2024-05-20T22:11:58.757515+0000 mon.a (mon.0) 1325 : cluster 0 osdmap e124: 8 total, 8 up, 8 in 2024-05-20T22:11:59.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:11:59 smithi145 bash[23893]: audit 2024-05-20T22:11:58.759980+0000 mon.a (mon.0) 1326 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi050-64146-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi050-64146-10"}]: dispatch 2024-05-20T22:11:59.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:11:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:11:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:11:59.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:59 smithi050 bash[21866]: audit 2024-05-20T22:11:57.695595+0000 mgr.y (mgr.14592) 229 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:59.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:59 smithi050 bash[21866]: cluster 2024-05-20T22:11:58.004050+0000 mgr.y (mgr.14592) 230 : cluster 0 pgmap v196: 612 pgs: 128 unknown, 484 active+clean; 218 MiB data, 1003 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 256 KiB/s wr, 1 op/s 2024-05-20T22:11:59.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:59 smithi050 bash[21866]: audit 2024-05-20T22:11:58.748990+0000 mon.a (mon.0) 1323 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi050-64146-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:59.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:59 smithi050 bash[21866]: audit 2024-05-20T22:11:58.749135+0000 mon.a (mon.0) 1324 : audit 1 from='client.? v1:172.21.15.50:0/3614562753' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi050-63936-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:59.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:59 smithi050 bash[21866]: cluster 2024-05-20T22:11:58.757515+0000 mon.a (mon.0) 1325 : cluster 0 osdmap e124: 8 total, 8 up, 8 in 2024-05-20T22:11:59.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:11:59 smithi050 bash[21866]: audit 2024-05-20T22:11:58.759980+0000 mon.a (mon.0) 1326 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi050-64146-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi050-64146-10"}]: dispatch 2024-05-20T22:11:59.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:59 smithi050 bash[28929]: audit 2024-05-20T22:11:57.695595+0000 mgr.y (mgr.14592) 229 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:11:59.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:59 smithi050 bash[28929]: cluster 2024-05-20T22:11:58.004050+0000 mgr.y (mgr.14592) 230 : cluster 0 pgmap v196: 612 pgs: 128 unknown, 484 active+clean; 218 MiB data, 1003 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 256 KiB/s wr, 1 op/s 2024-05-20T22:11:59.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:59 smithi050 bash[28929]: audit 2024-05-20T22:11:58.748990+0000 mon.a (mon.0) 1323 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi050-64146-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:11:59.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:59 smithi050 bash[28929]: audit 2024-05-20T22:11:58.749135+0000 mon.a (mon.0) 1324 : audit 1 from='client.? v1:172.21.15.50:0/3614562753' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi050-63936-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:11:59.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:59 smithi050 bash[28929]: cluster 2024-05-20T22:11:58.757515+0000 mon.a (mon.0) 1325 : cluster 0 osdmap e124: 8 total, 8 up, 8 in 2024-05-20T22:11:59.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:11:59 smithi050 bash[28929]: audit 2024-05-20T22:11:58.759980+0000 mon.a (mon.0) 1326 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi050-64146-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi050-64146-10"}]: dispatch 2024-05-20T22:12:00.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:00 smithi050 bash[21866]: audit 2024-05-20T22:11:59.123342+0000 mon.b (mon.1) 127 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:00.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:00 smithi050 bash[21866]: audit 2024-05-20T22:11:59.279368+0000 mon.a (mon.0) 1327 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:12:00.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:00 smithi050 bash[21866]: audit 2024-05-20T22:12:00.124924+0000 mon.b (mon.1) 128 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:00.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:00 smithi050 bash[21866]: audit 2024-05-20T22:12:00.193317+0000 mon.a (mon.0) 1328 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:12:00.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:00 smithi050 bash[28929]: audit 2024-05-20T22:11:59.123342+0000 mon.b (mon.1) 127 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:00.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:00 smithi050 bash[28929]: audit 2024-05-20T22:11:59.279368+0000 mon.a (mon.0) 1327 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:12:00.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:00 smithi050 bash[28929]: audit 2024-05-20T22:12:00.124924+0000 mon.b (mon.1) 128 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:00.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:00 smithi050 bash[28929]: audit 2024-05-20T22:12:00.193317+0000 mon.a (mon.0) 1328 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:12:01.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:00 smithi145 bash[23893]: audit 2024-05-20T22:11:59.123342+0000 mon.b (mon.1) 127 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:01.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:00 smithi145 bash[23893]: audit 2024-05-20T22:11:59.279368+0000 mon.a (mon.0) 1327 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:12:01.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:00 smithi145 bash[23893]: audit 2024-05-20T22:12:00.124924+0000 mon.b (mon.1) 128 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:01.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:00 smithi145 bash[23893]: audit 2024-05-20T22:12:00.193317+0000 mon.a (mon.0) 1328 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:12:01.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:01 smithi050 bash[28929]: cluster 2024-05-20T22:12:00.008032+0000 mgr.y (mgr.14592) 231 : cluster 0 pgmap v198: 516 pgs: 516 active+clean; 217 MiB data, 1013 MiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 3 op/s 2024-05-20T22:12:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:01 smithi050 bash[28929]: cluster 2024-05-20T22:12:00.654258+0000 mon.a (mon.0) 1329 : cluster 0 osdmap e125: 8 total, 8 up, 8 in 2024-05-20T22:12:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:01 smithi050 bash[28929]: audit 2024-05-20T22:12:00.655940+0000 mon.c (mon.2) 150 : audit 1 from='client.? v1:172.21.15.50:0/2400385894' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi050-63944-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:01 smithi050 bash[28929]: audit 2024-05-20T22:12:00.656213+0000 mon.a (mon.0) 1330 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-11"}]: dispatch 2024-05-20T22:12:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:01 smithi050 bash[28929]: audit 2024-05-20T22:12:00.664578+0000 mon.a (mon.0) 1331 : audit 1 from='client.25667 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi050-63944-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:01 smithi050 bash[28929]: audit 2024-05-20T22:12:01.126437+0000 mon.b (mon.1) 129 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:01 smithi050 bash[28929]: audit 2024-05-20T22:12:01.127902+0000 mon.b (mon.1) 130 : audit 1 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pg_num","val":"11"}]: dispatch 2024-05-20T22:12:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:01 smithi050 bash[28929]: audit 2024-05-20T22:12:01.137373+0000 mon.a (mon.0) 1332 : audit 1 from='client.24742 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pg_num","val":"11"}]: dispatch 2024-05-20T22:12:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:01 smithi050 bash[28929]: cluster 2024-05-20T22:12:01.195314+0000 mon.a (mon.0) 1333 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:12:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:01 smithi050 bash[28929]: audit 2024-05-20T22:12:01.198466+0000 mon.a (mon.0) 1334 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi050-64146-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi050-64146-10"}]': finished 2024-05-20T22:12:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:01 smithi050 bash[28929]: audit 2024-05-20T22:12:01.198716+0000 mon.a (mon.0) 1335 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-11"}]': finished 2024-05-20T22:12:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:01 smithi050 bash[28929]: audit 2024-05-20T22:12:01.198910+0000 mon.a (mon.0) 1336 : audit 1 from='client.25667 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi050-63944-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:01 smithi050 bash[28929]: audit 2024-05-20T22:12:01.199141+0000 mon.a (mon.0) 1337 : audit 1 from='client.24742 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pg_num","val":"11"}]': finished 2024-05-20T22:12:01.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:01 smithi050 bash[28929]: audit 2024-05-20T22:12:01.205972+0000 mon.b (mon.1) 131 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:01.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:01 smithi050 bash[28929]: audit 2024-05-20T22:12:01.207646+0000 mon.b (mon.1) 132 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:01.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:01 smithi050 bash[21866]: cluster 2024-05-20T22:12:00.008032+0000 mgr.y (mgr.14592) 231 : cluster 0 pgmap v198: 516 pgs: 516 active+clean; 217 MiB data, 1013 MiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 3 op/s 2024-05-20T22:12:01.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:01 smithi050 bash[21866]: cluster 2024-05-20T22:12:00.654258+0000 mon.a (mon.0) 1329 : cluster 0 osdmap e125: 8 total, 8 up, 8 in 2024-05-20T22:12:01.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:01 smithi050 bash[21866]: audit 2024-05-20T22:12:00.655940+0000 mon.c (mon.2) 150 : audit 1 from='client.? v1:172.21.15.50:0/2400385894' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi050-63944-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:01.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:01 smithi050 bash[21866]: audit 2024-05-20T22:12:00.656213+0000 mon.a (mon.0) 1330 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-11"}]: dispatch 2024-05-20T22:12:01.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:01 smithi050 bash[21866]: audit 2024-05-20T22:12:00.664578+0000 mon.a (mon.0) 1331 : audit 1 from='client.25667 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi050-63944-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:01.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:01 smithi050 bash[21866]: audit 2024-05-20T22:12:01.126437+0000 mon.b (mon.1) 129 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:01 smithi050 bash[21866]: audit 2024-05-20T22:12:01.127902+0000 mon.b (mon.1) 130 : audit 1 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pg_num","val":"11"}]: dispatch 2024-05-20T22:12:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:01 smithi050 bash[21866]: audit 2024-05-20T22:12:01.137373+0000 mon.a (mon.0) 1332 : audit 1 from='client.24742 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pg_num","val":"11"}]: dispatch 2024-05-20T22:12:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:01 smithi050 bash[21866]: cluster 2024-05-20T22:12:01.195314+0000 mon.a (mon.0) 1333 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:12:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:01 smithi050 bash[21866]: audit 2024-05-20T22:12:01.198466+0000 mon.a (mon.0) 1334 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi050-64146-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi050-64146-10"}]': finished 2024-05-20T22:12:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:01 smithi050 bash[21866]: audit 2024-05-20T22:12:01.198716+0000 mon.a (mon.0) 1335 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-11"}]': finished 2024-05-20T22:12:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:01 smithi050 bash[21866]: audit 2024-05-20T22:12:01.198910+0000 mon.a (mon.0) 1336 : audit 1 from='client.25667 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi050-63944-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:01 smithi050 bash[21866]: audit 2024-05-20T22:12:01.199141+0000 mon.a (mon.0) 1337 : audit 1 from='client.24742 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pg_num","val":"11"}]': finished 2024-05-20T22:12:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:01 smithi050 bash[21866]: audit 2024-05-20T22:12:01.205972+0000 mon.b (mon.1) 131 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:01 smithi050 bash[21866]: audit 2024-05-20T22:12:01.207646+0000 mon.b (mon.1) 132 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:01 smithi050 bash[21866]: audit 2024-05-20T22:12:01.209736+0000 mon.b (mon.1) 133 : audit 1 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pgp_num","val":"11"}]: dispatch 2024-05-20T22:12:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:01 smithi050 bash[21866]: cluster 2024-05-20T22:12:01.212656+0000 mon.a (mon.0) 1338 : cluster 0 osdmap e126: 8 total, 8 up, 8 in 2024-05-20T22:12:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:01 smithi050 bash[21866]: audit 2024-05-20T22:12:01.214939+0000 mon.c (mon.2) 151 : audit 1 from='client.? v1:172.21.15.50:0/2590582723' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi050-63936-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:01.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:01 smithi050 bash[21866]: audit 2024-05-20T22:12:01.215116+0000 mon.a (mon.0) 1339 : audit 1 from='client.24742 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pgp_num","val":"11"}]: dispatch 2024-05-20T22:12:01.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:01 smithi050 bash[21866]: audit 2024-05-20T22:12:01.216602+0000 mon.a (mon.0) 1340 : audit 1 from='client.25673 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi050-63936-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:01.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:01 smithi050 bash[28929]: audit 2024-05-20T22:12:01.209736+0000 mon.b (mon.1) 133 : audit 1 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pgp_num","val":"11"}]: dispatch 2024-05-20T22:12:01.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:01 smithi050 bash[28929]: cluster 2024-05-20T22:12:01.212656+0000 mon.a (mon.0) 1338 : cluster 0 osdmap e126: 8 total, 8 up, 8 in 2024-05-20T22:12:01.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:01 smithi050 bash[28929]: audit 2024-05-20T22:12:01.214939+0000 mon.c (mon.2) 151 : audit 1 from='client.? v1:172.21.15.50:0/2590582723' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi050-63936-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:01.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:01 smithi050 bash[28929]: audit 2024-05-20T22:12:01.215116+0000 mon.a (mon.0) 1339 : audit 1 from='client.24742 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pgp_num","val":"11"}]: dispatch 2024-05-20T22:12:01.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:01 smithi050 bash[28929]: audit 2024-05-20T22:12:01.216602+0000 mon.a (mon.0) 1340 : audit 1 from='client.25673 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi050-63936-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:02.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:01 smithi145 bash[23893]: cluster 2024-05-20T22:12:00.008032+0000 mgr.y (mgr.14592) 231 : cluster 0 pgmap v198: 516 pgs: 516 active+clean; 217 MiB data, 1013 MiB used, 714 GiB / 715 GiB avail; 2.4 KiB/s rd, 3 op/s 2024-05-20T22:12:02.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:01 smithi145 bash[23893]: cluster 2024-05-20T22:12:00.654258+0000 mon.a (mon.0) 1329 : cluster 0 osdmap e125: 8 total, 8 up, 8 in 2024-05-20T22:12:02.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:01 smithi145 bash[23893]: audit 2024-05-20T22:12:00.655940+0000 mon.c (mon.2) 150 : audit 1 from='client.? v1:172.21.15.50:0/2400385894' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi050-63944-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:02.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:01 smithi145 bash[23893]: audit 2024-05-20T22:12:00.656213+0000 mon.a (mon.0) 1330 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-11"}]: dispatch 2024-05-20T22:12:02.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:01 smithi145 bash[23893]: audit 2024-05-20T22:12:00.664578+0000 mon.a (mon.0) 1331 : audit 1 from='client.25667 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi050-63944-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:02.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:01 smithi145 bash[23893]: audit 2024-05-20T22:12:01.126437+0000 mon.b (mon.1) 129 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:02.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:01 smithi145 bash[23893]: audit 2024-05-20T22:12:01.127902+0000 mon.b (mon.1) 130 : audit 1 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pg_num","val":"11"}]: dispatch 2024-05-20T22:12:02.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:01 smithi145 bash[23893]: audit 2024-05-20T22:12:01.137373+0000 mon.a (mon.0) 1332 : audit 1 from='client.24742 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pg_num","val":"11"}]: dispatch 2024-05-20T22:12:02.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:01 smithi145 bash[23893]: cluster 2024-05-20T22:12:01.195314+0000 mon.a (mon.0) 1333 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:12:02.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:01 smithi145 bash[23893]: audit 2024-05-20T22:12:01.198466+0000 mon.a (mon.0) 1334 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi050-64146-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi050-64146-10"}]': finished 2024-05-20T22:12:02.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:01 smithi145 bash[23893]: audit 2024-05-20T22:12:01.198716+0000 mon.a (mon.0) 1335 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-11"}]': finished 2024-05-20T22:12:02.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:01 smithi145 bash[23893]: audit 2024-05-20T22:12:01.198910+0000 mon.a (mon.0) 1336 : audit 1 from='client.25667 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi050-63944-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:02.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:01 smithi145 bash[23893]: audit 2024-05-20T22:12:01.199141+0000 mon.a (mon.0) 1337 : audit 1 from='client.24742 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pg_num","val":"11"}]': finished 2024-05-20T22:12:02.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:01 smithi145 bash[23893]: audit 2024-05-20T22:12:01.205972+0000 mon.b (mon.1) 131 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:02.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:01 smithi145 bash[23893]: audit 2024-05-20T22:12:01.207646+0000 mon.b (mon.1) 132 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:02.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:01 smithi145 bash[23893]: audit 2024-05-20T22:12:01.209736+0000 mon.b (mon.1) 133 : audit 1 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pgp_num","val":"11"}]: dispatch 2024-05-20T22:12:02.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:01 smithi145 bash[23893]: cluster 2024-05-20T22:12:01.212656+0000 mon.a (mon.0) 1338 : cluster 0 osdmap e126: 8 total, 8 up, 8 in 2024-05-20T22:12:02.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:01 smithi145 bash[23893]: audit 2024-05-20T22:12:01.214939+0000 mon.c (mon.2) 151 : audit 1 from='client.? v1:172.21.15.50:0/2590582723' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi050-63936-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:02.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:01 smithi145 bash[23893]: audit 2024-05-20T22:12:01.215116+0000 mon.a (mon.0) 1339 : audit 1 from='client.24742 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pgp_num","val":"11"}]: dispatch 2024-05-20T22:12:02.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:01 smithi145 bash[23893]: audit 2024-05-20T22:12:01.216602+0000 mon.a (mon.0) 1340 : audit 1 from='client.25673 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi050-63936-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:03.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:03 smithi145 bash[23893]: cluster 2024-05-20T22:12:02.009294+0000 mgr.y (mgr.14592) 232 : cluster 0 pgmap v201: 620 pgs: 136 unknown, 484 active+clean; 217 MiB data, 1013 MiB used, 714 GiB / 715 GiB avail; 2.8 KiB/s rd, 239 B/s wr, 5 op/s 2024-05-20T22:12:03.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:03 smithi145 bash[23893]: audit 2024-05-20T22:12:02.201664+0000 mon.a (mon.0) 1341 : audit 1 from='client.24742 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pgp_num","val":"11"}]': finished 2024-05-20T22:12:03.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:03 smithi145 bash[23893]: audit 2024-05-20T22:12:02.201817+0000 mon.a (mon.0) 1342 : audit 1 from='client.25673 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi050-63936-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:03.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:03 smithi145 bash[23893]: audit 2024-05-20T22:12:02.209895+0000 mon.b (mon.1) 134 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:03.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:03 smithi145 bash[23893]: cluster 2024-05-20T22:12:02.210722+0000 mon.a (mon.0) 1343 : cluster 0 osdmap e127: 8 total, 8 up, 8 in 2024-05-20T22:12:03.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:03 smithi145 bash[23893]: audit 2024-05-20T22:12:02.381608+0000 mon.b (mon.1) 135 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:03.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:03 smithi145 bash[23893]: audit 2024-05-20T22:12:02.382123+0000 mon.b (mon.1) 136 : audit 1 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pg_num","val":"11"}]: dispatch 2024-05-20T22:12:03.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:03 smithi145 bash[23893]: cluster 2024-05-20T22:12:03.154085+0000 mon.a (mon.0) 1344 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:03.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:03 smithi050 bash[21866]: cluster 2024-05-20T22:12:02.009294+0000 mgr.y (mgr.14592) 232 : cluster 0 pgmap v201: 620 pgs: 136 unknown, 484 active+clean; 217 MiB data, 1013 MiB used, 714 GiB / 715 GiB avail; 2.8 KiB/s rd, 239 B/s wr, 5 op/s 2024-05-20T22:12:03.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:03 smithi050 bash[21866]: audit 2024-05-20T22:12:02.201664+0000 mon.a (mon.0) 1341 : audit 1 from='client.24742 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pgp_num","val":"11"}]': finished 2024-05-20T22:12:03.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:03 smithi050 bash[21866]: audit 2024-05-20T22:12:02.201817+0000 mon.a (mon.0) 1342 : audit 1 from='client.25673 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi050-63936-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:03.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:03 smithi050 bash[21866]: audit 2024-05-20T22:12:02.209895+0000 mon.b (mon.1) 134 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:03.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:03 smithi050 bash[21866]: cluster 2024-05-20T22:12:02.210722+0000 mon.a (mon.0) 1343 : cluster 0 osdmap e127: 8 total, 8 up, 8 in 2024-05-20T22:12:03.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:03 smithi050 bash[21866]: audit 2024-05-20T22:12:02.381608+0000 mon.b (mon.1) 135 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:03.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:03 smithi050 bash[21866]: audit 2024-05-20T22:12:02.382123+0000 mon.b (mon.1) 136 : audit 1 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pg_num","val":"11"}]: dispatch 2024-05-20T22:12:03.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:03 smithi050 bash[21866]: cluster 2024-05-20T22:12:03.154085+0000 mon.a (mon.0) 1344 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:03.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:03 smithi050 bash[28929]: cluster 2024-05-20T22:12:02.009294+0000 mgr.y (mgr.14592) 232 : cluster 0 pgmap v201: 620 pgs: 136 unknown, 484 active+clean; 217 MiB data, 1013 MiB used, 714 GiB / 715 GiB avail; 2.8 KiB/s rd, 239 B/s wr, 5 op/s 2024-05-20T22:12:03.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:03 smithi050 bash[28929]: audit 2024-05-20T22:12:02.201664+0000 mon.a (mon.0) 1341 : audit 1 from='client.24742 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pgp_num","val":"11"}]': finished 2024-05-20T22:12:03.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:03 smithi050 bash[28929]: audit 2024-05-20T22:12:02.201817+0000 mon.a (mon.0) 1342 : audit 1 from='client.25673 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi050-63936-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:03.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:03 smithi050 bash[28929]: audit 2024-05-20T22:12:02.209895+0000 mon.b (mon.1) 134 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:03.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:03 smithi050 bash[28929]: cluster 2024-05-20T22:12:02.210722+0000 mon.a (mon.0) 1343 : cluster 0 osdmap e127: 8 total, 8 up, 8 in 2024-05-20T22:12:03.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:03 smithi050 bash[28929]: audit 2024-05-20T22:12:02.381608+0000 mon.b (mon.1) 135 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:03.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:03 smithi050 bash[28929]: audit 2024-05-20T22:12:02.382123+0000 mon.b (mon.1) 136 : audit 1 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pg_num","val":"11"}]: dispatch 2024-05-20T22:12:03.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:03 smithi050 bash[28929]: cluster 2024-05-20T22:12:03.154085+0000 mon.a (mon.0) 1344 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:04.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:04 smithi050 bash[21866]: cluster 2024-05-20T22:12:03.630754+0000 mon.a (mon.0) 1345 : cluster 0 osdmap e128: 8 total, 8 up, 8 in 2024-05-20T22:12:04.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:04 smithi050 bash[21866]: audit 2024-05-20T22:12:03.650451+0000 mon.a (mon.0) 1346 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:04.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:04 smithi050 bash[21866]: cluster 2024-05-20T22:12:04.010533+0000 mgr.y (mgr.14592) 233 : cluster 0 pgmap v204: 556 pgs: 104 unknown, 452 active+clean; 217 MiB data, 1013 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:12:04.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:04 smithi050 bash[21866]: audit 2024-05-20T22:12:04.110391+0000 mon.a (mon.0) 1347 : audit 1 from='client.24742 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pg_num","val":"11"}]: dispatch 2024-05-20T22:12:04.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:04 smithi050 bash[21866]: audit 2024-05-20T22:12:04.172367+0000 mon.a (mon.0) 1348 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:04.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:04 smithi050 bash[21866]: audit 2024-05-20T22:12:04.172542+0000 mon.a (mon.0) 1349 : audit 1 from='client.24742 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pg_num","val":"11"}]': finished 2024-05-20T22:12:04.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:04 smithi050 bash[21866]: audit 2024-05-20T22:12:04.182558+0000 mon.b (mon.1) 137 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:04.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:04 smithi050 bash[21866]: cluster 2024-05-20T22:12:04.183914+0000 mon.a (mon.0) 1350 : cluster 0 osdmap e129: 8 total, 8 up, 8 in 2024-05-20T22:12:04.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:04 smithi050 bash[21866]: audit 2024-05-20T22:12:04.185361+0000 mon.b (mon.1) 138 : audit 1 from='client.? v1:172.21.15.50:0/766116152' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi050-63944-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:04.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:04 smithi050 bash[21866]: audit 2024-05-20T22:12:04.214211+0000 mon.a (mon.0) 1351 : audit 1 from='client.25612 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi050-63944-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:04.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:04 smithi050 bash[28929]: cluster 2024-05-20T22:12:03.630754+0000 mon.a (mon.0) 1345 : cluster 0 osdmap e128: 8 total, 8 up, 8 in 2024-05-20T22:12:04.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:04 smithi050 bash[28929]: audit 2024-05-20T22:12:03.650451+0000 mon.a (mon.0) 1346 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:04.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:04 smithi050 bash[28929]: cluster 2024-05-20T22:12:04.010533+0000 mgr.y (mgr.14592) 233 : cluster 0 pgmap v204: 556 pgs: 104 unknown, 452 active+clean; 217 MiB data, 1013 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:12:04.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:04 smithi050 bash[28929]: audit 2024-05-20T22:12:04.110391+0000 mon.a (mon.0) 1347 : audit 1 from='client.24742 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pg_num","val":"11"}]: dispatch 2024-05-20T22:12:04.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:04 smithi050 bash[28929]: audit 2024-05-20T22:12:04.172367+0000 mon.a (mon.0) 1348 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:04.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:04 smithi050 bash[28929]: audit 2024-05-20T22:12:04.172542+0000 mon.a (mon.0) 1349 : audit 1 from='client.24742 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pg_num","val":"11"}]': finished 2024-05-20T22:12:04.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:04 smithi050 bash[28929]: audit 2024-05-20T22:12:04.182558+0000 mon.b (mon.1) 137 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:04.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:04 smithi050 bash[28929]: cluster 2024-05-20T22:12:04.183914+0000 mon.a (mon.0) 1350 : cluster 0 osdmap e129: 8 total, 8 up, 8 in 2024-05-20T22:12:04.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:04 smithi050 bash[28929]: audit 2024-05-20T22:12:04.185361+0000 mon.b (mon.1) 138 : audit 1 from='client.? v1:172.21.15.50:0/766116152' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi050-63944-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:04.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:04 smithi050 bash[28929]: audit 2024-05-20T22:12:04.214211+0000 mon.a (mon.0) 1351 : audit 1 from='client.25612 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi050-63944-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:05.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:04 smithi145 bash[23893]: cluster 2024-05-20T22:12:03.630754+0000 mon.a (mon.0) 1345 : cluster 0 osdmap e128: 8 total, 8 up, 8 in 2024-05-20T22:12:05.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:04 smithi145 bash[23893]: audit 2024-05-20T22:12:03.650451+0000 mon.a (mon.0) 1346 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:05.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:04 smithi145 bash[23893]: cluster 2024-05-20T22:12:04.010533+0000 mgr.y (mgr.14592) 233 : cluster 0 pgmap v204: 556 pgs: 104 unknown, 452 active+clean; 217 MiB data, 1013 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:12:05.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:04 smithi145 bash[23893]: audit 2024-05-20T22:12:04.110391+0000 mon.a (mon.0) 1347 : audit 1 from='client.24742 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pg_num","val":"11"}]: dispatch 2024-05-20T22:12:05.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:04 smithi145 bash[23893]: audit 2024-05-20T22:12:04.172367+0000 mon.a (mon.0) 1348 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:05.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:04 smithi145 bash[23893]: audit 2024-05-20T22:12:04.172542+0000 mon.a (mon.0) 1349 : audit 1 from='client.24742 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pg_num","val":"11"}]': finished 2024-05-20T22:12:05.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:04 smithi145 bash[23893]: audit 2024-05-20T22:12:04.182558+0000 mon.b (mon.1) 137 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:05.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:04 smithi145 bash[23893]: cluster 2024-05-20T22:12:04.183914+0000 mon.a (mon.0) 1350 : cluster 0 osdmap e129: 8 total, 8 up, 8 in 2024-05-20T22:12:05.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:04 smithi145 bash[23893]: audit 2024-05-20T22:12:04.185361+0000 mon.b (mon.1) 138 : audit 1 from='client.? v1:172.21.15.50:0/766116152' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi050-63944-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:05.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:04 smithi145 bash[23893]: audit 2024-05-20T22:12:04.214211+0000 mon.a (mon.0) 1351 : audit 1 from='client.25612 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi050-63944-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:06.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:06 smithi050 bash[28929]: audit 2024-05-20T22:12:05.176741+0000 mon.a (mon.0) 1352 : audit 1 from='client.25612 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi050-63944-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:06.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:06 smithi050 bash[28929]: audit 2024-05-20T22:12:05.185100+0000 mon.b (mon.1) 139 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:06.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:06 smithi050 bash[28929]: cluster 2024-05-20T22:12:05.186336+0000 mon.a (mon.0) 1353 : cluster 0 osdmap e130: 8 total, 8 up, 8 in 2024-05-20T22:12:06.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:06 smithi050 bash[28929]: audit 2024-05-20T22:12:05.190089+0000 mon.a (mon.0) 1354 : audit 1 from='client.? v1:172.21.15.50:0/1312057465' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi050-63936-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:06.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:06 smithi050 bash[28929]: audit 2024-05-20T22:12:05.709992+0000 mon.a (mon.0) 1355 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:12:06.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:06 smithi050 bash[21866]: audit 2024-05-20T22:12:05.176741+0000 mon.a (mon.0) 1352 : audit 1 from='client.25612 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi050-63944-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:06.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:06 smithi050 bash[21866]: audit 2024-05-20T22:12:05.185100+0000 mon.b (mon.1) 139 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:06.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:06 smithi050 bash[21866]: cluster 2024-05-20T22:12:05.186336+0000 mon.a (mon.0) 1353 : cluster 0 osdmap e130: 8 total, 8 up, 8 in 2024-05-20T22:12:06.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:06 smithi050 bash[21866]: audit 2024-05-20T22:12:05.190089+0000 mon.a (mon.0) 1354 : audit 1 from='client.? v1:172.21.15.50:0/1312057465' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi050-63936-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:06.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:06 smithi050 bash[21866]: audit 2024-05-20T22:12:05.709992+0000 mon.a (mon.0) 1355 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:12:06.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:06 smithi145 bash[23893]: audit 2024-05-20T22:12:05.176741+0000 mon.a (mon.0) 1352 : audit 1 from='client.25612 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi050-63944-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:06.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:06 smithi145 bash[23893]: audit 2024-05-20T22:12:05.185100+0000 mon.b (mon.1) 139 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:06.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:06 smithi145 bash[23893]: cluster 2024-05-20T22:12:05.186336+0000 mon.a (mon.0) 1353 : cluster 0 osdmap e130: 8 total, 8 up, 8 in 2024-05-20T22:12:06.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:06 smithi145 bash[23893]: audit 2024-05-20T22:12:05.190089+0000 mon.a (mon.0) 1354 : audit 1 from='client.? v1:172.21.15.50:0/1312057465' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi050-63936-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:06.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:06 smithi145 bash[23893]: audit 2024-05-20T22:12:05.709992+0000 mon.a (mon.0) 1355 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:12:07.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:07 smithi145 bash[23893]: cluster 2024-05-20T22:12:06.011930+0000 mgr.y (mgr.14592) 234 : cluster 0 pgmap v207: 588 pgs: 64 creating+peering, 32 unknown, 492 active+clean; 217 MiB data, 1010 MiB used, 714 GiB / 715 GiB avail; 30 KiB/s wr, 33 op/s 2024-05-20T22:12:07.743 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:07 smithi145 bash[23893]: audit 2024-05-20T22:12:06.189152+0000 mon.a (mon.0) 1356 : audit 1 from='client.? v1:172.21.15.50:0/1312057465' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi050-63936-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:07.743 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:07 smithi145 bash[23893]: audit 2024-05-20T22:12:06.196183+0000 mon.b (mon.1) 140 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:07.743 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:07 smithi145 bash[23893]: cluster 2024-05-20T22:12:06.200250+0000 mon.a (mon.0) 1357 : cluster 0 osdmap e131: 8 total, 8 up, 8 in 2024-05-20T22:12:07.744 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:07 smithi050 bash[21866]: cluster 2024-05-20T22:12:06.011930+0000 mgr.y (mgr.14592) 234 : cluster 0 pgmap v207: 588 pgs: 64 creating+peering, 32 unknown, 492 active+clean; 217 MiB data, 1010 MiB used, 714 GiB / 715 GiB avail; 30 KiB/s wr, 33 op/s 2024-05-20T22:12:07.744 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:07 smithi050 bash[21866]: audit 2024-05-20T22:12:06.189152+0000 mon.a (mon.0) 1356 : audit 1 from='client.? v1:172.21.15.50:0/1312057465' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi050-63936-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:07.744 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:07 smithi050 bash[21866]: audit 2024-05-20T22:12:06.196183+0000 mon.b (mon.1) 140 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:07.744 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:07 smithi050 bash[21866]: cluster 2024-05-20T22:12:06.200250+0000 mon.a (mon.0) 1357 : cluster 0 osdmap e131: 8 total, 8 up, 8 in 2024-05-20T22:12:07.745 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:07 smithi050 bash[28929]: cluster 2024-05-20T22:12:06.011930+0000 mgr.y (mgr.14592) 234 : cluster 0 pgmap v207: 588 pgs: 64 creating+peering, 32 unknown, 492 active+clean; 217 MiB data, 1010 MiB used, 714 GiB / 715 GiB avail; 30 KiB/s wr, 33 op/s 2024-05-20T22:12:07.745 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:07 smithi050 bash[28929]: audit 2024-05-20T22:12:06.189152+0000 mon.a (mon.0) 1356 : audit 1 from='client.? v1:172.21.15.50:0/1312057465' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi050-63936-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:07.745 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:07 smithi050 bash[28929]: audit 2024-05-20T22:12:06.196183+0000 mon.b (mon.1) 140 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:07.745 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:07 smithi050 bash[28929]: cluster 2024-05-20T22:12:06.200250+0000 mon.a (mon.0) 1357 : cluster 0 osdmap e131: 8 total, 8 up, 8 in 2024-05-20T22:12:08.140 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:12:07 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:12:08.182 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: Running main() from gmock_main.cc 2024-05-20T22:12:08.183 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [==========] Running 14 tests from 1 test suite. 2024-05-20T22:12:08.183 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [----------] Global test environment set-up. 2024-05-20T22:12:08.183 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps 2024-05-20T22:12:08.183 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2024-05-20T22:12:08.183 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (19421 ms) 2024-05-20T22:12:08.183 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2024-05-20T22:12:08.183 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (10369 ms) 2024-05-20T22:12:08.183 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2024-05-20T22:12:08.183 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (5814 ms) 2024-05-20T22:12:08.183 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2024-05-20T22:12:08.183 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (5319 ms) 2024-05-20T22:12:08.183 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2024-05-20T22:12:08.184 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (7685 ms) 2024-05-20T22:12:08.184 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2024-05-20T22:12:08.184 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (3476 ms) 2024-05-20T22:12:08.184 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2024-05-20T22:12:08.184 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (5361 ms) 2024-05-20T22:12:08.184 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2024-05-20T22:12:08.184 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (4440 ms) 2024-05-20T22:12:08.184 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2024-05-20T22:12:08.184 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (4306 ms) 2024-05-20T22:12:08.184 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2024-05-20T22:12:08.184 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (2521 ms) 2024-05-20T22:12:08.184 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2024-05-20T22:12:08.184 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (2941 ms) 2024-05-20T22:12:08.184 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2024-05-20T22:12:08.185 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (3454 ms) 2024-05-20T22:12:08.185 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2024-05-20T22:12:08.185 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (2974 ms) 2024-05-20T22:12:08.185 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2024-05-20T22:12:08.185 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (2991 ms) 2024-05-20T22:12:08.185 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps (81073 ms total) 2024-05-20T22:12:08.185 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: 2024-05-20T22:12:08.185 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [----------] Global test environment tear-down 2024-05-20T22:12:08.185 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [==========] 14 tests from 1 test suite ran. (81073 ms total) 2024-05-20T22:12:08.185 INFO:tasks.workunit.client.0.smithi050.stdout: read_operations: [ PASSED ] 14 tests. 2024-05-20T22:12:08.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:08 smithi145 bash[23893]: cluster 2024-05-20T22:12:07.197667+0000 mon.a (mon.0) 1358 : cluster 0 osdmap e132: 8 total, 8 up, 8 in 2024-05-20T22:12:08.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:08 smithi145 bash[23893]: audit 2024-05-20T22:12:07.202514+0000 mon.b (mon.1) 141 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:08.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:08 smithi145 bash[23893]: audit 2024-05-20T22:12:07.204730+0000 mon.b (mon.1) 142 : audit 1 from='client.? v1:172.21.15.50:0/1086505514' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi050-63944-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:08 smithi145 bash[23893]: audit 2024-05-20T22:12:07.226741+0000 mon.a (mon.0) 1359 : audit 1 from='client.25630 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi050-63944-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:08 smithi145 bash[23893]: audit 2024-05-20T22:12:08.003780+0000 mon.c (mon.2) 152 : audit 0 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-20T22:12:08.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:08 smithi145 bash[23893]: audit 2024-05-20T22:12:08.012154+0000 mon.c (mon.2) 153 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:08 smithi145 bash[23893]: audit 2024-05-20T22:12:08.012934+0000 mon.a (mon.0) 1360 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:08 smithi145 bash[23893]: cluster 2024-05-20T22:12:08.157170+0000 mon.a (mon.0) 1361 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:08.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:08 smithi145 bash[23893]: audit 2024-05-20T22:12:08.162570+0000 mon.a (mon.0) 1362 : audit 1 from='client.25630 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi050-63944-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:08.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:08 smithi145 bash[23893]: audit 2024-05-20T22:12:08.162780+0000 mon.a (mon.0) 1363 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:08.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:08 smithi145 bash[23893]: cluster 2024-05-20T22:12:08.173923+0000 mon.a (mon.0) 1364 : cluster 0 osdmap e133: 8 total, 8 up, 8 in 2024-05-20T22:12:08.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:08 smithi145 bash[23893]: audit 2024-05-20T22:12:08.179527+0000 mon.c (mon.2) 154 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app2"}]: dispatch 2024-05-20T22:12:08.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:08 smithi145 bash[23893]: audit 2024-05-20T22:12:08.180149+0000 mon.c (mon.2) 155 : audit 1 from='client.? v1:172.21.15.50:0/1904105622' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi050-63936-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:08 smithi145 bash[23893]: audit 2024-05-20T22:12:08.180904+0000 mon.c (mon.2) 156 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:08 smithi145 bash[23893]: audit 2024-05-20T22:12:08.181410+0000 mon.a (mon.0) 1365 : audit 1 from='client.25721 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi050-63936-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:08 smithi145 bash[23893]: audit 2024-05-20T22:12:08.181997+0000 mon.a (mon.0) 1366 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:08 smithi050 bash[21866]: cluster 2024-05-20T22:12:07.197667+0000 mon.a (mon.0) 1358 : cluster 0 osdmap e132: 8 total, 8 up, 8 in 2024-05-20T22:12:08.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:08 smithi050 bash[21866]: audit 2024-05-20T22:12:07.202514+0000 mon.b (mon.1) 141 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:08.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:08 smithi050 bash[21866]: audit 2024-05-20T22:12:07.204730+0000 mon.b (mon.1) 142 : audit 1 from='client.? v1:172.21.15.50:0/1086505514' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi050-63944-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:08 smithi050 bash[21866]: audit 2024-05-20T22:12:07.226741+0000 mon.a (mon.0) 1359 : audit 1 from='client.25630 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi050-63944-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:08 smithi050 bash[21866]: audit 2024-05-20T22:12:08.003780+0000 mon.c (mon.2) 152 : audit 0 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-20T22:12:08.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:08 smithi050 bash[21866]: audit 2024-05-20T22:12:08.012154+0000 mon.c (mon.2) 153 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:08 smithi050 bash[21866]: audit 2024-05-20T22:12:08.012934+0000 mon.a (mon.0) 1360 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:08 smithi050 bash[21866]: cluster 2024-05-20T22:12:08.157170+0000 mon.a (mon.0) 1361 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:08.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:08 smithi050 bash[21866]: audit 2024-05-20T22:12:08.162570+0000 mon.a (mon.0) 1362 : audit 1 from='client.25630 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi050-63944-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:08.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:08 smithi050 bash[21866]: audit 2024-05-20T22:12:08.162780+0000 mon.a (mon.0) 1363 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:08.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:08 smithi050 bash[21866]: cluster 2024-05-20T22:12:08.173923+0000 mon.a (mon.0) 1364 : cluster 0 osdmap e133: 8 total, 8 up, 8 in 2024-05-20T22:12:08.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:08 smithi050 bash[21866]: audit 2024-05-20T22:12:08.179527+0000 mon.c (mon.2) 154 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app2"}]: dispatch 2024-05-20T22:12:08.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:08 smithi050 bash[21866]: audit 2024-05-20T22:12:08.180149+0000 mon.c (mon.2) 155 : audit 1 from='client.? v1:172.21.15.50:0/1904105622' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi050-63936-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:08 smithi050 bash[21866]: audit 2024-05-20T22:12:08.180904+0000 mon.c (mon.2) 156 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:08 smithi050 bash[21866]: audit 2024-05-20T22:12:08.181410+0000 mon.a (mon.0) 1365 : audit 1 from='client.25721 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi050-63936-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:08 smithi050 bash[21866]: audit 2024-05-20T22:12:08.181997+0000 mon.a (mon.0) 1366 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:08 smithi050 bash[28929]: cluster 2024-05-20T22:12:07.197667+0000 mon.a (mon.0) 1358 : cluster 0 osdmap e132: 8 total, 8 up, 8 in 2024-05-20T22:12:08.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:08 smithi050 bash[28929]: audit 2024-05-20T22:12:07.202514+0000 mon.b (mon.1) 141 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:08.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:08 smithi050 bash[28929]: audit 2024-05-20T22:12:07.204730+0000 mon.b (mon.1) 142 : audit 1 from='client.? v1:172.21.15.50:0/1086505514' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi050-63944-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:08 smithi050 bash[28929]: audit 2024-05-20T22:12:07.226741+0000 mon.a (mon.0) 1359 : audit 1 from='client.25630 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi050-63944-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:08 smithi050 bash[28929]: audit 2024-05-20T22:12:08.003780+0000 mon.c (mon.2) 152 : audit 0 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-20T22:12:08.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:08 smithi050 bash[28929]: audit 2024-05-20T22:12:08.012154+0000 mon.c (mon.2) 153 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:08 smithi050 bash[28929]: audit 2024-05-20T22:12:08.012934+0000 mon.a (mon.0) 1360 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:08 smithi050 bash[28929]: cluster 2024-05-20T22:12:08.157170+0000 mon.a (mon.0) 1361 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:08.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:08 smithi050 bash[28929]: audit 2024-05-20T22:12:08.162570+0000 mon.a (mon.0) 1362 : audit 1 from='client.25630 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi050-63944-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:08.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:08 smithi050 bash[28929]: audit 2024-05-20T22:12:08.162780+0000 mon.a (mon.0) 1363 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:08.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:08 smithi050 bash[28929]: cluster 2024-05-20T22:12:08.173923+0000 mon.a (mon.0) 1364 : cluster 0 osdmap e133: 8 total, 8 up, 8 in 2024-05-20T22:12:08.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:08 smithi050 bash[28929]: audit 2024-05-20T22:12:08.179527+0000 mon.c (mon.2) 154 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app2"}]: dispatch 2024-05-20T22:12:08.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:08 smithi050 bash[28929]: audit 2024-05-20T22:12:08.180149+0000 mon.c (mon.2) 155 : audit 1 from='client.? v1:172.21.15.50:0/1904105622' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi050-63936-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:08 smithi050 bash[28929]: audit 2024-05-20T22:12:08.180904+0000 mon.c (mon.2) 156 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:08 smithi050 bash[28929]: audit 2024-05-20T22:12:08.181410+0000 mon.a (mon.0) 1365 : audit 1 from='client.25721 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi050-63936-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:08.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:08 smithi050 bash[28929]: audit 2024-05-20T22:12:08.181997+0000 mon.a (mon.0) 1366 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:09.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:09 smithi145 bash[23893]: audit 2024-05-20T22:12:07.707064+0000 mgr.y (mgr.14592) 235 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:12:09.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:09 smithi145 bash[23893]: cluster 2024-05-20T22:12:08.013161+0000 mgr.y (mgr.14592) 236 : cluster 0 pgmap v210: 588 pgs: 96 unknown, 492 active+clean; 217 MiB data, 1010 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 30 KiB/s wr, 35 op/s 2024-05-20T22:12:09.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:09 smithi145 bash[23893]: audit 2024-05-20T22:12:08.204128+0000 mon.b (mon.1) 143 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:09.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:09 smithi145 bash[23893]: audit 2024-05-20T22:12:08.395357+0000 mon.a (mon.0) 1367 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:12:09.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:09 smithi145 bash[23893]: audit 2024-05-20T22:12:09.165821+0000 mon.a (mon.0) 1368 : audit 1 from='client.25721 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi050-63936-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:09.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:09 smithi145 bash[23893]: audit 2024-05-20T22:12:09.166046+0000 mon.a (mon.0) 1369 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:09.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:09 smithi145 bash[23893]: audit 2024-05-20T22:12:09.166173+0000 mon.a (mon.0) 1370 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-13", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:12:09.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:09 smithi145 bash[23893]: cluster 2024-05-20T22:12:09.174533+0000 mon.a (mon.0) 1371 : cluster 0 osdmap e134: 8 total, 8 up, 8 in 2024-05-20T22:12:09.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:09 smithi145 bash[23893]: audit 2024-05-20T22:12:09.177003+0000 mon.a (mon.0) 1372 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-13"}]: dispatch 2024-05-20T22:12:09.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:09 smithi145 bash[23893]: audit 2024-05-20T22:12:09.190668+0000 mon.c (mon.2) 157 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-05-20T22:12:09.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:09 smithi145 bash[23893]: audit 2024-05-20T22:12:09.191654+0000 mon.c (mon.2) 158 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-05-20T22:12:09.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:09 smithi145 bash[23893]: audit 2024-05-20T22:12:09.192316+0000 mon.a (mon.0) 1373 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-05-20T22:12:09.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:09 smithi145 bash[23893]: audit 2024-05-20T22:12:09.205844+0000 mon.b (mon.1) 144 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:09.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:12:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:12:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:12:09.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:09 smithi050 bash[21866]: audit 2024-05-20T22:12:07.707064+0000 mgr.y (mgr.14592) 235 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:12:09.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:09 smithi050 bash[21866]: cluster 2024-05-20T22:12:08.013161+0000 mgr.y (mgr.14592) 236 : cluster 0 pgmap v210: 588 pgs: 96 unknown, 492 active+clean; 217 MiB data, 1010 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 30 KiB/s wr, 35 op/s 2024-05-20T22:12:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:09 smithi050 bash[21866]: audit 2024-05-20T22:12:08.204128+0000 mon.b (mon.1) 143 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:09 smithi050 bash[21866]: audit 2024-05-20T22:12:08.395357+0000 mon.a (mon.0) 1367 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:12:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:09 smithi050 bash[21866]: audit 2024-05-20T22:12:09.165821+0000 mon.a (mon.0) 1368 : audit 1 from='client.25721 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi050-63936-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:09 smithi050 bash[21866]: audit 2024-05-20T22:12:09.166046+0000 mon.a (mon.0) 1369 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:09 smithi050 bash[21866]: audit 2024-05-20T22:12:09.166173+0000 mon.a (mon.0) 1370 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-13", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:12:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:09 smithi050 bash[21866]: cluster 2024-05-20T22:12:09.174533+0000 mon.a (mon.0) 1371 : cluster 0 osdmap e134: 8 total, 8 up, 8 in 2024-05-20T22:12:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:09 smithi050 bash[21866]: audit 2024-05-20T22:12:09.177003+0000 mon.a (mon.0) 1372 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-13"}]: dispatch 2024-05-20T22:12:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:09 smithi050 bash[21866]: audit 2024-05-20T22:12:09.190668+0000 mon.c (mon.2) 157 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-05-20T22:12:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:09 smithi050 bash[21866]: audit 2024-05-20T22:12:09.191654+0000 mon.c (mon.2) 158 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-05-20T22:12:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:09 smithi050 bash[21866]: audit 2024-05-20T22:12:09.192316+0000 mon.a (mon.0) 1373 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-05-20T22:12:09.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:09 smithi050 bash[21866]: audit 2024-05-20T22:12:09.205844+0000 mon.b (mon.1) 144 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:09.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:09 smithi050 bash[28929]: audit 2024-05-20T22:12:07.707064+0000 mgr.y (mgr.14592) 235 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:12:09.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:09 smithi050 bash[28929]: cluster 2024-05-20T22:12:08.013161+0000 mgr.y (mgr.14592) 236 : cluster 0 pgmap v210: 588 pgs: 96 unknown, 492 active+clean; 217 MiB data, 1010 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 30 KiB/s wr, 35 op/s 2024-05-20T22:12:09.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:09 smithi050 bash[28929]: audit 2024-05-20T22:12:08.204128+0000 mon.b (mon.1) 143 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:09.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:09 smithi050 bash[28929]: audit 2024-05-20T22:12:08.395357+0000 mon.a (mon.0) 1367 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:12:09.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:09 smithi050 bash[28929]: audit 2024-05-20T22:12:09.165821+0000 mon.a (mon.0) 1368 : audit 1 from='client.25721 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi050-63936-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:09.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:09 smithi050 bash[28929]: audit 2024-05-20T22:12:09.166046+0000 mon.a (mon.0) 1369 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi050-64061-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:09.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:09 smithi050 bash[28929]: audit 2024-05-20T22:12:09.166173+0000 mon.a (mon.0) 1370 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-13", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:12:09.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:09 smithi050 bash[28929]: cluster 2024-05-20T22:12:09.174533+0000 mon.a (mon.0) 1371 : cluster 0 osdmap e134: 8 total, 8 up, 8 in 2024-05-20T22:12:09.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:09 smithi050 bash[28929]: audit 2024-05-20T22:12:09.177003+0000 mon.a (mon.0) 1372 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-13"}]: dispatch 2024-05-20T22:12:09.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:09 smithi050 bash[28929]: audit 2024-05-20T22:12:09.190668+0000 mon.c (mon.2) 157 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-05-20T22:12:09.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:09 smithi050 bash[28929]: audit 2024-05-20T22:12:09.191654+0000 mon.c (mon.2) 158 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-05-20T22:12:09.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:09 smithi050 bash[28929]: audit 2024-05-20T22:12:09.192316+0000 mon.a (mon.0) 1373 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-05-20T22:12:09.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:09 smithi050 bash[28929]: audit 2024-05-20T22:12:09.205844+0000 mon.b (mon.1) 144 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:10.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:10 smithi145 bash[23893]: audit 2024-05-20T22:12:10.118100+0000 mon.a (mon.0) 1374 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi050-63976-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-05-20T22:12:10.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:10 smithi145 bash[23893]: audit 2024-05-20T22:12:10.169997+0000 mon.a (mon.0) 1375 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-13"}]': finished 2024-05-20T22:12:10.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:10 smithi145 bash[23893]: audit 2024-05-20T22:12:10.170217+0000 mon.a (mon.0) 1376 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-05-20T22:12:10.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:10 smithi145 bash[23893]: audit 2024-05-20T22:12:10.170370+0000 mon.a (mon.0) 1377 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi050-63976-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-05-20T22:12:10.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:10 smithi145 bash[23893]: cluster 2024-05-20T22:12:10.179619+0000 mon.a (mon.0) 1378 : cluster 0 osdmap e135: 8 total, 8 up, 8 in 2024-05-20T22:12:10.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:10 smithi145 bash[23893]: audit 2024-05-20T22:12:10.181550+0000 mon.a (mon.0) 1379 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-13", "mode": "writeback"}]: dispatch 2024-05-20T22:12:10.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:10 smithi145 bash[23893]: audit 2024-05-20T22:12:10.181981+0000 mon.c (mon.2) 159 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-05-20T22:12:10.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:10 smithi145 bash[23893]: audit 2024-05-20T22:12:10.182914+0000 mon.a (mon.0) 1380 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-05-20T22:12:10.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:10 smithi145 bash[23893]: audit 2024-05-20T22:12:10.190651+0000 mon.b (mon.1) 145 : audit 1 from='client.? v1:172.21.15.50:0/2285543344' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi050-63944-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:10.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:10 smithi145 bash[23893]: audit 2024-05-20T22:12:10.194400+0000 mon.a (mon.0) 1381 : audit 1 from='client.25639 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi050-63944-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:10.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:10 smithi145 bash[23893]: audit 2024-05-20T22:12:10.207338+0000 mon.b (mon.1) 146 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:10.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:10 smithi050 bash[21866]: audit 2024-05-20T22:12:10.118100+0000 mon.a (mon.0) 1374 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi050-63976-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-05-20T22:12:10.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:10 smithi050 bash[21866]: audit 2024-05-20T22:12:10.169997+0000 mon.a (mon.0) 1375 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-13"}]': finished 2024-05-20T22:12:10.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:10 smithi050 bash[21866]: audit 2024-05-20T22:12:10.170217+0000 mon.a (mon.0) 1376 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-05-20T22:12:10.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:10 smithi050 bash[21866]: audit 2024-05-20T22:12:10.170370+0000 mon.a (mon.0) 1377 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi050-63976-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-05-20T22:12:10.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:10 smithi050 bash[21866]: cluster 2024-05-20T22:12:10.179619+0000 mon.a (mon.0) 1378 : cluster 0 osdmap e135: 8 total, 8 up, 8 in 2024-05-20T22:12:10.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:10 smithi050 bash[21866]: audit 2024-05-20T22:12:10.181550+0000 mon.a (mon.0) 1379 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-13", "mode": "writeback"}]: dispatch 2024-05-20T22:12:10.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:10 smithi050 bash[21866]: audit 2024-05-20T22:12:10.181981+0000 mon.c (mon.2) 159 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-05-20T22:12:10.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:10 smithi050 bash[21866]: audit 2024-05-20T22:12:10.182914+0000 mon.a (mon.0) 1380 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-05-20T22:12:10.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:10 smithi050 bash[21866]: audit 2024-05-20T22:12:10.190651+0000 mon.b (mon.1) 145 : audit 1 from='client.? v1:172.21.15.50:0/2285543344' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi050-63944-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:10.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:10 smithi050 bash[21866]: audit 2024-05-20T22:12:10.194400+0000 mon.a (mon.0) 1381 : audit 1 from='client.25639 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi050-63944-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:10.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:10 smithi050 bash[21866]: audit 2024-05-20T22:12:10.207338+0000 mon.b (mon.1) 146 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:10.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:10 smithi050 bash[28929]: audit 2024-05-20T22:12:10.118100+0000 mon.a (mon.0) 1374 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi050-63976-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-05-20T22:12:10.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:10 smithi050 bash[28929]: audit 2024-05-20T22:12:10.169997+0000 mon.a (mon.0) 1375 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-13"}]': finished 2024-05-20T22:12:10.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:10 smithi050 bash[28929]: audit 2024-05-20T22:12:10.170217+0000 mon.a (mon.0) 1376 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-05-20T22:12:10.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:10 smithi050 bash[28929]: audit 2024-05-20T22:12:10.170370+0000 mon.a (mon.0) 1377 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi050-63976-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-05-20T22:12:10.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:10 smithi050 bash[28929]: cluster 2024-05-20T22:12:10.179619+0000 mon.a (mon.0) 1378 : cluster 0 osdmap e135: 8 total, 8 up, 8 in 2024-05-20T22:12:10.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:10 smithi050 bash[28929]: audit 2024-05-20T22:12:10.181550+0000 mon.a (mon.0) 1379 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-13", "mode": "writeback"}]: dispatch 2024-05-20T22:12:10.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:10 smithi050 bash[28929]: audit 2024-05-20T22:12:10.181981+0000 mon.c (mon.2) 159 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-05-20T22:12:10.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:10 smithi050 bash[28929]: audit 2024-05-20T22:12:10.182914+0000 mon.a (mon.0) 1380 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-05-20T22:12:10.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:10 smithi050 bash[28929]: audit 2024-05-20T22:12:10.190651+0000 mon.b (mon.1) 145 : audit 1 from='client.? v1:172.21.15.50:0/2285543344' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi050-63944-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:10.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:10 smithi050 bash[28929]: audit 2024-05-20T22:12:10.194400+0000 mon.a (mon.0) 1381 : audit 1 from='client.25639 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi050-63944-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:10.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:10 smithi050 bash[28929]: audit 2024-05-20T22:12:10.207338+0000 mon.b (mon.1) 146 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:11.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:11 smithi145 bash[23893]: cluster 2024-05-20T22:12:10.017209+0000 mgr.y (mgr.14592) 237 : cluster 0 pgmap v213: 524 pgs: 524 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 102 KiB/s wr, 103 op/s 2024-05-20T22:12:11.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:11 smithi145 bash[23893]: cluster 2024-05-20T22:12:11.171644+0000 mon.a (mon.0) 1382 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:12:11.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:11 smithi145 bash[23893]: audit 2024-05-20T22:12:11.174845+0000 mon.a (mon.0) 1383 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-13", "mode": "writeback"}]': finished 2024-05-20T22:12:11.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:11 smithi145 bash[23893]: audit 2024-05-20T22:12:11.175027+0000 mon.a (mon.0) 1384 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-05-20T22:12:11.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:11 smithi145 bash[23893]: audit 2024-05-20T22:12:11.175163+0000 mon.a (mon.0) 1385 : audit 1 from='client.25639 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi050-63944-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:11.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:11 smithi145 bash[23893]: cluster 2024-05-20T22:12:11.188925+0000 mon.a (mon.0) 1386 : cluster 0 osdmap e136: 8 total, 8 up, 8 in 2024-05-20T22:12:11.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:11 smithi145 bash[23893]: audit 2024-05-20T22:12:11.198381+0000 mon.c (mon.2) 160 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key1"}]: dispatch 2024-05-20T22:12:11.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:11 smithi145 bash[23893]: audit 2024-05-20T22:12:11.201069+0000 mon.a (mon.0) 1387 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key1"}]: dispatch 2024-05-20T22:12:11.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:11 smithi145 bash[23893]: audit 2024-05-20T22:12:11.202305+0000 mon.c (mon.2) 161 : audit 1 from='client.? v1:172.21.15.50:0/307408134' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi050-63936-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:11.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:11 smithi145 bash[23893]: audit 2024-05-20T22:12:11.204700+0000 mon.a (mon.0) 1388 : audit 1 from='client.25733 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi050-63936-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:11.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:11 smithi145 bash[23893]: audit 2024-05-20T22:12:11.215486+0000 mon.b (mon.1) 147 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:11.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:11 smithi145 bash[23893]: audit 2024-05-20T22:12:11.217530+0000 mon.b (mon.1) 148 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:11.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:11 smithi145 bash[23893]: audit 2024-05-20T22:12:11.219193+0000 mon.b (mon.1) 149 : audit 1 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pgp_num","val":"11"}]: dispatch 2024-05-20T22:12:11.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:11 smithi145 bash[23893]: audit 2024-05-20T22:12:11.222021+0000 mon.a (mon.0) 1389 : audit 1 from='client.24742 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pgp_num","val":"11"}]: dispatch 2024-05-20T22:12:11.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:11 smithi050 bash[21866]: cluster 2024-05-20T22:12:10.017209+0000 mgr.y (mgr.14592) 237 : cluster 0 pgmap v213: 524 pgs: 524 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 102 KiB/s wr, 103 op/s 2024-05-20T22:12:11.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:11 smithi050 bash[21866]: cluster 2024-05-20T22:12:11.171644+0000 mon.a (mon.0) 1382 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:12:11.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:11 smithi050 bash[21866]: audit 2024-05-20T22:12:11.174845+0000 mon.a (mon.0) 1383 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-13", "mode": "writeback"}]': finished 2024-05-20T22:12:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:11 smithi050 bash[21866]: audit 2024-05-20T22:12:11.175027+0000 mon.a (mon.0) 1384 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-05-20T22:12:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:11 smithi050 bash[21866]: audit 2024-05-20T22:12:11.175163+0000 mon.a (mon.0) 1385 : audit 1 from='client.25639 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi050-63944-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:11 smithi050 bash[21866]: cluster 2024-05-20T22:12:11.188925+0000 mon.a (mon.0) 1386 : cluster 0 osdmap e136: 8 total, 8 up, 8 in 2024-05-20T22:12:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:11 smithi050 bash[21866]: audit 2024-05-20T22:12:11.198381+0000 mon.c (mon.2) 160 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key1"}]: dispatch 2024-05-20T22:12:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:11 smithi050 bash[21866]: audit 2024-05-20T22:12:11.201069+0000 mon.a (mon.0) 1387 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key1"}]: dispatch 2024-05-20T22:12:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:11 smithi050 bash[21866]: audit 2024-05-20T22:12:11.202305+0000 mon.c (mon.2) 161 : audit 1 from='client.? v1:172.21.15.50:0/307408134' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi050-63936-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:11 smithi050 bash[21866]: audit 2024-05-20T22:12:11.204700+0000 mon.a (mon.0) 1388 : audit 1 from='client.25733 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi050-63936-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:11 smithi050 bash[21866]: audit 2024-05-20T22:12:11.215486+0000 mon.b (mon.1) 147 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:11 smithi050 bash[21866]: audit 2024-05-20T22:12:11.217530+0000 mon.b (mon.1) 148 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:11 smithi050 bash[21866]: audit 2024-05-20T22:12:11.219193+0000 mon.b (mon.1) 149 : audit 1 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pgp_num","val":"11"}]: dispatch 2024-05-20T22:12:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:11 smithi050 bash[21866]: audit 2024-05-20T22:12:11.222021+0000 mon.a (mon.0) 1389 : audit 1 from='client.24742 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pgp_num","val":"11"}]: dispatch 2024-05-20T22:12:11.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:11 smithi050 bash[28929]: cluster 2024-05-20T22:12:10.017209+0000 mgr.y (mgr.14592) 237 : cluster 0 pgmap v213: 524 pgs: 524 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 102 KiB/s wr, 103 op/s 2024-05-20T22:12:11.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:11 smithi050 bash[28929]: cluster 2024-05-20T22:12:11.171644+0000 mon.a (mon.0) 1382 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:12:11.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:11 smithi050 bash[28929]: audit 2024-05-20T22:12:11.174845+0000 mon.a (mon.0) 1383 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-13", "mode": "writeback"}]': finished 2024-05-20T22:12:11.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:11 smithi050 bash[28929]: audit 2024-05-20T22:12:11.175027+0000 mon.a (mon.0) 1384 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-05-20T22:12:11.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:11 smithi050 bash[28929]: audit 2024-05-20T22:12:11.175163+0000 mon.a (mon.0) 1385 : audit 1 from='client.25639 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi050-63944-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:11.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:11 smithi050 bash[28929]: cluster 2024-05-20T22:12:11.188925+0000 mon.a (mon.0) 1386 : cluster 0 osdmap e136: 8 total, 8 up, 8 in 2024-05-20T22:12:11.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:11 smithi050 bash[28929]: audit 2024-05-20T22:12:11.198381+0000 mon.c (mon.2) 160 : audit 1 from='client.? v1:172.21.15.50:0/131694991' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key1"}]: dispatch 2024-05-20T22:12:11.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:11 smithi050 bash[28929]: audit 2024-05-20T22:12:11.201069+0000 mon.a (mon.0) 1387 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key1"}]: dispatch 2024-05-20T22:12:11.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:11 smithi050 bash[28929]: audit 2024-05-20T22:12:11.202305+0000 mon.c (mon.2) 161 : audit 1 from='client.? v1:172.21.15.50:0/307408134' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi050-63936-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:11.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:11 smithi050 bash[28929]: audit 2024-05-20T22:12:11.204700+0000 mon.a (mon.0) 1388 : audit 1 from='client.25733 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi050-63936-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:11.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:11 smithi050 bash[28929]: audit 2024-05-20T22:12:11.215486+0000 mon.b (mon.1) 147 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:11.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:11 smithi050 bash[28929]: audit 2024-05-20T22:12:11.217530+0000 mon.b (mon.1) 148 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:11.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:11 smithi050 bash[28929]: audit 2024-05-20T22:12:11.219193+0000 mon.b (mon.1) 149 : audit 1 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pgp_num","val":"11"}]: dispatch 2024-05-20T22:12:11.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:11 smithi050 bash[28929]: audit 2024-05-20T22:12:11.222021+0000 mon.a (mon.0) 1389 : audit 1 from='client.24742 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pgp_num","val":"11"}]: dispatch 2024-05-20T22:12:12.202 INFO:tasks.workunit.client.0.smithi050.stdout: io: Running main() from gmock_main.cc 2024-05-20T22:12:12.202 INFO:tasks.workunit.client.0.smithi050.stdout: io: [==========] Running 14 tests from 1 test suite. 2024-05-20T22:12:12.202 INFO:tasks.workunit.client.0.smithi050.stdout: io: [----------] Global test environment set-up. 2024-05-20T22:12:12.202 INFO:tasks.workunit.client.0.smithi050.stdout: io: [----------] 14 tests from NeoRadosIo 2024-05-20T22:12:12.202 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ RUN ] NeoRadosIo.Limits 2024-05-20T22:12:12.202 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ OK ] NeoRadosIo.Limits (23747 ms) 2024-05-20T22:12:12.202 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2024-05-20T22:12:12.203 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (11908 ms) 2024-05-20T22:12:12.203 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2024-05-20T22:12:12.203 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ OK ] NeoRadosIo.ReadOp (5323 ms) 2024-05-20T22:12:12.203 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2024-05-20T22:12:12.203 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ OK ] NeoRadosIo.SparseRead (7678 ms) 2024-05-20T22:12:12.203 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2024-05-20T22:12:12.203 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ OK ] NeoRadosIo.RoundTrip (3475 ms) 2024-05-20T22:12:12.203 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-05-20T22:12:12.203 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (5358 ms) 2024-05-20T22:12:12.203 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-05-20T22:12:12.203 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (3431 ms) 2024-05-20T22:12:12.203 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-05-20T22:12:12.203 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (3462 ms) 2024-05-20T22:12:12.203 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2024-05-20T22:12:12.203 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (4358 ms) 2024-05-20T22:12:12.204 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ RUN ] NeoRadosIo.Trunc 2024-05-20T22:12:12.204 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ OK ] NeoRadosIo.Trunc (3006 ms) 2024-05-20T22:12:12.204 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ RUN ] NeoRadosIo.Remove 2024-05-20T22:12:12.204 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ OK ] NeoRadosIo.Remove (3424 ms) 2024-05-20T22:12:12.204 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2024-05-20T22:12:12.204 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (3982 ms) 2024-05-20T22:12:12.204 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2024-05-20T22:12:12.204 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ OK ] NeoRadosIo.RmXattr (2972 ms) 2024-05-20T22:12:12.204 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2024-05-20T22:12:12.204 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ OK ] NeoRadosIo.GetXattrs (3022 ms) 2024-05-20T22:12:12.204 INFO:tasks.workunit.client.0.smithi050.stdout: io: [----------] 14 tests from NeoRadosIo (85146 ms total) 2024-05-20T22:12:12.204 INFO:tasks.workunit.client.0.smithi050.stdout: io: 2024-05-20T22:12:12.204 INFO:tasks.workunit.client.0.smithi050.stdout: io: [----------] Global test environment tear-down 2024-05-20T22:12:12.204 INFO:tasks.workunit.client.0.smithi050.stdout: io: [==========] 14 tests from 1 test suite ran. (85146 ms total) 2024-05-20T22:12:12.205 INFO:tasks.workunit.client.0.smithi050.stdout: io: [ PASSED ] 14 tests. 2024-05-20T22:12:13.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2024-05-20T22:12:13.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [----------] Global test environment set-up. 2024-05-20T22:12:13.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2024-05-20T22:12:13.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2024-05-20T22:12:13.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-05-20T22:12:13.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-05-20T22:12:13.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: 2024-05-20T22:12:13.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2024-05-20T22:12:13.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: seed 64061 2024-05-20T22:12:13.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-05-20T22:12:13.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (0 ms) 2024-05-20T22:12:13.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2024-05-20T22:12:13.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (370 ms) 2024-05-20T22:12:13.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2024-05-20T22:12:13.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (21 ms) 2024-05-20T22:12:13.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2024-05-20T22:12:13.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (10 ms) 2024-05-20T22:12:13.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-05-20T22:12:13.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (16 ms) 2024-05-20T22:12:13.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2024-05-20T22:12:13.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (2 ms) 2024-05-20T22:12:13.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2024-05-20T22:12:13.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (3 ms) 2024-05-20T22:12:13.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2024-05-20T22:12:13.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (5 ms) 2024-05-20T22:12:13.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2024-05-20T22:12:13.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (2 ms) 2024-05-20T22:12:13.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2024-05-20T22:12:13.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (13 ms) 2024-05-20T22:12:13.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2024-05-20T22:12:13.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (2 ms) 2024-05-20T22:12:13.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2024-05-20T22:12:13.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (5 ms) 2024-05-20T22:12:13.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2024-05-20T22:12:13.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (9 ms) 2024-05-20T22:12:13.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2024-05-20T22:12:13.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: osd_max_attr_size = 0 2024-05-20T22:12:13.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2024-05-20T22:12:13.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (2354 ms) 2024-05-20T22:12:13.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2024-05-20T22:12:13.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (492 ms) 2024-05-20T22:12:13.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2024-05-20T22:12:13.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: waiting for initial deep scrubs... 2024-05-20T22:12:13.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: done waiting, doing copies 2024-05-20T22:12:13.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: waiting for final deep scrubs... 2024-05-20T22:12:13.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: done waiting 2024-05-20T22:12:13.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (60654 ms) 2024-05-20T22:12:13.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2024-05-20T22:12:13.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (11 ms) 2024-05-20T22:12:13.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2024-05-20T22:12:13.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (6 ms) 2024-05-20T22:12:13.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2024-05-20T22:12:13.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4195 ms) 2024-05-20T22:12:13.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2024-05-20T22:12:13.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-05-20T22:12:13.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2024-05-20T22:12:13.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (1 ms) 2024-05-20T22:12:13.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2024-05-20T22:12:13.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2024-05-20T22:12:13.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:13 smithi145 bash[23893]: cluster 2024-05-20T22:12:12.018443+0000 mgr.y (mgr.14592) 238 : cluster 0 pgmap v216: 588 pgs: 96 unknown, 492 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 102 KiB/s wr, 103 op/s 2024-05-20T22:12:13.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:13 smithi145 bash[23893]: audit 2024-05-20T22:12:12.177897+0000 mon.a (mon.0) 1390 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key1"}]': finished 2024-05-20T22:12:13.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:13 smithi145 bash[23893]: audit 2024-05-20T22:12:12.178034+0000 mon.a (mon.0) 1391 : audit 1 from='client.25733 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi050-63936-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:13.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:13 smithi145 bash[23893]: audit 2024-05-20T22:12:12.178171+0000 mon.a (mon.0) 1392 : audit 1 from='client.24742 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pgp_num","val":"11"}]': finished 2024-05-20T22:12:13.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:13 smithi145 bash[23893]: cluster 2024-05-20T22:12:12.186323+0000 mon.a (mon.0) 1393 : cluster 0 osdmap e137: 8 total, 8 up, 8 in 2024-05-20T22:12:13.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:13 smithi145 bash[23893]: audit 2024-05-20T22:12:12.188254+0000 mon.b (mon.1) 150 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:13.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:13 smithi145 bash[23893]: audit 2024-05-20T22:12:12.211616+0000 mon.a (mon.0) 1394 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi050-64146-10"}]: dispatch 2024-05-20T22:12:13.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:13 smithi145 bash[23893]: audit 2024-05-20T22:12:12.710030+0000 mon.a (mon.0) 1395 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.0"}]: dispatch 2024-05-20T22:12:13.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:13 smithi145 bash[23893]: audit 2024-05-20T22:12:12.711914+0000 mon.a (mon.0) 1396 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.1"}]: dispatch 2024-05-20T22:12:13.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:13 smithi145 bash[23893]: audit 2024-05-20T22:12:12.713050+0000 mon.a (mon.0) 1397 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.2"}]: dispatch 2024-05-20T22:12:13.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:13 smithi145 bash[23893]: audit 2024-05-20T22:12:12.713885+0000 mon.a (mon.0) 1398 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.3"}]: dispatch 2024-05-20T22:12:13.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:13 smithi145 bash[23893]: audit 2024-05-20T22:12:12.714737+0000 mon.a (mon.0) 1399 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.4"}]: dispatch 2024-05-20T22:12:13.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:13 smithi145 bash[23893]: audit 2024-05-20T22:12:12.715601+0000 mon.a (mon.0) 1400 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.5"}]: dispatch 2024-05-20T22:12:13.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:13 smithi145 bash[23893]: audit 2024-05-20T22:12:12.716516+0000 mon.a (mon.0) 1401 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.6"}]: dispatch 2024-05-20T22:12:13.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:13 smithi145 bash[23893]: audit 2024-05-20T22:12:12.717387+0000 mon.a (mon.0) 1402 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.7"}]: dispatch 2024-05-20T22:12:13.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:13 smithi145 bash[23893]: audit 2024-05-20T22:12:12.718248+0000 mon.a (mon.0) 1403 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.8"}]: dispatch 2024-05-20T22:12:13.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:13 smithi145 bash[23893]: audit 2024-05-20T22:12:12.719129+0000 mon.a (mon.0) 1404 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.9"}]: dispatch 2024-05-20T22:12:13.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:13 smithi050 bash[21866]: cluster 2024-05-20T22:12:12.018443+0000 mgr.y (mgr.14592) 238 : cluster 0 pgmap v216: 588 pgs: 96 unknown, 492 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 102 KiB/s wr, 103 op/s 2024-05-20T22:12:13.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:13 smithi050 bash[21866]: audit 2024-05-20T22:12:12.177897+0000 mon.a (mon.0) 1390 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key1"}]': finished 2024-05-20T22:12:13.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:13 smithi050 bash[21866]: audit 2024-05-20T22:12:12.178034+0000 mon.a (mon.0) 1391 : audit 1 from='client.25733 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi050-63936-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:13.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:13 smithi050 bash[21866]: audit 2024-05-20T22:12:12.178171+0000 mon.a (mon.0) 1392 : audit 1 from='client.24742 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pgp_num","val":"11"}]': finished 2024-05-20T22:12:13.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:13 smithi050 bash[21866]: cluster 2024-05-20T22:12:12.186323+0000 mon.a (mon.0) 1393 : cluster 0 osdmap e137: 8 total, 8 up, 8 in 2024-05-20T22:12:13.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:13 smithi050 bash[21866]: audit 2024-05-20T22:12:12.188254+0000 mon.b (mon.1) 150 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:13.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:13 smithi050 bash[21866]: audit 2024-05-20T22:12:12.211616+0000 mon.a (mon.0) 1394 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi050-64146-10"}]: dispatch 2024-05-20T22:12:13.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:13 smithi050 bash[21866]: audit 2024-05-20T22:12:12.710030+0000 mon.a (mon.0) 1395 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.0"}]: dispatch 2024-05-20T22:12:13.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:13 smithi050 bash[21866]: audit 2024-05-20T22:12:12.711914+0000 mon.a (mon.0) 1396 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.1"}]: dispatch 2024-05-20T22:12:13.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:13 smithi050 bash[21866]: audit 2024-05-20T22:12:12.713050+0000 mon.a (mon.0) 1397 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.2"}]: dispatch 2024-05-20T22:12:13.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:13 smithi050 bash[21866]: audit 2024-05-20T22:12:12.713885+0000 mon.a (mon.0) 1398 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.3"}]: dispatch 2024-05-20T22:12:13.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:13 smithi050 bash[21866]: audit 2024-05-20T22:12:12.714737+0000 mon.a (mon.0) 1399 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.4"}]: dispatch 2024-05-20T22:12:13.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:13 smithi050 bash[21866]: audit 2024-05-20T22:12:12.715601+0000 mon.a (mon.0) 1400 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.5"}]: dispatch 2024-05-20T22:12:13.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:13 smithi050 bash[21866]: audit 2024-05-20T22:12:12.716516+0000 mon.a (mon.0) 1401 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.6"}]: dispatch 2024-05-20T22:12:13.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:13 smithi050 bash[21866]: audit 2024-05-20T22:12:12.717387+0000 mon.a (mon.0) 1402 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.7"}]: dispatch 2024-05-20T22:12:13.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:13 smithi050 bash[21866]: audit 2024-05-20T22:12:12.718248+0000 mon.a (mon.0) 1403 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.8"}]: dispatch 2024-05-20T22:12:13.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:13 smithi050 bash[21866]: audit 2024-05-20T22:12:12.719129+0000 mon.a (mon.0) 1404 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.9"}]: dispatch 2024-05-20T22:12:13.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:13 smithi050 bash[28929]: cluster 2024-05-20T22:12:12.018443+0000 mgr.y (mgr.14592) 238 : cluster 0 pgmap v216: 588 pgs: 96 unknown, 492 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 102 KiB/s wr, 103 op/s 2024-05-20T22:12:13.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:13 smithi050 bash[28929]: audit 2024-05-20T22:12:12.177897+0000 mon.a (mon.0) 1390 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi050-64061-1","app":"app1","key":"key1"}]': finished 2024-05-20T22:12:13.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:13 smithi050 bash[28929]: audit 2024-05-20T22:12:12.178034+0000 mon.a (mon.0) 1391 : audit 1 from='client.25733 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi050-63936-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:13.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:13 smithi050 bash[28929]: audit 2024-05-20T22:12:12.178171+0000 mon.a (mon.0) 1392 : audit 1 from='client.24742 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi050-63976-1","var":"pgp_num","val":"11"}]': finished 2024-05-20T22:12:13.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:13 smithi050 bash[28929]: cluster 2024-05-20T22:12:12.186323+0000 mon.a (mon.0) 1393 : cluster 0 osdmap e137: 8 total, 8 up, 8 in 2024-05-20T22:12:13.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:13 smithi050 bash[28929]: audit 2024-05-20T22:12:12.188254+0000 mon.b (mon.1) 150 : audit 0 from='client.? v1:172.21.15.50:0/2038504831' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-05-20T22:12:13.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:13 smithi050 bash[28929]: audit 2024-05-20T22:12:12.211616+0000 mon.a (mon.0) 1394 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi050-64146-10"}]: dispatch 2024-05-20T22:12:13.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:13 smithi050 bash[28929]: audit 2024-05-20T22:12:12.710030+0000 mon.a (mon.0) 1395 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.0"}]: dispatch 2024-05-20T22:12:13.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:13 smithi050 bash[28929]: audit 2024-05-20T22:12:12.711914+0000 mon.a (mon.0) 1396 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.1"}]: dispatch 2024-05-20T22:12:13.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:13 smithi050 bash[28929]: audit 2024-05-20T22:12:12.713050+0000 mon.a (mon.0) 1397 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.2"}]: dispatch 2024-05-20T22:12:13.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:13 smithi050 bash[28929]: audit 2024-05-20T22:12:12.713885+0000 mon.a (mon.0) 1398 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.3"}]: dispatch 2024-05-20T22:12:13.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:13 smithi050 bash[28929]: audit 2024-05-20T22:12:12.714737+0000 mon.a (mon.0) 1399 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.4"}]: dispatch 2024-05-20T22:12:13.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:13 smithi050 bash[28929]: audit 2024-05-20T22:12:12.715601+0000 mon.a (mon.0) 1400 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.5"}]: dispatch 2024-05-20T22:12:13.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:13 smithi050 bash[28929]: audit 2024-05-20T22:12:12.716516+0000 mon.a (mon.0) 1401 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.6"}]: dispatch 2024-05-20T22:12:13.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:13 smithi050 bash[28929]: audit 2024-05-20T22:12:12.717387+0000 mon.a (mon.0) 1402 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.7"}]: dispatch 2024-05-20T22:12:13.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:13 smithi050 bash[28929]: audit 2024-05-20T22:12:12.718248+0000 mon.a (mon.0) 1403 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.8"}]: dispatch 2024-05-20T22:12:13.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:13 smithi050 bash[28929]: audit 2024-05-20T22:12:12.719129+0000 mon.a (mon.0) 1404 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "151.9"}]: dispatch 2024-05-20T22:12:14.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:12.710326+0000 mgr.y (mgr.14592) 239 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.0"}]: dispatch 2024-05-20T22:12:14.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:12.712110+0000 mgr.y (mgr.14592) 240 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.1"}]: dispatch 2024-05-20T22:12:14.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:12.713213+0000 mgr.y (mgr.14592) 241 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.2"}]: dispatch 2024-05-20T22:12:14.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:12.714053+0000 mgr.y (mgr.14592) 242 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.3"}]: dispatch 2024-05-20T22:12:14.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:12.714930+0000 mgr.y (mgr.14592) 243 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.4"}]: dispatch 2024-05-20T22:12:14.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:12.715783+0000 mgr.y (mgr.14592) 244 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.5"}]: dispatch 2024-05-20T22:12:14.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:12.716733+0000 mgr.y (mgr.14592) 245 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.6"}]: dispatch 2024-05-20T22:12:14.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:12.717576+0000 mgr.y (mgr.14592) 246 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.7"}]: dispatch 2024-05-20T22:12:14.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:12.718419+0000 mgr.y (mgr.14592) 247 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.8"}]: dispatch 2024-05-20T22:12:14.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:12.719365+0000 mgr.y (mgr.14592) 248 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.9"}]: dispatch 2024-05-20T22:12:14.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: cluster 2024-05-20T22:12:12.813977+0000 osd.2 (osd.2) 7 : cluster 0 151.5 scrub starts 2024-05-20T22:12:14.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: cluster 2024-05-20T22:12:12.821486+0000 osd.2 (osd.2) 8 : cluster 0 151.5 scrub ok 2024-05-20T22:12:14.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:13.181642+0000 mon.a (mon.0) 1405 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi050-64146-10"}]': finished 2024-05-20T22:12:14.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: cluster 2024-05-20T22:12:13.191942+0000 mon.a (mon.0) 1406 : cluster 0 osdmap e138: 8 total, 8 up, 8 in 2024-05-20T22:12:14.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:13.198328+0000 mon.a (mon.0) 1407 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi050-64146-10"}]: dispatch 2024-05-20T22:12:14.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:13.201492+0000 mon.a (mon.0) 1408 : audit 1 from='client.? v1:172.21.15.50:0/3245431153' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi050-63944-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:14.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:13.252345+0000 mon.c (mon.2) 162 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:14.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:13.253618+0000 mon.a (mon.0) 1409 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:14.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:13.255671+0000 mon.c (mon.2) 163 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:14.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:13.256332+0000 mon.a (mon.0) 1410 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:14.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:13.258012+0000 mon.c (mon.2) 164 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64061-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:14.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:13.258732+0000 mon.a (mon.0) 1411 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64061-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:14.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:13.262523+0000 mon.c (mon.2) 165 : audit 1 from='client.? v1:172.21.15.50:0/998072603' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:14.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:13.263114+0000 mon.a (mon.0) 1412 : audit 1 from='client.25751 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:14.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:13.266718+0000 mon.c (mon.2) 166 : audit 1 from='client.? v1:172.21.15.50:0/998072603' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:14.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: cluster 2024-05-20T22:12:13.371334+0000 osd.1 (osd.1) 11 : cluster 0 151.3 scrub starts 2024-05-20T22:12:14.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: cluster 2024-05-20T22:12:13.374161+0000 osd.1 (osd.1) 12 : cluster 0 151.3 scrub ok 2024-05-20T22:12:14.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: cluster 2024-05-20T22:12:13.655986+0000 osd.4 (osd.4) 3 : cluster 0 151.0 deep-scrub starts 2024-05-20T22:12:14.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: cluster 2024-05-20T22:12:13.679498+0000 osd.4 (osd.4) 4 : cluster 0 151.0 deep-scrub ok 2024-05-20T22:12:14.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:13.716888+0000 mon.a (mon.0) 1413 : audit 1 from='client.25751 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:14.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:13.717915+0000 mon.c (mon.2) 167 : audit 1 from='client.? v1:172.21.15.50:0/998072603' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi050-63976-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:14.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:13.718412+0000 mon.a (mon.0) 1414 : audit 1 from='client.25751 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi050-63976-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:14.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:14.186649+0000 mon.a (mon.0) 1415 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi050-64146-10"}]': finished 2024-05-20T22:12:14.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:14.186888+0000 mon.a (mon.0) 1416 : audit 1 from='client.? v1:172.21.15.50:0/3245431153' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi050-63944-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:14.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:14.187112+0000 mon.a (mon.0) 1417 : audit 1 from='client.25748 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64061-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:14.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:14.187337+0000 mon.a (mon.0) 1418 : audit 1 from='client.25751 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi050-63976-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:14.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:14.198268+0000 mon.c (mon.2) 168 : audit 1 from='client.? v1:172.21.15.50:0/998072603' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi050-63976-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:14.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:14.198734+0000 mon.c (mon.2) 169 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64061-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:14.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: cluster 2024-05-20T22:12:14.199654+0000 mon.a (mon.0) 1419 : cluster 0 osdmap e139: 8 total, 8 up, 8 in 2024-05-20T22:12:14.645 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:14 smithi145 bash[23893]: audit 2024-05-20T22:12:14.205311+0000 mon.a (mon.0) 1420 : audit 1 from='client.25751 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi050-63976-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:14.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:12.710326+0000 mgr.y (mgr.14592) 239 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.0"}]: dispatch 2024-05-20T22:12:14.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:12.712110+0000 mgr.y (mgr.14592) 240 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.1"}]: dispatch 2024-05-20T22:12:14.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:12.713213+0000 mgr.y (mgr.14592) 241 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.2"}]: dispatch 2024-05-20T22:12:14.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:12.714053+0000 mgr.y (mgr.14592) 242 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.3"}]: dispatch 2024-05-20T22:12:14.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:12.714930+0000 mgr.y (mgr.14592) 243 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.4"}]: dispatch 2024-05-20T22:12:14.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:12.715783+0000 mgr.y (mgr.14592) 244 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.5"}]: dispatch 2024-05-20T22:12:14.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:12.716733+0000 mgr.y (mgr.14592) 245 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.6"}]: dispatch 2024-05-20T22:12:14.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:12.717576+0000 mgr.y (mgr.14592) 246 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.7"}]: dispatch 2024-05-20T22:12:14.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:12.718419+0000 mgr.y (mgr.14592) 247 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.8"}]: dispatch 2024-05-20T22:12:14.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:12.719365+0000 mgr.y (mgr.14592) 248 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.9"}]: dispatch 2024-05-20T22:12:14.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: cluster 2024-05-20T22:12:12.813977+0000 osd.2 (osd.2) 7 : cluster 0 151.5 scrub starts 2024-05-20T22:12:14.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: cluster 2024-05-20T22:12:12.821486+0000 osd.2 (osd.2) 8 : cluster 0 151.5 scrub ok 2024-05-20T22:12:14.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:13.181642+0000 mon.a (mon.0) 1405 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi050-64146-10"}]': finished 2024-05-20T22:12:14.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: cluster 2024-05-20T22:12:13.191942+0000 mon.a (mon.0) 1406 : cluster 0 osdmap e138: 8 total, 8 up, 8 in 2024-05-20T22:12:14.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:13.198328+0000 mon.a (mon.0) 1407 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi050-64146-10"}]: dispatch 2024-05-20T22:12:14.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:13.201492+0000 mon.a (mon.0) 1408 : audit 1 from='client.? v1:172.21.15.50:0/3245431153' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi050-63944-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:14.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:13.252345+0000 mon.c (mon.2) 162 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:14.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:13.253618+0000 mon.a (mon.0) 1409 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:14.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:12.710326+0000 mgr.y (mgr.14592) 239 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.0"}]: dispatch 2024-05-20T22:12:14.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:12.712110+0000 mgr.y (mgr.14592) 240 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.1"}]: dispatch 2024-05-20T22:12:14.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:12.713213+0000 mgr.y (mgr.14592) 241 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.2"}]: dispatch 2024-05-20T22:12:14.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:12.714053+0000 mgr.y (mgr.14592) 242 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.3"}]: dispatch 2024-05-20T22:12:14.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:12.714930+0000 mgr.y (mgr.14592) 243 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.4"}]: dispatch 2024-05-20T22:12:14.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:12.715783+0000 mgr.y (mgr.14592) 244 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.5"}]: dispatch 2024-05-20T22:12:14.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:12.716733+0000 mgr.y (mgr.14592) 245 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.6"}]: dispatch 2024-05-20T22:12:14.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:12.717576+0000 mgr.y (mgr.14592) 246 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.7"}]: dispatch 2024-05-20T22:12:14.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:12.718419+0000 mgr.y (mgr.14592) 247 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.8"}]: dispatch 2024-05-20T22:12:14.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:12.719365+0000 mgr.y (mgr.14592) 248 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "151.9"}]: dispatch 2024-05-20T22:12:14.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: cluster 2024-05-20T22:12:12.813977+0000 osd.2 (osd.2) 7 : cluster 0 151.5 scrub starts 2024-05-20T22:12:14.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: cluster 2024-05-20T22:12:12.821486+0000 osd.2 (osd.2) 8 : cluster 0 151.5 scrub ok 2024-05-20T22:12:14.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:13.181642+0000 mon.a (mon.0) 1405 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi050-64146-10"}]': finished 2024-05-20T22:12:14.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: cluster 2024-05-20T22:12:13.191942+0000 mon.a (mon.0) 1406 : cluster 0 osdmap e138: 8 total, 8 up, 8 in 2024-05-20T22:12:14.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:13.198328+0000 mon.a (mon.0) 1407 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi050-64146-10"}]: dispatch 2024-05-20T22:12:14.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:13.201492+0000 mon.a (mon.0) 1408 : audit 1 from='client.? v1:172.21.15.50:0/3245431153' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi050-63944-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:14.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:13.252345+0000 mon.c (mon.2) 162 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:14.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:13.253618+0000 mon.a (mon.0) 1409 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:14.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:13.255671+0000 mon.c (mon.2) 163 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:14.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:13.256332+0000 mon.a (mon.0) 1410 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:14.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:13.258012+0000 mon.c (mon.2) 164 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64061-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:14.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:13.258732+0000 mon.a (mon.0) 1411 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64061-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:14.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:13.262523+0000 mon.c (mon.2) 165 : audit 1 from='client.? v1:172.21.15.50:0/998072603' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:14.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:13.263114+0000 mon.a (mon.0) 1412 : audit 1 from='client.25751 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:14.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:13.266718+0000 mon.c (mon.2) 166 : audit 1 from='client.? v1:172.21.15.50:0/998072603' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:14.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: cluster 2024-05-20T22:12:13.371334+0000 osd.1 (osd.1) 11 : cluster 0 151.3 scrub starts 2024-05-20T22:12:14.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: cluster 2024-05-20T22:12:13.374161+0000 osd.1 (osd.1) 12 : cluster 0 151.3 scrub ok 2024-05-20T22:12:14.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: cluster 2024-05-20T22:12:13.655986+0000 osd.4 (osd.4) 3 : cluster 0 151.0 deep-scrub starts 2024-05-20T22:12:14.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: cluster 2024-05-20T22:12:13.679498+0000 osd.4 (osd.4) 4 : cluster 0 151.0 deep-scrub ok 2024-05-20T22:12:14.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:13.716888+0000 mon.a (mon.0) 1413 : audit 1 from='client.25751 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:14.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:13.717915+0000 mon.c (mon.2) 167 : audit 1 from='client.? v1:172.21.15.50:0/998072603' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi050-63976-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:14.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:13.718412+0000 mon.a (mon.0) 1414 : audit 1 from='client.25751 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi050-63976-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:14.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:14.186649+0000 mon.a (mon.0) 1415 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi050-64146-10"}]': finished 2024-05-20T22:12:14.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:14.186888+0000 mon.a (mon.0) 1416 : audit 1 from='client.? v1:172.21.15.50:0/3245431153' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi050-63944-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:14.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:13.255671+0000 mon.c (mon.2) 163 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:14.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:13.256332+0000 mon.a (mon.0) 1410 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:14.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:13.258012+0000 mon.c (mon.2) 164 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64061-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:14.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:13.258732+0000 mon.a (mon.0) 1411 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64061-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:14.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:13.262523+0000 mon.c (mon.2) 165 : audit 1 from='client.? v1:172.21.15.50:0/998072603' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:14.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:13.263114+0000 mon.a (mon.0) 1412 : audit 1 from='client.25751 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:14.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:13.266718+0000 mon.c (mon.2) 166 : audit 1 from='client.? v1:172.21.15.50:0/998072603' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:14.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: cluster 2024-05-20T22:12:13.371334+0000 osd.1 (osd.1) 11 : cluster 0 151.3 scrub starts 2024-05-20T22:12:14.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: cluster 2024-05-20T22:12:13.374161+0000 osd.1 (osd.1) 12 : cluster 0 151.3 scrub ok 2024-05-20T22:12:14.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: cluster 2024-05-20T22:12:13.655986+0000 osd.4 (osd.4) 3 : cluster 0 151.0 deep-scrub starts 2024-05-20T22:12:14.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: cluster 2024-05-20T22:12:13.679498+0000 osd.4 (osd.4) 4 : cluster 0 151.0 deep-scrub ok 2024-05-20T22:12:14.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:13.716888+0000 mon.a (mon.0) 1413 : audit 1 from='client.25751 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:14.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:13.717915+0000 mon.c (mon.2) 167 : audit 1 from='client.? v1:172.21.15.50:0/998072603' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi050-63976-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:14.701 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:13.718412+0000 mon.a (mon.0) 1414 : audit 1 from='client.25751 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi050-63976-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:14.701 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:14.186649+0000 mon.a (mon.0) 1415 : audit 1 from='client.? v1:172.21.15.50:0/605330803' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi050-64146-10"}]': finished 2024-05-20T22:12:14.701 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:14.186888+0000 mon.a (mon.0) 1416 : audit 1 from='client.? v1:172.21.15.50:0/3245431153' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi050-63944-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:14.701 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:14.187112+0000 mon.a (mon.0) 1417 : audit 1 from='client.25748 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64061-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:14.701 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:14.187337+0000 mon.a (mon.0) 1418 : audit 1 from='client.25751 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi050-63976-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:14.701 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:14.198268+0000 mon.c (mon.2) 168 : audit 1 from='client.? v1:172.21.15.50:0/998072603' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi050-63976-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:14.701 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:14.198734+0000 mon.c (mon.2) 169 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64061-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:14.701 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: cluster 2024-05-20T22:12:14.199654+0000 mon.a (mon.0) 1419 : cluster 0 osdmap e139: 8 total, 8 up, 8 in 2024-05-20T22:12:14.701 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:14 smithi050 bash[28929]: audit 2024-05-20T22:12:14.205311+0000 mon.a (mon.0) 1420 : audit 1 from='client.25751 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi050-63976-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:14.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:14.187112+0000 mon.a (mon.0) 1417 : audit 1 from='client.25748 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64061-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:14.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:14.187337+0000 mon.a (mon.0) 1418 : audit 1 from='client.25751 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi050-63976-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:14.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:14.198268+0000 mon.c (mon.2) 168 : audit 1 from='client.? v1:172.21.15.50:0/998072603' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi050-63976-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:14.702 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:14.198734+0000 mon.c (mon.2) 169 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64061-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:14.702 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: cluster 2024-05-20T22:12:14.199654+0000 mon.a (mon.0) 1419 : cluster 0 osdmap e139: 8 total, 8 up, 8 in 2024-05-20T22:12:14.702 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:14 smithi050 bash[21866]: audit 2024-05-20T22:12:14.205311+0000 mon.a (mon.0) 1420 : audit 1 from='client.25751 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi050-63976-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:16.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:16 smithi145 bash[23893]: cluster 2024-05-20T22:12:13.320861+0000 osd.7 (osd.7) 11 : cluster 0 151.6 scrub starts 2024-05-20T22:12:16.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:16 smithi145 bash[23893]: cluster 2024-05-20T22:12:13.325035+0000 osd.7 (osd.7) 12 : cluster 0 151.6 scrub ok 2024-05-20T22:12:16.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:16 smithi145 bash[23893]: cluster 2024-05-20T22:12:13.525788+0000 osd.0 (osd.0) 15 : cluster 0 151.2 scrub starts 2024-05-20T22:12:16.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:16 smithi145 bash[23893]: cluster 2024-05-20T22:12:13.532368+0000 osd.0 (osd.0) 16 : cluster 0 151.2 scrub ok 2024-05-20T22:12:16.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:16 smithi145 bash[23893]: cluster 2024-05-20T22:12:13.677048+0000 osd.6 (osd.6) 3 : cluster 0 151.9 scrub starts 2024-05-20T22:12:16.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:16 smithi145 bash[23893]: cluster 2024-05-20T22:12:13.679395+0000 osd.6 (osd.6) 4 : cluster 0 151.9 scrub ok 2024-05-20T22:12:16.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:16 smithi145 bash[23893]: cluster 2024-05-20T22:12:13.765608+0000 osd.2 (osd.2) 9 : cluster 0 151.1 scrub starts 2024-05-20T22:12:16.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:16 smithi145 bash[23893]: cluster 2024-05-20T22:12:13.770729+0000 osd.2 (osd.2) 10 : cluster 0 151.1 scrub ok 2024-05-20T22:12:16.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:16 smithi145 bash[23893]: cluster 2024-05-20T22:12:14.019484+0000 mgr.y (mgr.14592) 249 : cluster 0 pgmap v219: 452 pgs: 32 unknown, 420 active+clean; 590 KiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-05-20T22:12:16.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:16 smithi145 bash[23893]: cluster 2024-05-20T22:12:14.212269+0000 mon.a (mon.0) 1421 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:16.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:16 smithi145 bash[23893]: audit 2024-05-20T22:12:14.216589+0000 mon.a (mon.0) 1422 : audit 1 from='client.? v1:172.21.15.50:0/1670183837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi050-63936-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:16.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:16 smithi145 bash[23893]: audit 2024-05-20T22:12:14.217453+0000 mon.a (mon.0) 1423 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64061-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:16.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:16 smithi145 bash[23893]: audit 2024-05-20T22:12:14.264127+0000 mon.a (mon.0) 1424 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]: dispatch 2024-05-20T22:12:16.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:16 smithi145 bash[23893]: audit 2024-05-20T22:12:14.265483+0000 mon.a (mon.0) 1425 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]: dispatch 2024-05-20T22:12:16.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:16 smithi145 bash[23893]: audit 2024-05-20T22:12:14.265816+0000 mon.a (mon.0) 1426 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:16.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:16 smithi145 bash[23893]: cluster 2024-05-20T22:12:14.421052+0000 osd.1 (osd.1) 13 : cluster 0 151.4 scrub starts 2024-05-20T22:12:16.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:16 smithi145 bash[23893]: cluster 2024-05-20T22:12:14.424818+0000 osd.1 (osd.1) 14 : cluster 0 151.4 scrub ok 2024-05-20T22:12:16.394 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:16 smithi145 bash[23893]: audit 2024-05-20T22:12:15.190842+0000 mon.a (mon.0) 1427 : audit 1 from='client.? v1:172.21.15.50:0/1670183837' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi050-63936-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:16.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:16 smithi050 bash[28929]: cluster 2024-05-20T22:12:13.320861+0000 osd.7 (osd.7) 11 : cluster 0 151.6 scrub starts 2024-05-20T22:12:16.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:16 smithi050 bash[28929]: cluster 2024-05-20T22:12:13.325035+0000 osd.7 (osd.7) 12 : cluster 0 151.6 scrub ok 2024-05-20T22:12:16.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:16 smithi050 bash[28929]: cluster 2024-05-20T22:12:13.525788+0000 osd.0 (osd.0) 15 : cluster 0 151.2 scrub starts 2024-05-20T22:12:16.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:16 smithi050 bash[28929]: cluster 2024-05-20T22:12:13.532368+0000 osd.0 (osd.0) 16 : cluster 0 151.2 scrub ok 2024-05-20T22:12:16.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:16 smithi050 bash[28929]: cluster 2024-05-20T22:12:13.677048+0000 osd.6 (osd.6) 3 : cluster 0 151.9 scrub starts 2024-05-20T22:12:16.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:16 smithi050 bash[28929]: cluster 2024-05-20T22:12:13.679395+0000 osd.6 (osd.6) 4 : cluster 0 151.9 scrub ok 2024-05-20T22:12:16.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:16 smithi050 bash[28929]: cluster 2024-05-20T22:12:13.765608+0000 osd.2 (osd.2) 9 : cluster 0 151.1 scrub starts 2024-05-20T22:12:16.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:16 smithi050 bash[28929]: cluster 2024-05-20T22:12:13.770729+0000 osd.2 (osd.2) 10 : cluster 0 151.1 scrub ok 2024-05-20T22:12:16.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:16 smithi050 bash[28929]: cluster 2024-05-20T22:12:14.019484+0000 mgr.y (mgr.14592) 249 : cluster 0 pgmap v219: 452 pgs: 32 unknown, 420 active+clean; 590 KiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-05-20T22:12:16.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:16 smithi050 bash[28929]: cluster 2024-05-20T22:12:14.212269+0000 mon.a (mon.0) 1421 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:16.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:16 smithi050 bash[28929]: audit 2024-05-20T22:12:14.216589+0000 mon.a (mon.0) 1422 : audit 1 from='client.? v1:172.21.15.50:0/1670183837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi050-63936-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:16.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:16 smithi050 bash[28929]: audit 2024-05-20T22:12:14.217453+0000 mon.a (mon.0) 1423 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64061-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:16.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:16 smithi050 bash[28929]: audit 2024-05-20T22:12:14.264127+0000 mon.a (mon.0) 1424 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]: dispatch 2024-05-20T22:12:16.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:16 smithi050 bash[28929]: audit 2024-05-20T22:12:14.265483+0000 mon.a (mon.0) 1425 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]: dispatch 2024-05-20T22:12:16.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:16 smithi050 bash[28929]: audit 2024-05-20T22:12:14.265816+0000 mon.a (mon.0) 1426 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:16.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:16 smithi050 bash[28929]: cluster 2024-05-20T22:12:14.421052+0000 osd.1 (osd.1) 13 : cluster 0 151.4 scrub starts 2024-05-20T22:12:16.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:16 smithi050 bash[28929]: cluster 2024-05-20T22:12:14.424818+0000 osd.1 (osd.1) 14 : cluster 0 151.4 scrub ok 2024-05-20T22:12:16.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:16 smithi050 bash[28929]: audit 2024-05-20T22:12:15.190842+0000 mon.a (mon.0) 1427 : audit 1 from='client.? v1:172.21.15.50:0/1670183837' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi050-63936-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:16.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:16 smithi050 bash[21866]: cluster 2024-05-20T22:12:13.320861+0000 osd.7 (osd.7) 11 : cluster 0 151.6 scrub starts 2024-05-20T22:12:16.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:16 smithi050 bash[21866]: cluster 2024-05-20T22:12:13.325035+0000 osd.7 (osd.7) 12 : cluster 0 151.6 scrub ok 2024-05-20T22:12:16.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:16 smithi050 bash[21866]: cluster 2024-05-20T22:12:13.525788+0000 osd.0 (osd.0) 15 : cluster 0 151.2 scrub starts 2024-05-20T22:12:16.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:16 smithi050 bash[21866]: cluster 2024-05-20T22:12:13.532368+0000 osd.0 (osd.0) 16 : cluster 0 151.2 scrub ok 2024-05-20T22:12:16.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:16 smithi050 bash[21866]: cluster 2024-05-20T22:12:13.677048+0000 osd.6 (osd.6) 3 : cluster 0 151.9 scrub starts 2024-05-20T22:12:16.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:16 smithi050 bash[21866]: cluster 2024-05-20T22:12:13.679395+0000 osd.6 (osd.6) 4 : cluster 0 151.9 scrub ok 2024-05-20T22:12:16.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:16 smithi050 bash[21866]: cluster 2024-05-20T22:12:13.765608+0000 osd.2 (osd.2) 9 : cluster 0 151.1 scrub starts 2024-05-20T22:12:16.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:16 smithi050 bash[21866]: cluster 2024-05-20T22:12:13.770729+0000 osd.2 (osd.2) 10 : cluster 0 151.1 scrub ok 2024-05-20T22:12:16.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:16 smithi050 bash[21866]: cluster 2024-05-20T22:12:14.019484+0000 mgr.y (mgr.14592) 249 : cluster 0 pgmap v219: 452 pgs: 32 unknown, 420 active+clean; 590 KiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-05-20T22:12:16.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:16 smithi050 bash[21866]: cluster 2024-05-20T22:12:14.212269+0000 mon.a (mon.0) 1421 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:16.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:16 smithi050 bash[21866]: audit 2024-05-20T22:12:14.216589+0000 mon.a (mon.0) 1422 : audit 1 from='client.? v1:172.21.15.50:0/1670183837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi050-63936-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:16.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:16 smithi050 bash[21866]: audit 2024-05-20T22:12:14.217453+0000 mon.a (mon.0) 1423 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64061-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:16.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:16 smithi050 bash[21866]: audit 2024-05-20T22:12:14.264127+0000 mon.a (mon.0) 1424 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]: dispatch 2024-05-20T22:12:16.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:16 smithi050 bash[21866]: audit 2024-05-20T22:12:14.265483+0000 mon.a (mon.0) 1425 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]: dispatch 2024-05-20T22:12:16.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:16 smithi050 bash[21866]: audit 2024-05-20T22:12:14.265816+0000 mon.a (mon.0) 1426 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:16.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:16 smithi050 bash[21866]: cluster 2024-05-20T22:12:14.421052+0000 osd.1 (osd.1) 13 : cluster 0 151.4 scrub starts 2024-05-20T22:12:16.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:16 smithi050 bash[21866]: cluster 2024-05-20T22:12:14.424818+0000 osd.1 (osd.1) 14 : cluster 0 151.4 scrub ok 2024-05-20T22:12:16.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:16 smithi050 bash[21866]: audit 2024-05-20T22:12:15.190842+0000 mon.a (mon.0) 1427 : audit 1 from='client.? v1:172.21.15.50:0/1670183837' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi050-63936-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:18.087 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPst: : entry=14 expected=14 2024-05-20T22:12:18.088 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:5c6b0b28:::7:head 2024-05-20T22:12:18.088 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : cursor()=11:5c6b0b28:::7:head expected=11:5c6b0b28:::7:head 2024-05-20T22:12:18.089 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:5c6b0b28:::7:head -> 7 2024-05-20T22:12:18.091 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : entry=7 expected=7 2024-05-20T22:12:18.091 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:52ea6a34:::10:head 2024-05-20T22:12:18.091 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : cursor()=11:52ea6a34:::10:head expected=11:52ea6a34:::10:head 2024-05-20T22:12:18.092 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:52ea6a34:::10:head -> 10 2024-05-20T22:12:18.092 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : entry=10 expected=10 2024-05-20T22:12:18.092 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:c4fdafeb:::6:head 2024-05-20T22:12:18.092 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : cursor()=11:c4fdafeb:::6:head expected=11:c4fdafeb:::6:head 2024-05-20T22:12:18.092 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:c4fdafeb:::6:head -> 6 2024-05-20T22:12:18.092 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : entry=6 expected=6 2024-05-20T22:12:18.092 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:bd63b0f1:::8:head 2024-05-20T22:12:18.092 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : cursor()=11:bd63b0f1:::8:head expected=11:bd63b0f1:::8:head 2024-05-20T22:12:18.092 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:bd63b0f1:::8:head -> 8 2024-05-20T22:12:18.092 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : entry=8 expected=8 2024-05-20T22:12:18.092 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:de5d7c5f:::12:head 2024-05-20T22:12:18.092 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : cursor()=11:de5d7c5f:::12:head expected=11:de5d7c5f:::12:head 2024-05-20T22:12:18.093 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:de5d7c5f:::12:head -> 12 2024-05-20T22:12:18.093 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : entry=12 expected=12 2024-05-20T22:12:18.093 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:d83876eb:::4:head 2024-05-20T22:12:18.093 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : cursor()=11:d83876eb:::4:head expected=11:d83876eb:::4:head 2024-05-20T22:12:18.093 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:d83876eb:::4:head -> 4 2024-05-20T22:12:18.093 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : entry=4 expected=4 2024-05-20T22:12:18.093 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:cfc208b3:::3:head 2024-05-20T22:12:18.093 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : cursor()=11:cfc208b3:::3:head expected=11:cfc208b3:::3:head 2024-05-20T22:12:18.093 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:cfc208b3:::3:head -> 3 2024-05-20T22:12:18.093 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : entry=3 expected=3 2024-05-20T22:12:18.093 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : seek to 11:02547ec2:::1:head 2024-05-20T22:12:18.093 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : cursor()=11:02547ec2:::1:head expected=11:02547ec2:::1:head 2024-05-20T22:12:18.093 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: > 11:02547ec2:::1:head -> 1 2024-05-20T22:12:18.093 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: : entry=1 expected=1 2024-05-20T22:12:18.094 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (275 ms) 2024-05-20T22:12:18.094 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2024-05-20T22:12:18.094 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (57389 ms) 2024-05-20T22:12:18.094 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2024-05-20T22:12:18.094 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: split 0/5 -> MIN 11:33333333::::head 2024-05-20T22:12:18.094 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: split 1/5 -> 11:33333333::::head 11:66666666::::head 2024-05-20T22:12:18.094 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: split 2/5 -> 11:66666666::::head 11:99999999::::head 2024-05-20T22:12:18.094 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: split 3/5 -> 11:99999999::::head 11:cccccccc::::head 2024-05-20T22:12:18.094 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: split 4/5 -> 11:cccccccc::::head MAX 2024-05-20T22:12:18.094 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (9954 ms) 2024-05-20T22:12:18.094 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [----------] 7 tests from LibRadosList (69333 ms total) 2024-05-20T22:12:18.094 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 2024-05-20T22:12:18.094 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [----------] 3 tests from LibRadosListEC 2024-05-20T22:12:18.095 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2024-05-20T22:12:18.095 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1454 ms) 2024-05-20T22:12:18.095 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2024-05-20T22:12:18.095 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: myset foo1,foo2,foo3 2024-05-20T22:12:18.095 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: foo1 2024-05-20T22:12:18.095 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: foo2 2024-05-20T22:12:18.095 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: foo3 2024-05-20T22:12:18.095 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: myset foo1,foo4,foo5 2024-05-20T22:12:18.095 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: foo4 2024-05-20T22:12:18.095 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: foo5 2024-05-20T22:12:18.095 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: foo1 2024-05-20T22:12:18.095 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: myset foo6,foo7 2024-05-20T22:12:18.095 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: foo7 2024-05-20T22:12:18.095 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: foo6 2024-05-20T22:12:18.096 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-05-20T22:12:18.096 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: ns1:foo4 2024-05-20T22:12:18.096 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: ns1:foo5 2024-05-20T22:12:18.096 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: ns2:foo7 2024-05-20T22:12:18.096 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: ns2:foo6 2024-05-20T22:12:18.096 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: ns1:foo1 2024-05-20T22:12:18.096 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: :foo1 2024-05-20T22:12:18.096 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: :foo2 2024-05-20T22:12:18.096 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: :foo3 2024-05-20T22:12:18.096 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (33 ms) 2024-05-20T22:12:18.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:17 smithi145 bash[23893]: cluster 2024-05-20T22:12:14.531546+0000 osd.0 (osd.0) 17 : cluster 0 151.7 scrub starts 2024-05-20T22:12:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:17 smithi145 bash[23893]: cluster 2024-05-20T22:12:14.535755+0000 osd.0 (osd.0) 18 : cluster 0 151.7 scrub ok 2024-05-20T22:12:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:17 smithi145 bash[23893]: audit 2024-05-20T22:12:15.191021+0000 mon.a (mon.0) 1428 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:17 smithi145 bash[23893]: cluster 2024-05-20T22:12:15.544953+0000 osd.0 (osd.0) 19 : cluster 0 151.8 scrub starts 2024-05-20T22:12:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:17 smithi145 bash[23893]: cluster 2024-05-20T22:12:15.562551+0000 osd.0 (osd.0) 20 : cluster 0 151.8 scrub ok 2024-05-20T22:12:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:17 smithi145 bash[23893]: cluster 2024-05-20T22:12:16.123076+0000 mon.a (mon.0) 1429 : cluster 0 osdmap e140: 8 total, 8 up, 8 in 2024-05-20T22:12:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:17 smithi145 bash[23893]: audit 2024-05-20T22:12:16.125459+0000 mon.a (mon.0) 1430 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi050-64146-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]: dispatch 2024-05-20T22:12:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:17 smithi145 bash[23893]: audit 2024-05-20T22:12:16.591304+0000 mon.a (mon.0) 1431 : audit 1 from='client.25751 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi050-63976-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi050-63976-2"}]': finished 2024-05-20T22:12:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:17 smithi145 bash[23893]: audit 2024-05-20T22:12:16.591513+0000 mon.a (mon.0) 1432 : audit 1 from='client.25748 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64061-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64061-24"}]': finished 2024-05-20T22:12:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:17 smithi145 bash[23893]: cluster 2024-05-20T22:12:17.054820+0000 mon.a (mon.0) 1433 : cluster 0 osdmap e141: 8 total, 8 up, 8 in 2024-05-20T22:12:18.142 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:12:17 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:12:18.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:17 smithi050 bash[21866]: cluster 2024-05-20T22:12:14.531546+0000 osd.0 (osd.0) 17 : cluster 0 151.7 scrub starts 2024-05-20T22:12:18.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:17 smithi050 bash[21866]: cluster 2024-05-20T22:12:14.535755+0000 osd.0 (osd.0) 18 : cluster 0 151.7 scrub ok 2024-05-20T22:12:18.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:17 smithi050 bash[21866]: audit 2024-05-20T22:12:15.191021+0000 mon.a (mon.0) 1428 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:18.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:17 smithi050 bash[21866]: cluster 2024-05-20T22:12:15.544953+0000 osd.0 (osd.0) 19 : cluster 0 151.8 scrub starts 2024-05-20T22:12:18.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:17 smithi050 bash[21866]: cluster 2024-05-20T22:12:15.562551+0000 osd.0 (osd.0) 20 : cluster 0 151.8 scrub ok 2024-05-20T22:12:18.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:17 smithi050 bash[21866]: cluster 2024-05-20T22:12:16.123076+0000 mon.a (mon.0) 1429 : cluster 0 osdmap e140: 8 total, 8 up, 8 in 2024-05-20T22:12:18.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:17 smithi050 bash[21866]: audit 2024-05-20T22:12:16.125459+0000 mon.a (mon.0) 1430 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi050-64146-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]: dispatch 2024-05-20T22:12:18.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:17 smithi050 bash[21866]: audit 2024-05-20T22:12:16.591304+0000 mon.a (mon.0) 1431 : audit 1 from='client.25751 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi050-63976-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi050-63976-2"}]': finished 2024-05-20T22:12:18.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:17 smithi050 bash[21866]: audit 2024-05-20T22:12:16.591513+0000 mon.a (mon.0) 1432 : audit 1 from='client.25748 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64061-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64061-24"}]': finished 2024-05-20T22:12:18.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:17 smithi050 bash[21866]: cluster 2024-05-20T22:12:17.054820+0000 mon.a (mon.0) 1433 : cluster 0 osdmap e141: 8 total, 8 up, 8 in 2024-05-20T22:12:18.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:17 smithi050 bash[28929]: cluster 2024-05-20T22:12:14.531546+0000 osd.0 (osd.0) 17 : cluster 0 151.7 scrub starts 2024-05-20T22:12:18.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:17 smithi050 bash[28929]: cluster 2024-05-20T22:12:14.535755+0000 osd.0 (osd.0) 18 : cluster 0 151.7 scrub ok 2024-05-20T22:12:18.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:17 smithi050 bash[28929]: audit 2024-05-20T22:12:15.191021+0000 mon.a (mon.0) 1428 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:18.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:17 smithi050 bash[28929]: cluster 2024-05-20T22:12:15.544953+0000 osd.0 (osd.0) 19 : cluster 0 151.8 scrub starts 2024-05-20T22:12:18.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:17 smithi050 bash[28929]: cluster 2024-05-20T22:12:15.562551+0000 osd.0 (osd.0) 20 : cluster 0 151.8 scrub ok 2024-05-20T22:12:18.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:17 smithi050 bash[28929]: cluster 2024-05-20T22:12:16.123076+0000 mon.a (mon.0) 1429 : cluster 0 osdmap e140: 8 total, 8 up, 8 in 2024-05-20T22:12:18.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:17 smithi050 bash[28929]: audit 2024-05-20T22:12:16.125459+0000 mon.a (mon.0) 1430 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi050-64146-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]: dispatch 2024-05-20T22:12:18.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:17 smithi050 bash[28929]: audit 2024-05-20T22:12:16.591304+0000 mon.a (mon.0) 1431 : audit 1 from='client.25751 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi050-63976-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi050-63976-2"}]': finished 2024-05-20T22:12:18.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:17 smithi050 bash[28929]: audit 2024-05-20T22:12:16.591513+0000 mon.a (mon.0) 1432 : audit 1 from='client.25748 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64061-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64061-24"}]': finished 2024-05-20T22:12:18.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:17 smithi050 bash[28929]: cluster 2024-05-20T22:12:17.054820+0000 mon.a (mon.0) 1433 : cluster 0 osdmap e141: 8 total, 8 up, 8 in 2024-05-20T22:12:19.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:18 smithi145 bash[23893]: cluster 2024-05-20T22:12:16.020455+0000 mgr.y (mgr.14592) 250 : cluster 0 pgmap v222: 452 pgs: 32 creating+peering, 420 active+clean; 592 KiB data, 405 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:19.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:18 smithi145 bash[23893]: audit 2024-05-20T22:12:17.056542+0000 mon.c (mon.2) 170 : audit 1 from='client.? v1:172.21.15.50:0/2643468585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi050-63944-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:19.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:18 smithi145 bash[23893]: audit 2024-05-20T22:12:17.504555+0000 mon.a (mon.0) 1434 : audit 1 from='client.25766 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi050-63944-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:19.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:18 smithi145 bash[23893]: audit 2024-05-20T22:12:17.718465+0000 mgr.y (mgr.14592) 251 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:12:19.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:18 smithi145 bash[23893]: audit 2024-05-20T22:12:17.970687+0000 mon.a (mon.0) 1435 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi050-64146-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]': finished 2024-05-20T22:12:19.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:18 smithi145 bash[23893]: audit 2024-05-20T22:12:17.970881+0000 mon.a (mon.0) 1436 : audit 1 from='client.25766 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi050-63944-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:19.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:18 smithi145 bash[23893]: cluster 2024-05-20T22:12:17.974615+0000 mon.a (mon.0) 1437 : cluster 0 osdmap e142: 8 total, 8 up, 8 in 2024-05-20T22:12:19.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:18 smithi145 bash[23893]: audit 2024-05-20T22:12:17.993847+0000 mon.c (mon.2) 171 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64061-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:19.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:18 smithi145 bash[23893]: audit 2024-05-20T22:12:17.994521+0000 mon.c (mon.2) 172 : audit 1 from='client.? v1:172.21.15.50:0/2377075981' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi050-63936-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:19.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:18 smithi145 bash[23893]: audit 2024-05-20T22:12:17.994606+0000 mon.a (mon.0) 1438 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64061-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:19.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:18 smithi145 bash[23893]: audit 2024-05-20T22:12:17.996373+0000 mon.a (mon.0) 1439 : audit 1 from='client.25772 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi050-63936-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:19.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:18 smithi145 bash[23893]: cluster 2024-05-20T22:12:18.021232+0000 mgr.y (mgr.14592) 252 : cluster 0 pgmap v225: 540 pgs: 120 unknown, 420 active+clean; 592 KiB data, 405 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 76 op/s 2024-05-20T22:12:19.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:18 smithi050 bash[21866]: cluster 2024-05-20T22:12:16.020455+0000 mgr.y (mgr.14592) 250 : cluster 0 pgmap v222: 452 pgs: 32 creating+peering, 420 active+clean; 592 KiB data, 405 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:19.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:18 smithi050 bash[21866]: audit 2024-05-20T22:12:17.056542+0000 mon.c (mon.2) 170 : audit 1 from='client.? v1:172.21.15.50:0/2643468585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi050-63944-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:19.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:18 smithi050 bash[21866]: audit 2024-05-20T22:12:17.504555+0000 mon.a (mon.0) 1434 : audit 1 from='client.25766 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi050-63944-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:19.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:18 smithi050 bash[21866]: audit 2024-05-20T22:12:17.718465+0000 mgr.y (mgr.14592) 251 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:12:19.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:18 smithi050 bash[21866]: audit 2024-05-20T22:12:17.970687+0000 mon.a (mon.0) 1435 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi050-64146-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]': finished 2024-05-20T22:12:19.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:18 smithi050 bash[21866]: audit 2024-05-20T22:12:17.970881+0000 mon.a (mon.0) 1436 : audit 1 from='client.25766 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi050-63944-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:19.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:18 smithi050 bash[21866]: cluster 2024-05-20T22:12:17.974615+0000 mon.a (mon.0) 1437 : cluster 0 osdmap e142: 8 total, 8 up, 8 in 2024-05-20T22:12:19.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:18 smithi050 bash[21866]: audit 2024-05-20T22:12:17.993847+0000 mon.c (mon.2) 171 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64061-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:19.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:18 smithi050 bash[21866]: audit 2024-05-20T22:12:17.994521+0000 mon.c (mon.2) 172 : audit 1 from='client.? v1:172.21.15.50:0/2377075981' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi050-63936-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:19.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:18 smithi050 bash[21866]: audit 2024-05-20T22:12:17.994606+0000 mon.a (mon.0) 1438 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64061-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:19.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:18 smithi050 bash[21866]: audit 2024-05-20T22:12:17.996373+0000 mon.a (mon.0) 1439 : audit 1 from='client.25772 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi050-63936-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:19.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:18 smithi050 bash[21866]: cluster 2024-05-20T22:12:18.021232+0000 mgr.y (mgr.14592) 252 : cluster 0 pgmap v225: 540 pgs: 120 unknown, 420 active+clean; 592 KiB data, 405 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 76 op/s 2024-05-20T22:12:19.393 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:18 smithi050 bash[28929]: cluster 2024-05-20T22:12:16.020455+0000 mgr.y (mgr.14592) 250 : cluster 0 pgmap v222: 452 pgs: 32 creating+peering, 420 active+clean; 592 KiB data, 405 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:19.393 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:18 smithi050 bash[28929]: audit 2024-05-20T22:12:17.056542+0000 mon.c (mon.2) 170 : audit 1 from='client.? v1:172.21.15.50:0/2643468585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi050-63944-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:19.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:18 smithi050 bash[28929]: audit 2024-05-20T22:12:17.504555+0000 mon.a (mon.0) 1434 : audit 1 from='client.25766 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi050-63944-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:19.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:18 smithi050 bash[28929]: audit 2024-05-20T22:12:17.718465+0000 mgr.y (mgr.14592) 251 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:12:19.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:18 smithi050 bash[28929]: audit 2024-05-20T22:12:17.970687+0000 mon.a (mon.0) 1435 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi050-64146-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]': finished 2024-05-20T22:12:19.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:18 smithi050 bash[28929]: audit 2024-05-20T22:12:17.970881+0000 mon.a (mon.0) 1436 : audit 1 from='client.25766 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi050-63944-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:19.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:18 smithi050 bash[28929]: cluster 2024-05-20T22:12:17.974615+0000 mon.a (mon.0) 1437 : cluster 0 osdmap e142: 8 total, 8 up, 8 in 2024-05-20T22:12:19.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:18 smithi050 bash[28929]: audit 2024-05-20T22:12:17.993847+0000 mon.c (mon.2) 171 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64061-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:19.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:18 smithi050 bash[28929]: audit 2024-05-20T22:12:17.994521+0000 mon.c (mon.2) 172 : audit 1 from='client.? v1:172.21.15.50:0/2377075981' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi050-63936-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:19.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:18 smithi050 bash[28929]: audit 2024-05-20T22:12:17.994606+0000 mon.a (mon.0) 1438 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64061-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:19.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:18 smithi050 bash[28929]: audit 2024-05-20T22:12:17.996373+0000 mon.a (mon.0) 1439 : audit 1 from='client.25772 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi050-63936-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:19.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:18 smithi050 bash[28929]: cluster 2024-05-20T22:12:18.021232+0000 mgr.y (mgr.14592) 252 : cluster 0 pgmap v225: 540 pgs: 120 unknown, 420 active+clean; 592 KiB data, 405 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 76 op/s 2024-05-20T22:12:19.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:12:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:12:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:12:20.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:20 smithi145 bash[23893]: audit 2024-05-20T22:12:18.981954+0000 mon.a (mon.0) 1440 : audit 1 from='client.25748 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64061-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:20.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:20 smithi145 bash[23893]: audit 2024-05-20T22:12:18.982142+0000 mon.a (mon.0) 1441 : audit 1 from='client.25772 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi050-63936-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:20.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:20 smithi145 bash[23893]: cluster 2024-05-20T22:12:18.990525+0000 mon.a (mon.0) 1442 : cluster 0 osdmap e143: 8 total, 8 up, 8 in 2024-05-20T22:12:20.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:20 smithi145 bash[23893]: audit 2024-05-20T22:12:18.993262+0000 mon.c (mon.2) 173 : audit 1 from='client.? v1:172.21.15.50:0/998072603' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:20.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:20 smithi145 bash[23893]: audit 2024-05-20T22:12:18.996038+0000 mon.a (mon.0) 1443 : audit 1 from='client.25751 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:20.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:20 smithi145 bash[23893]: audit 2024-05-20T22:12:18.999588+0000 mon.c (mon.2) 174 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64061-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:20.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:20 smithi145 bash[23893]: audit 2024-05-20T22:12:19.000547+0000 mon.a (mon.0) 1444 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64061-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:20.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:20 smithi050 bash[21866]: audit 2024-05-20T22:12:18.981954+0000 mon.a (mon.0) 1440 : audit 1 from='client.25748 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64061-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:20.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:20 smithi050 bash[21866]: audit 2024-05-20T22:12:18.982142+0000 mon.a (mon.0) 1441 : audit 1 from='client.25772 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi050-63936-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:20.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:20 smithi050 bash[21866]: cluster 2024-05-20T22:12:18.990525+0000 mon.a (mon.0) 1442 : cluster 0 osdmap e143: 8 total, 8 up, 8 in 2024-05-20T22:12:20.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:20 smithi050 bash[21866]: audit 2024-05-20T22:12:18.993262+0000 mon.c (mon.2) 173 : audit 1 from='client.? v1:172.21.15.50:0/998072603' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:20.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:20 smithi050 bash[21866]: audit 2024-05-20T22:12:18.996038+0000 mon.a (mon.0) 1443 : audit 1 from='client.25751 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:20.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:20 smithi050 bash[21866]: audit 2024-05-20T22:12:18.999588+0000 mon.c (mon.2) 174 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64061-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:20.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:20 smithi050 bash[21866]: audit 2024-05-20T22:12:19.000547+0000 mon.a (mon.0) 1444 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64061-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:20.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:20 smithi050 bash[28929]: audit 2024-05-20T22:12:18.981954+0000 mon.a (mon.0) 1440 : audit 1 from='client.25748 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64061-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:20.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:20 smithi050 bash[28929]: audit 2024-05-20T22:12:18.982142+0000 mon.a (mon.0) 1441 : audit 1 from='client.25772 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi050-63936-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:20.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:20 smithi050 bash[28929]: cluster 2024-05-20T22:12:18.990525+0000 mon.a (mon.0) 1442 : cluster 0 osdmap e143: 8 total, 8 up, 8 in 2024-05-20T22:12:20.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:20 smithi050 bash[28929]: audit 2024-05-20T22:12:18.993262+0000 mon.c (mon.2) 173 : audit 1 from='client.? v1:172.21.15.50:0/998072603' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:20.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:20 smithi050 bash[28929]: audit 2024-05-20T22:12:18.996038+0000 mon.a (mon.0) 1443 : audit 1 from='client.25751 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:20.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:20 smithi050 bash[28929]: audit 2024-05-20T22:12:18.999588+0000 mon.c (mon.2) 174 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64061-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:20.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:20 smithi050 bash[28929]: audit 2024-05-20T22:12:19.000547+0000 mon.a (mon.0) 1444 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64061-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:21 smithi145 bash[23893]: audit 2024-05-20T22:12:19.986147+0000 mon.a (mon.0) 1445 : audit 1 from='client.25751 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi050-63976-2"}]': finished 2024-05-20T22:12:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:21 smithi145 bash[23893]: audit 2024-05-20T22:12:19.986394+0000 mon.a (mon.0) 1446 : audit 1 from='client.25748 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64061-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:21 smithi145 bash[23893]: audit 2024-05-20T22:12:19.994462+0000 mon.c (mon.2) 175 : audit 1 from='client.? v1:172.21.15.50:0/998072603' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:21 smithi145 bash[23893]: cluster 2024-05-20T22:12:19.998005+0000 mon.a (mon.0) 1447 : cluster 0 osdmap e144: 8 total, 8 up, 8 in 2024-05-20T22:12:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:21 smithi145 bash[23893]: audit 2024-05-20T22:12:20.002261+0000 mon.a (mon.0) 1448 : audit 1 from='client.? v1:172.21.15.50:0/435344055' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64159-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:21 smithi145 bash[23893]: audit 2024-05-20T22:12:20.002848+0000 mon.a (mon.0) 1449 : audit 1 from='client.25751 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:21.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:21 smithi145 bash[23893]: audit 2024-05-20T22:12:20.006940+0000 mon.c (mon.2) 176 : audit 1 from='client.? v1:172.21.15.50:0/2514876325' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi050-63944-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:21.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:21 smithi145 bash[23893]: cluster 2024-05-20T22:12:20.028092+0000 mgr.y (mgr.14592) 253 : cluster 0 pgmap v228: 500 pgs: 64 unknown, 436 active+clean; 598 KiB data, 427 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:21.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:21 smithi145 bash[23893]: audit 2024-05-20T22:12:20.037934+0000 mon.a (mon.0) 1450 : audit 1 from='client.25778 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi050-63944-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:21.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:21 smithi145 bash[23893]: audit 2024-05-20T22:12:20.757748+0000 mon.a (mon.0) 1451 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:12:21.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:21 smithi145 bash[23893]: audit 2024-05-20T22:12:20.760525+0000 mon.a (mon.0) 1452 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:12:21.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:21 smithi145 bash[23893]: audit 2024-05-20T22:12:20.991520+0000 mon.a (mon.0) 1453 : audit 1 from='client.? v1:172.21.15.50:0/435344055' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64159-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:21.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:21 smithi145 bash[23893]: audit 2024-05-20T22:12:20.991746+0000 mon.a (mon.0) 1454 : audit 1 from='client.25751 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi050-63976-2"}]': finished 2024-05-20T22:12:21.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:21 smithi145 bash[23893]: audit 2024-05-20T22:12:20.991993+0000 mon.a (mon.0) 1455 : audit 1 from='client.25778 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi050-63944-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:21.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:21 smithi145 bash[23893]: cluster 2024-05-20T22:12:21.001706+0000 mon.a (mon.0) 1456 : cluster 0 osdmap e145: 8 total, 8 up, 8 in 2024-05-20T22:12:21.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:21 smithi145 bash[23893]: audit 2024-05-20T22:12:21.008447+0000 mon.c (mon.2) 177 : audit 1 from='client.? v1:172.21.15.50:0/137424997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi050-63936-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:21.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:21 smithi145 bash[23893]: audit 2024-05-20T22:12:21.015154+0000 mon.a (mon.0) 1457 : audit 1 from='client.25781 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi050-63936-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:21.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:21 smithi050 bash[28929]: audit 2024-05-20T22:12:19.986147+0000 mon.a (mon.0) 1445 : audit 1 from='client.25751 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi050-63976-2"}]': finished 2024-05-20T22:12:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:21 smithi050 bash[28929]: audit 2024-05-20T22:12:19.986394+0000 mon.a (mon.0) 1446 : audit 1 from='client.25748 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64061-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:21 smithi050 bash[28929]: audit 2024-05-20T22:12:19.994462+0000 mon.c (mon.2) 175 : audit 1 from='client.? v1:172.21.15.50:0/998072603' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:21 smithi050 bash[28929]: cluster 2024-05-20T22:12:19.998005+0000 mon.a (mon.0) 1447 : cluster 0 osdmap e144: 8 total, 8 up, 8 in 2024-05-20T22:12:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:21 smithi050 bash[28929]: audit 2024-05-20T22:12:20.002261+0000 mon.a (mon.0) 1448 : audit 1 from='client.? v1:172.21.15.50:0/435344055' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64159-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:21 smithi050 bash[28929]: audit 2024-05-20T22:12:20.002848+0000 mon.a (mon.0) 1449 : audit 1 from='client.25751 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:21 smithi050 bash[28929]: audit 2024-05-20T22:12:20.006940+0000 mon.c (mon.2) 176 : audit 1 from='client.? v1:172.21.15.50:0/2514876325' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi050-63944-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:21 smithi050 bash[28929]: cluster 2024-05-20T22:12:20.028092+0000 mgr.y (mgr.14592) 253 : cluster 0 pgmap v228: 500 pgs: 64 unknown, 436 active+clean; 598 KiB data, 427 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:21 smithi050 bash[28929]: audit 2024-05-20T22:12:20.037934+0000 mon.a (mon.0) 1450 : audit 1 from='client.25778 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi050-63944-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:21 smithi050 bash[28929]: audit 2024-05-20T22:12:20.757748+0000 mon.a (mon.0) 1451 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:12:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:21 smithi050 bash[28929]: audit 2024-05-20T22:12:20.760525+0000 mon.a (mon.0) 1452 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:12:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:21 smithi050 bash[28929]: audit 2024-05-20T22:12:20.991520+0000 mon.a (mon.0) 1453 : audit 1 from='client.? v1:172.21.15.50:0/435344055' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64159-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:21 smithi050 bash[28929]: audit 2024-05-20T22:12:20.991746+0000 mon.a (mon.0) 1454 : audit 1 from='client.25751 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi050-63976-2"}]': finished 2024-05-20T22:12:21.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:21 smithi050 bash[28929]: audit 2024-05-20T22:12:20.991993+0000 mon.a (mon.0) 1455 : audit 1 from='client.25778 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi050-63944-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:21.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:21 smithi050 bash[28929]: cluster 2024-05-20T22:12:21.001706+0000 mon.a (mon.0) 1456 : cluster 0 osdmap e145: 8 total, 8 up, 8 in 2024-05-20T22:12:21.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:21 smithi050 bash[28929]: audit 2024-05-20T22:12:21.008447+0000 mon.c (mon.2) 177 : audit 1 from='client.? v1:172.21.15.50:0/137424997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi050-63936-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:21.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:21 smithi050 bash[28929]: audit 2024-05-20T22:12:21.015154+0000 mon.a (mon.0) 1457 : audit 1 from='client.25781 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi050-63936-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:21.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:21 smithi050 bash[21866]: audit 2024-05-20T22:12:19.986147+0000 mon.a (mon.0) 1445 : audit 1 from='client.25751 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi050-63976-2"}]': finished 2024-05-20T22:12:21.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:21 smithi050 bash[21866]: audit 2024-05-20T22:12:19.986394+0000 mon.a (mon.0) 1446 : audit 1 from='client.25748 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64061-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:21.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:21 smithi050 bash[21866]: audit 2024-05-20T22:12:19.994462+0000 mon.c (mon.2) 175 : audit 1 from='client.? v1:172.21.15.50:0/998072603' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:21.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:21 smithi050 bash[21866]: cluster 2024-05-20T22:12:19.998005+0000 mon.a (mon.0) 1447 : cluster 0 osdmap e144: 8 total, 8 up, 8 in 2024-05-20T22:12:21.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:21 smithi050 bash[21866]: audit 2024-05-20T22:12:20.002261+0000 mon.a (mon.0) 1448 : audit 1 from='client.? v1:172.21.15.50:0/435344055' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64159-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:21.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:21 smithi050 bash[21866]: audit 2024-05-20T22:12:20.002848+0000 mon.a (mon.0) 1449 : audit 1 from='client.25751 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi050-63976-2"}]: dispatch 2024-05-20T22:12:21.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:21 smithi050 bash[21866]: audit 2024-05-20T22:12:20.006940+0000 mon.c (mon.2) 176 : audit 1 from='client.? v1:172.21.15.50:0/2514876325' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi050-63944-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:21.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:21 smithi050 bash[21866]: cluster 2024-05-20T22:12:20.028092+0000 mgr.y (mgr.14592) 253 : cluster 0 pgmap v228: 500 pgs: 64 unknown, 436 active+clean; 598 KiB data, 427 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:21.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:21 smithi050 bash[21866]: audit 2024-05-20T22:12:20.037934+0000 mon.a (mon.0) 1450 : audit 1 from='client.25778 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi050-63944-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:21.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:21 smithi050 bash[21866]: audit 2024-05-20T22:12:20.757748+0000 mon.a (mon.0) 1451 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:12:21.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:21 smithi050 bash[21866]: audit 2024-05-20T22:12:20.760525+0000 mon.a (mon.0) 1452 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:12:21.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:21 smithi050 bash[21866]: audit 2024-05-20T22:12:20.991520+0000 mon.a (mon.0) 1453 : audit 1 from='client.? v1:172.21.15.50:0/435344055' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64159-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:21.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:21 smithi050 bash[21866]: audit 2024-05-20T22:12:20.991746+0000 mon.a (mon.0) 1454 : audit 1 from='client.25751 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi050-63976-2"}]': finished 2024-05-20T22:12:21.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:21 smithi050 bash[21866]: audit 2024-05-20T22:12:20.991993+0000 mon.a (mon.0) 1455 : audit 1 from='client.25778 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi050-63944-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:21.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:21 smithi050 bash[21866]: cluster 2024-05-20T22:12:21.001706+0000 mon.a (mon.0) 1456 : cluster 0 osdmap e145: 8 total, 8 up, 8 in 2024-05-20T22:12:21.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:21 smithi050 bash[21866]: audit 2024-05-20T22:12:21.008447+0000 mon.c (mon.2) 177 : audit 1 from='client.? v1:172.21.15.50:0/137424997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi050-63936-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:21.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:21 smithi050 bash[21866]: audit 2024-05-20T22:12:21.015154+0000 mon.a (mon.0) 1457 : audit 1 from='client.25781 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi050-63936-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:22.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:22 smithi145 bash[23893]: cluster 2024-05-20T22:12:21.028969+0000 mon.a (mon.0) 1458 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:22.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:22 smithi145 bash[23893]: audit 2024-05-20T22:12:21.995899+0000 mon.a (mon.0) 1459 : audit 1 from='client.25781 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi050-63936-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:22.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:22 smithi145 bash[23893]: cluster 2024-05-20T22:12:22.008020+0000 mon.a (mon.0) 1460 : cluster 0 osdmap e146: 8 total, 8 up, 8 in 2024-05-20T22:12:22.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:22 smithi145 bash[23893]: audit 2024-05-20T22:12:22.008955+0000 mon.c (mon.2) 178 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:22.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:22 smithi145 bash[23893]: audit 2024-05-20T22:12:22.011419+0000 mon.a (mon.0) 1461 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:22.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:22 smithi145 bash[23893]: audit 2024-05-20T22:12:22.028221+0000 mon.a (mon.0) 1462 : audit 1 from='client.? v1:172.21.15.50:0/481851928' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-63976-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:22.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:22 smithi050 bash[21866]: cluster 2024-05-20T22:12:21.028969+0000 mon.a (mon.0) 1458 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:22.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:22 smithi050 bash[21866]: audit 2024-05-20T22:12:21.995899+0000 mon.a (mon.0) 1459 : audit 1 from='client.25781 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi050-63936-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:22.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:22 smithi050 bash[21866]: cluster 2024-05-20T22:12:22.008020+0000 mon.a (mon.0) 1460 : cluster 0 osdmap e146: 8 total, 8 up, 8 in 2024-05-20T22:12:22.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:22 smithi050 bash[21866]: audit 2024-05-20T22:12:22.008955+0000 mon.c (mon.2) 178 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:22.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:22 smithi050 bash[21866]: audit 2024-05-20T22:12:22.011419+0000 mon.a (mon.0) 1461 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:22.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:22 smithi050 bash[21866]: audit 2024-05-20T22:12:22.028221+0000 mon.a (mon.0) 1462 : audit 1 from='client.? v1:172.21.15.50:0/481851928' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-63976-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:22.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:22 smithi050 bash[28929]: cluster 2024-05-20T22:12:21.028969+0000 mon.a (mon.0) 1458 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:22.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:22 smithi050 bash[28929]: audit 2024-05-20T22:12:21.995899+0000 mon.a (mon.0) 1459 : audit 1 from='client.25781 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi050-63936-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:22.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:22 smithi050 bash[28929]: cluster 2024-05-20T22:12:22.008020+0000 mon.a (mon.0) 1460 : cluster 0 osdmap e146: 8 total, 8 up, 8 in 2024-05-20T22:12:22.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:22 smithi050 bash[28929]: audit 2024-05-20T22:12:22.008955+0000 mon.c (mon.2) 178 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:22.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:22 smithi050 bash[28929]: audit 2024-05-20T22:12:22.011419+0000 mon.a (mon.0) 1461 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:22.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:22 smithi050 bash[28929]: audit 2024-05-20T22:12:22.028221+0000 mon.a (mon.0) 1462 : audit 1 from='client.? v1:172.21.15.50:0/481851928' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-63976-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:23.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:23 smithi145 bash[23893]: cluster 2024-05-20T22:12:22.032782+0000 mgr.y (mgr.14592) 254 : cluster 0 pgmap v231: 492 pgs: 96 unknown, 396 active+clean; 598 KiB data, 427 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:23.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:23 smithi145 bash[23893]: audit 2024-05-20T22:12:23.008039+0000 mon.a (mon.0) 1463 : audit 1 from='client.25748 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64061-24"}]': finished 2024-05-20T22:12:23.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:23 smithi145 bash[23893]: audit 2024-05-20T22:12:23.008273+0000 mon.a (mon.0) 1464 : audit 1 from='client.? v1:172.21.15.50:0/481851928' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-63976-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:23.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:23 smithi145 bash[23893]: cluster 2024-05-20T22:12:23.016056+0000 mon.a (mon.0) 1465 : cluster 0 osdmap e147: 8 total, 8 up, 8 in 2024-05-20T22:12:23.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:23 smithi145 bash[23893]: audit 2024-05-20T22:12:23.020314+0000 mon.c (mon.2) 179 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:23.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:23 smithi145 bash[23893]: audit 2024-05-20T22:12:23.032064+0000 mon.a (mon.0) 1466 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:23.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:23 smithi145 bash[23893]: audit 2024-05-20T22:12:23.032469+0000 mon.a (mon.0) 1467 : audit 1 from='client.? v1:172.21.15.50:0/655119517' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi050-63944-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:23.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:23 smithi050 bash[28929]: cluster 2024-05-20T22:12:22.032782+0000 mgr.y (mgr.14592) 254 : cluster 0 pgmap v231: 492 pgs: 96 unknown, 396 active+clean; 598 KiB data, 427 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:23.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:23 smithi050 bash[28929]: audit 2024-05-20T22:12:23.008039+0000 mon.a (mon.0) 1463 : audit 1 from='client.25748 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64061-24"}]': finished 2024-05-20T22:12:23.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:23 smithi050 bash[28929]: audit 2024-05-20T22:12:23.008273+0000 mon.a (mon.0) 1464 : audit 1 from='client.? v1:172.21.15.50:0/481851928' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-63976-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:23.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:23 smithi050 bash[28929]: cluster 2024-05-20T22:12:23.016056+0000 mon.a (mon.0) 1465 : cluster 0 osdmap e147: 8 total, 8 up, 8 in 2024-05-20T22:12:23.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:23 smithi050 bash[28929]: audit 2024-05-20T22:12:23.020314+0000 mon.c (mon.2) 179 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:23.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:23 smithi050 bash[28929]: audit 2024-05-20T22:12:23.032064+0000 mon.a (mon.0) 1466 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:23.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:23 smithi050 bash[28929]: audit 2024-05-20T22:12:23.032469+0000 mon.a (mon.0) 1467 : audit 1 from='client.? v1:172.21.15.50:0/655119517' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi050-63944-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:23.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:23 smithi050 bash[21866]: cluster 2024-05-20T22:12:22.032782+0000 mgr.y (mgr.14592) 254 : cluster 0 pgmap v231: 492 pgs: 96 unknown, 396 active+clean; 598 KiB data, 427 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:23.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:23 smithi050 bash[21866]: audit 2024-05-20T22:12:23.008039+0000 mon.a (mon.0) 1463 : audit 1 from='client.25748 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64061-24"}]': finished 2024-05-20T22:12:23.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:23 smithi050 bash[21866]: audit 2024-05-20T22:12:23.008273+0000 mon.a (mon.0) 1464 : audit 1 from='client.? v1:172.21.15.50:0/481851928' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-63976-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:23.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:23 smithi050 bash[21866]: cluster 2024-05-20T22:12:23.016056+0000 mon.a (mon.0) 1465 : cluster 0 osdmap e147: 8 total, 8 up, 8 in 2024-05-20T22:12:23.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:23 smithi050 bash[21866]: audit 2024-05-20T22:12:23.020314+0000 mon.c (mon.2) 179 : audit 1 from='client.? v1:172.21.15.50:0/2163410626' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:23.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:23 smithi050 bash[21866]: audit 2024-05-20T22:12:23.032064+0000 mon.a (mon.0) 1466 : audit 1 from='client.25748 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64061-24"}]: dispatch 2024-05-20T22:12:23.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:23 smithi050 bash[21866]: audit 2024-05-20T22:12:23.032469+0000 mon.a (mon.0) 1467 : audit 1 from='client.? v1:172.21.15.50:0/655119517' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi050-63944-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:24.027 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2024-05-20T22:12:24.027 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 1 0 2024-05-20T22:12:24.027 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 10 0 2024-05-20T22:12:24.028 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 13 0 2024-05-20T22:12:24.028 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 7 0 2024-05-20T22:12:24.028 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 14 0 2024-05-20T22:12:24.028 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 0 0 2024-05-20T22:12:24.028 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 15 0 2024-05-20T22:12:24.028 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 11 0 2024-05-20T22:12:24.028 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 5 0 2024-05-20T22:12:24.028 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 8 0 2024-05-20T22:12:24.028 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 6 0 2024-05-20T22:12:24.028 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 3 0 2024-05-20T22:12:24.028 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 4 0 2024-05-20T22:12:24.028 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 12 0 2024-05-20T22:12:24.029 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 9 0 2024-05-20T22:12:24.029 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 2 0 2024-05-20T22:12:24.029 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-05-20T22:12:24.029 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (55 ms) 2024-05-20T22:12:24.029 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [----------] 3 tests from LibRadosListEC (1542 ms total) 2024-05-20T22:12:24.029 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 2024-05-20T22:12:24.029 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [----------] 1 test from LibRadosListNP 2024-05-20T22:12:24.029 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2024-05-20T22:12:24.029 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3014 ms) 2024-05-20T22:12:24.029 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [----------] 1 test from LibRadosListNP (3014 ms total) 2024-05-20T22:12:24.029 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: 2024-05-20T22:12:24.030 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [----------] Global test environment tear-down 2024-05-20T22:12:24.030 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [==========] 11 tests from 3 test suites ran. (97280 ms total) 2024-05-20T22:12:24.030 INFO:tasks.workunit.client.0.smithi050.stdout: api_list: [ PASSED ] 11 tests. 2024-05-20T22:12:24.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:24 smithi145 bash[23893]: audit 2024-05-20T22:12:23.534060+0000 mon.a (mon.0) 1468 : audit 1 from='client.? v1:172.21.15.50:0/481851928' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi050-63976-3","pool2":"test-rados-api-smithi050-63976-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-05-20T22:12:24.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:24 smithi145 bash[23893]: audit 2024-05-20T22:12:24.012947+0000 mon.a (mon.0) 1469 : audit 1 from='client.25748 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64061-24"}]': finished 2024-05-20T22:12:24.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:24 smithi145 bash[23893]: audit 2024-05-20T22:12:24.013119+0000 mon.a (mon.0) 1470 : audit 1 from='client.? v1:172.21.15.50:0/655119517' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi050-63944-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:24.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:24 smithi145 bash[23893]: audit 2024-05-20T22:12:24.013327+0000 mon.a (mon.0) 1471 : audit 1 from='client.? v1:172.21.15.50:0/481851928' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi050-63976-3","pool2":"test-rados-api-smithi050-63976-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-05-20T22:12:24.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:24 smithi145 bash[23893]: cluster 2024-05-20T22:12:24.022095+0000 mon.a (mon.0) 1472 : cluster 0 osdmap e148: 8 total, 8 up, 8 in 2024-05-20T22:12:24.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:24 smithi145 bash[23893]: audit 2024-05-20T22:12:24.024820+0000 mon.a (mon.0) 1473 : audit 1 from='client.? v1:172.21.15.50:0/364790' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi050-63936-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:24.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:24 smithi050 bash[21866]: audit 2024-05-20T22:12:23.534060+0000 mon.a (mon.0) 1468 : audit 1 from='client.? v1:172.21.15.50:0/481851928' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi050-63976-3","pool2":"test-rados-api-smithi050-63976-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-05-20T22:12:24.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:24 smithi050 bash[21866]: audit 2024-05-20T22:12:24.012947+0000 mon.a (mon.0) 1469 : audit 1 from='client.25748 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64061-24"}]': finished 2024-05-20T22:12:24.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:24 smithi050 bash[21866]: audit 2024-05-20T22:12:24.013119+0000 mon.a (mon.0) 1470 : audit 1 from='client.? v1:172.21.15.50:0/655119517' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi050-63944-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:24.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:24 smithi050 bash[21866]: audit 2024-05-20T22:12:24.013327+0000 mon.a (mon.0) 1471 : audit 1 from='client.? v1:172.21.15.50:0/481851928' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi050-63976-3","pool2":"test-rados-api-smithi050-63976-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-05-20T22:12:24.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:24 smithi050 bash[21866]: cluster 2024-05-20T22:12:24.022095+0000 mon.a (mon.0) 1472 : cluster 0 osdmap e148: 8 total, 8 up, 8 in 2024-05-20T22:12:24.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:24 smithi050 bash[21866]: audit 2024-05-20T22:12:24.024820+0000 mon.a (mon.0) 1473 : audit 1 from='client.? v1:172.21.15.50:0/364790' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi050-63936-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:24.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:24 smithi050 bash[28929]: audit 2024-05-20T22:12:23.534060+0000 mon.a (mon.0) 1468 : audit 1 from='client.? v1:172.21.15.50:0/481851928' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi050-63976-3","pool2":"test-rados-api-smithi050-63976-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-05-20T22:12:24.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:24 smithi050 bash[28929]: audit 2024-05-20T22:12:24.012947+0000 mon.a (mon.0) 1469 : audit 1 from='client.25748 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64061-24"}]': finished 2024-05-20T22:12:24.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:24 smithi050 bash[28929]: audit 2024-05-20T22:12:24.013119+0000 mon.a (mon.0) 1470 : audit 1 from='client.? v1:172.21.15.50:0/655119517' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi050-63944-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:24.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:24 smithi050 bash[28929]: audit 2024-05-20T22:12:24.013327+0000 mon.a (mon.0) 1471 : audit 1 from='client.? v1:172.21.15.50:0/481851928' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi050-63976-3","pool2":"test-rados-api-smithi050-63976-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-05-20T22:12:24.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:24 smithi050 bash[28929]: cluster 2024-05-20T22:12:24.022095+0000 mon.a (mon.0) 1472 : cluster 0 osdmap e148: 8 total, 8 up, 8 in 2024-05-20T22:12:24.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:24 smithi050 bash[28929]: audit 2024-05-20T22:12:24.024820+0000 mon.a (mon.0) 1473 : audit 1 from='client.? v1:172.21.15.50:0/364790' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi050-63936-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:25.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:25 smithi145 bash[23893]: cluster 2024-05-20T22:12:24.034769+0000 mgr.y (mgr.14592) 255 : cluster 0 pgmap v234: 460 pgs: 64 unknown, 396 active+clean; 598 KiB data, 427 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:25.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:25 smithi145 bash[23893]: audit 2024-05-20T22:12:24.111409+0000 mon.c (mon.2) 180 : audit 1 from='client.? v1:172.21.15.50:0/1686475988' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:25.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:25 smithi145 bash[23893]: audit 2024-05-20T22:12:24.535814+0000 mon.a (mon.0) 1474 : audit 1 from='client.25814 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:25.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:25 smithi145 bash[23893]: audit 2024-05-20T22:12:24.536766+0000 mon.c (mon.2) 181 : audit 1 from='client.? v1:172.21.15.50:0/1686475988' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:25.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:25 smithi145 bash[23893]: audit 2024-05-20T22:12:24.537341+0000 mon.a (mon.0) 1475 : audit 1 from='client.25814 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:25.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:25 smithi145 bash[23893]: audit 2024-05-20T22:12:24.537987+0000 mon.c (mon.2) 182 : audit 1 from='client.? v1:172.21.15.50:0/1686475988' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:25.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:25 smithi145 bash[23893]: audit 2024-05-20T22:12:24.538611+0000 mon.a (mon.0) 1476 : audit 1 from='client.25814 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:25.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:25 smithi145 bash[23893]: audit 2024-05-20T22:12:25.024367+0000 mon.a (mon.0) 1477 : audit 1 from='client.? v1:172.21.15.50:0/364790' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi050-63936-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:25.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:25 smithi145 bash[23893]: audit 2024-05-20T22:12:25.024562+0000 mon.a (mon.0) 1478 : audit 1 from='client.25814 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:25.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:25 smithi145 bash[23893]: cluster 2024-05-20T22:12:25.032856+0000 mon.a (mon.0) 1479 : cluster 0 osdmap e149: 8 total, 8 up, 8 in 2024-05-20T22:12:25.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:25 smithi145 bash[23893]: audit 2024-05-20T22:12:25.035150+0000 mon.c (mon.2) 183 : audit 1 from='client.? v1:172.21.15.50:0/1686475988' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi050-64159-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:25.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:25 smithi145 bash[23893]: audit 2024-05-20T22:12:25.036366+0000 mon.c (mon.2) 184 : audit 1 from='client.? v1:172.21.15.50:0/645867512' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi050-64061-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:25.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:25 smithi145 bash[23893]: audit 2024-05-20T22:12:25.037757+0000 mon.a (mon.0) 1480 : audit 1 from='client.25814 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi050-64159-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:25.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:25 smithi145 bash[23893]: audit 2024-05-20T22:12:25.038724+0000 mon.a (mon.0) 1481 : audit 1 from='client.25808 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi050-64061-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:25.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:25 smithi050 bash[21866]: cluster 2024-05-20T22:12:24.034769+0000 mgr.y (mgr.14592) 255 : cluster 0 pgmap v234: 460 pgs: 64 unknown, 396 active+clean; 598 KiB data, 427 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:25.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:25 smithi050 bash[21866]: audit 2024-05-20T22:12:24.111409+0000 mon.c (mon.2) 180 : audit 1 from='client.? v1:172.21.15.50:0/1686475988' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:25.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:25 smithi050 bash[21866]: audit 2024-05-20T22:12:24.535814+0000 mon.a (mon.0) 1474 : audit 1 from='client.25814 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:25.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:25 smithi050 bash[21866]: audit 2024-05-20T22:12:24.536766+0000 mon.c (mon.2) 181 : audit 1 from='client.? v1:172.21.15.50:0/1686475988' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:25.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:25 smithi050 bash[21866]: audit 2024-05-20T22:12:24.537341+0000 mon.a (mon.0) 1475 : audit 1 from='client.25814 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:25.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:25 smithi050 bash[21866]: audit 2024-05-20T22:12:24.537987+0000 mon.c (mon.2) 182 : audit 1 from='client.? v1:172.21.15.50:0/1686475988' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:25.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:25 smithi050 bash[21866]: audit 2024-05-20T22:12:24.538611+0000 mon.a (mon.0) 1476 : audit 1 from='client.25814 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:25.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:25 smithi050 bash[21866]: audit 2024-05-20T22:12:25.024367+0000 mon.a (mon.0) 1477 : audit 1 from='client.? v1:172.21.15.50:0/364790' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi050-63936-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:25.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:25 smithi050 bash[21866]: audit 2024-05-20T22:12:25.024562+0000 mon.a (mon.0) 1478 : audit 1 from='client.25814 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:25.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:25 smithi050 bash[21866]: cluster 2024-05-20T22:12:25.032856+0000 mon.a (mon.0) 1479 : cluster 0 osdmap e149: 8 total, 8 up, 8 in 2024-05-20T22:12:25.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:25 smithi050 bash[21866]: audit 2024-05-20T22:12:25.035150+0000 mon.c (mon.2) 183 : audit 1 from='client.? v1:172.21.15.50:0/1686475988' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi050-64159-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:25.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:25 smithi050 bash[21866]: audit 2024-05-20T22:12:25.036366+0000 mon.c (mon.2) 184 : audit 1 from='client.? v1:172.21.15.50:0/645867512' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi050-64061-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:25.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:25 smithi050 bash[21866]: audit 2024-05-20T22:12:25.037757+0000 mon.a (mon.0) 1480 : audit 1 from='client.25814 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi050-64159-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:25.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:25 smithi050 bash[21866]: audit 2024-05-20T22:12:25.038724+0000 mon.a (mon.0) 1481 : audit 1 from='client.25808 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi050-64061-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:25.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:25 smithi050 bash[28929]: cluster 2024-05-20T22:12:24.034769+0000 mgr.y (mgr.14592) 255 : cluster 0 pgmap v234: 460 pgs: 64 unknown, 396 active+clean; 598 KiB data, 427 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:25.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:25 smithi050 bash[28929]: audit 2024-05-20T22:12:24.111409+0000 mon.c (mon.2) 180 : audit 1 from='client.? v1:172.21.15.50:0/1686475988' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:25.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:25 smithi050 bash[28929]: audit 2024-05-20T22:12:24.535814+0000 mon.a (mon.0) 1474 : audit 1 from='client.25814 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:25.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:25 smithi050 bash[28929]: audit 2024-05-20T22:12:24.536766+0000 mon.c (mon.2) 181 : audit 1 from='client.? v1:172.21.15.50:0/1686475988' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:25.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:25 smithi050 bash[28929]: audit 2024-05-20T22:12:24.537341+0000 mon.a (mon.0) 1475 : audit 1 from='client.25814 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:25.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:25 smithi050 bash[28929]: audit 2024-05-20T22:12:24.537987+0000 mon.c (mon.2) 182 : audit 1 from='client.? v1:172.21.15.50:0/1686475988' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:25.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:25 smithi050 bash[28929]: audit 2024-05-20T22:12:24.538611+0000 mon.a (mon.0) 1476 : audit 1 from='client.25814 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:25.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:25 smithi050 bash[28929]: audit 2024-05-20T22:12:25.024367+0000 mon.a (mon.0) 1477 : audit 1 from='client.? v1:172.21.15.50:0/364790' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi050-63936-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:25.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:25 smithi050 bash[28929]: audit 2024-05-20T22:12:25.024562+0000 mon.a (mon.0) 1478 : audit 1 from='client.25814 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:25.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:25 smithi050 bash[28929]: cluster 2024-05-20T22:12:25.032856+0000 mon.a (mon.0) 1479 : cluster 0 osdmap e149: 8 total, 8 up, 8 in 2024-05-20T22:12:25.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:25 smithi050 bash[28929]: audit 2024-05-20T22:12:25.035150+0000 mon.c (mon.2) 183 : audit 1 from='client.? v1:172.21.15.50:0/1686475988' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi050-64159-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:25.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:25 smithi050 bash[28929]: audit 2024-05-20T22:12:25.036366+0000 mon.c (mon.2) 184 : audit 1 from='client.? v1:172.21.15.50:0/645867512' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi050-64061-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:25.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:25 smithi050 bash[28929]: audit 2024-05-20T22:12:25.037757+0000 mon.a (mon.0) 1480 : audit 1 from='client.25814 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi050-64159-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:25.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:25 smithi050 bash[28929]: audit 2024-05-20T22:12:25.038724+0000 mon.a (mon.0) 1481 : audit 1 from='client.25808 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi050-64061-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:27.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:27 smithi145 bash[23893]: audit 2024-05-20T22:12:26.029761+0000 mon.a (mon.0) 1482 : audit 1 from='client.25808 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi050-64061-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:27.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:27 smithi145 bash[23893]: cluster 2024-05-20T22:12:26.036172+0000 mgr.y (mgr.14592) 256 : cluster 0 pgmap v237: 460 pgs: 64 unknown, 396 active+clean; 598 KiB data, 463 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 6.0 KiB/s wr, 2 op/s 2024-05-20T22:12:27.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:27 smithi145 bash[23893]: cluster 2024-05-20T22:12:26.506240+0000 mon.a (mon.0) 1483 : cluster 0 osdmap e150: 8 total, 8 up, 8 in 2024-05-20T22:12:27.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:27 smithi145 bash[23893]: audit 2024-05-20T22:12:26.513197+0000 mon.a (mon.0) 1484 : audit 1 from='client.? v1:172.21.15.50:0/633884821' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi050-63944-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:27.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:27 smithi050 bash[21866]: audit 2024-05-20T22:12:26.029761+0000 mon.a (mon.0) 1482 : audit 1 from='client.25808 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi050-64061-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:27.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:27 smithi050 bash[21866]: cluster 2024-05-20T22:12:26.036172+0000 mgr.y (mgr.14592) 256 : cluster 0 pgmap v237: 460 pgs: 64 unknown, 396 active+clean; 598 KiB data, 463 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 6.0 KiB/s wr, 2 op/s 2024-05-20T22:12:27.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:27 smithi050 bash[21866]: cluster 2024-05-20T22:12:26.506240+0000 mon.a (mon.0) 1483 : cluster 0 osdmap e150: 8 total, 8 up, 8 in 2024-05-20T22:12:27.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:27 smithi050 bash[21866]: audit 2024-05-20T22:12:26.513197+0000 mon.a (mon.0) 1484 : audit 1 from='client.? v1:172.21.15.50:0/633884821' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi050-63944-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:27.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:27 smithi050 bash[28929]: audit 2024-05-20T22:12:26.029761+0000 mon.a (mon.0) 1482 : audit 1 from='client.25808 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi050-64061-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:27.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:27 smithi050 bash[28929]: cluster 2024-05-20T22:12:26.036172+0000 mgr.y (mgr.14592) 256 : cluster 0 pgmap v237: 460 pgs: 64 unknown, 396 active+clean; 598 KiB data, 463 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 6.0 KiB/s wr, 2 op/s 2024-05-20T22:12:27.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:27 smithi050 bash[28929]: cluster 2024-05-20T22:12:26.506240+0000 mon.a (mon.0) 1483 : cluster 0 osdmap e150: 8 total, 8 up, 8 in 2024-05-20T22:12:27.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:27 smithi050 bash[28929]: audit 2024-05-20T22:12:26.513197+0000 mon.a (mon.0) 1484 : audit 1 from='client.? v1:172.21.15.50:0/633884821' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi050-63944-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:28.071 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:12:27 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:12:28.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:28 smithi145 bash[23893]: audit 2024-05-20T22:12:27.041043+0000 mon.a (mon.0) 1485 : audit 1 from='client.25814 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi050-64159-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]': finished 2024-05-20T22:12:28.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:28 smithi145 bash[23893]: audit 2024-05-20T22:12:27.041291+0000 mon.a (mon.0) 1486 : audit 1 from='client.? v1:172.21.15.50:0/633884821' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi050-63944-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:28.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:28 smithi145 bash[23893]: cluster 2024-05-20T22:12:27.050745+0000 mon.a (mon.0) 1487 : cluster 0 osdmap e151: 8 total, 8 up, 8 in 2024-05-20T22:12:28.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:28 smithi145 bash[23893]: audit 2024-05-20T22:12:27.055944+0000 mon.a (mon.0) 1488 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]: dispatch 2024-05-20T22:12:28.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:28 smithi145 bash[23893]: audit 2024-05-20T22:12:27.056940+0000 mon.c (mon.2) 185 : audit 1 from='client.? v1:172.21.15.50:0/2627702492' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi050-63936-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:28.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:28 smithi145 bash[23893]: audit 2024-05-20T22:12:27.058357+0000 mon.a (mon.0) 1489 : audit 1 from='client.25826 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi050-63936-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:28.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:28 smithi050 bash[21866]: audit 2024-05-20T22:12:27.041043+0000 mon.a (mon.0) 1485 : audit 1 from='client.25814 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi050-64159-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]': finished 2024-05-20T22:12:28.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:28 smithi050 bash[21866]: audit 2024-05-20T22:12:27.041291+0000 mon.a (mon.0) 1486 : audit 1 from='client.? v1:172.21.15.50:0/633884821' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi050-63944-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:28.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:28 smithi050 bash[21866]: cluster 2024-05-20T22:12:27.050745+0000 mon.a (mon.0) 1487 : cluster 0 osdmap e151: 8 total, 8 up, 8 in 2024-05-20T22:12:28.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:28 smithi050 bash[21866]: audit 2024-05-20T22:12:27.055944+0000 mon.a (mon.0) 1488 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]: dispatch 2024-05-20T22:12:28.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:28 smithi050 bash[21866]: audit 2024-05-20T22:12:27.056940+0000 mon.c (mon.2) 185 : audit 1 from='client.? v1:172.21.15.50:0/2627702492' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi050-63936-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:28.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:28 smithi050 bash[21866]: audit 2024-05-20T22:12:27.058357+0000 mon.a (mon.0) 1489 : audit 1 from='client.25826 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi050-63936-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:28.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:28 smithi050 bash[28929]: audit 2024-05-20T22:12:27.041043+0000 mon.a (mon.0) 1485 : audit 1 from='client.25814 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi050-64159-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]': finished 2024-05-20T22:12:28.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:28 smithi050 bash[28929]: audit 2024-05-20T22:12:27.041291+0000 mon.a (mon.0) 1486 : audit 1 from='client.? v1:172.21.15.50:0/633884821' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi050-63944-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:28.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:28 smithi050 bash[28929]: cluster 2024-05-20T22:12:27.050745+0000 mon.a (mon.0) 1487 : cluster 0 osdmap e151: 8 total, 8 up, 8 in 2024-05-20T22:12:28.449 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:28 smithi050 bash[28929]: audit 2024-05-20T22:12:27.055944+0000 mon.a (mon.0) 1488 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]: dispatch 2024-05-20T22:12:28.451 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:28 smithi050 bash[28929]: audit 2024-05-20T22:12:27.056940+0000 mon.c (mon.2) 185 : audit 1 from='client.? v1:172.21.15.50:0/2627702492' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi050-63936-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:28.451 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:28 smithi050 bash[28929]: audit 2024-05-20T22:12:27.058357+0000 mon.a (mon.0) 1489 : audit 1 from='client.25826 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi050-63936-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:29.071 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: Running main() from gmock_main.cc 2024-05-20T22:12:29.071 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2024-05-20T22:12:29.071 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [----------] Global test environment set-up. 2024-05-20T22:12:29.071 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2024-05-20T22:12:29.071 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2024-05-20T22:12:29.071 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (7811 ms) 2024-05-20T22:12:29.071 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2024-05-20T22:12:29.071 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (7113 ms) 2024-05-20T22:12:29.072 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2024-05-20T22:12:29.072 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (8099 ms) 2024-05-20T22:12:29.072 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2024-05-20T22:12:29.072 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (3451 ms) 2024-05-20T22:12:29.072 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (26474 ms total) 2024-05-20T22:12:29.072 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: 2024-05-20T22:12:29.072 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-05-20T22:12:29.072 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-05-20T22:12:29.072 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (4973 ms) 2024-05-20T22:12:29.072 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-05-20T22:12:29.072 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (7382 ms) 2024-05-20T22:12:29.072 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-05-20T22:12:29.073 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (7813 ms) 2024-05-20T22:12:29.073 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (20168 ms total) 2024-05-20T22:12:29.073 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: 2024-05-20T22:12:29.073 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2024-05-20T22:12:29.073 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2024-05-20T22:12:29.073 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (3973 ms) 2024-05-20T22:12:29.073 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-05-20T22:12:29.073 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (2015 ms) 2024-05-20T22:12:29.073 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2024-05-20T22:12:29.074 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (1972 ms) 2024-05-20T22:12:29.074 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-05-20T22:12:29.074 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (2022 ms) 2024-05-20T22:12:29.074 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (9983 ms total) 2024-05-20T22:12:29.075 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: 2024-05-20T22:12:29.075 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-05-20T22:12:29.075 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-05-20T22:12:29.075 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4093 ms) 2024-05-20T22:12:29.076 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-05-20T22:12:29.076 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (4442 ms) 2024-05-20T22:12:29.076 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8535 ms total) 2024-05-20T22:12:29.076 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: 2024-05-20T22:12:29.076 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [----------] Global test environment tear-down 2024-05-20T22:12:29.076 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (102245 ms total) 2024-05-20T22:12:29.076 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ PASSED ] 13 tests. 2024-05-20T22:12:29.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:29 smithi145 bash[23893]: audit 2024-05-20T22:12:27.729913+0000 mgr.y (mgr.14592) 257 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:12:29.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:29 smithi145 bash[23893]: cluster 2024-05-20T22:12:28.037437+0000 mgr.y (mgr.14592) 258 : cluster 0 pgmap v239: 460 pgs: 72 unknown, 388 active+clean; 590 KiB data, 463 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:12:29.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:29 smithi145 bash[23893]: audit 2024-05-20T22:12:28.045676+0000 mon.a (mon.0) 1490 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]': finished 2024-05-20T22:12:29.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:29 smithi145 bash[23893]: audit 2024-05-20T22:12:28.045872+0000 mon.a (mon.0) 1491 : audit 1 from='client.25826 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi050-63936-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:29.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:29 smithi145 bash[23893]: cluster 2024-05-20T22:12:28.057368+0000 mon.a (mon.0) 1492 : cluster 0 osdmap e152: 8 total, 8 up, 8 in 2024-05-20T22:12:29.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:29 smithi145 bash[23893]: audit 2024-05-20T22:12:28.059678+0000 mon.c (mon.2) 186 : audit 1 from='client.? v1:172.21.15.50:0/4150303032' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi050-64061-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:29.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:29 smithi145 bash[23893]: audit 2024-05-20T22:12:28.063709+0000 mon.a (mon.0) 1493 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]: dispatch 2024-05-20T22:12:29.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:29 smithi145 bash[23893]: audit 2024-05-20T22:12:28.065068+0000 mon.a (mon.0) 1494 : audit 1 from='client.25829 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi050-64061-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:29.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:29 smithi145 bash[23893]: cluster 2024-05-20T22:12:28.557209+0000 mon.a (mon.0) 1495 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:29.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:29 smithi145 bash[23893]: audit 2024-05-20T22:12:29.050504+0000 mon.a (mon.0) 1496 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]': finished 2024-05-20T22:12:29.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:29 smithi145 bash[23893]: audit 2024-05-20T22:12:29.050636+0000 mon.a (mon.0) 1497 : audit 1 from='client.25829 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi050-64061-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:29.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:29 smithi145 bash[23893]: cluster 2024-05-20T22:12:29.058954+0000 mon.a (mon.0) 1498 : cluster 0 osdmap e153: 8 total, 8 up, 8 in 2024-05-20T22:12:29.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:29 smithi145 bash[23893]: audit 2024-05-20T22:12:29.061695+0000 mon.c (mon.2) 187 : audit 1 from='client.? v1:172.21.15.50:0/381308502' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi050-63944-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:29.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:29 smithi145 bash[23893]: audit 2024-05-20T22:12:29.071213+0000 mon.a (mon.0) 1499 : audit 1 from='client.25835 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi050-63944-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:29.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:29 smithi050 bash[21866]: audit 2024-05-20T22:12:27.729913+0000 mgr.y (mgr.14592) 257 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:12:29.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:29 smithi050 bash[21866]: cluster 2024-05-20T22:12:28.037437+0000 mgr.y (mgr.14592) 258 : cluster 0 pgmap v239: 460 pgs: 72 unknown, 388 active+clean; 590 KiB data, 463 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:12:29.394 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:29 smithi050 bash[21866]: audit 2024-05-20T22:12:28.045676+0000 mon.a (mon.0) 1490 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]': finished 2024-05-20T22:12:29.394 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:29 smithi050 bash[21866]: audit 2024-05-20T22:12:28.045872+0000 mon.a (mon.0) 1491 : audit 1 from='client.25826 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi050-63936-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:29.394 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:29 smithi050 bash[21866]: cluster 2024-05-20T22:12:28.057368+0000 mon.a (mon.0) 1492 : cluster 0 osdmap e152: 8 total, 8 up, 8 in 2024-05-20T22:12:29.394 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:29 smithi050 bash[21866]: audit 2024-05-20T22:12:28.059678+0000 mon.c (mon.2) 186 : audit 1 from='client.? v1:172.21.15.50:0/4150303032' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi050-64061-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:29.394 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:29 smithi050 bash[21866]: audit 2024-05-20T22:12:28.063709+0000 mon.a (mon.0) 1493 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]: dispatch 2024-05-20T22:12:29.394 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:29 smithi050 bash[21866]: audit 2024-05-20T22:12:28.065068+0000 mon.a (mon.0) 1494 : audit 1 from='client.25829 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi050-64061-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:29.394 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:29 smithi050 bash[21866]: cluster 2024-05-20T22:12:28.557209+0000 mon.a (mon.0) 1495 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:29.394 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:29 smithi050 bash[21866]: audit 2024-05-20T22:12:29.050504+0000 mon.a (mon.0) 1496 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]': finished 2024-05-20T22:12:29.395 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:29 smithi050 bash[21866]: audit 2024-05-20T22:12:29.050636+0000 mon.a (mon.0) 1497 : audit 1 from='client.25829 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi050-64061-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:29.395 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:29 smithi050 bash[21866]: cluster 2024-05-20T22:12:29.058954+0000 mon.a (mon.0) 1498 : cluster 0 osdmap e153: 8 total, 8 up, 8 in 2024-05-20T22:12:29.395 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:29 smithi050 bash[21866]: audit 2024-05-20T22:12:29.061695+0000 mon.c (mon.2) 187 : audit 1 from='client.? v1:172.21.15.50:0/381308502' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi050-63944-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:29.395 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:29 smithi050 bash[21866]: audit 2024-05-20T22:12:29.071213+0000 mon.a (mon.0) 1499 : audit 1 from='client.25835 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi050-63944-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:29.395 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:29 smithi050 bash[28929]: audit 2024-05-20T22:12:27.729913+0000 mgr.y (mgr.14592) 257 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:12:29.395 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:29 smithi050 bash[28929]: cluster 2024-05-20T22:12:28.037437+0000 mgr.y (mgr.14592) 258 : cluster 0 pgmap v239: 460 pgs: 72 unknown, 388 active+clean; 590 KiB data, 463 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:12:29.396 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:29 smithi050 bash[28929]: audit 2024-05-20T22:12:28.045676+0000 mon.a (mon.0) 1490 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]': finished 2024-05-20T22:12:29.396 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:29 smithi050 bash[28929]: audit 2024-05-20T22:12:28.045872+0000 mon.a (mon.0) 1491 : audit 1 from='client.25826 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi050-63936-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:29.396 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:29 smithi050 bash[28929]: cluster 2024-05-20T22:12:28.057368+0000 mon.a (mon.0) 1492 : cluster 0 osdmap e152: 8 total, 8 up, 8 in 2024-05-20T22:12:29.396 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:29 smithi050 bash[28929]: audit 2024-05-20T22:12:28.059678+0000 mon.c (mon.2) 186 : audit 1 from='client.? v1:172.21.15.50:0/4150303032' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi050-64061-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:29.396 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:29 smithi050 bash[28929]: audit 2024-05-20T22:12:28.063709+0000 mon.a (mon.0) 1493 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]: dispatch 2024-05-20T22:12:29.396 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:29 smithi050 bash[28929]: audit 2024-05-20T22:12:28.065068+0000 mon.a (mon.0) 1494 : audit 1 from='client.25829 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi050-64061-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:29.397 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:29 smithi050 bash[28929]: cluster 2024-05-20T22:12:28.557209+0000 mon.a (mon.0) 1495 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:29.397 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:29 smithi050 bash[28929]: audit 2024-05-20T22:12:29.050504+0000 mon.a (mon.0) 1496 : audit 1 from='client.? v1:172.21.15.50:0/3245712038' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi050-64146-15"}]': finished 2024-05-20T22:12:29.397 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:29 smithi050 bash[28929]: audit 2024-05-20T22:12:29.050636+0000 mon.a (mon.0) 1497 : audit 1 from='client.25829 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi050-64061-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:29.397 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:29 smithi050 bash[28929]: cluster 2024-05-20T22:12:29.058954+0000 mon.a (mon.0) 1498 : cluster 0 osdmap e153: 8 total, 8 up, 8 in 2024-05-20T22:12:29.397 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:29 smithi050 bash[28929]: audit 2024-05-20T22:12:29.061695+0000 mon.c (mon.2) 187 : audit 1 from='client.? v1:172.21.15.50:0/381308502' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi050-63944-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:29.397 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:29 smithi050 bash[28929]: audit 2024-05-20T22:12:29.071213+0000 mon.a (mon.0) 1499 : audit 1 from='client.25835 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi050-63944-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:29.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:12:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:12:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:12:31.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:31 smithi145 bash[23893]: cluster 2024-05-20T22:12:30.041107+0000 mgr.y (mgr.14592) 259 : cluster 0 pgmap v242: 460 pgs: 32 creating+peering, 428 active+clean; 598 KiB data, 503 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 1 op/s 2024-05-20T22:12:31.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:31 smithi145 bash[23893]: audit 2024-05-20T22:12:30.054833+0000 mon.a (mon.0) 1500 : audit 1 from='client.25835 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi050-63944-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:31.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:31 smithi145 bash[23893]: cluster 2024-05-20T22:12:30.065396+0000 mon.a (mon.0) 1501 : cluster 0 osdmap e154: 8 total, 8 up, 8 in 2024-05-20T22:12:31.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:31 smithi145 bash[23893]: audit 2024-05-20T22:12:30.073635+0000 mon.a (mon.0) 1502 : audit 1 from='client.? v1:172.21.15.50:0/2474039226' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi050-63936-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:31.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:31 smithi050 bash[21866]: cluster 2024-05-20T22:12:30.041107+0000 mgr.y (mgr.14592) 259 : cluster 0 pgmap v242: 460 pgs: 32 creating+peering, 428 active+clean; 598 KiB data, 503 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 1 op/s 2024-05-20T22:12:31.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:31 smithi050 bash[21866]: audit 2024-05-20T22:12:30.054833+0000 mon.a (mon.0) 1500 : audit 1 from='client.25835 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi050-63944-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:31.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:31 smithi050 bash[21866]: cluster 2024-05-20T22:12:30.065396+0000 mon.a (mon.0) 1501 : cluster 0 osdmap e154: 8 total, 8 up, 8 in 2024-05-20T22:12:31.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:31 smithi050 bash[21866]: audit 2024-05-20T22:12:30.073635+0000 mon.a (mon.0) 1502 : audit 1 from='client.? v1:172.21.15.50:0/2474039226' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi050-63936-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:31.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:31 smithi050 bash[28929]: cluster 2024-05-20T22:12:30.041107+0000 mgr.y (mgr.14592) 259 : cluster 0 pgmap v242: 460 pgs: 32 creating+peering, 428 active+clean; 598 KiB data, 503 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 1 op/s 2024-05-20T22:12:31.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:31 smithi050 bash[28929]: audit 2024-05-20T22:12:30.054833+0000 mon.a (mon.0) 1500 : audit 1 from='client.25835 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi050-63944-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:31.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:31 smithi050 bash[28929]: cluster 2024-05-20T22:12:30.065396+0000 mon.a (mon.0) 1501 : cluster 0 osdmap e154: 8 total, 8 up, 8 in 2024-05-20T22:12:31.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:31 smithi050 bash[28929]: audit 2024-05-20T22:12:30.073635+0000 mon.a (mon.0) 1502 : audit 1 from='client.? v1:172.21.15.50:0/2474039226' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi050-63936-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:32.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:32 smithi145 bash[23893]: audit 2024-05-20T22:12:31.059021+0000 mon.a (mon.0) 1503 : audit 1 from='client.? v1:172.21.15.50:0/2474039226' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi050-63936-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:32.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:32 smithi145 bash[23893]: cluster 2024-05-20T22:12:31.074666+0000 mon.a (mon.0) 1504 : cluster 0 osdmap e155: 8 total, 8 up, 8 in 2024-05-20T22:12:32.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:32 smithi145 bash[23893]: audit 2024-05-20T22:12:31.089251+0000 mon.a (mon.0) 1505 : audit 1 from='client.? v1:172.21.15.50:0/525808724' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi050-64061-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:32.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:32 smithi145 bash[23893]: audit 2024-05-20T22:12:32.063195+0000 mon.a (mon.0) 1506 : audit 1 from='client.? v1:172.21.15.50:0/525808724' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi050-64061-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:32.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:32 smithi145 bash[23893]: cluster 2024-05-20T22:12:32.073800+0000 mon.a (mon.0) 1507 : cluster 0 osdmap e156: 8 total, 8 up, 8 in 2024-05-20T22:12:32.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:32 smithi145 bash[23893]: audit 2024-05-20T22:12:32.081903+0000 mon.a (mon.0) 1508 : audit 1 from='client.? v1:172.21.15.50:0/379083546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi050-63944-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:32.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:32 smithi050 bash[21866]: audit 2024-05-20T22:12:31.059021+0000 mon.a (mon.0) 1503 : audit 1 from='client.? v1:172.21.15.50:0/2474039226' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi050-63936-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:32.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:32 smithi050 bash[21866]: cluster 2024-05-20T22:12:31.074666+0000 mon.a (mon.0) 1504 : cluster 0 osdmap e155: 8 total, 8 up, 8 in 2024-05-20T22:12:32.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:32 smithi050 bash[21866]: audit 2024-05-20T22:12:31.089251+0000 mon.a (mon.0) 1505 : audit 1 from='client.? v1:172.21.15.50:0/525808724' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi050-64061-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:32.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:32 smithi050 bash[21866]: audit 2024-05-20T22:12:32.063195+0000 mon.a (mon.0) 1506 : audit 1 from='client.? v1:172.21.15.50:0/525808724' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi050-64061-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:32.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:32 smithi050 bash[21866]: cluster 2024-05-20T22:12:32.073800+0000 mon.a (mon.0) 1507 : cluster 0 osdmap e156: 8 total, 8 up, 8 in 2024-05-20T22:12:32.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:32 smithi050 bash[21866]: audit 2024-05-20T22:12:32.081903+0000 mon.a (mon.0) 1508 : audit 1 from='client.? v1:172.21.15.50:0/379083546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi050-63944-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:32.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:32 smithi050 bash[28929]: audit 2024-05-20T22:12:31.059021+0000 mon.a (mon.0) 1503 : audit 1 from='client.? v1:172.21.15.50:0/2474039226' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi050-63936-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:32.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:32 smithi050 bash[28929]: cluster 2024-05-20T22:12:31.074666+0000 mon.a (mon.0) 1504 : cluster 0 osdmap e155: 8 total, 8 up, 8 in 2024-05-20T22:12:32.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:32 smithi050 bash[28929]: audit 2024-05-20T22:12:31.089251+0000 mon.a (mon.0) 1505 : audit 1 from='client.? v1:172.21.15.50:0/525808724' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi050-64061-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:32.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:32 smithi050 bash[28929]: audit 2024-05-20T22:12:32.063195+0000 mon.a (mon.0) 1506 : audit 1 from='client.? v1:172.21.15.50:0/525808724' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi050-64061-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:32.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:32 smithi050 bash[28929]: cluster 2024-05-20T22:12:32.073800+0000 mon.a (mon.0) 1507 : cluster 0 osdmap e156: 8 total, 8 up, 8 in 2024-05-20T22:12:32.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:32 smithi050 bash[28929]: audit 2024-05-20T22:12:32.081903+0000 mon.a (mon.0) 1508 : audit 1 from='client.? v1:172.21.15.50:0/379083546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi050-63944-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:33.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:33 smithi145 bash[23893]: cluster 2024-05-20T22:12:32.042174+0000 mgr.y (mgr.14592) 260 : cluster 0 pgmap v245: 460 pgs: 64 unknown, 396 active+clean; 590 KiB data, 503 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:12:33.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:33 smithi145 bash[23893]: audit 2024-05-20T22:12:33.067381+0000 mon.a (mon.0) 1509 : audit 1 from='client.? v1:172.21.15.50:0/379083546' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi050-63944-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:33.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:33 smithi145 bash[23893]: cluster 2024-05-20T22:12:33.078184+0000 mon.a (mon.0) 1510 : cluster 0 osdmap e157: 8 total, 8 up, 8 in 2024-05-20T22:12:33.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:33 smithi145 bash[23893]: audit 2024-05-20T22:12:33.083834+0000 mon.a (mon.0) 1511 : audit 1 from='client.? v1:172.21.15.50:0/1191817584' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi050-63936-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:33.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:33 smithi050 bash[21866]: cluster 2024-05-20T22:12:32.042174+0000 mgr.y (mgr.14592) 260 : cluster 0 pgmap v245: 460 pgs: 64 unknown, 396 active+clean; 590 KiB data, 503 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:12:33.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:33 smithi050 bash[21866]: audit 2024-05-20T22:12:33.067381+0000 mon.a (mon.0) 1509 : audit 1 from='client.? v1:172.21.15.50:0/379083546' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi050-63944-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:33.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:33 smithi050 bash[21866]: cluster 2024-05-20T22:12:33.078184+0000 mon.a (mon.0) 1510 : cluster 0 osdmap e157: 8 total, 8 up, 8 in 2024-05-20T22:12:33.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:33 smithi050 bash[21866]: audit 2024-05-20T22:12:33.083834+0000 mon.a (mon.0) 1511 : audit 1 from='client.? v1:172.21.15.50:0/1191817584' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi050-63936-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:33.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:33 smithi050 bash[28929]: cluster 2024-05-20T22:12:32.042174+0000 mgr.y (mgr.14592) 260 : cluster 0 pgmap v245: 460 pgs: 64 unknown, 396 active+clean; 590 KiB data, 503 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:12:33.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:33 smithi050 bash[28929]: audit 2024-05-20T22:12:33.067381+0000 mon.a (mon.0) 1509 : audit 1 from='client.? v1:172.21.15.50:0/379083546' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi050-63944-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:33.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:33 smithi050 bash[28929]: cluster 2024-05-20T22:12:33.078184+0000 mon.a (mon.0) 1510 : cluster 0 osdmap e157: 8 total, 8 up, 8 in 2024-05-20T22:12:33.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:33 smithi050 bash[28929]: audit 2024-05-20T22:12:33.083834+0000 mon.a (mon.0) 1511 : audit 1 from='client.? v1:172.21.15.50:0/1191817584' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi050-63936-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:34.076 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2024-05-20T22:12:34.076 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2024-05-20T22:12:34.076 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2024-05-20T22:12:34.076 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2024-05-20T22:12:34.076 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: seed 64159 2024-05-20T22:12:34.076 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-05-20T22:12:34.076 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (5362 ms) 2024-05-20T22:12:34.076 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-05-20T22:12:34.077 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (4213 ms) 2024-05-20T22:12:34.077 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-05-20T22:12:34.077 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (3294 ms) 2024-05-20T22:12:34.077 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-05-20T22:12:34.077 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (4281 ms) 2024-05-20T22:12:34.077 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-05-20T22:12:34.077 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (5830 ms) 2024-05-20T22:12:34.077 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (22980 ms total) 2024-05-20T22:12:34.077 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: 2024-05-20T22:12:34.077 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-05-20T22:12:34.077 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-05-20T22:12:34.077 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (6026 ms) 2024-05-20T22:12:34.078 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-05-20T22:12:34.078 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (6297 ms) 2024-05-20T22:12:34.078 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-05-20T22:12:34.078 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (8229 ms) 2024-05-20T22:12:34.078 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-05-20T22:12:34.078 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (3964 ms) 2024-05-20T22:12:34.078 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-05-20T22:12:34.078 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2922 ms) 2024-05-20T22:12:34.078 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-05-20T22:12:34.078 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: ./src/test/librados/snapshots_cxx.cc:463: Skipped 2024-05-20T22:12:34.078 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: 2024-05-20T22:12:34.078 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-05-20T22:12:34.078 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-05-20T22:12:34.079 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi050-64159-7 2024-05-20T22:12:34.079 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: waiting for snaps to purge 2024-05-20T22:12:34.079 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17505 ms) 2024-05-20T22:12:34.079 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (44943 ms total) 2024-05-20T22:12:34.079 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: 2024-05-20T22:12:34.079 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-05-20T22:12:34.079 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-05-20T22:12:34.079 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (11 ms) 2024-05-20T22:12:34.079 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-05-20T22:12:34.079 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5089 ms) 2024-05-20T22:12:34.079 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5100 ms total) 2024-05-20T22:12:34.079 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: 2024-05-20T22:12:34.079 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2024-05-20T22:12:34.079 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-05-20T22:12:34.080 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3009 ms) 2024-05-20T22:12:34.080 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-05-20T22:12:34.080 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (2008 ms) 2024-05-20T22:12:34.080 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-05-20T22:12:34.080 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (2008 ms) 2024-05-20T22:12:34.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:34 smithi145 bash[23893]: audit 2024-05-20T22:12:33.136856+0000 mon.c (mon.2) 188 : audit 1 from='client.? v1:172.21.15.50:0/3328451960' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:34.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:34 smithi145 bash[23893]: audit 2024-05-20T22:12:33.137771+0000 mon.a (mon.0) 1512 : audit 1 from='client.25865 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:34.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:34 smithi145 bash[23893]: audit 2024-05-20T22:12:33.140384+0000 mon.c (mon.2) 189 : audit 1 from='client.? v1:172.21.15.50:0/3328451960' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:34.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:34 smithi145 bash[23893]: audit 2024-05-20T22:12:33.141075+0000 mon.a (mon.0) 1513 : audit 1 from='client.25865 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:34.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:34 smithi145 bash[23893]: audit 2024-05-20T22:12:33.141732+0000 mon.c (mon.2) 190 : audit 1 from='client.? v1:172.21.15.50:0/3328451960' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:34.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:34 smithi145 bash[23893]: audit 2024-05-20T22:12:33.142129+0000 mon.a (mon.0) 1514 : audit 1 from='client.25865 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:34.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:34 smithi145 bash[23893]: audit 2024-05-20T22:12:34.070615+0000 mon.a (mon.0) 1515 : audit 1 from='client.? v1:172.21.15.50:0/1191817584' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi050-63936-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:34.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:34 smithi145 bash[23893]: audit 2024-05-20T22:12:34.070763+0000 mon.a (mon.0) 1516 : audit 1 from='client.25865 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:34.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:34 smithi145 bash[23893]: cluster 2024-05-20T22:12:34.079768+0000 mon.a (mon.0) 1517 : cluster 0 osdmap e158: 8 total, 8 up, 8 in 2024-05-20T22:12:34.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:34 smithi145 bash[23893]: audit 2024-05-20T22:12:34.080122+0000 mon.c (mon.2) 191 : audit 1 from='client.? v1:172.21.15.50:0/3328451960' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi050-64061-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:34.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:34 smithi145 bash[23893]: audit 2024-05-20T22:12:34.089988+0000 mon.a (mon.0) 1518 : audit 1 from='client.25865 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi050-64061-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:34.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:34 smithi050 bash[28929]: audit 2024-05-20T22:12:33.136856+0000 mon.c (mon.2) 188 : audit 1 from='client.? v1:172.21.15.50:0/3328451960' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:34.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:34 smithi050 bash[28929]: audit 2024-05-20T22:12:33.137771+0000 mon.a (mon.0) 1512 : audit 1 from='client.25865 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:34.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:34 smithi050 bash[28929]: audit 2024-05-20T22:12:33.140384+0000 mon.c (mon.2) 189 : audit 1 from='client.? v1:172.21.15.50:0/3328451960' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:34.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:34 smithi050 bash[28929]: audit 2024-05-20T22:12:33.141075+0000 mon.a (mon.0) 1513 : audit 1 from='client.25865 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:34.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:34 smithi050 bash[28929]: audit 2024-05-20T22:12:33.141732+0000 mon.c (mon.2) 190 : audit 1 from='client.? v1:172.21.15.50:0/3328451960' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:34.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:34 smithi050 bash[28929]: audit 2024-05-20T22:12:33.142129+0000 mon.a (mon.0) 1514 : audit 1 from='client.25865 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:34.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:34 smithi050 bash[28929]: audit 2024-05-20T22:12:34.070615+0000 mon.a (mon.0) 1515 : audit 1 from='client.? v1:172.21.15.50:0/1191817584' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi050-63936-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:34.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:34 smithi050 bash[28929]: audit 2024-05-20T22:12:34.070763+0000 mon.a (mon.0) 1516 : audit 1 from='client.25865 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:34.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:34 smithi050 bash[28929]: cluster 2024-05-20T22:12:34.079768+0000 mon.a (mon.0) 1517 : cluster 0 osdmap e158: 8 total, 8 up, 8 in 2024-05-20T22:12:34.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:34 smithi050 bash[28929]: audit 2024-05-20T22:12:34.080122+0000 mon.c (mon.2) 191 : audit 1 from='client.? v1:172.21.15.50:0/3328451960' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi050-64061-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:34.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:34 smithi050 bash[28929]: audit 2024-05-20T22:12:34.089988+0000 mon.a (mon.0) 1518 : audit 1 from='client.25865 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi050-64061-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:34.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:34 smithi050 bash[21866]: audit 2024-05-20T22:12:33.136856+0000 mon.c (mon.2) 188 : audit 1 from='client.? v1:172.21.15.50:0/3328451960' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:34.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:34 smithi050 bash[21866]: audit 2024-05-20T22:12:33.137771+0000 mon.a (mon.0) 1512 : audit 1 from='client.25865 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:34.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:34 smithi050 bash[21866]: audit 2024-05-20T22:12:33.140384+0000 mon.c (mon.2) 189 : audit 1 from='client.? v1:172.21.15.50:0/3328451960' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:34.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:34 smithi050 bash[21866]: audit 2024-05-20T22:12:33.141075+0000 mon.a (mon.0) 1513 : audit 1 from='client.25865 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:34.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:34 smithi050 bash[21866]: audit 2024-05-20T22:12:33.141732+0000 mon.c (mon.2) 190 : audit 1 from='client.? v1:172.21.15.50:0/3328451960' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:34.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:34 smithi050 bash[21866]: audit 2024-05-20T22:12:33.142129+0000 mon.a (mon.0) 1514 : audit 1 from='client.25865 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:34.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:34 smithi050 bash[21866]: audit 2024-05-20T22:12:34.070615+0000 mon.a (mon.0) 1515 : audit 1 from='client.? v1:172.21.15.50:0/1191817584' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi050-63936-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:34.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:34 smithi050 bash[21866]: audit 2024-05-20T22:12:34.070763+0000 mon.a (mon.0) 1516 : audit 1 from='client.25865 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:34.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:34 smithi050 bash[21866]: cluster 2024-05-20T22:12:34.079768+0000 mon.a (mon.0) 1517 : cluster 0 osdmap e158: 8 total, 8 up, 8 in 2024-05-20T22:12:34.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:34 smithi050 bash[21866]: audit 2024-05-20T22:12:34.080122+0000 mon.c (mon.2) 191 : audit 1 from='client.? v1:172.21.15.50:0/3328451960' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi050-64061-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:34.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:34 smithi050 bash[21866]: audit 2024-05-20T22:12:34.089988+0000 mon.a (mon.0) 1518 : audit 1 from='client.25865 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi050-64061-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:35.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:35 smithi145 bash[23893]: cluster 2024-05-20T22:12:34.043247+0000 mgr.y (mgr.14592) 261 : cluster 0 pgmap v248: 460 pgs: 64 unknown, 396 active+clean; 590 KiB data, 503 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:35.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:35 smithi145 bash[23893]: cluster 2024-05-20T22:12:35.551346+0000 mon.a (mon.0) 1519 : cluster 0 osdmap e159: 8 total, 8 up, 8 in 2024-05-20T22:12:35.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:35 smithi050 bash[21866]: cluster 2024-05-20T22:12:34.043247+0000 mgr.y (mgr.14592) 261 : cluster 0 pgmap v248: 460 pgs: 64 unknown, 396 active+clean; 590 KiB data, 503 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:35.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:35 smithi050 bash[21866]: cluster 2024-05-20T22:12:35.551346+0000 mon.a (mon.0) 1519 : cluster 0 osdmap e159: 8 total, 8 up, 8 in 2024-05-20T22:12:35.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:35 smithi050 bash[28929]: cluster 2024-05-20T22:12:34.043247+0000 mgr.y (mgr.14592) 261 : cluster 0 pgmap v248: 460 pgs: 64 unknown, 396 active+clean; 590 KiB data, 503 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:35.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:35 smithi050 bash[28929]: cluster 2024-05-20T22:12:35.551346+0000 mon.a (mon.0) 1519 : cluster 0 osdmap e159: 8 total, 8 up, 8 in 2024-05-20T22:12:36.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:36 smithi145 bash[23893]: audit 2024-05-20T22:12:35.554543+0000 mon.a (mon.0) 1520 : audit 1 from='client.? v1:172.21.15.50:0/110681453' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi050-63944-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:36.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:36 smithi145 bash[23893]: audit 2024-05-20T22:12:36.025243+0000 mon.a (mon.0) 1521 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:12:36.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:36 smithi145 bash[23893]: audit 2024-05-20T22:12:36.079728+0000 mon.a (mon.0) 1522 : audit 1 from='client.25865 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi050-64061-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi050-64061-36"}]': finished 2024-05-20T22:12:36.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:36 smithi145 bash[23893]: audit 2024-05-20T22:12:36.080047+0000 mon.a (mon.0) 1523 : audit 1 from='client.? v1:172.21.15.50:0/110681453' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi050-63944-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:36.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:36 smithi145 bash[23893]: cluster 2024-05-20T22:12:36.092012+0000 mon.a (mon.0) 1524 : cluster 0 osdmap e160: 8 total, 8 up, 8 in 2024-05-20T22:12:36.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:36 smithi145 bash[23893]: audit 2024-05-20T22:12:36.093701+0000 mon.c (mon.2) 192 : audit 1 from='client.? v1:172.21.15.50:0/13383333' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi050-63936-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:36.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:36 smithi145 bash[23893]: audit 2024-05-20T22:12:36.096555+0000 mon.a (mon.0) 1525 : audit 1 from='client.25877 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi050-63936-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:36.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:36 smithi050 bash[21866]: audit 2024-05-20T22:12:35.554543+0000 mon.a (mon.0) 1520 : audit 1 from='client.? v1:172.21.15.50:0/110681453' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi050-63944-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:36.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:36 smithi050 bash[21866]: audit 2024-05-20T22:12:36.025243+0000 mon.a (mon.0) 1521 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:12:36.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:36 smithi050 bash[21866]: audit 2024-05-20T22:12:36.079728+0000 mon.a (mon.0) 1522 : audit 1 from='client.25865 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi050-64061-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi050-64061-36"}]': finished 2024-05-20T22:12:36.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:36 smithi050 bash[21866]: audit 2024-05-20T22:12:36.080047+0000 mon.a (mon.0) 1523 : audit 1 from='client.? v1:172.21.15.50:0/110681453' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi050-63944-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:36.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:36 smithi050 bash[21866]: cluster 2024-05-20T22:12:36.092012+0000 mon.a (mon.0) 1524 : cluster 0 osdmap e160: 8 total, 8 up, 8 in 2024-05-20T22:12:36.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:36 smithi050 bash[21866]: audit 2024-05-20T22:12:36.093701+0000 mon.c (mon.2) 192 : audit 1 from='client.? v1:172.21.15.50:0/13383333' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi050-63936-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:36.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:36 smithi050 bash[21866]: audit 2024-05-20T22:12:36.096555+0000 mon.a (mon.0) 1525 : audit 1 from='client.25877 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi050-63936-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:36.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:36 smithi050 bash[28929]: audit 2024-05-20T22:12:35.554543+0000 mon.a (mon.0) 1520 : audit 1 from='client.? v1:172.21.15.50:0/110681453' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi050-63944-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:36.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:36 smithi050 bash[28929]: audit 2024-05-20T22:12:36.025243+0000 mon.a (mon.0) 1521 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:12:36.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:36 smithi050 bash[28929]: audit 2024-05-20T22:12:36.079728+0000 mon.a (mon.0) 1522 : audit 1 from='client.25865 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi050-64061-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi050-64061-36"}]': finished 2024-05-20T22:12:36.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:36 smithi050 bash[28929]: audit 2024-05-20T22:12:36.080047+0000 mon.a (mon.0) 1523 : audit 1 from='client.? v1:172.21.15.50:0/110681453' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi050-63944-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:36.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:36 smithi050 bash[28929]: cluster 2024-05-20T22:12:36.092012+0000 mon.a (mon.0) 1524 : cluster 0 osdmap e160: 8 total, 8 up, 8 in 2024-05-20T22:12:36.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:36 smithi050 bash[28929]: audit 2024-05-20T22:12:36.093701+0000 mon.c (mon.2) 192 : audit 1 from='client.? v1:172.21.15.50:0/13383333' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi050-63936-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:36.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:36 smithi050 bash[28929]: audit 2024-05-20T22:12:36.096555+0000 mon.a (mon.0) 1525 : audit 1 from='client.25877 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi050-63936-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:37.890 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:12:37 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:12:37.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:37 smithi145 bash[23893]: cluster 2024-05-20T22:12:36.043816+0000 mgr.y (mgr.14592) 262 : cluster 0 pgmap v251: 428 pgs: 32 unknown, 396 active+clean; 590 KiB data, 504 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-05-20T22:12:37.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:37 smithi145 bash[23893]: audit 2024-05-20T22:12:37.083048+0000 mon.a (mon.0) 1526 : audit 1 from='client.25877 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi050-63936-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:37.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:37 smithi145 bash[23893]: cluster 2024-05-20T22:12:37.091176+0000 mon.a (mon.0) 1527 : cluster 0 osdmap e161: 8 total, 8 up, 8 in 2024-05-20T22:12:37.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:37 smithi145 bash[23893]: audit 2024-05-20T22:12:37.094879+0000 mon.c (mon.2) 193 : audit 1 from='client.? v1:172.21.15.50:0/1686475988' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:37.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:37 smithi145 bash[23893]: audit 2024-05-20T22:12:37.095424+0000 mon.a (mon.0) 1528 : audit 1 from='client.25814 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:37.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:37 smithi050 bash[21866]: cluster 2024-05-20T22:12:36.043816+0000 mgr.y (mgr.14592) 262 : cluster 0 pgmap v251: 428 pgs: 32 unknown, 396 active+clean; 590 KiB data, 504 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-05-20T22:12:37.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:37 smithi050 bash[21866]: audit 2024-05-20T22:12:37.083048+0000 mon.a (mon.0) 1526 : audit 1 from='client.25877 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi050-63936-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:37.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:37 smithi050 bash[21866]: cluster 2024-05-20T22:12:37.091176+0000 mon.a (mon.0) 1527 : cluster 0 osdmap e161: 8 total, 8 up, 8 in 2024-05-20T22:12:37.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:37 smithi050 bash[21866]: audit 2024-05-20T22:12:37.094879+0000 mon.c (mon.2) 193 : audit 1 from='client.? v1:172.21.15.50:0/1686475988' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:37.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:37 smithi050 bash[21866]: audit 2024-05-20T22:12:37.095424+0000 mon.a (mon.0) 1528 : audit 1 from='client.25814 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:37.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:37 smithi050 bash[28929]: cluster 2024-05-20T22:12:36.043816+0000 mgr.y (mgr.14592) 262 : cluster 0 pgmap v251: 428 pgs: 32 unknown, 396 active+clean; 590 KiB data, 504 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-05-20T22:12:37.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:37 smithi050 bash[28929]: audit 2024-05-20T22:12:37.083048+0000 mon.a (mon.0) 1526 : audit 1 from='client.25877 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi050-63936-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:37.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:37 smithi050 bash[28929]: cluster 2024-05-20T22:12:37.091176+0000 mon.a (mon.0) 1527 : cluster 0 osdmap e161: 8 total, 8 up, 8 in 2024-05-20T22:12:37.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:37 smithi050 bash[28929]: audit 2024-05-20T22:12:37.094879+0000 mon.c (mon.2) 193 : audit 1 from='client.? v1:172.21.15.50:0/1686475988' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:37.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:37 smithi050 bash[28929]: audit 2024-05-20T22:12:37.095424+0000 mon.a (mon.0) 1528 : audit 1 from='client.25814 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:39.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:39 smithi145 bash[23893]: audit 2024-05-20T22:12:37.741387+0000 mgr.y (mgr.14592) 263 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:12:39.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:39 smithi145 bash[23893]: cluster 2024-05-20T22:12:38.044747+0000 mgr.y (mgr.14592) 264 : cluster 0 pgmap v254: 428 pgs: 40 unknown, 388 active+clean; 590 KiB data, 504 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:12:39.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:39 smithi145 bash[23893]: audit 2024-05-20T22:12:38.086595+0000 mon.a (mon.0) 1529 : audit 1 from='client.25814 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]': finished 2024-05-20T22:12:39.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:39 smithi145 bash[23893]: cluster 2024-05-20T22:12:38.094340+0000 mon.a (mon.0) 1530 : cluster 0 osdmap e162: 8 total, 8 up, 8 in 2024-05-20T22:12:39.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:39 smithi145 bash[23893]: audit 2024-05-20T22:12:38.096058+0000 mon.c (mon.2) 194 : audit 1 from='client.? v1:172.21.15.50:0/1686475988' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:39.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:39 smithi145 bash[23893]: audit 2024-05-20T22:12:38.097848+0000 mon.c (mon.2) 195 : audit 1 from='client.? v1:172.21.15.50:0/3328451960' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:39.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:39 smithi145 bash[23893]: audit 2024-05-20T22:12:38.098454+0000 mon.a (mon.0) 1531 : audit 1 from='client.25814 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:39.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:39 smithi145 bash[23893]: audit 2024-05-20T22:12:38.099398+0000 mon.a (mon.0) 1532 : audit 1 from='client.? v1:172.21.15.50:0/919504905' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi050-63944-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:39.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:39 smithi145 bash[23893]: audit 2024-05-20T22:12:38.099795+0000 mon.a (mon.0) 1533 : audit 1 from='client.25865 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:39.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:39 smithi145 bash[23893]: cluster 2024-05-20T22:12:38.607418+0000 mon.a (mon.0) 1534 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:39.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:39 smithi050 bash[21866]: audit 2024-05-20T22:12:37.741387+0000 mgr.y (mgr.14592) 263 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:12:39.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:39 smithi050 bash[21866]: cluster 2024-05-20T22:12:38.044747+0000 mgr.y (mgr.14592) 264 : cluster 0 pgmap v254: 428 pgs: 40 unknown, 388 active+clean; 590 KiB data, 504 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:12:39.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:39 smithi050 bash[21866]: audit 2024-05-20T22:12:38.086595+0000 mon.a (mon.0) 1529 : audit 1 from='client.25814 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]': finished 2024-05-20T22:12:39.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:39 smithi050 bash[21866]: cluster 2024-05-20T22:12:38.094340+0000 mon.a (mon.0) 1530 : cluster 0 osdmap e162: 8 total, 8 up, 8 in 2024-05-20T22:12:39.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:39 smithi050 bash[21866]: audit 2024-05-20T22:12:38.096058+0000 mon.c (mon.2) 194 : audit 1 from='client.? v1:172.21.15.50:0/1686475988' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:39.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:39 smithi050 bash[21866]: audit 2024-05-20T22:12:38.097848+0000 mon.c (mon.2) 195 : audit 1 from='client.? v1:172.21.15.50:0/3328451960' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:39.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:39 smithi050 bash[21866]: audit 2024-05-20T22:12:38.098454+0000 mon.a (mon.0) 1531 : audit 1 from='client.25814 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:39.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:39 smithi050 bash[21866]: audit 2024-05-20T22:12:38.099398+0000 mon.a (mon.0) 1532 : audit 1 from='client.? v1:172.21.15.50:0/919504905' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi050-63944-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:39.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:39 smithi050 bash[21866]: audit 2024-05-20T22:12:38.099795+0000 mon.a (mon.0) 1533 : audit 1 from='client.25865 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:39.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:39 smithi050 bash[21866]: cluster 2024-05-20T22:12:38.607418+0000 mon.a (mon.0) 1534 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:39.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:39 smithi050 bash[28929]: audit 2024-05-20T22:12:37.741387+0000 mgr.y (mgr.14592) 263 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:12:39.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:39 smithi050 bash[28929]: cluster 2024-05-20T22:12:38.044747+0000 mgr.y (mgr.14592) 264 : cluster 0 pgmap v254: 428 pgs: 40 unknown, 388 active+clean; 590 KiB data, 504 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:12:39.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:39 smithi050 bash[28929]: audit 2024-05-20T22:12:38.086595+0000 mon.a (mon.0) 1529 : audit 1 from='client.25814 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi050-64159-16"}]': finished 2024-05-20T22:12:39.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:39 smithi050 bash[28929]: cluster 2024-05-20T22:12:38.094340+0000 mon.a (mon.0) 1530 : cluster 0 osdmap e162: 8 total, 8 up, 8 in 2024-05-20T22:12:39.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:39 smithi050 bash[28929]: audit 2024-05-20T22:12:38.096058+0000 mon.c (mon.2) 194 : audit 1 from='client.? v1:172.21.15.50:0/1686475988' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:39.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:39 smithi050 bash[28929]: audit 2024-05-20T22:12:38.097848+0000 mon.c (mon.2) 195 : audit 1 from='client.? v1:172.21.15.50:0/3328451960' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:39.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:39 smithi050 bash[28929]: audit 2024-05-20T22:12:38.098454+0000 mon.a (mon.0) 1531 : audit 1 from='client.25814 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi050-64159-16"}]: dispatch 2024-05-20T22:12:39.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:39 smithi050 bash[28929]: audit 2024-05-20T22:12:38.099398+0000 mon.a (mon.0) 1532 : audit 1 from='client.? v1:172.21.15.50:0/919504905' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi050-63944-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:39.395 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:39 smithi050 bash[28929]: audit 2024-05-20T22:12:38.099795+0000 mon.a (mon.0) 1533 : audit 1 from='client.25865 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:39.395 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:39 smithi050 bash[28929]: cluster 2024-05-20T22:12:38.607418+0000 mon.a (mon.0) 1534 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:39.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:12:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:12:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:12:40.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_P (68171 ms total) 2024-05-20T22:12:40.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: 2024-05-20T22:12:40.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2024-05-20T22:12:40.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-05-20T22:12:40.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (191 ms) 2024-05-20T22:12:40.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (191 ms total) 2024-05-20T22:12:40.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: 2024-05-20T22:12:40.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-05-20T22:12:40.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2024-05-20T22:12:40.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (74 ms) 2024-05-20T22:12:40.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2024-05-20T22:12:40.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (8 ms) 2024-05-20T22:12:40.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (82 ms total) 2024-05-20T22:12:40.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: 2024-05-20T22:12:40.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-05-20T22:12:40.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2024-05-20T22:12:40.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (62 ms) 2024-05-20T22:12:40.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2024-05-20T22:12:40.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (2 ms) 2024-05-20T22:12:40.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (64 ms total) 2024-05-20T22:12:40.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: 2024-05-20T22:12:40.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-05-20T22:12:40.133 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2024-05-20T22:12:40.133 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (61 ms) 2024-05-20T22:12:40.133 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2024-05-20T22:12:40.133 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (5 ms) 2024-05-20T22:12:40.133 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (66 ms total) 2024-05-20T22:12:40.133 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: 2024-05-20T22:12:40.133 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2024-05-20T22:12:40.133 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-05-20T22:12:40.133 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1073 ms) 2024-05-20T22:12:40.133 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1073 ms total) 2024-05-20T22:12:40.133 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: 2024-05-20T22:12:40.133 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [----------] Global test environment tear-down 2024-05-20T22:12:40.133 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (113338 ms total) 2024-05-20T22:12:40.133 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc_pp: [ PASSED ] 31 tests. 2024-05-20T22:12:40.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:40 smithi145 bash[23893]: audit 2024-05-20T22:12:39.091433+0000 mon.a (mon.0) 1535 : audit 1 from='client.25814 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi050-64159-16"}]': finished 2024-05-20T22:12:40.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:40 smithi145 bash[23893]: audit 2024-05-20T22:12:39.091686+0000 mon.a (mon.0) 1536 : audit 1 from='client.? v1:172.21.15.50:0/919504905' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi050-63944-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:40.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:40 smithi145 bash[23893]: audit 2024-05-20T22:12:39.091834+0000 mon.a (mon.0) 1537 : audit 1 from='client.25865 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36"}]': finished 2024-05-20T22:12:40.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:40 smithi145 bash[23893]: cluster 2024-05-20T22:12:39.098723+0000 mon.a (mon.0) 1538 : cluster 0 osdmap e163: 8 total, 8 up, 8 in 2024-05-20T22:12:40.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:40 smithi145 bash[23893]: audit 2024-05-20T22:12:39.102562+0000 mon.c (mon.2) 196 : audit 1 from='client.? v1:172.21.15.50:0/3328451960' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:40.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:40 smithi145 bash[23893]: audit 2024-05-20T22:12:39.105495+0000 mon.c (mon.2) 197 : audit 1 from='client.? v1:172.21.15.50:0/1308337133' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi050-63936-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:40.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:40 smithi145 bash[23893]: audit 2024-05-20T22:12:39.128635+0000 mon.a (mon.0) 1539 : audit 1 from='client.25865 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:40.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:40 smithi145 bash[23893]: audit 2024-05-20T22:12:39.129936+0000 mon.a (mon.0) 1540 : audit 1 from='client.25889 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi050-63936-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:40.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:40 smithi145 bash[23893]: audit 2024-05-20T22:12:39.154776+0000 mon.c (mon.2) 198 : audit 1 from='client.? v1:172.21.15.50:0/1472725422' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:40.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:40 smithi145 bash[23893]: audit 2024-05-20T22:12:39.155330+0000 mon.a (mon.0) 1541 : audit 1 from='client.25895 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:40.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:40 smithi145 bash[23893]: audit 2024-05-20T22:12:39.156406+0000 mon.c (mon.2) 199 : audit 1 from='client.? v1:172.21.15.50:0/1472725422' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:40.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:40 smithi145 bash[23893]: audit 2024-05-20T22:12:39.156741+0000 mon.a (mon.0) 1542 : audit 1 from='client.25895 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:40.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:40 smithi145 bash[23893]: audit 2024-05-20T22:12:39.157314+0000 mon.c (mon.2) 200 : audit 1 from='client.? v1:172.21.15.50:0/1472725422' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:40.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:40 smithi145 bash[23893]: audit 2024-05-20T22:12:39.157761+0000 mon.a (mon.0) 1543 : audit 1 from='client.25895 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:40.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:40 smithi050 bash[21866]: audit 2024-05-20T22:12:39.091433+0000 mon.a (mon.0) 1535 : audit 1 from='client.25814 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi050-64159-16"}]': finished 2024-05-20T22:12:40.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:40 smithi050 bash[21866]: audit 2024-05-20T22:12:39.091686+0000 mon.a (mon.0) 1536 : audit 1 from='client.? v1:172.21.15.50:0/919504905' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi050-63944-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:40.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:40 smithi050 bash[21866]: audit 2024-05-20T22:12:39.091834+0000 mon.a (mon.0) 1537 : audit 1 from='client.25865 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36"}]': finished 2024-05-20T22:12:40.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:40 smithi050 bash[21866]: cluster 2024-05-20T22:12:39.098723+0000 mon.a (mon.0) 1538 : cluster 0 osdmap e163: 8 total, 8 up, 8 in 2024-05-20T22:12:40.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:40 smithi050 bash[21866]: audit 2024-05-20T22:12:39.102562+0000 mon.c (mon.2) 196 : audit 1 from='client.? v1:172.21.15.50:0/3328451960' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:40.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:40 smithi050 bash[21866]: audit 2024-05-20T22:12:39.105495+0000 mon.c (mon.2) 197 : audit 1 from='client.? v1:172.21.15.50:0/1308337133' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi050-63936-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:40.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:40 smithi050 bash[21866]: audit 2024-05-20T22:12:39.128635+0000 mon.a (mon.0) 1539 : audit 1 from='client.25865 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:40.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:40 smithi050 bash[21866]: audit 2024-05-20T22:12:39.129936+0000 mon.a (mon.0) 1540 : audit 1 from='client.25889 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi050-63936-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:40.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:40 smithi050 bash[21866]: audit 2024-05-20T22:12:39.154776+0000 mon.c (mon.2) 198 : audit 1 from='client.? v1:172.21.15.50:0/1472725422' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:40.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:40 smithi050 bash[21866]: audit 2024-05-20T22:12:39.155330+0000 mon.a (mon.0) 1541 : audit 1 from='client.25895 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:40.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:40 smithi050 bash[21866]: audit 2024-05-20T22:12:39.156406+0000 mon.c (mon.2) 199 : audit 1 from='client.? v1:172.21.15.50:0/1472725422' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:40.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:40 smithi050 bash[21866]: audit 2024-05-20T22:12:39.156741+0000 mon.a (mon.0) 1542 : audit 1 from='client.25895 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:40.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:40 smithi050 bash[21866]: audit 2024-05-20T22:12:39.157314+0000 mon.c (mon.2) 200 : audit 1 from='client.? v1:172.21.15.50:0/1472725422' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:40.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:40 smithi050 bash[21866]: audit 2024-05-20T22:12:39.157761+0000 mon.a (mon.0) 1543 : audit 1 from='client.25895 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:40.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:40 smithi050 bash[28929]: audit 2024-05-20T22:12:39.091433+0000 mon.a (mon.0) 1535 : audit 1 from='client.25814 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi050-64159-16"}]': finished 2024-05-20T22:12:40.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:40 smithi050 bash[28929]: audit 2024-05-20T22:12:39.091686+0000 mon.a (mon.0) 1536 : audit 1 from='client.? v1:172.21.15.50:0/919504905' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi050-63944-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:40.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:40 smithi050 bash[28929]: audit 2024-05-20T22:12:39.091834+0000 mon.a (mon.0) 1537 : audit 1 from='client.25865 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi050-64061-36"}]': finished 2024-05-20T22:12:40.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:40 smithi050 bash[28929]: cluster 2024-05-20T22:12:39.098723+0000 mon.a (mon.0) 1538 : cluster 0 osdmap e163: 8 total, 8 up, 8 in 2024-05-20T22:12:40.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:40 smithi050 bash[28929]: audit 2024-05-20T22:12:39.102562+0000 mon.c (mon.2) 196 : audit 1 from='client.? v1:172.21.15.50:0/3328451960' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:40.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:40 smithi050 bash[28929]: audit 2024-05-20T22:12:39.105495+0000 mon.c (mon.2) 197 : audit 1 from='client.? v1:172.21.15.50:0/1308337133' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi050-63936-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:40.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:40 smithi050 bash[28929]: audit 2024-05-20T22:12:39.128635+0000 mon.a (mon.0) 1539 : audit 1 from='client.25865 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi050-64061-36"}]: dispatch 2024-05-20T22:12:40.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:40 smithi050 bash[28929]: audit 2024-05-20T22:12:39.129936+0000 mon.a (mon.0) 1540 : audit 1 from='client.25889 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi050-63936-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:40.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:40 smithi050 bash[28929]: audit 2024-05-20T22:12:39.154776+0000 mon.c (mon.2) 198 : audit 1 from='client.? v1:172.21.15.50:0/1472725422' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:40.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:40 smithi050 bash[28929]: audit 2024-05-20T22:12:39.155330+0000 mon.a (mon.0) 1541 : audit 1 from='client.25895 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:40.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:40 smithi050 bash[28929]: audit 2024-05-20T22:12:39.156406+0000 mon.c (mon.2) 199 : audit 1 from='client.? v1:172.21.15.50:0/1472725422' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:40.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:40 smithi050 bash[28929]: audit 2024-05-20T22:12:39.156741+0000 mon.a (mon.0) 1542 : audit 1 from='client.25895 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:40.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:40 smithi050 bash[28929]: audit 2024-05-20T22:12:39.157314+0000 mon.c (mon.2) 200 : audit 1 from='client.? v1:172.21.15.50:0/1472725422' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:40.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:40 smithi050 bash[28929]: audit 2024-05-20T22:12:39.157761+0000 mon.a (mon.0) 1543 : audit 1 from='client.25895 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:41.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:41 smithi145 bash[23893]: cluster 2024-05-20T22:12:40.048339+0000 mgr.y (mgr.14592) 265 : cluster 0 pgmap v257: 452 pgs: 32 creating+peering, 420 active+clean; 590 KiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-05-20T22:12:41.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:41 smithi145 bash[23893]: audit 2024-05-20T22:12:40.114406+0000 mon.a (mon.0) 1544 : audit 1 from='client.25865 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi050-64061-36"}]': finished 2024-05-20T22:12:41.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:41 smithi145 bash[23893]: audit 2024-05-20T22:12:40.114568+0000 mon.a (mon.0) 1545 : audit 1 from='client.25889 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi050-63936-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:41.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:41 smithi145 bash[23893]: audit 2024-05-20T22:12:40.114731+0000 mon.a (mon.0) 1546 : audit 1 from='client.25895 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:41.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:41 smithi145 bash[23893]: cluster 2024-05-20T22:12:40.123555+0000 mon.a (mon.0) 1547 : cluster 0 osdmap e164: 8 total, 8 up, 8 in 2024-05-20T22:12:41.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:41 smithi145 bash[23893]: audit 2024-05-20T22:12:40.126757+0000 mon.c (mon.2) 201 : audit 1 from='client.? v1:172.21.15.50:0/1472725422' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:41.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:41 smithi145 bash[23893]: audit 2024-05-20T22:12:40.128799+0000 mon.a (mon.0) 1548 : audit 1 from='client.25895 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:41.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:41 smithi050 bash[21866]: cluster 2024-05-20T22:12:40.048339+0000 mgr.y (mgr.14592) 265 : cluster 0 pgmap v257: 452 pgs: 32 creating+peering, 420 active+clean; 590 KiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-05-20T22:12:41.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:41 smithi050 bash[21866]: audit 2024-05-20T22:12:40.114406+0000 mon.a (mon.0) 1544 : audit 1 from='client.25865 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi050-64061-36"}]': finished 2024-05-20T22:12:41.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:41 smithi050 bash[21866]: audit 2024-05-20T22:12:40.114568+0000 mon.a (mon.0) 1545 : audit 1 from='client.25889 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi050-63936-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:41.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:41 smithi050 bash[21866]: audit 2024-05-20T22:12:40.114731+0000 mon.a (mon.0) 1546 : audit 1 from='client.25895 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:41.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:41 smithi050 bash[21866]: cluster 2024-05-20T22:12:40.123555+0000 mon.a (mon.0) 1547 : cluster 0 osdmap e164: 8 total, 8 up, 8 in 2024-05-20T22:12:41.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:41 smithi050 bash[21866]: audit 2024-05-20T22:12:40.126757+0000 mon.c (mon.2) 201 : audit 1 from='client.? v1:172.21.15.50:0/1472725422' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:41.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:41 smithi050 bash[21866]: audit 2024-05-20T22:12:40.128799+0000 mon.a (mon.0) 1548 : audit 1 from='client.25895 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:41.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:41 smithi050 bash[28929]: cluster 2024-05-20T22:12:40.048339+0000 mgr.y (mgr.14592) 265 : cluster 0 pgmap v257: 452 pgs: 32 creating+peering, 420 active+clean; 590 KiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-05-20T22:12:41.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:41 smithi050 bash[28929]: audit 2024-05-20T22:12:40.114406+0000 mon.a (mon.0) 1544 : audit 1 from='client.25865 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi050-64061-36"}]': finished 2024-05-20T22:12:41.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:41 smithi050 bash[28929]: audit 2024-05-20T22:12:40.114568+0000 mon.a (mon.0) 1545 : audit 1 from='client.25889 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi050-63936-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:41.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:41 smithi050 bash[28929]: audit 2024-05-20T22:12:40.114731+0000 mon.a (mon.0) 1546 : audit 1 from='client.25895 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:41.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:41 smithi050 bash[28929]: cluster 2024-05-20T22:12:40.123555+0000 mon.a (mon.0) 1547 : cluster 0 osdmap e164: 8 total, 8 up, 8 in 2024-05-20T22:12:41.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:41 smithi050 bash[28929]: audit 2024-05-20T22:12:40.126757+0000 mon.c (mon.2) 201 : audit 1 from='client.? v1:172.21.15.50:0/1472725422' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:41.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:41 smithi050 bash[28929]: audit 2024-05-20T22:12:40.128799+0000 mon.a (mon.0) 1548 : audit 1 from='client.25895 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:42.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:42 smithi145 bash[23893]: cluster 2024-05-20T22:12:41.578985+0000 mon.a (mon.0) 1549 : cluster 0 osdmap e165: 8 total, 8 up, 8 in 2024-05-20T22:12:42.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:42 smithi145 bash[23893]: audit 2024-05-20T22:12:41.589482+0000 mon.a (mon.0) 1550 : audit 1 from='client.? v1:172.21.15.50:0/2505284918' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi050-63944-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:42.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:42 smithi145 bash[23893]: audit 2024-05-20T22:12:42.050855+0000 mon.a (mon.0) 1551 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:12:42.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:42 smithi145 bash[23893]: audit 2024-05-20T22:12:42.125353+0000 mon.a (mon.0) 1552 : audit 1 from='client.25895 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]': finished 2024-05-20T22:12:42.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:42 smithi145 bash[23893]: audit 2024-05-20T22:12:42.125641+0000 mon.a (mon.0) 1553 : audit 1 from='client.? v1:172.21.15.50:0/2505284918' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi050-63944-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:42.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:42 smithi145 bash[23893]: cluster 2024-05-20T22:12:42.137443+0000 mon.a (mon.0) 1554 : cluster 0 osdmap e166: 8 total, 8 up, 8 in 2024-05-20T22:12:42.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:42 smithi145 bash[23893]: audit 2024-05-20T22:12:42.141833+0000 mon.c (mon.2) 202 : audit 1 from='client.? v1:172.21.15.50:0/3599086986' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi050-63936-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:42.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:42 smithi145 bash[23893]: audit 2024-05-20T22:12:42.144488+0000 mon.a (mon.0) 1555 : audit 1 from='client.25907 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi050-63936-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:42.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:42 smithi050 bash[21866]: cluster 2024-05-20T22:12:41.578985+0000 mon.a (mon.0) 1549 : cluster 0 osdmap e165: 8 total, 8 up, 8 in 2024-05-20T22:12:42.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:42 smithi050 bash[21866]: audit 2024-05-20T22:12:41.589482+0000 mon.a (mon.0) 1550 : audit 1 from='client.? v1:172.21.15.50:0/2505284918' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi050-63944-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:42.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:42 smithi050 bash[21866]: audit 2024-05-20T22:12:42.050855+0000 mon.a (mon.0) 1551 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:12:42.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:42 smithi050 bash[21866]: audit 2024-05-20T22:12:42.125353+0000 mon.a (mon.0) 1552 : audit 1 from='client.25895 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]': finished 2024-05-20T22:12:42.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:42 smithi050 bash[21866]: audit 2024-05-20T22:12:42.125641+0000 mon.a (mon.0) 1553 : audit 1 from='client.? v1:172.21.15.50:0/2505284918' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi050-63944-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:42.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:42 smithi050 bash[21866]: cluster 2024-05-20T22:12:42.137443+0000 mon.a (mon.0) 1554 : cluster 0 osdmap e166: 8 total, 8 up, 8 in 2024-05-20T22:12:42.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:42 smithi050 bash[21866]: audit 2024-05-20T22:12:42.141833+0000 mon.c (mon.2) 202 : audit 1 from='client.? v1:172.21.15.50:0/3599086986' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi050-63936-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:42.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:42 smithi050 bash[21866]: audit 2024-05-20T22:12:42.144488+0000 mon.a (mon.0) 1555 : audit 1 from='client.25907 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi050-63936-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:42 smithi050 bash[28929]: cluster 2024-05-20T22:12:41.578985+0000 mon.a (mon.0) 1549 : cluster 0 osdmap e165: 8 total, 8 up, 8 in 2024-05-20T22:12:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:42 smithi050 bash[28929]: audit 2024-05-20T22:12:41.589482+0000 mon.a (mon.0) 1550 : audit 1 from='client.? v1:172.21.15.50:0/2505284918' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi050-63944-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:42 smithi050 bash[28929]: audit 2024-05-20T22:12:42.050855+0000 mon.a (mon.0) 1551 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:12:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:42 smithi050 bash[28929]: audit 2024-05-20T22:12:42.125353+0000 mon.a (mon.0) 1552 : audit 1 from='client.25895 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]': finished 2024-05-20T22:12:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:42 smithi050 bash[28929]: audit 2024-05-20T22:12:42.125641+0000 mon.a (mon.0) 1553 : audit 1 from='client.? v1:172.21.15.50:0/2505284918' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi050-63944-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:42 smithi050 bash[28929]: cluster 2024-05-20T22:12:42.137443+0000 mon.a (mon.0) 1554 : cluster 0 osdmap e166: 8 total, 8 up, 8 in 2024-05-20T22:12:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:42 smithi050 bash[28929]: audit 2024-05-20T22:12:42.141833+0000 mon.c (mon.2) 202 : audit 1 from='client.? v1:172.21.15.50:0/3599086986' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi050-63936-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:42 smithi050 bash[28929]: audit 2024-05-20T22:12:42.144488+0000 mon.a (mon.0) 1555 : audit 1 from='client.25907 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi050-63936-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:43.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:43 smithi050 bash[21866]: cluster 2024-05-20T22:12:42.049405+0000 mgr.y (mgr.14592) 266 : cluster 0 pgmap v260: 420 pgs: 32 unknown, 388 active+clean; 590 KiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:12:43.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:43 smithi050 bash[21866]: audit 2024-05-20T22:12:42.772158+0000 mon.a (mon.0) 1556 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:12:43.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:43 smithi050 bash[21866]: audit 2024-05-20T22:12:42.773207+0000 mon.a (mon.0) 1557 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:12:43.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:43 smithi050 bash[21866]: audit 2024-05-20T22:12:42.781029+0000 mon.a (mon.0) 1558 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:12:43.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:43 smithi050 bash[21866]: audit 2024-05-20T22:12:43.128421+0000 mon.a (mon.0) 1559 : audit 1 from='client.25907 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi050-63936-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:43.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:43 smithi050 bash[21866]: cluster 2024-05-20T22:12:43.136158+0000 mon.a (mon.0) 1560 : cluster 0 osdmap e167: 8 total, 8 up, 8 in 2024-05-20T22:12:43.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:43 smithi050 bash[28929]: cluster 2024-05-20T22:12:42.049405+0000 mgr.y (mgr.14592) 266 : cluster 0 pgmap v260: 420 pgs: 32 unknown, 388 active+clean; 590 KiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:12:43.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:43 smithi050 bash[28929]: audit 2024-05-20T22:12:42.772158+0000 mon.a (mon.0) 1556 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:12:43.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:43 smithi050 bash[28929]: audit 2024-05-20T22:12:42.773207+0000 mon.a (mon.0) 1557 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:12:43.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:43 smithi050 bash[28929]: audit 2024-05-20T22:12:42.781029+0000 mon.a (mon.0) 1558 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:12:43.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:43 smithi050 bash[28929]: audit 2024-05-20T22:12:43.128421+0000 mon.a (mon.0) 1559 : audit 1 from='client.25907 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi050-63936-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:43.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:43 smithi050 bash[28929]: cluster 2024-05-20T22:12:43.136158+0000 mon.a (mon.0) 1560 : cluster 0 osdmap e167: 8 total, 8 up, 8 in 2024-05-20T22:12:44.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:43 smithi145 bash[23893]: cluster 2024-05-20T22:12:42.049405+0000 mgr.y (mgr.14592) 266 : cluster 0 pgmap v260: 420 pgs: 32 unknown, 388 active+clean; 590 KiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:12:44.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:43 smithi145 bash[23893]: audit 2024-05-20T22:12:42.772158+0000 mon.a (mon.0) 1556 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:12:44.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:43 smithi145 bash[23893]: audit 2024-05-20T22:12:42.773207+0000 mon.a (mon.0) 1557 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:12:44.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:43 smithi145 bash[23893]: audit 2024-05-20T22:12:42.781029+0000 mon.a (mon.0) 1558 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:12:44.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:43 smithi145 bash[23893]: audit 2024-05-20T22:12:43.128421+0000 mon.a (mon.0) 1559 : audit 1 from='client.25907 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi050-63936-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:44.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:43 smithi145 bash[23893]: cluster 2024-05-20T22:12:43.136158+0000 mon.a (mon.0) 1560 : cluster 0 osdmap e167: 8 total, 8 up, 8 in 2024-05-20T22:12:45.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:45 smithi050 bash[21866]: cluster 2024-05-20T22:12:44.050565+0000 mgr.y (mgr.14592) 267 : cluster 0 pgmap v263: 428 pgs: 40 unknown, 388 active+clean; 590 KiB data, 566 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:45.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:45 smithi050 bash[21866]: cluster 2024-05-20T22:12:44.139612+0000 mon.a (mon.0) 1561 : cluster 0 osdmap e168: 8 total, 8 up, 8 in 2024-05-20T22:12:45.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:45 smithi050 bash[21866]: audit 2024-05-20T22:12:44.163083+0000 mon.a (mon.0) 1562 : audit 1 from='client.? v1:172.21.15.50:0/4038723130' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi050-63944-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:45.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:45 smithi050 bash[28929]: cluster 2024-05-20T22:12:44.050565+0000 mgr.y (mgr.14592) 267 : cluster 0 pgmap v263: 428 pgs: 40 unknown, 388 active+clean; 590 KiB data, 566 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:45.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:45 smithi050 bash[28929]: cluster 2024-05-20T22:12:44.139612+0000 mon.a (mon.0) 1561 : cluster 0 osdmap e168: 8 total, 8 up, 8 in 2024-05-20T22:12:45.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:45 smithi050 bash[28929]: audit 2024-05-20T22:12:44.163083+0000 mon.a (mon.0) 1562 : audit 1 from='client.? v1:172.21.15.50:0/4038723130' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi050-63944-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:45.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:45 smithi145 bash[23893]: cluster 2024-05-20T22:12:44.050565+0000 mgr.y (mgr.14592) 267 : cluster 0 pgmap v263: 428 pgs: 40 unknown, 388 active+clean; 590 KiB data, 566 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:45.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:45 smithi145 bash[23893]: cluster 2024-05-20T22:12:44.139612+0000 mon.a (mon.0) 1561 : cluster 0 osdmap e168: 8 total, 8 up, 8 in 2024-05-20T22:12:45.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:45 smithi145 bash[23893]: audit 2024-05-20T22:12:44.163083+0000 mon.a (mon.0) 1562 : audit 1 from='client.? v1:172.21.15.50:0/4038723130' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi050-63944-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:46.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:46 smithi050 bash[28929]: audit 2024-05-20T22:12:45.135728+0000 mon.a (mon.0) 1563 : audit 1 from='client.? v1:172.21.15.50:0/4038723130' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi050-63944-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:46.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:46 smithi050 bash[28929]: cluster 2024-05-20T22:12:45.144378+0000 mon.a (mon.0) 1564 : cluster 0 osdmap e169: 8 total, 8 up, 8 in 2024-05-20T22:12:46.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:46 smithi050 bash[28929]: audit 2024-05-20T22:12:45.166135+0000 mon.a (mon.0) 1565 : audit 1 from='client.? v1:172.21.15.50:0/2901398298' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi050-63936-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:46.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:46 smithi050 bash[28929]: audit 2024-05-20T22:12:46.139114+0000 mon.a (mon.0) 1566 : audit 1 from='client.? v1:172.21.15.50:0/2901398298' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi050-63936-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:46.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:46 smithi050 bash[28929]: cluster 2024-05-20T22:12:46.147226+0000 mon.a (mon.0) 1567 : cluster 0 osdmap e170: 8 total, 8 up, 8 in 2024-05-20T22:12:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:46 smithi050 bash[21866]: audit 2024-05-20T22:12:45.135728+0000 mon.a (mon.0) 1563 : audit 1 from='client.? v1:172.21.15.50:0/4038723130' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi050-63944-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:46 smithi050 bash[21866]: cluster 2024-05-20T22:12:45.144378+0000 mon.a (mon.0) 1564 : cluster 0 osdmap e169: 8 total, 8 up, 8 in 2024-05-20T22:12:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:46 smithi050 bash[21866]: audit 2024-05-20T22:12:45.166135+0000 mon.a (mon.0) 1565 : audit 1 from='client.? v1:172.21.15.50:0/2901398298' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi050-63936-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:46 smithi050 bash[21866]: audit 2024-05-20T22:12:46.139114+0000 mon.a (mon.0) 1566 : audit 1 from='client.? v1:172.21.15.50:0/2901398298' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi050-63936-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:46 smithi050 bash[21866]: cluster 2024-05-20T22:12:46.147226+0000 mon.a (mon.0) 1567 : cluster 0 osdmap e170: 8 total, 8 up, 8 in 2024-05-20T22:12:46.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:46 smithi145 bash[23893]: audit 2024-05-20T22:12:45.135728+0000 mon.a (mon.0) 1563 : audit 1 from='client.? v1:172.21.15.50:0/4038723130' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi050-63944-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:46.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:46 smithi145 bash[23893]: cluster 2024-05-20T22:12:45.144378+0000 mon.a (mon.0) 1564 : cluster 0 osdmap e169: 8 total, 8 up, 8 in 2024-05-20T22:12:46.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:46 smithi145 bash[23893]: audit 2024-05-20T22:12:45.166135+0000 mon.a (mon.0) 1565 : audit 1 from='client.? v1:172.21.15.50:0/2901398298' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi050-63936-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:46.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:46 smithi145 bash[23893]: audit 2024-05-20T22:12:46.139114+0000 mon.a (mon.0) 1566 : audit 1 from='client.? v1:172.21.15.50:0/2901398298' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi050-63936-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:46.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:46 smithi145 bash[23893]: cluster 2024-05-20T22:12:46.147226+0000 mon.a (mon.0) 1567 : cluster 0 osdmap e170: 8 total, 8 up, 8 in 2024-05-20T22:12:47.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: Running main() from gmock_main.cc 2024-05-20T22:12:47.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2024-05-20T22:12:47.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [----------] Global test environment set-up. 2024-05-20T22:12:47.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [----------] 26 tests from LibRadosAio 2024-05-20T22:12:47.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2024-05-20T22:12:47.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.TooBig (18325 ms) 2024-05-20T22:12:47.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2024-05-20T22:12:47.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (12886 ms) 2024-05-20T22:12:47.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2024-05-20T22:12:47.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (10096 ms) 2024-05-20T22:12:47.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2024-05-20T22:12:47.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (5213 ms) 2024-05-20T22:12:47.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2024-05-20T22:12:47.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (4948 ms) 2024-05-20T22:12:47.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2024-05-20T22:12:47.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (4341 ms) 2024-05-20T22:12:47.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2024-05-20T22:12:47.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (3955 ms) 2024-05-20T22:12:47.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2024-05-20T22:12:47.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (2491 ms) 2024-05-20T22:12:47.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2024-05-20T22:12:47.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (4818 ms) 2024-05-20T22:12:47.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2024-05-20T22:12:47.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (3429 ms) 2024-05-20T22:12:47.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2024-05-20T22:12:47.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (3436 ms) 2024-05-20T22:12:47.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2024-05-20T22:12:47.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (3529 ms) 2024-05-20T22:12:47.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2024-05-20T22:12:47.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (3013 ms) 2024-05-20T22:12:47.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2024-05-20T22:12:47.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (2983 ms) 2024-05-20T22:12:47.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2024-05-20T22:12:47.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.Flush (3023 ms) 2024-05-20T22:12:47.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2024-05-20T22:12:47.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (3852 ms) 2024-05-20T22:12:47.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2024-05-20T22:12:47.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (2948 ms) 2024-05-20T22:12:47.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2024-05-20T22:12:47.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3015 ms) 2024-05-20T22:12:47.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2024-05-20T22:12:47.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3489 ms) 2024-05-20T22:12:47.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2024-05-20T22:12:47.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (2554 ms) 2024-05-20T22:12:47.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2024-05-20T22:12:47.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (3021 ms) 2024-05-20T22:12:47.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2024-05-20T22:12:47.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (3471 ms) 2024-05-20T22:12:47.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2024-05-20T22:12:47.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (2544 ms) 2024-05-20T22:12:47.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2024-05-20T22:12:47.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3482 ms) 2024-05-20T22:12:47.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2024-05-20T22:12:47.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (2564 ms) 2024-05-20T22:12:47.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2024-05-20T22:12:47.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (3056 ms) 2024-05-20T22:12:47.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [----------] 26 tests from LibRadosAio (120483 ms total) 2024-05-20T22:12:47.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: 2024-05-20T22:12:47.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2024-05-20T22:12:47.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:47 smithi050 bash[21866]: cluster 2024-05-20T22:12:46.051814+0000 mgr.y (mgr.14592) 268 : cluster 0 pgmap v266: 460 pgs: 32 unknown, 32 creating+peering, 396 active+clean; 603 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-05-20T22:12:47.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:47 smithi050 bash[21866]: cluster 2024-05-20T22:12:46.161320+0000 mon.a (mon.0) 1568 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:47.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:47 smithi050 bash[21866]: audit 2024-05-20T22:12:46.679137+0000 mon.a (mon.0) 1569 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:12:47.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:47 smithi050 bash[28929]: cluster 2024-05-20T22:12:46.051814+0000 mgr.y (mgr.14592) 268 : cluster 0 pgmap v266: 460 pgs: 32 unknown, 32 creating+peering, 396 active+clean; 603 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-05-20T22:12:47.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:47 smithi050 bash[28929]: cluster 2024-05-20T22:12:46.161320+0000 mon.a (mon.0) 1568 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:47.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:47 smithi050 bash[28929]: audit 2024-05-20T22:12:46.679137+0000 mon.a (mon.0) 1569 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:12:47.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:47 smithi145 bash[23893]: cluster 2024-05-20T22:12:46.051814+0000 mgr.y (mgr.14592) 268 : cluster 0 pgmap v266: 460 pgs: 32 unknown, 32 creating+peering, 396 active+clean; 603 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-05-20T22:12:47.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:47 smithi145 bash[23893]: cluster 2024-05-20T22:12:46.161320+0000 mon.a (mon.0) 1568 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:47.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:47 smithi145 bash[23893]: audit 2024-05-20T22:12:46.679137+0000 mon.a (mon.0) 1569 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:12:48.140 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:12:47 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:12:48.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:48 smithi145 bash[23893]: audit 2024-05-20T22:12:47.187079+0000 mon.a (mon.0) 1570 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:12:48.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:48 smithi145 bash[23893]: cluster 2024-05-20T22:12:47.194490+0000 mon.a (mon.0) 1571 : cluster 0 osdmap e171: 8 total, 8 up, 8 in 2024-05-20T22:12:48.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:48 smithi145 bash[23893]: audit 2024-05-20T22:12:47.197988+0000 mon.a (mon.0) 1572 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-13"}]: dispatch 2024-05-20T22:12:48.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:48 smithi145 bash[23893]: audit 2024-05-20T22:12:47.199517+0000 mon.a (mon.0) 1573 : audit 1 from='client.? v1:172.21.15.50:0/1283260583' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi050-63944-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:48.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:48 smithi145 bash[23893]: audit 2024-05-20T22:12:47.243638+0000 mon.c (mon.2) 203 : audit 1 from='client.? v1:172.21.15.50:0/4204483522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:48.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:48 smithi145 bash[23893]: audit 2024-05-20T22:12:47.244309+0000 mon.a (mon.0) 1574 : audit 1 from='client.25931 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:48.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:48 smithi145 bash[23893]: audit 2024-05-20T22:12:47.245261+0000 mon.c (mon.2) 204 : audit 1 from='client.? v1:172.21.15.50:0/4204483522' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:48.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:48 smithi145 bash[23893]: audit 2024-05-20T22:12:47.245727+0000 mon.a (mon.0) 1575 : audit 1 from='client.25931 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:48.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:48 smithi145 bash[23893]: audit 2024-05-20T22:12:47.246261+0000 mon.c (mon.2) 205 : audit 1 from='client.? v1:172.21.15.50:0/4204483522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi050-63936-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:48.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:48 smithi145 bash[23893]: audit 2024-05-20T22:12:47.246555+0000 mon.a (mon.0) 1576 : audit 1 from='client.25931 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi050-63936-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:48.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:48 smithi050 bash[28929]: audit 2024-05-20T22:12:47.187079+0000 mon.a (mon.0) 1570 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:12:48.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:48 smithi050 bash[28929]: cluster 2024-05-20T22:12:47.194490+0000 mon.a (mon.0) 1571 : cluster 0 osdmap e171: 8 total, 8 up, 8 in 2024-05-20T22:12:48.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:48 smithi050 bash[28929]: audit 2024-05-20T22:12:47.197988+0000 mon.a (mon.0) 1572 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-13"}]: dispatch 2024-05-20T22:12:48.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:48 smithi050 bash[28929]: audit 2024-05-20T22:12:47.199517+0000 mon.a (mon.0) 1573 : audit 1 from='client.? v1:172.21.15.50:0/1283260583' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi050-63944-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:48.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:48 smithi050 bash[28929]: audit 2024-05-20T22:12:47.243638+0000 mon.c (mon.2) 203 : audit 1 from='client.? v1:172.21.15.50:0/4204483522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:48.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:48 smithi050 bash[28929]: audit 2024-05-20T22:12:47.244309+0000 mon.a (mon.0) 1574 : audit 1 from='client.25931 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:48.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:48 smithi050 bash[28929]: audit 2024-05-20T22:12:47.245261+0000 mon.c (mon.2) 204 : audit 1 from='client.? v1:172.21.15.50:0/4204483522' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:48.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:48 smithi050 bash[28929]: audit 2024-05-20T22:12:47.245727+0000 mon.a (mon.0) 1575 : audit 1 from='client.25931 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:48.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:48 smithi050 bash[28929]: audit 2024-05-20T22:12:47.246261+0000 mon.c (mon.2) 205 : audit 1 from='client.? v1:172.21.15.50:0/4204483522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi050-63936-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:48.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:48 smithi050 bash[28929]: audit 2024-05-20T22:12:47.246555+0000 mon.a (mon.0) 1576 : audit 1 from='client.25931 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi050-63936-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:48.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:48 smithi050 bash[21866]: audit 2024-05-20T22:12:47.187079+0000 mon.a (mon.0) 1570 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:12:48.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:48 smithi050 bash[21866]: cluster 2024-05-20T22:12:47.194490+0000 mon.a (mon.0) 1571 : cluster 0 osdmap e171: 8 total, 8 up, 8 in 2024-05-20T22:12:48.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:48 smithi050 bash[21866]: audit 2024-05-20T22:12:47.197988+0000 mon.a (mon.0) 1572 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-13"}]: dispatch 2024-05-20T22:12:48.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:48 smithi050 bash[21866]: audit 2024-05-20T22:12:47.199517+0000 mon.a (mon.0) 1573 : audit 1 from='client.? v1:172.21.15.50:0/1283260583' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi050-63944-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:48.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:48 smithi050 bash[21866]: audit 2024-05-20T22:12:47.243638+0000 mon.c (mon.2) 203 : audit 1 from='client.? v1:172.21.15.50:0/4204483522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:48.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:48 smithi050 bash[21866]: audit 2024-05-20T22:12:47.244309+0000 mon.a (mon.0) 1574 : audit 1 from='client.25931 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:48.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:48 smithi050 bash[21866]: audit 2024-05-20T22:12:47.245261+0000 mon.c (mon.2) 204 : audit 1 from='client.? v1:172.21.15.50:0/4204483522' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:48.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:48 smithi050 bash[21866]: audit 2024-05-20T22:12:47.245727+0000 mon.a (mon.0) 1575 : audit 1 from='client.25931 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:48.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:48 smithi050 bash[21866]: audit 2024-05-20T22:12:47.246261+0000 mon.c (mon.2) 205 : audit 1 from='client.? v1:172.21.15.50:0/4204483522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi050-63936-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:48.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:48 smithi050 bash[21866]: audit 2024-05-20T22:12:47.246555+0000 mon.a (mon.0) 1576 : audit 1 from='client.25931 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi050-63936-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:49.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:12:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:12:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:12:50.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:50 smithi145 bash[23893]: audit 2024-05-20T22:12:47.751496+0000 mgr.y (mgr.14592) 269 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:12:50.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:50 smithi145 bash[23893]: cluster 2024-05-20T22:12:48.053055+0000 mgr.y (mgr.14592) 270 : cluster 0 pgmap v269: 428 pgs: 32 unknown, 396 active+clean; 603 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-05-20T22:12:50.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:50 smithi145 bash[23893]: cluster 2024-05-20T22:12:48.187776+0000 mon.a (mon.0) 1577 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:12:50.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:50 smithi145 bash[23893]: audit 2024-05-20T22:12:48.190411+0000 mon.a (mon.0) 1578 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-13"}]': finished 2024-05-20T22:12:50.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:50 smithi145 bash[23893]: audit 2024-05-20T22:12:48.190562+0000 mon.a (mon.0) 1579 : audit 1 from='client.? v1:172.21.15.50:0/1283260583' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi050-63944-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:50.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:50 smithi145 bash[23893]: audit 2024-05-20T22:12:48.190723+0000 mon.a (mon.0) 1580 : audit 1 from='client.25931 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi050-63936-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:50.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:50 smithi145 bash[23893]: cluster 2024-05-20T22:12:48.199661+0000 mon.a (mon.0) 1581 : cluster 0 osdmap e172: 8 total, 8 up, 8 in 2024-05-20T22:12:50.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:50 smithi145 bash[23893]: audit 2024-05-20T22:12:48.200376+0000 mon.c (mon.2) 206 : audit 1 from='client.? v1:172.21.15.50:0/4204483522' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi050-63936-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:50.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:50 smithi145 bash[23893]: audit 2024-05-20T22:12:48.205559+0000 mon.a (mon.0) 1582 : audit 1 from='client.25931 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi050-63936-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:50.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:50 smithi145 bash[23893]: cluster 2024-05-20T22:12:49.136871+0000 mon.a (mon.0) 1583 : cluster 0 osdmap e173: 8 total, 8 up, 8 in 2024-05-20T22:12:50.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:50 smithi050 bash[21866]: audit 2024-05-20T22:12:47.751496+0000 mgr.y (mgr.14592) 269 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:12:50.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:50 smithi050 bash[21866]: cluster 2024-05-20T22:12:48.053055+0000 mgr.y (mgr.14592) 270 : cluster 0 pgmap v269: 428 pgs: 32 unknown, 396 active+clean; 603 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-05-20T22:12:50.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:50 smithi050 bash[21866]: cluster 2024-05-20T22:12:48.187776+0000 mon.a (mon.0) 1577 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:12:50.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:50 smithi050 bash[21866]: audit 2024-05-20T22:12:48.190411+0000 mon.a (mon.0) 1578 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-13"}]': finished 2024-05-20T22:12:50.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:50 smithi050 bash[21866]: audit 2024-05-20T22:12:48.190562+0000 mon.a (mon.0) 1579 : audit 1 from='client.? v1:172.21.15.50:0/1283260583' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi050-63944-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:50.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:50 smithi050 bash[21866]: audit 2024-05-20T22:12:48.190723+0000 mon.a (mon.0) 1580 : audit 1 from='client.25931 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi050-63936-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:50.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:50 smithi050 bash[21866]: cluster 2024-05-20T22:12:48.199661+0000 mon.a (mon.0) 1581 : cluster 0 osdmap e172: 8 total, 8 up, 8 in 2024-05-20T22:12:50.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:50 smithi050 bash[21866]: audit 2024-05-20T22:12:48.200376+0000 mon.c (mon.2) 206 : audit 1 from='client.? v1:172.21.15.50:0/4204483522' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi050-63936-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:50.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:50 smithi050 bash[21866]: audit 2024-05-20T22:12:48.205559+0000 mon.a (mon.0) 1582 : audit 1 from='client.25931 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi050-63936-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:50.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:50 smithi050 bash[21866]: cluster 2024-05-20T22:12:49.136871+0000 mon.a (mon.0) 1583 : cluster 0 osdmap e173: 8 total, 8 up, 8 in 2024-05-20T22:12:50.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:50 smithi050 bash[28929]: audit 2024-05-20T22:12:47.751496+0000 mgr.y (mgr.14592) 269 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:12:50.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:50 smithi050 bash[28929]: cluster 2024-05-20T22:12:48.053055+0000 mgr.y (mgr.14592) 270 : cluster 0 pgmap v269: 428 pgs: 32 unknown, 396 active+clean; 603 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-05-20T22:12:50.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:50 smithi050 bash[28929]: cluster 2024-05-20T22:12:48.187776+0000 mon.a (mon.0) 1577 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:12:50.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:50 smithi050 bash[28929]: audit 2024-05-20T22:12:48.190411+0000 mon.a (mon.0) 1578 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-13"}]': finished 2024-05-20T22:12:50.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:50 smithi050 bash[28929]: audit 2024-05-20T22:12:48.190562+0000 mon.a (mon.0) 1579 : audit 1 from='client.? v1:172.21.15.50:0/1283260583' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi050-63944-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:50.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:50 smithi050 bash[28929]: audit 2024-05-20T22:12:48.190723+0000 mon.a (mon.0) 1580 : audit 1 from='client.25931 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi050-63936-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:50.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:50 smithi050 bash[28929]: cluster 2024-05-20T22:12:48.199661+0000 mon.a (mon.0) 1581 : cluster 0 osdmap e172: 8 total, 8 up, 8 in 2024-05-20T22:12:50.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:50 smithi050 bash[28929]: audit 2024-05-20T22:12:48.200376+0000 mon.c (mon.2) 206 : audit 1 from='client.? v1:172.21.15.50:0/4204483522' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi050-63936-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:50.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:50 smithi050 bash[28929]: audit 2024-05-20T22:12:48.205559+0000 mon.a (mon.0) 1582 : audit 1 from='client.25931 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi050-63936-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:50.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:50 smithi050 bash[28929]: cluster 2024-05-20T22:12:49.136871+0000 mon.a (mon.0) 1583 : cluster 0 osdmap e173: 8 total, 8 up, 8 in 2024-05-20T22:12:51.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:51 smithi145 bash[23893]: audit 2024-05-20T22:12:50.040517+0000 mon.a (mon.0) 1584 : audit 1 from='client.25931 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi050-63936-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi050-63936-27"}]': finished 2024-05-20T22:12:51.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:51 smithi145 bash[23893]: cluster 2024-05-20T22:12:50.048756+0000 mon.a (mon.0) 1585 : cluster 0 osdmap e174: 8 total, 8 up, 8 in 2024-05-20T22:12:51.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:51 smithi145 bash[23893]: audit 2024-05-20T22:12:50.050567+0000 mon.a (mon.0) 1586 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:51.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:51 smithi145 bash[23893]: cluster 2024-05-20T22:12:50.053707+0000 mgr.y (mgr.14592) 271 : cluster 0 pgmap v273: 436 pgs: 72 unknown, 364 active+clean; 608 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 8.2 KiB/s wr, 1 op/s 2024-05-20T22:12:51.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:51 smithi145 bash[23893]: audit 2024-05-20T22:12:50.065653+0000 mon.c (mon.2) 207 : audit 1 from='client.? v1:172.21.15.50:0/1752782716' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi050-63944-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:51.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:51 smithi145 bash[23893]: audit 2024-05-20T22:12:50.068376+0000 mon.a (mon.0) 1587 : audit 1 from='client.25937 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi050-63944-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:51.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:51 smithi050 bash[21866]: audit 2024-05-20T22:12:50.040517+0000 mon.a (mon.0) 1584 : audit 1 from='client.25931 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi050-63936-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi050-63936-27"}]': finished 2024-05-20T22:12:51.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:51 smithi050 bash[21866]: cluster 2024-05-20T22:12:50.048756+0000 mon.a (mon.0) 1585 : cluster 0 osdmap e174: 8 total, 8 up, 8 in 2024-05-20T22:12:51.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:51 smithi050 bash[21866]: audit 2024-05-20T22:12:50.050567+0000 mon.a (mon.0) 1586 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:51.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:51 smithi050 bash[21866]: cluster 2024-05-20T22:12:50.053707+0000 mgr.y (mgr.14592) 271 : cluster 0 pgmap v273: 436 pgs: 72 unknown, 364 active+clean; 608 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 8.2 KiB/s wr, 1 op/s 2024-05-20T22:12:51.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:51 smithi050 bash[21866]: audit 2024-05-20T22:12:50.065653+0000 mon.c (mon.2) 207 : audit 1 from='client.? v1:172.21.15.50:0/1752782716' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi050-63944-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:51.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:51 smithi050 bash[21866]: audit 2024-05-20T22:12:50.068376+0000 mon.a (mon.0) 1587 : audit 1 from='client.25937 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi050-63944-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:51.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:51 smithi050 bash[28929]: audit 2024-05-20T22:12:50.040517+0000 mon.a (mon.0) 1584 : audit 1 from='client.25931 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi050-63936-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi050-63936-27"}]': finished 2024-05-20T22:12:51.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:51 smithi050 bash[28929]: cluster 2024-05-20T22:12:50.048756+0000 mon.a (mon.0) 1585 : cluster 0 osdmap e174: 8 total, 8 up, 8 in 2024-05-20T22:12:51.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:51 smithi050 bash[28929]: audit 2024-05-20T22:12:50.050567+0000 mon.a (mon.0) 1586 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:51.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:51 smithi050 bash[28929]: cluster 2024-05-20T22:12:50.053707+0000 mgr.y (mgr.14592) 271 : cluster 0 pgmap v273: 436 pgs: 72 unknown, 364 active+clean; 608 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 8.2 KiB/s wr, 1 op/s 2024-05-20T22:12:51.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:51 smithi050 bash[28929]: audit 2024-05-20T22:12:50.065653+0000 mon.c (mon.2) 207 : audit 1 from='client.? v1:172.21.15.50:0/1752782716' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi050-63944-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:51.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:51 smithi050 bash[28929]: audit 2024-05-20T22:12:50.068376+0000 mon.a (mon.0) 1587 : audit 1 from='client.25937 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi050-63944-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:52.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:52 smithi145 bash[23893]: audit 2024-05-20T22:12:51.044064+0000 mon.a (mon.0) 1588 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:52.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:52 smithi145 bash[23893]: audit 2024-05-20T22:12:51.044261+0000 mon.a (mon.0) 1589 : audit 1 from='client.25937 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi050-63944-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:52.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:52 smithi145 bash[23893]: cluster 2024-05-20T22:12:51.052505+0000 mon.a (mon.0) 1590 : cluster 0 osdmap e175: 8 total, 8 up, 8 in 2024-05-20T22:12:52.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:52 smithi145 bash[23893]: audit 2024-05-20T22:12:51.083149+0000 mon.a (mon.0) 1591 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:12:52.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:52 smithi145 bash[23893]: audit 2024-05-20T22:12:51.086527+0000 mon.a (mon.0) 1592 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:12:52.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:52 smithi050 bash[21866]: audit 2024-05-20T22:12:51.044064+0000 mon.a (mon.0) 1588 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:52.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:52 smithi050 bash[21866]: audit 2024-05-20T22:12:51.044261+0000 mon.a (mon.0) 1589 : audit 1 from='client.25937 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi050-63944-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:52.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:52 smithi050 bash[21866]: cluster 2024-05-20T22:12:51.052505+0000 mon.a (mon.0) 1590 : cluster 0 osdmap e175: 8 total, 8 up, 8 in 2024-05-20T22:12:52.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:52 smithi050 bash[21866]: audit 2024-05-20T22:12:51.083149+0000 mon.a (mon.0) 1591 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:12:52.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:52 smithi050 bash[21866]: audit 2024-05-20T22:12:51.086527+0000 mon.a (mon.0) 1592 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:12:52.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:52 smithi050 bash[28929]: audit 2024-05-20T22:12:51.044064+0000 mon.a (mon.0) 1588 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:52.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:52 smithi050 bash[28929]: audit 2024-05-20T22:12:51.044261+0000 mon.a (mon.0) 1589 : audit 1 from='client.25937 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi050-63944-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:52.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:52 smithi050 bash[28929]: cluster 2024-05-20T22:12:51.052505+0000 mon.a (mon.0) 1590 : cluster 0 osdmap e175: 8 total, 8 up, 8 in 2024-05-20T22:12:52.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:52 smithi050 bash[28929]: audit 2024-05-20T22:12:51.083149+0000 mon.a (mon.0) 1591 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:12:52.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:52 smithi050 bash[28929]: audit 2024-05-20T22:12:51.086527+0000 mon.a (mon.0) 1592 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:12:53.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:53 smithi145 bash[23893]: cluster 2024-05-20T22:12:52.054798+0000 mgr.y (mgr.14592) 272 : cluster 0 pgmap v275: 436 pgs: 72 unknown, 364 active+clean; 608 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 8.0 KiB/s wr, 1 op/s 2024-05-20T22:12:53.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:53 smithi145 bash[23893]: cluster 2024-05-20T22:12:52.080445+0000 mon.a (mon.0) 1593 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:53.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:53 smithi145 bash[23893]: cluster 2024-05-20T22:12:52.088772+0000 mon.a (mon.0) 1594 : cluster 0 osdmap e176: 8 total, 8 up, 8 in 2024-05-20T22:12:53.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:53 smithi145 bash[23893]: audit 2024-05-20T22:12:52.093809+0000 mon.c (mon.2) 208 : audit 1 from='client.? v1:172.21.15.50:0/4204483522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:53.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:53 smithi145 bash[23893]: audit 2024-05-20T22:12:52.102366+0000 mon.a (mon.0) 1595 : audit 1 from='client.25931 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:53.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:53 smithi145 bash[23893]: audit 2024-05-20T22:12:52.131772+0000 mon.a (mon.0) 1596 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:12:53.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:53 smithi050 bash[21866]: cluster 2024-05-20T22:12:52.054798+0000 mgr.y (mgr.14592) 272 : cluster 0 pgmap v275: 436 pgs: 72 unknown, 364 active+clean; 608 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 8.0 KiB/s wr, 1 op/s 2024-05-20T22:12:53.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:53 smithi050 bash[21866]: cluster 2024-05-20T22:12:52.080445+0000 mon.a (mon.0) 1593 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:53.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:53 smithi050 bash[21866]: cluster 2024-05-20T22:12:52.088772+0000 mon.a (mon.0) 1594 : cluster 0 osdmap e176: 8 total, 8 up, 8 in 2024-05-20T22:12:53.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:53 smithi050 bash[21866]: audit 2024-05-20T22:12:52.093809+0000 mon.c (mon.2) 208 : audit 1 from='client.? v1:172.21.15.50:0/4204483522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:53.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:53 smithi050 bash[21866]: audit 2024-05-20T22:12:52.102366+0000 mon.a (mon.0) 1595 : audit 1 from='client.25931 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:53.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:53 smithi050 bash[21866]: audit 2024-05-20T22:12:52.131772+0000 mon.a (mon.0) 1596 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:12:53.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:53 smithi050 bash[28929]: cluster 2024-05-20T22:12:52.054798+0000 mgr.y (mgr.14592) 272 : cluster 0 pgmap v275: 436 pgs: 72 unknown, 364 active+clean; 608 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 8.0 KiB/s wr, 1 op/s 2024-05-20T22:12:53.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:53 smithi050 bash[28929]: cluster 2024-05-20T22:12:52.080445+0000 mon.a (mon.0) 1593 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:53.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:53 smithi050 bash[28929]: cluster 2024-05-20T22:12:52.088772+0000 mon.a (mon.0) 1594 : cluster 0 osdmap e176: 8 total, 8 up, 8 in 2024-05-20T22:12:53.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:53 smithi050 bash[28929]: audit 2024-05-20T22:12:52.093809+0000 mon.c (mon.2) 208 : audit 1 from='client.? v1:172.21.15.50:0/4204483522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:53.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:53 smithi050 bash[28929]: audit 2024-05-20T22:12:52.102366+0000 mon.a (mon.0) 1595 : audit 1 from='client.25931 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:53.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:53 smithi050 bash[28929]: audit 2024-05-20T22:12:52.131772+0000 mon.a (mon.0) 1596 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:12:54.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:54 smithi145 bash[23893]: audit 2024-05-20T22:12:53.098397+0000 mon.a (mon.0) 1597 : audit 1 from='client.25931 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi050-63936-27"}]': finished 2024-05-20T22:12:54.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:54 smithi145 bash[23893]: audit 2024-05-20T22:12:53.098617+0000 mon.a (mon.0) 1598 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-15", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:12:54.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:54 smithi145 bash[23893]: cluster 2024-05-20T22:12:53.106048+0000 mon.a (mon.0) 1599 : cluster 0 osdmap e177: 8 total, 8 up, 8 in 2024-05-20T22:12:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:54 smithi145 bash[23893]: audit 2024-05-20T22:12:53.107817+0000 mon.c (mon.2) 209 : audit 1 from='client.? v1:172.21.15.50:0/4204483522' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:54 smithi145 bash[23893]: audit 2024-05-20T22:12:53.109239+0000 mon.c (mon.2) 210 : audit 1 from='client.? v1:172.21.15.50:0/3539960813' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi050-63944-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:54 smithi145 bash[23893]: audit 2024-05-20T22:12:53.111303+0000 mon.a (mon.0) 1600 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-15"}]: dispatch 2024-05-20T22:12:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:54 smithi145 bash[23893]: audit 2024-05-20T22:12:53.112735+0000 mon.a (mon.0) 1601 : audit 1 from='client.25931 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:54 smithi145 bash[23893]: audit 2024-05-20T22:12:53.113874+0000 mon.a (mon.0) 1602 : audit 1 from='client.25943 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi050-63944-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:54 smithi145 bash[23893]: audit 2024-05-20T22:12:53.657211+0000 mon.a (mon.0) 1603 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-15"}]': finished 2024-05-20T22:12:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:54 smithi145 bash[23893]: audit 2024-05-20T22:12:53.657334+0000 mon.a (mon.0) 1604 : audit 1 from='client.25931 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi050-63936-27"}]': finished 2024-05-20T22:12:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:54 smithi145 bash[23893]: audit 2024-05-20T22:12:53.657477+0000 mon.a (mon.0) 1605 : audit 1 from='client.25943 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi050-63944-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:54 smithi145 bash[23893]: cluster 2024-05-20T22:12:53.666148+0000 mon.a (mon.0) 1606 : cluster 0 osdmap e178: 8 total, 8 up, 8 in 2024-05-20T22:12:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:54 smithi145 bash[23893]: audit 2024-05-20T22:12:53.672965+0000 mon.a (mon.0) 1607 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-15", "mode": "writeback"}]: dispatch 2024-05-20T22:12:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:54 smithi145 bash[23893]: audit 2024-05-20T22:12:53.707792+0000 mon.c (mon.2) 211 : audit 1 from='client.? v1:172.21.15.50:0/2811323972' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:12:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:54 smithi145 bash[23893]: audit 2024-05-20T22:12:53.708209+0000 mon.a (mon.0) 1608 : audit 1 from='client.25949 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:12:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:54 smithi145 bash[23893]: audit 2024-05-20T22:12:53.708700+0000 mon.c (mon.2) 212 : audit 1 from='client.? v1:172.21.15.50:0/2811323972' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:12:54.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:54 smithi145 bash[23893]: audit 2024-05-20T22:12:53.708964+0000 mon.a (mon.0) 1609 : audit 1 from='client.25949 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:12:54.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:54 smithi145 bash[23893]: audit 2024-05-20T22:12:53.709412+0000 mon.c (mon.2) 213 : audit 1 from='client.? v1:172.21.15.50:0/2811323972' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi050-63936-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:54.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:54 smithi145 bash[23893]: audit 2024-05-20T22:12:53.709658+0000 mon.a (mon.0) 1610 : audit 1 from='client.25949 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi050-63936-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:54.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:54 smithi050 bash[21866]: audit 2024-05-20T22:12:53.098397+0000 mon.a (mon.0) 1597 : audit 1 from='client.25931 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi050-63936-27"}]': finished 2024-05-20T22:12:54.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:54 smithi050 bash[21866]: audit 2024-05-20T22:12:53.098617+0000 mon.a (mon.0) 1598 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-15", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:12:54.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:54 smithi050 bash[21866]: cluster 2024-05-20T22:12:53.106048+0000 mon.a (mon.0) 1599 : cluster 0 osdmap e177: 8 total, 8 up, 8 in 2024-05-20T22:12:54.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:54 smithi050 bash[21866]: audit 2024-05-20T22:12:53.107817+0000 mon.c (mon.2) 209 : audit 1 from='client.? v1:172.21.15.50:0/4204483522' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:54.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:54 smithi050 bash[21866]: audit 2024-05-20T22:12:53.109239+0000 mon.c (mon.2) 210 : audit 1 from='client.? v1:172.21.15.50:0/3539960813' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi050-63944-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:54.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:54 smithi050 bash[21866]: audit 2024-05-20T22:12:53.111303+0000 mon.a (mon.0) 1600 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-15"}]: dispatch 2024-05-20T22:12:54.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:54 smithi050 bash[21866]: audit 2024-05-20T22:12:53.112735+0000 mon.a (mon.0) 1601 : audit 1 from='client.25931 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:54.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:54 smithi050 bash[21866]: audit 2024-05-20T22:12:53.113874+0000 mon.a (mon.0) 1602 : audit 1 from='client.25943 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi050-63944-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:54.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:54 smithi050 bash[21866]: audit 2024-05-20T22:12:53.657211+0000 mon.a (mon.0) 1603 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-15"}]': finished 2024-05-20T22:12:54.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:54 smithi050 bash[21866]: audit 2024-05-20T22:12:53.657334+0000 mon.a (mon.0) 1604 : audit 1 from='client.25931 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi050-63936-27"}]': finished 2024-05-20T22:12:54.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:54 smithi050 bash[21866]: audit 2024-05-20T22:12:53.657477+0000 mon.a (mon.0) 1605 : audit 1 from='client.25943 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi050-63944-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:54.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:54 smithi050 bash[21866]: cluster 2024-05-20T22:12:53.666148+0000 mon.a (mon.0) 1606 : cluster 0 osdmap e178: 8 total, 8 up, 8 in 2024-05-20T22:12:54.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:54 smithi050 bash[21866]: audit 2024-05-20T22:12:53.672965+0000 mon.a (mon.0) 1607 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-15", "mode": "writeback"}]: dispatch 2024-05-20T22:12:54.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:54 smithi050 bash[21866]: audit 2024-05-20T22:12:53.707792+0000 mon.c (mon.2) 211 : audit 1 from='client.? v1:172.21.15.50:0/2811323972' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:12:54.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:54 smithi050 bash[21866]: audit 2024-05-20T22:12:53.708209+0000 mon.a (mon.0) 1608 : audit 1 from='client.25949 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:12:54.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:54 smithi050 bash[28929]: audit 2024-05-20T22:12:53.098397+0000 mon.a (mon.0) 1597 : audit 1 from='client.25931 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi050-63936-27"}]': finished 2024-05-20T22:12:54.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:54 smithi050 bash[28929]: audit 2024-05-20T22:12:53.098617+0000 mon.a (mon.0) 1598 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-15", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:12:54.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:54 smithi050 bash[28929]: cluster 2024-05-20T22:12:53.106048+0000 mon.a (mon.0) 1599 : cluster 0 osdmap e177: 8 total, 8 up, 8 in 2024-05-20T22:12:54.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:54 smithi050 bash[28929]: audit 2024-05-20T22:12:53.107817+0000 mon.c (mon.2) 209 : audit 1 from='client.? v1:172.21.15.50:0/4204483522' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:54.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:54 smithi050 bash[28929]: audit 2024-05-20T22:12:53.109239+0000 mon.c (mon.2) 210 : audit 1 from='client.? v1:172.21.15.50:0/3539960813' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi050-63944-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:54.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:54 smithi050 bash[28929]: audit 2024-05-20T22:12:53.111303+0000 mon.a (mon.0) 1600 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-15"}]: dispatch 2024-05-20T22:12:54.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:54 smithi050 bash[28929]: audit 2024-05-20T22:12:53.112735+0000 mon.a (mon.0) 1601 : audit 1 from='client.25931 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi050-63936-27"}]: dispatch 2024-05-20T22:12:54.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:54 smithi050 bash[28929]: audit 2024-05-20T22:12:53.113874+0000 mon.a (mon.0) 1602 : audit 1 from='client.25943 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi050-63944-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:54.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:54 smithi050 bash[28929]: audit 2024-05-20T22:12:53.657211+0000 mon.a (mon.0) 1603 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-15"}]': finished 2024-05-20T22:12:54.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:54 smithi050 bash[28929]: audit 2024-05-20T22:12:53.657334+0000 mon.a (mon.0) 1604 : audit 1 from='client.25931 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi050-63936-27"}]': finished 2024-05-20T22:12:54.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:54 smithi050 bash[28929]: audit 2024-05-20T22:12:53.657477+0000 mon.a (mon.0) 1605 : audit 1 from='client.25943 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi050-63944-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:54.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:54 smithi050 bash[28929]: cluster 2024-05-20T22:12:53.666148+0000 mon.a (mon.0) 1606 : cluster 0 osdmap e178: 8 total, 8 up, 8 in 2024-05-20T22:12:54.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:54 smithi050 bash[28929]: audit 2024-05-20T22:12:53.672965+0000 mon.a (mon.0) 1607 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-15", "mode": "writeback"}]: dispatch 2024-05-20T22:12:54.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:54 smithi050 bash[28929]: audit 2024-05-20T22:12:53.707792+0000 mon.c (mon.2) 211 : audit 1 from='client.? v1:172.21.15.50:0/2811323972' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:12:54.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:54 smithi050 bash[28929]: audit 2024-05-20T22:12:53.708209+0000 mon.a (mon.0) 1608 : audit 1 from='client.25949 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:12:54.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:54 smithi050 bash[21866]: audit 2024-05-20T22:12:53.708700+0000 mon.c (mon.2) 212 : audit 1 from='client.? v1:172.21.15.50:0/2811323972' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:12:54.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:54 smithi050 bash[21866]: audit 2024-05-20T22:12:53.708964+0000 mon.a (mon.0) 1609 : audit 1 from='client.25949 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:12:54.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:54 smithi050 bash[21866]: audit 2024-05-20T22:12:53.709412+0000 mon.c (mon.2) 213 : audit 1 from='client.? v1:172.21.15.50:0/2811323972' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi050-63936-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:54.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:54 smithi050 bash[21866]: audit 2024-05-20T22:12:53.709658+0000 mon.a (mon.0) 1610 : audit 1 from='client.25949 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi050-63936-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:54.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:54 smithi050 bash[28929]: audit 2024-05-20T22:12:53.708700+0000 mon.c (mon.2) 212 : audit 1 from='client.? v1:172.21.15.50:0/2811323972' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:12:54.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:54 smithi050 bash[28929]: audit 2024-05-20T22:12:53.708964+0000 mon.a (mon.0) 1609 : audit 1 from='client.25949 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:12:54.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:54 smithi050 bash[28929]: audit 2024-05-20T22:12:53.709412+0000 mon.c (mon.2) 213 : audit 1 from='client.? v1:172.21.15.50:0/2811323972' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi050-63936-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:54.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:54 smithi050 bash[28929]: audit 2024-05-20T22:12:53.709658+0000 mon.a (mon.0) 1610 : audit 1 from='client.25949 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi050-63936-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:12:55.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:55 smithi050 bash[21866]: cluster 2024-05-20T22:12:54.056027+0000 mgr.y (mgr.14592) 273 : cluster 0 pgmap v279: 428 pgs: 64 unknown, 364 active+clean; 608 KiB data, 570 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:55.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:55 smithi050 bash[21866]: cluster 2024-05-20T22:12:54.657684+0000 mon.a (mon.0) 1611 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:12:55.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:55 smithi050 bash[21866]: audit 2024-05-20T22:12:54.660123+0000 mon.a (mon.0) 1612 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-15", "mode": "writeback"}]': finished 2024-05-20T22:12:55.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:55 smithi050 bash[21866]: audit 2024-05-20T22:12:54.660317+0000 mon.a (mon.0) 1613 : audit 1 from='client.25949 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi050-63936-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:55.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:55 smithi050 bash[21866]: cluster 2024-05-20T22:12:54.668325+0000 mon.a (mon.0) 1614 : cluster 0 osdmap e179: 8 total, 8 up, 8 in 2024-05-20T22:12:55.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:55 smithi050 bash[21866]: audit 2024-05-20T22:12:54.671242+0000 mon.c (mon.2) 214 : audit 1 from='client.? v1:172.21.15.50:0/2811323972' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi050-63936-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:12:55.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:55 smithi050 bash[21866]: audit 2024-05-20T22:12:54.672380+0000 mon.c (mon.2) 215 : audit 1 from='client.? v1:172.21.15.50:0/1472725422' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:55.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:55 smithi050 bash[21866]: audit 2024-05-20T22:12:54.689631+0000 mon.a (mon.0) 1615 : audit 1 from='client.25949 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi050-63936-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:12:55.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:55 smithi050 bash[21866]: audit 2024-05-20T22:12:54.689988+0000 mon.a (mon.0) 1616 : audit 1 from='client.25895 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:55.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:55 smithi050 bash[28929]: cluster 2024-05-20T22:12:54.056027+0000 mgr.y (mgr.14592) 273 : cluster 0 pgmap v279: 428 pgs: 64 unknown, 364 active+clean; 608 KiB data, 570 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:55.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:55 smithi050 bash[28929]: cluster 2024-05-20T22:12:54.657684+0000 mon.a (mon.0) 1611 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:12:55.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:55 smithi050 bash[28929]: audit 2024-05-20T22:12:54.660123+0000 mon.a (mon.0) 1612 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-15", "mode": "writeback"}]': finished 2024-05-20T22:12:55.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:55 smithi050 bash[28929]: audit 2024-05-20T22:12:54.660317+0000 mon.a (mon.0) 1613 : audit 1 from='client.25949 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi050-63936-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:55.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:55 smithi050 bash[28929]: cluster 2024-05-20T22:12:54.668325+0000 mon.a (mon.0) 1614 : cluster 0 osdmap e179: 8 total, 8 up, 8 in 2024-05-20T22:12:55.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:55 smithi050 bash[28929]: audit 2024-05-20T22:12:54.671242+0000 mon.c (mon.2) 214 : audit 1 from='client.? v1:172.21.15.50:0/2811323972' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi050-63936-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:12:55.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:55 smithi050 bash[28929]: audit 2024-05-20T22:12:54.672380+0000 mon.c (mon.2) 215 : audit 1 from='client.? v1:172.21.15.50:0/1472725422' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:55.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:55 smithi050 bash[28929]: audit 2024-05-20T22:12:54.689631+0000 mon.a (mon.0) 1615 : audit 1 from='client.25949 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi050-63936-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:12:55.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:55 smithi050 bash[28929]: audit 2024-05-20T22:12:54.689988+0000 mon.a (mon.0) 1616 : audit 1 from='client.25895 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:55.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:55 smithi145 bash[23893]: cluster 2024-05-20T22:12:54.056027+0000 mgr.y (mgr.14592) 273 : cluster 0 pgmap v279: 428 pgs: 64 unknown, 364 active+clean; 608 KiB data, 570 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:55.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:55 smithi145 bash[23893]: cluster 2024-05-20T22:12:54.657684+0000 mon.a (mon.0) 1611 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:12:55.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:55 smithi145 bash[23893]: audit 2024-05-20T22:12:54.660123+0000 mon.a (mon.0) 1612 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-15", "mode": "writeback"}]': finished 2024-05-20T22:12:55.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:55 smithi145 bash[23893]: audit 2024-05-20T22:12:54.660317+0000 mon.a (mon.0) 1613 : audit 1 from='client.25949 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi050-63936-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:12:55.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:55 smithi145 bash[23893]: cluster 2024-05-20T22:12:54.668325+0000 mon.a (mon.0) 1614 : cluster 0 osdmap e179: 8 total, 8 up, 8 in 2024-05-20T22:12:55.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:55 smithi145 bash[23893]: audit 2024-05-20T22:12:54.671242+0000 mon.c (mon.2) 214 : audit 1 from='client.? v1:172.21.15.50:0/2811323972' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi050-63936-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:12:55.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:55 smithi145 bash[23893]: audit 2024-05-20T22:12:54.672380+0000 mon.c (mon.2) 215 : audit 1 from='client.? v1:172.21.15.50:0/1472725422' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:55.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:55 smithi145 bash[23893]: audit 2024-05-20T22:12:54.689631+0000 mon.a (mon.0) 1615 : audit 1 from='client.25949 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi050-63936-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:12:55.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:55 smithi145 bash[23893]: audit 2024-05-20T22:12:54.689988+0000 mon.a (mon.0) 1616 : audit 1 from='client.25895 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:56.703 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWripp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-05-20T22:12:56.703 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2011 ms) 2024-05-20T22:12:56.703 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (9036 ms total) 2024-05-20T22:12:56.703 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: 2024-05-20T22:12:56.703 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-05-20T22:12:56.703 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-05-20T22:12:56.703 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4095 ms) 2024-05-20T22:12:56.703 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-05-20T22:12:56.703 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (3814 ms) 2024-05-20T22:12:56.703 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-05-20T22:12:56.703 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (3618 ms) 2024-05-20T22:12:56.704 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (11527 ms total) 2024-05-20T22:12:56.704 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: 2024-05-20T22:12:56.704 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2024-05-20T22:12:56.704 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (129885 ms total) 2024-05-20T22:12:56.704 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2024-05-20T22:12:56.704 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2024-05-20T22:12:56.704 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-05-20T22:12:56.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:56 smithi050 bash[21866]: audit 2024-05-20T22:12:55.664656+0000 mon.a (mon.0) 1617 : audit 1 from='client.25895 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]': finished 2024-05-20T22:12:56.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:56 smithi050 bash[21866]: audit 2024-05-20T22:12:55.674896+0000 mon.c (mon.2) 216 : audit 1 from='client.? v1:172.21.15.50:0/1472725422' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:56.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:56 smithi050 bash[21866]: cluster 2024-05-20T22:12:56.134986+0000 mon.a (mon.0) 1618 : cluster 0 osdmap e180: 8 total, 8 up, 8 in 2024-05-20T22:12:56.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:56 smithi050 bash[21866]: audit 2024-05-20T22:12:56.137539+0000 mon.a (mon.0) 1619 : audit 1 from='client.25895 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:56.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:56 smithi050 bash[21866]: audit 2024-05-20T22:12:56.139224+0000 mon.c (mon.2) 217 : audit 1 from='client.? v1:172.21.15.50:0/1739218708' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi050-63944-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:56.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:56 smithi050 bash[21866]: audit 2024-05-20T22:12:56.139809+0000 mon.a (mon.0) 1620 : audit 1 from='client.25955 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi050-63944-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:56.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:56 smithi050 bash[21866]: audit 2024-05-20T22:12:56.167036+0000 mon.a (mon.0) 1621 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:12:56.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:56 smithi050 bash[28929]: audit 2024-05-20T22:12:55.664656+0000 mon.a (mon.0) 1617 : audit 1 from='client.25895 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]': finished 2024-05-20T22:12:56.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:56 smithi050 bash[28929]: audit 2024-05-20T22:12:55.674896+0000 mon.c (mon.2) 216 : audit 1 from='client.? v1:172.21.15.50:0/1472725422' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:56.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:56 smithi050 bash[28929]: cluster 2024-05-20T22:12:56.134986+0000 mon.a (mon.0) 1618 : cluster 0 osdmap e180: 8 total, 8 up, 8 in 2024-05-20T22:12:56.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:56 smithi050 bash[28929]: audit 2024-05-20T22:12:56.137539+0000 mon.a (mon.0) 1619 : audit 1 from='client.25895 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:56.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:56 smithi050 bash[28929]: audit 2024-05-20T22:12:56.139224+0000 mon.c (mon.2) 217 : audit 1 from='client.? v1:172.21.15.50:0/1739218708' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi050-63944-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:56.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:56 smithi050 bash[28929]: audit 2024-05-20T22:12:56.139809+0000 mon.a (mon.0) 1620 : audit 1 from='client.25955 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi050-63944-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:56.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:56 smithi050 bash[28929]: audit 2024-05-20T22:12:56.167036+0000 mon.a (mon.0) 1621 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:12:57.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:56 smithi145 bash[23893]: audit 2024-05-20T22:12:55.664656+0000 mon.a (mon.0) 1617 : audit 1 from='client.25895 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]': finished 2024-05-20T22:12:57.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:56 smithi145 bash[23893]: audit 2024-05-20T22:12:55.674896+0000 mon.c (mon.2) 216 : audit 1 from='client.? v1:172.21.15.50:0/1472725422' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:57.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:56 smithi145 bash[23893]: cluster 2024-05-20T22:12:56.134986+0000 mon.a (mon.0) 1618 : cluster 0 osdmap e180: 8 total, 8 up, 8 in 2024-05-20T22:12:57.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:56 smithi145 bash[23893]: audit 2024-05-20T22:12:56.137539+0000 mon.a (mon.0) 1619 : audit 1 from='client.25895 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]: dispatch 2024-05-20T22:12:57.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:56 smithi145 bash[23893]: audit 2024-05-20T22:12:56.139224+0000 mon.c (mon.2) 217 : audit 1 from='client.? v1:172.21.15.50:0/1739218708' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi050-63944-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:57.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:56 smithi145 bash[23893]: audit 2024-05-20T22:12:56.139809+0000 mon.a (mon.0) 1620 : audit 1 from='client.25955 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi050-63944-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:12:57.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:56 smithi145 bash[23893]: audit 2024-05-20T22:12:56.167036+0000 mon.a (mon.0) 1621 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:12:58.140 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:12:57 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:12:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:57 smithi145 bash[23893]: cluster 2024-05-20T22:12:56.057033+0000 mgr.y (mgr.14592) 274 : cluster 0 pgmap v282: 420 pgs: 32 unknown, 388 active+clean; 584 KiB data, 571 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:57 smithi145 bash[23893]: audit 2024-05-20T22:12:56.679633+0000 mon.a (mon.0) 1622 : audit 1 from='client.25949 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi050-63936-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi050-63936-28"}]': finished 2024-05-20T22:12:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:57 smithi145 bash[23893]: audit 2024-05-20T22:12:56.679953+0000 mon.a (mon.0) 1623 : audit 1 from='client.25895 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]': finished 2024-05-20T22:12:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:57 smithi145 bash[23893]: audit 2024-05-20T22:12:56.680094+0000 mon.a (mon.0) 1624 : audit 1 from='client.25955 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi050-63944-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:57 smithi145 bash[23893]: audit 2024-05-20T22:12:56.680234+0000 mon.a (mon.0) 1625 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:12:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:57 smithi145 bash[23893]: cluster 2024-05-20T22:12:56.690872+0000 mon.a (mon.0) 1626 : cluster 0 osdmap e181: 8 total, 8 up, 8 in 2024-05-20T22:12:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:57 smithi145 bash[23893]: audit 2024-05-20T22:12:56.696008+0000 mon.a (mon.0) 1627 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-15"}]: dispatch 2024-05-20T22:12:58.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:57 smithi050 bash[21866]: cluster 2024-05-20T22:12:56.057033+0000 mgr.y (mgr.14592) 274 : cluster 0 pgmap v282: 420 pgs: 32 unknown, 388 active+clean; 584 KiB data, 571 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:58.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:57 smithi050 bash[21866]: audit 2024-05-20T22:12:56.679633+0000 mon.a (mon.0) 1622 : audit 1 from='client.25949 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi050-63936-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi050-63936-28"}]': finished 2024-05-20T22:12:58.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:57 smithi050 bash[21866]: audit 2024-05-20T22:12:56.679953+0000 mon.a (mon.0) 1623 : audit 1 from='client.25895 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]': finished 2024-05-20T22:12:58.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:57 smithi050 bash[21866]: audit 2024-05-20T22:12:56.680094+0000 mon.a (mon.0) 1624 : audit 1 from='client.25955 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi050-63944-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:58.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:57 smithi050 bash[21866]: audit 2024-05-20T22:12:56.680234+0000 mon.a (mon.0) 1625 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:12:58.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:57 smithi050 bash[21866]: cluster 2024-05-20T22:12:56.690872+0000 mon.a (mon.0) 1626 : cluster 0 osdmap e181: 8 total, 8 up, 8 in 2024-05-20T22:12:58.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:57 smithi050 bash[21866]: audit 2024-05-20T22:12:56.696008+0000 mon.a (mon.0) 1627 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-15"}]: dispatch 2024-05-20T22:12:58.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:57 smithi050 bash[28929]: cluster 2024-05-20T22:12:56.057033+0000 mgr.y (mgr.14592) 274 : cluster 0 pgmap v282: 420 pgs: 32 unknown, 388 active+clean; 584 KiB data, 571 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:58.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:57 smithi050 bash[28929]: audit 2024-05-20T22:12:56.679633+0000 mon.a (mon.0) 1622 : audit 1 from='client.25949 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi050-63936-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi050-63936-28"}]': finished 2024-05-20T22:12:58.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:57 smithi050 bash[28929]: audit 2024-05-20T22:12:56.679953+0000 mon.a (mon.0) 1623 : audit 1 from='client.25895 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi050-64159-21"}]': finished 2024-05-20T22:12:58.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:57 smithi050 bash[28929]: audit 2024-05-20T22:12:56.680094+0000 mon.a (mon.0) 1624 : audit 1 from='client.25955 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi050-63944-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:12:58.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:57 smithi050 bash[28929]: audit 2024-05-20T22:12:56.680234+0000 mon.a (mon.0) 1625 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:12:58.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:57 smithi050 bash[28929]: cluster 2024-05-20T22:12:56.690872+0000 mon.a (mon.0) 1626 : cluster 0 osdmap e181: 8 total, 8 up, 8 in 2024-05-20T22:12:58.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:57 smithi050 bash[28929]: audit 2024-05-20T22:12:56.696008+0000 mon.a (mon.0) 1627 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-15"}]: dispatch 2024-05-20T22:12:59.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:58 smithi145 bash[23893]: cluster 2024-05-20T22:12:57.680126+0000 mon.a (mon.0) 1628 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:12:59.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:58 smithi145 bash[23893]: audit 2024-05-20T22:12:57.682692+0000 mon.a (mon.0) 1629 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-15"}]': finished 2024-05-20T22:12:59.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:58 smithi145 bash[23893]: cluster 2024-05-20T22:12:57.691601+0000 mon.a (mon.0) 1630 : cluster 0 osdmap e182: 8 total, 8 up, 8 in 2024-05-20T22:12:59.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:58 smithi145 bash[23893]: audit 2024-05-20T22:12:57.759357+0000 mgr.y (mgr.14592) 275 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:12:59.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:58 smithi145 bash[23893]: cluster 2024-05-20T22:12:58.057945+0000 mgr.y (mgr.14592) 276 : cluster 0 pgmap v285: 396 pgs: 8 unknown, 388 active+clean; 584 KiB data, 571 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:59.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:58 smithi145 bash[23893]: cluster 2024-05-20T22:12:58.656412+0000 mon.a (mon.0) 1631 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:59.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:58 smithi050 bash[21866]: cluster 2024-05-20T22:12:57.680126+0000 mon.a (mon.0) 1628 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:12:59.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:58 smithi050 bash[21866]: audit 2024-05-20T22:12:57.682692+0000 mon.a (mon.0) 1629 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-15"}]': finished 2024-05-20T22:12:59.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:58 smithi050 bash[21866]: cluster 2024-05-20T22:12:57.691601+0000 mon.a (mon.0) 1630 : cluster 0 osdmap e182: 8 total, 8 up, 8 in 2024-05-20T22:12:59.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:58 smithi050 bash[21866]: audit 2024-05-20T22:12:57.759357+0000 mgr.y (mgr.14592) 275 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:12:59.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:58 smithi050 bash[21866]: cluster 2024-05-20T22:12:58.057945+0000 mgr.y (mgr.14592) 276 : cluster 0 pgmap v285: 396 pgs: 8 unknown, 388 active+clean; 584 KiB data, 571 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:59.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:58 smithi050 bash[21866]: cluster 2024-05-20T22:12:58.656412+0000 mon.a (mon.0) 1631 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:59.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:58 smithi050 bash[28929]: cluster 2024-05-20T22:12:57.680126+0000 mon.a (mon.0) 1628 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:12:59.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:58 smithi050 bash[28929]: audit 2024-05-20T22:12:57.682692+0000 mon.a (mon.0) 1629 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-15"}]': finished 2024-05-20T22:12:59.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:58 smithi050 bash[28929]: cluster 2024-05-20T22:12:57.691601+0000 mon.a (mon.0) 1630 : cluster 0 osdmap e182: 8 total, 8 up, 8 in 2024-05-20T22:12:59.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:58 smithi050 bash[28929]: audit 2024-05-20T22:12:57.759357+0000 mgr.y (mgr.14592) 275 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:12:59.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:58 smithi050 bash[28929]: cluster 2024-05-20T22:12:58.057945+0000 mgr.y (mgr.14592) 276 : cluster 0 pgmap v285: 396 pgs: 8 unknown, 388 active+clean; 584 KiB data, 571 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:12:59.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:58 smithi050 bash[28929]: cluster 2024-05-20T22:12:58.656412+0000 mon.a (mon.0) 1631 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:12:59.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:12:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:12:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:13:00.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:59 smithi145 bash[23893]: cluster 2024-05-20T22:12:58.717390+0000 mon.a (mon.0) 1632 : cluster 0 osdmap e183: 8 total, 8 up, 8 in 2024-05-20T22:13:00.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:59 smithi145 bash[23893]: audit 2024-05-20T22:12:58.731432+0000 mon.c (mon.2) 218 : audit 1 from='client.? v1:172.21.15.50:0/4264041120' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi050-63944-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:00.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:59 smithi145 bash[23893]: audit 2024-05-20T22:12:58.732251+0000 mon.c (mon.2) 219 : audit 1 from='client.? v1:172.21.15.50:0/2811323972' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:13:00.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:59 smithi145 bash[23893]: audit 2024-05-20T22:12:59.187580+0000 mon.a (mon.0) 1633 : audit 1 from='client.25961 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi050-63944-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:00.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:12:59 smithi145 bash[23893]: audit 2024-05-20T22:12:59.188327+0000 mon.a (mon.0) 1634 : audit 1 from='client.25949 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:13:00.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:59 smithi050 bash[21866]: cluster 2024-05-20T22:12:58.717390+0000 mon.a (mon.0) 1632 : cluster 0 osdmap e183: 8 total, 8 up, 8 in 2024-05-20T22:13:00.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:59 smithi050 bash[21866]: audit 2024-05-20T22:12:58.731432+0000 mon.c (mon.2) 218 : audit 1 from='client.? v1:172.21.15.50:0/4264041120' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi050-63944-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:00.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:59 smithi050 bash[21866]: audit 2024-05-20T22:12:58.732251+0000 mon.c (mon.2) 219 : audit 1 from='client.? v1:172.21.15.50:0/2811323972' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:13:00.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:59 smithi050 bash[21866]: audit 2024-05-20T22:12:59.187580+0000 mon.a (mon.0) 1633 : audit 1 from='client.25961 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi050-63944-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:00.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:12:59 smithi050 bash[21866]: audit 2024-05-20T22:12:59.188327+0000 mon.a (mon.0) 1634 : audit 1 from='client.25949 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:13:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:59 smithi050 bash[28929]: cluster 2024-05-20T22:12:58.717390+0000 mon.a (mon.0) 1632 : cluster 0 osdmap e183: 8 total, 8 up, 8 in 2024-05-20T22:13:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:59 smithi050 bash[28929]: audit 2024-05-20T22:12:58.731432+0000 mon.c (mon.2) 218 : audit 1 from='client.? v1:172.21.15.50:0/4264041120' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi050-63944-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:59 smithi050 bash[28929]: audit 2024-05-20T22:12:58.732251+0000 mon.c (mon.2) 219 : audit 1 from='client.? v1:172.21.15.50:0/2811323972' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:13:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:59 smithi050 bash[28929]: audit 2024-05-20T22:12:59.187580+0000 mon.a (mon.0) 1633 : audit 1 from='client.25961 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi050-63944-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:00.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:12:59 smithi050 bash[28929]: audit 2024-05-20T22:12:59.188327+0000 mon.a (mon.0) 1634 : audit 1 from='client.25949 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:13:00.733 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: Running main() from gmock_main.cc 2024-05-20T22:13:00.733 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2024-05-20T22:13:00.734 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [----------] Global test environment set-up. 2024-05-20T22:13:00.734 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2024-05-20T22:13:00.734 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2024-05-20T22:13:00.734 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (17840 ms) 2024-05-20T22:13:00.734 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2024-05-20T22:13:00.734 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (28678 ms) 2024-05-20T22:13:00.734 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2024-05-20T22:13:00.734 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (9310 ms) 2024-05-20T22:13:00.734 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2024-05-20T22:13:00.734 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (4426 ms) 2024-05-20T22:13:00.734 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2024-05-20T22:13:00.734 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (4422 ms) 2024-05-20T22:13:00.735 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2024-05-20T22:13:00.735 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (4398 ms) 2024-05-20T22:13:00.735 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2024-05-20T22:13:00.735 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (2968 ms) 2024-05-20T22:13:00.735 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-05-20T22:13:00.735 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (3455 ms) 2024-05-20T22:13:00.735 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2024-05-20T22:13:00.735 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (3997 ms) 2024-05-20T22:13:00.735 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2024-05-20T22:13:00.735 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (2978 ms) 2024-05-20T22:13:00.735 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2024-05-20T22:13:00.735 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (3018 ms) 2024-05-20T22:13:00.735 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2024-05-20T22:13:00.736 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3928 ms) 2024-05-20T22:13:00.736 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2024-05-20T22:13:00.736 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (2863 ms) 2024-05-20T22:13:00.736 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-05-20T22:13:00.736 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3012 ms) 2024-05-20T22:13:00.736 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-05-20T22:13:00.736 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3028 ms) 2024-05-20T22:13:00.736 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-05-20T22:13:00.736 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (3025 ms) 2024-05-20T22:13:00.736 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-05-20T22:13:00.736 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (3012 ms) 2024-05-20T22:13:00.736 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2024-05-20T22:13:00.737 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (3016 ms) 2024-05-20T22:13:00.737 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2024-05-20T22:13:00.737 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3002 ms) 2024-05-20T22:13:00.737 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2024-05-20T22:13:00.737 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3033 ms) 2024-05-20T22:13:00.737 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2024-05-20T22:13:00.737 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (3016 ms) 2024-05-20T22:13:00.737 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2024-05-20T22:13:00.737 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3009 ms) 2024-05-20T22:13:00.738 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2024-05-20T22:13:00.738 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (2985 ms) 2024-05-20T22:13:00.738 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2024-05-20T22:13:00.738 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (2956 ms) 2024-05-20T22:13:00.738 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2024-05-20T22:13:00.738 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (2583 ms) 2024-05-20T22:13:00.738 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2024-05-20T22:13:00.738 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3044 ms) 2024-05-20T22:13:00.738 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2024-05-20T22:13:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:00 smithi145 bash[23893]: audit 2024-05-20T22:12:59.716313+0000 mon.a (mon.0) 1635 : audit 1 from='client.25961 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi050-63944-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:00 smithi145 bash[23893]: audit 2024-05-20T22:12:59.716491+0000 mon.a (mon.0) 1636 : audit 1 from='client.25949 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi050-63936-28"}]': finished 2024-05-20T22:13:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:00 smithi145 bash[23893]: audit 2024-05-20T22:12:59.728396+0000 mon.c (mon.2) 220 : audit 1 from='client.? v1:172.21.15.50:0/2811323972' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:13:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:00 smithi145 bash[23893]: cluster 2024-05-20T22:12:59.728683+0000 mon.a (mon.0) 1637 : cluster 0 osdmap e184: 8 total, 8 up, 8 in 2024-05-20T22:13:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:00 smithi145 bash[23893]: audit 2024-05-20T22:12:59.730649+0000 mon.a (mon.0) 1638 : audit 1 from='client.25949 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:13:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:00 smithi145 bash[23893]: audit 2024-05-20T22:12:59.765647+0000 mon.a (mon.0) 1639 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:00 smithi145 bash[23893]: cluster 2024-05-20T22:13:00.061927+0000 mgr.y (mgr.14592) 277 : cluster 0 pgmap v288: 420 pgs: 32 creating+peering, 388 active+clean; 584 KiB data, 555 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-05-20T22:13:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:00 smithi145 bash[23893]: audit 2024-05-20T22:13:00.720364+0000 mon.a (mon.0) 1640 : audit 1 from='client.25949 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi050-63936-28"}]': finished 2024-05-20T22:13:01.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:00 smithi145 bash[23893]: audit 2024-05-20T22:13:00.720548+0000 mon.a (mon.0) 1641 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:01.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:00 smithi145 bash[23893]: cluster 2024-05-20T22:13:00.728794+0000 mon.a (mon.0) 1642 : cluster 0 osdmap e185: 8 total, 8 up, 8 in 2024-05-20T22:13:01.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:00 smithi050 bash[21866]: audit 2024-05-20T22:12:59.716313+0000 mon.a (mon.0) 1635 : audit 1 from='client.25961 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi050-63944-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:01.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:00 smithi050 bash[21866]: audit 2024-05-20T22:12:59.716491+0000 mon.a (mon.0) 1636 : audit 1 from='client.25949 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi050-63936-28"}]': finished 2024-05-20T22:13:01.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:00 smithi050 bash[21866]: audit 2024-05-20T22:12:59.728396+0000 mon.c (mon.2) 220 : audit 1 from='client.? v1:172.21.15.50:0/2811323972' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:13:01.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:00 smithi050 bash[21866]: cluster 2024-05-20T22:12:59.728683+0000 mon.a (mon.0) 1637 : cluster 0 osdmap e184: 8 total, 8 up, 8 in 2024-05-20T22:13:01.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:00 smithi050 bash[21866]: audit 2024-05-20T22:12:59.730649+0000 mon.a (mon.0) 1638 : audit 1 from='client.25949 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:13:01.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:00 smithi050 bash[21866]: audit 2024-05-20T22:12:59.765647+0000 mon.a (mon.0) 1639 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:01.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:00 smithi050 bash[21866]: cluster 2024-05-20T22:13:00.061927+0000 mgr.y (mgr.14592) 277 : cluster 0 pgmap v288: 420 pgs: 32 creating+peering, 388 active+clean; 584 KiB data, 555 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-05-20T22:13:01.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:00 smithi050 bash[21866]: audit 2024-05-20T22:13:00.720364+0000 mon.a (mon.0) 1640 : audit 1 from='client.25949 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi050-63936-28"}]': finished 2024-05-20T22:13:01.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:00 smithi050 bash[21866]: audit 2024-05-20T22:13:00.720548+0000 mon.a (mon.0) 1641 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:01.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:00 smithi050 bash[21866]: cluster 2024-05-20T22:13:00.728794+0000 mon.a (mon.0) 1642 : cluster 0 osdmap e185: 8 total, 8 up, 8 in 2024-05-20T22:13:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:00 smithi050 bash[28929]: audit 2024-05-20T22:12:59.716313+0000 mon.a (mon.0) 1635 : audit 1 from='client.25961 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi050-63944-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:00 smithi050 bash[28929]: audit 2024-05-20T22:12:59.716491+0000 mon.a (mon.0) 1636 : audit 1 from='client.25949 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi050-63936-28"}]': finished 2024-05-20T22:13:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:00 smithi050 bash[28929]: audit 2024-05-20T22:12:59.728396+0000 mon.c (mon.2) 220 : audit 1 from='client.? v1:172.21.15.50:0/2811323972' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:13:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:00 smithi050 bash[28929]: cluster 2024-05-20T22:12:59.728683+0000 mon.a (mon.0) 1637 : cluster 0 osdmap e184: 8 total, 8 up, 8 in 2024-05-20T22:13:01.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:00 smithi050 bash[28929]: audit 2024-05-20T22:12:59.730649+0000 mon.a (mon.0) 1638 : audit 1 from='client.25949 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi050-63936-28"}]: dispatch 2024-05-20T22:13:01.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:00 smithi050 bash[28929]: audit 2024-05-20T22:12:59.765647+0000 mon.a (mon.0) 1639 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:01.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:00 smithi050 bash[28929]: cluster 2024-05-20T22:13:00.061927+0000 mgr.y (mgr.14592) 277 : cluster 0 pgmap v288: 420 pgs: 32 creating+peering, 388 active+clean; 584 KiB data, 555 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-05-20T22:13:01.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:00 smithi050 bash[28929]: audit 2024-05-20T22:13:00.720364+0000 mon.a (mon.0) 1640 : audit 1 from='client.25949 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi050-63936-28"}]': finished 2024-05-20T22:13:01.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:00 smithi050 bash[28929]: audit 2024-05-20T22:13:00.720548+0000 mon.a (mon.0) 1641 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:01.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:00 smithi050 bash[28929]: cluster 2024-05-20T22:13:00.728794+0000 mon.a (mon.0) 1642 : cluster 0 osdmap e185: 8 total, 8 up, 8 in 2024-05-20T22:13:02.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:01 smithi145 bash[23893]: audit 2024-05-20T22:13:00.779960+0000 mon.a (mon.0) 1643 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:02.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:01 smithi145 bash[23893]: audit 2024-05-20T22:13:00.791848+0000 mon.c (mon.2) 221 : audit 1 from='client.? v1:172.21.15.50:0/3772908650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:02.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:01 smithi145 bash[23893]: audit 2024-05-20T22:13:00.794358+0000 mon.a (mon.0) 1644 : audit 1 from='client.25970 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:02.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:01 smithi145 bash[23893]: audit 2024-05-20T22:13:00.794965+0000 mon.c (mon.2) 222 : audit 1 from='client.? v1:172.21.15.50:0/3772908650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:02.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:01 smithi145 bash[23893]: audit 2024-05-20T22:13:00.795297+0000 mon.a (mon.0) 1645 : audit 1 from='client.25970 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:02.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:01 smithi145 bash[23893]: audit 2024-05-20T22:13:00.795935+0000 mon.c (mon.2) 223 : audit 1 from='client.? v1:172.21.15.50:0/3772908650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi050-63936-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:02.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:01 smithi145 bash[23893]: audit 2024-05-20T22:13:01.246150+0000 mon.a (mon.0) 1646 : audit 1 from='client.25970 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi050-63936-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:02.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:01 smithi145 bash[23893]: audit 2024-05-20T22:13:01.761174+0000 mon.a (mon.0) 1647 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-17", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:02.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:01 smithi050 bash[21866]: audit 2024-05-20T22:13:00.779960+0000 mon.a (mon.0) 1643 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:02.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:01 smithi050 bash[21866]: audit 2024-05-20T22:13:00.791848+0000 mon.c (mon.2) 221 : audit 1 from='client.? v1:172.21.15.50:0/3772908650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:02.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:01 smithi050 bash[21866]: audit 2024-05-20T22:13:00.794358+0000 mon.a (mon.0) 1644 : audit 1 from='client.25970 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:02.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:01 smithi050 bash[21866]: audit 2024-05-20T22:13:00.794965+0000 mon.c (mon.2) 222 : audit 1 from='client.? v1:172.21.15.50:0/3772908650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:02.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:01 smithi050 bash[21866]: audit 2024-05-20T22:13:00.795297+0000 mon.a (mon.0) 1645 : audit 1 from='client.25970 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:02.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:01 smithi050 bash[21866]: audit 2024-05-20T22:13:00.795935+0000 mon.c (mon.2) 223 : audit 1 from='client.? v1:172.21.15.50:0/3772908650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi050-63936-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:02.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:01 smithi050 bash[21866]: audit 2024-05-20T22:13:01.246150+0000 mon.a (mon.0) 1646 : audit 1 from='client.25970 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi050-63936-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:02.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:01 smithi050 bash[21866]: audit 2024-05-20T22:13:01.761174+0000 mon.a (mon.0) 1647 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-17", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:02.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:01 smithi050 bash[28929]: audit 2024-05-20T22:13:00.779960+0000 mon.a (mon.0) 1643 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:02.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:01 smithi050 bash[28929]: audit 2024-05-20T22:13:00.791848+0000 mon.c (mon.2) 221 : audit 1 from='client.? v1:172.21.15.50:0/3772908650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:02.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:01 smithi050 bash[28929]: audit 2024-05-20T22:13:00.794358+0000 mon.a (mon.0) 1644 : audit 1 from='client.25970 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:02.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:01 smithi050 bash[28929]: audit 2024-05-20T22:13:00.794965+0000 mon.c (mon.2) 222 : audit 1 from='client.? v1:172.21.15.50:0/3772908650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:02.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:01 smithi050 bash[28929]: audit 2024-05-20T22:13:00.795297+0000 mon.a (mon.0) 1645 : audit 1 from='client.25970 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:02.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:01 smithi050 bash[28929]: audit 2024-05-20T22:13:00.795935+0000 mon.c (mon.2) 223 : audit 1 from='client.? v1:172.21.15.50:0/3772908650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi050-63936-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:02.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:01 smithi050 bash[28929]: audit 2024-05-20T22:13:01.246150+0000 mon.a (mon.0) 1646 : audit 1 from='client.25970 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi050-63936-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:02.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:01 smithi050 bash[28929]: audit 2024-05-20T22:13:01.761174+0000 mon.a (mon.0) 1647 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-17", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:03.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:03 smithi145 bash[23893]: audit 2024-05-20T22:13:01.761429+0000 mon.a (mon.0) 1648 : audit 1 from='client.25970 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi050-63936-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:03.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:03 smithi145 bash[23893]: cluster 2024-05-20T22:13:01.771623+0000 mon.a (mon.0) 1649 : cluster 0 osdmap e186: 8 total, 8 up, 8 in 2024-05-20T22:13:03.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:03 smithi145 bash[23893]: audit 2024-05-20T22:13:01.778779+0000 mon.c (mon.2) 224 : audit 1 from='client.? v1:172.21.15.50:0/3772908650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi050-63936-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:03.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:03 smithi145 bash[23893]: audit 2024-05-20T22:13:01.781796+0000 mon.a (mon.0) 1650 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-17"}]: dispatch 2024-05-20T22:13:03.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:03 smithi145 bash[23893]: audit 2024-05-20T22:13:01.784441+0000 mon.a (mon.0) 1651 : audit 1 from='client.25970 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi050-63936-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:03.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:03 smithi145 bash[23893]: audit 2024-05-20T22:13:01.793345+0000 mon.a (mon.0) 1652 : audit 1 from='client.? v1:172.21.15.50:0/1761647973' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi050-63944-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:03.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:03 smithi145 bash[23893]: cluster 2024-05-20T22:13:02.062999+0000 mgr.y (mgr.14592) 278 : cluster 0 pgmap v291: 420 pgs: 32 unknown, 32 creating+peering, 356 active+clean; 584 KiB data, 555 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:13:03.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:03 smithi145 bash[23893]: audit 2024-05-20T22:13:02.765238+0000 mon.a (mon.0) 1653 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-17"}]': finished 2024-05-20T22:13:03.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:03 smithi050 bash[21866]: audit 2024-05-20T22:13:01.761429+0000 mon.a (mon.0) 1648 : audit 1 from='client.25970 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi050-63936-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:03.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:03 smithi050 bash[21866]: cluster 2024-05-20T22:13:01.771623+0000 mon.a (mon.0) 1649 : cluster 0 osdmap e186: 8 total, 8 up, 8 in 2024-05-20T22:13:03.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:03 smithi050 bash[21866]: audit 2024-05-20T22:13:01.778779+0000 mon.c (mon.2) 224 : audit 1 from='client.? v1:172.21.15.50:0/3772908650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi050-63936-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:03.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:03 smithi050 bash[21866]: audit 2024-05-20T22:13:01.781796+0000 mon.a (mon.0) 1650 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-17"}]: dispatch 2024-05-20T22:13:03.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:03 smithi050 bash[21866]: audit 2024-05-20T22:13:01.784441+0000 mon.a (mon.0) 1651 : audit 1 from='client.25970 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi050-63936-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:03.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:03 smithi050 bash[21866]: audit 2024-05-20T22:13:01.793345+0000 mon.a (mon.0) 1652 : audit 1 from='client.? v1:172.21.15.50:0/1761647973' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi050-63944-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:03.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:03 smithi050 bash[21866]: cluster 2024-05-20T22:13:02.062999+0000 mgr.y (mgr.14592) 278 : cluster 0 pgmap v291: 420 pgs: 32 unknown, 32 creating+peering, 356 active+clean; 584 KiB data, 555 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:13:03.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:03 smithi050 bash[21866]: audit 2024-05-20T22:13:02.765238+0000 mon.a (mon.0) 1653 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-17"}]': finished 2024-05-20T22:13:03.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:03 smithi050 bash[28929]: audit 2024-05-20T22:13:01.761429+0000 mon.a (mon.0) 1648 : audit 1 from='client.25970 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi050-63936-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:03.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:03 smithi050 bash[28929]: cluster 2024-05-20T22:13:01.771623+0000 mon.a (mon.0) 1649 : cluster 0 osdmap e186: 8 total, 8 up, 8 in 2024-05-20T22:13:03.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:03 smithi050 bash[28929]: audit 2024-05-20T22:13:01.778779+0000 mon.c (mon.2) 224 : audit 1 from='client.? v1:172.21.15.50:0/3772908650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi050-63936-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:03.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:03 smithi050 bash[28929]: audit 2024-05-20T22:13:01.781796+0000 mon.a (mon.0) 1650 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-17"}]: dispatch 2024-05-20T22:13:03.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:03 smithi050 bash[28929]: audit 2024-05-20T22:13:01.784441+0000 mon.a (mon.0) 1651 : audit 1 from='client.25970 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi050-63936-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:03.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:03 smithi050 bash[28929]: audit 2024-05-20T22:13:01.793345+0000 mon.a (mon.0) 1652 : audit 1 from='client.? v1:172.21.15.50:0/1761647973' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi050-63944-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:03.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:03 smithi050 bash[28929]: cluster 2024-05-20T22:13:02.062999+0000 mgr.y (mgr.14592) 278 : cluster 0 pgmap v291: 420 pgs: 32 unknown, 32 creating+peering, 356 active+clean; 584 KiB data, 555 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:13:03.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:03 smithi050 bash[28929]: audit 2024-05-20T22:13:02.765238+0000 mon.a (mon.0) 1653 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-17"}]': finished 2024-05-20T22:13:04.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:04 smithi145 bash[23893]: audit 2024-05-20T22:13:02.765505+0000 mon.a (mon.0) 1654 : audit 1 from='client.? v1:172.21.15.50:0/1761647973' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi050-63944-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:04.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:04 smithi145 bash[23893]: cluster 2024-05-20T22:13:03.237568+0000 mon.a (mon.0) 1655 : cluster 0 osdmap e187: 8 total, 8 up, 8 in 2024-05-20T22:13:04.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:04 smithi145 bash[23893]: audit 2024-05-20T22:13:03.239631+0000 mon.a (mon.0) 1656 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-17", "mode": "writeback"}]: dispatch 2024-05-20T22:13:04.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:04 smithi145 bash[23893]: cluster 2024-05-20T22:13:03.660369+0000 mon.a (mon.0) 1657 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:13:04.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:04 smithi145 bash[23893]: audit 2024-05-20T22:13:03.663002+0000 mon.a (mon.0) 1658 : audit 1 from='client.25970 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi050-63936-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi050-63936-29"}]': finished 2024-05-20T22:13:04.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:04 smithi145 bash[23893]: audit 2024-05-20T22:13:03.663221+0000 mon.a (mon.0) 1659 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-17", "mode": "writeback"}]': finished 2024-05-20T22:13:04.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:04 smithi145 bash[23893]: cluster 2024-05-20T22:13:03.670909+0000 mon.a (mon.0) 1660 : cluster 0 osdmap e188: 8 total, 8 up, 8 in 2024-05-20T22:13:04.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:04 smithi145 bash[23893]: audit 2024-05-20T22:13:04.166143+0000 mon.a (mon.0) 1661 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:13:04.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:04 smithi050 bash[21866]: audit 2024-05-20T22:13:02.765505+0000 mon.a (mon.0) 1654 : audit 1 from='client.? v1:172.21.15.50:0/1761647973' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi050-63944-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:04.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:04 smithi050 bash[21866]: cluster 2024-05-20T22:13:03.237568+0000 mon.a (mon.0) 1655 : cluster 0 osdmap e187: 8 total, 8 up, 8 in 2024-05-20T22:13:04.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:04 smithi050 bash[21866]: audit 2024-05-20T22:13:03.239631+0000 mon.a (mon.0) 1656 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-17", "mode": "writeback"}]: dispatch 2024-05-20T22:13:04.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:04 smithi050 bash[21866]: cluster 2024-05-20T22:13:03.660369+0000 mon.a (mon.0) 1657 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:13:04.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:04 smithi050 bash[21866]: audit 2024-05-20T22:13:03.663002+0000 mon.a (mon.0) 1658 : audit 1 from='client.25970 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi050-63936-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi050-63936-29"}]': finished 2024-05-20T22:13:04.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:04 smithi050 bash[21866]: audit 2024-05-20T22:13:03.663221+0000 mon.a (mon.0) 1659 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-17", "mode": "writeback"}]': finished 2024-05-20T22:13:04.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:04 smithi050 bash[21866]: cluster 2024-05-20T22:13:03.670909+0000 mon.a (mon.0) 1660 : cluster 0 osdmap e188: 8 total, 8 up, 8 in 2024-05-20T22:13:04.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:04 smithi050 bash[21866]: audit 2024-05-20T22:13:04.166143+0000 mon.a (mon.0) 1661 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:13:04.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:04 smithi050 bash[28929]: audit 2024-05-20T22:13:02.765505+0000 mon.a (mon.0) 1654 : audit 1 from='client.? v1:172.21.15.50:0/1761647973' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi050-63944-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:04.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:04 smithi050 bash[28929]: cluster 2024-05-20T22:13:03.237568+0000 mon.a (mon.0) 1655 : cluster 0 osdmap e187: 8 total, 8 up, 8 in 2024-05-20T22:13:04.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:04 smithi050 bash[28929]: audit 2024-05-20T22:13:03.239631+0000 mon.a (mon.0) 1656 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-17", "mode": "writeback"}]: dispatch 2024-05-20T22:13:04.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:04 smithi050 bash[28929]: cluster 2024-05-20T22:13:03.660369+0000 mon.a (mon.0) 1657 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:13:04.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:04 smithi050 bash[28929]: audit 2024-05-20T22:13:03.663002+0000 mon.a (mon.0) 1658 : audit 1 from='client.25970 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi050-63936-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi050-63936-29"}]': finished 2024-05-20T22:13:04.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:04 smithi050 bash[28929]: audit 2024-05-20T22:13:03.663221+0000 mon.a (mon.0) 1659 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-17", "mode": "writeback"}]': finished 2024-05-20T22:13:04.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:04 smithi050 bash[28929]: cluster 2024-05-20T22:13:03.670909+0000 mon.a (mon.0) 1660 : cluster 0 osdmap e188: 8 total, 8 up, 8 in 2024-05-20T22:13:04.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:04 smithi050 bash[28929]: audit 2024-05-20T22:13:04.166143+0000 mon.a (mon.0) 1661 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:13:05.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:05 smithi050 bash[21866]: cluster 2024-05-20T22:13:04.063943+0000 mgr.y (mgr.14592) 279 : cluster 0 pgmap v294: 396 pgs: 8 unknown, 32 creating+peering, 356 active+clean; 584 KiB data, 555 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:05.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:05 smithi050 bash[21866]: audit 2024-05-20T22:13:04.673309+0000 mon.a (mon.0) 1662 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:13:05.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:05 smithi050 bash[21866]: cluster 2024-05-20T22:13:04.683495+0000 mon.a (mon.0) 1663 : cluster 0 osdmap e189: 8 total, 8 up, 8 in 2024-05-20T22:13:05.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:05 smithi050 bash[21866]: audit 2024-05-20T22:13:04.684769+0000 mon.a (mon.0) 1664 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-17"}]: dispatch 2024-05-20T22:13:05.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:05 smithi050 bash[21866]: audit 2024-05-20T22:13:04.685519+0000 mon.c (mon.2) 225 : audit 1 from='client.? v1:172.21.15.50:0/806807112' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi050-63944-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:05.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:05 smithi050 bash[21866]: audit 2024-05-20T22:13:04.695962+0000 mon.a (mon.0) 1665 : audit 1 from='client.25979 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi050-63944-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:05.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:05 smithi050 bash[28929]: cluster 2024-05-20T22:13:04.063943+0000 mgr.y (mgr.14592) 279 : cluster 0 pgmap v294: 396 pgs: 8 unknown, 32 creating+peering, 356 active+clean; 584 KiB data, 555 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:05.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:05 smithi050 bash[28929]: audit 2024-05-20T22:13:04.673309+0000 mon.a (mon.0) 1662 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:13:05.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:05 smithi050 bash[28929]: cluster 2024-05-20T22:13:04.683495+0000 mon.a (mon.0) 1663 : cluster 0 osdmap e189: 8 total, 8 up, 8 in 2024-05-20T22:13:05.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:05 smithi050 bash[28929]: audit 2024-05-20T22:13:04.684769+0000 mon.a (mon.0) 1664 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-17"}]: dispatch 2024-05-20T22:13:05.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:05 smithi050 bash[28929]: audit 2024-05-20T22:13:04.685519+0000 mon.c (mon.2) 225 : audit 1 from='client.? v1:172.21.15.50:0/806807112' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi050-63944-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:05.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:05 smithi050 bash[28929]: audit 2024-05-20T22:13:04.695962+0000 mon.a (mon.0) 1665 : audit 1 from='client.25979 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi050-63944-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:06.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:05 smithi145 bash[23893]: cluster 2024-05-20T22:13:04.063943+0000 mgr.y (mgr.14592) 279 : cluster 0 pgmap v294: 396 pgs: 8 unknown, 32 creating+peering, 356 active+clean; 584 KiB data, 555 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:06.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:05 smithi145 bash[23893]: audit 2024-05-20T22:13:04.673309+0000 mon.a (mon.0) 1662 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:13:06.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:05 smithi145 bash[23893]: cluster 2024-05-20T22:13:04.683495+0000 mon.a (mon.0) 1663 : cluster 0 osdmap e189: 8 total, 8 up, 8 in 2024-05-20T22:13:06.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:05 smithi145 bash[23893]: audit 2024-05-20T22:13:04.684769+0000 mon.a (mon.0) 1664 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-17"}]: dispatch 2024-05-20T22:13:06.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:05 smithi145 bash[23893]: audit 2024-05-20T22:13:04.685519+0000 mon.c (mon.2) 225 : audit 1 from='client.? v1:172.21.15.50:0/806807112' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi050-63944-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:06.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:05 smithi145 bash[23893]: audit 2024-05-20T22:13:04.695962+0000 mon.a (mon.0) 1665 : audit 1 from='client.25979 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi050-63944-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:06.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:06 smithi050 bash[21866]: cluster 2024-05-20T22:13:05.674768+0000 mon.a (mon.0) 1666 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:13:06.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:06 smithi050 bash[21866]: audit 2024-05-20T22:13:05.684702+0000 mon.a (mon.0) 1667 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-17"}]': finished 2024-05-20T22:13:06.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:06 smithi050 bash[21866]: audit 2024-05-20T22:13:05.684853+0000 mon.a (mon.0) 1668 : audit 1 from='client.25979 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi050-63944-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:06.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:06 smithi050 bash[21866]: cluster 2024-05-20T22:13:05.692999+0000 mon.a (mon.0) 1669 : cluster 0 osdmap e190: 8 total, 8 up, 8 in 2024-05-20T22:13:06.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:06 smithi050 bash[21866]: audit 2024-05-20T22:13:05.698186+0000 mon.c (mon.2) 226 : audit 1 from='client.? v1:172.21.15.50:0/3772908650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:06.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:06 smithi050 bash[21866]: audit 2024-05-20T22:13:05.700560+0000 mon.a (mon.0) 1670 : audit 1 from='client.25970 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:06.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:06 smithi050 bash[21866]: audit 2024-05-20T22:13:06.113869+0000 mon.a (mon.0) 1671 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:13:06.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:06 smithi050 bash[28929]: cluster 2024-05-20T22:13:05.674768+0000 mon.a (mon.0) 1666 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:13:06.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:06 smithi050 bash[28929]: audit 2024-05-20T22:13:05.684702+0000 mon.a (mon.0) 1667 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-17"}]': finished 2024-05-20T22:13:06.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:06 smithi050 bash[28929]: audit 2024-05-20T22:13:05.684853+0000 mon.a (mon.0) 1668 : audit 1 from='client.25979 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi050-63944-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:06.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:06 smithi050 bash[28929]: cluster 2024-05-20T22:13:05.692999+0000 mon.a (mon.0) 1669 : cluster 0 osdmap e190: 8 total, 8 up, 8 in 2024-05-20T22:13:06.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:06 smithi050 bash[28929]: audit 2024-05-20T22:13:05.698186+0000 mon.c (mon.2) 226 : audit 1 from='client.? v1:172.21.15.50:0/3772908650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:06.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:06 smithi050 bash[28929]: audit 2024-05-20T22:13:05.700560+0000 mon.a (mon.0) 1670 : audit 1 from='client.25970 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:06.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:06 smithi050 bash[28929]: audit 2024-05-20T22:13:06.113869+0000 mon.a (mon.0) 1671 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:13:07.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:06 smithi145 bash[23893]: cluster 2024-05-20T22:13:05.674768+0000 mon.a (mon.0) 1666 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:13:07.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:06 smithi145 bash[23893]: audit 2024-05-20T22:13:05.684702+0000 mon.a (mon.0) 1667 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-17"}]': finished 2024-05-20T22:13:07.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:06 smithi145 bash[23893]: audit 2024-05-20T22:13:05.684853+0000 mon.a (mon.0) 1668 : audit 1 from='client.25979 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi050-63944-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:07.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:06 smithi145 bash[23893]: cluster 2024-05-20T22:13:05.692999+0000 mon.a (mon.0) 1669 : cluster 0 osdmap e190: 8 total, 8 up, 8 in 2024-05-20T22:13:07.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:06 smithi145 bash[23893]: audit 2024-05-20T22:13:05.698186+0000 mon.c (mon.2) 226 : audit 1 from='client.? v1:172.21.15.50:0/3772908650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:07.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:06 smithi145 bash[23893]: audit 2024-05-20T22:13:05.700560+0000 mon.a (mon.0) 1670 : audit 1 from='client.25970 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:07.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:06 smithi145 bash[23893]: audit 2024-05-20T22:13:06.113869+0000 mon.a (mon.0) 1671 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:13:07.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:07 smithi050 bash[21866]: cluster 2024-05-20T22:13:06.064967+0000 mgr.y (mgr.14592) 280 : cluster 0 pgmap v297: 420 pgs: 32 creating+peering, 388 active+clean; 584 KiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-05-20T22:13:07.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:07 smithi050 bash[21866]: cluster 2024-05-20T22:13:06.685805+0000 mon.a (mon.0) 1672 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:07.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:07 smithi050 bash[21866]: audit 2024-05-20T22:13:06.694554+0000 mon.a (mon.0) 1673 : audit 1 from='client.25970 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi050-63936-29"}]': finished 2024-05-20T22:13:07.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:07 smithi050 bash[21866]: cluster 2024-05-20T22:13:06.701811+0000 mon.a (mon.0) 1674 : cluster 0 osdmap e191: 8 total, 8 up, 8 in 2024-05-20T22:13:07.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:07 smithi050 bash[21866]: audit 2024-05-20T22:13:06.703696+0000 mon.c (mon.2) 227 : audit 1 from='client.? v1:172.21.15.50:0/3772908650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:07.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:07 smithi050 bash[21866]: audit 2024-05-20T22:13:06.707281+0000 mon.a (mon.0) 1675 : audit 1 from='client.25970 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:07.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:07 smithi050 bash[28929]: cluster 2024-05-20T22:13:06.064967+0000 mgr.y (mgr.14592) 280 : cluster 0 pgmap v297: 420 pgs: 32 creating+peering, 388 active+clean; 584 KiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-05-20T22:13:07.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:07 smithi050 bash[28929]: cluster 2024-05-20T22:13:06.685805+0000 mon.a (mon.0) 1672 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:07.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:07 smithi050 bash[28929]: audit 2024-05-20T22:13:06.694554+0000 mon.a (mon.0) 1673 : audit 1 from='client.25970 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi050-63936-29"}]': finished 2024-05-20T22:13:07.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:07 smithi050 bash[28929]: cluster 2024-05-20T22:13:06.701811+0000 mon.a (mon.0) 1674 : cluster 0 osdmap e191: 8 total, 8 up, 8 in 2024-05-20T22:13:07.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:07 smithi050 bash[28929]: audit 2024-05-20T22:13:06.703696+0000 mon.c (mon.2) 227 : audit 1 from='client.? v1:172.21.15.50:0/3772908650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:07.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:07 smithi050 bash[28929]: audit 2024-05-20T22:13:06.707281+0000 mon.a (mon.0) 1675 : audit 1 from='client.25970 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:08.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:13:07 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:13:08.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:07 smithi145 bash[23893]: cluster 2024-05-20T22:13:06.064967+0000 mgr.y (mgr.14592) 280 : cluster 0 pgmap v297: 420 pgs: 32 creating+peering, 388 active+clean; 584 KiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-05-20T22:13:08.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:07 smithi145 bash[23893]: cluster 2024-05-20T22:13:06.685805+0000 mon.a (mon.0) 1672 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:08.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:07 smithi145 bash[23893]: audit 2024-05-20T22:13:06.694554+0000 mon.a (mon.0) 1673 : audit 1 from='client.25970 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi050-63936-29"}]': finished 2024-05-20T22:13:08.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:07 smithi145 bash[23893]: cluster 2024-05-20T22:13:06.701811+0000 mon.a (mon.0) 1674 : cluster 0 osdmap e191: 8 total, 8 up, 8 in 2024-05-20T22:13:08.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:07 smithi145 bash[23893]: audit 2024-05-20T22:13:06.703696+0000 mon.c (mon.2) 227 : audit 1 from='client.? v1:172.21.15.50:0/3772908650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:08.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:07 smithi145 bash[23893]: audit 2024-05-20T22:13:06.707281+0000 mon.a (mon.0) 1675 : audit 1 from='client.25970 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi050-63936-29"}]: dispatch 2024-05-20T22:13:09.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:08 smithi145 bash[23893]: audit 2024-05-20T22:13:07.699482+0000 mon.a (mon.0) 1676 : audit 1 from='client.25970 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi050-63936-29"}]': finished 2024-05-20T22:13:09.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:08 smithi145 bash[23893]: cluster 2024-05-20T22:13:07.706889+0000 mon.a (mon.0) 1677 : cluster 0 osdmap e192: 8 total, 8 up, 8 in 2024-05-20T22:13:09.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:08 smithi145 bash[23893]: audit 2024-05-20T22:13:07.716210+0000 mon.a (mon.0) 1678 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:09.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:08 smithi145 bash[23893]: audit 2024-05-20T22:13:07.719522+0000 mon.c (mon.2) 228 : audit 1 from='client.? v1:172.21.15.50:0/638869234' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi050-63944-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:09.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:08 smithi145 bash[23893]: audit 2024-05-20T22:13:07.720744+0000 mon.a (mon.0) 1679 : audit 1 from='client.25985 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi050-63944-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:09.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:08 smithi145 bash[23893]: audit 2024-05-20T22:13:07.747954+0000 mon.c (mon.2) 229 : audit 1 from='client.? v1:172.21.15.50:0/2114776618' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:09.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:08 smithi145 bash[23893]: audit 2024-05-20T22:13:07.748579+0000 mon.a (mon.0) 1680 : audit 1 from='client.25991 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:09.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:08 smithi145 bash[23893]: audit 2024-05-20T22:13:07.749522+0000 mon.c (mon.2) 230 : audit 1 from='client.? v1:172.21.15.50:0/2114776618' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:09.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:08 smithi145 bash[23893]: audit 2024-05-20T22:13:07.749778+0000 mon.a (mon.0) 1681 : audit 1 from='client.25991 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:09.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:08 smithi145 bash[23893]: audit 2024-05-20T22:13:07.750184+0000 mon.c (mon.2) 231 : audit 1 from='client.? v1:172.21.15.50:0/2114776618' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi050-63936-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:09.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:08 smithi145 bash[23893]: audit 2024-05-20T22:13:07.750437+0000 mon.a (mon.0) 1682 : audit 1 from='client.25991 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi050-63936-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:09.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:08 smithi145 bash[23893]: audit 2024-05-20T22:13:07.767515+0000 mgr.y (mgr.14592) 281 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:13:09.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:08 smithi145 bash[23893]: cluster 2024-05-20T22:13:08.065973+0000 mgr.y (mgr.14592) 282 : cluster 0 pgmap v300: 420 pgs: 64 unknown, 356 active+clean; 584 KiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:13:09.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:08 smithi050 bash[21866]: audit 2024-05-20T22:13:07.699482+0000 mon.a (mon.0) 1676 : audit 1 from='client.25970 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi050-63936-29"}]': finished 2024-05-20T22:13:09.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:08 smithi050 bash[21866]: cluster 2024-05-20T22:13:07.706889+0000 mon.a (mon.0) 1677 : cluster 0 osdmap e192: 8 total, 8 up, 8 in 2024-05-20T22:13:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:08 smithi050 bash[21866]: audit 2024-05-20T22:13:07.716210+0000 mon.a (mon.0) 1678 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:08 smithi050 bash[21866]: audit 2024-05-20T22:13:07.719522+0000 mon.c (mon.2) 228 : audit 1 from='client.? v1:172.21.15.50:0/638869234' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi050-63944-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:08 smithi050 bash[21866]: audit 2024-05-20T22:13:07.720744+0000 mon.a (mon.0) 1679 : audit 1 from='client.25985 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi050-63944-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:08 smithi050 bash[21866]: audit 2024-05-20T22:13:07.747954+0000 mon.c (mon.2) 229 : audit 1 from='client.? v1:172.21.15.50:0/2114776618' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:08 smithi050 bash[21866]: audit 2024-05-20T22:13:07.748579+0000 mon.a (mon.0) 1680 : audit 1 from='client.25991 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:08 smithi050 bash[21866]: audit 2024-05-20T22:13:07.749522+0000 mon.c (mon.2) 230 : audit 1 from='client.? v1:172.21.15.50:0/2114776618' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:08 smithi050 bash[21866]: audit 2024-05-20T22:13:07.749778+0000 mon.a (mon.0) 1681 : audit 1 from='client.25991 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:08 smithi050 bash[21866]: audit 2024-05-20T22:13:07.750184+0000 mon.c (mon.2) 231 : audit 1 from='client.? v1:172.21.15.50:0/2114776618' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi050-63936-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:08 smithi050 bash[21866]: audit 2024-05-20T22:13:07.750437+0000 mon.a (mon.0) 1682 : audit 1 from='client.25991 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi050-63936-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:08 smithi050 bash[21866]: audit 2024-05-20T22:13:07.767515+0000 mgr.y (mgr.14592) 281 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:13:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:08 smithi050 bash[21866]: cluster 2024-05-20T22:13:08.065973+0000 mgr.y (mgr.14592) 282 : cluster 0 pgmap v300: 420 pgs: 64 unknown, 356 active+clean; 584 KiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:13:09.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:08 smithi050 bash[28929]: audit 2024-05-20T22:13:07.699482+0000 mon.a (mon.0) 1676 : audit 1 from='client.25970 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi050-63936-29"}]': finished 2024-05-20T22:13:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:08 smithi050 bash[28929]: cluster 2024-05-20T22:13:07.706889+0000 mon.a (mon.0) 1677 : cluster 0 osdmap e192: 8 total, 8 up, 8 in 2024-05-20T22:13:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:08 smithi050 bash[28929]: audit 2024-05-20T22:13:07.716210+0000 mon.a (mon.0) 1678 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:08 smithi050 bash[28929]: audit 2024-05-20T22:13:07.719522+0000 mon.c (mon.2) 228 : audit 1 from='client.? v1:172.21.15.50:0/638869234' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi050-63944-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:08 smithi050 bash[28929]: audit 2024-05-20T22:13:07.720744+0000 mon.a (mon.0) 1679 : audit 1 from='client.25985 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi050-63944-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:08 smithi050 bash[28929]: audit 2024-05-20T22:13:07.747954+0000 mon.c (mon.2) 229 : audit 1 from='client.? v1:172.21.15.50:0/2114776618' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:08 smithi050 bash[28929]: audit 2024-05-20T22:13:07.748579+0000 mon.a (mon.0) 1680 : audit 1 from='client.25991 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:08 smithi050 bash[28929]: audit 2024-05-20T22:13:07.749522+0000 mon.c (mon.2) 230 : audit 1 from='client.? v1:172.21.15.50:0/2114776618' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:08 smithi050 bash[28929]: audit 2024-05-20T22:13:07.749778+0000 mon.a (mon.0) 1681 : audit 1 from='client.25991 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:08 smithi050 bash[28929]: audit 2024-05-20T22:13:07.750184+0000 mon.c (mon.2) 231 : audit 1 from='client.? v1:172.21.15.50:0/2114776618' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi050-63936-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:08 smithi050 bash[28929]: audit 2024-05-20T22:13:07.750437+0000 mon.a (mon.0) 1682 : audit 1 from='client.25991 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi050-63936-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:08 smithi050 bash[28929]: audit 2024-05-20T22:13:07.767515+0000 mgr.y (mgr.14592) 281 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:13:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:08 smithi050 bash[28929]: cluster 2024-05-20T22:13:08.065973+0000 mgr.y (mgr.14592) 282 : cluster 0 pgmap v300: 420 pgs: 64 unknown, 356 active+clean; 584 KiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:13:09.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:13:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:13:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:13:10.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:10 smithi050 bash[28929]: audit 2024-05-20T22:13:08.709389+0000 mon.a (mon.0) 1683 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:10.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:10 smithi050 bash[28929]: audit 2024-05-20T22:13:08.709615+0000 mon.a (mon.0) 1684 : audit 1 from='client.25985 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi050-63944-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:10.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:10 smithi050 bash[28929]: audit 2024-05-20T22:13:08.709766+0000 mon.a (mon.0) 1685 : audit 1 from='client.25991 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi050-63936-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:10.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:10 smithi050 bash[28929]: cluster 2024-05-20T22:13:08.720384+0000 mon.a (mon.0) 1686 : cluster 0 osdmap e193: 8 total, 8 up, 8 in 2024-05-20T22:13:10.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:10 smithi050 bash[28929]: audit 2024-05-20T22:13:08.723510+0000 mon.c (mon.2) 232 : audit 1 from='client.? v1:172.21.15.50:0/2114776618' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi050-63936-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:10.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:10 smithi050 bash[28929]: audit 2024-05-20T22:13:08.724261+0000 mon.a (mon.0) 1687 : audit 1 from='client.25991 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi050-63936-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:10.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:10 smithi050 bash[28929]: audit 2024-05-20T22:13:08.725704+0000 mon.a (mon.0) 1688 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:10.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:10 smithi050 bash[21866]: audit 2024-05-20T22:13:08.709389+0000 mon.a (mon.0) 1683 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:10.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:10 smithi050 bash[21866]: audit 2024-05-20T22:13:08.709615+0000 mon.a (mon.0) 1684 : audit 1 from='client.25985 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi050-63944-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:10.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:10 smithi050 bash[21866]: audit 2024-05-20T22:13:08.709766+0000 mon.a (mon.0) 1685 : audit 1 from='client.25991 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi050-63936-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:10.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:10 smithi050 bash[21866]: cluster 2024-05-20T22:13:08.720384+0000 mon.a (mon.0) 1686 : cluster 0 osdmap e193: 8 total, 8 up, 8 in 2024-05-20T22:13:10.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:10 smithi050 bash[21866]: audit 2024-05-20T22:13:08.723510+0000 mon.c (mon.2) 232 : audit 1 from='client.? v1:172.21.15.50:0/2114776618' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi050-63936-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:10.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:10 smithi050 bash[21866]: audit 2024-05-20T22:13:08.724261+0000 mon.a (mon.0) 1687 : audit 1 from='client.25991 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi050-63936-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:10.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:10 smithi050 bash[21866]: audit 2024-05-20T22:13:08.725704+0000 mon.a (mon.0) 1688 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:10.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:10 smithi145 bash[23893]: audit 2024-05-20T22:13:08.709389+0000 mon.a (mon.0) 1683 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:10.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:10 smithi145 bash[23893]: audit 2024-05-20T22:13:08.709615+0000 mon.a (mon.0) 1684 : audit 1 from='client.25985 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi050-63944-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:10.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:10 smithi145 bash[23893]: audit 2024-05-20T22:13:08.709766+0000 mon.a (mon.0) 1685 : audit 1 from='client.25991 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi050-63936-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:10.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:10 smithi145 bash[23893]: cluster 2024-05-20T22:13:08.720384+0000 mon.a (mon.0) 1686 : cluster 0 osdmap e193: 8 total, 8 up, 8 in 2024-05-20T22:13:10.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:10 smithi145 bash[23893]: audit 2024-05-20T22:13:08.723510+0000 mon.c (mon.2) 232 : audit 1 from='client.? v1:172.21.15.50:0/2114776618' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi050-63936-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:10.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:10 smithi145 bash[23893]: audit 2024-05-20T22:13:08.724261+0000 mon.a (mon.0) 1687 : audit 1 from='client.25991 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi050-63936-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:10.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:10 smithi145 bash[23893]: audit 2024-05-20T22:13:08.725704+0000 mon.a (mon.0) 1688 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:11.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:11 smithi050 bash[21866]: audit 2024-05-20T22:13:09.713029+0000 mon.a (mon.0) 1689 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-19", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:11.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:11 smithi050 bash[21866]: cluster 2024-05-20T22:13:10.069044+0000 mgr.y (mgr.14592) 283 : cluster 0 pgmap v303: 388 pgs: 388 active+clean; 584 KiB data, 552 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:13:11.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:11 smithi050 bash[21866]: cluster 2024-05-20T22:13:10.186059+0000 mon.a (mon.0) 1690 : cluster 0 osdmap e194: 8 total, 8 up, 8 in 2024-05-20T22:13:11.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:11 smithi050 bash[21866]: audit 2024-05-20T22:13:10.187773+0000 mon.a (mon.0) 1691 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-19"}]: dispatch 2024-05-20T22:13:11.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:11 smithi050 bash[21866]: audit 2024-05-20T22:13:10.723693+0000 mon.a (mon.0) 1692 : audit 1 from='client.25991 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi050-63936-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi050-63936-30"}]': finished 2024-05-20T22:13:11.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:11 smithi050 bash[21866]: audit 2024-05-20T22:13:10.723982+0000 mon.a (mon.0) 1693 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-19"}]': finished 2024-05-20T22:13:11.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:11 smithi050 bash[21866]: cluster 2024-05-20T22:13:10.731539+0000 mon.a (mon.0) 1694 : cluster 0 osdmap e195: 8 total, 8 up, 8 in 2024-05-20T22:13:11.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:11 smithi050 bash[21866]: audit 2024-05-20T22:13:10.734296+0000 mon.a (mon.0) 1695 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-19", "mode": "writeback"}]: dispatch 2024-05-20T22:13:11.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:11 smithi050 bash[21866]: audit 2024-05-20T22:13:10.750319+0000 mon.c (mon.2) 233 : audit 1 from='client.? v1:172.21.15.50:0/3174590550' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi050-63944-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:11.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:11 smithi050 bash[21866]: audit 2024-05-20T22:13:10.750984+0000 mon.a (mon.0) 1696 : audit 1 from='client.25997 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi050-63944-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:11.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:11 smithi050 bash[28929]: audit 2024-05-20T22:13:09.713029+0000 mon.a (mon.0) 1689 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-19", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:11.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:11 smithi050 bash[28929]: cluster 2024-05-20T22:13:10.069044+0000 mgr.y (mgr.14592) 283 : cluster 0 pgmap v303: 388 pgs: 388 active+clean; 584 KiB data, 552 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:13:11.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:11 smithi050 bash[28929]: cluster 2024-05-20T22:13:10.186059+0000 mon.a (mon.0) 1690 : cluster 0 osdmap e194: 8 total, 8 up, 8 in 2024-05-20T22:13:11.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:11 smithi050 bash[28929]: audit 2024-05-20T22:13:10.187773+0000 mon.a (mon.0) 1691 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-19"}]: dispatch 2024-05-20T22:13:11.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:11 smithi050 bash[28929]: audit 2024-05-20T22:13:10.723693+0000 mon.a (mon.0) 1692 : audit 1 from='client.25991 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi050-63936-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi050-63936-30"}]': finished 2024-05-20T22:13:11.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:11 smithi050 bash[28929]: audit 2024-05-20T22:13:10.723982+0000 mon.a (mon.0) 1693 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-19"}]': finished 2024-05-20T22:13:11.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:11 smithi050 bash[28929]: cluster 2024-05-20T22:13:10.731539+0000 mon.a (mon.0) 1694 : cluster 0 osdmap e195: 8 total, 8 up, 8 in 2024-05-20T22:13:11.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:11 smithi050 bash[28929]: audit 2024-05-20T22:13:10.734296+0000 mon.a (mon.0) 1695 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-19", "mode": "writeback"}]: dispatch 2024-05-20T22:13:11.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:11 smithi050 bash[28929]: audit 2024-05-20T22:13:10.750319+0000 mon.c (mon.2) 233 : audit 1 from='client.? v1:172.21.15.50:0/3174590550' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi050-63944-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:11.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:11 smithi050 bash[28929]: audit 2024-05-20T22:13:10.750984+0000 mon.a (mon.0) 1696 : audit 1 from='client.25997 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi050-63944-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:11.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:11 smithi145 bash[23893]: audit 2024-05-20T22:13:09.713029+0000 mon.a (mon.0) 1689 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-19", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:11.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:11 smithi145 bash[23893]: cluster 2024-05-20T22:13:10.069044+0000 mgr.y (mgr.14592) 283 : cluster 0 pgmap v303: 388 pgs: 388 active+clean; 584 KiB data, 552 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:13:11.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:11 smithi145 bash[23893]: cluster 2024-05-20T22:13:10.186059+0000 mon.a (mon.0) 1690 : cluster 0 osdmap e194: 8 total, 8 up, 8 in 2024-05-20T22:13:11.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:11 smithi145 bash[23893]: audit 2024-05-20T22:13:10.187773+0000 mon.a (mon.0) 1691 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-19"}]: dispatch 2024-05-20T22:13:11.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:11 smithi145 bash[23893]: audit 2024-05-20T22:13:10.723693+0000 mon.a (mon.0) 1692 : audit 1 from='client.25991 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi050-63936-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi050-63936-30"}]': finished 2024-05-20T22:13:11.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:11 smithi145 bash[23893]: audit 2024-05-20T22:13:10.723982+0000 mon.a (mon.0) 1693 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-19"}]': finished 2024-05-20T22:13:11.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:11 smithi145 bash[23893]: cluster 2024-05-20T22:13:10.731539+0000 mon.a (mon.0) 1694 : cluster 0 osdmap e195: 8 total, 8 up, 8 in 2024-05-20T22:13:11.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:11 smithi145 bash[23893]: audit 2024-05-20T22:13:10.734296+0000 mon.a (mon.0) 1695 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-19", "mode": "writeback"}]: dispatch 2024-05-20T22:13:11.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:11 smithi145 bash[23893]: audit 2024-05-20T22:13:10.750319+0000 mon.c (mon.2) 233 : audit 1 from='client.? v1:172.21.15.50:0/3174590550' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi050-63944-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:11.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:11 smithi145 bash[23893]: audit 2024-05-20T22:13:10.750984+0000 mon.a (mon.0) 1696 : audit 1 from='client.25997 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi050-63944-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:12.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:12 smithi050 bash[21866]: cluster 2024-05-20T22:13:11.724478+0000 mon.a (mon.0) 1697 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:13:12.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:12 smithi050 bash[21866]: audit 2024-05-20T22:13:11.727035+0000 mon.a (mon.0) 1698 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-19", "mode": "writeback"}]': finished 2024-05-20T22:13:12.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:12 smithi050 bash[21866]: audit 2024-05-20T22:13:11.727282+0000 mon.a (mon.0) 1699 : audit 1 from='client.25997 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi050-63944-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:12.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:12 smithi050 bash[21866]: cluster 2024-05-20T22:13:11.736032+0000 mon.a (mon.0) 1700 : cluster 0 osdmap e196: 8 total, 8 up, 8 in 2024-05-20T22:13:12.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:12 smithi050 bash[21866]: audit 2024-05-20T22:13:11.815389+0000 mon.a (mon.0) 1701 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:13:12.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:12 smithi050 bash[28929]: cluster 2024-05-20T22:13:11.724478+0000 mon.a (mon.0) 1697 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:13:12.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:12 smithi050 bash[28929]: audit 2024-05-20T22:13:11.727035+0000 mon.a (mon.0) 1698 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-19", "mode": "writeback"}]': finished 2024-05-20T22:13:12.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:12 smithi050 bash[28929]: audit 2024-05-20T22:13:11.727282+0000 mon.a (mon.0) 1699 : audit 1 from='client.25997 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi050-63944-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:12.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:12 smithi050 bash[28929]: cluster 2024-05-20T22:13:11.736032+0000 mon.a (mon.0) 1700 : cluster 0 osdmap e196: 8 total, 8 up, 8 in 2024-05-20T22:13:12.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:12 smithi050 bash[28929]: audit 2024-05-20T22:13:11.815389+0000 mon.a (mon.0) 1701 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:13:12.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:12 smithi145 bash[23893]: cluster 2024-05-20T22:13:11.724478+0000 mon.a (mon.0) 1697 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:13:12.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:12 smithi145 bash[23893]: audit 2024-05-20T22:13:11.727035+0000 mon.a (mon.0) 1698 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-19", "mode": "writeback"}]': finished 2024-05-20T22:13:12.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:12 smithi145 bash[23893]: audit 2024-05-20T22:13:11.727282+0000 mon.a (mon.0) 1699 : audit 1 from='client.25997 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi050-63944-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:12.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:12 smithi145 bash[23893]: cluster 2024-05-20T22:13:11.736032+0000 mon.a (mon.0) 1700 : cluster 0 osdmap e196: 8 total, 8 up, 8 in 2024-05-20T22:13:12.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:12 smithi145 bash[23893]: audit 2024-05-20T22:13:11.815389+0000 mon.a (mon.0) 1701 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:13:13.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: cluster 2024-05-20T22:13:12.070048+0000 mgr.y (mgr.14592) 284 : cluster 0 pgmap v306: 428 pgs: 40 unknown, 388 active+clean; 584 KiB data, 552 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:13:13.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.238055+0000 mon.c (mon.2) 234 : audit 1 from='client.? v1:172.21.15.50:0/3174590550' entity='client.admin' cmd=[{ 2024-05-20T22:13:13.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.238111+0000 mon.c (mon.2) 235 : audit 1 "prefix": "osd pool set", 2024-05-20T22:13:13.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.238147+0000 mon.c (mon.2) 236 : audit 1 "pool": "PoolEIOFlag_smithi050-63944-33", 2024-05-20T22:13:13.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.238177+0000 mon.c (mon.2) 237 : audit 1 "var": "eio", 2024-05-20T22:13:13.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.238211+0000 mon.c (mon.2) 238 : audit 1 "val": "true" 2024-05-20T22:13:13.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.238243+0000 mon.c (mon.2) 239 : audit 1 }]: dispatch 2024-05-20T22:13:13.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.239179+0000 mon.a (mon.0) 1702 : audit 1 from='client.25997 ' entity='client.admin' cmd=[{ 2024-05-20T22:13:13.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.239223+0000 mon.a (mon.0) 1703 : audit 1 "prefix": "osd pool set", 2024-05-20T22:13:13.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.239257+0000 mon.a (mon.0) 1704 : audit 1 "pool": "PoolEIOFlag_smithi050-63944-33", 2024-05-20T22:13:13.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.239289+0000 mon.a (mon.0) 1705 : audit 1 "var": "eio", 2024-05-20T22:13:13.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.239317+0000 mon.a (mon.0) 1706 : audit 1 "val": "true" 2024-05-20T22:13:13.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.239353+0000 mon.a (mon.0) 1707 : audit 1 }]: dispatch 2024-05-20T22:13:13.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: cluster 2024-05-20T22:13:12.728289+0000 mon.a (mon.0) 1708 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:13.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.729628+0000 mon.a (mon.0) 1709 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:13:13.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.729809+0000 mon.a (mon.0) 1710 : audit 1 from='client.25997 ' entity='client.admin' cmd='[{ 2024-05-20T22:13:13.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.729835+0000 mon.a (mon.0) 1711 : audit 1 "prefix": "osd pool set", 2024-05-20T22:13:13.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.729850+0000 mon.a (mon.0) 1712 : audit 1 "pool": "PoolEIOFlag_smithi050-63944-33", 2024-05-20T22:13:13.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.729881+0000 mon.a (mon.0) 1713 : audit 1 "var": "eio", 2024-05-20T22:13:13.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.729911+0000 mon.a (mon.0) 1714 : audit 1 "val": "true" 2024-05-20T22:13:13.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.729943+0000 mon.a (mon.0) 1715 : audit 1 }]': finished 2024-05-20T22:13:13.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: cluster 2024-05-20T22:13:12.738148+0000 mon.a (mon.0) 1716 : cluster 0 osdmap e197: 8 total, 8 up, 8 in 2024-05-20T22:13:13.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.740395+0000 mon.c (mon.2) 240 : audit 1 from='client.? v1:172.21.15.50:0/2114776618' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:13.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.743769+0000 mon.a (mon.0) 1717 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-19"}]: dispatch 2024-05-20T22:13:13.446 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:13 smithi050 bash[21866]: audit 2024-05-20T22:13:12.744509+0000 mon.a (mon.0) 1718 : audit 1 from='client.25991 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:13.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: cluster 2024-05-20T22:13:12.070048+0000 mgr.y (mgr.14592) 284 : cluster 0 pgmap v306: 428 pgs: 40 unknown, 388 active+clean; 584 KiB data, 552 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:13:13.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.238055+0000 mon.c (mon.2) 234 : audit 1 from='client.? v1:172.21.15.50:0/3174590550' entity='client.admin' cmd=[{ 2024-05-20T22:13:13.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.238111+0000 mon.c (mon.2) 235 : audit 1 "prefix": "osd pool set", 2024-05-20T22:13:13.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.238147+0000 mon.c (mon.2) 236 : audit 1 "pool": "PoolEIOFlag_smithi050-63944-33", 2024-05-20T22:13:13.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.238177+0000 mon.c (mon.2) 237 : audit 1 "var": "eio", 2024-05-20T22:13:13.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.238211+0000 mon.c (mon.2) 238 : audit 1 "val": "true" 2024-05-20T22:13:13.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.238243+0000 mon.c (mon.2) 239 : audit 1 }]: dispatch 2024-05-20T22:13:13.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.239179+0000 mon.a (mon.0) 1702 : audit 1 from='client.25997 ' entity='client.admin' cmd=[{ 2024-05-20T22:13:13.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.239223+0000 mon.a (mon.0) 1703 : audit 1 "prefix": "osd pool set", 2024-05-20T22:13:13.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.239257+0000 mon.a (mon.0) 1704 : audit 1 "pool": "PoolEIOFlag_smithi050-63944-33", 2024-05-20T22:13:13.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.239289+0000 mon.a (mon.0) 1705 : audit 1 "var": "eio", 2024-05-20T22:13:13.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.239317+0000 mon.a (mon.0) 1706 : audit 1 "val": "true" 2024-05-20T22:13:13.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.239353+0000 mon.a (mon.0) 1707 : audit 1 }]: dispatch 2024-05-20T22:13:13.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: cluster 2024-05-20T22:13:12.728289+0000 mon.a (mon.0) 1708 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:13.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.729628+0000 mon.a (mon.0) 1709 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:13:13.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.729809+0000 mon.a (mon.0) 1710 : audit 1 from='client.25997 ' entity='client.admin' cmd='[{ 2024-05-20T22:13:13.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.729835+0000 mon.a (mon.0) 1711 : audit 1 "prefix": "osd pool set", 2024-05-20T22:13:13.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.729850+0000 mon.a (mon.0) 1712 : audit 1 "pool": "PoolEIOFlag_smithi050-63944-33", 2024-05-20T22:13:13.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.729881+0000 mon.a (mon.0) 1713 : audit 1 "var": "eio", 2024-05-20T22:13:13.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.729911+0000 mon.a (mon.0) 1714 : audit 1 "val": "true" 2024-05-20T22:13:13.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.729943+0000 mon.a (mon.0) 1715 : audit 1 }]': finished 2024-05-20T22:13:13.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: cluster 2024-05-20T22:13:12.738148+0000 mon.a (mon.0) 1716 : cluster 0 osdmap e197: 8 total, 8 up, 8 in 2024-05-20T22:13:13.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.740395+0000 mon.c (mon.2) 240 : audit 1 from='client.? v1:172.21.15.50:0/2114776618' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:13.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.743769+0000 mon.a (mon.0) 1717 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-19"}]: dispatch 2024-05-20T22:13:13.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:13 smithi050 bash[28929]: audit 2024-05-20T22:13:12.744509+0000 mon.a (mon.0) 1718 : audit 1 from='client.25991 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:13.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: cluster 2024-05-20T22:13:12.070048+0000 mgr.y (mgr.14592) 284 : cluster 0 pgmap v306: 428 pgs: 40 unknown, 388 active+clean; 584 KiB data, 552 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:13:13.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.238055+0000 mon.c (mon.2) 234 : audit 1 from='client.? v1:172.21.15.50:0/3174590550' entity='client.admin' cmd=[{ 2024-05-20T22:13:13.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.238111+0000 mon.c (mon.2) 235 : audit 1 "prefix": "osd pool set", 2024-05-20T22:13:13.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.238147+0000 mon.c (mon.2) 236 : audit 1 "pool": "PoolEIOFlag_smithi050-63944-33", 2024-05-20T22:13:13.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.238177+0000 mon.c (mon.2) 237 : audit 1 "var": "eio", 2024-05-20T22:13:13.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.238211+0000 mon.c (mon.2) 238 : audit 1 "val": "true" 2024-05-20T22:13:13.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.238243+0000 mon.c (mon.2) 239 : audit 1 }]: dispatch 2024-05-20T22:13:13.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.239179+0000 mon.a (mon.0) 1702 : audit 1 from='client.25997 ' entity='client.admin' cmd=[{ 2024-05-20T22:13:13.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.239223+0000 mon.a (mon.0) 1703 : audit 1 "prefix": "osd pool set", 2024-05-20T22:13:13.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.239257+0000 mon.a (mon.0) 1704 : audit 1 "pool": "PoolEIOFlag_smithi050-63944-33", 2024-05-20T22:13:13.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.239289+0000 mon.a (mon.0) 1705 : audit 1 "var": "eio", 2024-05-20T22:13:13.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.239317+0000 mon.a (mon.0) 1706 : audit 1 "val": "true" 2024-05-20T22:13:13.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.239353+0000 mon.a (mon.0) 1707 : audit 1 }]: dispatch 2024-05-20T22:13:13.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: cluster 2024-05-20T22:13:12.728289+0000 mon.a (mon.0) 1708 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:13.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.729628+0000 mon.a (mon.0) 1709 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:13:13.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.729809+0000 mon.a (mon.0) 1710 : audit 1 from='client.25997 ' entity='client.admin' cmd='[{ 2024-05-20T22:13:13.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.729835+0000 mon.a (mon.0) 1711 : audit 1 "prefix": "osd pool set", 2024-05-20T22:13:13.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.729850+0000 mon.a (mon.0) 1712 : audit 1 "pool": "PoolEIOFlag_smithi050-63944-33", 2024-05-20T22:13:13.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.729881+0000 mon.a (mon.0) 1713 : audit 1 "var": "eio", 2024-05-20T22:13:13.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.729911+0000 mon.a (mon.0) 1714 : audit 1 "val": "true" 2024-05-20T22:13:13.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.729943+0000 mon.a (mon.0) 1715 : audit 1 }]': finished 2024-05-20T22:13:13.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: cluster 2024-05-20T22:13:12.738148+0000 mon.a (mon.0) 1716 : cluster 0 osdmap e197: 8 total, 8 up, 8 in 2024-05-20T22:13:13.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.740395+0000 mon.c (mon.2) 240 : audit 1 from='client.? v1:172.21.15.50:0/2114776618' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:13.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.743769+0000 mon.a (mon.0) 1717 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-19"}]: dispatch 2024-05-20T22:13:13.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:13 smithi145 bash[23893]: audit 2024-05-20T22:13:12.744509+0000 mon.a (mon.0) 1718 : audit 1 from='client.25991 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:14.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:14 smithi145 bash[23893]: cluster 2024-05-20T22:13:13.730122+0000 mon.a (mon.0) 1719 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:13:14.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:14 smithi145 bash[23893]: audit 2024-05-20T22:13:13.732499+0000 mon.a (mon.0) 1720 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-19"}]': finished 2024-05-20T22:13:14.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:14 smithi145 bash[23893]: audit 2024-05-20T22:13:13.732617+0000 mon.a (mon.0) 1721 : audit 1 from='client.25991 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi050-63936-30"}]': finished 2024-05-20T22:13:14.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:14 smithi145 bash[23893]: cluster 2024-05-20T22:13:13.740408+0000 mon.a (mon.0) 1722 : cluster 0 osdmap e198: 8 total, 8 up, 8 in 2024-05-20T22:13:14.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:14 smithi145 bash[23893]: audit 2024-05-20T22:13:13.742107+0000 mon.c (mon.2) 241 : audit 1 from='client.? v1:172.21.15.50:0/2114776618' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:14.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:14 smithi145 bash[23893]: audit 2024-05-20T22:13:13.745274+0000 mon.a (mon.0) 1723 : audit 1 from='client.25991 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:14.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:14 smithi050 bash[28929]: cluster 2024-05-20T22:13:13.730122+0000 mon.a (mon.0) 1719 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:13:14.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:14 smithi050 bash[28929]: audit 2024-05-20T22:13:13.732499+0000 mon.a (mon.0) 1720 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-19"}]': finished 2024-05-20T22:13:14.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:14 smithi050 bash[28929]: audit 2024-05-20T22:13:13.732617+0000 mon.a (mon.0) 1721 : audit 1 from='client.25991 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi050-63936-30"}]': finished 2024-05-20T22:13:14.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:14 smithi050 bash[28929]: cluster 2024-05-20T22:13:13.740408+0000 mon.a (mon.0) 1722 : cluster 0 osdmap e198: 8 total, 8 up, 8 in 2024-05-20T22:13:14.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:14 smithi050 bash[28929]: audit 2024-05-20T22:13:13.742107+0000 mon.c (mon.2) 241 : audit 1 from='client.? v1:172.21.15.50:0/2114776618' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:14.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:14 smithi050 bash[28929]: audit 2024-05-20T22:13:13.745274+0000 mon.a (mon.0) 1723 : audit 1 from='client.25991 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:14.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:14 smithi050 bash[21866]: cluster 2024-05-20T22:13:13.730122+0000 mon.a (mon.0) 1719 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:13:14.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:14 smithi050 bash[21866]: audit 2024-05-20T22:13:13.732499+0000 mon.a (mon.0) 1720 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-19"}]': finished 2024-05-20T22:13:14.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:14 smithi050 bash[21866]: audit 2024-05-20T22:13:13.732617+0000 mon.a (mon.0) 1721 : audit 1 from='client.25991 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi050-63936-30"}]': finished 2024-05-20T22:13:14.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:14 smithi050 bash[21866]: cluster 2024-05-20T22:13:13.740408+0000 mon.a (mon.0) 1722 : cluster 0 osdmap e198: 8 total, 8 up, 8 in 2024-05-20T22:13:14.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:14 smithi050 bash[21866]: audit 2024-05-20T22:13:13.742107+0000 mon.c (mon.2) 241 : audit 1 from='client.? v1:172.21.15.50:0/2114776618' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:14.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:14 smithi050 bash[21866]: audit 2024-05-20T22:13:13.745274+0000 mon.a (mon.0) 1723 : audit 1 from='client.25991 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi050-63936-30"}]: dispatch 2024-05-20T22:13:15.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:15 smithi145 bash[23893]: cluster 2024-05-20T22:13:14.071031+0000 mgr.y (mgr.14592) 285 : cluster 0 pgmap v309: 388 pgs: 388 active+clean; 584 KiB data, 552 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:15.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:15 smithi145 bash[23893]: audit 2024-05-20T22:13:14.640848+0000 mon.a (mon.0) 1724 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.9", "id": [3, 1]}]: dispatch 2024-05-20T22:13:15.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:15 smithi145 bash[23893]: audit 2024-05-20T22:13:14.641663+0000 mon.a (mon.0) 1725 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.e", "id": [3, 1]}]: dispatch 2024-05-20T22:13:15.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:15 smithi145 bash[23893]: audit 2024-05-20T22:13:14.642383+0000 mon.a (mon.0) 1726 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]: dispatch 2024-05-20T22:13:15.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:15 smithi145 bash[23893]: audit 2024-05-20T22:13:14.642807+0000 mon.a (mon.0) 1727 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1e", "id": [3, 7]}]: dispatch 2024-05-20T22:13:15.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:15 smithi145 bash[23893]: audit 2024-05-20T22:13:14.643206+0000 mon.a (mon.0) 1728 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "209.1e", "id": [6, 5]}]: dispatch 2024-05-20T22:13:15.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:15 smithi145 bash[23893]: audit 2024-05-20T22:13:14.743449+0000 mon.a (mon.0) 1729 : audit 1 from='client.25991 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi050-63936-30"}]': finished 2024-05-20T22:13:15.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:15 smithi145 bash[23893]: audit 2024-05-20T22:13:14.743646+0000 mon.a (mon.0) 1730 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.9", "id": [3, 1]}]': finished 2024-05-20T22:13:15.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:15 smithi145 bash[23893]: audit 2024-05-20T22:13:14.743814+0000 mon.a (mon.0) 1731 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.e", "id": [3, 1]}]': finished 2024-05-20T22:13:15.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:15 smithi145 bash[23893]: audit 2024-05-20T22:13:14.744008+0000 mon.a (mon.0) 1732 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]': finished 2024-05-20T22:13:15.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:15 smithi145 bash[23893]: audit 2024-05-20T22:13:14.744174+0000 mon.a (mon.0) 1733 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1e", "id": [3, 7]}]': finished 2024-05-20T22:13:15.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:15 smithi145 bash[23893]: audit 2024-05-20T22:13:14.744412+0000 mon.a (mon.0) 1734 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "209.1e", "id": [6, 5]}]': finished 2024-05-20T22:13:15.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:15 smithi145 bash[23893]: cluster 2024-05-20T22:13:14.751767+0000 mon.a (mon.0) 1735 : cluster 0 osdmap e199: 8 total, 8 up, 8 in 2024-05-20T22:13:15.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:15 smithi145 bash[23893]: audit 2024-05-20T22:13:14.769556+0000 mon.a (mon.0) 1736 : audit 1 from='client.? v1:172.21.15.50:0/283531942' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi050-63944-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:15.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:15 smithi145 bash[23893]: audit 2024-05-20T22:13:14.808093+0000 mon.c (mon.2) 242 : audit 1 from='client.? v1:172.21.15.50:0/3172954634' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:15.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:15 smithi145 bash[23893]: audit 2024-05-20T22:13:15.231325+0000 mon.a (mon.0) 1737 : audit 1 from='client.26006 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:15.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:15 smithi145 bash[23893]: audit 2024-05-20T22:13:15.232675+0000 mon.c (mon.2) 243 : audit 1 from='client.? v1:172.21.15.50:0/3172954634' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:15.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:15 smithi145 bash[23893]: audit 2024-05-20T22:13:15.233329+0000 mon.a (mon.0) 1738 : audit 1 from='client.26006 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:15.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:15 smithi145 bash[23893]: audit 2024-05-20T22:13:15.234483+0000 mon.c (mon.2) 244 : audit 1 from='client.? v1:172.21.15.50:0/3172954634' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi050-63936-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:15.645 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:15 smithi145 bash[23893]: audit 2024-05-20T22:13:15.235152+0000 mon.a (mon.0) 1739 : audit 1 from='client.26006 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi050-63936-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:15 smithi050 bash[21866]: cluster 2024-05-20T22:13:14.071031+0000 mgr.y (mgr.14592) 285 : cluster 0 pgmap v309: 388 pgs: 388 active+clean; 584 KiB data, 552 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:15 smithi050 bash[21866]: audit 2024-05-20T22:13:14.640848+0000 mon.a (mon.0) 1724 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.9", "id": [3, 1]}]: dispatch 2024-05-20T22:13:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:15 smithi050 bash[21866]: audit 2024-05-20T22:13:14.641663+0000 mon.a (mon.0) 1725 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.e", "id": [3, 1]}]: dispatch 2024-05-20T22:13:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:15 smithi050 bash[21866]: audit 2024-05-20T22:13:14.642383+0000 mon.a (mon.0) 1726 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]: dispatch 2024-05-20T22:13:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:15 smithi050 bash[21866]: audit 2024-05-20T22:13:14.642807+0000 mon.a (mon.0) 1727 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1e", "id": [3, 7]}]: dispatch 2024-05-20T22:13:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:15 smithi050 bash[21866]: audit 2024-05-20T22:13:14.643206+0000 mon.a (mon.0) 1728 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "209.1e", "id": [6, 5]}]: dispatch 2024-05-20T22:13:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:15 smithi050 bash[21866]: audit 2024-05-20T22:13:14.743449+0000 mon.a (mon.0) 1729 : audit 1 from='client.25991 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi050-63936-30"}]': finished 2024-05-20T22:13:15.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:15 smithi050 bash[21866]: audit 2024-05-20T22:13:14.743646+0000 mon.a (mon.0) 1730 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.9", "id": [3, 1]}]': finished 2024-05-20T22:13:15.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:15 smithi050 bash[21866]: audit 2024-05-20T22:13:14.743814+0000 mon.a (mon.0) 1731 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.e", "id": [3, 1]}]': finished 2024-05-20T22:13:15.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:15 smithi050 bash[21866]: audit 2024-05-20T22:13:14.744008+0000 mon.a (mon.0) 1732 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]': finished 2024-05-20T22:13:15.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:15 smithi050 bash[21866]: audit 2024-05-20T22:13:14.744174+0000 mon.a (mon.0) 1733 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1e", "id": [3, 7]}]': finished 2024-05-20T22:13:15.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:15 smithi050 bash[21866]: audit 2024-05-20T22:13:14.744412+0000 mon.a (mon.0) 1734 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "209.1e", "id": [6, 5]}]': finished 2024-05-20T22:13:15.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:15 smithi050 bash[21866]: cluster 2024-05-20T22:13:14.751767+0000 mon.a (mon.0) 1735 : cluster 0 osdmap e199: 8 total, 8 up, 8 in 2024-05-20T22:13:15.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:15 smithi050 bash[21866]: audit 2024-05-20T22:13:14.769556+0000 mon.a (mon.0) 1736 : audit 1 from='client.? v1:172.21.15.50:0/283531942' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi050-63944-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:15.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:15 smithi050 bash[21866]: audit 2024-05-20T22:13:14.808093+0000 mon.c (mon.2) 242 : audit 1 from='client.? v1:172.21.15.50:0/3172954634' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:15.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:15 smithi050 bash[21866]: audit 2024-05-20T22:13:15.231325+0000 mon.a (mon.0) 1737 : audit 1 from='client.26006 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:15.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:15 smithi050 bash[21866]: audit 2024-05-20T22:13:15.232675+0000 mon.c (mon.2) 243 : audit 1 from='client.? v1:172.21.15.50:0/3172954634' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:15.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:15 smithi050 bash[21866]: audit 2024-05-20T22:13:15.233329+0000 mon.a (mon.0) 1738 : audit 1 from='client.26006 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:15.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:15 smithi050 bash[21866]: audit 2024-05-20T22:13:15.234483+0000 mon.c (mon.2) 244 : audit 1 from='client.? v1:172.21.15.50:0/3172954634' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi050-63936-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:15.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:15 smithi050 bash[21866]: audit 2024-05-20T22:13:15.235152+0000 mon.a (mon.0) 1739 : audit 1 from='client.26006 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi050-63936-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:15.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:15 smithi050 bash[28929]: cluster 2024-05-20T22:13:14.071031+0000 mgr.y (mgr.14592) 285 : cluster 0 pgmap v309: 388 pgs: 388 active+clean; 584 KiB data, 552 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:15.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:15 smithi050 bash[28929]: audit 2024-05-20T22:13:14.640848+0000 mon.a (mon.0) 1724 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.9", "id": [3, 1]}]: dispatch 2024-05-20T22:13:15.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:15 smithi050 bash[28929]: audit 2024-05-20T22:13:14.641663+0000 mon.a (mon.0) 1725 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.e", "id": [3, 1]}]: dispatch 2024-05-20T22:13:15.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:15 smithi050 bash[28929]: audit 2024-05-20T22:13:14.642383+0000 mon.a (mon.0) 1726 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]: dispatch 2024-05-20T22:13:15.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:15 smithi050 bash[28929]: audit 2024-05-20T22:13:14.642807+0000 mon.a (mon.0) 1727 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1e", "id": [3, 7]}]: dispatch 2024-05-20T22:13:15.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:15 smithi050 bash[28929]: audit 2024-05-20T22:13:14.643206+0000 mon.a (mon.0) 1728 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "209.1e", "id": [6, 5]}]: dispatch 2024-05-20T22:13:15.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:15 smithi050 bash[28929]: audit 2024-05-20T22:13:14.743449+0000 mon.a (mon.0) 1729 : audit 1 from='client.25991 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi050-63936-30"}]': finished 2024-05-20T22:13:15.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:15 smithi050 bash[28929]: audit 2024-05-20T22:13:14.743646+0000 mon.a (mon.0) 1730 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.9", "id": [3, 1]}]': finished 2024-05-20T22:13:15.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:15 smithi050 bash[28929]: audit 2024-05-20T22:13:14.743814+0000 mon.a (mon.0) 1731 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.e", "id": [3, 1]}]': finished 2024-05-20T22:13:15.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:15 smithi050 bash[28929]: audit 2024-05-20T22:13:14.744008+0000 mon.a (mon.0) 1732 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]': finished 2024-05-20T22:13:15.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:15 smithi050 bash[28929]: audit 2024-05-20T22:13:14.744174+0000 mon.a (mon.0) 1733 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1e", "id": [3, 7]}]': finished 2024-05-20T22:13:15.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:15 smithi050 bash[28929]: audit 2024-05-20T22:13:14.744412+0000 mon.a (mon.0) 1734 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "209.1e", "id": [6, 5]}]': finished 2024-05-20T22:13:15.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:15 smithi050 bash[28929]: cluster 2024-05-20T22:13:14.751767+0000 mon.a (mon.0) 1735 : cluster 0 osdmap e199: 8 total, 8 up, 8 in 2024-05-20T22:13:15.698 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:15 smithi050 bash[28929]: audit 2024-05-20T22:13:14.769556+0000 mon.a (mon.0) 1736 : audit 1 from='client.? v1:172.21.15.50:0/283531942' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi050-63944-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:15.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:15 smithi050 bash[28929]: audit 2024-05-20T22:13:14.808093+0000 mon.c (mon.2) 242 : audit 1 from='client.? v1:172.21.15.50:0/3172954634' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:15.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:15 smithi050 bash[28929]: audit 2024-05-20T22:13:15.231325+0000 mon.a (mon.0) 1737 : audit 1 from='client.26006 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:15.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:15 smithi050 bash[28929]: audit 2024-05-20T22:13:15.232675+0000 mon.c (mon.2) 243 : audit 1 from='client.? v1:172.21.15.50:0/3172954634' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:15.699 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:15 smithi050 bash[28929]: audit 2024-05-20T22:13:15.233329+0000 mon.a (mon.0) 1738 : audit 1 from='client.26006 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:15.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:15 smithi050 bash[28929]: audit 2024-05-20T22:13:15.234483+0000 mon.c (mon.2) 244 : audit 1 from='client.? v1:172.21.15.50:0/3172954634' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi050-63936-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:15.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:15 smithi050 bash[28929]: audit 2024-05-20T22:13:15.235152+0000 mon.a (mon.0) 1739 : audit 1 from='client.26006 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi050-63936-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:16 smithi145 bash[23893]: audit 2024-05-20T22:13:15.747430+0000 mon.a (mon.0) 1740 : audit 1 from='client.? v1:172.21.15.50:0/283531942' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi050-63944-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:16 smithi145 bash[23893]: audit 2024-05-20T22:13:15.747611+0000 mon.a (mon.0) 1741 : audit 1 from='client.26006 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi050-63936-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:16 smithi145 bash[23893]: cluster 2024-05-20T22:13:15.756265+0000 mon.a (mon.0) 1742 : cluster 0 osdmap e200: 8 total, 8 up, 8 in 2024-05-20T22:13:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:16 smithi145 bash[23893]: audit 2024-05-20T22:13:15.761485+0000 mon.c (mon.2) 245 : audit 1 from='client.? v1:172.21.15.50:0/3172954634' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi050-63936-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:16 smithi145 bash[23893]: audit 2024-05-20T22:13:15.779955+0000 mon.a (mon.0) 1743 : audit 1 from='client.26006 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi050-63936-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:16 smithi145 bash[23893]: audit 2024-05-20T22:13:15.782621+0000 mon.a (mon.0) 1744 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:17.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:16 smithi145 bash[23893]: cluster 2024-05-20T22:13:16.072478+0000 mgr.y (mgr.14592) 286 : cluster 0 pgmap v312: 420 pgs: 32 unknown, 32 creating+peering, 4 peering, 352 active+clean; 584 KiB data, 561 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:13:17.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:16 smithi050 bash[21866]: audit 2024-05-20T22:13:15.747430+0000 mon.a (mon.0) 1740 : audit 1 from='client.? v1:172.21.15.50:0/283531942' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi050-63944-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:17.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:16 smithi050 bash[21866]: audit 2024-05-20T22:13:15.747611+0000 mon.a (mon.0) 1741 : audit 1 from='client.26006 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi050-63936-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:17.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:16 smithi050 bash[21866]: cluster 2024-05-20T22:13:15.756265+0000 mon.a (mon.0) 1742 : cluster 0 osdmap e200: 8 total, 8 up, 8 in 2024-05-20T22:13:17.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:16 smithi050 bash[21866]: audit 2024-05-20T22:13:15.761485+0000 mon.c (mon.2) 245 : audit 1 from='client.? v1:172.21.15.50:0/3172954634' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi050-63936-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:17.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:16 smithi050 bash[21866]: audit 2024-05-20T22:13:15.779955+0000 mon.a (mon.0) 1743 : audit 1 from='client.26006 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi050-63936-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:17.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:16 smithi050 bash[21866]: audit 2024-05-20T22:13:15.782621+0000 mon.a (mon.0) 1744 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:17.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:16 smithi050 bash[21866]: cluster 2024-05-20T22:13:16.072478+0000 mgr.y (mgr.14592) 286 : cluster 0 pgmap v312: 420 pgs: 32 unknown, 32 creating+peering, 4 peering, 352 active+clean; 584 KiB data, 561 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:13:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:16 smithi050 bash[28929]: audit 2024-05-20T22:13:15.747430+0000 mon.a (mon.0) 1740 : audit 1 from='client.? v1:172.21.15.50:0/283531942' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi050-63944-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:16 smithi050 bash[28929]: audit 2024-05-20T22:13:15.747611+0000 mon.a (mon.0) 1741 : audit 1 from='client.26006 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi050-63936-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:16 smithi050 bash[28929]: cluster 2024-05-20T22:13:15.756265+0000 mon.a (mon.0) 1742 : cluster 0 osdmap e200: 8 total, 8 up, 8 in 2024-05-20T22:13:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:16 smithi050 bash[28929]: audit 2024-05-20T22:13:15.761485+0000 mon.c (mon.2) 245 : audit 1 from='client.? v1:172.21.15.50:0/3172954634' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi050-63936-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:16 smithi050 bash[28929]: audit 2024-05-20T22:13:15.779955+0000 mon.a (mon.0) 1743 : audit 1 from='client.26006 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi050-63936-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:16 smithi050 bash[28929]: audit 2024-05-20T22:13:15.782621+0000 mon.a (mon.0) 1744 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:16 smithi050 bash[28929]: cluster 2024-05-20T22:13:16.072478+0000 mgr.y (mgr.14592) 286 : cluster 0 pgmap v312: 420 pgs: 32 unknown, 32 creating+peering, 4 peering, 352 active+clean; 584 KiB data, 561 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:13:18.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:13:17 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:13:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:17 smithi145 bash[23893]: cluster 2024-05-20T22:13:16.747533+0000 mon.a (mon.0) 1745 : cluster 3 Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-05-20T22:13:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:17 smithi145 bash[23893]: audit 2024-05-20T22:13:16.758582+0000 mon.a (mon.0) 1746 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:17 smithi145 bash[23893]: cluster 2024-05-20T22:13:17.235125+0000 mon.a (mon.0) 1747 : cluster 0 osdmap e201: 8 total, 8 up, 8 in 2024-05-20T22:13:18.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:17 smithi145 bash[23893]: audit 2024-05-20T22:13:17.252878+0000 mon.a (mon.0) 1748 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:18.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:17 smithi050 bash[28929]: cluster 2024-05-20T22:13:16.747533+0000 mon.a (mon.0) 1745 : cluster 3 Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-05-20T22:13:18.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:17 smithi050 bash[28929]: audit 2024-05-20T22:13:16.758582+0000 mon.a (mon.0) 1746 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:18.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:17 smithi050 bash[28929]: cluster 2024-05-20T22:13:17.235125+0000 mon.a (mon.0) 1747 : cluster 0 osdmap e201: 8 total, 8 up, 8 in 2024-05-20T22:13:18.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:17 smithi050 bash[28929]: audit 2024-05-20T22:13:17.252878+0000 mon.a (mon.0) 1748 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:18.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:17 smithi050 bash[21866]: cluster 2024-05-20T22:13:16.747533+0000 mon.a (mon.0) 1745 : cluster 3 Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-05-20T22:13:18.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:17 smithi050 bash[21866]: audit 2024-05-20T22:13:16.758582+0000 mon.a (mon.0) 1746 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:18.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:17 smithi050 bash[21866]: cluster 2024-05-20T22:13:17.235125+0000 mon.a (mon.0) 1747 : cluster 0 osdmap e201: 8 total, 8 up, 8 in 2024-05-20T22:13:18.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:17 smithi050 bash[21866]: audit 2024-05-20T22:13:17.252878+0000 mon.a (mon.0) 1748 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:19.064 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAi 0x55740885a320 2024-05-20T22:13:19.065 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885a450 2024-05-20T22:13:19.065 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885a560 2024-05-20T22:13:19.065 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885a900 2024-05-20T22:13:19.065 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885adf0 2024-05-20T22:13:19.065 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885af40 2024-05-20T22:13:19.065 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885b520 2024-05-20T22:13:19.065 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885aa50 2024-05-20T22:13:19.065 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885aba0 2024-05-20T22:13:19.065 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885acb0 2024-05-20T22:13:19.065 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885b650 2024-05-20T22:13:19.065 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885b070 2024-05-20T22:13:19.066 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885b1c0 2024-05-20T22:13:19.066 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885b310 2024-05-20T22:13:19.066 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885b7e0 2024-05-20T22:13:19.066 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885bcb0 2024-05-20T22:13:19.066 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885bde0 2024-05-20T22:13:19.066 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885c3c0 2024-05-20T22:13:19.066 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885b910 2024-05-20T22:13:19.066 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885ba40 2024-05-20T22:13:19.066 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885bb70 2024-05-20T22:13:19.066 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885c4d0 2024-05-20T22:13:19.066 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885bf10 2024-05-20T22:13:19.066 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408859df0 2024-05-20T22:13:19.066 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408859f20 2024-05-20T22:13:19.067 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885a030 2024-05-20T22:13:19.067 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885cad0 2024-05-20T22:13:19.067 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885c620 2024-05-20T22:13:19.067 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885c020 2024-05-20T22:13:19.067 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885c130 2024-05-20T22:13:19.067 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885c280 2024-05-20T22:13:19.067 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885d0f0 2024-05-20T22:13:19.067 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885cc40 2024-05-20T22:13:19.067 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885cd90 2024-05-20T22:13:19.067 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885cee0 2024-05-20T22:13:19.067 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885d200 2024-05-20T22:13:19.067 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885d350 2024-05-20T22:13:19.067 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885d950 2024-05-20T22:13:19.067 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885d4a0 2024-05-20T22:13:19.068 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885d5f0 2024-05-20T22:13:19.068 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885d700 2024-05-20T22:13:19.068 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885daa0 2024-05-20T22:13:19.068 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885df50 2024-05-20T22:13:19.068 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885e0a0 2024-05-20T22:13:19.068 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885c730 2024-05-20T22:13:19.068 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885c860 2024-05-20T22:13:19.068 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885c970 2024-05-20T22:13:19.068 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885e1d0 2024-05-20T22:13:19.068 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885e6a0 2024-05-20T22:13:19.068 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885e7d0 2024-05-20T22:13:19.068 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885edd0 2024-05-20T22:13:19.068 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885e300 2024-05-20T22:13:19.068 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885e450 2024-05-20T22:13:19.068 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885e920 2024-05-20T22:13:19.069 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885dbb0 2024-05-20T22:13:19.069 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885dce0 2024-05-20T22:13:19.069 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885ddf0 2024-05-20T22:13:19.069 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885f3d0 2024-05-20T22:13:19.069 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885ef20 2024-05-20T22:13:19.069 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885f050 2024-05-20T22:13:19.069 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885f180 2024-05-20T22:13:19.069 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885f2b0 2024-05-20T22:13:19.069 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885f9b0 2024-05-20T22:13:19.069 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885f500 2024-05-20T22:13:19.069 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885f630 2024-05-20T22:13:19.069 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885f780 2024-05-20T22:13:19.069 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885fac0 2024-05-20T22:13:19.069 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885fc10 2024-05-20T22:13:19.070 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408860210 2024-05-20T22:13:19.070 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885fd60 2024-05-20T22:13:19.070 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885fe90 2024-05-20T22:13:19.070 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885f890 2024-05-20T22:13:19.070 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885ffa0 2024-05-20T22:13:19.070 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088600d0 2024-05-20T22:13:19.070 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408860320 2024-05-20T22:13:19.070 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408860510 2024-05-20T22:13:19.070 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408860b10 2024-05-20T22:13:19.070 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408860660 2024-05-20T22:13:19.070 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088607b0 2024-05-20T22:13:19.070 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088608e0 2024-05-20T22:13:19.070 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408860c40 2024-05-20T22:13:19.070 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408860d90 2024-05-20T22:13:19.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:18 smithi145 bash[23893]: audit 2024-05-20T22:13:17.770553+0000 mon.a (mon.0) 1749 : audit 1 from='client.26006 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi050-63936-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi050-63936-31"}]': finished 2024-05-20T22:13:19.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:18 smithi145 bash[23893]: audit 2024-05-20T22:13:17.770783+0000 mon.a (mon.0) 1750 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-21", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:19.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:18 smithi145 bash[23893]: cluster 2024-05-20T22:13:17.777575+0000 mon.a (mon.0) 1751 : cluster 0 osdmap e202: 8 total, 8 up, 8 in 2024-05-20T22:13:19.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:18 smithi145 bash[23893]: audit 2024-05-20T22:13:17.778613+0000 mgr.y (mgr.14592) 287 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:13:19.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:18 smithi145 bash[23893]: audit 2024-05-20T22:13:17.785195+0000 mon.a (mon.0) 1752 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-21"}]: dispatch 2024-05-20T22:13:19.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:18 smithi145 bash[23893]: audit 2024-05-20T22:13:17.785407+0000 mon.c (mon.2) 246 : audit 1 from='client.? v1:172.21.15.50:0/53716902' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi050-63944-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:19.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:18 smithi145 bash[23893]: audit 2024-05-20T22:13:17.786658+0000 mon.a (mon.0) 1753 : audit 1 from='client.26012 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi050-63944-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:19.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:18 smithi145 bash[23893]: cluster 2024-05-20T22:13:18.073543+0000 mgr.y (mgr.14592) 288 : cluster 0 pgmap v315: 428 pgs: 72 unknown, 4 peering, 352 active+clean; 584 KiB data, 561 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:13:19.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:18 smithi050 bash[21866]: audit 2024-05-20T22:13:17.770553+0000 mon.a (mon.0) 1749 : audit 1 from='client.26006 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi050-63936-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi050-63936-31"}]': finished 2024-05-20T22:13:19.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:18 smithi050 bash[21866]: audit 2024-05-20T22:13:17.770783+0000 mon.a (mon.0) 1750 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-21", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:19.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:18 smithi050 bash[21866]: cluster 2024-05-20T22:13:17.777575+0000 mon.a (mon.0) 1751 : cluster 0 osdmap e202: 8 total, 8 up, 8 in 2024-05-20T22:13:19.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:18 smithi050 bash[21866]: audit 2024-05-20T22:13:17.778613+0000 mgr.y (mgr.14592) 287 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:13:19.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:18 smithi050 bash[21866]: audit 2024-05-20T22:13:17.785195+0000 mon.a (mon.0) 1752 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-21"}]: dispatch 2024-05-20T22:13:19.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:18 smithi050 bash[21866]: audit 2024-05-20T22:13:17.785407+0000 mon.c (mon.2) 246 : audit 1 from='client.? v1:172.21.15.50:0/53716902' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi050-63944-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:19.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:18 smithi050 bash[21866]: audit 2024-05-20T22:13:17.786658+0000 mon.a (mon.0) 1753 : audit 1 from='client.26012 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi050-63944-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:19.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:18 smithi050 bash[21866]: cluster 2024-05-20T22:13:18.073543+0000 mgr.y (mgr.14592) 288 : cluster 0 pgmap v315: 428 pgs: 72 unknown, 4 peering, 352 active+clean; 584 KiB data, 561 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:13:19.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:18 smithi050 bash[28929]: audit 2024-05-20T22:13:17.770553+0000 mon.a (mon.0) 1749 : audit 1 from='client.26006 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi050-63936-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi050-63936-31"}]': finished 2024-05-20T22:13:19.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:18 smithi050 bash[28929]: audit 2024-05-20T22:13:17.770783+0000 mon.a (mon.0) 1750 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-21", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:19.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:18 smithi050 bash[28929]: cluster 2024-05-20T22:13:17.777575+0000 mon.a (mon.0) 1751 : cluster 0 osdmap e202: 8 total, 8 up, 8 in 2024-05-20T22:13:19.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:18 smithi050 bash[28929]: audit 2024-05-20T22:13:17.778613+0000 mgr.y (mgr.14592) 287 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:13:19.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:18 smithi050 bash[28929]: audit 2024-05-20T22:13:17.785195+0000 mon.a (mon.0) 1752 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-21"}]: dispatch 2024-05-20T22:13:19.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:18 smithi050 bash[28929]: audit 2024-05-20T22:13:17.785407+0000 mon.c (mon.2) 246 : audit 1 from='client.? v1:172.21.15.50:0/53716902' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi050-63944-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:19.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:18 smithi050 bash[28929]: audit 2024-05-20T22:13:17.786658+0000 mon.a (mon.0) 1753 : audit 1 from='client.26012 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi050-63944-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:19.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:18 smithi050 bash[28929]: cluster 2024-05-20T22:13:18.073543+0000 mgr.y (mgr.14592) 288 : cluster 0 pgmap v315: 428 pgs: 72 unknown, 4 peering, 352 active+clean; 584 KiB data, 561 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:13:19.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:13:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:13:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:13:20.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:19 smithi145 bash[23893]: cluster 2024-05-20T22:13:18.772481+0000 mon.a (mon.0) 1754 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:20.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:19 smithi145 bash[23893]: audit 2024-05-20T22:13:18.774139+0000 mon.a (mon.0) 1755 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-21"}]': finished 2024-05-20T22:13:20.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:19 smithi145 bash[23893]: audit 2024-05-20T22:13:18.774355+0000 mon.a (mon.0) 1756 : audit 1 from='client.26012 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi050-63944-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:20.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:19 smithi145 bash[23893]: cluster 2024-05-20T22:13:18.783435+0000 mon.a (mon.0) 1757 : cluster 0 osdmap e203: 8 total, 8 up, 8 in 2024-05-20T22:13:20.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:19 smithi145 bash[23893]: audit 2024-05-20T22:13:18.785555+0000 mon.a (mon.0) 1758 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-21", "mode": "writeback"}]: dispatch 2024-05-20T22:13:20.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:19 smithi145 bash[23893]: cluster 2024-05-20T22:13:19.774534+0000 mon.a (mon.0) 1759 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:13:20.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:19 smithi145 bash[23893]: audit 2024-05-20T22:13:19.776827+0000 mon.a (mon.0) 1760 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-21", "mode": "writeback"}]': finished 2024-05-20T22:13:20.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:19 smithi145 bash[23893]: cluster 2024-05-20T22:13:19.784644+0000 mon.a (mon.0) 1761 : cluster 0 osdmap e204: 8 total, 8 up, 8 in 2024-05-20T22:13:20.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:19 smithi050 bash[21866]: cluster 2024-05-20T22:13:18.772481+0000 mon.a (mon.0) 1754 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:20.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:19 smithi050 bash[21866]: audit 2024-05-20T22:13:18.774139+0000 mon.a (mon.0) 1755 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-21"}]': finished 2024-05-20T22:13:20.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:19 smithi050 bash[21866]: audit 2024-05-20T22:13:18.774355+0000 mon.a (mon.0) 1756 : audit 1 from='client.26012 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi050-63944-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:20.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:19 smithi050 bash[21866]: cluster 2024-05-20T22:13:18.783435+0000 mon.a (mon.0) 1757 : cluster 0 osdmap e203: 8 total, 8 up, 8 in 2024-05-20T22:13:20.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:19 smithi050 bash[21866]: audit 2024-05-20T22:13:18.785555+0000 mon.a (mon.0) 1758 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-21", "mode": "writeback"}]: dispatch 2024-05-20T22:13:20.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:19 smithi050 bash[21866]: cluster 2024-05-20T22:13:19.774534+0000 mon.a (mon.0) 1759 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:13:20.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:19 smithi050 bash[21866]: audit 2024-05-20T22:13:19.776827+0000 mon.a (mon.0) 1760 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-21", "mode": "writeback"}]': finished 2024-05-20T22:13:20.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:19 smithi050 bash[21866]: cluster 2024-05-20T22:13:19.784644+0000 mon.a (mon.0) 1761 : cluster 0 osdmap e204: 8 total, 8 up, 8 in 2024-05-20T22:13:20.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:19 smithi050 bash[28929]: cluster 2024-05-20T22:13:18.772481+0000 mon.a (mon.0) 1754 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:20.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:19 smithi050 bash[28929]: audit 2024-05-20T22:13:18.774139+0000 mon.a (mon.0) 1755 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-21"}]': finished 2024-05-20T22:13:20.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:19 smithi050 bash[28929]: audit 2024-05-20T22:13:18.774355+0000 mon.a (mon.0) 1756 : audit 1 from='client.26012 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi050-63944-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:20.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:19 smithi050 bash[28929]: cluster 2024-05-20T22:13:18.783435+0000 mon.a (mon.0) 1757 : cluster 0 osdmap e203: 8 total, 8 up, 8 in 2024-05-20T22:13:20.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:19 smithi050 bash[28929]: audit 2024-05-20T22:13:18.785555+0000 mon.a (mon.0) 1758 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-21", "mode": "writeback"}]: dispatch 2024-05-20T22:13:20.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:19 smithi050 bash[28929]: cluster 2024-05-20T22:13:19.774534+0000 mon.a (mon.0) 1759 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:13:20.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:19 smithi050 bash[28929]: audit 2024-05-20T22:13:19.776827+0000 mon.a (mon.0) 1760 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-21", "mode": "writeback"}]': finished 2024-05-20T22:13:20.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:19 smithi050 bash[28929]: cluster 2024-05-20T22:13:19.784644+0000 mon.a (mon.0) 1761 : cluster 0 osdmap e204: 8 total, 8 up, 8 in 2024-05-20T22:13:21.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:20 smithi145 bash[23893]: audit 2024-05-20T22:13:19.794943+0000 mon.c (mon.2) 247 : audit 1 from='client.? v1:172.21.15.50:0/3172954634' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:21.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:20 smithi145 bash[23893]: audit 2024-05-20T22:13:19.796161+0000 mon.a (mon.0) 1762 : audit 1 from='client.26006 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:21.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:20 smithi145 bash[23893]: cluster 2024-05-20T22:13:20.076640+0000 mgr.y (mgr.14592) 289 : cluster 0 pgmap v318: 388 pgs: 388 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-05-20T22:13:21.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:20 smithi145 bash[23893]: audit 2024-05-20T22:13:20.287581+0000 mon.a (mon.0) 1763 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:13:21.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:20 smithi145 bash[23893]: audit 2024-05-20T22:13:20.780602+0000 mon.a (mon.0) 1764 : audit 1 from='client.26006 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi050-63936-31"}]': finished 2024-05-20T22:13:21.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:20 smithi145 bash[23893]: audit 2024-05-20T22:13:20.780858+0000 mon.a (mon.0) 1765 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:13:21.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:20 smithi145 bash[23893]: cluster 2024-05-20T22:13:20.791824+0000 mon.a (mon.0) 1766 : cluster 0 osdmap e205: 8 total, 8 up, 8 in 2024-05-20T22:13:21.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:20 smithi145 bash[23893]: audit 2024-05-20T22:13:20.792729+0000 mon.a (mon.0) 1767 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-21"}]: dispatch 2024-05-20T22:13:21.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:20 smithi145 bash[23893]: audit 2024-05-20T22:13:20.793631+0000 mon.c (mon.2) 248 : audit 1 from='client.? v1:172.21.15.50:0/3172954634' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:21.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:20 smithi145 bash[23893]: audit 2024-05-20T22:13:20.797673+0000 mon.a (mon.0) 1768 : audit 1 from='client.26006 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:21.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:20 smithi145 bash[23893]: audit 2024-05-20T22:13:20.798660+0000 mon.c (mon.2) 249 : audit 1 from='client.? v1:172.21.15.50:0/2071020144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:21.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:20 smithi145 bash[23893]: audit 2024-05-20T22:13:20.810532+0000 mon.a (mon.0) 1769 : audit 1 from='client.26018 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:21.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:20 smithi050 bash[21866]: audit 2024-05-20T22:13:19.794943+0000 mon.c (mon.2) 247 : audit 1 from='client.? v1:172.21.15.50:0/3172954634' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:21.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:20 smithi050 bash[21866]: audit 2024-05-20T22:13:19.796161+0000 mon.a (mon.0) 1762 : audit 1 from='client.26006 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:21.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:20 smithi050 bash[21866]: cluster 2024-05-20T22:13:20.076640+0000 mgr.y (mgr.14592) 289 : cluster 0 pgmap v318: 388 pgs: 388 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-05-20T22:13:21.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:20 smithi050 bash[21866]: audit 2024-05-20T22:13:20.287581+0000 mon.a (mon.0) 1763 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:13:21.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:20 smithi050 bash[21866]: audit 2024-05-20T22:13:20.780602+0000 mon.a (mon.0) 1764 : audit 1 from='client.26006 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi050-63936-31"}]': finished 2024-05-20T22:13:21.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:20 smithi050 bash[21866]: audit 2024-05-20T22:13:20.780858+0000 mon.a (mon.0) 1765 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:13:21.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:20 smithi050 bash[21866]: cluster 2024-05-20T22:13:20.791824+0000 mon.a (mon.0) 1766 : cluster 0 osdmap e205: 8 total, 8 up, 8 in 2024-05-20T22:13:21.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:20 smithi050 bash[21866]: audit 2024-05-20T22:13:20.792729+0000 mon.a (mon.0) 1767 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-21"}]: dispatch 2024-05-20T22:13:21.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:20 smithi050 bash[21866]: audit 2024-05-20T22:13:20.793631+0000 mon.c (mon.2) 248 : audit 1 from='client.? v1:172.21.15.50:0/3172954634' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:21.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:20 smithi050 bash[21866]: audit 2024-05-20T22:13:20.797673+0000 mon.a (mon.0) 1768 : audit 1 from='client.26006 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:21.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:20 smithi050 bash[21866]: audit 2024-05-20T22:13:20.798660+0000 mon.c (mon.2) 249 : audit 1 from='client.? v1:172.21.15.50:0/2071020144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:21.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:20 smithi050 bash[21866]: audit 2024-05-20T22:13:20.810532+0000 mon.a (mon.0) 1769 : audit 1 from='client.26018 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:21.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:20 smithi050 bash[28929]: audit 2024-05-20T22:13:19.794943+0000 mon.c (mon.2) 247 : audit 1 from='client.? v1:172.21.15.50:0/3172954634' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:21.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:20 smithi050 bash[28929]: audit 2024-05-20T22:13:19.796161+0000 mon.a (mon.0) 1762 : audit 1 from='client.26006 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:21.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:20 smithi050 bash[28929]: cluster 2024-05-20T22:13:20.076640+0000 mgr.y (mgr.14592) 289 : cluster 0 pgmap v318: 388 pgs: 388 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-05-20T22:13:21.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:20 smithi050 bash[28929]: audit 2024-05-20T22:13:20.287581+0000 mon.a (mon.0) 1763 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:13:21.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:20 smithi050 bash[28929]: audit 2024-05-20T22:13:20.780602+0000 mon.a (mon.0) 1764 : audit 1 from='client.26006 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi050-63936-31"}]': finished 2024-05-20T22:13:21.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:20 smithi050 bash[28929]: audit 2024-05-20T22:13:20.780858+0000 mon.a (mon.0) 1765 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:13:21.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:20 smithi050 bash[28929]: cluster 2024-05-20T22:13:20.791824+0000 mon.a (mon.0) 1766 : cluster 0 osdmap e205: 8 total, 8 up, 8 in 2024-05-20T22:13:21.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:20 smithi050 bash[28929]: audit 2024-05-20T22:13:20.792729+0000 mon.a (mon.0) 1767 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-21"}]: dispatch 2024-05-20T22:13:21.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:20 smithi050 bash[28929]: audit 2024-05-20T22:13:20.793631+0000 mon.c (mon.2) 248 : audit 1 from='client.? v1:172.21.15.50:0/3172954634' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:21.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:20 smithi050 bash[28929]: audit 2024-05-20T22:13:20.797673+0000 mon.a (mon.0) 1768 : audit 1 from='client.26006 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi050-63936-31"}]: dispatch 2024-05-20T22:13:21.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:20 smithi050 bash[28929]: audit 2024-05-20T22:13:20.798660+0000 mon.c (mon.2) 249 : audit 1 from='client.? v1:172.21.15.50:0/2071020144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:21.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:20 smithi050 bash[28929]: audit 2024-05-20T22:13:20.810532+0000 mon.a (mon.0) 1769 : audit 1 from='client.26018 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:22.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:21 smithi145 bash[23893]: cluster 2024-05-20T22:13:20.814666+0000 mon.a (mon.0) 1770 : cluster 1 Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-05-20T22:13:22.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:21 smithi145 bash[23893]: audit 2024-05-20T22:13:21.147650+0000 mon.a (mon.0) 1771 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:13:22.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:21 smithi145 bash[23893]: audit 2024-05-20T22:13:21.150280+0000 mon.a (mon.0) 1772 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:13:22.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:21 smithi145 bash[23893]: cluster 2024-05-20T22:13:21.782272+0000 mon.a (mon.0) 1773 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:13:22.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:21 smithi145 bash[23893]: audit 2024-05-20T22:13:21.784760+0000 mon.a (mon.0) 1774 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-21"}]': finished 2024-05-20T22:13:22.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:21 smithi145 bash[23893]: audit 2024-05-20T22:13:21.784917+0000 mon.a (mon.0) 1775 : audit 1 from='client.26006 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi050-63936-31"}]': finished 2024-05-20T22:13:22.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:21 smithi145 bash[23893]: audit 2024-05-20T22:13:21.785069+0000 mon.a (mon.0) 1776 : audit 1 from='client.26018 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:22.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:21 smithi145 bash[23893]: cluster 2024-05-20T22:13:21.792997+0000 mon.a (mon.0) 1777 : cluster 0 osdmap e206: 8 total, 8 up, 8 in 2024-05-20T22:13:22.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:21 smithi050 bash[21866]: cluster 2024-05-20T22:13:20.814666+0000 mon.a (mon.0) 1770 : cluster 1 Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-05-20T22:13:22.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:21 smithi050 bash[21866]: audit 2024-05-20T22:13:21.147650+0000 mon.a (mon.0) 1771 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:13:22.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:21 smithi050 bash[21866]: audit 2024-05-20T22:13:21.150280+0000 mon.a (mon.0) 1772 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:13:22.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:21 smithi050 bash[21866]: cluster 2024-05-20T22:13:21.782272+0000 mon.a (mon.0) 1773 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:13:22.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:21 smithi050 bash[21866]: audit 2024-05-20T22:13:21.784760+0000 mon.a (mon.0) 1774 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-21"}]': finished 2024-05-20T22:13:22.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:21 smithi050 bash[21866]: audit 2024-05-20T22:13:21.784917+0000 mon.a (mon.0) 1775 : audit 1 from='client.26006 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi050-63936-31"}]': finished 2024-05-20T22:13:22.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:21 smithi050 bash[21866]: audit 2024-05-20T22:13:21.785069+0000 mon.a (mon.0) 1776 : audit 1 from='client.26018 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:22.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:21 smithi050 bash[21866]: cluster 2024-05-20T22:13:21.792997+0000 mon.a (mon.0) 1777 : cluster 0 osdmap e206: 8 total, 8 up, 8 in 2024-05-20T22:13:22.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:21 smithi050 bash[28929]: cluster 2024-05-20T22:13:20.814666+0000 mon.a (mon.0) 1770 : cluster 1 Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-05-20T22:13:22.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:21 smithi050 bash[28929]: audit 2024-05-20T22:13:21.147650+0000 mon.a (mon.0) 1771 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:13:22.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:21 smithi050 bash[28929]: audit 2024-05-20T22:13:21.150280+0000 mon.a (mon.0) 1772 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:13:22.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:21 smithi050 bash[28929]: cluster 2024-05-20T22:13:21.782272+0000 mon.a (mon.0) 1773 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:13:22.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:21 smithi050 bash[28929]: audit 2024-05-20T22:13:21.784760+0000 mon.a (mon.0) 1774 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-21"}]': finished 2024-05-20T22:13:22.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:21 smithi050 bash[28929]: audit 2024-05-20T22:13:21.784917+0000 mon.a (mon.0) 1775 : audit 1 from='client.26006 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi050-63936-31"}]': finished 2024-05-20T22:13:22.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:21 smithi050 bash[28929]: audit 2024-05-20T22:13:21.785069+0000 mon.a (mon.0) 1776 : audit 1 from='client.26018 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:22.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:21 smithi050 bash[28929]: cluster 2024-05-20T22:13:21.792997+0000 mon.a (mon.0) 1777 : cluster 0 osdmap e206: 8 total, 8 up, 8 in 2024-05-20T22:13:23.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:23 smithi145 bash[23893]: audit 2024-05-20T22:13:21.846709+0000 mon.c (mon.2) 250 : audit 1 from='client.? v1:172.21.15.50:0/2971836940' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:23.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:23 smithi145 bash[23893]: audit 2024-05-20T22:13:21.848109+0000 mon.a (mon.0) 1778 : audit 1 from='client.26024 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:23.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:23 smithi145 bash[23893]: audit 2024-05-20T22:13:21.848736+0000 mon.c (mon.2) 251 : audit 1 from='client.? v1:172.21.15.50:0/2971836940' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:23.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:23 smithi145 bash[23893]: audit 2024-05-20T22:13:21.848987+0000 mon.a (mon.0) 1779 : audit 1 from='client.26024 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:23.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:23 smithi145 bash[23893]: audit 2024-05-20T22:13:21.849519+0000 mon.c (mon.2) 252 : audit 1 from='client.? v1:172.21.15.50:0/2971836940' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi050-63936-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:23.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:23 smithi145 bash[23893]: audit 2024-05-20T22:13:21.849822+0000 mon.a (mon.0) 1780 : audit 1 from='client.26024 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi050-63936-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:23.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:23 smithi145 bash[23893]: cluster 2024-05-20T22:13:22.077583+0000 mgr.y (mgr.14592) 290 : cluster 0 pgmap v321: 420 pgs: 32 unknown, 388 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-05-20T22:13:23.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:23 smithi145 bash[23893]: audit 2024-05-20T22:13:22.788850+0000 mon.a (mon.0) 1781 : audit 1 from='client.26024 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi050-63936-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:23.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:23 smithi145 bash[23893]: audit 2024-05-20T22:13:22.798338+0000 mon.c (mon.2) 253 : audit 1 from='client.? v1:172.21.15.50:0/2971836940' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi050-63936-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:23.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:23 smithi145 bash[23893]: cluster 2024-05-20T22:13:22.799293+0000 mon.a (mon.0) 1782 : cluster 0 osdmap e207: 8 total, 8 up, 8 in 2024-05-20T22:13:23.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:23 smithi145 bash[23893]: audit 2024-05-20T22:13:22.804738+0000 mon.a (mon.0) 1783 : audit 1 from='client.26024 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi050-63936-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:23.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:23 smithi050 bash[28929]: audit 2024-05-20T22:13:21.846709+0000 mon.c (mon.2) 250 : audit 1 from='client.? v1:172.21.15.50:0/2971836940' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:23.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:23 smithi050 bash[28929]: audit 2024-05-20T22:13:21.848109+0000 mon.a (mon.0) 1778 : audit 1 from='client.26024 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:23.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:23 smithi050 bash[28929]: audit 2024-05-20T22:13:21.848736+0000 mon.c (mon.2) 251 : audit 1 from='client.? v1:172.21.15.50:0/2971836940' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:23.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:23 smithi050 bash[28929]: audit 2024-05-20T22:13:21.848987+0000 mon.a (mon.0) 1779 : audit 1 from='client.26024 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:23.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:23 smithi050 bash[28929]: audit 2024-05-20T22:13:21.849519+0000 mon.c (mon.2) 252 : audit 1 from='client.? v1:172.21.15.50:0/2971836940' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi050-63936-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:23.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:23 smithi050 bash[28929]: audit 2024-05-20T22:13:21.849822+0000 mon.a (mon.0) 1780 : audit 1 from='client.26024 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi050-63936-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:23.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:23 smithi050 bash[28929]: cluster 2024-05-20T22:13:22.077583+0000 mgr.y (mgr.14592) 290 : cluster 0 pgmap v321: 420 pgs: 32 unknown, 388 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-05-20T22:13:23.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:23 smithi050 bash[28929]: audit 2024-05-20T22:13:22.788850+0000 mon.a (mon.0) 1781 : audit 1 from='client.26024 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi050-63936-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:23.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:23 smithi050 bash[28929]: audit 2024-05-20T22:13:22.798338+0000 mon.c (mon.2) 253 : audit 1 from='client.? v1:172.21.15.50:0/2971836940' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi050-63936-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:23.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:23 smithi050 bash[28929]: cluster 2024-05-20T22:13:22.799293+0000 mon.a (mon.0) 1782 : cluster 0 osdmap e207: 8 total, 8 up, 8 in 2024-05-20T22:13:23.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:23 smithi050 bash[28929]: audit 2024-05-20T22:13:22.804738+0000 mon.a (mon.0) 1783 : audit 1 from='client.26024 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi050-63936-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:23.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:23 smithi050 bash[21866]: audit 2024-05-20T22:13:21.846709+0000 mon.c (mon.2) 250 : audit 1 from='client.? v1:172.21.15.50:0/2971836940' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:23.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:23 smithi050 bash[21866]: audit 2024-05-20T22:13:21.848109+0000 mon.a (mon.0) 1778 : audit 1 from='client.26024 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:23.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:23 smithi050 bash[21866]: audit 2024-05-20T22:13:21.848736+0000 mon.c (mon.2) 251 : audit 1 from='client.? v1:172.21.15.50:0/2971836940' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:23.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:23 smithi050 bash[21866]: audit 2024-05-20T22:13:21.848987+0000 mon.a (mon.0) 1779 : audit 1 from='client.26024 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:23.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:23 smithi050 bash[21866]: audit 2024-05-20T22:13:21.849519+0000 mon.c (mon.2) 252 : audit 1 from='client.? v1:172.21.15.50:0/2971836940' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi050-63936-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:23.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:23 smithi050 bash[21866]: audit 2024-05-20T22:13:21.849822+0000 mon.a (mon.0) 1780 : audit 1 from='client.26024 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi050-63936-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:23.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:23 smithi050 bash[21866]: cluster 2024-05-20T22:13:22.077583+0000 mgr.y (mgr.14592) 290 : cluster 0 pgmap v321: 420 pgs: 32 unknown, 388 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-05-20T22:13:23.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:23 smithi050 bash[21866]: audit 2024-05-20T22:13:22.788850+0000 mon.a (mon.0) 1781 : audit 1 from='client.26024 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi050-63936-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:23.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:23 smithi050 bash[21866]: audit 2024-05-20T22:13:22.798338+0000 mon.c (mon.2) 253 : audit 1 from='client.? v1:172.21.15.50:0/2971836940' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi050-63936-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:23.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:23 smithi050 bash[21866]: cluster 2024-05-20T22:13:22.799293+0000 mon.a (mon.0) 1782 : cluster 0 osdmap e207: 8 total, 8 up, 8 in 2024-05-20T22:13:23.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:23 smithi050 bash[21866]: audit 2024-05-20T22:13:22.804738+0000 mon.a (mon.0) 1783 : audit 1 from='client.26024 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi050-63936-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:24.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:24 smithi145 bash[23893]: audit 2024-05-20T22:13:22.805705+0000 mon.c (mon.2) 254 : audit 1 from='client.? v1:172.21.15.50:0/346617039' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:24.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:24 smithi145 bash[23893]: audit 2024-05-20T22:13:23.271659+0000 mon.a (mon.0) 1784 : audit 1 from='client.26030 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:24.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:24 smithi145 bash[23893]: audit 2024-05-20T22:13:23.793492+0000 mon.a (mon.0) 1785 : audit 1 from='client.26030 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:24.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:24 smithi145 bash[23893]: cluster 2024-05-20T22:13:24.267482+0000 mon.a (mon.0) 1786 : cluster 0 osdmap e208: 8 total, 8 up, 8 in 2024-05-20T22:13:24.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:24 smithi050 bash[21866]: audit 2024-05-20T22:13:22.805705+0000 mon.c (mon.2) 254 : audit 1 from='client.? v1:172.21.15.50:0/346617039' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:24.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:24 smithi050 bash[21866]: audit 2024-05-20T22:13:23.271659+0000 mon.a (mon.0) 1784 : audit 1 from='client.26030 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:24.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:24 smithi050 bash[21866]: audit 2024-05-20T22:13:23.793492+0000 mon.a (mon.0) 1785 : audit 1 from='client.26030 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:24.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:24 smithi050 bash[21866]: cluster 2024-05-20T22:13:24.267482+0000 mon.a (mon.0) 1786 : cluster 0 osdmap e208: 8 total, 8 up, 8 in 2024-05-20T22:13:24.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:24 smithi050 bash[28929]: audit 2024-05-20T22:13:22.805705+0000 mon.c (mon.2) 254 : audit 1 from='client.? v1:172.21.15.50:0/346617039' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:24.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:24 smithi050 bash[28929]: audit 2024-05-20T22:13:23.271659+0000 mon.a (mon.0) 1784 : audit 1 from='client.26030 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:24.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:24 smithi050 bash[28929]: audit 2024-05-20T22:13:23.793492+0000 mon.a (mon.0) 1785 : audit 1 from='client.26030 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:24.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:24 smithi050 bash[28929]: cluster 2024-05-20T22:13:24.267482+0000 mon.a (mon.0) 1786 : cluster 0 osdmap e208: 8 total, 8 up, 8 in 2024-05-20T22:13:25.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:25 smithi145 bash[23893]: cluster 2024-05-20T22:13:24.078546+0000 mgr.y (mgr.14592) 291 : cluster 0 pgmap v324: 452 pgs: 96 unknown, 356 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:25.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:25 smithi145 bash[23893]: audit 2024-05-20T22:13:24.274658+0000 mon.a (mon.0) 1787 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:25.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:25 smithi145 bash[23893]: cluster 2024-05-20T22:13:24.794704+0000 mon.a (mon.0) 1788 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:25.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:25 smithi145 bash[23893]: audit 2024-05-20T22:13:24.796732+0000 mon.a (mon.0) 1789 : audit 1 from='client.26024 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi050-63936-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi050-63936-32"}]': finished 2024-05-20T22:13:25.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:25 smithi145 bash[23893]: audit 2024-05-20T22:13:24.796939+0000 mon.a (mon.0) 1790 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:25.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:25 smithi145 bash[23893]: cluster 2024-05-20T22:13:24.806274+0000 mon.a (mon.0) 1791 : cluster 0 osdmap e209: 8 total, 8 up, 8 in 2024-05-20T22:13:25.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:25 smithi145 bash[23893]: audit 2024-05-20T22:13:24.810722+0000 mon.c (mon.2) 255 : audit 1 from='client.? v1:172.21.15.50:0/3516075188' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:25.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:25 smithi145 bash[23893]: audit 2024-05-20T22:13:24.816310+0000 mon.a (mon.0) 1792 : audit 1 from='client.26036 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:25.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:25 smithi050 bash[21866]: cluster 2024-05-20T22:13:24.078546+0000 mgr.y (mgr.14592) 291 : cluster 0 pgmap v324: 452 pgs: 96 unknown, 356 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:25.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:25 smithi050 bash[21866]: audit 2024-05-20T22:13:24.274658+0000 mon.a (mon.0) 1787 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:25.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:25 smithi050 bash[21866]: cluster 2024-05-20T22:13:24.794704+0000 mon.a (mon.0) 1788 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:25.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:25 smithi050 bash[21866]: audit 2024-05-20T22:13:24.796732+0000 mon.a (mon.0) 1789 : audit 1 from='client.26024 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi050-63936-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi050-63936-32"}]': finished 2024-05-20T22:13:25.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:25 smithi050 bash[21866]: audit 2024-05-20T22:13:24.796939+0000 mon.a (mon.0) 1790 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:25.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:25 smithi050 bash[21866]: cluster 2024-05-20T22:13:24.806274+0000 mon.a (mon.0) 1791 : cluster 0 osdmap e209: 8 total, 8 up, 8 in 2024-05-20T22:13:25.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:25 smithi050 bash[21866]: audit 2024-05-20T22:13:24.810722+0000 mon.c (mon.2) 255 : audit 1 from='client.? v1:172.21.15.50:0/3516075188' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:25.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:25 smithi050 bash[21866]: audit 2024-05-20T22:13:24.816310+0000 mon.a (mon.0) 1792 : audit 1 from='client.26036 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:25.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:25 smithi050 bash[28929]: cluster 2024-05-20T22:13:24.078546+0000 mgr.y (mgr.14592) 291 : cluster 0 pgmap v324: 452 pgs: 96 unknown, 356 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:25.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:25 smithi050 bash[28929]: audit 2024-05-20T22:13:24.274658+0000 mon.a (mon.0) 1787 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:25.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:25 smithi050 bash[28929]: cluster 2024-05-20T22:13:24.794704+0000 mon.a (mon.0) 1788 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:25.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:25 smithi050 bash[28929]: audit 2024-05-20T22:13:24.796732+0000 mon.a (mon.0) 1789 : audit 1 from='client.26024 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi050-63936-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi050-63936-32"}]': finished 2024-05-20T22:13:25.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:25 smithi050 bash[28929]: audit 2024-05-20T22:13:24.796939+0000 mon.a (mon.0) 1790 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:25.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:25 smithi050 bash[28929]: cluster 2024-05-20T22:13:24.806274+0000 mon.a (mon.0) 1791 : cluster 0 osdmap e209: 8 total, 8 up, 8 in 2024-05-20T22:13:25.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:25 smithi050 bash[28929]: audit 2024-05-20T22:13:24.810722+0000 mon.c (mon.2) 255 : audit 1 from='client.? v1:172.21.15.50:0/3516075188' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:25.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:25 smithi050 bash[28929]: audit 2024-05-20T22:13:24.816310+0000 mon.a (mon.0) 1792 : audit 1 from='client.26036 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:27.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:26 smithi145 bash[23893]: audit 2024-05-20T22:13:25.800461+0000 mon.a (mon.0) 1793 : audit 1 from='client.26036 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:27.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:26 smithi145 bash[23893]: cluster 2024-05-20T22:13:25.808471+0000 mon.a (mon.0) 1794 : cluster 0 osdmap e210: 8 total, 8 up, 8 in 2024-05-20T22:13:27.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:26 smithi145 bash[23893]: audit 2024-05-20T22:13:25.875892+0000 mon.a (mon.0) 1795 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:27.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:26 smithi145 bash[23893]: cluster 2024-05-20T22:13:26.079624+0000 mgr.y (mgr.14592) 292 : cluster 0 pgmap v327: 492 pgs: 40 creating+peering, 452 active+clean; 584 KiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.2 KiB/s wr, 0 op/s 2024-05-20T22:13:27.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:26 smithi050 bash[21866]: audit 2024-05-20T22:13:25.800461+0000 mon.a (mon.0) 1793 : audit 1 from='client.26036 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:27.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:26 smithi050 bash[21866]: cluster 2024-05-20T22:13:25.808471+0000 mon.a (mon.0) 1794 : cluster 0 osdmap e210: 8 total, 8 up, 8 in 2024-05-20T22:13:27.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:26 smithi050 bash[21866]: audit 2024-05-20T22:13:25.875892+0000 mon.a (mon.0) 1795 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:27.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:26 smithi050 bash[21866]: cluster 2024-05-20T22:13:26.079624+0000 mgr.y (mgr.14592) 292 : cluster 0 pgmap v327: 492 pgs: 40 creating+peering, 452 active+clean; 584 KiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.2 KiB/s wr, 0 op/s 2024-05-20T22:13:27.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:26 smithi050 bash[28929]: audit 2024-05-20T22:13:25.800461+0000 mon.a (mon.0) 1793 : audit 1 from='client.26036 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi050-63944-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:27.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:26 smithi050 bash[28929]: cluster 2024-05-20T22:13:25.808471+0000 mon.a (mon.0) 1794 : cluster 0 osdmap e210: 8 total, 8 up, 8 in 2024-05-20T22:13:27.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:26 smithi050 bash[28929]: audit 2024-05-20T22:13:25.875892+0000 mon.a (mon.0) 1795 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:27.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:26 smithi050 bash[28929]: cluster 2024-05-20T22:13:26.079624+0000 mgr.y (mgr.14592) 292 : cluster 0 pgmap v327: 492 pgs: 40 creating+peering, 452 active+clean; 584 KiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.2 KiB/s wr, 0 op/s 2024-05-20T22:13:28.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:13:27 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:13:28.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:27 smithi145 bash[23893]: audit 2024-05-20T22:13:26.810056+0000 mon.a (mon.0) 1796 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-23", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:28.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:27 smithi145 bash[23893]: cluster 2024-05-20T22:13:26.818921+0000 mon.a (mon.0) 1797 : cluster 0 osdmap e211: 8 total, 8 up, 8 in 2024-05-20T22:13:28.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:27 smithi145 bash[23893]: audit 2024-05-20T22:13:26.820162+0000 mon.a (mon.0) 1798 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-23"}]: dispatch 2024-05-20T22:13:28.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:27 smithi145 bash[23893]: audit 2024-05-20T22:13:26.823087+0000 mon.c (mon.2) 256 : audit 1 from='client.? v1:172.21.15.50:0/2971836940' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:28.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:27 smithi145 bash[23893]: audit 2024-05-20T22:13:26.824107+0000 mon.a (mon.0) 1799 : audit 1 from='client.26024 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:28.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:27 smithi050 bash[21866]: audit 2024-05-20T22:13:26.810056+0000 mon.a (mon.0) 1796 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-23", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:28.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:27 smithi050 bash[21866]: cluster 2024-05-20T22:13:26.818921+0000 mon.a (mon.0) 1797 : cluster 0 osdmap e211: 8 total, 8 up, 8 in 2024-05-20T22:13:28.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:27 smithi050 bash[21866]: audit 2024-05-20T22:13:26.820162+0000 mon.a (mon.0) 1798 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-23"}]: dispatch 2024-05-20T22:13:28.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:27 smithi050 bash[21866]: audit 2024-05-20T22:13:26.823087+0000 mon.c (mon.2) 256 : audit 1 from='client.? v1:172.21.15.50:0/2971836940' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:28.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:27 smithi050 bash[21866]: audit 2024-05-20T22:13:26.824107+0000 mon.a (mon.0) 1799 : audit 1 from='client.26024 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:28.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:27 smithi050 bash[28929]: audit 2024-05-20T22:13:26.810056+0000 mon.a (mon.0) 1796 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-23", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:28.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:27 smithi050 bash[28929]: cluster 2024-05-20T22:13:26.818921+0000 mon.a (mon.0) 1797 : cluster 0 osdmap e211: 8 total, 8 up, 8 in 2024-05-20T22:13:28.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:27 smithi050 bash[28929]: audit 2024-05-20T22:13:26.820162+0000 mon.a (mon.0) 1798 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-23"}]: dispatch 2024-05-20T22:13:28.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:27 smithi050 bash[28929]: audit 2024-05-20T22:13:26.823087+0000 mon.c (mon.2) 256 : audit 1 from='client.? v1:172.21.15.50:0/2971836940' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:28.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:27 smithi050 bash[28929]: audit 2024-05-20T22:13:26.824107+0000 mon.a (mon.0) 1799 : audit 1 from='client.26024 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:29.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:28 smithi145 bash[23893]: audit 2024-05-20T22:13:27.783904+0000 mgr.y (mgr.14592) 293 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:13:29.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:28 smithi145 bash[23893]: audit 2024-05-20T22:13:27.820816+0000 mon.a (mon.0) 1800 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-23"}]': finished 2024-05-20T22:13:29.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:28 smithi145 bash[23893]: audit 2024-05-20T22:13:27.820970+0000 mon.a (mon.0) 1801 : audit 1 from='client.26024 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi050-63936-32"}]': finished 2024-05-20T22:13:29.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:28 smithi145 bash[23893]: cluster 2024-05-20T22:13:27.827508+0000 mon.a (mon.0) 1802 : cluster 0 osdmap e212: 8 total, 8 up, 8 in 2024-05-20T22:13:29.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:28 smithi145 bash[23893]: audit 2024-05-20T22:13:27.828372+0000 mon.a (mon.0) 1803 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-23", "mode": "writeback"}]: dispatch 2024-05-20T22:13:29.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:28 smithi145 bash[23893]: audit 2024-05-20T22:13:27.843778+0000 mon.c (mon.2) 257 : audit 1 from='client.? v1:172.21.15.50:0/2971836940' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:29.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:28 smithi145 bash[23893]: audit 2024-05-20T22:13:27.844695+0000 mon.a (mon.0) 1804 : audit 1 from='client.26024 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:29.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:28 smithi145 bash[23893]: cluster 2024-05-20T22:13:28.080724+0000 mgr.y (mgr.14592) 294 : cluster 0 pgmap v330: 420 pgs: 420 active+clean; 584 KiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:13:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:28 smithi050 bash[21866]: audit 2024-05-20T22:13:27.783904+0000 mgr.y (mgr.14592) 293 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:13:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:28 smithi050 bash[21866]: audit 2024-05-20T22:13:27.820816+0000 mon.a (mon.0) 1800 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-23"}]': finished 2024-05-20T22:13:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:28 smithi050 bash[21866]: audit 2024-05-20T22:13:27.820970+0000 mon.a (mon.0) 1801 : audit 1 from='client.26024 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi050-63936-32"}]': finished 2024-05-20T22:13:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:28 smithi050 bash[21866]: cluster 2024-05-20T22:13:27.827508+0000 mon.a (mon.0) 1802 : cluster 0 osdmap e212: 8 total, 8 up, 8 in 2024-05-20T22:13:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:28 smithi050 bash[21866]: audit 2024-05-20T22:13:27.828372+0000 mon.a (mon.0) 1803 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-23", "mode": "writeback"}]: dispatch 2024-05-20T22:13:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:28 smithi050 bash[21866]: audit 2024-05-20T22:13:27.843778+0000 mon.c (mon.2) 257 : audit 1 from='client.? v1:172.21.15.50:0/2971836940' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:28 smithi050 bash[21866]: audit 2024-05-20T22:13:27.844695+0000 mon.a (mon.0) 1804 : audit 1 from='client.26024 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:28 smithi050 bash[21866]: cluster 2024-05-20T22:13:28.080724+0000 mgr.y (mgr.14592) 294 : cluster 0 pgmap v330: 420 pgs: 420 active+clean; 584 KiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:13:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:28 smithi050 bash[28929]: audit 2024-05-20T22:13:27.783904+0000 mgr.y (mgr.14592) 293 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:13:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:28 smithi050 bash[28929]: audit 2024-05-20T22:13:27.820816+0000 mon.a (mon.0) 1800 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-23"}]': finished 2024-05-20T22:13:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:28 smithi050 bash[28929]: audit 2024-05-20T22:13:27.820970+0000 mon.a (mon.0) 1801 : audit 1 from='client.26024 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi050-63936-32"}]': finished 2024-05-20T22:13:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:28 smithi050 bash[28929]: cluster 2024-05-20T22:13:27.827508+0000 mon.a (mon.0) 1802 : cluster 0 osdmap e212: 8 total, 8 up, 8 in 2024-05-20T22:13:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:28 smithi050 bash[28929]: audit 2024-05-20T22:13:27.828372+0000 mon.a (mon.0) 1803 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-23", "mode": "writeback"}]: dispatch 2024-05-20T22:13:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:28 smithi050 bash[28929]: audit 2024-05-20T22:13:27.843778+0000 mon.c (mon.2) 257 : audit 1 from='client.? v1:172.21.15.50:0/2971836940' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:28 smithi050 bash[28929]: audit 2024-05-20T22:13:27.844695+0000 mon.a (mon.0) 1804 : audit 1 from='client.26024 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi050-63936-32"}]: dispatch 2024-05-20T22:13:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:28 smithi050 bash[28929]: cluster 2024-05-20T22:13:28.080724+0000 mgr.y (mgr.14592) 294 : cluster 0 pgmap v330: 420 pgs: 420 active+clean; 584 KiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:13:29.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:13:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:13:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:13:30.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:29 smithi145 bash[23893]: cluster 2024-05-20T22:13:28.822853+0000 mon.a (mon.0) 1805 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:13:30.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:29 smithi145 bash[23893]: audit 2024-05-20T22:13:28.831084+0000 mon.a (mon.0) 1806 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-23", "mode": "writeback"}]': finished 2024-05-20T22:13:30.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:29 smithi145 bash[23893]: audit 2024-05-20T22:13:28.831244+0000 mon.a (mon.0) 1807 : audit 1 from='client.26024 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi050-63936-32"}]': finished 2024-05-20T22:13:30.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:29 smithi145 bash[23893]: cluster 2024-05-20T22:13:28.841420+0000 mon.a (mon.0) 1808 : cluster 0 osdmap e213: 8 total, 8 up, 8 in 2024-05-20T22:13:30.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:29 smithi145 bash[23893]: audit 2024-05-20T22:13:28.894179+0000 mon.a (mon.0) 1809 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi050-63936-33"}]: dispatch 2024-05-20T22:13:30.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:29 smithi145 bash[23893]: audit 2024-05-20T22:13:29.354831+0000 mon.a (mon.0) 1810 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi050-63936-33"}]: dispatch 2024-05-20T22:13:30.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:29 smithi145 bash[23893]: audit 2024-05-20T22:13:29.355590+0000 mon.a (mon.0) 1811 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi050-63936-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:29 smithi050 bash[21866]: cluster 2024-05-20T22:13:28.822853+0000 mon.a (mon.0) 1805 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:13:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:29 smithi050 bash[21866]: audit 2024-05-20T22:13:28.831084+0000 mon.a (mon.0) 1806 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-23", "mode": "writeback"}]': finished 2024-05-20T22:13:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:29 smithi050 bash[21866]: audit 2024-05-20T22:13:28.831244+0000 mon.a (mon.0) 1807 : audit 1 from='client.26024 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi050-63936-32"}]': finished 2024-05-20T22:13:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:29 smithi050 bash[21866]: cluster 2024-05-20T22:13:28.841420+0000 mon.a (mon.0) 1808 : cluster 0 osdmap e213: 8 total, 8 up, 8 in 2024-05-20T22:13:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:29 smithi050 bash[21866]: audit 2024-05-20T22:13:28.894179+0000 mon.a (mon.0) 1809 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi050-63936-33"}]: dispatch 2024-05-20T22:13:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:29 smithi050 bash[21866]: audit 2024-05-20T22:13:29.354831+0000 mon.a (mon.0) 1810 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi050-63936-33"}]: dispatch 2024-05-20T22:13:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:29 smithi050 bash[21866]: audit 2024-05-20T22:13:29.355590+0000 mon.a (mon.0) 1811 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi050-63936-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:29 smithi050 bash[28929]: cluster 2024-05-20T22:13:28.822853+0000 mon.a (mon.0) 1805 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:13:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:29 smithi050 bash[28929]: audit 2024-05-20T22:13:28.831084+0000 mon.a (mon.0) 1806 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-23", "mode": "writeback"}]': finished 2024-05-20T22:13:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:29 smithi050 bash[28929]: audit 2024-05-20T22:13:28.831244+0000 mon.a (mon.0) 1807 : audit 1 from='client.26024 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi050-63936-32"}]': finished 2024-05-20T22:13:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:29 smithi050 bash[28929]: cluster 2024-05-20T22:13:28.841420+0000 mon.a (mon.0) 1808 : cluster 0 osdmap e213: 8 total, 8 up, 8 in 2024-05-20T22:13:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:29 smithi050 bash[28929]: audit 2024-05-20T22:13:28.894179+0000 mon.a (mon.0) 1809 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi050-63936-33"}]: dispatch 2024-05-20T22:13:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:29 smithi050 bash[28929]: audit 2024-05-20T22:13:29.354831+0000 mon.a (mon.0) 1810 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi050-63936-33"}]: dispatch 2024-05-20T22:13:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:29 smithi050 bash[28929]: audit 2024-05-20T22:13:29.355590+0000 mon.a (mon.0) 1811 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi050-63936-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:31.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:30 smithi145 bash[23893]: audit 2024-05-20T22:13:29.844814+0000 mon.a (mon.0) 1812 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi050-63936-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:31.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:30 smithi145 bash[23893]: cluster 2024-05-20T22:13:29.852676+0000 mon.a (mon.0) 1813 : cluster 0 osdmap e214: 8 total, 8 up, 8 in 2024-05-20T22:13:31.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:30 smithi145 bash[23893]: audit 2024-05-20T22:13:29.859997+0000 mon.a (mon.0) 1814 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi050-63936-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi050-63936-33"}]: dispatch 2024-05-20T22:13:31.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:30 smithi145 bash[23893]: audit 2024-05-20T22:13:29.860293+0000 mon.c (mon.2) 258 : audit 1 from='client.? v1:172.21.15.50:0/3077766465' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:31.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:30 smithi145 bash[23893]: audit 2024-05-20T22:13:29.861806+0000 mon.a (mon.0) 1815 : audit 1 from='client.26045 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:31.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:30 smithi145 bash[23893]: audit 2024-05-20T22:13:29.920717+0000 mon.a (mon.0) 1816 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:13:31.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:30 smithi145 bash[23893]: cluster 2024-05-20T22:13:30.084294+0000 mgr.y (mgr.14592) 295 : cluster 0 pgmap v333: 420 pgs: 32 creating+peering, 388 active+clean; 584 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-05-20T22:13:31.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:30 smithi050 bash[21866]: audit 2024-05-20T22:13:29.844814+0000 mon.a (mon.0) 1812 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi050-63936-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:31.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:30 smithi050 bash[21866]: cluster 2024-05-20T22:13:29.852676+0000 mon.a (mon.0) 1813 : cluster 0 osdmap e214: 8 total, 8 up, 8 in 2024-05-20T22:13:31.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:30 smithi050 bash[21866]: audit 2024-05-20T22:13:29.859997+0000 mon.a (mon.0) 1814 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi050-63936-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi050-63936-33"}]: dispatch 2024-05-20T22:13:31.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:30 smithi050 bash[21866]: audit 2024-05-20T22:13:29.860293+0000 mon.c (mon.2) 258 : audit 1 from='client.? v1:172.21.15.50:0/3077766465' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:31.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:30 smithi050 bash[21866]: audit 2024-05-20T22:13:29.861806+0000 mon.a (mon.0) 1815 : audit 1 from='client.26045 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:31.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:30 smithi050 bash[21866]: audit 2024-05-20T22:13:29.920717+0000 mon.a (mon.0) 1816 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:13:31.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:30 smithi050 bash[21866]: cluster 2024-05-20T22:13:30.084294+0000 mgr.y (mgr.14592) 295 : cluster 0 pgmap v333: 420 pgs: 32 creating+peering, 388 active+clean; 584 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-05-20T22:13:31.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:30 smithi050 bash[28929]: audit 2024-05-20T22:13:29.844814+0000 mon.a (mon.0) 1812 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi050-63936-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:31.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:30 smithi050 bash[28929]: cluster 2024-05-20T22:13:29.852676+0000 mon.a (mon.0) 1813 : cluster 0 osdmap e214: 8 total, 8 up, 8 in 2024-05-20T22:13:31.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:30 smithi050 bash[28929]: audit 2024-05-20T22:13:29.859997+0000 mon.a (mon.0) 1814 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi050-63936-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi050-63936-33"}]: dispatch 2024-05-20T22:13:31.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:30 smithi050 bash[28929]: audit 2024-05-20T22:13:29.860293+0000 mon.c (mon.2) 258 : audit 1 from='client.? v1:172.21.15.50:0/3077766465' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:31.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:30 smithi050 bash[28929]: audit 2024-05-20T22:13:29.861806+0000 mon.a (mon.0) 1815 : audit 1 from='client.26045 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:31.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:30 smithi050 bash[28929]: audit 2024-05-20T22:13:29.920717+0000 mon.a (mon.0) 1816 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:13:31.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:30 smithi050 bash[28929]: cluster 2024-05-20T22:13:30.084294+0000 mgr.y (mgr.14592) 295 : cluster 0 pgmap v333: 420 pgs: 32 creating+peering, 388 active+clean; 584 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-05-20T22:13:32.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:31 smithi145 bash[23893]: cluster 2024-05-20T22:13:30.844812+0000 mon.a (mon.0) 1817 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:32.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:31 smithi145 bash[23893]: audit 2024-05-20T22:13:30.855507+0000 mon.a (mon.0) 1818 : audit 1 from='client.26045 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:32.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:31 smithi145 bash[23893]: audit 2024-05-20T22:13:30.855703+0000 mon.a (mon.0) 1819 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:13:32.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:31 smithi145 bash[23893]: cluster 2024-05-20T22:13:31.322537+0000 mon.a (mon.0) 1820 : cluster 0 osdmap e215: 8 total, 8 up, 8 in 2024-05-20T22:13:32.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:31 smithi145 bash[23893]: audit 2024-05-20T22:13:31.325892+0000 mon.a (mon.0) 1821 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-23"}]: dispatch 2024-05-20T22:13:32.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:31 smithi050 bash[21866]: cluster 2024-05-20T22:13:30.844812+0000 mon.a (mon.0) 1817 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:32.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:31 smithi050 bash[21866]: audit 2024-05-20T22:13:30.855507+0000 mon.a (mon.0) 1818 : audit 1 from='client.26045 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:32.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:31 smithi050 bash[21866]: audit 2024-05-20T22:13:30.855703+0000 mon.a (mon.0) 1819 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:13:32.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:31 smithi050 bash[21866]: cluster 2024-05-20T22:13:31.322537+0000 mon.a (mon.0) 1820 : cluster 0 osdmap e215: 8 total, 8 up, 8 in 2024-05-20T22:13:32.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:31 smithi050 bash[21866]: audit 2024-05-20T22:13:31.325892+0000 mon.a (mon.0) 1821 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-23"}]: dispatch 2024-05-20T22:13:32.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:31 smithi050 bash[28929]: cluster 2024-05-20T22:13:30.844812+0000 mon.a (mon.0) 1817 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:32.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:31 smithi050 bash[28929]: audit 2024-05-20T22:13:30.855507+0000 mon.a (mon.0) 1818 : audit 1 from='client.26045 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:32.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:31 smithi050 bash[28929]: audit 2024-05-20T22:13:30.855703+0000 mon.a (mon.0) 1819 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:13:32.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:31 smithi050 bash[28929]: cluster 2024-05-20T22:13:31.322537+0000 mon.a (mon.0) 1820 : cluster 0 osdmap e215: 8 total, 8 up, 8 in 2024-05-20T22:13:32.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:31 smithi050 bash[28929]: audit 2024-05-20T22:13:31.325892+0000 mon.a (mon.0) 1821 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-23"}]: dispatch 2024-05-20T22:13:33.351 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:33 smithi050 bash[21866]: cluster 2024-05-20T22:13:31.856837+0000 mon.a (mon.0) 1822 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:13:33.351 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:33 smithi050 bash[21866]: audit 2024-05-20T22:13:31.858986+0000 mon.a (mon.0) 1823 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi050-63936-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi050-63936-33"}]': finished 2024-05-20T22:13:33.351 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:33 smithi050 bash[21866]: audit 2024-05-20T22:13:31.859093+0000 mon.a (mon.0) 1824 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-23"}]': finished 2024-05-20T22:13:33.351 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:33 smithi050 bash[21866]: cluster 2024-05-20T22:13:31.863322+0000 mon.a (mon.0) 1825 : cluster 0 osdmap e216: 8 total, 8 up, 8 in 2024-05-20T22:13:33.352 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:33 smithi050 bash[21866]: audit 2024-05-20T22:13:31.893184+0000 mon.c (mon.2) 259 : audit 1 from='client.? v1:172.21.15.50:0/1021626509' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:33.352 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:33 smithi050 bash[21866]: audit 2024-05-20T22:13:31.894026+0000 mon.a (mon.0) 1826 : audit 1 from='client.26054 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:33.352 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:33 smithi050 bash[21866]: cluster 2024-05-20T22:13:32.085264+0000 mgr.y (mgr.14592) 296 : cluster 0 pgmap v336: 460 pgs: 40 unknown, 32 creating+peering, 388 active+clean; 584 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-05-20T22:13:33.352 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:33 smithi050 bash[21866]: audit 2024-05-20T22:13:32.862109+0000 mon.a (mon.0) 1827 : audit 1 from='client.26054 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:33.352 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:33 smithi050 bash[28929]: cluster 2024-05-20T22:13:31.856837+0000 mon.a (mon.0) 1822 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:13:33.352 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:33 smithi050 bash[28929]: audit 2024-05-20T22:13:31.858986+0000 mon.a (mon.0) 1823 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi050-63936-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi050-63936-33"}]': finished 2024-05-20T22:13:33.352 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:33 smithi050 bash[28929]: audit 2024-05-20T22:13:31.859093+0000 mon.a (mon.0) 1824 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-23"}]': finished 2024-05-20T22:13:33.352 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:33 smithi050 bash[28929]: cluster 2024-05-20T22:13:31.863322+0000 mon.a (mon.0) 1825 : cluster 0 osdmap e216: 8 total, 8 up, 8 in 2024-05-20T22:13:33.352 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:33 smithi050 bash[28929]: audit 2024-05-20T22:13:31.893184+0000 mon.c (mon.2) 259 : audit 1 from='client.? v1:172.21.15.50:0/1021626509' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:33.353 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:33 smithi050 bash[28929]: audit 2024-05-20T22:13:31.894026+0000 mon.a (mon.0) 1826 : audit 1 from='client.26054 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:33.353 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:33 smithi050 bash[28929]: cluster 2024-05-20T22:13:32.085264+0000 mgr.y (mgr.14592) 296 : cluster 0 pgmap v336: 460 pgs: 40 unknown, 32 creating+peering, 388 active+clean; 584 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-05-20T22:13:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:33 smithi145 bash[23893]: cluster 2024-05-20T22:13:31.856837+0000 mon.a (mon.0) 1822 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:13:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:33 smithi145 bash[23893]: audit 2024-05-20T22:13:31.858986+0000 mon.a (mon.0) 1823 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi050-63936-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi050-63936-33"}]': finished 2024-05-20T22:13:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:33 smithi145 bash[23893]: audit 2024-05-20T22:13:31.859093+0000 mon.a (mon.0) 1824 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-23"}]': finished 2024-05-20T22:13:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:33 smithi145 bash[23893]: cluster 2024-05-20T22:13:31.863322+0000 mon.a (mon.0) 1825 : cluster 0 osdmap e216: 8 total, 8 up, 8 in 2024-05-20T22:13:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:33 smithi145 bash[23893]: audit 2024-05-20T22:13:31.893184+0000 mon.c (mon.2) 259 : audit 1 from='client.? v1:172.21.15.50:0/1021626509' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:33 smithi145 bash[23893]: audit 2024-05-20T22:13:31.894026+0000 mon.a (mon.0) 1826 : audit 1 from='client.26054 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:33 smithi145 bash[23893]: cluster 2024-05-20T22:13:32.085264+0000 mgr.y (mgr.14592) 296 : cluster 0 pgmap v336: 460 pgs: 40 unknown, 32 creating+peering, 388 active+clean; 584 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-05-20T22:13:33.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:33 smithi145 bash[23893]: audit 2024-05-20T22:13:32.862109+0000 mon.a (mon.0) 1827 : audit 1 from='client.26054 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:33.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:33 smithi050 bash[28929]: audit 2024-05-20T22:13:32.862109+0000 mon.a (mon.0) 1827 : audit 1 from='client.26054 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:34.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:34 smithi145 bash[23893]: cluster 2024-05-20T22:13:32.872013+0000 mon.a (mon.0) 1828 : cluster 0 osdmap e217: 8 total, 8 up, 8 in 2024-05-20T22:13:34.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:34 smithi145 bash[23893]: cluster 2024-05-20T22:13:33.827396+0000 mon.a (mon.0) 1829 : cluster 0 osdmap e218: 8 total, 8 up, 8 in 2024-05-20T22:13:34.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:34 smithi145 bash[23893]: audit 2024-05-20T22:13:33.828623+0000 mon.a (mon.0) 1830 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:34.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:34 smithi145 bash[23893]: audit 2024-05-20T22:13:33.834182+0000 mon.a (mon.0) 1831 : audit 1 from='client.? v1:172.21.15.50:0/595529279' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:34.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:34 smithi145 bash[23893]: audit 2024-05-20T22:13:33.834489+0000 mon.a (mon.0) 1832 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi050-63936-33"}]: dispatch 2024-05-20T22:13:34.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:34 smithi050 bash[21866]: cluster 2024-05-20T22:13:32.872013+0000 mon.a (mon.0) 1828 : cluster 0 osdmap e217: 8 total, 8 up, 8 in 2024-05-20T22:13:34.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:34 smithi050 bash[21866]: cluster 2024-05-20T22:13:33.827396+0000 mon.a (mon.0) 1829 : cluster 0 osdmap e218: 8 total, 8 up, 8 in 2024-05-20T22:13:34.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:34 smithi050 bash[21866]: audit 2024-05-20T22:13:33.828623+0000 mon.a (mon.0) 1830 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:34.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:34 smithi050 bash[21866]: audit 2024-05-20T22:13:33.834182+0000 mon.a (mon.0) 1831 : audit 1 from='client.? v1:172.21.15.50:0/595529279' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:34.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:34 smithi050 bash[21866]: audit 2024-05-20T22:13:33.834489+0000 mon.a (mon.0) 1832 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi050-63936-33"}]: dispatch 2024-05-20T22:13:34.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:34 smithi050 bash[28929]: cluster 2024-05-20T22:13:32.872013+0000 mon.a (mon.0) 1828 : cluster 0 osdmap e217: 8 total, 8 up, 8 in 2024-05-20T22:13:34.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:34 smithi050 bash[28929]: cluster 2024-05-20T22:13:33.827396+0000 mon.a (mon.0) 1829 : cluster 0 osdmap e218: 8 total, 8 up, 8 in 2024-05-20T22:13:34.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:34 smithi050 bash[28929]: audit 2024-05-20T22:13:33.828623+0000 mon.a (mon.0) 1830 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:34.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:34 smithi050 bash[28929]: audit 2024-05-20T22:13:33.834182+0000 mon.a (mon.0) 1831 : audit 1 from='client.? v1:172.21.15.50:0/595529279' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:34.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:34 smithi050 bash[28929]: audit 2024-05-20T22:13:33.834489+0000 mon.a (mon.0) 1832 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi050-63936-33"}]: dispatch 2024-05-20T22:13:35.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:35 smithi145 bash[23893]: cluster 2024-05-20T22:13:34.086521+0000 mgr.y (mgr.14592) 297 : cluster 0 pgmap v339: 484 pgs: 96 unknown, 32 creating+peering, 356 active+clean; 584 KiB data, 572 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:35.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:35 smithi145 bash[23893]: audit 2024-05-20T22:13:34.827142+0000 mon.a (mon.0) 1833 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:35.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:35 smithi145 bash[23893]: audit 2024-05-20T22:13:34.827315+0000 mon.a (mon.0) 1834 : audit 1 from='client.? v1:172.21.15.50:0/595529279' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:35.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:35 smithi145 bash[23893]: audit 2024-05-20T22:13:34.827478+0000 mon.a (mon.0) 1835 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi050-63936-33"}]': finished 2024-05-20T22:13:35.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:35 smithi145 bash[23893]: cluster 2024-05-20T22:13:34.836111+0000 mon.a (mon.0) 1836 : cluster 0 osdmap e219: 8 total, 8 up, 8 in 2024-05-20T22:13:35.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:35 smithi145 bash[23893]: audit 2024-05-20T22:13:34.838839+0000 mon.a (mon.0) 1837 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi050-63936-33"}]: dispatch 2024-05-20T22:13:35.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:35 smithi050 bash[21866]: cluster 2024-05-20T22:13:34.086521+0000 mgr.y (mgr.14592) 297 : cluster 0 pgmap v339: 484 pgs: 96 unknown, 32 creating+peering, 356 active+clean; 584 KiB data, 572 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:35.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:35 smithi050 bash[21866]: audit 2024-05-20T22:13:34.827142+0000 mon.a (mon.0) 1833 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:35.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:35 smithi050 bash[21866]: audit 2024-05-20T22:13:34.827315+0000 mon.a (mon.0) 1834 : audit 1 from='client.? v1:172.21.15.50:0/595529279' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:35.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:35 smithi050 bash[21866]: audit 2024-05-20T22:13:34.827478+0000 mon.a (mon.0) 1835 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi050-63936-33"}]': finished 2024-05-20T22:13:35.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:35 smithi050 bash[21866]: cluster 2024-05-20T22:13:34.836111+0000 mon.a (mon.0) 1836 : cluster 0 osdmap e219: 8 total, 8 up, 8 in 2024-05-20T22:13:35.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:35 smithi050 bash[21866]: audit 2024-05-20T22:13:34.838839+0000 mon.a (mon.0) 1837 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi050-63936-33"}]: dispatch 2024-05-20T22:13:35.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:35 smithi050 bash[28929]: cluster 2024-05-20T22:13:34.086521+0000 mgr.y (mgr.14592) 297 : cluster 0 pgmap v339: 484 pgs: 96 unknown, 32 creating+peering, 356 active+clean; 584 KiB data, 572 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:35.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:35 smithi050 bash[28929]: audit 2024-05-20T22:13:34.827142+0000 mon.a (mon.0) 1833 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:35.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:35 smithi050 bash[28929]: audit 2024-05-20T22:13:34.827315+0000 mon.a (mon.0) 1834 : audit 1 from='client.? v1:172.21.15.50:0/595529279' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:35.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:35 smithi050 bash[28929]: audit 2024-05-20T22:13:34.827478+0000 mon.a (mon.0) 1835 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi050-63936-33"}]': finished 2024-05-20T22:13:35.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:35 smithi050 bash[28929]: cluster 2024-05-20T22:13:34.836111+0000 mon.a (mon.0) 1836 : cluster 0 osdmap e219: 8 total, 8 up, 8 in 2024-05-20T22:13:35.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:35 smithi050 bash[28929]: audit 2024-05-20T22:13:34.838839+0000 mon.a (mon.0) 1837 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi050-63936-33"}]: dispatch 2024-05-20T22:13:37.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:36 smithi145 bash[23893]: audit 2024-05-20T22:13:35.832158+0000 mon.a (mon.0) 1838 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi050-63936-33"}]': finished 2024-05-20T22:13:37.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:36 smithi145 bash[23893]: cluster 2024-05-20T22:13:35.841906+0000 mon.a (mon.0) 1839 : cluster 0 osdmap e220: 8 total, 8 up, 8 in 2024-05-20T22:13:37.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:36 smithi145 bash[23893]: audit 2024-05-20T22:13:35.843844+0000 mon.b (mon.1) 151 : audit 1 from='client.? v1:172.21.15.50:0/648412979' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:37.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:36 smithi145 bash[23893]: audit 2024-05-20T22:13:35.855746+0000 mon.a (mon.0) 1840 : audit 1 from='client.25906 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:37.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:36 smithi145 bash[23893]: audit 2024-05-20T22:13:35.873836+0000 mon.a (mon.0) 1841 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:37.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:36 smithi145 bash[23893]: audit 2024-05-20T22:13:35.876312+0000 mon.c (mon.2) 260 : audit 1 from='client.? v1:172.21.15.50:0/3346139972' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:37.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:36 smithi145 bash[23893]: audit 2024-05-20T22:13:35.876643+0000 mon.a (mon.0) 1842 : audit 1 from='client.26069 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:37.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:36 smithi145 bash[23893]: audit 2024-05-20T22:13:35.878179+0000 mon.c (mon.2) 261 : audit 1 from='client.? v1:172.21.15.50:0/3346139972' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:37.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:36 smithi145 bash[23893]: audit 2024-05-20T22:13:35.878456+0000 mon.a (mon.0) 1843 : audit 1 from='client.26069 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:37.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:36 smithi145 bash[23893]: audit 2024-05-20T22:13:35.878937+0000 mon.c (mon.2) 262 : audit 1 from='client.? v1:172.21.15.50:0/3346139972' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi050-63936-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:37.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:36 smithi145 bash[23893]: audit 2024-05-20T22:13:35.879199+0000 mon.a (mon.0) 1844 : audit 1 from='client.26069 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi050-63936-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:37.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:36 smithi145 bash[23893]: cluster 2024-05-20T22:13:36.087654+0000 mgr.y (mgr.14592) 298 : cluster 0 pgmap v342: 516 pgs: 32 unknown, 484 active+clean; 584 KiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:37.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:36 smithi145 bash[23893]: audit 2024-05-20T22:13:36.199218+0000 mon.a (mon.0) 1845 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:13:37.145 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:36 smithi145 bash[23893]: audit 2024-05-20T22:13:36.201952+0000 mon.a (mon.0) 1846 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:13:37.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:36 smithi050 bash[21866]: audit 2024-05-20T22:13:35.832158+0000 mon.a (mon.0) 1838 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi050-63936-33"}]': finished 2024-05-20T22:13:37.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:36 smithi050 bash[21866]: cluster 2024-05-20T22:13:35.841906+0000 mon.a (mon.0) 1839 : cluster 0 osdmap e220: 8 total, 8 up, 8 in 2024-05-20T22:13:37.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:36 smithi050 bash[21866]: audit 2024-05-20T22:13:35.843844+0000 mon.b (mon.1) 151 : audit 1 from='client.? v1:172.21.15.50:0/648412979' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:37.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:36 smithi050 bash[21866]: audit 2024-05-20T22:13:35.855746+0000 mon.a (mon.0) 1840 : audit 1 from='client.25906 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:37.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:36 smithi050 bash[21866]: audit 2024-05-20T22:13:35.873836+0000 mon.a (mon.0) 1841 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:37.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:36 smithi050 bash[21866]: audit 2024-05-20T22:13:35.876312+0000 mon.c (mon.2) 260 : audit 1 from='client.? v1:172.21.15.50:0/3346139972' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:37.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:36 smithi050 bash[21866]: audit 2024-05-20T22:13:35.876643+0000 mon.a (mon.0) 1842 : audit 1 from='client.26069 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:37.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:36 smithi050 bash[21866]: audit 2024-05-20T22:13:35.878179+0000 mon.c (mon.2) 261 : audit 1 from='client.? v1:172.21.15.50:0/3346139972' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:37.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:36 smithi050 bash[21866]: audit 2024-05-20T22:13:35.878456+0000 mon.a (mon.0) 1843 : audit 1 from='client.26069 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:37.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:36 smithi050 bash[21866]: audit 2024-05-20T22:13:35.878937+0000 mon.c (mon.2) 262 : audit 1 from='client.? v1:172.21.15.50:0/3346139972' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi050-63936-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:37.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:36 smithi050 bash[21866]: audit 2024-05-20T22:13:35.879199+0000 mon.a (mon.0) 1844 : audit 1 from='client.26069 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi050-63936-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:37.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:36 smithi050 bash[21866]: cluster 2024-05-20T22:13:36.087654+0000 mgr.y (mgr.14592) 298 : cluster 0 pgmap v342: 516 pgs: 32 unknown, 484 active+clean; 584 KiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:37.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:36 smithi050 bash[21866]: audit 2024-05-20T22:13:36.199218+0000 mon.a (mon.0) 1845 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:13:37.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:36 smithi050 bash[21866]: audit 2024-05-20T22:13:36.201952+0000 mon.a (mon.0) 1846 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:13:37.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:36 smithi050 bash[28929]: audit 2024-05-20T22:13:35.832158+0000 mon.a (mon.0) 1838 : audit 1 from='client.? v1:172.21.15.50:0/198792562' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi050-63936-33"}]': finished 2024-05-20T22:13:37.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:36 smithi050 bash[28929]: cluster 2024-05-20T22:13:35.841906+0000 mon.a (mon.0) 1839 : cluster 0 osdmap e220: 8 total, 8 up, 8 in 2024-05-20T22:13:37.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:36 smithi050 bash[28929]: audit 2024-05-20T22:13:35.843844+0000 mon.b (mon.1) 151 : audit 1 from='client.? v1:172.21.15.50:0/648412979' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:37.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:36 smithi050 bash[28929]: audit 2024-05-20T22:13:35.855746+0000 mon.a (mon.0) 1840 : audit 1 from='client.25906 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:37.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:36 smithi050 bash[28929]: audit 2024-05-20T22:13:35.873836+0000 mon.a (mon.0) 1841 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:37.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:36 smithi050 bash[28929]: audit 2024-05-20T22:13:35.876312+0000 mon.c (mon.2) 260 : audit 1 from='client.? v1:172.21.15.50:0/3346139972' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:37.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:36 smithi050 bash[28929]: audit 2024-05-20T22:13:35.876643+0000 mon.a (mon.0) 1842 : audit 1 from='client.26069 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:37.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:36 smithi050 bash[28929]: audit 2024-05-20T22:13:35.878179+0000 mon.c (mon.2) 261 : audit 1 from='client.? v1:172.21.15.50:0/3346139972' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:37.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:36 smithi050 bash[28929]: audit 2024-05-20T22:13:35.878456+0000 mon.a (mon.0) 1843 : audit 1 from='client.26069 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:37.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:36 smithi050 bash[28929]: audit 2024-05-20T22:13:35.878937+0000 mon.c (mon.2) 262 : audit 1 from='client.? v1:172.21.15.50:0/3346139972' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi050-63936-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:37.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:36 smithi050 bash[28929]: audit 2024-05-20T22:13:35.879199+0000 mon.a (mon.0) 1844 : audit 1 from='client.26069 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi050-63936-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:37.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:36 smithi050 bash[28929]: cluster 2024-05-20T22:13:36.087654+0000 mgr.y (mgr.14592) 298 : cluster 0 pgmap v342: 516 pgs: 32 unknown, 484 active+clean; 584 KiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:37.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:36 smithi050 bash[28929]: audit 2024-05-20T22:13:36.199218+0000 mon.a (mon.0) 1845 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:13:37.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:36 smithi050 bash[28929]: audit 2024-05-20T22:13:36.201952+0000 mon.a (mon.0) 1846 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:13:38.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:13:37 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:13:38.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:37 smithi145 bash[23893]: cluster 2024-05-20T22:13:36.832098+0000 mon.a (mon.0) 1847 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:38.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:37 smithi145 bash[23893]: audit 2024-05-20T22:13:36.842267+0000 mon.a (mon.0) 1848 : audit 1 from='client.25906 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:38.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:37 smithi145 bash[23893]: audit 2024-05-20T22:13:36.842430+0000 mon.a (mon.0) 1849 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-25", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:38.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:37 smithi145 bash[23893]: audit 2024-05-20T22:13:36.842588+0000 mon.a (mon.0) 1850 : audit 1 from='client.26069 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi050-63936-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:38.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:37 smithi145 bash[23893]: cluster 2024-05-20T22:13:36.853239+0000 mon.a (mon.0) 1851 : cluster 0 osdmap e221: 8 total, 8 up, 8 in 2024-05-20T22:13:38.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:37 smithi145 bash[23893]: audit 2024-05-20T22:13:36.854299+0000 mon.c (mon.2) 263 : audit 1 from='client.? v1:172.21.15.50:0/3346139972' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi050-63936-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:38.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:37 smithi145 bash[23893]: audit 2024-05-20T22:13:36.857070+0000 mon.a (mon.0) 1852 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-25"}]: dispatch 2024-05-20T22:13:38.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:37 smithi145 bash[23893]: audit 2024-05-20T22:13:36.857584+0000 mon.a (mon.0) 1853 : audit 1 from='client.26069 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi050-63936-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:38.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:37 smithi050 bash[21866]: cluster 2024-05-20T22:13:36.832098+0000 mon.a (mon.0) 1847 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:38.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:37 smithi050 bash[21866]: audit 2024-05-20T22:13:36.842267+0000 mon.a (mon.0) 1848 : audit 1 from='client.25906 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:38.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:37 smithi050 bash[21866]: audit 2024-05-20T22:13:36.842430+0000 mon.a (mon.0) 1849 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-25", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:38.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:37 smithi050 bash[21866]: audit 2024-05-20T22:13:36.842588+0000 mon.a (mon.0) 1850 : audit 1 from='client.26069 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi050-63936-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:38.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:37 smithi050 bash[21866]: cluster 2024-05-20T22:13:36.853239+0000 mon.a (mon.0) 1851 : cluster 0 osdmap e221: 8 total, 8 up, 8 in 2024-05-20T22:13:38.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:37 smithi050 bash[21866]: audit 2024-05-20T22:13:36.854299+0000 mon.c (mon.2) 263 : audit 1 from='client.? v1:172.21.15.50:0/3346139972' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi050-63936-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:38.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:37 smithi050 bash[21866]: audit 2024-05-20T22:13:36.857070+0000 mon.a (mon.0) 1852 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-25"}]: dispatch 2024-05-20T22:13:38.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:37 smithi050 bash[21866]: audit 2024-05-20T22:13:36.857584+0000 mon.a (mon.0) 1853 : audit 1 from='client.26069 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi050-63936-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:38.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:37 smithi050 bash[28929]: cluster 2024-05-20T22:13:36.832098+0000 mon.a (mon.0) 1847 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:38.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:37 smithi050 bash[28929]: audit 2024-05-20T22:13:36.842267+0000 mon.a (mon.0) 1848 : audit 1 from='client.25906 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:38.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:37 smithi050 bash[28929]: audit 2024-05-20T22:13:36.842430+0000 mon.a (mon.0) 1849 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-25", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:38.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:37 smithi050 bash[28929]: audit 2024-05-20T22:13:36.842588+0000 mon.a (mon.0) 1850 : audit 1 from='client.26069 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi050-63936-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:38.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:37 smithi050 bash[28929]: cluster 2024-05-20T22:13:36.853239+0000 mon.a (mon.0) 1851 : cluster 0 osdmap e221: 8 total, 8 up, 8 in 2024-05-20T22:13:38.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:37 smithi050 bash[28929]: audit 2024-05-20T22:13:36.854299+0000 mon.c (mon.2) 263 : audit 1 from='client.? v1:172.21.15.50:0/3346139972' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi050-63936-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:38.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:37 smithi050 bash[28929]: audit 2024-05-20T22:13:36.857070+0000 mon.a (mon.0) 1852 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-25"}]: dispatch 2024-05-20T22:13:38.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:37 smithi050 bash[28929]: audit 2024-05-20T22:13:36.857584+0000 mon.a (mon.0) 1853 : audit 1 from='client.26069 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi050-63936-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:39.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:38 smithi145 bash[23893]: audit 2024-05-20T22:13:37.795331+0000 mgr.y (mgr.14592) 299 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:13:39.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:38 smithi145 bash[23893]: audit 2024-05-20T22:13:37.856723+0000 mon.a (mon.0) 1854 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-25"}]': finished 2024-05-20T22:13:39.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:38 smithi145 bash[23893]: cluster 2024-05-20T22:13:38.088731+0000 mgr.y (mgr.14592) 300 : cluster 0 pgmap v345: 548 pgs: 64 unknown, 484 active+clean; 584 KiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:13:39.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:38 smithi145 bash[23893]: cluster 2024-05-20T22:13:38.325961+0000 mon.a (mon.0) 1855 : cluster 0 osdmap e222: 8 total, 8 up, 8 in 2024-05-20T22:13:39.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:38 smithi145 bash[23893]: audit 2024-05-20T22:13:38.327418+0000 mon.a (mon.0) 1856 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-25", "mode": "writeback"}]: dispatch 2024-05-20T22:13:39.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:38 smithi145 bash[23893]: audit 2024-05-20T22:13:38.327548+0000 mon.c (mon.2) 264 : audit 1 from='client.? v1:172.21.15.50:0/1822128640' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:39.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:38 smithi145 bash[23893]: audit 2024-05-20T22:13:38.329496+0000 mon.a (mon.0) 1857 : audit 1 from='client.26075 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:39.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:38 smithi050 bash[21866]: audit 2024-05-20T22:13:37.795331+0000 mgr.y (mgr.14592) 299 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:13:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:38 smithi050 bash[21866]: audit 2024-05-20T22:13:37.856723+0000 mon.a (mon.0) 1854 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-25"}]': finished 2024-05-20T22:13:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:38 smithi050 bash[21866]: cluster 2024-05-20T22:13:38.088731+0000 mgr.y (mgr.14592) 300 : cluster 0 pgmap v345: 548 pgs: 64 unknown, 484 active+clean; 584 KiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:13:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:38 smithi050 bash[21866]: cluster 2024-05-20T22:13:38.325961+0000 mon.a (mon.0) 1855 : cluster 0 osdmap e222: 8 total, 8 up, 8 in 2024-05-20T22:13:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:38 smithi050 bash[21866]: audit 2024-05-20T22:13:38.327418+0000 mon.a (mon.0) 1856 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-25", "mode": "writeback"}]: dispatch 2024-05-20T22:13:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:38 smithi050 bash[21866]: audit 2024-05-20T22:13:38.327548+0000 mon.c (mon.2) 264 : audit 1 from='client.? v1:172.21.15.50:0/1822128640' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:38 smithi050 bash[21866]: audit 2024-05-20T22:13:38.329496+0000 mon.a (mon.0) 1857 : audit 1 from='client.26075 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:39.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:38 smithi050 bash[28929]: audit 2024-05-20T22:13:37.795331+0000 mgr.y (mgr.14592) 299 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:13:39.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:38 smithi050 bash[28929]: audit 2024-05-20T22:13:37.856723+0000 mon.a (mon.0) 1854 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-25"}]': finished 2024-05-20T22:13:39.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:38 smithi050 bash[28929]: cluster 2024-05-20T22:13:38.088731+0000 mgr.y (mgr.14592) 300 : cluster 0 pgmap v345: 548 pgs: 64 unknown, 484 active+clean; 584 KiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:13:39.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:38 smithi050 bash[28929]: cluster 2024-05-20T22:13:38.325961+0000 mon.a (mon.0) 1855 : cluster 0 osdmap e222: 8 total, 8 up, 8 in 2024-05-20T22:13:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:38 smithi050 bash[28929]: audit 2024-05-20T22:13:38.327418+0000 mon.a (mon.0) 1856 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-25", "mode": "writeback"}]: dispatch 2024-05-20T22:13:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:38 smithi050 bash[28929]: audit 2024-05-20T22:13:38.327548+0000 mon.c (mon.2) 264 : audit 1 from='client.? v1:172.21.15.50:0/1822128640' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:38 smithi050 bash[28929]: audit 2024-05-20T22:13:38.329496+0000 mon.a (mon.0) 1857 : audit 1 from='client.26075 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:39.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:13:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:13:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:13:40.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:39 smithi145 bash[23893]: cluster 2024-05-20T22:13:38.857745+0000 mon.a (mon.0) 1858 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:13:40.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:39 smithi145 bash[23893]: audit 2024-05-20T22:13:38.860554+0000 mon.a (mon.0) 1859 : audit 1 from='client.26069 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi050-63936-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi050-63936-34"}]': finished 2024-05-20T22:13:40.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:39 smithi145 bash[23893]: audit 2024-05-20T22:13:38.860815+0000 mon.a (mon.0) 1860 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-25", "mode": "writeback"}]': finished 2024-05-20T22:13:40.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:39 smithi145 bash[23893]: audit 2024-05-20T22:13:38.861002+0000 mon.a (mon.0) 1861 : audit 1 from='client.26075 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:40.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:39 smithi145 bash[23893]: cluster 2024-05-20T22:13:38.871047+0000 mon.a (mon.0) 1862 : cluster 0 osdmap e223: 8 total, 8 up, 8 in 2024-05-20T22:13:40.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:39 smithi145 bash[23893]: audit 2024-05-20T22:13:38.959957+0000 mon.a (mon.0) 1863 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:13:40.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:39 smithi145 bash[23893]: audit 2024-05-20T22:13:39.863502+0000 mon.a (mon.0) 1864 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:13:40.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:39 smithi145 bash[23893]: cluster 2024-05-20T22:13:39.870696+0000 mon.a (mon.0) 1865 : cluster 0 osdmap e224: 8 total, 8 up, 8 in 2024-05-20T22:13:40.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:39 smithi145 bash[23893]: audit 2024-05-20T22:13:39.871363+0000 mon.a (mon.0) 1866 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-25"}]: dispatch 2024-05-20T22:13:40.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:39 smithi050 bash[21866]: cluster 2024-05-20T22:13:38.857745+0000 mon.a (mon.0) 1858 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:13:40.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:39 smithi050 bash[21866]: audit 2024-05-20T22:13:38.860554+0000 mon.a (mon.0) 1859 : audit 1 from='client.26069 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi050-63936-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi050-63936-34"}]': finished 2024-05-20T22:13:40.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:39 smithi050 bash[21866]: audit 2024-05-20T22:13:38.860815+0000 mon.a (mon.0) 1860 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-25", "mode": "writeback"}]': finished 2024-05-20T22:13:40.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:39 smithi050 bash[21866]: audit 2024-05-20T22:13:38.861002+0000 mon.a (mon.0) 1861 : audit 1 from='client.26075 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:40.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:39 smithi050 bash[21866]: cluster 2024-05-20T22:13:38.871047+0000 mon.a (mon.0) 1862 : cluster 0 osdmap e223: 8 total, 8 up, 8 in 2024-05-20T22:13:40.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:39 smithi050 bash[21866]: audit 2024-05-20T22:13:38.959957+0000 mon.a (mon.0) 1863 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:13:40.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:39 smithi050 bash[21866]: audit 2024-05-20T22:13:39.863502+0000 mon.a (mon.0) 1864 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:13:40.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:39 smithi050 bash[21866]: cluster 2024-05-20T22:13:39.870696+0000 mon.a (mon.0) 1865 : cluster 0 osdmap e224: 8 total, 8 up, 8 in 2024-05-20T22:13:40.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:39 smithi050 bash[21866]: audit 2024-05-20T22:13:39.871363+0000 mon.a (mon.0) 1866 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-25"}]: dispatch 2024-05-20T22:13:40.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:39 smithi050 bash[28929]: cluster 2024-05-20T22:13:38.857745+0000 mon.a (mon.0) 1858 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:13:40.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:39 smithi050 bash[28929]: audit 2024-05-20T22:13:38.860554+0000 mon.a (mon.0) 1859 : audit 1 from='client.26069 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi050-63936-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi050-63936-34"}]': finished 2024-05-20T22:13:40.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:39 smithi050 bash[28929]: audit 2024-05-20T22:13:38.860815+0000 mon.a (mon.0) 1860 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-25", "mode": "writeback"}]': finished 2024-05-20T22:13:40.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:39 smithi050 bash[28929]: audit 2024-05-20T22:13:38.861002+0000 mon.a (mon.0) 1861 : audit 1 from='client.26075 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi050-63944-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:40.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:39 smithi050 bash[28929]: cluster 2024-05-20T22:13:38.871047+0000 mon.a (mon.0) 1862 : cluster 0 osdmap e223: 8 total, 8 up, 8 in 2024-05-20T22:13:40.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:39 smithi050 bash[28929]: audit 2024-05-20T22:13:38.959957+0000 mon.a (mon.0) 1863 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:13:40.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:39 smithi050 bash[28929]: audit 2024-05-20T22:13:39.863502+0000 mon.a (mon.0) 1864 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:13:40.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:39 smithi050 bash[28929]: cluster 2024-05-20T22:13:39.870696+0000 mon.a (mon.0) 1865 : cluster 0 osdmap e224: 8 total, 8 up, 8 in 2024-05-20T22:13:40.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:39 smithi050 bash[28929]: audit 2024-05-20T22:13:39.871363+0000 mon.a (mon.0) 1866 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-25"}]: dispatch 2024-05-20T22:13:41.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:40 smithi050 bash[21866]: cluster 2024-05-20T22:13:40.093038+0000 mgr.y (mgr.14592) 301 : cluster 0 pgmap v348: 524 pgs: 1 creating+activating, 523 active+clean; 584 KiB data, 549 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:13:41.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:40 smithi050 bash[21866]: cluster 2024-05-20T22:13:40.863957+0000 mon.a (mon.0) 1867 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:13:41.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:40 smithi050 bash[21866]: audit 2024-05-20T22:13:40.866289+0000 mon.a (mon.0) 1868 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-25"}]': finished 2024-05-20T22:13:41.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:40 smithi050 bash[21866]: cluster 2024-05-20T22:13:40.874768+0000 mon.a (mon.0) 1869 : cluster 0 osdmap e225: 8 total, 8 up, 8 in 2024-05-20T22:13:41.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:40 smithi050 bash[21866]: audit 2024-05-20T22:13:40.884262+0000 mon.c (mon.2) 265 : audit 1 from='client.? v1:172.21.15.50:0/3346139972' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:41.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:40 smithi050 bash[21866]: audit 2024-05-20T22:13:40.884936+0000 mon.a (mon.0) 1870 : audit 1 from='client.26069 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:41.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:40 smithi050 bash[28929]: cluster 2024-05-20T22:13:40.093038+0000 mgr.y (mgr.14592) 301 : cluster 0 pgmap v348: 524 pgs: 1 creating+activating, 523 active+clean; 584 KiB data, 549 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:13:41.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:40 smithi050 bash[28929]: cluster 2024-05-20T22:13:40.863957+0000 mon.a (mon.0) 1867 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:13:41.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:40 smithi050 bash[28929]: audit 2024-05-20T22:13:40.866289+0000 mon.a (mon.0) 1868 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-25"}]': finished 2024-05-20T22:13:41.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:40 smithi050 bash[28929]: cluster 2024-05-20T22:13:40.874768+0000 mon.a (mon.0) 1869 : cluster 0 osdmap e225: 8 total, 8 up, 8 in 2024-05-20T22:13:41.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:40 smithi050 bash[28929]: audit 2024-05-20T22:13:40.884262+0000 mon.c (mon.2) 265 : audit 1 from='client.? v1:172.21.15.50:0/3346139972' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:41.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:40 smithi050 bash[28929]: audit 2024-05-20T22:13:40.884936+0000 mon.a (mon.0) 1870 : audit 1 from='client.26069 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:41.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:40 smithi145 bash[23893]: cluster 2024-05-20T22:13:40.093038+0000 mgr.y (mgr.14592) 301 : cluster 0 pgmap v348: 524 pgs: 1 creating+activating, 523 active+clean; 584 KiB data, 549 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:13:41.651 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:40 smithi145 bash[23893]: cluster 2024-05-20T22:13:40.863957+0000 mon.a (mon.0) 1867 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:13:41.651 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:40 smithi145 bash[23893]: audit 2024-05-20T22:13:40.866289+0000 mon.a (mon.0) 1868 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-25"}]': finished 2024-05-20T22:13:41.651 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:40 smithi145 bash[23893]: cluster 2024-05-20T22:13:40.874768+0000 mon.a (mon.0) 1869 : cluster 0 osdmap e225: 8 total, 8 up, 8 in 2024-05-20T22:13:41.651 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:40 smithi145 bash[23893]: audit 2024-05-20T22:13:40.884262+0000 mon.c (mon.2) 265 : audit 1 from='client.? v1:172.21.15.50:0/3346139972' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:41.652 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:40 smithi145 bash[23893]: audit 2024-05-20T22:13:40.884936+0000 mon.a (mon.0) 1870 : audit 1 from='client.26069 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:43.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:42 smithi145 bash[23893]: audit 2024-05-20T22:13:41.869012+0000 mon.a (mon.0) 1871 : audit 1 from='client.26069 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi050-63936-34"}]': finished 2024-05-20T22:13:43.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:42 smithi145 bash[23893]: cluster 2024-05-20T22:13:41.876662+0000 mon.a (mon.0) 1872 : cluster 0 osdmap e226: 8 total, 8 up, 8 in 2024-05-20T22:13:43.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:42 smithi145 bash[23893]: audit 2024-05-20T22:13:41.889985+0000 mon.c (mon.2) 266 : audit 1 from='client.? v1:172.21.15.50:0/3346139972' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:43.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:42 smithi145 bash[23893]: cluster 2024-05-20T22:13:42.093982+0000 mgr.y (mgr.14592) 302 : cluster 0 pgmap v351: 420 pgs: 420 active+clean; 584 KiB data, 549 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:13:43.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:42 smithi145 bash[23893]: audit 2024-05-20T22:13:42.348427+0000 mon.a (mon.0) 1873 : audit 1 from='client.26069 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:43.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:42 smithi050 bash[28929]: audit 2024-05-20T22:13:41.869012+0000 mon.a (mon.0) 1871 : audit 1 from='client.26069 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi050-63936-34"}]': finished 2024-05-20T22:13:43.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:42 smithi050 bash[28929]: cluster 2024-05-20T22:13:41.876662+0000 mon.a (mon.0) 1872 : cluster 0 osdmap e226: 8 total, 8 up, 8 in 2024-05-20T22:13:43.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:42 smithi050 bash[28929]: audit 2024-05-20T22:13:41.889985+0000 mon.c (mon.2) 266 : audit 1 from='client.? v1:172.21.15.50:0/3346139972' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:43.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:42 smithi050 bash[28929]: cluster 2024-05-20T22:13:42.093982+0000 mgr.y (mgr.14592) 302 : cluster 0 pgmap v351: 420 pgs: 420 active+clean; 584 KiB data, 549 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:13:43.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:42 smithi050 bash[28929]: audit 2024-05-20T22:13:42.348427+0000 mon.a (mon.0) 1873 : audit 1 from='client.26069 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:43.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:42 smithi050 bash[21866]: audit 2024-05-20T22:13:41.869012+0000 mon.a (mon.0) 1871 : audit 1 from='client.26069 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi050-63936-34"}]': finished 2024-05-20T22:13:43.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:42 smithi050 bash[21866]: cluster 2024-05-20T22:13:41.876662+0000 mon.a (mon.0) 1872 : cluster 0 osdmap e226: 8 total, 8 up, 8 in 2024-05-20T22:13:43.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:42 smithi050 bash[21866]: audit 2024-05-20T22:13:41.889985+0000 mon.c (mon.2) 266 : audit 1 from='client.? v1:172.21.15.50:0/3346139972' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:43.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:42 smithi050 bash[21866]: cluster 2024-05-20T22:13:42.093982+0000 mgr.y (mgr.14592) 302 : cluster 0 pgmap v351: 420 pgs: 420 active+clean; 584 KiB data, 549 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:13:43.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:42 smithi050 bash[21866]: audit 2024-05-20T22:13:42.348427+0000 mon.a (mon.0) 1873 : audit 1 from='client.26069 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi050-63936-34"}]: dispatch 2024-05-20T22:13:44.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:43 smithi050 bash[21866]: cluster 2024-05-20T22:13:42.869080+0000 mon.a (mon.0) 1874 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:44.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:43 smithi050 bash[21866]: audit 2024-05-20T22:13:42.882201+0000 mon.a (mon.0) 1875 : audit 1 from='client.26069 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi050-63936-34"}]': finished 2024-05-20T22:13:44.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:43 smithi050 bash[21866]: cluster 2024-05-20T22:13:42.892658+0000 mon.a (mon.0) 1876 : cluster 0 osdmap e227: 8 total, 8 up, 8 in 2024-05-20T22:13:44.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:43 smithi050 bash[21866]: audit 2024-05-20T22:13:42.899145+0000 mon.a (mon.0) 1877 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:44.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:43 smithi050 bash[21866]: audit 2024-05-20T22:13:42.913102+0000 mon.a (mon.0) 1878 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:13:44.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:43 smithi050 bash[21866]: audit 2024-05-20T22:13:42.941056+0000 mon.c (mon.2) 267 : audit 1 from='client.? v1:172.21.15.50:0/2311346786' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:44.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:43 smithi050 bash[21866]: audit 2024-05-20T22:13:42.941717+0000 mon.a (mon.0) 1879 : audit 1 from='client.26081 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:44.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:43 smithi050 bash[21866]: audit 2024-05-20T22:13:42.942770+0000 mon.c (mon.2) 268 : audit 1 from='client.? v1:172.21.15.50:0/2311346786' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:44.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:43 smithi050 bash[21866]: audit 2024-05-20T22:13:42.943094+0000 mon.a (mon.0) 1880 : audit 1 from='client.26081 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:44.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:43 smithi050 bash[21866]: audit 2024-05-20T22:13:42.943548+0000 mon.c (mon.2) 269 : audit 1 from='client.? v1:172.21.15.50:0/2311346786' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi050-63936-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:44.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:43 smithi050 bash[21866]: audit 2024-05-20T22:13:42.943816+0000 mon.a (mon.0) 1881 : audit 1 from='client.26081 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi050-63936-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:44.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:43 smithi050 bash[21866]: audit 2024-05-20T22:13:43.581821+0000 mon.a (mon.0) 1882 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:13:44.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:43 smithi050 bash[21866]: audit 2024-05-20T22:13:43.583424+0000 mon.a (mon.0) 1883 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:13:44.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:43 smithi050 bash[21866]: audit 2024-05-20T22:13:43.592248+0000 mon.a (mon.0) 1884 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:13:44.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:43 smithi050 bash[28929]: cluster 2024-05-20T22:13:42.869080+0000 mon.a (mon.0) 1874 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:44.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:43 smithi050 bash[28929]: audit 2024-05-20T22:13:42.882201+0000 mon.a (mon.0) 1875 : audit 1 from='client.26069 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi050-63936-34"}]': finished 2024-05-20T22:13:44.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:43 smithi050 bash[28929]: cluster 2024-05-20T22:13:42.892658+0000 mon.a (mon.0) 1876 : cluster 0 osdmap e227: 8 total, 8 up, 8 in 2024-05-20T22:13:44.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:43 smithi050 bash[28929]: audit 2024-05-20T22:13:42.899145+0000 mon.a (mon.0) 1877 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:44.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:43 smithi050 bash[28929]: audit 2024-05-20T22:13:42.913102+0000 mon.a (mon.0) 1878 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:13:44.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:43 smithi050 bash[28929]: audit 2024-05-20T22:13:42.941056+0000 mon.c (mon.2) 267 : audit 1 from='client.? v1:172.21.15.50:0/2311346786' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:44.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:43 smithi050 bash[28929]: audit 2024-05-20T22:13:42.941717+0000 mon.a (mon.0) 1879 : audit 1 from='client.26081 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:44.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:43 smithi050 bash[28929]: audit 2024-05-20T22:13:42.942770+0000 mon.c (mon.2) 268 : audit 1 from='client.? v1:172.21.15.50:0/2311346786' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:44.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:43 smithi050 bash[28929]: audit 2024-05-20T22:13:42.943094+0000 mon.a (mon.0) 1880 : audit 1 from='client.26081 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:44.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:43 smithi050 bash[28929]: audit 2024-05-20T22:13:42.943548+0000 mon.c (mon.2) 269 : audit 1 from='client.? v1:172.21.15.50:0/2311346786' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi050-63936-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:44.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:43 smithi050 bash[28929]: audit 2024-05-20T22:13:42.943816+0000 mon.a (mon.0) 1881 : audit 1 from='client.26081 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi050-63936-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:44.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:43 smithi050 bash[28929]: audit 2024-05-20T22:13:43.581821+0000 mon.a (mon.0) 1882 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:13:44.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:43 smithi050 bash[28929]: audit 2024-05-20T22:13:43.583424+0000 mon.a (mon.0) 1883 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:13:44.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:43 smithi050 bash[28929]: audit 2024-05-20T22:13:43.592248+0000 mon.a (mon.0) 1884 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:13:44.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:43 smithi145 bash[23893]: cluster 2024-05-20T22:13:42.869080+0000 mon.a (mon.0) 1874 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:44.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:43 smithi145 bash[23893]: audit 2024-05-20T22:13:42.882201+0000 mon.a (mon.0) 1875 : audit 1 from='client.26069 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi050-63936-34"}]': finished 2024-05-20T22:13:44.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:43 smithi145 bash[23893]: cluster 2024-05-20T22:13:42.892658+0000 mon.a (mon.0) 1876 : cluster 0 osdmap e227: 8 total, 8 up, 8 in 2024-05-20T22:13:44.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:43 smithi145 bash[23893]: audit 2024-05-20T22:13:42.899145+0000 mon.a (mon.0) 1877 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:44.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:43 smithi145 bash[23893]: audit 2024-05-20T22:13:42.913102+0000 mon.a (mon.0) 1878 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:13:44.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:43 smithi145 bash[23893]: audit 2024-05-20T22:13:42.941056+0000 mon.c (mon.2) 267 : audit 1 from='client.? v1:172.21.15.50:0/2311346786' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:44.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:43 smithi145 bash[23893]: audit 2024-05-20T22:13:42.941717+0000 mon.a (mon.0) 1879 : audit 1 from='client.26081 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:44.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:43 smithi145 bash[23893]: audit 2024-05-20T22:13:42.942770+0000 mon.c (mon.2) 268 : audit 1 from='client.? v1:172.21.15.50:0/2311346786' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:44.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:43 smithi145 bash[23893]: audit 2024-05-20T22:13:42.943094+0000 mon.a (mon.0) 1880 : audit 1 from='client.26081 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:44.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:43 smithi145 bash[23893]: audit 2024-05-20T22:13:42.943548+0000 mon.c (mon.2) 269 : audit 1 from='client.? v1:172.21.15.50:0/2311346786' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi050-63936-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:44.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:43 smithi145 bash[23893]: audit 2024-05-20T22:13:42.943816+0000 mon.a (mon.0) 1881 : audit 1 from='client.26081 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi050-63936-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:44.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:43 smithi145 bash[23893]: audit 2024-05-20T22:13:43.581821+0000 mon.a (mon.0) 1882 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:13:44.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:43 smithi145 bash[23893]: audit 2024-05-20T22:13:43.583424+0000 mon.a (mon.0) 1883 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:13:44.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:43 smithi145 bash[23893]: audit 2024-05-20T22:13:43.592248+0000 mon.a (mon.0) 1884 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:13:45.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:44 smithi050 bash[21866]: audit 2024-05-20T22:13:43.885257+0000 mon.a (mon.0) 1885 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:45.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:44 smithi050 bash[21866]: audit 2024-05-20T22:13:43.885397+0000 mon.a (mon.0) 1886 : audit 1 from='client.26081 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi050-63936-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:45.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:44 smithi050 bash[21866]: cluster 2024-05-20T22:13:43.893547+0000 mon.a (mon.0) 1887 : cluster 0 osdmap e228: 8 total, 8 up, 8 in 2024-05-20T22:13:45.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:44 smithi050 bash[21866]: audit 2024-05-20T22:13:43.907206+0000 mon.c (mon.2) 270 : audit 1 from='client.? v1:172.21.15.50:0/2311346786' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi050-63936-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:45.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:44 smithi050 bash[21866]: audit 2024-05-20T22:13:43.933840+0000 mon.a (mon.0) 1888 : audit 1 from='client.26081 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi050-63936-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:45.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:44 smithi050 bash[21866]: cluster 2024-05-20T22:13:44.094994+0000 mgr.y (mgr.14592) 303 : cluster 0 pgmap v354: 388 pgs: 32 unknown, 356 active+clean; 584 KiB data, 549 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:45.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:44 smithi050 bash[28929]: audit 2024-05-20T22:13:43.885257+0000 mon.a (mon.0) 1885 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:45.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:44 smithi050 bash[28929]: audit 2024-05-20T22:13:43.885397+0000 mon.a (mon.0) 1886 : audit 1 from='client.26081 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi050-63936-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:45.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:44 smithi050 bash[28929]: cluster 2024-05-20T22:13:43.893547+0000 mon.a (mon.0) 1887 : cluster 0 osdmap e228: 8 total, 8 up, 8 in 2024-05-20T22:13:45.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:44 smithi050 bash[28929]: audit 2024-05-20T22:13:43.907206+0000 mon.c (mon.2) 270 : audit 1 from='client.? v1:172.21.15.50:0/2311346786' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi050-63936-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:45.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:44 smithi050 bash[28929]: audit 2024-05-20T22:13:43.933840+0000 mon.a (mon.0) 1888 : audit 1 from='client.26081 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi050-63936-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:45.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:44 smithi050 bash[28929]: cluster 2024-05-20T22:13:44.094994+0000 mgr.y (mgr.14592) 303 : cluster 0 pgmap v354: 388 pgs: 32 unknown, 356 active+clean; 584 KiB data, 549 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:45.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:44 smithi145 bash[23893]: audit 2024-05-20T22:13:43.885257+0000 mon.a (mon.0) 1885 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:45.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:44 smithi145 bash[23893]: audit 2024-05-20T22:13:43.885397+0000 mon.a (mon.0) 1886 : audit 1 from='client.26081 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi050-63936-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:45.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:44 smithi145 bash[23893]: cluster 2024-05-20T22:13:43.893547+0000 mon.a (mon.0) 1887 : cluster 0 osdmap e228: 8 total, 8 up, 8 in 2024-05-20T22:13:45.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:44 smithi145 bash[23893]: audit 2024-05-20T22:13:43.907206+0000 mon.c (mon.2) 270 : audit 1 from='client.? v1:172.21.15.50:0/2311346786' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi050-63936-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:45.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:44 smithi145 bash[23893]: audit 2024-05-20T22:13:43.933840+0000 mon.a (mon.0) 1888 : audit 1 from='client.26081 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi050-63936-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:45.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:44 smithi145 bash[23893]: cluster 2024-05-20T22:13:44.094994+0000 mgr.y (mgr.14592) 303 : cluster 0 pgmap v354: 388 pgs: 32 unknown, 356 active+clean; 584 KiB data, 549 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:46.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:45 smithi050 bash[21866]: cluster 2024-05-20T22:13:45.398597+0000 mon.a (mon.0) 1889 : cluster 0 osdmap e229: 8 total, 8 up, 8 in 2024-05-20T22:13:46.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:45 smithi050 bash[21866]: audit 2024-05-20T22:13:45.400693+0000 mon.c (mon.2) 271 : audit 1 from='client.? v1:172.21.15.50:0/2394706402' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi050-63944-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:46.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:45 smithi050 bash[21866]: audit 2024-05-20T22:13:45.401284+0000 mon.a (mon.0) 1890 : audit 1 from='client.26087 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi050-63944-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:46.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:45 smithi050 bash[21866]: audit 2024-05-20T22:13:45.415103+0000 mon.a (mon.0) 1891 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:46.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:45 smithi050 bash[28929]: cluster 2024-05-20T22:13:45.398597+0000 mon.a (mon.0) 1889 : cluster 0 osdmap e229: 8 total, 8 up, 8 in 2024-05-20T22:13:46.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:45 smithi050 bash[28929]: audit 2024-05-20T22:13:45.400693+0000 mon.c (mon.2) 271 : audit 1 from='client.? v1:172.21.15.50:0/2394706402' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi050-63944-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:46.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:45 smithi050 bash[28929]: audit 2024-05-20T22:13:45.401284+0000 mon.a (mon.0) 1890 : audit 1 from='client.26087 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi050-63944-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:46.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:45 smithi050 bash[28929]: audit 2024-05-20T22:13:45.415103+0000 mon.a (mon.0) 1891 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:46.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:45 smithi145 bash[23893]: cluster 2024-05-20T22:13:45.398597+0000 mon.a (mon.0) 1889 : cluster 0 osdmap e229: 8 total, 8 up, 8 in 2024-05-20T22:13:46.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:45 smithi145 bash[23893]: audit 2024-05-20T22:13:45.400693+0000 mon.c (mon.2) 271 : audit 1 from='client.? v1:172.21.15.50:0/2394706402' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi050-63944-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:46.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:45 smithi145 bash[23893]: audit 2024-05-20T22:13:45.401284+0000 mon.a (mon.0) 1890 : audit 1 from='client.26087 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi050-63944-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:46.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:45 smithi145 bash[23893]: audit 2024-05-20T22:13:45.415103+0000 mon.a (mon.0) 1891 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:47.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:46 smithi050 bash[28929]: audit 2024-05-20T22:13:45.933328+0000 mon.a (mon.0) 1892 : audit 1 from='client.26081 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi050-63936-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi050-63936-35"}]': finished 2024-05-20T22:13:47.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:46 smithi050 bash[28929]: audit 2024-05-20T22:13:45.933583+0000 mon.a (mon.0) 1893 : audit 1 from='client.26087 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi050-63944-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:47.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:46 smithi050 bash[28929]: audit 2024-05-20T22:13:45.933780+0000 mon.a (mon.0) 1894 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-27", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:47.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:46 smithi050 bash[28929]: cluster 2024-05-20T22:13:45.942538+0000 mon.a (mon.0) 1895 : cluster 0 osdmap e230: 8 total, 8 up, 8 in 2024-05-20T22:13:47.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:46 smithi050 bash[28929]: audit 2024-05-20T22:13:45.949687+0000 mon.a (mon.0) 1896 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-27"}]: dispatch 2024-05-20T22:13:47.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:46 smithi050 bash[28929]: cluster 2024-05-20T22:13:46.096094+0000 mgr.y (mgr.14592) 304 : cluster 0 pgmap v357: 428 pgs: 9 creating+peering, 31 unknown, 388 active+clean; 584 KiB data, 553 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:13:47.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:46 smithi050 bash[21866]: audit 2024-05-20T22:13:45.933328+0000 mon.a (mon.0) 1892 : audit 1 from='client.26081 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi050-63936-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi050-63936-35"}]': finished 2024-05-20T22:13:47.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:46 smithi050 bash[21866]: audit 2024-05-20T22:13:45.933583+0000 mon.a (mon.0) 1893 : audit 1 from='client.26087 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi050-63944-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:47.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:46 smithi050 bash[21866]: audit 2024-05-20T22:13:45.933780+0000 mon.a (mon.0) 1894 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-27", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:47.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:46 smithi050 bash[21866]: cluster 2024-05-20T22:13:45.942538+0000 mon.a (mon.0) 1895 : cluster 0 osdmap e230: 8 total, 8 up, 8 in 2024-05-20T22:13:47.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:46 smithi050 bash[21866]: audit 2024-05-20T22:13:45.949687+0000 mon.a (mon.0) 1896 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-27"}]: dispatch 2024-05-20T22:13:47.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:46 smithi050 bash[21866]: cluster 2024-05-20T22:13:46.096094+0000 mgr.y (mgr.14592) 304 : cluster 0 pgmap v357: 428 pgs: 9 creating+peering, 31 unknown, 388 active+clean; 584 KiB data, 553 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:13:47.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:46 smithi145 bash[23893]: audit 2024-05-20T22:13:45.933328+0000 mon.a (mon.0) 1892 : audit 1 from='client.26081 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi050-63936-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi050-63936-35"}]': finished 2024-05-20T22:13:47.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:46 smithi145 bash[23893]: audit 2024-05-20T22:13:45.933583+0000 mon.a (mon.0) 1893 : audit 1 from='client.26087 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi050-63944-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:47.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:46 smithi145 bash[23893]: audit 2024-05-20T22:13:45.933780+0000 mon.a (mon.0) 1894 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-27", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:47.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:46 smithi145 bash[23893]: cluster 2024-05-20T22:13:45.942538+0000 mon.a (mon.0) 1895 : cluster 0 osdmap e230: 8 total, 8 up, 8 in 2024-05-20T22:13:47.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:46 smithi145 bash[23893]: audit 2024-05-20T22:13:45.949687+0000 mon.a (mon.0) 1896 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-27"}]: dispatch 2024-05-20T22:13:47.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:46 smithi145 bash[23893]: cluster 2024-05-20T22:13:46.096094+0000 mgr.y (mgr.14592) 304 : cluster 0 pgmap v357: 428 pgs: 9 creating+peering, 31 unknown, 388 active+clean; 584 KiB data, 553 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:13:48.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:13:47 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:13:48.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:47 smithi145 bash[23893]: audit 2024-05-20T22:13:46.942733+0000 mon.a (mon.0) 1897 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-27"}]': finished 2024-05-20T22:13:48.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:47 smithi145 bash[23893]: cluster 2024-05-20T22:13:46.951809+0000 mon.a (mon.0) 1898 : cluster 0 osdmap e231: 8 total, 8 up, 8 in 2024-05-20T22:13:48.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:47 smithi145 bash[23893]: audit 2024-05-20T22:13:46.954671+0000 mon.a (mon.0) 1899 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-27", "mode": "writeback"}]: dispatch 2024-05-20T22:13:48.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:47 smithi050 bash[21866]: audit 2024-05-20T22:13:46.942733+0000 mon.a (mon.0) 1897 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-27"}]': finished 2024-05-20T22:13:48.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:47 smithi050 bash[21866]: cluster 2024-05-20T22:13:46.951809+0000 mon.a (mon.0) 1898 : cluster 0 osdmap e231: 8 total, 8 up, 8 in 2024-05-20T22:13:48.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:47 smithi050 bash[21866]: audit 2024-05-20T22:13:46.954671+0000 mon.a (mon.0) 1899 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-27", "mode": "writeback"}]: dispatch 2024-05-20T22:13:48.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:47 smithi050 bash[28929]: audit 2024-05-20T22:13:46.942733+0000 mon.a (mon.0) 1897 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-27"}]': finished 2024-05-20T22:13:48.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:47 smithi050 bash[28929]: cluster 2024-05-20T22:13:46.951809+0000 mon.a (mon.0) 1898 : cluster 0 osdmap e231: 8 total, 8 up, 8 in 2024-05-20T22:13:48.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:47 smithi050 bash[28929]: audit 2024-05-20T22:13:46.954671+0000 mon.a (mon.0) 1899 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-27", "mode": "writeback"}]: dispatch 2024-05-20T22:13:49.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:48 smithi050 bash[21866]: audit 2024-05-20T22:13:47.806658+0000 mgr.y (mgr.14592) 305 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:13:49.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:48 smithi050 bash[21866]: cluster 2024-05-20T22:13:47.944684+0000 mon.a (mon.0) 1900 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:13:49.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:48 smithi050 bash[21866]: audit 2024-05-20T22:13:47.955794+0000 mon.a (mon.0) 1901 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-27", "mode": "writeback"}]': finished 2024-05-20T22:13:49.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:48 smithi050 bash[21866]: cluster 2024-05-20T22:13:47.964177+0000 mon.a (mon.0) 1902 : cluster 0 osdmap e232: 8 total, 8 up, 8 in 2024-05-20T22:13:49.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:48 smithi050 bash[21866]: audit 2024-05-20T22:13:47.969565+0000 mon.c (mon.2) 272 : audit 1 from='client.? v1:172.21.15.50:0/3948514742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi050-63944-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:49.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:48 smithi050 bash[21866]: audit 2024-05-20T22:13:47.969869+0000 mon.c (mon.2) 273 : audit 1 from='client.? v1:172.21.15.50:0/2311346786' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:49.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:48 smithi050 bash[21866]: audit 2024-05-20T22:13:47.970163+0000 mon.a (mon.0) 1903 : audit 1 from='client.26093 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi050-63944-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:49.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:48 smithi050 bash[21866]: audit 2024-05-20T22:13:47.971730+0000 mon.a (mon.0) 1904 : audit 1 from='client.26081 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:49.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:48 smithi050 bash[21866]: cluster 2024-05-20T22:13:48.097054+0000 mgr.y (mgr.14592) 306 : cluster 0 pgmap v360: 420 pgs: 32 unknown, 388 active+clean; 584 KiB data, 553 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-05-20T22:13:49.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:48 smithi050 bash[21866]: cluster 2024-05-20T22:13:48.825845+0000 mon.a (mon.0) 1905 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:49.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:48 smithi050 bash[28929]: audit 2024-05-20T22:13:47.806658+0000 mgr.y (mgr.14592) 305 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:13:49.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:48 smithi050 bash[28929]: cluster 2024-05-20T22:13:47.944684+0000 mon.a (mon.0) 1900 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:13:49.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:48 smithi050 bash[28929]: audit 2024-05-20T22:13:47.955794+0000 mon.a (mon.0) 1901 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-27", "mode": "writeback"}]': finished 2024-05-20T22:13:49.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:48 smithi050 bash[28929]: cluster 2024-05-20T22:13:47.964177+0000 mon.a (mon.0) 1902 : cluster 0 osdmap e232: 8 total, 8 up, 8 in 2024-05-20T22:13:49.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:48 smithi050 bash[28929]: audit 2024-05-20T22:13:47.969565+0000 mon.c (mon.2) 272 : audit 1 from='client.? v1:172.21.15.50:0/3948514742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi050-63944-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:49.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:48 smithi050 bash[28929]: audit 2024-05-20T22:13:47.969869+0000 mon.c (mon.2) 273 : audit 1 from='client.? v1:172.21.15.50:0/2311346786' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:49.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:48 smithi050 bash[28929]: audit 2024-05-20T22:13:47.970163+0000 mon.a (mon.0) 1903 : audit 1 from='client.26093 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi050-63944-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:49.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:48 smithi050 bash[28929]: audit 2024-05-20T22:13:47.971730+0000 mon.a (mon.0) 1904 : audit 1 from='client.26081 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:49.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:48 smithi050 bash[28929]: cluster 2024-05-20T22:13:48.097054+0000 mgr.y (mgr.14592) 306 : cluster 0 pgmap v360: 420 pgs: 32 unknown, 388 active+clean; 584 KiB data, 553 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-05-20T22:13:49.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:48 smithi050 bash[28929]: cluster 2024-05-20T22:13:48.825845+0000 mon.a (mon.0) 1905 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:49.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:48 smithi145 bash[23893]: audit 2024-05-20T22:13:47.806658+0000 mgr.y (mgr.14592) 305 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:13:49.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:48 smithi145 bash[23893]: cluster 2024-05-20T22:13:47.944684+0000 mon.a (mon.0) 1900 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:13:49.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:48 smithi145 bash[23893]: audit 2024-05-20T22:13:47.955794+0000 mon.a (mon.0) 1901 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-27", "mode": "writeback"}]': finished 2024-05-20T22:13:49.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:48 smithi145 bash[23893]: cluster 2024-05-20T22:13:47.964177+0000 mon.a (mon.0) 1902 : cluster 0 osdmap e232: 8 total, 8 up, 8 in 2024-05-20T22:13:49.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:48 smithi145 bash[23893]: audit 2024-05-20T22:13:47.969565+0000 mon.c (mon.2) 272 : audit 1 from='client.? v1:172.21.15.50:0/3948514742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi050-63944-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:49.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:48 smithi145 bash[23893]: audit 2024-05-20T22:13:47.969869+0000 mon.c (mon.2) 273 : audit 1 from='client.? v1:172.21.15.50:0/2311346786' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:49.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:48 smithi145 bash[23893]: audit 2024-05-20T22:13:47.970163+0000 mon.a (mon.0) 1903 : audit 1 from='client.26093 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi050-63944-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:49.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:48 smithi145 bash[23893]: audit 2024-05-20T22:13:47.971730+0000 mon.a (mon.0) 1904 : audit 1 from='client.26081 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:49.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:48 smithi145 bash[23893]: cluster 2024-05-20T22:13:48.097054+0000 mgr.y (mgr.14592) 306 : cluster 0 pgmap v360: 420 pgs: 32 unknown, 388 active+clean; 584 KiB data, 553 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-05-20T22:13:49.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:48 smithi145 bash[23893]: cluster 2024-05-20T22:13:48.825845+0000 mon.a (mon.0) 1905 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:49.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:13:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:13:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:13:50.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:49 smithi145 bash[23893]: audit 2024-05-20T22:13:48.964780+0000 mon.a (mon.0) 1906 : audit 1 from='client.26093 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi050-63944-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:50.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:49 smithi145 bash[23893]: audit 2024-05-20T22:13:48.965020+0000 mon.a (mon.0) 1907 : audit 1 from='client.26081 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi050-63936-35"}]': finished 2024-05-20T22:13:50.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:49 smithi145 bash[23893]: cluster 2024-05-20T22:13:48.971793+0000 mon.a (mon.0) 1908 : cluster 0 osdmap e233: 8 total, 8 up, 8 in 2024-05-20T22:13:50.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:49 smithi145 bash[23893]: audit 2024-05-20T22:13:48.973743+0000 mon.c (mon.2) 274 : audit 1 from='client.? v1:172.21.15.50:0/2311346786' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:50.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:49 smithi145 bash[23893]: audit 2024-05-20T22:13:48.978992+0000 mon.a (mon.0) 1909 : audit 1 from='client.26081 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:50.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:49 smithi145 bash[23893]: audit 2024-05-20T22:13:49.044118+0000 mon.a (mon.0) 1910 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:13:50.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:49 smithi050 bash[21866]: audit 2024-05-20T22:13:48.964780+0000 mon.a (mon.0) 1906 : audit 1 from='client.26093 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi050-63944-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:50.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:49 smithi050 bash[21866]: audit 2024-05-20T22:13:48.965020+0000 mon.a (mon.0) 1907 : audit 1 from='client.26081 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi050-63936-35"}]': finished 2024-05-20T22:13:50.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:49 smithi050 bash[21866]: cluster 2024-05-20T22:13:48.971793+0000 mon.a (mon.0) 1908 : cluster 0 osdmap e233: 8 total, 8 up, 8 in 2024-05-20T22:13:50.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:49 smithi050 bash[21866]: audit 2024-05-20T22:13:48.973743+0000 mon.c (mon.2) 274 : audit 1 from='client.? v1:172.21.15.50:0/2311346786' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:50.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:49 smithi050 bash[21866]: audit 2024-05-20T22:13:48.978992+0000 mon.a (mon.0) 1909 : audit 1 from='client.26081 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:50.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:49 smithi050 bash[21866]: audit 2024-05-20T22:13:49.044118+0000 mon.a (mon.0) 1910 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:13:50.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:49 smithi050 bash[28929]: audit 2024-05-20T22:13:48.964780+0000 mon.a (mon.0) 1906 : audit 1 from='client.26093 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi050-63944-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:50.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:49 smithi050 bash[28929]: audit 2024-05-20T22:13:48.965020+0000 mon.a (mon.0) 1907 : audit 1 from='client.26081 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi050-63936-35"}]': finished 2024-05-20T22:13:50.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:49 smithi050 bash[28929]: cluster 2024-05-20T22:13:48.971793+0000 mon.a (mon.0) 1908 : cluster 0 osdmap e233: 8 total, 8 up, 8 in 2024-05-20T22:13:50.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:49 smithi050 bash[28929]: audit 2024-05-20T22:13:48.973743+0000 mon.c (mon.2) 274 : audit 1 from='client.? v1:172.21.15.50:0/2311346786' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:50.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:49 smithi050 bash[28929]: audit 2024-05-20T22:13:48.978992+0000 mon.a (mon.0) 1909 : audit 1 from='client.26081 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi050-63936-35"}]: dispatch 2024-05-20T22:13:50.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:49 smithi050 bash[28929]: audit 2024-05-20T22:13:49.044118+0000 mon.a (mon.0) 1910 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:13:51.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:50 smithi145 bash[23893]: audit 2024-05-20T22:13:49.968725+0000 mon.a (mon.0) 1911 : audit 1 from='client.26081 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi050-63936-35"}]': finished 2024-05-20T22:13:51.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:50 smithi145 bash[23893]: audit 2024-05-20T22:13:49.968888+0000 mon.a (mon.0) 1912 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:13:51.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:50 smithi145 bash[23893]: cluster 2024-05-20T22:13:49.976122+0000 mon.a (mon.0) 1913 : cluster 0 osdmap e234: 8 total, 8 up, 8 in 2024-05-20T22:13:51.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:50 smithi145 bash[23893]: audit 2024-05-20T22:13:49.980568+0000 mon.a (mon.0) 1914 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-27"}]: dispatch 2024-05-20T22:13:51.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:50 smithi145 bash[23893]: audit 2024-05-20T22:13:50.015289+0000 mon.a (mon.0) 1915 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi050-63936-36"}]: dispatch 2024-05-20T22:13:51.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:50 smithi145 bash[23893]: audit 2024-05-20T22:13:50.016803+0000 mon.a (mon.0) 1916 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi050-63936-36"}]: dispatch 2024-05-20T22:13:51.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:50 smithi145 bash[23893]: audit 2024-05-20T22:13:50.017197+0000 mon.a (mon.0) 1917 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi050-63936-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:51.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:50 smithi145 bash[23893]: audit 2024-05-20T22:13:50.022154+0000 mon.c (mon.2) 275 : audit 1 from='client.? v1:172.21.15.50:0/3126547293' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:51.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:50 smithi145 bash[23893]: audit 2024-05-20T22:13:50.022702+0000 mon.a (mon.0) 1918 : audit 1 from='client.26105 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:51.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:50 smithi145 bash[23893]: audit 2024-05-20T22:13:50.023478+0000 mon.c (mon.2) 276 : audit 1 from='client.? v1:172.21.15.50:0/3126547293' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:51.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:50 smithi145 bash[23893]: audit 2024-05-20T22:13:50.023715+0000 mon.a (mon.0) 1919 : audit 1 from='client.26105 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:51.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:50 smithi145 bash[23893]: audit 2024-05-20T22:13:50.024173+0000 mon.c (mon.2) 277 : audit 1 from='client.? v1:172.21.15.50:0/3126547293' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi050-63944-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:51.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:50 smithi145 bash[23893]: audit 2024-05-20T22:13:50.024446+0000 mon.a (mon.0) 1920 : audit 1 from='client.26105 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi050-63944-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:51.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:50 smithi145 bash[23893]: cluster 2024-05-20T22:13:50.097745+0000 mgr.y (mgr.14592) 307 : cluster 0 pgmap v363: 388 pgs: 388 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 3 op/s 2024-05-20T22:13:51.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:50 smithi145 bash[23893]: cluster 2024-05-20T22:13:50.969154+0000 mon.a (mon.0) 1921 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:13:51.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:50 smithi145 bash[23893]: audit 2024-05-20T22:13:50.971498+0000 mon.a (mon.0) 1922 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-27"}]': finished 2024-05-20T22:13:51.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:50 smithi145 bash[23893]: audit 2024-05-20T22:13:50.971662+0000 mon.a (mon.0) 1923 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi050-63936-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:51.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:50 smithi145 bash[23893]: audit 2024-05-20T22:13:50.971779+0000 mon.a (mon.0) 1924 : audit 1 from='client.26105 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi050-63944-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:51.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:50 smithi145 bash[23893]: audit 2024-05-20T22:13:50.978339+0000 mon.c (mon.2) 278 : audit 1 from='client.? v1:172.21.15.50:0/3126547293' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi050-63944-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:51.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:50 smithi145 bash[23893]: cluster 2024-05-20T22:13:50.979534+0000 mon.a (mon.0) 1925 : cluster 0 osdmap e235: 8 total, 8 up, 8 in 2024-05-20T22:13:51.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:50 smithi050 bash[21866]: audit 2024-05-20T22:13:49.968725+0000 mon.a (mon.0) 1911 : audit 1 from='client.26081 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi050-63936-35"}]': finished 2024-05-20T22:13:51.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:50 smithi050 bash[21866]: audit 2024-05-20T22:13:49.968888+0000 mon.a (mon.0) 1912 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:13:51.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:50 smithi050 bash[21866]: cluster 2024-05-20T22:13:49.976122+0000 mon.a (mon.0) 1913 : cluster 0 osdmap e234: 8 total, 8 up, 8 in 2024-05-20T22:13:51.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:50 smithi050 bash[21866]: audit 2024-05-20T22:13:49.980568+0000 mon.a (mon.0) 1914 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-27"}]: dispatch 2024-05-20T22:13:51.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:50 smithi050 bash[21866]: audit 2024-05-20T22:13:50.015289+0000 mon.a (mon.0) 1915 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi050-63936-36"}]: dispatch 2024-05-20T22:13:51.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:50 smithi050 bash[21866]: audit 2024-05-20T22:13:50.016803+0000 mon.a (mon.0) 1916 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi050-63936-36"}]: dispatch 2024-05-20T22:13:51.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:50 smithi050 bash[21866]: audit 2024-05-20T22:13:50.017197+0000 mon.a (mon.0) 1917 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi050-63936-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:51.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:50 smithi050 bash[21866]: audit 2024-05-20T22:13:50.022154+0000 mon.c (mon.2) 275 : audit 1 from='client.? v1:172.21.15.50:0/3126547293' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:51.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:50 smithi050 bash[21866]: audit 2024-05-20T22:13:50.022702+0000 mon.a (mon.0) 1918 : audit 1 from='client.26105 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:51.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:51 smithi050 bash[21866]: audit 2024-05-20T22:13:50.023478+0000 mon.c (mon.2) 276 : audit 1 from='client.? v1:172.21.15.50:0/3126547293' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:51.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:51 smithi050 bash[21866]: audit 2024-05-20T22:13:50.023715+0000 mon.a (mon.0) 1919 : audit 1 from='client.26105 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:51.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:51 smithi050 bash[21866]: audit 2024-05-20T22:13:50.024173+0000 mon.c (mon.2) 277 : audit 1 from='client.? v1:172.21.15.50:0/3126547293' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi050-63944-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:51.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:51 smithi050 bash[21866]: audit 2024-05-20T22:13:50.024446+0000 mon.a (mon.0) 1920 : audit 1 from='client.26105 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi050-63944-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:51.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:51 smithi050 bash[21866]: cluster 2024-05-20T22:13:50.097745+0000 mgr.y (mgr.14592) 307 : cluster 0 pgmap v363: 388 pgs: 388 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 3 op/s 2024-05-20T22:13:51.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:51 smithi050 bash[21866]: cluster 2024-05-20T22:13:50.969154+0000 mon.a (mon.0) 1921 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:13:51.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:50 smithi050 bash[28929]: audit 2024-05-20T22:13:49.968725+0000 mon.a (mon.0) 1911 : audit 1 from='client.26081 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi050-63936-35"}]': finished 2024-05-20T22:13:51.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:50 smithi050 bash[28929]: audit 2024-05-20T22:13:49.968888+0000 mon.a (mon.0) 1912 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:13:51.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:50 smithi050 bash[28929]: cluster 2024-05-20T22:13:49.976122+0000 mon.a (mon.0) 1913 : cluster 0 osdmap e234: 8 total, 8 up, 8 in 2024-05-20T22:13:51.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:50 smithi050 bash[28929]: audit 2024-05-20T22:13:49.980568+0000 mon.a (mon.0) 1914 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-27"}]: dispatch 2024-05-20T22:13:51.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:50 smithi050 bash[28929]: audit 2024-05-20T22:13:50.015289+0000 mon.a (mon.0) 1915 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi050-63936-36"}]: dispatch 2024-05-20T22:13:51.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:50 smithi050 bash[28929]: audit 2024-05-20T22:13:50.016803+0000 mon.a (mon.0) 1916 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi050-63936-36"}]: dispatch 2024-05-20T22:13:51.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:50 smithi050 bash[28929]: audit 2024-05-20T22:13:50.017197+0000 mon.a (mon.0) 1917 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi050-63936-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:51.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:50 smithi050 bash[28929]: audit 2024-05-20T22:13:50.022154+0000 mon.c (mon.2) 275 : audit 1 from='client.? v1:172.21.15.50:0/3126547293' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:51.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:50 smithi050 bash[28929]: audit 2024-05-20T22:13:50.022702+0000 mon.a (mon.0) 1918 : audit 1 from='client.26105 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:51.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:50 smithi050 bash[28929]: audit 2024-05-20T22:13:50.023478+0000 mon.c (mon.2) 276 : audit 1 from='client.? v1:172.21.15.50:0/3126547293' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:51.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:50 smithi050 bash[28929]: audit 2024-05-20T22:13:50.023715+0000 mon.a (mon.0) 1919 : audit 1 from='client.26105 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:51.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:51 smithi050 bash[28929]: audit 2024-05-20T22:13:50.024173+0000 mon.c (mon.2) 277 : audit 1 from='client.? v1:172.21.15.50:0/3126547293' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi050-63944-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:51.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:51 smithi050 bash[28929]: audit 2024-05-20T22:13:50.024446+0000 mon.a (mon.0) 1920 : audit 1 from='client.26105 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi050-63944-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:51.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:51 smithi050 bash[28929]: cluster 2024-05-20T22:13:50.097745+0000 mgr.y (mgr.14592) 307 : cluster 0 pgmap v363: 388 pgs: 388 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 3 op/s 2024-05-20T22:13:51.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:51 smithi050 bash[28929]: cluster 2024-05-20T22:13:50.969154+0000 mon.a (mon.0) 1921 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:13:51.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:51 smithi050 bash[21866]: audit 2024-05-20T22:13:50.971498+0000 mon.a (mon.0) 1922 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-27"}]': finished 2024-05-20T22:13:51.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:51 smithi050 bash[21866]: audit 2024-05-20T22:13:50.971662+0000 mon.a (mon.0) 1923 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi050-63936-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:51.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:51 smithi050 bash[21866]: audit 2024-05-20T22:13:50.971779+0000 mon.a (mon.0) 1924 : audit 1 from='client.26105 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi050-63944-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:51.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:51 smithi050 bash[21866]: audit 2024-05-20T22:13:50.978339+0000 mon.c (mon.2) 278 : audit 1 from='client.? v1:172.21.15.50:0/3126547293' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi050-63944-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:51.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:51 smithi050 bash[21866]: cluster 2024-05-20T22:13:50.979534+0000 mon.a (mon.0) 1925 : cluster 0 osdmap e235: 8 total, 8 up, 8 in 2024-05-20T22:13:51.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:51 smithi050 bash[28929]: audit 2024-05-20T22:13:50.971498+0000 mon.a (mon.0) 1922 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-27"}]': finished 2024-05-20T22:13:51.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:51 smithi050 bash[28929]: audit 2024-05-20T22:13:50.971662+0000 mon.a (mon.0) 1923 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi050-63936-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:51.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:51 smithi050 bash[28929]: audit 2024-05-20T22:13:50.971779+0000 mon.a (mon.0) 1924 : audit 1 from='client.26105 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi050-63944-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:13:51.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:51 smithi050 bash[28929]: audit 2024-05-20T22:13:50.978339+0000 mon.c (mon.2) 278 : audit 1 from='client.? v1:172.21.15.50:0/3126547293' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi050-63944-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:51.448 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:51 smithi050 bash[28929]: cluster 2024-05-20T22:13:50.979534+0000 mon.a (mon.0) 1925 : cluster 0 osdmap e235: 8 total, 8 up, 8 in 2024-05-20T22:13:53.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:52 smithi050 bash[21866]: audit 2024-05-20T22:13:50.982590+0000 mon.a (mon.0) 1926 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi050-63936-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi050-63936-36"}]: dispatch 2024-05-20T22:13:53.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:52 smithi050 bash[21866]: audit 2024-05-20T22:13:50.983363+0000 mon.a (mon.0) 1927 : audit 1 from='client.26105 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi050-63944-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:53.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:52 smithi050 bash[21866]: audit 2024-05-20T22:13:51.237643+0000 mon.a (mon.0) 1928 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:13:53.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:52 smithi050 bash[28929]: audit 2024-05-20T22:13:50.982590+0000 mon.a (mon.0) 1926 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi050-63936-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi050-63936-36"}]: dispatch 2024-05-20T22:13:53.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:52 smithi050 bash[28929]: audit 2024-05-20T22:13:50.983363+0000 mon.a (mon.0) 1927 : audit 1 from='client.26105 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi050-63944-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:53.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:52 smithi050 bash[28929]: audit 2024-05-20T22:13:51.237643+0000 mon.a (mon.0) 1928 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:13:53.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:52 smithi145 bash[23893]: audit 2024-05-20T22:13:50.982590+0000 mon.a (mon.0) 1926 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi050-63936-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi050-63936-36"}]: dispatch 2024-05-20T22:13:53.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:52 smithi145 bash[23893]: audit 2024-05-20T22:13:50.983363+0000 mon.a (mon.0) 1927 : audit 1 from='client.26105 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi050-63944-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:53.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:52 smithi145 bash[23893]: audit 2024-05-20T22:13:51.237643+0000 mon.a (mon.0) 1928 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:13:54.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:53 smithi050 bash[21866]: cluster 2024-05-20T22:13:52.098643+0000 mgr.y (mgr.14592) 308 : cluster 0 pgmap v366: 356 pgs: 356 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:13:54.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:53 smithi050 bash[21866]: cluster 2024-05-20T22:13:52.898995+0000 mon.a (mon.0) 1929 : cluster 0 osdmap e236: 8 total, 8 up, 8 in 2024-05-20T22:13:54.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:53 smithi050 bash[21866]: audit 2024-05-20T22:13:53.384950+0000 mon.a (mon.0) 1930 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi050-63936-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi050-63936-36"}]': finished 2024-05-20T22:13:54.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:53 smithi050 bash[21866]: audit 2024-05-20T22:13:53.385145+0000 mon.a (mon.0) 1931 : audit 1 from='client.26105 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi050-63944-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi050-63944-46"}]': finished 2024-05-20T22:13:54.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:53 smithi050 bash[21866]: cluster 2024-05-20T22:13:53.392670+0000 mon.a (mon.0) 1932 : cluster 0 osdmap e237: 8 total, 8 up, 8 in 2024-05-20T22:13:54.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:53 smithi050 bash[21866]: audit 2024-05-20T22:13:53.402545+0000 mon.a (mon.0) 1933 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:54.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:53 smithi050 bash[21866]: cluster 2024-05-20T22:13:53.827375+0000 mon.a (mon.0) 1934 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:54.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:53 smithi050 bash[21866]: audit 2024-05-20T22:13:53.831895+0000 mon.a (mon.0) 1935 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:54.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:53 smithi050 bash[21866]: cluster 2024-05-20T22:13:53.840788+0000 mon.a (mon.0) 1936 : cluster 0 osdmap e238: 8 total, 8 up, 8 in 2024-05-20T22:13:54.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:53 smithi050 bash[28929]: cluster 2024-05-20T22:13:52.098643+0000 mgr.y (mgr.14592) 308 : cluster 0 pgmap v366: 356 pgs: 356 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:13:54.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:53 smithi050 bash[28929]: cluster 2024-05-20T22:13:52.898995+0000 mon.a (mon.0) 1929 : cluster 0 osdmap e236: 8 total, 8 up, 8 in 2024-05-20T22:13:54.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:53 smithi050 bash[28929]: audit 2024-05-20T22:13:53.384950+0000 mon.a (mon.0) 1930 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi050-63936-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi050-63936-36"}]': finished 2024-05-20T22:13:54.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:53 smithi050 bash[28929]: audit 2024-05-20T22:13:53.385145+0000 mon.a (mon.0) 1931 : audit 1 from='client.26105 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi050-63944-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi050-63944-46"}]': finished 2024-05-20T22:13:54.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:53 smithi050 bash[28929]: cluster 2024-05-20T22:13:53.392670+0000 mon.a (mon.0) 1932 : cluster 0 osdmap e237: 8 total, 8 up, 8 in 2024-05-20T22:13:54.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:53 smithi050 bash[28929]: audit 2024-05-20T22:13:53.402545+0000 mon.a (mon.0) 1933 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:54.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:53 smithi050 bash[28929]: cluster 2024-05-20T22:13:53.827375+0000 mon.a (mon.0) 1934 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:54.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:53 smithi050 bash[28929]: audit 2024-05-20T22:13:53.831895+0000 mon.a (mon.0) 1935 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:54.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:53 smithi050 bash[28929]: cluster 2024-05-20T22:13:53.840788+0000 mon.a (mon.0) 1936 : cluster 0 osdmap e238: 8 total, 8 up, 8 in 2024-05-20T22:13:54.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:53 smithi145 bash[23893]: cluster 2024-05-20T22:13:52.098643+0000 mgr.y (mgr.14592) 308 : cluster 0 pgmap v366: 356 pgs: 356 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:13:54.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:53 smithi145 bash[23893]: cluster 2024-05-20T22:13:52.898995+0000 mon.a (mon.0) 1929 : cluster 0 osdmap e236: 8 total, 8 up, 8 in 2024-05-20T22:13:54.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:53 smithi145 bash[23893]: audit 2024-05-20T22:13:53.384950+0000 mon.a (mon.0) 1930 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi050-63936-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi050-63936-36"}]': finished 2024-05-20T22:13:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:53 smithi145 bash[23893]: audit 2024-05-20T22:13:53.385145+0000 mon.a (mon.0) 1931 : audit 1 from='client.26105 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi050-63944-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi050-63944-46"}]': finished 2024-05-20T22:13:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:53 smithi145 bash[23893]: cluster 2024-05-20T22:13:53.392670+0000 mon.a (mon.0) 1932 : cluster 0 osdmap e237: 8 total, 8 up, 8 in 2024-05-20T22:13:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:53 smithi145 bash[23893]: audit 2024-05-20T22:13:53.402545+0000 mon.a (mon.0) 1933 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:13:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:53 smithi145 bash[23893]: cluster 2024-05-20T22:13:53.827375+0000 mon.a (mon.0) 1934 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:13:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:53 smithi145 bash[23893]: audit 2024-05-20T22:13:53.831895+0000 mon.a (mon.0) 1935 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:13:54.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:53 smithi145 bash[23893]: cluster 2024-05-20T22:13:53.840788+0000 mon.a (mon.0) 1936 : cluster 0 osdmap e238: 8 total, 8 up, 8 in 2024-05-20T22:13:55.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:54 smithi050 bash[21866]: cluster 2024-05-20T22:13:54.099651+0000 mgr.y (mgr.14592) 309 : cluster 0 pgmap v369: 404 pgs: 48 unknown, 356 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:55.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:54 smithi050 bash[21866]: cluster 2024-05-20T22:13:54.842086+0000 mon.a (mon.0) 1937 : cluster 0 osdmap e239: 8 total, 8 up, 8 in 2024-05-20T22:13:55.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:54 smithi050 bash[21866]: audit 2024-05-20T22:13:54.846155+0000 mon.a (mon.0) 1938 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi050-63936-36"}]: dispatch 2024-05-20T22:13:55.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:54 smithi050 bash[21866]: audit 2024-05-20T22:13:54.847931+0000 mon.c (mon.2) 279 : audit 1 from='client.? v1:172.21.15.50:0/3126547293' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:55.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:54 smithi050 bash[21866]: audit 2024-05-20T22:13:54.849011+0000 mon.a (mon.0) 1939 : audit 1 from='client.26105 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:55.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:54 smithi050 bash[28929]: cluster 2024-05-20T22:13:54.099651+0000 mgr.y (mgr.14592) 309 : cluster 0 pgmap v369: 404 pgs: 48 unknown, 356 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:55.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:54 smithi050 bash[28929]: cluster 2024-05-20T22:13:54.842086+0000 mon.a (mon.0) 1937 : cluster 0 osdmap e239: 8 total, 8 up, 8 in 2024-05-20T22:13:55.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:54 smithi050 bash[28929]: audit 2024-05-20T22:13:54.846155+0000 mon.a (mon.0) 1938 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi050-63936-36"}]: dispatch 2024-05-20T22:13:55.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:54 smithi050 bash[28929]: audit 2024-05-20T22:13:54.847931+0000 mon.c (mon.2) 279 : audit 1 from='client.? v1:172.21.15.50:0/3126547293' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:55.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:54 smithi050 bash[28929]: audit 2024-05-20T22:13:54.849011+0000 mon.a (mon.0) 1939 : audit 1 from='client.26105 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:55.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:54 smithi145 bash[23893]: cluster 2024-05-20T22:13:54.099651+0000 mgr.y (mgr.14592) 309 : cluster 0 pgmap v369: 404 pgs: 48 unknown, 356 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:13:55.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:54 smithi145 bash[23893]: cluster 2024-05-20T22:13:54.842086+0000 mon.a (mon.0) 1937 : cluster 0 osdmap e239: 8 total, 8 up, 8 in 2024-05-20T22:13:55.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:54 smithi145 bash[23893]: audit 2024-05-20T22:13:54.846155+0000 mon.a (mon.0) 1938 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi050-63936-36"}]: dispatch 2024-05-20T22:13:55.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:54 smithi145 bash[23893]: audit 2024-05-20T22:13:54.847931+0000 mon.c (mon.2) 279 : audit 1 from='client.? v1:172.21.15.50:0/3126547293' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:55.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:54 smithi145 bash[23893]: audit 2024-05-20T22:13:54.849011+0000 mon.a (mon.0) 1939 : audit 1 from='client.26105 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:57.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:56 smithi145 bash[23893]: audit 2024-05-20T22:13:55.837846+0000 mon.a (mon.0) 1940 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi050-63936-36"}]': finished 2024-05-20T22:13:57.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:56 smithi145 bash[23893]: audit 2024-05-20T22:13:55.838009+0000 mon.a (mon.0) 1941 : audit 1 from='client.26105 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-46"}]': finished 2024-05-20T22:13:57.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:56 smithi145 bash[23893]: cluster 2024-05-20T22:13:55.846191+0000 mon.a (mon.0) 1942 : cluster 0 osdmap e240: 8 total, 8 up, 8 in 2024-05-20T22:13:57.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:56 smithi145 bash[23893]: audit 2024-05-20T22:13:55.847460+0000 mon.a (mon.0) 1943 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi050-63936-36"}]: dispatch 2024-05-20T22:13:57.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:56 smithi145 bash[23893]: audit 2024-05-20T22:13:55.848460+0000 mon.c (mon.2) 280 : audit 1 from='client.? v1:172.21.15.50:0/3126547293' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:57.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:56 smithi145 bash[23893]: audit 2024-05-20T22:13:55.850628+0000 mon.a (mon.0) 1944 : audit 1 from='client.26105 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:57.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:56 smithi145 bash[23893]: audit 2024-05-20T22:13:55.872911+0000 mon.a (mon.0) 1945 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:57.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:56 smithi145 bash[23893]: cluster 2024-05-20T22:13:56.100808+0000 mgr.y (mgr.14592) 310 : cluster 0 pgmap v372: 388 pgs: 388 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 KiB/s wr, 1 op/s 2024-05-20T22:13:57.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:56 smithi050 bash[21866]: audit 2024-05-20T22:13:55.837846+0000 mon.a (mon.0) 1940 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi050-63936-36"}]': finished 2024-05-20T22:13:57.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:56 smithi050 bash[21866]: audit 2024-05-20T22:13:55.838009+0000 mon.a (mon.0) 1941 : audit 1 from='client.26105 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-46"}]': finished 2024-05-20T22:13:57.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:56 smithi050 bash[21866]: cluster 2024-05-20T22:13:55.846191+0000 mon.a (mon.0) 1942 : cluster 0 osdmap e240: 8 total, 8 up, 8 in 2024-05-20T22:13:57.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:56 smithi050 bash[21866]: audit 2024-05-20T22:13:55.847460+0000 mon.a (mon.0) 1943 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi050-63936-36"}]: dispatch 2024-05-20T22:13:57.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:56 smithi050 bash[21866]: audit 2024-05-20T22:13:55.848460+0000 mon.c (mon.2) 280 : audit 1 from='client.? v1:172.21.15.50:0/3126547293' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:57.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:56 smithi050 bash[21866]: audit 2024-05-20T22:13:55.850628+0000 mon.a (mon.0) 1944 : audit 1 from='client.26105 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:57.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:56 smithi050 bash[21866]: audit 2024-05-20T22:13:55.872911+0000 mon.a (mon.0) 1945 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:57.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:56 smithi050 bash[21866]: cluster 2024-05-20T22:13:56.100808+0000 mgr.y (mgr.14592) 310 : cluster 0 pgmap v372: 388 pgs: 388 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 KiB/s wr, 1 op/s 2024-05-20T22:13:57.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:56 smithi050 bash[28929]: audit 2024-05-20T22:13:55.837846+0000 mon.a (mon.0) 1940 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi050-63936-36"}]': finished 2024-05-20T22:13:57.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:56 smithi050 bash[28929]: audit 2024-05-20T22:13:55.838009+0000 mon.a (mon.0) 1941 : audit 1 from='client.26105 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-46"}]': finished 2024-05-20T22:13:57.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:56 smithi050 bash[28929]: cluster 2024-05-20T22:13:55.846191+0000 mon.a (mon.0) 1942 : cluster 0 osdmap e240: 8 total, 8 up, 8 in 2024-05-20T22:13:57.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:56 smithi050 bash[28929]: audit 2024-05-20T22:13:55.847460+0000 mon.a (mon.0) 1943 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi050-63936-36"}]: dispatch 2024-05-20T22:13:57.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:56 smithi050 bash[28929]: audit 2024-05-20T22:13:55.848460+0000 mon.c (mon.2) 280 : audit 1 from='client.? v1:172.21.15.50:0/3126547293' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:57.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:56 smithi050 bash[28929]: audit 2024-05-20T22:13:55.850628+0000 mon.a (mon.0) 1944 : audit 1 from='client.26105 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-46"}]: dispatch 2024-05-20T22:13:57.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:56 smithi050 bash[28929]: audit 2024-05-20T22:13:55.872911+0000 mon.a (mon.0) 1945 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:13:57.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:56 smithi050 bash[28929]: cluster 2024-05-20T22:13:56.100808+0000 mgr.y (mgr.14592) 310 : cluster 0 pgmap v372: 388 pgs: 388 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 KiB/s wr, 1 op/s 2024-05-20T22:13:58.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:13:57 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:13:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:57 smithi145 bash[23893]: audit 2024-05-20T22:13:56.847735+0000 mon.a (mon.0) 1946 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi050-63936-36"}]': finished 2024-05-20T22:13:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:57 smithi145 bash[23893]: audit 2024-05-20T22:13:56.847947+0000 mon.a (mon.0) 1947 : audit 1 from='client.26105 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-46"}]': finished 2024-05-20T22:13:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:57 smithi145 bash[23893]: audit 2024-05-20T22:13:56.848127+0000 mon.a (mon.0) 1948 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-29", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:57 smithi145 bash[23893]: cluster 2024-05-20T22:13:56.858628+0000 mon.a (mon.0) 1949 : cluster 0 osdmap e241: 8 total, 8 up, 8 in 2024-05-20T22:13:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:57 smithi145 bash[23893]: audit 2024-05-20T22:13:56.860302+0000 mon.a (mon.0) 1950 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-29"}]: dispatch 2024-05-20T22:13:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:57 smithi145 bash[23893]: audit 2024-05-20T22:13:56.889175+0000 mon.a (mon.0) 1951 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi050-63936-37"}]: dispatch 2024-05-20T22:13:58.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:57 smithi145 bash[23893]: audit 2024-05-20T22:13:56.890671+0000 mon.a (mon.0) 1952 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi050-63936-37"}]: dispatch 2024-05-20T22:13:58.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:57 smithi145 bash[23893]: audit 2024-05-20T22:13:56.891189+0000 mon.a (mon.0) 1953 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi050-63936-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:58.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:57 smithi145 bash[23893]: audit 2024-05-20T22:13:56.892889+0000 mon.c (mon.2) 281 : audit 1 from='client.? v1:172.21.15.50:0/1692703538' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:13:58.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:57 smithi145 bash[23893]: audit 2024-05-20T22:13:56.893494+0000 mon.a (mon.0) 1954 : audit 1 from='client.26117 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:13:58.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:57 smithi145 bash[23893]: audit 2024-05-20T22:13:56.894401+0000 mon.c (mon.2) 282 : audit 1 from='client.? v1:172.21.15.50:0/1692703538' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:13:58.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:57 smithi145 bash[23893]: audit 2024-05-20T22:13:56.894666+0000 mon.a (mon.0) 1955 : audit 1 from='client.26117 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:13:58.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:57 smithi145 bash[23893]: audit 2024-05-20T22:13:56.895121+0000 mon.c (mon.2) 283 : audit 1 from='client.? v1:172.21.15.50:0/1692703538' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi050-63944-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:58.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:57 smithi145 bash[23893]: audit 2024-05-20T22:13:56.895401+0000 mon.a (mon.0) 1956 : audit 1 from='client.26117 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi050-63944-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:58.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:57 smithi050 bash[21866]: audit 2024-05-20T22:13:56.847735+0000 mon.a (mon.0) 1946 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi050-63936-36"}]': finished 2024-05-20T22:13:58.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:57 smithi050 bash[21866]: audit 2024-05-20T22:13:56.847947+0000 mon.a (mon.0) 1947 : audit 1 from='client.26105 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-46"}]': finished 2024-05-20T22:13:58.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:57 smithi050 bash[21866]: audit 2024-05-20T22:13:56.848127+0000 mon.a (mon.0) 1948 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-29", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:58.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:57 smithi050 bash[21866]: cluster 2024-05-20T22:13:56.858628+0000 mon.a (mon.0) 1949 : cluster 0 osdmap e241: 8 total, 8 up, 8 in 2024-05-20T22:13:58.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:57 smithi050 bash[21866]: audit 2024-05-20T22:13:56.860302+0000 mon.a (mon.0) 1950 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-29"}]: dispatch 2024-05-20T22:13:58.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:57 smithi050 bash[21866]: audit 2024-05-20T22:13:56.889175+0000 mon.a (mon.0) 1951 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi050-63936-37"}]: dispatch 2024-05-20T22:13:58.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:57 smithi050 bash[21866]: audit 2024-05-20T22:13:56.890671+0000 mon.a (mon.0) 1952 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi050-63936-37"}]: dispatch 2024-05-20T22:13:58.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:57 smithi050 bash[21866]: audit 2024-05-20T22:13:56.891189+0000 mon.a (mon.0) 1953 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi050-63936-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:58.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:57 smithi050 bash[21866]: audit 2024-05-20T22:13:56.892889+0000 mon.c (mon.2) 281 : audit 1 from='client.? v1:172.21.15.50:0/1692703538' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:13:58.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:57 smithi050 bash[21866]: audit 2024-05-20T22:13:56.893494+0000 mon.a (mon.0) 1954 : audit 1 from='client.26117 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:13:58.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:57 smithi050 bash[21866]: audit 2024-05-20T22:13:56.894401+0000 mon.c (mon.2) 282 : audit 1 from='client.? v1:172.21.15.50:0/1692703538' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:13:58.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:57 smithi050 bash[21866]: audit 2024-05-20T22:13:56.894666+0000 mon.a (mon.0) 1955 : audit 1 from='client.26117 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:13:58.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:57 smithi050 bash[21866]: audit 2024-05-20T22:13:56.895121+0000 mon.c (mon.2) 283 : audit 1 from='client.? v1:172.21.15.50:0/1692703538' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi050-63944-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:58.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:57 smithi050 bash[21866]: audit 2024-05-20T22:13:56.895401+0000 mon.a (mon.0) 1956 : audit 1 from='client.26117 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi050-63944-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:58.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:57 smithi050 bash[28929]: audit 2024-05-20T22:13:56.847735+0000 mon.a (mon.0) 1946 : audit 1 from='client.? v1:172.21.15.50:0/2258921867' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi050-63936-36"}]': finished 2024-05-20T22:13:58.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:57 smithi050 bash[28929]: audit 2024-05-20T22:13:56.847947+0000 mon.a (mon.0) 1947 : audit 1 from='client.26105 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-46"}]': finished 2024-05-20T22:13:58.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:57 smithi050 bash[28929]: audit 2024-05-20T22:13:56.848127+0000 mon.a (mon.0) 1948 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-29", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:13:58.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:57 smithi050 bash[28929]: cluster 2024-05-20T22:13:56.858628+0000 mon.a (mon.0) 1949 : cluster 0 osdmap e241: 8 total, 8 up, 8 in 2024-05-20T22:13:58.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:57 smithi050 bash[28929]: audit 2024-05-20T22:13:56.860302+0000 mon.a (mon.0) 1950 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-29"}]: dispatch 2024-05-20T22:13:58.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:57 smithi050 bash[28929]: audit 2024-05-20T22:13:56.889175+0000 mon.a (mon.0) 1951 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi050-63936-37"}]: dispatch 2024-05-20T22:13:58.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:57 smithi050 bash[28929]: audit 2024-05-20T22:13:56.890671+0000 mon.a (mon.0) 1952 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi050-63936-37"}]: dispatch 2024-05-20T22:13:58.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:57 smithi050 bash[28929]: audit 2024-05-20T22:13:56.891189+0000 mon.a (mon.0) 1953 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi050-63936-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:58.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:57 smithi050 bash[28929]: audit 2024-05-20T22:13:56.892889+0000 mon.c (mon.2) 281 : audit 1 from='client.? v1:172.21.15.50:0/1692703538' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:13:58.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:57 smithi050 bash[28929]: audit 2024-05-20T22:13:56.893494+0000 mon.a (mon.0) 1954 : audit 1 from='client.26117 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:13:58.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:57 smithi050 bash[28929]: audit 2024-05-20T22:13:56.894401+0000 mon.c (mon.2) 282 : audit 1 from='client.? v1:172.21.15.50:0/1692703538' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:13:58.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:57 smithi050 bash[28929]: audit 2024-05-20T22:13:56.894666+0000 mon.a (mon.0) 1955 : audit 1 from='client.26117 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:13:58.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:57 smithi050 bash[28929]: audit 2024-05-20T22:13:56.895121+0000 mon.c (mon.2) 283 : audit 1 from='client.? v1:172.21.15.50:0/1692703538' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi050-63944-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:58.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:57 smithi050 bash[28929]: audit 2024-05-20T22:13:56.895401+0000 mon.a (mon.0) 1956 : audit 1 from='client.26117 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi050-63944-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:13:59.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:13:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:13:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:14:00.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:59 smithi145 bash[23893]: audit 2024-05-20T22:13:57.818207+0000 mgr.y (mgr.14592) 311 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:14:00.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:59 smithi145 bash[23893]: audit 2024-05-20T22:13:57.850758+0000 mon.a (mon.0) 1957 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-29"}]': finished 2024-05-20T22:14:00.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:59 smithi145 bash[23893]: audit 2024-05-20T22:13:57.850922+0000 mon.a (mon.0) 1958 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi050-63936-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:00.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:59 smithi145 bash[23893]: audit 2024-05-20T22:13:57.851064+0000 mon.a (mon.0) 1959 : audit 1 from='client.26117 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi050-63944-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:00.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:59 smithi145 bash[23893]: audit 2024-05-20T22:13:57.857018+0000 mon.c (mon.2) 284 : audit 1 from='client.? v1:172.21.15.50:0/1692703538' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi050-63944-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:14:00.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:59 smithi145 bash[23893]: cluster 2024-05-20T22:13:57.857969+0000 mon.a (mon.0) 1960 : cluster 0 osdmap e242: 8 total, 8 up, 8 in 2024-05-20T22:14:00.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:59 smithi145 bash[23893]: audit 2024-05-20T22:13:57.859809+0000 mon.a (mon.0) 1961 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-29", "mode": "writeback"}]: dispatch 2024-05-20T22:14:00.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:59 smithi145 bash[23893]: audit 2024-05-20T22:13:57.860515+0000 mon.a (mon.0) 1962 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi050-63936-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi050-63936-37"}]: dispatch 2024-05-20T22:14:00.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:59 smithi145 bash[23893]: audit 2024-05-20T22:13:57.861956+0000 mon.a (mon.0) 1963 : audit 1 from='client.26117 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi050-63944-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:14:00.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:59 smithi145 bash[23893]: cluster 2024-05-20T22:13:58.101830+0000 mgr.y (mgr.14592) 312 : cluster 0 pgmap v375: 388 pgs: 388 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 KiB/s wr, 1 op/s 2024-05-20T22:14:00.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:59 smithi145 bash[23893]: cluster 2024-05-20T22:13:58.852067+0000 mon.a (mon.0) 1964 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:14:00.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:13:59 smithi145 bash[23893]: audit 2024-05-20T22:13:58.854346+0000 mon.a (mon.0) 1965 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-29", "mode": "writeback"}]': finished 2024-05-20T22:14:00.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:59 smithi050 bash[21866]: audit 2024-05-20T22:13:57.818207+0000 mgr.y (mgr.14592) 311 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:14:00.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:59 smithi050 bash[21866]: audit 2024-05-20T22:13:57.850758+0000 mon.a (mon.0) 1957 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-29"}]': finished 2024-05-20T22:14:00.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:59 smithi050 bash[21866]: audit 2024-05-20T22:13:57.850922+0000 mon.a (mon.0) 1958 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi050-63936-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:00.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:59 smithi050 bash[21866]: audit 2024-05-20T22:13:57.851064+0000 mon.a (mon.0) 1959 : audit 1 from='client.26117 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi050-63944-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:00.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:59 smithi050 bash[21866]: audit 2024-05-20T22:13:57.857018+0000 mon.c (mon.2) 284 : audit 1 from='client.? v1:172.21.15.50:0/1692703538' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi050-63944-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:14:00.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:59 smithi050 bash[21866]: cluster 2024-05-20T22:13:57.857969+0000 mon.a (mon.0) 1960 : cluster 0 osdmap e242: 8 total, 8 up, 8 in 2024-05-20T22:14:00.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:59 smithi050 bash[21866]: audit 2024-05-20T22:13:57.859809+0000 mon.a (mon.0) 1961 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-29", "mode": "writeback"}]: dispatch 2024-05-20T22:14:00.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:59 smithi050 bash[21866]: audit 2024-05-20T22:13:57.860515+0000 mon.a (mon.0) 1962 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi050-63936-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi050-63936-37"}]: dispatch 2024-05-20T22:14:00.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:59 smithi050 bash[21866]: audit 2024-05-20T22:13:57.861956+0000 mon.a (mon.0) 1963 : audit 1 from='client.26117 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi050-63944-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:14:00.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:59 smithi050 bash[21866]: cluster 2024-05-20T22:13:58.101830+0000 mgr.y (mgr.14592) 312 : cluster 0 pgmap v375: 388 pgs: 388 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 KiB/s wr, 1 op/s 2024-05-20T22:14:00.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:59 smithi050 bash[21866]: cluster 2024-05-20T22:13:58.852067+0000 mon.a (mon.0) 1964 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:14:00.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:13:59 smithi050 bash[21866]: audit 2024-05-20T22:13:58.854346+0000 mon.a (mon.0) 1965 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-29", "mode": "writeback"}]': finished 2024-05-20T22:14:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:59 smithi050 bash[28929]: audit 2024-05-20T22:13:57.818207+0000 mgr.y (mgr.14592) 311 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:14:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:59 smithi050 bash[28929]: audit 2024-05-20T22:13:57.850758+0000 mon.a (mon.0) 1957 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-29"}]': finished 2024-05-20T22:14:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:59 smithi050 bash[28929]: audit 2024-05-20T22:13:57.850922+0000 mon.a (mon.0) 1958 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi050-63936-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:59 smithi050 bash[28929]: audit 2024-05-20T22:13:57.851064+0000 mon.a (mon.0) 1959 : audit 1 from='client.26117 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi050-63944-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:59 smithi050 bash[28929]: audit 2024-05-20T22:13:57.857018+0000 mon.c (mon.2) 284 : audit 1 from='client.? v1:172.21.15.50:0/1692703538' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi050-63944-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:14:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:59 smithi050 bash[28929]: cluster 2024-05-20T22:13:57.857969+0000 mon.a (mon.0) 1960 : cluster 0 osdmap e242: 8 total, 8 up, 8 in 2024-05-20T22:14:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:59 smithi050 bash[28929]: audit 2024-05-20T22:13:57.859809+0000 mon.a (mon.0) 1961 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-29", "mode": "writeback"}]: dispatch 2024-05-20T22:14:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:59 smithi050 bash[28929]: audit 2024-05-20T22:13:57.860515+0000 mon.a (mon.0) 1962 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi050-63936-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi050-63936-37"}]: dispatch 2024-05-20T22:14:00.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:59 smithi050 bash[28929]: audit 2024-05-20T22:13:57.861956+0000 mon.a (mon.0) 1963 : audit 1 from='client.26117 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi050-63944-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:14:00.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:59 smithi050 bash[28929]: cluster 2024-05-20T22:13:58.101830+0000 mgr.y (mgr.14592) 312 : cluster 0 pgmap v375: 388 pgs: 388 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 KiB/s wr, 1 op/s 2024-05-20T22:14:00.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:59 smithi050 bash[28929]: cluster 2024-05-20T22:13:58.852067+0000 mon.a (mon.0) 1964 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:14:00.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:13:59 smithi050 bash[28929]: audit 2024-05-20T22:13:58.854346+0000 mon.a (mon.0) 1965 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-29", "mode": "writeback"}]': finished 2024-05-20T22:14:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:00 smithi145 bash[23893]: cluster 2024-05-20T22:13:59.789760+0000 mon.a (mon.0) 1966 : cluster 0 osdmap e243: 8 total, 8 up, 8 in 2024-05-20T22:14:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:00 smithi145 bash[23893]: audit 2024-05-20T22:13:59.858741+0000 mon.a (mon.0) 1967 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi050-63936-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi050-63936-37"}]': finished 2024-05-20T22:14:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:00 smithi145 bash[23893]: audit 2024-05-20T22:13:59.858936+0000 mon.a (mon.0) 1968 : audit 1 from='client.26117 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi050-63944-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi050-63944-47"}]': finished 2024-05-20T22:14:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:00 smithi145 bash[23893]: cluster 2024-05-20T22:13:59.868474+0000 mon.a (mon.0) 1969 : cluster 0 osdmap e244: 8 total, 8 up, 8 in 2024-05-20T22:14:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:00 smithi145 bash[23893]: cluster 2024-05-20T22:14:00.103751+0000 mgr.y (mgr.14592) 313 : cluster 0 pgmap v378: 404 pgs: 16 creating+peering, 388 active+clean; 8.6 MiB data, 571 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 3 op/s 2024-05-20T22:14:01.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:00 smithi050 bash[21866]: cluster 2024-05-20T22:13:59.789760+0000 mon.a (mon.0) 1966 : cluster 0 osdmap e243: 8 total, 8 up, 8 in 2024-05-20T22:14:01.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:00 smithi050 bash[21866]: audit 2024-05-20T22:13:59.858741+0000 mon.a (mon.0) 1967 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi050-63936-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi050-63936-37"}]': finished 2024-05-20T22:14:01.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:00 smithi050 bash[21866]: audit 2024-05-20T22:13:59.858936+0000 mon.a (mon.0) 1968 : audit 1 from='client.26117 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi050-63944-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi050-63944-47"}]': finished 2024-05-20T22:14:01.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:00 smithi050 bash[21866]: cluster 2024-05-20T22:13:59.868474+0000 mon.a (mon.0) 1969 : cluster 0 osdmap e244: 8 total, 8 up, 8 in 2024-05-20T22:14:01.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:00 smithi050 bash[21866]: cluster 2024-05-20T22:14:00.103751+0000 mgr.y (mgr.14592) 313 : cluster 0 pgmap v378: 404 pgs: 16 creating+peering, 388 active+clean; 8.6 MiB data, 571 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 3 op/s 2024-05-20T22:14:01.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:00 smithi050 bash[28929]: cluster 2024-05-20T22:13:59.789760+0000 mon.a (mon.0) 1966 : cluster 0 osdmap e243: 8 total, 8 up, 8 in 2024-05-20T22:14:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:00 smithi050 bash[28929]: audit 2024-05-20T22:13:59.858741+0000 mon.a (mon.0) 1967 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi050-63936-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi050-63936-37"}]': finished 2024-05-20T22:14:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:00 smithi050 bash[28929]: audit 2024-05-20T22:13:59.858936+0000 mon.a (mon.0) 1968 : audit 1 from='client.26117 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi050-63944-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi050-63944-47"}]': finished 2024-05-20T22:14:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:00 smithi050 bash[28929]: cluster 2024-05-20T22:13:59.868474+0000 mon.a (mon.0) 1969 : cluster 0 osdmap e244: 8 total, 8 up, 8 in 2024-05-20T22:14:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:00 smithi050 bash[28929]: cluster 2024-05-20T22:14:00.103751+0000 mgr.y (mgr.14592) 313 : cluster 0 pgmap v378: 404 pgs: 16 creating+peering, 388 active+clean; 8.6 MiB data, 571 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 3 op/s 2024-05-20T22:14:02.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:01 smithi145 bash[23893]: cluster 2024-05-20T22:14:00.858668+0000 mon.a (mon.0) 1970 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:02.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:01 smithi145 bash[23893]: cluster 2024-05-20T22:14:00.876997+0000 mon.a (mon.0) 1971 : cluster 0 osdmap e245: 8 total, 8 up, 8 in 2024-05-20T22:14:02.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:01 smithi050 bash[21866]: cluster 2024-05-20T22:14:00.858668+0000 mon.a (mon.0) 1970 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:02.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:01 smithi050 bash[21866]: cluster 2024-05-20T22:14:00.876997+0000 mon.a (mon.0) 1971 : cluster 0 osdmap e245: 8 total, 8 up, 8 in 2024-05-20T22:14:02.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:01 smithi050 bash[28929]: cluster 2024-05-20T22:14:00.858668+0000 mon.a (mon.0) 1970 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:02.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:01 smithi050 bash[28929]: cluster 2024-05-20T22:14:00.876997+0000 mon.a (mon.0) 1971 : cluster 0 osdmap e245: 8 total, 8 up, 8 in 2024-05-20T22:14:03.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:02 smithi145 bash[23893]: cluster 2024-05-20T22:14:01.879094+0000 mon.a (mon.0) 1972 : cluster 0 osdmap e246: 8 total, 8 up, 8 in 2024-05-20T22:14:03.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:02 smithi145 bash[23893]: audit 2024-05-20T22:14:01.881339+0000 mon.a (mon.0) 1973 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi050-63936-37"}]: dispatch 2024-05-20T22:14:03.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:02 smithi145 bash[23893]: audit 2024-05-20T22:14:01.882587+0000 mon.c (mon.2) 285 : audit 1 from='client.? v1:172.21.15.50:0/1692703538' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:14:03.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:02 smithi145 bash[23893]: audit 2024-05-20T22:14:01.884101+0000 mon.a (mon.0) 1974 : audit 1 from='client.26117 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:14:03.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:02 smithi145 bash[23893]: audit 2024-05-20T22:14:01.989931+0000 mon.a (mon.0) 1975 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:03.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:02 smithi145 bash[23893]: cluster 2024-05-20T22:14:02.104715+0000 mgr.y (mgr.14592) 314 : cluster 0 pgmap v381: 388 pgs: 388 active+clean; 8.6 MiB data, 571 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 3 op/s 2024-05-20T22:14:03.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:02 smithi050 bash[21866]: cluster 2024-05-20T22:14:01.879094+0000 mon.a (mon.0) 1972 : cluster 0 osdmap e246: 8 total, 8 up, 8 in 2024-05-20T22:14:03.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:02 smithi050 bash[21866]: audit 2024-05-20T22:14:01.881339+0000 mon.a (mon.0) 1973 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi050-63936-37"}]: dispatch 2024-05-20T22:14:03.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:02 smithi050 bash[21866]: audit 2024-05-20T22:14:01.882587+0000 mon.c (mon.2) 285 : audit 1 from='client.? v1:172.21.15.50:0/1692703538' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:14:03.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:02 smithi050 bash[21866]: audit 2024-05-20T22:14:01.884101+0000 mon.a (mon.0) 1974 : audit 1 from='client.26117 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:14:03.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:02 smithi050 bash[21866]: audit 2024-05-20T22:14:01.989931+0000 mon.a (mon.0) 1975 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:03.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:02 smithi050 bash[21866]: cluster 2024-05-20T22:14:02.104715+0000 mgr.y (mgr.14592) 314 : cluster 0 pgmap v381: 388 pgs: 388 active+clean; 8.6 MiB data, 571 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 3 op/s 2024-05-20T22:14:03.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:02 smithi050 bash[28929]: cluster 2024-05-20T22:14:01.879094+0000 mon.a (mon.0) 1972 : cluster 0 osdmap e246: 8 total, 8 up, 8 in 2024-05-20T22:14:03.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:02 smithi050 bash[28929]: audit 2024-05-20T22:14:01.881339+0000 mon.a (mon.0) 1973 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi050-63936-37"}]: dispatch 2024-05-20T22:14:03.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:02 smithi050 bash[28929]: audit 2024-05-20T22:14:01.882587+0000 mon.c (mon.2) 285 : audit 1 from='client.? v1:172.21.15.50:0/1692703538' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:14:03.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:02 smithi050 bash[28929]: audit 2024-05-20T22:14:01.884101+0000 mon.a (mon.0) 1974 : audit 1 from='client.26117 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:14:03.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:02 smithi050 bash[28929]: audit 2024-05-20T22:14:01.989931+0000 mon.a (mon.0) 1975 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:03.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:02 smithi050 bash[28929]: cluster 2024-05-20T22:14:02.104715+0000 mgr.y (mgr.14592) 314 : cluster 0 pgmap v381: 388 pgs: 388 active+clean; 8.6 MiB data, 571 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 3 op/s 2024-05-20T22:14:04.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:03 smithi050 bash[21866]: audit 2024-05-20T22:14:02.875133+0000 mon.a (mon.0) 1976 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi050-63936-37"}]': finished 2024-05-20T22:14:04.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:03 smithi050 bash[21866]: audit 2024-05-20T22:14:02.875276+0000 mon.a (mon.0) 1977 : audit 1 from='client.26117 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-47"}]': finished 2024-05-20T22:14:04.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:03 smithi050 bash[21866]: audit 2024-05-20T22:14:02.875423+0000 mon.a (mon.0) 1978 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:04.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:03 smithi050 bash[21866]: cluster 2024-05-20T22:14:02.883026+0000 mon.a (mon.0) 1979 : cluster 0 osdmap e247: 8 total, 8 up, 8 in 2024-05-20T22:14:04.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:03 smithi050 bash[21866]: audit 2024-05-20T22:14:02.883822+0000 mon.c (mon.2) 286 : audit 1 from='client.? v1:172.21.15.50:0/1692703538' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:14:04.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:03 smithi050 bash[21866]: audit 2024-05-20T22:14:02.892285+0000 mon.a (mon.0) 1980 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi050-63936-37"}]: dispatch 2024-05-20T22:14:04.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:03 smithi050 bash[21866]: audit 2024-05-20T22:14:02.892723+0000 mon.a (mon.0) 1981 : audit 1 from='client.26117 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:14:04.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:03 smithi050 bash[21866]: audit 2024-05-20T22:14:02.893149+0000 mon.a (mon.0) 1982 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-29"}]: dispatch 2024-05-20T22:14:04.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:03 smithi050 bash[21866]: cluster 2024-05-20T22:14:03.876477+0000 mon.a (mon.0) 1983 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:14:04.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:03 smithi050 bash[21866]: audit 2024-05-20T22:14:03.878896+0000 mon.a (mon.0) 1984 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi050-63936-37"}]': finished 2024-05-20T22:14:04.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:03 smithi050 bash[21866]: audit 2024-05-20T22:14:03.879033+0000 mon.a (mon.0) 1985 : audit 1 from='client.26117 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-47"}]': finished 2024-05-20T22:14:04.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:03 smithi050 bash[21866]: audit 2024-05-20T22:14:03.879238+0000 mon.a (mon.0) 1986 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-29"}]': finished 2024-05-20T22:14:04.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:03 smithi050 bash[21866]: cluster 2024-05-20T22:14:03.886719+0000 mon.a (mon.0) 1987 : cluster 0 osdmap e248: 8 total, 8 up, 8 in 2024-05-20T22:14:04.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:03 smithi050 bash[28929]: audit 2024-05-20T22:14:02.875133+0000 mon.a (mon.0) 1976 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi050-63936-37"}]': finished 2024-05-20T22:14:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:03 smithi050 bash[28929]: audit 2024-05-20T22:14:02.875276+0000 mon.a (mon.0) 1977 : audit 1 from='client.26117 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-47"}]': finished 2024-05-20T22:14:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:03 smithi050 bash[28929]: audit 2024-05-20T22:14:02.875423+0000 mon.a (mon.0) 1978 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:03 smithi050 bash[28929]: cluster 2024-05-20T22:14:02.883026+0000 mon.a (mon.0) 1979 : cluster 0 osdmap e247: 8 total, 8 up, 8 in 2024-05-20T22:14:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:03 smithi050 bash[28929]: audit 2024-05-20T22:14:02.883822+0000 mon.c (mon.2) 286 : audit 1 from='client.? v1:172.21.15.50:0/1692703538' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:14:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:03 smithi050 bash[28929]: audit 2024-05-20T22:14:02.892285+0000 mon.a (mon.0) 1980 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi050-63936-37"}]: dispatch 2024-05-20T22:14:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:03 smithi050 bash[28929]: audit 2024-05-20T22:14:02.892723+0000 mon.a (mon.0) 1981 : audit 1 from='client.26117 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:14:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:03 smithi050 bash[28929]: audit 2024-05-20T22:14:02.893149+0000 mon.a (mon.0) 1982 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-29"}]: dispatch 2024-05-20T22:14:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:03 smithi050 bash[28929]: cluster 2024-05-20T22:14:03.876477+0000 mon.a (mon.0) 1983 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:14:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:03 smithi050 bash[28929]: audit 2024-05-20T22:14:03.878896+0000 mon.a (mon.0) 1984 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi050-63936-37"}]': finished 2024-05-20T22:14:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:03 smithi050 bash[28929]: audit 2024-05-20T22:14:03.879033+0000 mon.a (mon.0) 1985 : audit 1 from='client.26117 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-47"}]': finished 2024-05-20T22:14:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:03 smithi050 bash[28929]: audit 2024-05-20T22:14:03.879238+0000 mon.a (mon.0) 1986 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-29"}]': finished 2024-05-20T22:14:04.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:03 smithi050 bash[28929]: cluster 2024-05-20T22:14:03.886719+0000 mon.a (mon.0) 1987 : cluster 0 osdmap e248: 8 total, 8 up, 8 in 2024-05-20T22:14:04.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:03 smithi145 bash[23893]: audit 2024-05-20T22:14:02.875133+0000 mon.a (mon.0) 1976 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi050-63936-37"}]': finished 2024-05-20T22:14:04.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:03 smithi145 bash[23893]: audit 2024-05-20T22:14:02.875276+0000 mon.a (mon.0) 1977 : audit 1 from='client.26117 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi050-63944-47"}]': finished 2024-05-20T22:14:04.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:03 smithi145 bash[23893]: audit 2024-05-20T22:14:02.875423+0000 mon.a (mon.0) 1978 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:04.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:03 smithi145 bash[23893]: cluster 2024-05-20T22:14:02.883026+0000 mon.a (mon.0) 1979 : cluster 0 osdmap e247: 8 total, 8 up, 8 in 2024-05-20T22:14:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:03 smithi145 bash[23893]: audit 2024-05-20T22:14:02.883822+0000 mon.c (mon.2) 286 : audit 1 from='client.? v1:172.21.15.50:0/1692703538' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:14:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:03 smithi145 bash[23893]: audit 2024-05-20T22:14:02.892285+0000 mon.a (mon.0) 1980 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi050-63936-37"}]: dispatch 2024-05-20T22:14:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:03 smithi145 bash[23893]: audit 2024-05-20T22:14:02.892723+0000 mon.a (mon.0) 1981 : audit 1 from='client.26117 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-47"}]: dispatch 2024-05-20T22:14:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:03 smithi145 bash[23893]: audit 2024-05-20T22:14:02.893149+0000 mon.a (mon.0) 1982 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-29"}]: dispatch 2024-05-20T22:14:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:03 smithi145 bash[23893]: cluster 2024-05-20T22:14:03.876477+0000 mon.a (mon.0) 1983 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:14:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:03 smithi145 bash[23893]: audit 2024-05-20T22:14:03.878896+0000 mon.a (mon.0) 1984 : audit 1 from='client.? v1:172.21.15.50:0/2815093388' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi050-63936-37"}]': finished 2024-05-20T22:14:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:03 smithi145 bash[23893]: audit 2024-05-20T22:14:03.879033+0000 mon.a (mon.0) 1985 : audit 1 from='client.26117 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi050-63944-47"}]': finished 2024-05-20T22:14:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:03 smithi145 bash[23893]: audit 2024-05-20T22:14:03.879238+0000 mon.a (mon.0) 1986 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-29"}]': finished 2024-05-20T22:14:04.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:03 smithi145 bash[23893]: cluster 2024-05-20T22:14:03.886719+0000 mon.a (mon.0) 1987 : cluster 0 osdmap e248: 8 total, 8 up, 8 in 2024-05-20T22:14:05.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:04 smithi050 bash[21866]: audit 2024-05-20T22:14:03.928373+0000 mon.c (mon.2) 287 : audit 1 from='client.? v1:172.21.15.50:0/1542499290' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:05.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:04 smithi050 bash[21866]: audit 2024-05-20T22:14:03.929046+0000 mon.a (mon.0) 1988 : audit 1 from='client.26126 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:05.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:04 smithi050 bash[21866]: audit 2024-05-20T22:14:03.930544+0000 mon.c (mon.2) 288 : audit 1 from='client.? v1:172.21.15.50:0/328999752' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:05.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:04 smithi050 bash[21866]: audit 2024-05-20T22:14:03.931158+0000 mon.c (mon.2) 289 : audit 1 from='client.? v1:172.21.15.50:0/1542499290' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:05.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:04 smithi050 bash[21866]: audit 2024-05-20T22:14:03.931375+0000 mon.a (mon.0) 1989 : audit 1 from='client.26129 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:05.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:04 smithi050 bash[21866]: audit 2024-05-20T22:14:03.931706+0000 mon.a (mon.0) 1990 : audit 1 from='client.26126 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:05.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:04 smithi050 bash[21866]: audit 2024-05-20T22:14:03.932259+0000 mon.c (mon.2) 290 : audit 1 from='client.? v1:172.21.15.50:0/1542499290' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi050-63944-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:05.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:04 smithi050 bash[21866]: audit 2024-05-20T22:14:03.932445+0000 mon.c (mon.2) 291 : audit 1 from='client.? v1:172.21.15.50:0/328999752' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:05.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:04 smithi050 bash[21866]: audit 2024-05-20T22:14:03.932586+0000 mon.a (mon.0) 1991 : audit 1 from='client.26126 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi050-63944-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:05.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:04 smithi050 bash[21866]: audit 2024-05-20T22:14:03.932990+0000 mon.a (mon.0) 1992 : audit 1 from='client.26129 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:05.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:04 smithi050 bash[21866]: audit 2024-05-20T22:14:03.933494+0000 mon.c (mon.2) 292 : audit 1 from='client.? v1:172.21.15.50:0/328999752' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi050-63936-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:05.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:04 smithi050 bash[21866]: audit 2024-05-20T22:14:03.933830+0000 mon.a (mon.0) 1993 : audit 1 from='client.26129 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi050-63936-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:05.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:04 smithi050 bash[21866]: cluster 2024-05-20T22:14:04.105681+0000 mgr.y (mgr.14592) 315 : cluster 0 pgmap v384: 388 pgs: 388 active+clean; 8.6 MiB data, 571 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:05.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:04 smithi050 bash[28929]: audit 2024-05-20T22:14:03.928373+0000 mon.c (mon.2) 287 : audit 1 from='client.? v1:172.21.15.50:0/1542499290' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:05.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:04 smithi050 bash[28929]: audit 2024-05-20T22:14:03.929046+0000 mon.a (mon.0) 1988 : audit 1 from='client.26126 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:05.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:04 smithi050 bash[28929]: audit 2024-05-20T22:14:03.930544+0000 mon.c (mon.2) 288 : audit 1 from='client.? v1:172.21.15.50:0/328999752' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:05.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:04 smithi050 bash[28929]: audit 2024-05-20T22:14:03.931158+0000 mon.c (mon.2) 289 : audit 1 from='client.? v1:172.21.15.50:0/1542499290' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:05.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:04 smithi050 bash[28929]: audit 2024-05-20T22:14:03.931375+0000 mon.a (mon.0) 1989 : audit 1 from='client.26129 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:05.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:04 smithi050 bash[28929]: audit 2024-05-20T22:14:03.931706+0000 mon.a (mon.0) 1990 : audit 1 from='client.26126 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:05.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:04 smithi050 bash[28929]: audit 2024-05-20T22:14:03.932259+0000 mon.c (mon.2) 290 : audit 1 from='client.? v1:172.21.15.50:0/1542499290' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi050-63944-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:05.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:04 smithi050 bash[28929]: audit 2024-05-20T22:14:03.932445+0000 mon.c (mon.2) 291 : audit 1 from='client.? v1:172.21.15.50:0/328999752' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:05.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:04 smithi050 bash[28929]: audit 2024-05-20T22:14:03.932586+0000 mon.a (mon.0) 1991 : audit 1 from='client.26126 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi050-63944-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:05.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:04 smithi050 bash[28929]: audit 2024-05-20T22:14:03.932990+0000 mon.a (mon.0) 1992 : audit 1 from='client.26129 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:05.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:04 smithi050 bash[28929]: audit 2024-05-20T22:14:03.933494+0000 mon.c (mon.2) 292 : audit 1 from='client.? v1:172.21.15.50:0/328999752' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi050-63936-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:05.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:04 smithi050 bash[28929]: audit 2024-05-20T22:14:03.933830+0000 mon.a (mon.0) 1993 : audit 1 from='client.26129 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi050-63936-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:05.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:04 smithi050 bash[28929]: cluster 2024-05-20T22:14:04.105681+0000 mgr.y (mgr.14592) 315 : cluster 0 pgmap v384: 388 pgs: 388 active+clean; 8.6 MiB data, 571 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:05.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:04 smithi145 bash[23893]: audit 2024-05-20T22:14:03.928373+0000 mon.c (mon.2) 287 : audit 1 from='client.? v1:172.21.15.50:0/1542499290' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:05.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:04 smithi145 bash[23893]: audit 2024-05-20T22:14:03.929046+0000 mon.a (mon.0) 1988 : audit 1 from='client.26126 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:05.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:04 smithi145 bash[23893]: audit 2024-05-20T22:14:03.930544+0000 mon.c (mon.2) 288 : audit 1 from='client.? v1:172.21.15.50:0/328999752' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:05.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:04 smithi145 bash[23893]: audit 2024-05-20T22:14:03.931158+0000 mon.c (mon.2) 289 : audit 1 from='client.? v1:172.21.15.50:0/1542499290' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:05.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:04 smithi145 bash[23893]: audit 2024-05-20T22:14:03.931375+0000 mon.a (mon.0) 1989 : audit 1 from='client.26129 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:05.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:04 smithi145 bash[23893]: audit 2024-05-20T22:14:03.931706+0000 mon.a (mon.0) 1990 : audit 1 from='client.26126 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:05.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:04 smithi145 bash[23893]: audit 2024-05-20T22:14:03.932259+0000 mon.c (mon.2) 290 : audit 1 from='client.? v1:172.21.15.50:0/1542499290' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi050-63944-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:05.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:04 smithi145 bash[23893]: audit 2024-05-20T22:14:03.932445+0000 mon.c (mon.2) 291 : audit 1 from='client.? v1:172.21.15.50:0/328999752' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:05.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:04 smithi145 bash[23893]: audit 2024-05-20T22:14:03.932586+0000 mon.a (mon.0) 1991 : audit 1 from='client.26126 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi050-63944-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:05.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:04 smithi145 bash[23893]: audit 2024-05-20T22:14:03.932990+0000 mon.a (mon.0) 1992 : audit 1 from='client.26129 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:05.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:04 smithi145 bash[23893]: audit 2024-05-20T22:14:03.933494+0000 mon.c (mon.2) 292 : audit 1 from='client.? v1:172.21.15.50:0/328999752' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi050-63936-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:05.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:04 smithi145 bash[23893]: audit 2024-05-20T22:14:03.933830+0000 mon.a (mon.0) 1993 : audit 1 from='client.26129 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi050-63936-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:05.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:04 smithi145 bash[23893]: cluster 2024-05-20T22:14:04.105681+0000 mgr.y (mgr.14592) 315 : cluster 0 pgmap v384: 388 pgs: 388 active+clean; 8.6 MiB data, 571 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:06.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:05 smithi050 bash[21866]: audit 2024-05-20T22:14:04.926282+0000 mon.a (mon.0) 1994 : audit 1 from='client.26126 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi050-63944-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:06.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:05 smithi050 bash[21866]: audit 2024-05-20T22:14:04.926523+0000 mon.a (mon.0) 1995 : audit 1 from='client.26129 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi050-63936-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:06.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:05 smithi050 bash[21866]: cluster 2024-05-20T22:14:04.936947+0000 mon.a (mon.0) 1996 : cluster 0 osdmap e249: 8 total, 8 up, 8 in 2024-05-20T22:14:06.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:05 smithi050 bash[21866]: audit 2024-05-20T22:14:04.938442+0000 mon.c (mon.2) 293 : audit 1 from='client.? v1:172.21.15.50:0/1542499290' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi050-63944-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:06.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:05 smithi050 bash[21866]: audit 2024-05-20T22:14:04.938895+0000 mon.c (mon.2) 294 : audit 1 from='client.? v1:172.21.15.50:0/328999752' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi050-63936-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:06.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:05 smithi050 bash[21866]: audit 2024-05-20T22:14:05.402083+0000 mon.a (mon.0) 1997 : audit 1 from='client.26126 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi050-63944-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:06.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:05 smithi050 bash[21866]: audit 2024-05-20T22:14:05.402464+0000 mon.a (mon.0) 1998 : audit 1 from='client.26129 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi050-63936-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:06.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:05 smithi050 bash[28929]: audit 2024-05-20T22:14:04.926282+0000 mon.a (mon.0) 1994 : audit 1 from='client.26126 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi050-63944-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:06.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:05 smithi050 bash[28929]: audit 2024-05-20T22:14:04.926523+0000 mon.a (mon.0) 1995 : audit 1 from='client.26129 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi050-63936-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:06.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:05 smithi050 bash[28929]: cluster 2024-05-20T22:14:04.936947+0000 mon.a (mon.0) 1996 : cluster 0 osdmap e249: 8 total, 8 up, 8 in 2024-05-20T22:14:06.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:05 smithi050 bash[28929]: audit 2024-05-20T22:14:04.938442+0000 mon.c (mon.2) 293 : audit 1 from='client.? v1:172.21.15.50:0/1542499290' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi050-63944-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:06.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:05 smithi050 bash[28929]: audit 2024-05-20T22:14:04.938895+0000 mon.c (mon.2) 294 : audit 1 from='client.? v1:172.21.15.50:0/328999752' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi050-63936-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:06.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:05 smithi050 bash[28929]: audit 2024-05-20T22:14:05.402083+0000 mon.a (mon.0) 1997 : audit 1 from='client.26126 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi050-63944-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:06.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:05 smithi050 bash[28929]: audit 2024-05-20T22:14:05.402464+0000 mon.a (mon.0) 1998 : audit 1 from='client.26129 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi050-63936-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:06.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:05 smithi145 bash[23893]: audit 2024-05-20T22:14:04.926282+0000 mon.a (mon.0) 1994 : audit 1 from='client.26126 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi050-63944-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:06.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:05 smithi145 bash[23893]: audit 2024-05-20T22:14:04.926523+0000 mon.a (mon.0) 1995 : audit 1 from='client.26129 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi050-63936-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:06.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:05 smithi145 bash[23893]: cluster 2024-05-20T22:14:04.936947+0000 mon.a (mon.0) 1996 : cluster 0 osdmap e249: 8 total, 8 up, 8 in 2024-05-20T22:14:06.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:05 smithi145 bash[23893]: audit 2024-05-20T22:14:04.938442+0000 mon.c (mon.2) 293 : audit 1 from='client.? v1:172.21.15.50:0/1542499290' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi050-63944-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:06.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:05 smithi145 bash[23893]: audit 2024-05-20T22:14:04.938895+0000 mon.c (mon.2) 294 : audit 1 from='client.? v1:172.21.15.50:0/328999752' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi050-63936-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:06.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:05 smithi145 bash[23893]: audit 2024-05-20T22:14:05.402083+0000 mon.a (mon.0) 1997 : audit 1 from='client.26126 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi050-63944-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:06.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:05 smithi145 bash[23893]: audit 2024-05-20T22:14:05.402464+0000 mon.a (mon.0) 1998 : audit 1 from='client.26129 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi050-63936-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:07.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:06 smithi145 bash[23893]: cluster 2024-05-20T22:14:06.106605+0000 mgr.y (mgr.14592) 316 : cluster 0 pgmap v387: 388 pgs: 32 unknown, 356 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:07.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:06 smithi145 bash[23893]: cluster 2024-05-20T22:14:06.864780+0000 mon.a (mon.0) 1999 : cluster 0 osdmap e250: 8 total, 8 up, 8 in 2024-05-20T22:14:07.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:06 smithi145 bash[23893]: audit 2024-05-20T22:14:06.872850+0000 mon.a (mon.0) 2000 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:14:07.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:06 smithi145 bash[23893]: audit 2024-05-20T22:14:06.873757+0000 mon.a (mon.0) 2001 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:07.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:06 smithi050 bash[21866]: cluster 2024-05-20T22:14:06.106605+0000 mgr.y (mgr.14592) 316 : cluster 0 pgmap v387: 388 pgs: 32 unknown, 356 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:07.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:06 smithi050 bash[21866]: cluster 2024-05-20T22:14:06.864780+0000 mon.a (mon.0) 1999 : cluster 0 osdmap e250: 8 total, 8 up, 8 in 2024-05-20T22:14:07.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:06 smithi050 bash[21866]: audit 2024-05-20T22:14:06.872850+0000 mon.a (mon.0) 2000 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:14:07.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:06 smithi050 bash[21866]: audit 2024-05-20T22:14:06.873757+0000 mon.a (mon.0) 2001 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:07.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:06 smithi050 bash[28929]: cluster 2024-05-20T22:14:06.106605+0000 mgr.y (mgr.14592) 316 : cluster 0 pgmap v387: 388 pgs: 32 unknown, 356 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:07.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:06 smithi050 bash[28929]: cluster 2024-05-20T22:14:06.864780+0000 mon.a (mon.0) 1999 : cluster 0 osdmap e250: 8 total, 8 up, 8 in 2024-05-20T22:14:07.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:06 smithi050 bash[28929]: audit 2024-05-20T22:14:06.872850+0000 mon.a (mon.0) 2000 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:14:07.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:06 smithi050 bash[28929]: audit 2024-05-20T22:14:06.873757+0000 mon.a (mon.0) 2001 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:08.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:14:07 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:14:08.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:07 smithi145 bash[23893]: cluster 2024-05-20T22:14:06.941859+0000 mon.a (mon.0) 2002 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:08.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:07 smithi145 bash[23893]: audit 2024-05-20T22:14:06.943750+0000 mon.a (mon.0) 2003 : audit 1 from='client.26126 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi050-63944-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi050-63944-48"}]': finished 2024-05-20T22:14:08.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:07 smithi145 bash[23893]: audit 2024-05-20T22:14:06.943989+0000 mon.a (mon.0) 2004 : audit 1 from='client.26129 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi050-63936-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi050-63936-38"}]': finished 2024-05-20T22:14:08.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:07 smithi145 bash[23893]: audit 2024-05-20T22:14:06.944173+0000 mon.a (mon.0) 2005 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:08.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:07 smithi145 bash[23893]: cluster 2024-05-20T22:14:06.954772+0000 mon.a (mon.0) 2006 : cluster 0 osdmap e251: 8 total, 8 up, 8 in 2024-05-20T22:14:08.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:07 smithi145 bash[23893]: audit 2024-05-20T22:14:06.962880+0000 mon.a (mon.0) 2007 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:14:08.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:07 smithi145 bash[23893]: audit 2024-05-20T22:14:07.946789+0000 mon.a (mon.0) 2008 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-31", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:14:08.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:07 smithi145 bash[23893]: cluster 2024-05-20T22:14:07.955328+0000 mon.a (mon.0) 2009 : cluster 0 osdmap e252: 8 total, 8 up, 8 in 2024-05-20T22:14:08.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:07 smithi145 bash[23893]: audit 2024-05-20T22:14:07.961735+0000 mon.a (mon.0) 2010 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-31"}]: dispatch 2024-05-20T22:14:08.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:07 smithi050 bash[21866]: cluster 2024-05-20T22:14:06.941859+0000 mon.a (mon.0) 2002 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:08.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:07 smithi050 bash[21866]: audit 2024-05-20T22:14:06.943750+0000 mon.a (mon.0) 2003 : audit 1 from='client.26126 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi050-63944-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi050-63944-48"}]': finished 2024-05-20T22:14:08.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:07 smithi050 bash[21866]: audit 2024-05-20T22:14:06.943989+0000 mon.a (mon.0) 2004 : audit 1 from='client.26129 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi050-63936-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi050-63936-38"}]': finished 2024-05-20T22:14:08.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:07 smithi050 bash[21866]: audit 2024-05-20T22:14:06.944173+0000 mon.a (mon.0) 2005 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:08.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:07 smithi050 bash[21866]: cluster 2024-05-20T22:14:06.954772+0000 mon.a (mon.0) 2006 : cluster 0 osdmap e251: 8 total, 8 up, 8 in 2024-05-20T22:14:08.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:07 smithi050 bash[21866]: audit 2024-05-20T22:14:06.962880+0000 mon.a (mon.0) 2007 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:14:08.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:07 smithi050 bash[21866]: audit 2024-05-20T22:14:07.946789+0000 mon.a (mon.0) 2008 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-31", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:14:08.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:07 smithi050 bash[21866]: cluster 2024-05-20T22:14:07.955328+0000 mon.a (mon.0) 2009 : cluster 0 osdmap e252: 8 total, 8 up, 8 in 2024-05-20T22:14:08.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:07 smithi050 bash[21866]: audit 2024-05-20T22:14:07.961735+0000 mon.a (mon.0) 2010 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-31"}]: dispatch 2024-05-20T22:14:08.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:07 smithi050 bash[28929]: cluster 2024-05-20T22:14:06.941859+0000 mon.a (mon.0) 2002 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:08.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:07 smithi050 bash[28929]: audit 2024-05-20T22:14:06.943750+0000 mon.a (mon.0) 2003 : audit 1 from='client.26126 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi050-63944-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi050-63944-48"}]': finished 2024-05-20T22:14:08.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:07 smithi050 bash[28929]: audit 2024-05-20T22:14:06.943989+0000 mon.a (mon.0) 2004 : audit 1 from='client.26129 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi050-63936-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi050-63936-38"}]': finished 2024-05-20T22:14:08.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:07 smithi050 bash[28929]: audit 2024-05-20T22:14:06.944173+0000 mon.a (mon.0) 2005 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:08.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:07 smithi050 bash[28929]: cluster 2024-05-20T22:14:06.954772+0000 mon.a (mon.0) 2006 : cluster 0 osdmap e251: 8 total, 8 up, 8 in 2024-05-20T22:14:08.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:07 smithi050 bash[28929]: audit 2024-05-20T22:14:06.962880+0000 mon.a (mon.0) 2007 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:14:08.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:07 smithi050 bash[28929]: audit 2024-05-20T22:14:07.946789+0000 mon.a (mon.0) 2008 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-31", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:14:08.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:07 smithi050 bash[28929]: cluster 2024-05-20T22:14:07.955328+0000 mon.a (mon.0) 2009 : cluster 0 osdmap e252: 8 total, 8 up, 8 in 2024-05-20T22:14:08.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:07 smithi050 bash[28929]: audit 2024-05-20T22:14:07.961735+0000 mon.a (mon.0) 2010 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-31"}]: dispatch 2024-05-20T22:14:09.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:08 smithi145 bash[23893]: audit 2024-05-20T22:14:07.820516+0000 mgr.y (mgr.14592) 317 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:14:09.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:08 smithi145 bash[23893]: cluster 2024-05-20T22:14:08.107744+0000 mgr.y (mgr.14592) 318 : cluster 0 pgmap v390: 404 pgs: 48 unknown, 356 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:09.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:08 smithi145 bash[23893]: audit 2024-05-20T22:14:08.836894+0000 mon.a (mon.0) 2011 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-31"}]': finished 2024-05-20T22:14:09.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:08 smithi145 bash[23893]: cluster 2024-05-20T22:14:08.844543+0000 mon.a (mon.0) 2012 : cluster 0 osdmap e253: 8 total, 8 up, 8 in 2024-05-20T22:14:09.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:08 smithi145 bash[23893]: audit 2024-05-20T22:14:08.845059+0000 mon.a (mon.0) 2013 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-31", "mode": "writeback"}]: dispatch 2024-05-20T22:14:09.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:08 smithi145 bash[23893]: audit 2024-05-20T22:14:08.849830+0000 mon.c (mon.2) 295 : audit 1 from='client.? v1:172.21.15.50:0/1542499290' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:09.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:08 smithi145 bash[23893]: audit 2024-05-20T22:14:08.850475+0000 mon.c (mon.2) 296 : audit 1 from='client.? v1:172.21.15.50:0/328999752' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:09.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:08 smithi145 bash[23893]: audit 2024-05-20T22:14:08.852648+0000 mon.a (mon.0) 2014 : audit 1 from='client.26126 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:09.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:08 smithi145 bash[23893]: audit 2024-05-20T22:14:08.852978+0000 mon.a (mon.0) 2015 : audit 1 from='client.26129 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:09.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:08 smithi050 bash[21866]: audit 2024-05-20T22:14:07.820516+0000 mgr.y (mgr.14592) 317 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:14:09.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:08 smithi050 bash[21866]: cluster 2024-05-20T22:14:08.107744+0000 mgr.y (mgr.14592) 318 : cluster 0 pgmap v390: 404 pgs: 48 unknown, 356 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:09.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:08 smithi050 bash[21866]: audit 2024-05-20T22:14:08.836894+0000 mon.a (mon.0) 2011 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-31"}]': finished 2024-05-20T22:14:09.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:08 smithi050 bash[21866]: cluster 2024-05-20T22:14:08.844543+0000 mon.a (mon.0) 2012 : cluster 0 osdmap e253: 8 total, 8 up, 8 in 2024-05-20T22:14:09.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:08 smithi050 bash[21866]: audit 2024-05-20T22:14:08.845059+0000 mon.a (mon.0) 2013 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-31", "mode": "writeback"}]: dispatch 2024-05-20T22:14:09.394 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:08 smithi050 bash[21866]: audit 2024-05-20T22:14:08.849830+0000 mon.c (mon.2) 295 : audit 1 from='client.? v1:172.21.15.50:0/1542499290' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:09.394 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:08 smithi050 bash[21866]: audit 2024-05-20T22:14:08.850475+0000 mon.c (mon.2) 296 : audit 1 from='client.? v1:172.21.15.50:0/328999752' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:09.394 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:08 smithi050 bash[21866]: audit 2024-05-20T22:14:08.852648+0000 mon.a (mon.0) 2014 : audit 1 from='client.26126 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:09.394 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:08 smithi050 bash[21866]: audit 2024-05-20T22:14:08.852978+0000 mon.a (mon.0) 2015 : audit 1 from='client.26129 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:09.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:08 smithi050 bash[28929]: audit 2024-05-20T22:14:07.820516+0000 mgr.y (mgr.14592) 317 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:14:09.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:08 smithi050 bash[28929]: cluster 2024-05-20T22:14:08.107744+0000 mgr.y (mgr.14592) 318 : cluster 0 pgmap v390: 404 pgs: 48 unknown, 356 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:09.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:08 smithi050 bash[28929]: audit 2024-05-20T22:14:08.836894+0000 mon.a (mon.0) 2011 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-31"}]': finished 2024-05-20T22:14:09.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:08 smithi050 bash[28929]: cluster 2024-05-20T22:14:08.844543+0000 mon.a (mon.0) 2012 : cluster 0 osdmap e253: 8 total, 8 up, 8 in 2024-05-20T22:14:09.394 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:08 smithi050 bash[28929]: audit 2024-05-20T22:14:08.845059+0000 mon.a (mon.0) 2013 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-31", "mode": "writeback"}]: dispatch 2024-05-20T22:14:09.395 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:08 smithi050 bash[28929]: audit 2024-05-20T22:14:08.849830+0000 mon.c (mon.2) 295 : audit 1 from='client.? v1:172.21.15.50:0/1542499290' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:09.395 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:08 smithi050 bash[28929]: audit 2024-05-20T22:14:08.850475+0000 mon.c (mon.2) 296 : audit 1 from='client.? v1:172.21.15.50:0/328999752' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:09.395 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:08 smithi050 bash[28929]: audit 2024-05-20T22:14:08.852648+0000 mon.a (mon.0) 2014 : audit 1 from='client.26126 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:09.395 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:08 smithi050 bash[28929]: audit 2024-05-20T22:14:08.852978+0000 mon.a (mon.0) 2015 : audit 1 from='client.26129 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:09.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:14:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:14:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:14:10.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:09 smithi145 bash[23893]: cluster 2024-05-20T22:14:09.837350+0000 mon.a (mon.0) 2016 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:14:10.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:09 smithi145 bash[23893]: audit 2024-05-20T22:14:09.839686+0000 mon.a (mon.0) 2017 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-31", "mode": "writeback"}]': finished 2024-05-20T22:14:10.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:09 smithi145 bash[23893]: audit 2024-05-20T22:14:09.839855+0000 mon.a (mon.0) 2018 : audit 1 from='client.26126 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi050-63944-48"}]': finished 2024-05-20T22:14:10.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:09 smithi145 bash[23893]: audit 2024-05-20T22:14:09.840030+0000 mon.a (mon.0) 2019 : audit 1 from='client.26129 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi050-63936-38"}]': finished 2024-05-20T22:14:10.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:09 smithi145 bash[23893]: cluster 2024-05-20T22:14:09.847796+0000 mon.a (mon.0) 2020 : cluster 0 osdmap e254: 8 total, 8 up, 8 in 2024-05-20T22:14:10.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:09 smithi145 bash[23893]: audit 2024-05-20T22:14:09.849004+0000 mon.c (mon.2) 297 : audit 1 from='client.? v1:172.21.15.50:0/328999752' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:10.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:09 smithi145 bash[23893]: audit 2024-05-20T22:14:09.849617+0000 mon.c (mon.2) 298 : audit 1 from='client.? v1:172.21.15.50:0/1542499290' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:10.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:09 smithi145 bash[23893]: audit 2024-05-20T22:14:09.850315+0000 mon.a (mon.0) 2021 : audit 1 from='client.26129 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:10.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:09 smithi145 bash[23893]: audit 2024-05-20T22:14:09.851772+0000 mon.a (mon.0) 2022 : audit 1 from='client.26126 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:10.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:09 smithi050 bash[21866]: cluster 2024-05-20T22:14:09.837350+0000 mon.a (mon.0) 2016 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:14:10.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:09 smithi050 bash[21866]: audit 2024-05-20T22:14:09.839686+0000 mon.a (mon.0) 2017 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-31", "mode": "writeback"}]': finished 2024-05-20T22:14:10.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:09 smithi050 bash[21866]: audit 2024-05-20T22:14:09.839855+0000 mon.a (mon.0) 2018 : audit 1 from='client.26126 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi050-63944-48"}]': finished 2024-05-20T22:14:10.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:09 smithi050 bash[21866]: audit 2024-05-20T22:14:09.840030+0000 mon.a (mon.0) 2019 : audit 1 from='client.26129 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi050-63936-38"}]': finished 2024-05-20T22:14:10.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:09 smithi050 bash[21866]: cluster 2024-05-20T22:14:09.847796+0000 mon.a (mon.0) 2020 : cluster 0 osdmap e254: 8 total, 8 up, 8 in 2024-05-20T22:14:10.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:09 smithi050 bash[21866]: audit 2024-05-20T22:14:09.849004+0000 mon.c (mon.2) 297 : audit 1 from='client.? v1:172.21.15.50:0/328999752' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:10.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:09 smithi050 bash[21866]: audit 2024-05-20T22:14:09.849617+0000 mon.c (mon.2) 298 : audit 1 from='client.? v1:172.21.15.50:0/1542499290' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:10.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:09 smithi050 bash[21866]: audit 2024-05-20T22:14:09.850315+0000 mon.a (mon.0) 2021 : audit 1 from='client.26129 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:10.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:09 smithi050 bash[21866]: audit 2024-05-20T22:14:09.851772+0000 mon.a (mon.0) 2022 : audit 1 from='client.26126 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:10.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:09 smithi050 bash[28929]: cluster 2024-05-20T22:14:09.837350+0000 mon.a (mon.0) 2016 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:14:10.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:09 smithi050 bash[28929]: audit 2024-05-20T22:14:09.839686+0000 mon.a (mon.0) 2017 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-31", "mode": "writeback"}]': finished 2024-05-20T22:14:10.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:09 smithi050 bash[28929]: audit 2024-05-20T22:14:09.839855+0000 mon.a (mon.0) 2018 : audit 1 from='client.26126 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi050-63944-48"}]': finished 2024-05-20T22:14:10.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:09 smithi050 bash[28929]: audit 2024-05-20T22:14:09.840030+0000 mon.a (mon.0) 2019 : audit 1 from='client.26129 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi050-63936-38"}]': finished 2024-05-20T22:14:10.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:09 smithi050 bash[28929]: cluster 2024-05-20T22:14:09.847796+0000 mon.a (mon.0) 2020 : cluster 0 osdmap e254: 8 total, 8 up, 8 in 2024-05-20T22:14:10.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:09 smithi050 bash[28929]: audit 2024-05-20T22:14:09.849004+0000 mon.c (mon.2) 297 : audit 1 from='client.? v1:172.21.15.50:0/328999752' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:10.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:09 smithi050 bash[28929]: audit 2024-05-20T22:14:09.849617+0000 mon.c (mon.2) 298 : audit 1 from='client.? v1:172.21.15.50:0/1542499290' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:10.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:09 smithi050 bash[28929]: audit 2024-05-20T22:14:09.850315+0000 mon.a (mon.0) 2021 : audit 1 from='client.26129 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi050-63936-38"}]: dispatch 2024-05-20T22:14:10.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:09 smithi050 bash[28929]: audit 2024-05-20T22:14:09.851772+0000 mon.a (mon.0) 2022 : audit 1 from='client.26126 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi050-63944-48"}]: dispatch 2024-05-20T22:14:11.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:10 smithi145 bash[23893]: audit 2024-05-20T22:14:10.041748+0000 mon.a (mon.0) 2023 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:11.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:10 smithi145 bash[23893]: cluster 2024-05-20T22:14:10.111191+0000 mgr.y (mgr.14592) 319 : cluster 0 pgmap v393: 388 pgs: 388 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:14:11.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:10 smithi145 bash[23893]: audit 2024-05-20T22:14:10.843550+0000 mon.a (mon.0) 2024 : audit 1 from='client.26129 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi050-63936-38"}]': finished 2024-05-20T22:14:11.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:10 smithi145 bash[23893]: audit 2024-05-20T22:14:10.843679+0000 mon.a (mon.0) 2025 : audit 1 from='client.26126 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi050-63944-48"}]': finished 2024-05-20T22:14:11.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:10 smithi145 bash[23893]: audit 2024-05-20T22:14:10.843774+0000 mon.a (mon.0) 2026 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:11.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:10 smithi145 bash[23893]: cluster 2024-05-20T22:14:10.851078+0000 mon.a (mon.0) 2027 : cluster 0 osdmap e255: 8 total, 8 up, 8 in 2024-05-20T22:14:11.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:10 smithi145 bash[23893]: audit 2024-05-20T22:14:10.854416+0000 mon.a (mon.0) 2028 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-31"}]: dispatch 2024-05-20T22:14:11.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:11 smithi145 bash[23893]: audit 2024-05-20T22:14:10.879024+0000 mon.c (mon.2) 299 : audit 1 from='client.? v1:172.21.15.50:0/2007113188' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:11.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:11 smithi145 bash[23893]: audit 2024-05-20T22:14:10.879771+0000 mon.a (mon.0) 2029 : audit 1 from='client.26135 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:11.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:11 smithi145 bash[23893]: audit 2024-05-20T22:14:10.880841+0000 mon.c (mon.2) 300 : audit 1 from='client.? v1:172.21.15.50:0/2007113188' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:11.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:11 smithi145 bash[23893]: audit 2024-05-20T22:14:10.881354+0000 mon.a (mon.0) 2030 : audit 1 from='client.26135 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:11.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:11 smithi145 bash[23893]: audit 2024-05-20T22:14:10.881846+0000 mon.c (mon.2) 301 : audit 1 from='client.? v1:172.21.15.50:0/2007113188' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi050-63936-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:11.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:11 smithi145 bash[23893]: audit 2024-05-20T22:14:10.882164+0000 mon.a (mon.0) 2031 : audit 1 from='client.26135 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi050-63936-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:11.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:11 smithi145 bash[23893]: audit 2024-05-20T22:14:10.884877+0000 mon.a (mon.0) 2032 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi050-63944-49"}]: dispatch 2024-05-20T22:14:11.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:11 smithi145 bash[23893]: audit 2024-05-20T22:14:10.886308+0000 mon.a (mon.0) 2033 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi050-63944-49"}]: dispatch 2024-05-20T22:14:11.393 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:11 smithi145 bash[23893]: audit 2024-05-20T22:14:10.886619+0000 mon.a (mon.0) 2034 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi050-63944-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:11.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:11 smithi050 bash[21866]: audit 2024-05-20T22:14:10.041748+0000 mon.a (mon.0) 2023 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:11.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:11 smithi050 bash[21866]: cluster 2024-05-20T22:14:10.111191+0000 mgr.y (mgr.14592) 319 : cluster 0 pgmap v393: 388 pgs: 388 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:14:11.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:11 smithi050 bash[21866]: audit 2024-05-20T22:14:10.843550+0000 mon.a (mon.0) 2024 : audit 1 from='client.26129 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi050-63936-38"}]': finished 2024-05-20T22:14:11.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:11 smithi050 bash[21866]: audit 2024-05-20T22:14:10.843679+0000 mon.a (mon.0) 2025 : audit 1 from='client.26126 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi050-63944-48"}]': finished 2024-05-20T22:14:11.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:11 smithi050 bash[21866]: audit 2024-05-20T22:14:10.843774+0000 mon.a (mon.0) 2026 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:11.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:11 smithi050 bash[21866]: cluster 2024-05-20T22:14:10.851078+0000 mon.a (mon.0) 2027 : cluster 0 osdmap e255: 8 total, 8 up, 8 in 2024-05-20T22:14:11.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:11 smithi050 bash[21866]: audit 2024-05-20T22:14:10.854416+0000 mon.a (mon.0) 2028 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-31"}]: dispatch 2024-05-20T22:14:11.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:11 smithi050 bash[21866]: audit 2024-05-20T22:14:10.879024+0000 mon.c (mon.2) 299 : audit 1 from='client.? v1:172.21.15.50:0/2007113188' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:11.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:11 smithi050 bash[21866]: audit 2024-05-20T22:14:10.879771+0000 mon.a (mon.0) 2029 : audit 1 from='client.26135 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:11.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:11 smithi050 bash[21866]: audit 2024-05-20T22:14:10.880841+0000 mon.c (mon.2) 300 : audit 1 from='client.? v1:172.21.15.50:0/2007113188' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:11.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:11 smithi050 bash[21866]: audit 2024-05-20T22:14:10.881354+0000 mon.a (mon.0) 2030 : audit 1 from='client.26135 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:11.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:11 smithi050 bash[21866]: audit 2024-05-20T22:14:10.881846+0000 mon.c (mon.2) 301 : audit 1 from='client.? v1:172.21.15.50:0/2007113188' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi050-63936-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:11.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:11 smithi050 bash[21866]: audit 2024-05-20T22:14:10.882164+0000 mon.a (mon.0) 2031 : audit 1 from='client.26135 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi050-63936-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:11.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:11 smithi050 bash[21866]: audit 2024-05-20T22:14:10.884877+0000 mon.a (mon.0) 2032 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi050-63944-49"}]: dispatch 2024-05-20T22:14:11.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:11 smithi050 bash[21866]: audit 2024-05-20T22:14:10.886308+0000 mon.a (mon.0) 2033 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi050-63944-49"}]: dispatch 2024-05-20T22:14:11.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:11 smithi050 bash[21866]: audit 2024-05-20T22:14:10.886619+0000 mon.a (mon.0) 2034 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi050-63944-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:11.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:11 smithi050 bash[28929]: audit 2024-05-20T22:14:10.041748+0000 mon.a (mon.0) 2023 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:11.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:11 smithi050 bash[28929]: cluster 2024-05-20T22:14:10.111191+0000 mgr.y (mgr.14592) 319 : cluster 0 pgmap v393: 388 pgs: 388 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:14:11.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:11 smithi050 bash[28929]: audit 2024-05-20T22:14:10.843550+0000 mon.a (mon.0) 2024 : audit 1 from='client.26129 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi050-63936-38"}]': finished 2024-05-20T22:14:11.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:11 smithi050 bash[28929]: audit 2024-05-20T22:14:10.843679+0000 mon.a (mon.0) 2025 : audit 1 from='client.26126 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi050-63944-48"}]': finished 2024-05-20T22:14:11.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:11 smithi050 bash[28929]: audit 2024-05-20T22:14:10.843774+0000 mon.a (mon.0) 2026 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:11.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:11 smithi050 bash[28929]: cluster 2024-05-20T22:14:10.851078+0000 mon.a (mon.0) 2027 : cluster 0 osdmap e255: 8 total, 8 up, 8 in 2024-05-20T22:14:11.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:11 smithi050 bash[28929]: audit 2024-05-20T22:14:10.854416+0000 mon.a (mon.0) 2028 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-31"}]: dispatch 2024-05-20T22:14:11.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:11 smithi050 bash[28929]: audit 2024-05-20T22:14:10.879024+0000 mon.c (mon.2) 299 : audit 1 from='client.? v1:172.21.15.50:0/2007113188' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:11.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:11 smithi050 bash[28929]: audit 2024-05-20T22:14:10.879771+0000 mon.a (mon.0) 2029 : audit 1 from='client.26135 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:11.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:11 smithi050 bash[28929]: audit 2024-05-20T22:14:10.880841+0000 mon.c (mon.2) 300 : audit 1 from='client.? v1:172.21.15.50:0/2007113188' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:11.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:11 smithi050 bash[28929]: audit 2024-05-20T22:14:10.881354+0000 mon.a (mon.0) 2030 : audit 1 from='client.26135 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:11.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:11 smithi050 bash[28929]: audit 2024-05-20T22:14:10.881846+0000 mon.c (mon.2) 301 : audit 1 from='client.? v1:172.21.15.50:0/2007113188' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi050-63936-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:11.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:11 smithi050 bash[28929]: audit 2024-05-20T22:14:10.882164+0000 mon.a (mon.0) 2031 : audit 1 from='client.26135 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi050-63936-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:11.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:11 smithi050 bash[28929]: audit 2024-05-20T22:14:10.884877+0000 mon.a (mon.0) 2032 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi050-63944-49"}]: dispatch 2024-05-20T22:14:11.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:11 smithi050 bash[28929]: audit 2024-05-20T22:14:10.886308+0000 mon.a (mon.0) 2033 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi050-63944-49"}]: dispatch 2024-05-20T22:14:11.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:11 smithi050 bash[28929]: audit 2024-05-20T22:14:10.886619+0000 mon.a (mon.0) 2034 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi050-63944-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:12.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:12 smithi145 bash[23893]: cluster 2024-05-20T22:14:11.844021+0000 mon.a (mon.0) 2035 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:14:12.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:12 smithi145 bash[23893]: audit 2024-05-20T22:14:11.846355+0000 mon.a (mon.0) 2036 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-31"}]': finished 2024-05-20T22:14:12.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:12 smithi145 bash[23893]: audit 2024-05-20T22:14:11.846510+0000 mon.a (mon.0) 2037 : audit 1 from='client.26135 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi050-63936-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:12.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:12 smithi145 bash[23893]: audit 2024-05-20T22:14:11.846643+0000 mon.a (mon.0) 2038 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi050-63944-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:12.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:12 smithi145 bash[23893]: cluster 2024-05-20T22:14:11.855081+0000 mon.a (mon.0) 2039 : cluster 0 osdmap e256: 8 total, 8 up, 8 in 2024-05-20T22:14:12.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:12 smithi145 bash[23893]: audit 2024-05-20T22:14:11.856011+0000 mon.c (mon.2) 302 : audit 1 from='client.? v1:172.21.15.50:0/2007113188' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi050-63936-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:12.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:12 smithi145 bash[23893]: audit 2024-05-20T22:14:11.858951+0000 mon.a (mon.0) 2040 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi050-63944-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi050-63944-49"}]: dispatch 2024-05-20T22:14:12.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:12 smithi145 bash[23893]: audit 2024-05-20T22:14:11.859961+0000 mon.a (mon.0) 2041 : audit 1 from='client.26135 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi050-63936-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:12.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:12 smithi050 bash[21866]: cluster 2024-05-20T22:14:11.844021+0000 mon.a (mon.0) 2035 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:14:12.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:12 smithi050 bash[21866]: audit 2024-05-20T22:14:11.846355+0000 mon.a (mon.0) 2036 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-31"}]': finished 2024-05-20T22:14:12.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:12 smithi050 bash[21866]: audit 2024-05-20T22:14:11.846510+0000 mon.a (mon.0) 2037 : audit 1 from='client.26135 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi050-63936-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:12.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:12 smithi050 bash[21866]: audit 2024-05-20T22:14:11.846643+0000 mon.a (mon.0) 2038 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi050-63944-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:12.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:12 smithi050 bash[21866]: cluster 2024-05-20T22:14:11.855081+0000 mon.a (mon.0) 2039 : cluster 0 osdmap e256: 8 total, 8 up, 8 in 2024-05-20T22:14:12.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:12 smithi050 bash[21866]: audit 2024-05-20T22:14:11.856011+0000 mon.c (mon.2) 302 : audit 1 from='client.? v1:172.21.15.50:0/2007113188' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi050-63936-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:12.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:12 smithi050 bash[21866]: audit 2024-05-20T22:14:11.858951+0000 mon.a (mon.0) 2040 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi050-63944-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi050-63944-49"}]: dispatch 2024-05-20T22:14:12.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:12 smithi050 bash[21866]: audit 2024-05-20T22:14:11.859961+0000 mon.a (mon.0) 2041 : audit 1 from='client.26135 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi050-63936-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:12.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:12 smithi050 bash[28929]: cluster 2024-05-20T22:14:11.844021+0000 mon.a (mon.0) 2035 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:14:12.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:12 smithi050 bash[28929]: audit 2024-05-20T22:14:11.846355+0000 mon.a (mon.0) 2036 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-31"}]': finished 2024-05-20T22:14:12.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:12 smithi050 bash[28929]: audit 2024-05-20T22:14:11.846510+0000 mon.a (mon.0) 2037 : audit 1 from='client.26135 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi050-63936-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:12.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:12 smithi050 bash[28929]: audit 2024-05-20T22:14:11.846643+0000 mon.a (mon.0) 2038 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi050-63944-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:12.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:12 smithi050 bash[28929]: cluster 2024-05-20T22:14:11.855081+0000 mon.a (mon.0) 2039 : cluster 0 osdmap e256: 8 total, 8 up, 8 in 2024-05-20T22:14:12.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:12 smithi050 bash[28929]: audit 2024-05-20T22:14:11.856011+0000 mon.c (mon.2) 302 : audit 1 from='client.? v1:172.21.15.50:0/2007113188' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi050-63936-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:12.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:12 smithi050 bash[28929]: audit 2024-05-20T22:14:11.858951+0000 mon.a (mon.0) 2040 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi050-63944-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi050-63944-49"}]: dispatch 2024-05-20T22:14:12.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:12 smithi050 bash[28929]: audit 2024-05-20T22:14:11.859961+0000 mon.a (mon.0) 2041 : audit 1 from='client.26135 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi050-63936-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:14.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:14 smithi145 bash[23893]: cluster 2024-05-20T22:14:12.112230+0000 mgr.y (mgr.14592) 320 : cluster 0 pgmap v396: 388 pgs: 388 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:14:14.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:14 smithi050 bash[21866]: cluster 2024-05-20T22:14:12.112230+0000 mgr.y (mgr.14592) 320 : cluster 0 pgmap v396: 388 pgs: 388 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:14:14.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:14 smithi050 bash[28929]: cluster 2024-05-20T22:14:12.112230+0000 mgr.y (mgr.14592) 320 : cluster 0 pgmap v396: 388 pgs: 388 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:14:15.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:15 smithi145 bash[23893]: cluster 2024-05-20T22:14:13.745397+0000 mon.a (mon.0) 2042 : cluster 0 osdmap e257: 8 total, 8 up, 8 in 2024-05-20T22:14:15.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:15 smithi145 bash[23893]: cluster 2024-05-20T22:14:14.113153+0000 mgr.y (mgr.14592) 321 : cluster 0 pgmap v398: 356 pgs: 356 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:15.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:15 smithi145 bash[23893]: cluster 2024-05-20T22:14:14.200870+0000 mon.a (mon.0) 2043 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:15.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:15 smithi145 bash[23893]: audit 2024-05-20T22:14:14.211330+0000 mon.a (mon.0) 2044 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi050-63944-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi050-63944-49"}]': finished 2024-05-20T22:14:15.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:15 smithi145 bash[23893]: audit 2024-05-20T22:14:14.211515+0000 mon.a (mon.0) 2045 : audit 1 from='client.26135 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi050-63936-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi050-63936-39"}]': finished 2024-05-20T22:14:15.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:15 smithi145 bash[23893]: cluster 2024-05-20T22:14:14.220665+0000 mon.a (mon.0) 2046 : cluster 0 osdmap e258: 8 total, 8 up, 8 in 2024-05-20T22:14:15.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:15 smithi145 bash[23893]: audit 2024-05-20T22:14:14.225233+0000 mon.a (mon.0) 2047 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:15.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:15 smithi050 bash[21866]: cluster 2024-05-20T22:14:13.745397+0000 mon.a (mon.0) 2042 : cluster 0 osdmap e257: 8 total, 8 up, 8 in 2024-05-20T22:14:15.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:15 smithi050 bash[21866]: cluster 2024-05-20T22:14:14.113153+0000 mgr.y (mgr.14592) 321 : cluster 0 pgmap v398: 356 pgs: 356 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:15.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:15 smithi050 bash[21866]: cluster 2024-05-20T22:14:14.200870+0000 mon.a (mon.0) 2043 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:15.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:15 smithi050 bash[21866]: audit 2024-05-20T22:14:14.211330+0000 mon.a (mon.0) 2044 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi050-63944-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi050-63944-49"}]': finished 2024-05-20T22:14:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:15 smithi050 bash[21866]: audit 2024-05-20T22:14:14.211515+0000 mon.a (mon.0) 2045 : audit 1 from='client.26135 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi050-63936-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi050-63936-39"}]': finished 2024-05-20T22:14:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:15 smithi050 bash[21866]: cluster 2024-05-20T22:14:14.220665+0000 mon.a (mon.0) 2046 : cluster 0 osdmap e258: 8 total, 8 up, 8 in 2024-05-20T22:14:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:15 smithi050 bash[21866]: audit 2024-05-20T22:14:14.225233+0000 mon.a (mon.0) 2047 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:15.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:15 smithi050 bash[28929]: cluster 2024-05-20T22:14:13.745397+0000 mon.a (mon.0) 2042 : cluster 0 osdmap e257: 8 total, 8 up, 8 in 2024-05-20T22:14:15.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:15 smithi050 bash[28929]: cluster 2024-05-20T22:14:14.113153+0000 mgr.y (mgr.14592) 321 : cluster 0 pgmap v398: 356 pgs: 356 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:15.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:15 smithi050 bash[28929]: cluster 2024-05-20T22:14:14.200870+0000 mon.a (mon.0) 2043 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:15.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:15 smithi050 bash[28929]: audit 2024-05-20T22:14:14.211330+0000 mon.a (mon.0) 2044 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi050-63944-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi050-63944-49"}]': finished 2024-05-20T22:14:15.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:15 smithi050 bash[28929]: audit 2024-05-20T22:14:14.211515+0000 mon.a (mon.0) 2045 : audit 1 from='client.26135 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi050-63936-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi050-63936-39"}]': finished 2024-05-20T22:14:15.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:15 smithi050 bash[28929]: cluster 2024-05-20T22:14:14.220665+0000 mon.a (mon.0) 2046 : cluster 0 osdmap e258: 8 total, 8 up, 8 in 2024-05-20T22:14:15.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:15 smithi050 bash[28929]: audit 2024-05-20T22:14:14.225233+0000 mon.a (mon.0) 2047 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:16.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:16 smithi145 bash[23893]: audit 2024-05-20T22:14:15.224996+0000 mon.a (mon.0) 2048 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:16.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:16 smithi145 bash[23893]: cluster 2024-05-20T22:14:15.233601+0000 mon.a (mon.0) 2049 : cluster 0 osdmap e259: 8 total, 8 up, 8 in 2024-05-20T22:14:16.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:16 smithi145 bash[23893]: audit 2024-05-20T22:14:15.240264+0000 mon.a (mon.0) 2050 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:14:16.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:16 smithi050 bash[21866]: audit 2024-05-20T22:14:15.224996+0000 mon.a (mon.0) 2048 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:16.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:16 smithi050 bash[21866]: cluster 2024-05-20T22:14:15.233601+0000 mon.a (mon.0) 2049 : cluster 0 osdmap e259: 8 total, 8 up, 8 in 2024-05-20T22:14:16.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:16 smithi050 bash[21866]: audit 2024-05-20T22:14:15.240264+0000 mon.a (mon.0) 2050 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:14:16.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:16 smithi050 bash[28929]: audit 2024-05-20T22:14:15.224996+0000 mon.a (mon.0) 2048 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:16.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:16 smithi050 bash[28929]: cluster 2024-05-20T22:14:15.233601+0000 mon.a (mon.0) 2049 : cluster 0 osdmap e259: 8 total, 8 up, 8 in 2024-05-20T22:14:16.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:16 smithi050 bash[28929]: audit 2024-05-20T22:14:15.240264+0000 mon.a (mon.0) 2050 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:14:17.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:17 smithi145 bash[23893]: cluster 2024-05-20T22:14:16.114344+0000 mgr.y (mgr.14592) 322 : cluster 0 pgmap v401: 404 pgs: 48 creating+peering, 356 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:17.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:17 smithi145 bash[23893]: audit 2024-05-20T22:14:16.234108+0000 mon.a (mon.0) 2051 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-33", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:14:17.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:17 smithi145 bash[23893]: cluster 2024-05-20T22:14:16.243931+0000 mon.a (mon.0) 2052 : cluster 0 osdmap e260: 8 total, 8 up, 8 in 2024-05-20T22:14:17.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:17 smithi145 bash[23893]: audit 2024-05-20T22:14:16.244823+0000 mon.a (mon.0) 2053 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-33"}]: dispatch 2024-05-20T22:14:17.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:17 smithi145 bash[23893]: audit 2024-05-20T22:14:16.250564+0000 mon.c (mon.2) 303 : audit 1 from='client.? v1:172.21.15.50:0/2007113188' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:17.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:17 smithi145 bash[23893]: audit 2024-05-20T22:14:16.256173+0000 mon.a (mon.0) 2054 : audit 1 from='client.26135 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:17.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:17 smithi145 bash[23893]: audit 2024-05-20T22:14:16.256703+0000 mon.a (mon.0) 2055 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi050-63944-49"}]: dispatch 2024-05-20T22:14:17.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:17 smithi050 bash[21866]: cluster 2024-05-20T22:14:16.114344+0000 mgr.y (mgr.14592) 322 : cluster 0 pgmap v401: 404 pgs: 48 creating+peering, 356 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:17.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:17 smithi050 bash[21866]: audit 2024-05-20T22:14:16.234108+0000 mon.a (mon.0) 2051 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-33", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:14:17.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:17 smithi050 bash[21866]: cluster 2024-05-20T22:14:16.243931+0000 mon.a (mon.0) 2052 : cluster 0 osdmap e260: 8 total, 8 up, 8 in 2024-05-20T22:14:17.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:17 smithi050 bash[21866]: audit 2024-05-20T22:14:16.244823+0000 mon.a (mon.0) 2053 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-33"}]: dispatch 2024-05-20T22:14:17.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:17 smithi050 bash[21866]: audit 2024-05-20T22:14:16.250564+0000 mon.c (mon.2) 303 : audit 1 from='client.? v1:172.21.15.50:0/2007113188' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:17.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:17 smithi050 bash[21866]: audit 2024-05-20T22:14:16.256173+0000 mon.a (mon.0) 2054 : audit 1 from='client.26135 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:17.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:17 smithi050 bash[21866]: audit 2024-05-20T22:14:16.256703+0000 mon.a (mon.0) 2055 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi050-63944-49"}]: dispatch 2024-05-20T22:14:17.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:17 smithi050 bash[28929]: cluster 2024-05-20T22:14:16.114344+0000 mgr.y (mgr.14592) 322 : cluster 0 pgmap v401: 404 pgs: 48 creating+peering, 356 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:17.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:17 smithi050 bash[28929]: audit 2024-05-20T22:14:16.234108+0000 mon.a (mon.0) 2051 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-33", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:14:17.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:17 smithi050 bash[28929]: cluster 2024-05-20T22:14:16.243931+0000 mon.a (mon.0) 2052 : cluster 0 osdmap e260: 8 total, 8 up, 8 in 2024-05-20T22:14:17.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:17 smithi050 bash[28929]: audit 2024-05-20T22:14:16.244823+0000 mon.a (mon.0) 2053 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-33"}]: dispatch 2024-05-20T22:14:17.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:17 smithi050 bash[28929]: audit 2024-05-20T22:14:16.250564+0000 mon.c (mon.2) 303 : audit 1 from='client.? v1:172.21.15.50:0/2007113188' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:17.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:17 smithi050 bash[28929]: audit 2024-05-20T22:14:16.256173+0000 mon.a (mon.0) 2054 : audit 1 from='client.26135 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:17.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:17 smithi050 bash[28929]: audit 2024-05-20T22:14:16.256703+0000 mon.a (mon.0) 2055 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi050-63944-49"}]: dispatch 2024-05-20T22:14:18.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:14:17 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:14:18.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:18 smithi145 bash[23893]: audit 2024-05-20T22:14:17.237018+0000 mon.a (mon.0) 2056 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-33"}]': finished 2024-05-20T22:14:18.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:18 smithi145 bash[23893]: audit 2024-05-20T22:14:17.237201+0000 mon.a (mon.0) 2057 : audit 1 from='client.26135 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi050-63936-39"}]': finished 2024-05-20T22:14:18.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:18 smithi145 bash[23893]: audit 2024-05-20T22:14:17.237361+0000 mon.a (mon.0) 2058 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi050-63944-49"}]': finished 2024-05-20T22:14:18.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:18 smithi145 bash[23893]: cluster 2024-05-20T22:14:17.245136+0000 mon.a (mon.0) 2059 : cluster 0 osdmap e261: 8 total, 8 up, 8 in 2024-05-20T22:14:18.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:18 smithi145 bash[23893]: audit 2024-05-20T22:14:17.247160+0000 mon.a (mon.0) 2060 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-33", "mode": "writeback"}]: dispatch 2024-05-20T22:14:18.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:18 smithi145 bash[23893]: audit 2024-05-20T22:14:17.247575+0000 mon.c (mon.2) 304 : audit 1 from='client.? v1:172.21.15.50:0/2007113188' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:18.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:18 smithi145 bash[23893]: audit 2024-05-20T22:14:17.247840+0000 mon.a (mon.0) 2061 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi050-63944-49"}]: dispatch 2024-05-20T22:14:18.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:18 smithi145 bash[23893]: audit 2024-05-20T22:14:17.264410+0000 mon.a (mon.0) 2062 : audit 1 from='client.26135 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:18.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:18 smithi145 bash[23893]: cluster 2024-05-20T22:14:18.238304+0000 mon.a (mon.0) 2063 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:14:18.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:18 smithi145 bash[23893]: audit 2024-05-20T22:14:18.240704+0000 mon.a (mon.0) 2064 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-33", "mode": "writeback"}]': finished 2024-05-20T22:14:18.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:18 smithi145 bash[23893]: audit 2024-05-20T22:14:18.240873+0000 mon.a (mon.0) 2065 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi050-63944-49"}]': finished 2024-05-20T22:14:18.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:18 smithi050 bash[21866]: audit 2024-05-20T22:14:17.237018+0000 mon.a (mon.0) 2056 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-33"}]': finished 2024-05-20T22:14:18.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:18 smithi050 bash[21866]: audit 2024-05-20T22:14:17.237201+0000 mon.a (mon.0) 2057 : audit 1 from='client.26135 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi050-63936-39"}]': finished 2024-05-20T22:14:18.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:18 smithi050 bash[21866]: audit 2024-05-20T22:14:17.237361+0000 mon.a (mon.0) 2058 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi050-63944-49"}]': finished 2024-05-20T22:14:18.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:18 smithi050 bash[21866]: cluster 2024-05-20T22:14:17.245136+0000 mon.a (mon.0) 2059 : cluster 0 osdmap e261: 8 total, 8 up, 8 in 2024-05-20T22:14:18.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:18 smithi050 bash[21866]: audit 2024-05-20T22:14:17.247160+0000 mon.a (mon.0) 2060 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-33", "mode": "writeback"}]: dispatch 2024-05-20T22:14:18.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:18 smithi050 bash[21866]: audit 2024-05-20T22:14:17.247575+0000 mon.c (mon.2) 304 : audit 1 from='client.? v1:172.21.15.50:0/2007113188' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:18.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:18 smithi050 bash[21866]: audit 2024-05-20T22:14:17.247840+0000 mon.a (mon.0) 2061 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi050-63944-49"}]: dispatch 2024-05-20T22:14:18.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:18 smithi050 bash[21866]: audit 2024-05-20T22:14:17.264410+0000 mon.a (mon.0) 2062 : audit 1 from='client.26135 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:18.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:18 smithi050 bash[21866]: cluster 2024-05-20T22:14:18.238304+0000 mon.a (mon.0) 2063 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:14:18.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:18 smithi050 bash[21866]: audit 2024-05-20T22:14:18.240704+0000 mon.a (mon.0) 2064 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-33", "mode": "writeback"}]': finished 2024-05-20T22:14:18.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:18 smithi050 bash[21866]: audit 2024-05-20T22:14:18.240873+0000 mon.a (mon.0) 2065 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi050-63944-49"}]': finished 2024-05-20T22:14:18.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:18 smithi050 bash[28929]: audit 2024-05-20T22:14:17.237018+0000 mon.a (mon.0) 2056 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-33"}]': finished 2024-05-20T22:14:18.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:18 smithi050 bash[28929]: audit 2024-05-20T22:14:17.237201+0000 mon.a (mon.0) 2057 : audit 1 from='client.26135 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi050-63936-39"}]': finished 2024-05-20T22:14:18.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:18 smithi050 bash[28929]: audit 2024-05-20T22:14:17.237361+0000 mon.a (mon.0) 2058 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi050-63944-49"}]': finished 2024-05-20T22:14:18.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:18 smithi050 bash[28929]: cluster 2024-05-20T22:14:17.245136+0000 mon.a (mon.0) 2059 : cluster 0 osdmap e261: 8 total, 8 up, 8 in 2024-05-20T22:14:18.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:18 smithi050 bash[28929]: audit 2024-05-20T22:14:17.247160+0000 mon.a (mon.0) 2060 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-33", "mode": "writeback"}]: dispatch 2024-05-20T22:14:18.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:18 smithi050 bash[28929]: audit 2024-05-20T22:14:17.247575+0000 mon.c (mon.2) 304 : audit 1 from='client.? v1:172.21.15.50:0/2007113188' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:18.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:18 smithi050 bash[28929]: audit 2024-05-20T22:14:17.247840+0000 mon.a (mon.0) 2061 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi050-63944-49"}]: dispatch 2024-05-20T22:14:18.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:18 smithi050 bash[28929]: audit 2024-05-20T22:14:17.264410+0000 mon.a (mon.0) 2062 : audit 1 from='client.26135 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi050-63936-39"}]: dispatch 2024-05-20T22:14:18.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:18 smithi050 bash[28929]: cluster 2024-05-20T22:14:18.238304+0000 mon.a (mon.0) 2063 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:14:18.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:18 smithi050 bash[28929]: audit 2024-05-20T22:14:18.240704+0000 mon.a (mon.0) 2064 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-33", "mode": "writeback"}]': finished 2024-05-20T22:14:18.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:18 smithi050 bash[28929]: audit 2024-05-20T22:14:18.240873+0000 mon.a (mon.0) 2065 : audit 1 from='client.? v1:172.21.15.50:0/292706221' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi050-63944-49"}]': finished 2024-05-20T22:14:19.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:19 smithi145 bash[23893]: audit 2024-05-20T22:14:17.829037+0000 mgr.y (mgr.14592) 323 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:14:19.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:19 smithi145 bash[23893]: cluster 2024-05-20T22:14:18.115348+0000 mgr.y (mgr.14592) 324 : cluster 0 pgmap v404: 388 pgs: 32 creating+peering, 356 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:14:19.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:19 smithi145 bash[23893]: audit 2024-05-20T22:14:18.241009+0000 mon.a (mon.0) 2066 : audit 1 from='client.26135 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi050-63936-39"}]': finished 2024-05-20T22:14:19.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:19 smithi145 bash[23893]: cluster 2024-05-20T22:14:18.249385+0000 mon.a (mon.0) 2067 : cluster 0 osdmap e262: 8 total, 8 up, 8 in 2024-05-20T22:14:19.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:19 smithi145 bash[23893]: audit 2024-05-20T22:14:18.296013+0000 mon.c (mon.2) 305 : audit 1 from='client.? v1:172.21.15.50:0/27267719' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:19.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:19 smithi145 bash[23893]: audit 2024-05-20T22:14:18.296782+0000 mon.a (mon.0) 2068 : audit 1 from='client.26144 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:19.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:19 smithi145 bash[23893]: audit 2024-05-20T22:14:18.297999+0000 mon.c (mon.2) 306 : audit 1 from='client.? v1:172.21.15.50:0/27267719' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:19 smithi145 bash[23893]: audit 2024-05-20T22:14:18.298324+0000 mon.a (mon.0) 2069 : audit 1 from='client.26144 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:19 smithi145 bash[23893]: audit 2024-05-20T22:14:18.298846+0000 mon.c (mon.2) 307 : audit 1 from='client.? v1:172.21.15.50:0/27267719' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi050-63944-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:19 smithi145 bash[23893]: audit 2024-05-20T22:14:18.299165+0000 mon.a (mon.0) 2070 : audit 1 from='client.26144 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi050-63944-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:19 smithi145 bash[23893]: audit 2024-05-20T22:14:18.309462+0000 mon.c (mon.2) 308 : audit 1 from='client.? v1:172.21.15.50:0/3920913945' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:19 smithi145 bash[23893]: audit 2024-05-20T22:14:18.310154+0000 mon.a (mon.0) 2071 : audit 1 from='client.26150 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:19 smithi145 bash[23893]: audit 2024-05-20T22:14:18.310985+0000 mon.c (mon.2) 309 : audit 1 from='client.? v1:172.21.15.50:0/3920913945' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:19 smithi145 bash[23893]: audit 2024-05-20T22:14:18.311269+0000 mon.a (mon.0) 2072 : audit 1 from='client.26150 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:19 smithi145 bash[23893]: audit 2024-05-20T22:14:18.311815+0000 mon.c (mon.2) 310 : audit 1 from='client.? v1:172.21.15.50:0/3920913945' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi050-63936-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:19 smithi145 bash[23893]: audit 2024-05-20T22:14:18.312171+0000 mon.a (mon.0) 2073 : audit 1 from='client.26150 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi050-63936-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:19.643 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:19 smithi145 bash[23893]: audit 2024-05-20T22:14:18.477976+0000 mon.a (mon.0) 2074 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:19.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:14:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:14:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:14:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:19 smithi050 bash[28929]: audit 2024-05-20T22:14:17.829037+0000 mgr.y (mgr.14592) 323 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:14:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:19 smithi050 bash[28929]: cluster 2024-05-20T22:14:18.115348+0000 mgr.y (mgr.14592) 324 : cluster 0 pgmap v404: 388 pgs: 32 creating+peering, 356 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:14:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:19 smithi050 bash[28929]: audit 2024-05-20T22:14:18.241009+0000 mon.a (mon.0) 2066 : audit 1 from='client.26135 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi050-63936-39"}]': finished 2024-05-20T22:14:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:19 smithi050 bash[28929]: cluster 2024-05-20T22:14:18.249385+0000 mon.a (mon.0) 2067 : cluster 0 osdmap e262: 8 total, 8 up, 8 in 2024-05-20T22:14:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:19 smithi050 bash[28929]: audit 2024-05-20T22:14:18.296013+0000 mon.c (mon.2) 305 : audit 1 from='client.? v1:172.21.15.50:0/27267719' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:19 smithi050 bash[28929]: audit 2024-05-20T22:14:18.296782+0000 mon.a (mon.0) 2068 : audit 1 from='client.26144 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:19 smithi050 bash[28929]: audit 2024-05-20T22:14:18.297999+0000 mon.c (mon.2) 306 : audit 1 from='client.? v1:172.21.15.50:0/27267719' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:19 smithi050 bash[28929]: audit 2024-05-20T22:14:18.298324+0000 mon.a (mon.0) 2069 : audit 1 from='client.26144 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:19 smithi050 bash[28929]: audit 2024-05-20T22:14:18.298846+0000 mon.c (mon.2) 307 : audit 1 from='client.? v1:172.21.15.50:0/27267719' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi050-63944-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:19.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:19 smithi050 bash[28929]: audit 2024-05-20T22:14:18.299165+0000 mon.a (mon.0) 2070 : audit 1 from='client.26144 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi050-63944-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:19.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:19 smithi050 bash[28929]: audit 2024-05-20T22:14:18.309462+0000 mon.c (mon.2) 308 : audit 1 from='client.? v1:172.21.15.50:0/3920913945' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:19.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:19 smithi050 bash[28929]: audit 2024-05-20T22:14:18.310154+0000 mon.a (mon.0) 2071 : audit 1 from='client.26150 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:19.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:19 smithi050 bash[28929]: audit 2024-05-20T22:14:18.310985+0000 mon.c (mon.2) 309 : audit 1 from='client.? v1:172.21.15.50:0/3920913945' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:19.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:19 smithi050 bash[28929]: audit 2024-05-20T22:14:18.311269+0000 mon.a (mon.0) 2072 : audit 1 from='client.26150 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:19.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:19 smithi050 bash[28929]: audit 2024-05-20T22:14:18.311815+0000 mon.c (mon.2) 310 : audit 1 from='client.? v1:172.21.15.50:0/3920913945' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi050-63936-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:19.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:19 smithi050 bash[28929]: audit 2024-05-20T22:14:18.312171+0000 mon.a (mon.0) 2073 : audit 1 from='client.26150 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi050-63936-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:19.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:19 smithi050 bash[28929]: audit 2024-05-20T22:14:18.477976+0000 mon.a (mon.0) 2074 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:19.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:19 smithi050 bash[21866]: audit 2024-05-20T22:14:17.829037+0000 mgr.y (mgr.14592) 323 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:14:19.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:19 smithi050 bash[21866]: cluster 2024-05-20T22:14:18.115348+0000 mgr.y (mgr.14592) 324 : cluster 0 pgmap v404: 388 pgs: 32 creating+peering, 356 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:14:19.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:19 smithi050 bash[21866]: audit 2024-05-20T22:14:18.241009+0000 mon.a (mon.0) 2066 : audit 1 from='client.26135 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi050-63936-39"}]': finished 2024-05-20T22:14:19.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:19 smithi050 bash[21866]: cluster 2024-05-20T22:14:18.249385+0000 mon.a (mon.0) 2067 : cluster 0 osdmap e262: 8 total, 8 up, 8 in 2024-05-20T22:14:19.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:19 smithi050 bash[21866]: audit 2024-05-20T22:14:18.296013+0000 mon.c (mon.2) 305 : audit 1 from='client.? v1:172.21.15.50:0/27267719' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:19.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:19 smithi050 bash[21866]: audit 2024-05-20T22:14:18.296782+0000 mon.a (mon.0) 2068 : audit 1 from='client.26144 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:19.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:19 smithi050 bash[21866]: audit 2024-05-20T22:14:18.297999+0000 mon.c (mon.2) 306 : audit 1 from='client.? v1:172.21.15.50:0/27267719' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:19.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:19 smithi050 bash[21866]: audit 2024-05-20T22:14:18.298324+0000 mon.a (mon.0) 2069 : audit 1 from='client.26144 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:19.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:19 smithi050 bash[21866]: audit 2024-05-20T22:14:18.298846+0000 mon.c (mon.2) 307 : audit 1 from='client.? v1:172.21.15.50:0/27267719' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi050-63944-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:19.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:19 smithi050 bash[21866]: audit 2024-05-20T22:14:18.299165+0000 mon.a (mon.0) 2070 : audit 1 from='client.26144 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi050-63944-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:19.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:19 smithi050 bash[21866]: audit 2024-05-20T22:14:18.309462+0000 mon.c (mon.2) 308 : audit 1 from='client.? v1:172.21.15.50:0/3920913945' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:19.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:19 smithi050 bash[21866]: audit 2024-05-20T22:14:18.310154+0000 mon.a (mon.0) 2071 : audit 1 from='client.26150 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:19.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:19 smithi050 bash[21866]: audit 2024-05-20T22:14:18.310985+0000 mon.c (mon.2) 309 : audit 1 from='client.? v1:172.21.15.50:0/3920913945' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:19.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:19 smithi050 bash[21866]: audit 2024-05-20T22:14:18.311269+0000 mon.a (mon.0) 2072 : audit 1 from='client.26150 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:19.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:19 smithi050 bash[21866]: audit 2024-05-20T22:14:18.311815+0000 mon.c (mon.2) 310 : audit 1 from='client.? v1:172.21.15.50:0/3920913945' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi050-63936-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:19.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:19 smithi050 bash[21866]: audit 2024-05-20T22:14:18.312171+0000 mon.a (mon.0) 2073 : audit 1 from='client.26150 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi050-63936-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:19.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:19 smithi050 bash[21866]: audit 2024-05-20T22:14:18.477976+0000 mon.a (mon.0) 2074 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:21.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:21 smithi145 bash[23893]: audit 2024-05-20T22:14:19.291701+0000 mon.a (mon.0) 2075 : audit 1 from='client.26144 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi050-63944-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:21.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:21 smithi145 bash[23893]: audit 2024-05-20T22:14:19.292121+0000 mon.a (mon.0) 2076 : audit 1 from='client.26150 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi050-63936-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:21.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:21 smithi145 bash[23893]: audit 2024-05-20T22:14:19.292297+0000 mon.a (mon.0) 2077 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:21.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:21 smithi145 bash[23893]: cluster 2024-05-20T22:14:19.300037+0000 mon.a (mon.0) 2078 : cluster 0 osdmap e263: 8 total, 8 up, 8 in 2024-05-20T22:14:21.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:21 smithi145 bash[23893]: audit 2024-05-20T22:14:19.300929+0000 mon.a (mon.0) 2079 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-33"}]: dispatch 2024-05-20T22:14:21.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:21 smithi145 bash[23893]: audit 2024-05-20T22:14:19.301066+0000 mon.c (mon.2) 311 : audit 1 from='client.? v1:172.21.15.50:0/27267719' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi050-63944-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:21.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:21 smithi145 bash[23893]: audit 2024-05-20T22:14:19.301783+0000 mon.c (mon.2) 312 : audit 1 from='client.? v1:172.21.15.50:0/3920913945' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi050-63936-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:21.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:21 smithi145 bash[23893]: audit 2024-05-20T22:14:19.301948+0000 mon.a (mon.0) 2080 : audit 1 from='client.26144 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi050-63944-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:21.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:21 smithi145 bash[23893]: audit 2024-05-20T22:14:19.302992+0000 mon.a (mon.0) 2081 : audit 1 from='client.26150 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi050-63936-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:21.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:21 smithi050 bash[28929]: audit 2024-05-20T22:14:19.291701+0000 mon.a (mon.0) 2075 : audit 1 from='client.26144 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi050-63944-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:21.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:21 smithi050 bash[28929]: audit 2024-05-20T22:14:19.292121+0000 mon.a (mon.0) 2076 : audit 1 from='client.26150 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi050-63936-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:21.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:21 smithi050 bash[28929]: audit 2024-05-20T22:14:19.292297+0000 mon.a (mon.0) 2077 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:21.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:21 smithi050 bash[28929]: cluster 2024-05-20T22:14:19.300037+0000 mon.a (mon.0) 2078 : cluster 0 osdmap e263: 8 total, 8 up, 8 in 2024-05-20T22:14:21.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:21 smithi050 bash[28929]: audit 2024-05-20T22:14:19.300929+0000 mon.a (mon.0) 2079 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-33"}]: dispatch 2024-05-20T22:14:21.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:21 smithi050 bash[28929]: audit 2024-05-20T22:14:19.301066+0000 mon.c (mon.2) 311 : audit 1 from='client.? v1:172.21.15.50:0/27267719' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi050-63944-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:21.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:21 smithi050 bash[28929]: audit 2024-05-20T22:14:19.301783+0000 mon.c (mon.2) 312 : audit 1 from='client.? v1:172.21.15.50:0/3920913945' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi050-63936-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:21.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:21 smithi050 bash[28929]: audit 2024-05-20T22:14:19.301948+0000 mon.a (mon.0) 2080 : audit 1 from='client.26144 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi050-63944-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:21.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:21 smithi050 bash[28929]: audit 2024-05-20T22:14:19.302992+0000 mon.a (mon.0) 2081 : audit 1 from='client.26150 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi050-63936-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:21.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:21 smithi050 bash[21866]: audit 2024-05-20T22:14:19.291701+0000 mon.a (mon.0) 2075 : audit 1 from='client.26144 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi050-63944-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:21.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:21 smithi050 bash[21866]: audit 2024-05-20T22:14:19.292121+0000 mon.a (mon.0) 2076 : audit 1 from='client.26150 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi050-63936-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:21.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:21 smithi050 bash[21866]: audit 2024-05-20T22:14:19.292297+0000 mon.a (mon.0) 2077 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:21.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:21 smithi050 bash[21866]: cluster 2024-05-20T22:14:19.300037+0000 mon.a (mon.0) 2078 : cluster 0 osdmap e263: 8 total, 8 up, 8 in 2024-05-20T22:14:21.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:21 smithi050 bash[21866]: audit 2024-05-20T22:14:19.300929+0000 mon.a (mon.0) 2079 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-33"}]: dispatch 2024-05-20T22:14:21.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:21 smithi050 bash[21866]: audit 2024-05-20T22:14:19.301066+0000 mon.c (mon.2) 311 : audit 1 from='client.? v1:172.21.15.50:0/27267719' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi050-63944-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:21.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:21 smithi050 bash[21866]: audit 2024-05-20T22:14:19.301783+0000 mon.c (mon.2) 312 : audit 1 from='client.? v1:172.21.15.50:0/3920913945' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi050-63936-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:21.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:21 smithi050 bash[21866]: audit 2024-05-20T22:14:19.301948+0000 mon.a (mon.0) 2080 : audit 1 from='client.26144 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi050-63944-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:21.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:21 smithi050 bash[21866]: audit 2024-05-20T22:14:19.302992+0000 mon.a (mon.0) 2081 : audit 1 from='client.26150 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi050-63936-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:22.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:22 smithi145 bash[23893]: cluster 2024-05-20T22:14:20.118833+0000 mgr.y (mgr.14592) 325 : cluster 0 pgmap v407: 388 pgs: 388 active+clean; 4.6 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-05-20T22:14:22.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:22 smithi145 bash[23893]: cluster 2024-05-20T22:14:20.293346+0000 mon.a (mon.0) 2082 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:14:22.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:22 smithi145 bash[23893]: audit 2024-05-20T22:14:20.296590+0000 mon.a (mon.0) 2083 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-33"}]': finished 2024-05-20T22:14:22.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:22 smithi145 bash[23893]: cluster 2024-05-20T22:14:21.209578+0000 mon.a (mon.0) 2084 : cluster 0 osdmap e264: 8 total, 8 up, 8 in 2024-05-20T22:14:22.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:22 smithi145 bash[23893]: audit 2024-05-20T22:14:21.299248+0000 mon.a (mon.0) 2085 : audit 1 from='client.26144 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi050-63944-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi050-63944-50"}]': finished 2024-05-20T22:14:22.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:22 smithi145 bash[23893]: audit 2024-05-20T22:14:21.299453+0000 mon.a (mon.0) 2086 : audit 1 from='client.26150 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi050-63936-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi050-63936-40"}]': finished 2024-05-20T22:14:22.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:22 smithi145 bash[23893]: cluster 2024-05-20T22:14:21.305255+0000 mon.a (mon.0) 2087 : cluster 0 osdmap e265: 8 total, 8 up, 8 in 2024-05-20T22:14:22.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:22 smithi145 bash[23893]: audit 2024-05-20T22:14:21.907014+0000 mon.a (mon.0) 2088 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:14:22.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:22 smithi050 bash[21866]: cluster 2024-05-20T22:14:20.118833+0000 mgr.y (mgr.14592) 325 : cluster 0 pgmap v407: 388 pgs: 388 active+clean; 4.6 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-05-20T22:14:22.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:22 smithi050 bash[21866]: cluster 2024-05-20T22:14:20.293346+0000 mon.a (mon.0) 2082 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:14:22.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:22 smithi050 bash[21866]: audit 2024-05-20T22:14:20.296590+0000 mon.a (mon.0) 2083 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-33"}]': finished 2024-05-20T22:14:22.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:22 smithi050 bash[21866]: cluster 2024-05-20T22:14:21.209578+0000 mon.a (mon.0) 2084 : cluster 0 osdmap e264: 8 total, 8 up, 8 in 2024-05-20T22:14:22.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:22 smithi050 bash[21866]: audit 2024-05-20T22:14:21.299248+0000 mon.a (mon.0) 2085 : audit 1 from='client.26144 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi050-63944-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi050-63944-50"}]': finished 2024-05-20T22:14:22.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:22 smithi050 bash[21866]: audit 2024-05-20T22:14:21.299453+0000 mon.a (mon.0) 2086 : audit 1 from='client.26150 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi050-63936-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi050-63936-40"}]': finished 2024-05-20T22:14:22.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:22 smithi050 bash[21866]: cluster 2024-05-20T22:14:21.305255+0000 mon.a (mon.0) 2087 : cluster 0 osdmap e265: 8 total, 8 up, 8 in 2024-05-20T22:14:22.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:22 smithi050 bash[21866]: audit 2024-05-20T22:14:21.907014+0000 mon.a (mon.0) 2088 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:14:22.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:22 smithi050 bash[28929]: cluster 2024-05-20T22:14:20.118833+0000 mgr.y (mgr.14592) 325 : cluster 0 pgmap v407: 388 pgs: 388 active+clean; 4.6 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-05-20T22:14:22.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:22 smithi050 bash[28929]: cluster 2024-05-20T22:14:20.293346+0000 mon.a (mon.0) 2082 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:14:22.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:22 smithi050 bash[28929]: audit 2024-05-20T22:14:20.296590+0000 mon.a (mon.0) 2083 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-33"}]': finished 2024-05-20T22:14:22.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:22 smithi050 bash[28929]: cluster 2024-05-20T22:14:21.209578+0000 mon.a (mon.0) 2084 : cluster 0 osdmap e264: 8 total, 8 up, 8 in 2024-05-20T22:14:22.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:22 smithi050 bash[28929]: audit 2024-05-20T22:14:21.299248+0000 mon.a (mon.0) 2085 : audit 1 from='client.26144 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi050-63944-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi050-63944-50"}]': finished 2024-05-20T22:14:22.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:22 smithi050 bash[28929]: audit 2024-05-20T22:14:21.299453+0000 mon.a (mon.0) 2086 : audit 1 from='client.26150 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi050-63936-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi050-63936-40"}]': finished 2024-05-20T22:14:22.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:22 smithi050 bash[28929]: cluster 2024-05-20T22:14:21.305255+0000 mon.a (mon.0) 2087 : cluster 0 osdmap e265: 8 total, 8 up, 8 in 2024-05-20T22:14:22.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:22 smithi050 bash[28929]: audit 2024-05-20T22:14:21.907014+0000 mon.a (mon.0) 2088 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:14:23.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:23 smithi145 bash[23893]: cluster 2024-05-20T22:14:22.119886+0000 mgr.y (mgr.14592) 326 : cluster 0 pgmap v410: 372 pgs: 16 unknown, 356 active+clean; 4.6 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:14:23.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:23 smithi145 bash[23893]: cluster 2024-05-20T22:14:22.299231+0000 mon.a (mon.0) 2089 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:23.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:23 smithi145 bash[23893]: cluster 2024-05-20T22:14:22.318169+0000 mon.a (mon.0) 2090 : cluster 0 osdmap e266: 8 total, 8 up, 8 in 2024-05-20T22:14:23.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:23 smithi145 bash[23893]: audit 2024-05-20T22:14:22.322361+0000 mon.a (mon.0) 2091 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:23.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:23 smithi050 bash[21866]: cluster 2024-05-20T22:14:22.119886+0000 mgr.y (mgr.14592) 326 : cluster 0 pgmap v410: 372 pgs: 16 unknown, 356 active+clean; 4.6 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:14:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:23 smithi050 bash[21866]: cluster 2024-05-20T22:14:22.299231+0000 mon.a (mon.0) 2089 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:23 smithi050 bash[21866]: cluster 2024-05-20T22:14:22.318169+0000 mon.a (mon.0) 2090 : cluster 0 osdmap e266: 8 total, 8 up, 8 in 2024-05-20T22:14:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:23 smithi050 bash[21866]: audit 2024-05-20T22:14:22.322361+0000 mon.a (mon.0) 2091 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:23.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:23 smithi050 bash[28929]: cluster 2024-05-20T22:14:22.119886+0000 mgr.y (mgr.14592) 326 : cluster 0 pgmap v410: 372 pgs: 16 unknown, 356 active+clean; 4.6 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:14:23.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:23 smithi050 bash[28929]: cluster 2024-05-20T22:14:22.299231+0000 mon.a (mon.0) 2089 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:23.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:23 smithi050 bash[28929]: cluster 2024-05-20T22:14:22.318169+0000 mon.a (mon.0) 2090 : cluster 0 osdmap e266: 8 total, 8 up, 8 in 2024-05-20T22:14:23.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:23 smithi050 bash[28929]: audit 2024-05-20T22:14:22.322361+0000 mon.a (mon.0) 2091 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:24.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:24 smithi145 bash[23893]: audit 2024-05-20T22:14:23.313710+0000 mon.a (mon.0) 2092 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:24.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:24 smithi145 bash[23893]: cluster 2024-05-20T22:14:23.322982+0000 mon.a (mon.0) 2093 : cluster 0 osdmap e267: 8 total, 8 up, 8 in 2024-05-20T22:14:24.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:24 smithi145 bash[23893]: audit 2024-05-20T22:14:23.324543+0000 mon.c (mon.2) 313 : audit 1 from='client.? v1:172.21.15.50:0/27267719' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:24.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:24 smithi145 bash[23893]: audit 2024-05-20T22:14:23.325048+0000 mon.c (mon.2) 314 : audit 1 from='client.? v1:172.21.15.50:0/3920913945' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:24.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:24 smithi145 bash[23893]: audit 2024-05-20T22:14:23.327000+0000 mon.a (mon.0) 2094 : audit 1 from='client.26144 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:24.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:24 smithi145 bash[23893]: audit 2024-05-20T22:14:23.327564+0000 mon.a (mon.0) 2095 : audit 1 from='client.26150 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:24.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:24 smithi145 bash[23893]: audit 2024-05-20T22:14:23.327910+0000 mon.a (mon.0) 2096 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:14:24.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:24 smithi050 bash[21866]: audit 2024-05-20T22:14:23.313710+0000 mon.a (mon.0) 2092 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:24.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:24 smithi050 bash[21866]: cluster 2024-05-20T22:14:23.322982+0000 mon.a (mon.0) 2093 : cluster 0 osdmap e267: 8 total, 8 up, 8 in 2024-05-20T22:14:24.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:24 smithi050 bash[21866]: audit 2024-05-20T22:14:23.324543+0000 mon.c (mon.2) 313 : audit 1 from='client.? v1:172.21.15.50:0/27267719' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:24.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:24 smithi050 bash[21866]: audit 2024-05-20T22:14:23.325048+0000 mon.c (mon.2) 314 : audit 1 from='client.? v1:172.21.15.50:0/3920913945' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:24.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:24 smithi050 bash[21866]: audit 2024-05-20T22:14:23.327000+0000 mon.a (mon.0) 2094 : audit 1 from='client.26144 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:24.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:24 smithi050 bash[21866]: audit 2024-05-20T22:14:23.327564+0000 mon.a (mon.0) 2095 : audit 1 from='client.26150 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:24.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:24 smithi050 bash[21866]: audit 2024-05-20T22:14:23.327910+0000 mon.a (mon.0) 2096 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:14:24.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:24 smithi050 bash[28929]: audit 2024-05-20T22:14:23.313710+0000 mon.a (mon.0) 2092 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:24.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:24 smithi050 bash[28929]: cluster 2024-05-20T22:14:23.322982+0000 mon.a (mon.0) 2093 : cluster 0 osdmap e267: 8 total, 8 up, 8 in 2024-05-20T22:14:24.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:24 smithi050 bash[28929]: audit 2024-05-20T22:14:23.324543+0000 mon.c (mon.2) 313 : audit 1 from='client.? v1:172.21.15.50:0/27267719' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:24.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:24 smithi050 bash[28929]: audit 2024-05-20T22:14:23.325048+0000 mon.c (mon.2) 314 : audit 1 from='client.? v1:172.21.15.50:0/3920913945' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:24.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:24 smithi050 bash[28929]: audit 2024-05-20T22:14:23.327000+0000 mon.a (mon.0) 2094 : audit 1 from='client.26144 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:24.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:24 smithi050 bash[28929]: audit 2024-05-20T22:14:23.327564+0000 mon.a (mon.0) 2095 : audit 1 from='client.26150 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:24.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:24 smithi050 bash[28929]: audit 2024-05-20T22:14:23.327910+0000 mon.a (mon.0) 2096 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:14:25.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:25 smithi145 bash[23893]: cluster 2024-05-20T22:14:24.120849+0000 mgr.y (mgr.14592) 327 : cluster 0 pgmap v413: 388 pgs: 32 unknown, 356 active+clean; 4.6 MiB data, 566 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:25.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:25 smithi145 bash[23893]: audit 2024-05-20T22:14:24.323284+0000 mon.a (mon.0) 2097 : audit 1 from='client.26144 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi050-63944-50"}]': finished 2024-05-20T22:14:25.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:25 smithi145 bash[23893]: audit 2024-05-20T22:14:24.323463+0000 mon.a (mon.0) 2098 : audit 1 from='client.26150 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi050-63936-40"}]': finished 2024-05-20T22:14:25.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:25 smithi145 bash[23893]: audit 2024-05-20T22:14:24.323570+0000 mon.a (mon.0) 2099 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-35", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:14:25.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:25 smithi145 bash[23893]: cluster 2024-05-20T22:14:24.332658+0000 mon.a (mon.0) 2100 : cluster 0 osdmap e268: 8 total, 8 up, 8 in 2024-05-20T22:14:25.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:25 smithi145 bash[23893]: audit 2024-05-20T22:14:24.334391+0000 mon.c (mon.2) 315 : audit 1 from='client.? v1:172.21.15.50:0/27267719' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:25.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:25 smithi145 bash[23893]: audit 2024-05-20T22:14:24.335099+0000 mon.c (mon.2) 316 : audit 1 from='client.? v1:172.21.15.50:0/3920913945' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:25.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:25 smithi145 bash[23893]: audit 2024-05-20T22:14:24.345003+0000 mon.a (mon.0) 2101 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-35"}]: dispatch 2024-05-20T22:14:25.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:25 smithi145 bash[23893]: audit 2024-05-20T22:14:24.345371+0000 mon.a (mon.0) 2102 : audit 1 from='client.26144 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:25.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:25 smithi145 bash[23893]: audit 2024-05-20T22:14:24.345863+0000 mon.a (mon.0) 2103 : audit 1 from='client.26150 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:25.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:25 smithi050 bash[21866]: cluster 2024-05-20T22:14:24.120849+0000 mgr.y (mgr.14592) 327 : cluster 0 pgmap v413: 388 pgs: 32 unknown, 356 active+clean; 4.6 MiB data, 566 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:25.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:25 smithi050 bash[21866]: audit 2024-05-20T22:14:24.323284+0000 mon.a (mon.0) 2097 : audit 1 from='client.26144 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi050-63944-50"}]': finished 2024-05-20T22:14:25.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:25 smithi050 bash[21866]: audit 2024-05-20T22:14:24.323463+0000 mon.a (mon.0) 2098 : audit 1 from='client.26150 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi050-63936-40"}]': finished 2024-05-20T22:14:25.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:25 smithi050 bash[21866]: audit 2024-05-20T22:14:24.323570+0000 mon.a (mon.0) 2099 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-35", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:14:25.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:25 smithi050 bash[21866]: cluster 2024-05-20T22:14:24.332658+0000 mon.a (mon.0) 2100 : cluster 0 osdmap e268: 8 total, 8 up, 8 in 2024-05-20T22:14:25.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:25 smithi050 bash[21866]: audit 2024-05-20T22:14:24.334391+0000 mon.c (mon.2) 315 : audit 1 from='client.? v1:172.21.15.50:0/27267719' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:25.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:25 smithi050 bash[21866]: audit 2024-05-20T22:14:24.335099+0000 mon.c (mon.2) 316 : audit 1 from='client.? v1:172.21.15.50:0/3920913945' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:25.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:25 smithi050 bash[21866]: audit 2024-05-20T22:14:24.345003+0000 mon.a (mon.0) 2101 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-35"}]: dispatch 2024-05-20T22:14:25.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:25 smithi050 bash[21866]: audit 2024-05-20T22:14:24.345371+0000 mon.a (mon.0) 2102 : audit 1 from='client.26144 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:25.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:25 smithi050 bash[21866]: audit 2024-05-20T22:14:24.345863+0000 mon.a (mon.0) 2103 : audit 1 from='client.26150 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:25.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:25 smithi050 bash[28929]: cluster 2024-05-20T22:14:24.120849+0000 mgr.y (mgr.14592) 327 : cluster 0 pgmap v413: 388 pgs: 32 unknown, 356 active+clean; 4.6 MiB data, 566 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:25.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:25 smithi050 bash[28929]: audit 2024-05-20T22:14:24.323284+0000 mon.a (mon.0) 2097 : audit 1 from='client.26144 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi050-63944-50"}]': finished 2024-05-20T22:14:25.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:25 smithi050 bash[28929]: audit 2024-05-20T22:14:24.323463+0000 mon.a (mon.0) 2098 : audit 1 from='client.26150 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi050-63936-40"}]': finished 2024-05-20T22:14:25.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:25 smithi050 bash[28929]: audit 2024-05-20T22:14:24.323570+0000 mon.a (mon.0) 2099 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-35", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:14:25.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:25 smithi050 bash[28929]: cluster 2024-05-20T22:14:24.332658+0000 mon.a (mon.0) 2100 : cluster 0 osdmap e268: 8 total, 8 up, 8 in 2024-05-20T22:14:25.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:25 smithi050 bash[28929]: audit 2024-05-20T22:14:24.334391+0000 mon.c (mon.2) 315 : audit 1 from='client.? v1:172.21.15.50:0/27267719' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:25.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:25 smithi050 bash[28929]: audit 2024-05-20T22:14:24.335099+0000 mon.c (mon.2) 316 : audit 1 from='client.? v1:172.21.15.50:0/3920913945' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:25.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:25 smithi050 bash[28929]: audit 2024-05-20T22:14:24.345003+0000 mon.a (mon.0) 2101 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-35"}]: dispatch 2024-05-20T22:14:25.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:25 smithi050 bash[28929]: audit 2024-05-20T22:14:24.345371+0000 mon.a (mon.0) 2102 : audit 1 from='client.26144 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi050-63944-50"}]: dispatch 2024-05-20T22:14:25.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:25 smithi050 bash[28929]: audit 2024-05-20T22:14:24.345863+0000 mon.a (mon.0) 2103 : audit 1 from='client.26150 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi050-63936-40"}]: dispatch 2024-05-20T22:14:26.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:26 smithi145 bash[23893]: audit 2024-05-20T22:14:25.327262+0000 mon.a (mon.0) 2104 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-35"}]': finished 2024-05-20T22:14:26.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:26 smithi145 bash[23893]: audit 2024-05-20T22:14:25.327419+0000 mon.a (mon.0) 2105 : audit 1 from='client.26144 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi050-63944-50"}]': finished 2024-05-20T22:14:26.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:26 smithi145 bash[23893]: audit 2024-05-20T22:14:25.327539+0000 mon.a (mon.0) 2106 : audit 1 from='client.26150 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi050-63936-40"}]': finished 2024-05-20T22:14:26.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:26 smithi145 bash[23893]: cluster 2024-05-20T22:14:25.334354+0000 mon.a (mon.0) 2107 : cluster 0 osdmap e269: 8 total, 8 up, 8 in 2024-05-20T22:14:26.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:26 smithi145 bash[23893]: audit 2024-05-20T22:14:25.338473+0000 mon.a (mon.0) 2108 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-35", "mode": "writeback"}]: dispatch 2024-05-20T22:14:26.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:26 smithi145 bash[23893]: audit 2024-05-20T22:14:25.371798+0000 mon.c (mon.2) 317 : audit 1 from='client.? v1:172.21.15.50:0/3075524203' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:26.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:26 smithi145 bash[23893]: audit 2024-05-20T22:14:25.372504+0000 mon.a (mon.0) 2109 : audit 1 from='client.26156 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:26.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:26 smithi145 bash[23893]: audit 2024-05-20T22:14:25.373687+0000 mon.c (mon.2) 318 : audit 1 from='client.? v1:172.21.15.50:0/3075524203' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:26.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:26 smithi145 bash[23893]: audit 2024-05-20T22:14:25.374028+0000 mon.a (mon.0) 2110 : audit 1 from='client.26156 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:26.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:26 smithi145 bash[23893]: audit 2024-05-20T22:14:25.374836+0000 mon.c (mon.2) 319 : audit 1 from='client.? v1:172.21.15.50:0/3075524203' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi050-63936-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:26.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:26 smithi145 bash[23893]: audit 2024-05-20T22:14:25.375360+0000 mon.a (mon.0) 2111 : audit 1 from='client.26156 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi050-63936-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:26.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:26 smithi145 bash[23893]: cluster 2024-05-20T22:14:26.328400+0000 mon.a (mon.0) 2112 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:14:26.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:26 smithi145 bash[23893]: audit 2024-05-20T22:14:26.331139+0000 mon.a (mon.0) 2113 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-35", "mode": "writeback"}]': finished 2024-05-20T22:14:26.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:26 smithi050 bash[21866]: audit 2024-05-20T22:14:25.327262+0000 mon.a (mon.0) 2104 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-35"}]': finished 2024-05-20T22:14:26.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:26 smithi050 bash[21866]: audit 2024-05-20T22:14:25.327419+0000 mon.a (mon.0) 2105 : audit 1 from='client.26144 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi050-63944-50"}]': finished 2024-05-20T22:14:26.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:26 smithi050 bash[21866]: audit 2024-05-20T22:14:25.327539+0000 mon.a (mon.0) 2106 : audit 1 from='client.26150 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi050-63936-40"}]': finished 2024-05-20T22:14:26.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:26 smithi050 bash[21866]: cluster 2024-05-20T22:14:25.334354+0000 mon.a (mon.0) 2107 : cluster 0 osdmap e269: 8 total, 8 up, 8 in 2024-05-20T22:14:26.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:26 smithi050 bash[21866]: audit 2024-05-20T22:14:25.338473+0000 mon.a (mon.0) 2108 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-35", "mode": "writeback"}]: dispatch 2024-05-20T22:14:26.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:26 smithi050 bash[21866]: audit 2024-05-20T22:14:25.371798+0000 mon.c (mon.2) 317 : audit 1 from='client.? v1:172.21.15.50:0/3075524203' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:26.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:26 smithi050 bash[21866]: audit 2024-05-20T22:14:25.372504+0000 mon.a (mon.0) 2109 : audit 1 from='client.26156 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:26.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:26 smithi050 bash[21866]: audit 2024-05-20T22:14:25.373687+0000 mon.c (mon.2) 318 : audit 1 from='client.? v1:172.21.15.50:0/3075524203' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:26.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:26 smithi050 bash[21866]: audit 2024-05-20T22:14:25.374028+0000 mon.a (mon.0) 2110 : audit 1 from='client.26156 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:26.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:26 smithi050 bash[21866]: audit 2024-05-20T22:14:25.374836+0000 mon.c (mon.2) 319 : audit 1 from='client.? v1:172.21.15.50:0/3075524203' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi050-63936-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:26.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:26 smithi050 bash[21866]: audit 2024-05-20T22:14:25.375360+0000 mon.a (mon.0) 2111 : audit 1 from='client.26156 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi050-63936-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:26.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:26 smithi050 bash[21866]: cluster 2024-05-20T22:14:26.328400+0000 mon.a (mon.0) 2112 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:14:26.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:26 smithi050 bash[21866]: audit 2024-05-20T22:14:26.331139+0000 mon.a (mon.0) 2113 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-35", "mode": "writeback"}]': finished 2024-05-20T22:14:26.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:26 smithi050 bash[28929]: audit 2024-05-20T22:14:25.327262+0000 mon.a (mon.0) 2104 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-35"}]': finished 2024-05-20T22:14:26.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:26 smithi050 bash[28929]: audit 2024-05-20T22:14:25.327419+0000 mon.a (mon.0) 2105 : audit 1 from='client.26144 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi050-63944-50"}]': finished 2024-05-20T22:14:26.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:26 smithi050 bash[28929]: audit 2024-05-20T22:14:25.327539+0000 mon.a (mon.0) 2106 : audit 1 from='client.26150 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi050-63936-40"}]': finished 2024-05-20T22:14:26.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:26 smithi050 bash[28929]: cluster 2024-05-20T22:14:25.334354+0000 mon.a (mon.0) 2107 : cluster 0 osdmap e269: 8 total, 8 up, 8 in 2024-05-20T22:14:26.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:26 smithi050 bash[28929]: audit 2024-05-20T22:14:25.338473+0000 mon.a (mon.0) 2108 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-35", "mode": "writeback"}]: dispatch 2024-05-20T22:14:26.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:26 smithi050 bash[28929]: audit 2024-05-20T22:14:25.371798+0000 mon.c (mon.2) 317 : audit 1 from='client.? v1:172.21.15.50:0/3075524203' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:26.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:26 smithi050 bash[28929]: audit 2024-05-20T22:14:25.372504+0000 mon.a (mon.0) 2109 : audit 1 from='client.26156 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:26.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:26 smithi050 bash[28929]: audit 2024-05-20T22:14:25.373687+0000 mon.c (mon.2) 318 : audit 1 from='client.? v1:172.21.15.50:0/3075524203' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:26.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:26 smithi050 bash[28929]: audit 2024-05-20T22:14:25.374028+0000 mon.a (mon.0) 2110 : audit 1 from='client.26156 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:26.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:26 smithi050 bash[28929]: audit 2024-05-20T22:14:25.374836+0000 mon.c (mon.2) 319 : audit 1 from='client.? v1:172.21.15.50:0/3075524203' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi050-63936-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:26.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:26 smithi050 bash[28929]: audit 2024-05-20T22:14:25.375360+0000 mon.a (mon.0) 2111 : audit 1 from='client.26156 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi050-63936-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:26.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:26 smithi050 bash[28929]: cluster 2024-05-20T22:14:26.328400+0000 mon.a (mon.0) 2112 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:14:26.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:26 smithi050 bash[28929]: audit 2024-05-20T22:14:26.331139+0000 mon.a (mon.0) 2113 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-35", "mode": "writeback"}]': finished 2024-05-20T22:14:28.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:14:27 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:14:28.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:27 smithi145 bash[23893]: cluster 2024-05-20T22:14:26.121823+0000 mgr.y (mgr.14592) 328 : cluster 0 pgmap v416: 388 pgs: 388 active+clean; 4.6 MiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:28.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:27 smithi145 bash[23893]: audit 2024-05-20T22:14:26.331396+0000 mon.a (mon.0) 2114 : audit 1 from='client.26156 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi050-63936-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:28.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:27 smithi145 bash[23893]: audit 2024-05-20T22:14:26.341561+0000 mon.c (mon.2) 320 : audit 1 from='client.? v1:172.21.15.50:0/3075524203' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi050-63936-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:28.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:27 smithi145 bash[23893]: cluster 2024-05-20T22:14:26.342315+0000 mon.a (mon.0) 2115 : cluster 0 osdmap e270: 8 total, 8 up, 8 in 2024-05-20T22:14:28.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:27 smithi145 bash[23893]: audit 2024-05-20T22:14:26.348415+0000 mon.a (mon.0) 2116 : audit 1 from='client.26156 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi050-63936-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:28.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:27 smithi145 bash[23893]: audit 2024-05-20T22:14:26.349090+0000 mon.a (mon.0) 2117 : audit 1 from='client.? v1:172.21.15.50:0/3691081132' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi050-63944-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:28.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:27 smithi145 bash[23893]: audit 2024-05-20T22:14:27.335402+0000 mon.a (mon.0) 2118 : audit 1 from='client.? v1:172.21.15.50:0/3691081132' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi050-63944-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:28.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:27 smithi050 bash[21866]: cluster 2024-05-20T22:14:26.121823+0000 mgr.y (mgr.14592) 328 : cluster 0 pgmap v416: 388 pgs: 388 active+clean; 4.6 MiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:28.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:27 smithi050 bash[21866]: audit 2024-05-20T22:14:26.331396+0000 mon.a (mon.0) 2114 : audit 1 from='client.26156 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi050-63936-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:28.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:27 smithi050 bash[21866]: audit 2024-05-20T22:14:26.341561+0000 mon.c (mon.2) 320 : audit 1 from='client.? v1:172.21.15.50:0/3075524203' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi050-63936-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:28.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:27 smithi050 bash[21866]: cluster 2024-05-20T22:14:26.342315+0000 mon.a (mon.0) 2115 : cluster 0 osdmap e270: 8 total, 8 up, 8 in 2024-05-20T22:14:28.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:27 smithi050 bash[21866]: audit 2024-05-20T22:14:26.348415+0000 mon.a (mon.0) 2116 : audit 1 from='client.26156 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi050-63936-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:28.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:27 smithi050 bash[21866]: audit 2024-05-20T22:14:26.349090+0000 mon.a (mon.0) 2117 : audit 1 from='client.? v1:172.21.15.50:0/3691081132' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi050-63944-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:28.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:27 smithi050 bash[21866]: audit 2024-05-20T22:14:27.335402+0000 mon.a (mon.0) 2118 : audit 1 from='client.? v1:172.21.15.50:0/3691081132' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi050-63944-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:28.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:27 smithi050 bash[28929]: cluster 2024-05-20T22:14:26.121823+0000 mgr.y (mgr.14592) 328 : cluster 0 pgmap v416: 388 pgs: 388 active+clean; 4.6 MiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:28.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:27 smithi050 bash[28929]: audit 2024-05-20T22:14:26.331396+0000 mon.a (mon.0) 2114 : audit 1 from='client.26156 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi050-63936-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:28.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:27 smithi050 bash[28929]: audit 2024-05-20T22:14:26.341561+0000 mon.c (mon.2) 320 : audit 1 from='client.? v1:172.21.15.50:0/3075524203' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi050-63936-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:28.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:27 smithi050 bash[28929]: cluster 2024-05-20T22:14:26.342315+0000 mon.a (mon.0) 2115 : cluster 0 osdmap e270: 8 total, 8 up, 8 in 2024-05-20T22:14:28.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:27 smithi050 bash[28929]: audit 2024-05-20T22:14:26.348415+0000 mon.a (mon.0) 2116 : audit 1 from='client.26156 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi050-63936-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:28.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:27 smithi050 bash[28929]: audit 2024-05-20T22:14:26.349090+0000 mon.a (mon.0) 2117 : audit 1 from='client.? v1:172.21.15.50:0/3691081132' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi050-63944-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:28.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:27 smithi050 bash[28929]: audit 2024-05-20T22:14:27.335402+0000 mon.a (mon.0) 2118 : audit 1 from='client.? v1:172.21.15.50:0/3691081132' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi050-63944-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:29.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:28 smithi145 bash[23893]: cluster 2024-05-20T22:14:27.810160+0000 mon.a (mon.0) 2119 : cluster 0 osdmap e271: 8 total, 8 up, 8 in 2024-05-20T22:14:29.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:28 smithi145 bash[23893]: audit 2024-05-20T22:14:27.839786+0000 mgr.y (mgr.14592) 329 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:14:29.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:28 smithi145 bash[23893]: cluster 2024-05-20T22:14:28.122961+0000 mgr.y (mgr.14592) 330 : cluster 0 pgmap v419: 420 pgs: 32 unknown, 388 active+clean; 4.6 MiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:29.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:28 smithi145 bash[23893]: audit 2024-05-20T22:14:28.338138+0000 mon.a (mon.0) 2120 : audit 1 from='client.26156 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi050-63936-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi050-63936-41"}]': finished 2024-05-20T22:14:29.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:28 smithi145 bash[23893]: cluster 2024-05-20T22:14:28.346376+0000 mon.a (mon.0) 2121 : cluster 0 osdmap e272: 8 total, 8 up, 8 in 2024-05-20T22:14:29.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:28 smithi145 bash[23893]: audit 2024-05-20T22:14:28.401606+0000 mon.a (mon.0) 2122 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi050-63944-52"}]: dispatch 2024-05-20T22:14:29.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:28 smithi145 bash[23893]: audit 2024-05-20T22:14:28.403122+0000 mon.a (mon.0) 2123 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi050-63944-52"}]: dispatch 2024-05-20T22:14:29.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:28 smithi145 bash[23893]: audit 2024-05-20T22:14:28.403484+0000 mon.a (mon.0) 2124 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi050-63944-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:29.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:28 smithi145 bash[23893]: audit 2024-05-20T22:14:28.456168+0000 mon.a (mon.0) 2125 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:28 smithi050 bash[21866]: cluster 2024-05-20T22:14:27.810160+0000 mon.a (mon.0) 2119 : cluster 0 osdmap e271: 8 total, 8 up, 8 in 2024-05-20T22:14:29.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:28 smithi050 bash[21866]: audit 2024-05-20T22:14:27.839786+0000 mgr.y (mgr.14592) 329 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:14:29.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:28 smithi050 bash[21866]: cluster 2024-05-20T22:14:28.122961+0000 mgr.y (mgr.14592) 330 : cluster 0 pgmap v419: 420 pgs: 32 unknown, 388 active+clean; 4.6 MiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:29.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:28 smithi050 bash[21866]: audit 2024-05-20T22:14:28.338138+0000 mon.a (mon.0) 2120 : audit 1 from='client.26156 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi050-63936-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi050-63936-41"}]': finished 2024-05-20T22:14:29.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:28 smithi050 bash[21866]: cluster 2024-05-20T22:14:28.346376+0000 mon.a (mon.0) 2121 : cluster 0 osdmap e272: 8 total, 8 up, 8 in 2024-05-20T22:14:29.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:28 smithi050 bash[21866]: audit 2024-05-20T22:14:28.401606+0000 mon.a (mon.0) 2122 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi050-63944-52"}]: dispatch 2024-05-20T22:14:29.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:28 smithi050 bash[21866]: audit 2024-05-20T22:14:28.403122+0000 mon.a (mon.0) 2123 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi050-63944-52"}]: dispatch 2024-05-20T22:14:29.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:28 smithi050 bash[21866]: audit 2024-05-20T22:14:28.403484+0000 mon.a (mon.0) 2124 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi050-63944-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:29.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:28 smithi050 bash[21866]: audit 2024-05-20T22:14:28.456168+0000 mon.a (mon.0) 2125 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:29.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:28 smithi050 bash[28929]: cluster 2024-05-20T22:14:27.810160+0000 mon.a (mon.0) 2119 : cluster 0 osdmap e271: 8 total, 8 up, 8 in 2024-05-20T22:14:29.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:28 smithi050 bash[28929]: audit 2024-05-20T22:14:27.839786+0000 mgr.y (mgr.14592) 329 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:14:29.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:28 smithi050 bash[28929]: cluster 2024-05-20T22:14:28.122961+0000 mgr.y (mgr.14592) 330 : cluster 0 pgmap v419: 420 pgs: 32 unknown, 388 active+clean; 4.6 MiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:29.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:28 smithi050 bash[28929]: audit 2024-05-20T22:14:28.338138+0000 mon.a (mon.0) 2120 : audit 1 from='client.26156 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi050-63936-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi050-63936-41"}]': finished 2024-05-20T22:14:29.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:28 smithi050 bash[28929]: cluster 2024-05-20T22:14:28.346376+0000 mon.a (mon.0) 2121 : cluster 0 osdmap e272: 8 total, 8 up, 8 in 2024-05-20T22:14:29.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:28 smithi050 bash[28929]: audit 2024-05-20T22:14:28.401606+0000 mon.a (mon.0) 2122 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi050-63944-52"}]: dispatch 2024-05-20T22:14:29.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:28 smithi050 bash[28929]: audit 2024-05-20T22:14:28.403122+0000 mon.a (mon.0) 2123 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi050-63944-52"}]: dispatch 2024-05-20T22:14:29.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:28 smithi050 bash[28929]: audit 2024-05-20T22:14:28.403484+0000 mon.a (mon.0) 2124 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi050-63944-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:29.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:28 smithi050 bash[28929]: audit 2024-05-20T22:14:28.456168+0000 mon.a (mon.0) 2125 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:29.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:14:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:14:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:14:30.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:29 smithi145 bash[23893]: cluster 2024-05-20T22:14:29.204793+0000 mon.a (mon.0) 2126 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:30.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:29 smithi145 bash[23893]: audit 2024-05-20T22:14:29.340606+0000 mon.a (mon.0) 2127 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi050-63944-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:30.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:29 smithi145 bash[23893]: audit 2024-05-20T22:14:29.340768+0000 mon.a (mon.0) 2128 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:30.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:29 smithi145 bash[23893]: cluster 2024-05-20T22:14:29.349163+0000 mon.a (mon.0) 2129 : cluster 0 osdmap e273: 8 total, 8 up, 8 in 2024-05-20T22:14:30.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:29 smithi145 bash[23893]: audit 2024-05-20T22:14:29.350137+0000 mon.a (mon.0) 2130 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi050-63944-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi050-63944-52"}]: dispatch 2024-05-20T22:14:30.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:29 smithi145 bash[23893]: audit 2024-05-20T22:14:29.372594+0000 mon.a (mon.0) 2131 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-35"}]: dispatch 2024-05-20T22:14:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:29 smithi050 bash[21866]: cluster 2024-05-20T22:14:29.204793+0000 mon.a (mon.0) 2126 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:29 smithi050 bash[21866]: audit 2024-05-20T22:14:29.340606+0000 mon.a (mon.0) 2127 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi050-63944-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:29 smithi050 bash[21866]: audit 2024-05-20T22:14:29.340768+0000 mon.a (mon.0) 2128 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:29 smithi050 bash[21866]: cluster 2024-05-20T22:14:29.349163+0000 mon.a (mon.0) 2129 : cluster 0 osdmap e273: 8 total, 8 up, 8 in 2024-05-20T22:14:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:29 smithi050 bash[21866]: audit 2024-05-20T22:14:29.350137+0000 mon.a (mon.0) 2130 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi050-63944-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi050-63944-52"}]: dispatch 2024-05-20T22:14:30.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:29 smithi050 bash[21866]: audit 2024-05-20T22:14:29.372594+0000 mon.a (mon.0) 2131 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-35"}]: dispatch 2024-05-20T22:14:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:29 smithi050 bash[28929]: cluster 2024-05-20T22:14:29.204793+0000 mon.a (mon.0) 2126 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:29 smithi050 bash[28929]: audit 2024-05-20T22:14:29.340606+0000 mon.a (mon.0) 2127 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi050-63944-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:29 smithi050 bash[28929]: audit 2024-05-20T22:14:29.340768+0000 mon.a (mon.0) 2128 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:29 smithi050 bash[28929]: cluster 2024-05-20T22:14:29.349163+0000 mon.a (mon.0) 2129 : cluster 0 osdmap e273: 8 total, 8 up, 8 in 2024-05-20T22:14:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:29 smithi050 bash[28929]: audit 2024-05-20T22:14:29.350137+0000 mon.a (mon.0) 2130 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi050-63944-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi050-63944-52"}]: dispatch 2024-05-20T22:14:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:29 smithi050 bash[28929]: audit 2024-05-20T22:14:29.372594+0000 mon.a (mon.0) 2131 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-35"}]: dispatch 2024-05-20T22:14:31.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:31 smithi145 bash[23893]: cluster 2024-05-20T22:14:30.126333+0000 mgr.y (mgr.14592) 331 : cluster 0 pgmap v422: 396 pgs: 396 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-05-20T22:14:31.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:31 smithi145 bash[23893]: audit 2024-05-20T22:14:30.344057+0000 mon.a (mon.0) 2132 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-35"}]': finished 2024-05-20T22:14:31.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:31 smithi145 bash[23893]: cluster 2024-05-20T22:14:30.809728+0000 mon.a (mon.0) 2133 : cluster 0 osdmap e274: 8 total, 8 up, 8 in 2024-05-20T22:14:31.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:31 smithi145 bash[23893]: audit 2024-05-20T22:14:30.810962+0000 mon.c (mon.2) 321 : audit 1 from='client.? v1:172.21.15.50:0/3075524203' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:31.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:31 smithi145 bash[23893]: audit 2024-05-20T22:14:30.811442+0000 mon.a (mon.0) 2134 : audit 1 from='client.26156 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:31.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:31 smithi050 bash[21866]: cluster 2024-05-20T22:14:30.126333+0000 mgr.y (mgr.14592) 331 : cluster 0 pgmap v422: 396 pgs: 396 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-05-20T22:14:31.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:31 smithi050 bash[21866]: audit 2024-05-20T22:14:30.344057+0000 mon.a (mon.0) 2132 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-35"}]': finished 2024-05-20T22:14:31.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:31 smithi050 bash[21866]: cluster 2024-05-20T22:14:30.809728+0000 mon.a (mon.0) 2133 : cluster 0 osdmap e274: 8 total, 8 up, 8 in 2024-05-20T22:14:31.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:31 smithi050 bash[21866]: audit 2024-05-20T22:14:30.810962+0000 mon.c (mon.2) 321 : audit 1 from='client.? v1:172.21.15.50:0/3075524203' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:31.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:31 smithi050 bash[21866]: audit 2024-05-20T22:14:30.811442+0000 mon.a (mon.0) 2134 : audit 1 from='client.26156 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:31.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:31 smithi050 bash[28929]: cluster 2024-05-20T22:14:30.126333+0000 mgr.y (mgr.14592) 331 : cluster 0 pgmap v422: 396 pgs: 396 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-05-20T22:14:31.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:31 smithi050 bash[28929]: audit 2024-05-20T22:14:30.344057+0000 mon.a (mon.0) 2132 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-35"}]': finished 2024-05-20T22:14:31.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:31 smithi050 bash[28929]: cluster 2024-05-20T22:14:30.809728+0000 mon.a (mon.0) 2133 : cluster 0 osdmap e274: 8 total, 8 up, 8 in 2024-05-20T22:14:31.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:31 smithi050 bash[28929]: audit 2024-05-20T22:14:30.810962+0000 mon.c (mon.2) 321 : audit 1 from='client.? v1:172.21.15.50:0/3075524203' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:31.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:31 smithi050 bash[28929]: audit 2024-05-20T22:14:30.811442+0000 mon.a (mon.0) 2134 : audit 1 from='client.26156 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:32.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:32 smithi145 bash[23893]: audit 2024-05-20T22:14:31.347145+0000 mon.a (mon.0) 2135 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi050-63944-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi050-63944-52"}]': finished 2024-05-20T22:14:32.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:32 smithi145 bash[23893]: audit 2024-05-20T22:14:31.347339+0000 mon.a (mon.0) 2136 : audit 1 from='client.26156 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi050-63936-41"}]': finished 2024-05-20T22:14:32.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:32 smithi145 bash[23893]: audit 2024-05-20T22:14:31.354822+0000 mon.c (mon.2) 322 : audit 1 from='client.? v1:172.21.15.50:0/3075524203' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:32.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:32 smithi145 bash[23893]: cluster 2024-05-20T22:14:31.357146+0000 mon.a (mon.0) 2137 : cluster 0 osdmap e275: 8 total, 8 up, 8 in 2024-05-20T22:14:32.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:32 smithi145 bash[23893]: audit 2024-05-20T22:14:31.365545+0000 mon.a (mon.0) 2138 : audit 1 from='client.26156 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:32.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:32 smithi145 bash[23893]: audit 2024-05-20T22:14:31.429188+0000 mon.a (mon.0) 2139 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:32.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:32 smithi145 bash[23893]: audit 2024-05-20T22:14:32.350874+0000 mon.a (mon.0) 2140 : audit 1 from='client.26156 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi050-63936-41"}]': finished 2024-05-20T22:14:32.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:32 smithi145 bash[23893]: audit 2024-05-20T22:14:32.351083+0000 mon.a (mon.0) 2141 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:32.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:32 smithi145 bash[23893]: cluster 2024-05-20T22:14:32.359010+0000 mon.a (mon.0) 2142 : cluster 0 osdmap e276: 8 total, 8 up, 8 in 2024-05-20T22:14:32.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:32 smithi145 bash[23893]: audit 2024-05-20T22:14:32.363275+0000 mon.a (mon.0) 2143 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-35"}]: dispatch 2024-05-20T22:14:32.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:32 smithi050 bash[21866]: audit 2024-05-20T22:14:31.347145+0000 mon.a (mon.0) 2135 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi050-63944-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi050-63944-52"}]': finished 2024-05-20T22:14:32.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:32 smithi050 bash[21866]: audit 2024-05-20T22:14:31.347339+0000 mon.a (mon.0) 2136 : audit 1 from='client.26156 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi050-63936-41"}]': finished 2024-05-20T22:14:32.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:32 smithi050 bash[21866]: audit 2024-05-20T22:14:31.354822+0000 mon.c (mon.2) 322 : audit 1 from='client.? v1:172.21.15.50:0/3075524203' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:32.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:32 smithi050 bash[21866]: cluster 2024-05-20T22:14:31.357146+0000 mon.a (mon.0) 2137 : cluster 0 osdmap e275: 8 total, 8 up, 8 in 2024-05-20T22:14:32.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:32 smithi050 bash[21866]: audit 2024-05-20T22:14:31.365545+0000 mon.a (mon.0) 2138 : audit 1 from='client.26156 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:32.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:32 smithi050 bash[21866]: audit 2024-05-20T22:14:31.429188+0000 mon.a (mon.0) 2139 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:32.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:32 smithi050 bash[21866]: audit 2024-05-20T22:14:32.350874+0000 mon.a (mon.0) 2140 : audit 1 from='client.26156 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi050-63936-41"}]': finished 2024-05-20T22:14:32.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:32 smithi050 bash[21866]: audit 2024-05-20T22:14:32.351083+0000 mon.a (mon.0) 2141 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:32.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:32 smithi050 bash[21866]: cluster 2024-05-20T22:14:32.359010+0000 mon.a (mon.0) 2142 : cluster 0 osdmap e276: 8 total, 8 up, 8 in 2024-05-20T22:14:32.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:32 smithi050 bash[21866]: audit 2024-05-20T22:14:32.363275+0000 mon.a (mon.0) 2143 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-35"}]: dispatch 2024-05-20T22:14:32.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:32 smithi050 bash[28929]: audit 2024-05-20T22:14:31.347145+0000 mon.a (mon.0) 2135 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi050-63944-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi050-63944-52"}]': finished 2024-05-20T22:14:32.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:32 smithi050 bash[28929]: audit 2024-05-20T22:14:31.347339+0000 mon.a (mon.0) 2136 : audit 1 from='client.26156 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi050-63936-41"}]': finished 2024-05-20T22:14:32.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:32 smithi050 bash[28929]: audit 2024-05-20T22:14:31.354822+0000 mon.c (mon.2) 322 : audit 1 from='client.? v1:172.21.15.50:0/3075524203' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:32.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:32 smithi050 bash[28929]: cluster 2024-05-20T22:14:31.357146+0000 mon.a (mon.0) 2137 : cluster 0 osdmap e275: 8 total, 8 up, 8 in 2024-05-20T22:14:32.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:32 smithi050 bash[28929]: audit 2024-05-20T22:14:31.365545+0000 mon.a (mon.0) 2138 : audit 1 from='client.26156 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi050-63936-41"}]: dispatch 2024-05-20T22:14:32.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:32 smithi050 bash[28929]: audit 2024-05-20T22:14:31.429188+0000 mon.a (mon.0) 2139 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:32.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:32 smithi050 bash[28929]: audit 2024-05-20T22:14:32.350874+0000 mon.a (mon.0) 2140 : audit 1 from='client.26156 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi050-63936-41"}]': finished 2024-05-20T22:14:32.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:32 smithi050 bash[28929]: audit 2024-05-20T22:14:32.351083+0000 mon.a (mon.0) 2141 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:32.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:32 smithi050 bash[28929]: cluster 2024-05-20T22:14:32.359010+0000 mon.a (mon.0) 2142 : cluster 0 osdmap e276: 8 total, 8 up, 8 in 2024-05-20T22:14:32.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:32 smithi050 bash[28929]: audit 2024-05-20T22:14:32.363275+0000 mon.a (mon.0) 2143 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-35"}]: dispatch 2024-05-20T22:14:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:33 smithi145 bash[23893]: cluster 2024-05-20T22:14:32.127347+0000 mgr.y (mgr.14592) 332 : cluster 0 pgmap v425: 396 pgs: 8 unknown, 388 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-05-20T22:14:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:33 smithi145 bash[23893]: audit 2024-05-20T22:14:32.397593+0000 mon.a (mon.0) 2144 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi050-63936-42"}]: dispatch 2024-05-20T22:14:33.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:33 smithi145 bash[23893]: audit 2024-05-20T22:14:32.399007+0000 mon.a (mon.0) 2145 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi050-63936-42"}]: dispatch 2024-05-20T22:14:33.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:33 smithi145 bash[23893]: audit 2024-05-20T22:14:32.399335+0000 mon.a (mon.0) 2146 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi050-63936-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:33.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:33 smithi145 bash[23893]: cluster 2024-05-20T22:14:33.351260+0000 mon.a (mon.0) 2147 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:14:33.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:33 smithi145 bash[23893]: audit 2024-05-20T22:14:33.353460+0000 mon.a (mon.0) 2148 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-35"}]': finished 2024-05-20T22:14:33.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:33 smithi145 bash[23893]: audit 2024-05-20T22:14:33.353618+0000 mon.a (mon.0) 2149 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi050-63936-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:33.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:33 smithi145 bash[23893]: cluster 2024-05-20T22:14:33.361520+0000 mon.a (mon.0) 2150 : cluster 0 osdmap e277: 8 total, 8 up, 8 in 2024-05-20T22:14:33.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:33 smithi145 bash[23893]: audit 2024-05-20T22:14:33.363001+0000 mon.a (mon.0) 2151 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi050-63936-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi050-63936-42"}]: dispatch 2024-05-20T22:14:33.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:33 smithi145 bash[23893]: audit 2024-05-20T22:14:33.366484+0000 mon.a (mon.0) 2152 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi050-63944-52"}]: dispatch 2024-05-20T22:14:33.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:33 smithi050 bash[21866]: cluster 2024-05-20T22:14:32.127347+0000 mgr.y (mgr.14592) 332 : cluster 0 pgmap v425: 396 pgs: 8 unknown, 388 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-05-20T22:14:33.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:33 smithi050 bash[21866]: audit 2024-05-20T22:14:32.397593+0000 mon.a (mon.0) 2144 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi050-63936-42"}]: dispatch 2024-05-20T22:14:33.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:33 smithi050 bash[21866]: audit 2024-05-20T22:14:32.399007+0000 mon.a (mon.0) 2145 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi050-63936-42"}]: dispatch 2024-05-20T22:14:33.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:33 smithi050 bash[21866]: audit 2024-05-20T22:14:32.399335+0000 mon.a (mon.0) 2146 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi050-63936-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:33.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:33 smithi050 bash[21866]: cluster 2024-05-20T22:14:33.351260+0000 mon.a (mon.0) 2147 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:14:33.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:33 smithi050 bash[21866]: audit 2024-05-20T22:14:33.353460+0000 mon.a (mon.0) 2148 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-35"}]': finished 2024-05-20T22:14:33.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:33 smithi050 bash[21866]: audit 2024-05-20T22:14:33.353618+0000 mon.a (mon.0) 2149 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi050-63936-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:33.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:33 smithi050 bash[21866]: cluster 2024-05-20T22:14:33.361520+0000 mon.a (mon.0) 2150 : cluster 0 osdmap e277: 8 total, 8 up, 8 in 2024-05-20T22:14:33.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:33 smithi050 bash[21866]: audit 2024-05-20T22:14:33.363001+0000 mon.a (mon.0) 2151 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi050-63936-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi050-63936-42"}]: dispatch 2024-05-20T22:14:33.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:33 smithi050 bash[21866]: audit 2024-05-20T22:14:33.366484+0000 mon.a (mon.0) 2152 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi050-63944-52"}]: dispatch 2024-05-20T22:14:33.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:33 smithi050 bash[28929]: cluster 2024-05-20T22:14:32.127347+0000 mgr.y (mgr.14592) 332 : cluster 0 pgmap v425: 396 pgs: 8 unknown, 388 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-05-20T22:14:33.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:33 smithi050 bash[28929]: audit 2024-05-20T22:14:32.397593+0000 mon.a (mon.0) 2144 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi050-63936-42"}]: dispatch 2024-05-20T22:14:33.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:33 smithi050 bash[28929]: audit 2024-05-20T22:14:32.399007+0000 mon.a (mon.0) 2145 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi050-63936-42"}]: dispatch 2024-05-20T22:14:33.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:33 smithi050 bash[28929]: audit 2024-05-20T22:14:32.399335+0000 mon.a (mon.0) 2146 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi050-63936-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:33.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:33 smithi050 bash[28929]: cluster 2024-05-20T22:14:33.351260+0000 mon.a (mon.0) 2147 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:14:33.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:33 smithi050 bash[28929]: audit 2024-05-20T22:14:33.353460+0000 mon.a (mon.0) 2148 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-35"}]': finished 2024-05-20T22:14:33.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:33 smithi050 bash[28929]: audit 2024-05-20T22:14:33.353618+0000 mon.a (mon.0) 2149 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi050-63936-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:33.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:33 smithi050 bash[28929]: cluster 2024-05-20T22:14:33.361520+0000 mon.a (mon.0) 2150 : cluster 0 osdmap e277: 8 total, 8 up, 8 in 2024-05-20T22:14:33.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:33 smithi050 bash[28929]: audit 2024-05-20T22:14:33.363001+0000 mon.a (mon.0) 2151 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi050-63936-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi050-63936-42"}]: dispatch 2024-05-20T22:14:33.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:33 smithi050 bash[28929]: audit 2024-05-20T22:14:33.366484+0000 mon.a (mon.0) 2152 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi050-63944-52"}]: dispatch 2024-05-20T22:14:35.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:35 smithi145 bash[23893]: cluster 2024-05-20T22:14:34.208590+0000 mon.a (mon.0) 2153 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:35.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:35 smithi145 bash[23893]: audit 2024-05-20T22:14:34.356981+0000 mon.a (mon.0) 2154 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi050-63944-52"}]': finished 2024-05-20T22:14:35.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:35 smithi050 bash[21866]: cluster 2024-05-20T22:14:34.208590+0000 mon.a (mon.0) 2153 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:35.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:35 smithi050 bash[21866]: audit 2024-05-20T22:14:34.356981+0000 mon.a (mon.0) 2154 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi050-63944-52"}]': finished 2024-05-20T22:14:35.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:35 smithi050 bash[28929]: cluster 2024-05-20T22:14:34.208590+0000 mon.a (mon.0) 2153 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:35.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:35 smithi050 bash[28929]: audit 2024-05-20T22:14:34.356981+0000 mon.a (mon.0) 2154 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi050-63944-52"}]': finished 2024-05-20T22:14:36.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:36 smithi145 bash[23893]: cluster 2024-05-20T22:14:34.128375+0000 mgr.y (mgr.14592) 333 : cluster 0 pgmap v428: 388 pgs: 388 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:36.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:36 smithi145 bash[23893]: cluster 2024-05-20T22:14:34.832753+0000 mon.a (mon.0) 2155 : cluster 0 osdmap e278: 8 total, 8 up, 8 in 2024-05-20T22:14:36.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:36 smithi145 bash[23893]: audit 2024-05-20T22:14:34.834598+0000 mon.a (mon.0) 2156 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi050-63944-52"}]: dispatch 2024-05-20T22:14:36.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:36 smithi145 bash[23893]: audit 2024-05-20T22:14:35.361316+0000 mon.a (mon.0) 2157 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi050-63936-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi050-63936-42"}]': finished 2024-05-20T22:14:36.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:36 smithi145 bash[23893]: audit 2024-05-20T22:14:35.361492+0000 mon.a (mon.0) 2158 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi050-63944-52"}]': finished 2024-05-20T22:14:36.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:36 smithi145 bash[23893]: cluster 2024-05-20T22:14:35.368847+0000 mon.a (mon.0) 2159 : cluster 0 osdmap e279: 8 total, 8 up, 8 in 2024-05-20T22:14:36.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:36 smithi145 bash[23893]: audit 2024-05-20T22:14:35.377935+0000 mon.a (mon.0) 2160 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:36.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:36 smithi145 bash[23893]: audit 2024-05-20T22:14:35.407316+0000 mon.c (mon.2) 323 : audit 1 from='client.? v1:172.21.15.50:0/3180505524' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:36.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:36 smithi145 bash[23893]: audit 2024-05-20T22:14:35.407903+0000 mon.a (mon.0) 2161 : audit 1 from='client.26177 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:36.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:36 smithi145 bash[23893]: audit 2024-05-20T22:14:35.408843+0000 mon.c (mon.2) 324 : audit 1 from='client.? v1:172.21.15.50:0/3180505524' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:36.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:36 smithi145 bash[23893]: audit 2024-05-20T22:14:35.409086+0000 mon.a (mon.0) 2162 : audit 1 from='client.26177 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:36.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:36 smithi145 bash[23893]: audit 2024-05-20T22:14:35.409562+0000 mon.c (mon.2) 325 : audit 1 from='client.? v1:172.21.15.50:0/3180505524' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:36.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:36 smithi145 bash[23893]: audit 2024-05-20T22:14:35.409910+0000 mon.a (mon.0) 2163 : audit 1 from='client.26177 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:36.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:36 smithi050 bash[21866]: cluster 2024-05-20T22:14:34.128375+0000 mgr.y (mgr.14592) 333 : cluster 0 pgmap v428: 388 pgs: 388 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:36.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:36 smithi050 bash[21866]: cluster 2024-05-20T22:14:34.832753+0000 mon.a (mon.0) 2155 : cluster 0 osdmap e278: 8 total, 8 up, 8 in 2024-05-20T22:14:36.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:36 smithi050 bash[21866]: audit 2024-05-20T22:14:34.834598+0000 mon.a (mon.0) 2156 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi050-63944-52"}]: dispatch 2024-05-20T22:14:36.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:36 smithi050 bash[21866]: audit 2024-05-20T22:14:35.361316+0000 mon.a (mon.0) 2157 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi050-63936-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi050-63936-42"}]': finished 2024-05-20T22:14:36.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:36 smithi050 bash[21866]: audit 2024-05-20T22:14:35.361492+0000 mon.a (mon.0) 2158 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi050-63944-52"}]': finished 2024-05-20T22:14:36.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:36 smithi050 bash[21866]: cluster 2024-05-20T22:14:35.368847+0000 mon.a (mon.0) 2159 : cluster 0 osdmap e279: 8 total, 8 up, 8 in 2024-05-20T22:14:36.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:36 smithi050 bash[21866]: audit 2024-05-20T22:14:35.377935+0000 mon.a (mon.0) 2160 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:36.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:36 smithi050 bash[21866]: audit 2024-05-20T22:14:35.407316+0000 mon.c (mon.2) 323 : audit 1 from='client.? v1:172.21.15.50:0/3180505524' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:36.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:36 smithi050 bash[21866]: audit 2024-05-20T22:14:35.407903+0000 mon.a (mon.0) 2161 : audit 1 from='client.26177 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:36.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:36 smithi050 bash[21866]: audit 2024-05-20T22:14:35.408843+0000 mon.c (mon.2) 324 : audit 1 from='client.? v1:172.21.15.50:0/3180505524' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:36.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:36 smithi050 bash[21866]: audit 2024-05-20T22:14:35.409086+0000 mon.a (mon.0) 2162 : audit 1 from='client.26177 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:36.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:36 smithi050 bash[21866]: audit 2024-05-20T22:14:35.409562+0000 mon.c (mon.2) 325 : audit 1 from='client.? v1:172.21.15.50:0/3180505524' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:36.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:36 smithi050 bash[21866]: audit 2024-05-20T22:14:35.409910+0000 mon.a (mon.0) 2163 : audit 1 from='client.26177 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:36.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:36 smithi050 bash[28929]: cluster 2024-05-20T22:14:34.128375+0000 mgr.y (mgr.14592) 333 : cluster 0 pgmap v428: 388 pgs: 388 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:36.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:36 smithi050 bash[28929]: cluster 2024-05-20T22:14:34.832753+0000 mon.a (mon.0) 2155 : cluster 0 osdmap e278: 8 total, 8 up, 8 in 2024-05-20T22:14:36.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:36 smithi050 bash[28929]: audit 2024-05-20T22:14:34.834598+0000 mon.a (mon.0) 2156 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi050-63944-52"}]: dispatch 2024-05-20T22:14:36.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:36 smithi050 bash[28929]: audit 2024-05-20T22:14:35.361316+0000 mon.a (mon.0) 2157 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi050-63936-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi050-63936-42"}]': finished 2024-05-20T22:14:36.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:36 smithi050 bash[28929]: audit 2024-05-20T22:14:35.361492+0000 mon.a (mon.0) 2158 : audit 1 from='client.? v1:172.21.15.50:0/1986713572' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi050-63944-52"}]': finished 2024-05-20T22:14:36.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:36 smithi050 bash[28929]: cluster 2024-05-20T22:14:35.368847+0000 mon.a (mon.0) 2159 : cluster 0 osdmap e279: 8 total, 8 up, 8 in 2024-05-20T22:14:36.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:36 smithi050 bash[28929]: audit 2024-05-20T22:14:35.377935+0000 mon.a (mon.0) 2160 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:36.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:36 smithi050 bash[28929]: audit 2024-05-20T22:14:35.407316+0000 mon.c (mon.2) 323 : audit 1 from='client.? v1:172.21.15.50:0/3180505524' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:36.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:36 smithi050 bash[28929]: audit 2024-05-20T22:14:35.407903+0000 mon.a (mon.0) 2161 : audit 1 from='client.26177 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:36.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:36 smithi050 bash[28929]: audit 2024-05-20T22:14:35.408843+0000 mon.c (mon.2) 324 : audit 1 from='client.? v1:172.21.15.50:0/3180505524' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:36.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:36 smithi050 bash[28929]: audit 2024-05-20T22:14:35.409086+0000 mon.a (mon.0) 2162 : audit 1 from='client.26177 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:36.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:36 smithi050 bash[28929]: audit 2024-05-20T22:14:35.409562+0000 mon.c (mon.2) 325 : audit 1 from='client.? v1:172.21.15.50:0/3180505524' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:36.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:36 smithi050 bash[28929]: audit 2024-05-20T22:14:35.409910+0000 mon.a (mon.0) 2163 : audit 1 from='client.26177 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:38.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:14:37 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:14:38.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:37 smithi145 bash[23893]: cluster 2024-05-20T22:14:36.129378+0000 mgr.y (mgr.14592) 334 : cluster 0 pgmap v431: 396 pgs: 40 unknown, 356 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-20T22:14:38.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:37 smithi145 bash[23893]: audit 2024-05-20T22:14:36.370525+0000 mon.a (mon.0) 2164 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:38.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:37 smithi145 bash[23893]: audit 2024-05-20T22:14:36.370726+0000 mon.a (mon.0) 2165 : audit 1 from='client.26177 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:38.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:37 smithi145 bash[23893]: cluster 2024-05-20T22:14:36.378087+0000 mon.a (mon.0) 2166 : cluster 0 osdmap e280: 8 total, 8 up, 8 in 2024-05-20T22:14:38.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:37 smithi145 bash[23893]: audit 2024-05-20T22:14:36.379899+0000 mon.c (mon.2) 326 : audit 1 from='client.? v1:172.21.15.50:0/3180505524' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi050-63944-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:38.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:37 smithi145 bash[23893]: audit 2024-05-20T22:14:36.382452+0000 mon.a (mon.0) 2167 : audit 1 from='client.26177 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi050-63944-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:38.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:37 smithi145 bash[23893]: audit 2024-05-20T22:14:36.383987+0000 mon.a (mon.0) 2168 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:14:38.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:37 smithi145 bash[23893]: audit 2024-05-20T22:14:36.940731+0000 mon.a (mon.0) 2169 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:14:38.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:37 smithi050 bash[21866]: cluster 2024-05-20T22:14:36.129378+0000 mgr.y (mgr.14592) 334 : cluster 0 pgmap v431: 396 pgs: 40 unknown, 356 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-20T22:14:38.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:37 smithi050 bash[21866]: audit 2024-05-20T22:14:36.370525+0000 mon.a (mon.0) 2164 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:38.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:37 smithi050 bash[21866]: audit 2024-05-20T22:14:36.370726+0000 mon.a (mon.0) 2165 : audit 1 from='client.26177 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:38.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:37 smithi050 bash[21866]: cluster 2024-05-20T22:14:36.378087+0000 mon.a (mon.0) 2166 : cluster 0 osdmap e280: 8 total, 8 up, 8 in 2024-05-20T22:14:38.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:37 smithi050 bash[21866]: audit 2024-05-20T22:14:36.379899+0000 mon.c (mon.2) 326 : audit 1 from='client.? v1:172.21.15.50:0/3180505524' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi050-63944-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:38.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:37 smithi050 bash[21866]: audit 2024-05-20T22:14:36.382452+0000 mon.a (mon.0) 2167 : audit 1 from='client.26177 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi050-63944-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:38.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:37 smithi050 bash[21866]: audit 2024-05-20T22:14:36.383987+0000 mon.a (mon.0) 2168 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:14:38.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:37 smithi050 bash[21866]: audit 2024-05-20T22:14:36.940731+0000 mon.a (mon.0) 2169 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:14:38.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:37 smithi050 bash[28929]: cluster 2024-05-20T22:14:36.129378+0000 mgr.y (mgr.14592) 334 : cluster 0 pgmap v431: 396 pgs: 40 unknown, 356 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-20T22:14:38.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:37 smithi050 bash[28929]: audit 2024-05-20T22:14:36.370525+0000 mon.a (mon.0) 2164 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:38.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:37 smithi050 bash[28929]: audit 2024-05-20T22:14:36.370726+0000 mon.a (mon.0) 2165 : audit 1 from='client.26177 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:38.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:37 smithi050 bash[28929]: cluster 2024-05-20T22:14:36.378087+0000 mon.a (mon.0) 2166 : cluster 0 osdmap e280: 8 total, 8 up, 8 in 2024-05-20T22:14:38.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:37 smithi050 bash[28929]: audit 2024-05-20T22:14:36.379899+0000 mon.c (mon.2) 326 : audit 1 from='client.? v1:172.21.15.50:0/3180505524' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi050-63944-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:38.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:37 smithi050 bash[28929]: audit 2024-05-20T22:14:36.382452+0000 mon.a (mon.0) 2167 : audit 1 from='client.26177 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi050-63944-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:38.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:37 smithi050 bash[28929]: audit 2024-05-20T22:14:36.383987+0000 mon.a (mon.0) 2168 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:14:38.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:37 smithi050 bash[28929]: audit 2024-05-20T22:14:36.940731+0000 mon.a (mon.0) 2169 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:14:39.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:38 smithi145 bash[23893]: audit 2024-05-20T22:14:37.374382+0000 mon.a (mon.0) 2170 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-37", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:14:39.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:38 smithi145 bash[23893]: cluster 2024-05-20T22:14:37.842505+0000 mon.a (mon.0) 2171 : cluster 0 osdmap e281: 8 total, 8 up, 8 in 2024-05-20T22:14:39.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:38 smithi145 bash[23893]: audit 2024-05-20T22:14:37.843378+0000 mon.a (mon.0) 2172 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-37"}]: dispatch 2024-05-20T22:14:39.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:38 smithi145 bash[23893]: audit 2024-05-20T22:14:37.843546+0000 mgr.y (mgr.14592) 335 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:14:39.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:38 smithi145 bash[23893]: audit 2024-05-20T22:14:37.849925+0000 mon.a (mon.0) 2173 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi050-63936-42"}]: dispatch 2024-05-20T22:14:39.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:38 smithi145 bash[23893]: cluster 2024-05-20T22:14:38.130353+0000 mgr.y (mgr.14592) 336 : cluster 0 pgmap v434: 388 pgs: 32 unknown, 356 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-20T22:14:39.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:38 smithi145 bash[23893]: audit 2024-05-20T22:14:38.377738+0000 mon.a (mon.0) 2174 : audit 1 from='client.26177 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi050-63944-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi050-63944-53"}]': finished 2024-05-20T22:14:39.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:38 smithi145 bash[23893]: audit 2024-05-20T22:14:38.377964+0000 mon.a (mon.0) 2175 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-37"}]': finished 2024-05-20T22:14:39.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:38 smithi145 bash[23893]: audit 2024-05-20T22:14:38.378075+0000 mon.a (mon.0) 2176 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi050-63936-42"}]': finished 2024-05-20T22:14:39.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:38 smithi145 bash[23893]: cluster 2024-05-20T22:14:38.383839+0000 mon.a (mon.0) 2177 : cluster 0 osdmap e282: 8 total, 8 up, 8 in 2024-05-20T22:14:39.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:38 smithi145 bash[23893]: audit 2024-05-20T22:14:38.385291+0000 mon.a (mon.0) 2178 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-37", "mode": "writeback"}]: dispatch 2024-05-20T22:14:39.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:38 smithi145 bash[23893]: audit 2024-05-20T22:14:38.386604+0000 mon.a (mon.0) 2179 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi050-63936-42"}]: dispatch 2024-05-20T22:14:39.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:38 smithi050 bash[21866]: audit 2024-05-20T22:14:37.374382+0000 mon.a (mon.0) 2170 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-37", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:14:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:38 smithi050 bash[21866]: cluster 2024-05-20T22:14:37.842505+0000 mon.a (mon.0) 2171 : cluster 0 osdmap e281: 8 total, 8 up, 8 in 2024-05-20T22:14:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:38 smithi050 bash[21866]: audit 2024-05-20T22:14:37.843378+0000 mon.a (mon.0) 2172 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-37"}]: dispatch 2024-05-20T22:14:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:38 smithi050 bash[21866]: audit 2024-05-20T22:14:37.843546+0000 mgr.y (mgr.14592) 335 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:14:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:38 smithi050 bash[21866]: audit 2024-05-20T22:14:37.849925+0000 mon.a (mon.0) 2173 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi050-63936-42"}]: dispatch 2024-05-20T22:14:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:38 smithi050 bash[21866]: cluster 2024-05-20T22:14:38.130353+0000 mgr.y (mgr.14592) 336 : cluster 0 pgmap v434: 388 pgs: 32 unknown, 356 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-20T22:14:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:38 smithi050 bash[21866]: audit 2024-05-20T22:14:38.377738+0000 mon.a (mon.0) 2174 : audit 1 from='client.26177 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi050-63944-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi050-63944-53"}]': finished 2024-05-20T22:14:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:38 smithi050 bash[21866]: audit 2024-05-20T22:14:38.377964+0000 mon.a (mon.0) 2175 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-37"}]': finished 2024-05-20T22:14:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:38 smithi050 bash[21866]: audit 2024-05-20T22:14:38.378075+0000 mon.a (mon.0) 2176 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi050-63936-42"}]': finished 2024-05-20T22:14:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:38 smithi050 bash[21866]: cluster 2024-05-20T22:14:38.383839+0000 mon.a (mon.0) 2177 : cluster 0 osdmap e282: 8 total, 8 up, 8 in 2024-05-20T22:14:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:38 smithi050 bash[21866]: audit 2024-05-20T22:14:38.385291+0000 mon.a (mon.0) 2178 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-37", "mode": "writeback"}]: dispatch 2024-05-20T22:14:39.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:38 smithi050 bash[21866]: audit 2024-05-20T22:14:38.386604+0000 mon.a (mon.0) 2179 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi050-63936-42"}]: dispatch 2024-05-20T22:14:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:38 smithi050 bash[28929]: audit 2024-05-20T22:14:37.374382+0000 mon.a (mon.0) 2170 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-37", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:14:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:38 smithi050 bash[28929]: cluster 2024-05-20T22:14:37.842505+0000 mon.a (mon.0) 2171 : cluster 0 osdmap e281: 8 total, 8 up, 8 in 2024-05-20T22:14:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:38 smithi050 bash[28929]: audit 2024-05-20T22:14:37.843378+0000 mon.a (mon.0) 2172 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-37"}]: dispatch 2024-05-20T22:14:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:38 smithi050 bash[28929]: audit 2024-05-20T22:14:37.843546+0000 mgr.y (mgr.14592) 335 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:14:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:38 smithi050 bash[28929]: audit 2024-05-20T22:14:37.849925+0000 mon.a (mon.0) 2173 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi050-63936-42"}]: dispatch 2024-05-20T22:14:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:38 smithi050 bash[28929]: cluster 2024-05-20T22:14:38.130353+0000 mgr.y (mgr.14592) 336 : cluster 0 pgmap v434: 388 pgs: 32 unknown, 356 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-20T22:14:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:38 smithi050 bash[28929]: audit 2024-05-20T22:14:38.377738+0000 mon.a (mon.0) 2174 : audit 1 from='client.26177 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi050-63944-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi050-63944-53"}]': finished 2024-05-20T22:14:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:38 smithi050 bash[28929]: audit 2024-05-20T22:14:38.377964+0000 mon.a (mon.0) 2175 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-37"}]': finished 2024-05-20T22:14:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:38 smithi050 bash[28929]: audit 2024-05-20T22:14:38.378075+0000 mon.a (mon.0) 2176 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi050-63936-42"}]': finished 2024-05-20T22:14:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:38 smithi050 bash[28929]: cluster 2024-05-20T22:14:38.383839+0000 mon.a (mon.0) 2177 : cluster 0 osdmap e282: 8 total, 8 up, 8 in 2024-05-20T22:14:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:38 smithi050 bash[28929]: audit 2024-05-20T22:14:38.385291+0000 mon.a (mon.0) 2178 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-37", "mode": "writeback"}]: dispatch 2024-05-20T22:14:39.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:38 smithi050 bash[28929]: audit 2024-05-20T22:14:38.386604+0000 mon.a (mon.0) 2179 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi050-63936-42"}]: dispatch 2024-05-20T22:14:39.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: state 2024-05-20T22:14:39.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (6468 ms) 2024-05-20T22:14:39.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2024-05-20T22:14:39.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (7066 ms) 2024-05-20T22:14:39.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2024-05-20T22:14:39.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (6982 ms) 2024-05-20T22:14:39.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2024-05-20T22:14:39.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (7037 ms) 2024-05-20T22:14:39.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2024-05-20T22:14:39.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7044 ms) 2024-05-20T22:14:39.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2024-05-20T22:14:39.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7050 ms) 2024-05-20T22:14:39.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2024-05-20T22:14:39.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (6999 ms) 2024-05-20T22:14:39.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2024-05-20T22:14:39.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7050 ms) 2024-05-20T22:14:39.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2024-05-20T22:14:39.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (7093 ms) 2024-05-20T22:14:39.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2024-05-20T22:14:39.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (6872 ms) 2024-05-20T22:14:39.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-05-20T22:14:39.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (7028 ms) 2024-05-20T22:14:39.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2024-05-20T22:14:39.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6967 ms) 2024-05-20T22:14:39.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2024-05-20T22:14:39.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (7400 ms) 2024-05-20T22:14:39.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2024-05-20T22:14:39.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7085 ms) 2024-05-20T22:14:39.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2024-05-20T22:14:39.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7025 ms) 2024-05-20T22:14:39.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2024-05-20T22:14:39.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (6865 ms) 2024-05-20T22:14:39.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112031 ms total) 2024-05-20T22:14:39.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: 2024-05-20T22:14:39.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [----------] Global test environment tear-down 2024-05-20T22:14:39.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [==========] 42 tests from 2 test suites ran. (232514 ms total) 2024-05-20T22:14:39.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ PASSED ] 42 tests. 2024-05-20T22:14:39.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:14:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:14:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:14:40.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:39 smithi145 bash[23893]: cluster 2024-05-20T22:14:39.209817+0000 mon.a (mon.0) 2180 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:40.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:39 smithi145 bash[23893]: cluster 2024-05-20T22:14:39.211819+0000 mon.a (mon.0) 2181 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:14:40.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:39 smithi145 bash[23893]: audit 2024-05-20T22:14:39.214176+0000 mon.a (mon.0) 2182 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-37", "mode": "writeback"}]': finished 2024-05-20T22:14:40.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:39 smithi145 bash[23893]: audit 2024-05-20T22:14:39.214322+0000 mon.a (mon.0) 2183 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi050-63936-42"}]': finished 2024-05-20T22:14:40.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:39 smithi145 bash[23893]: cluster 2024-05-20T22:14:39.223642+0000 mon.a (mon.0) 2184 : cluster 0 osdmap e283: 8 total, 8 up, 8 in 2024-05-20T22:14:40.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:39 smithi145 bash[23893]: audit 2024-05-20T22:14:39.317539+0000 mon.a (mon.0) 2185 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:40.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:39 smithi050 bash[21866]: cluster 2024-05-20T22:14:39.209817+0000 mon.a (mon.0) 2180 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:40.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:39 smithi050 bash[21866]: cluster 2024-05-20T22:14:39.211819+0000 mon.a (mon.0) 2181 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:14:40.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:39 smithi050 bash[21866]: audit 2024-05-20T22:14:39.214176+0000 mon.a (mon.0) 2182 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-37", "mode": "writeback"}]': finished 2024-05-20T22:14:40.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:39 smithi050 bash[21866]: audit 2024-05-20T22:14:39.214322+0000 mon.a (mon.0) 2183 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi050-63936-42"}]': finished 2024-05-20T22:14:40.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:39 smithi050 bash[21866]: cluster 2024-05-20T22:14:39.223642+0000 mon.a (mon.0) 2184 : cluster 0 osdmap e283: 8 total, 8 up, 8 in 2024-05-20T22:14:40.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:39 smithi050 bash[21866]: audit 2024-05-20T22:14:39.317539+0000 mon.a (mon.0) 2185 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:40.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:39 smithi050 bash[28929]: cluster 2024-05-20T22:14:39.209817+0000 mon.a (mon.0) 2180 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:40.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:39 smithi050 bash[28929]: cluster 2024-05-20T22:14:39.211819+0000 mon.a (mon.0) 2181 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:14:40.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:39 smithi050 bash[28929]: audit 2024-05-20T22:14:39.214176+0000 mon.a (mon.0) 2182 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-37", "mode": "writeback"}]': finished 2024-05-20T22:14:40.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:39 smithi050 bash[28929]: audit 2024-05-20T22:14:39.214322+0000 mon.a (mon.0) 2183 : audit 1 from='client.? v1:172.21.15.50:0/2726348769' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi050-63936-42"}]': finished 2024-05-20T22:14:40.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:39 smithi050 bash[28929]: cluster 2024-05-20T22:14:39.223642+0000 mon.a (mon.0) 2184 : cluster 0 osdmap e283: 8 total, 8 up, 8 in 2024-05-20T22:14:40.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:39 smithi050 bash[28929]: audit 2024-05-20T22:14:39.317539+0000 mon.a (mon.0) 2185 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:41.083 INFO:tasks.workunit.client.0.smithi050.stdout:rted 0x557408861390 2024-05-20T22:14:41.083 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408860ee0 2024-05-20T22:14:41.083 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408861010 2024-05-20T22:14:41.083 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408861120 2024-05-20T22:14:41.083 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408861250 2024-05-20T22:14:41.083 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408861950 2024-05-20T22:14:41.083 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088614a0 2024-05-20T22:14:41.083 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088615d0 2024-05-20T22:14:41.083 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408861700 2024-05-20T22:14:41.083 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408861830 2024-05-20T22:14:41.083 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408861f30 2024-05-20T22:14:41.084 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408861a80 2024-05-20T22:14:41.084 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408861bb0 2024-05-20T22:14:41.084 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408861d00 2024-05-20T22:14:41.084 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408862060 2024-05-20T22:14:41.084 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408862530 2024-05-20T22:14:41.084 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408862640 2024-05-20T22:14:41.084 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408862c40 2024-05-20T22:14:41.084 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408862190 2024-05-20T22:14:41.084 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088622c0 2024-05-20T22:14:41.084 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408862790 2024-05-20T22:14:41.084 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088628e0 2024-05-20T22:14:41.084 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088629f0 2024-05-20T22:14:41.084 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408862b20 2024-05-20T22:14:41.085 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408863200 2024-05-20T22:14:41.085 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408862d50 2024-05-20T22:14:41.085 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408862ea0 2024-05-20T22:14:41.085 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408862fb0 2024-05-20T22:14:41.085 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408863330 2024-05-20T22:14:41.085 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408863800 2024-05-20T22:14:41.085 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408863930 2024-05-20T22:14:41.085 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088630e0 2024-05-20T22:14:41.085 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408863a60 2024-05-20T22:14:41.085 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408863bf0 2024-05-20T22:14:41.085 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088641f0 2024-05-20T22:14:41.085 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885ea30 2024-05-20T22:14:41.085 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408861e10 2024-05-20T22:14:41.085 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885eb80 2024-05-20T22:14:41.086 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740885ecb0 2024-05-20T22:14:41.086 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408863d40 2024-05-20T22:14:41.086 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408863460 2024-05-20T22:14:41.086 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408863590 2024-05-20T22:14:41.086 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088636e0 2024-05-20T22:14:41.086 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088647f0 2024-05-20T22:14:41.086 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408864340 2024-05-20T22:14:41.086 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408864490 2024-05-20T22:14:41.086 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088645e0 2024-05-20T22:14:41.086 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408864920 2024-05-20T22:14:41.086 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408864e40 2024-05-20T22:14:41.086 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408864f70 2024-05-20T22:14:41.086 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408865530 2024-05-20T22:14:41.087 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408864a50 2024-05-20T22:14:41.087 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408864b60 2024-05-20T22:14:41.087 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408864c90 2024-05-20T22:14:41.087 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408865660 2024-05-20T22:14:41.087 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408865080 2024-05-20T22:14:41.087 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408863e50 2024-05-20T22:14:41.087 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408863fa0 2024-05-20T22:14:41.087 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088640b0 2024-05-20T22:14:41.087 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408865c60 2024-05-20T22:14:41.087 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088657b0 2024-05-20T22:14:41.087 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088658e0 2024-05-20T22:14:41.087 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408865a30 2024-05-20T22:14:41.087 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408865d90 2024-05-20T22:14:41.087 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408866260 2024-05-20T22:14:41.087 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408866390 2024-05-20T22:14:41.088 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408865b40 2024-05-20T22:14:41.088 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088664c0 2024-05-20T22:14:41.088 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088665f0 2024-05-20T22:14:41.088 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408865ea0 2024-05-20T22:14:41.088 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408865ff0 2024-05-20T22:14:41.088 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408866bd0 2024-05-20T22:14:41.088 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408866720 2024-05-20T22:14:41.088 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408866870 2024-05-20T22:14:41.088 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088669c0 2024-05-20T22:14:41.088 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408866ce0 2024-05-20T22:14:41.088 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088671d0 2024-05-20T22:14:41.088 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408867300 2024-05-20T22:14:41.088 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088678e0 2024-05-20T22:14:41.088 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408866e30 2024-05-20T22:14:41.089 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408866f60 2024-05-20T22:14:41.089 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088670b0 2024-05-20T22:14:41.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:41 smithi145 bash[23893]: cluster 2024-05-20T22:14:40.133615+0000 mgr.y (mgr.14592) 337 : cluster 0 pgmap v437: 396 pgs: 396 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 5.2 KiB/s wr, 4 op/s 2024-05-20T22:14:41.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:41 smithi145 bash[23893]: audit 2024-05-20T22:14:40.216894+0000 mon.a (mon.0) 2186 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:41.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:41 smithi145 bash[23893]: cluster 2024-05-20T22:14:40.223679+0000 mon.a (mon.0) 2187 : cluster 0 osdmap e284: 8 total, 8 up, 8 in 2024-05-20T22:14:41.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:41 smithi145 bash[23893]: audit 2024-05-20T22:14:40.226270+0000 mon.a (mon.0) 2188 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-37"}]: dispatch 2024-05-20T22:14:41.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:41 smithi145 bash[23893]: audit 2024-05-20T22:14:40.226627+0000 mon.c (mon.2) 327 : audit 1 from='client.? v1:172.21.15.50:0/3180505524' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:41.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:41 smithi145 bash[23893]: audit 2024-05-20T22:14:40.227722+0000 mon.a (mon.0) 2189 : audit 1 from='client.26177 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:41.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:41 smithi050 bash[21866]: cluster 2024-05-20T22:14:40.133615+0000 mgr.y (mgr.14592) 337 : cluster 0 pgmap v437: 396 pgs: 396 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 5.2 KiB/s wr, 4 op/s 2024-05-20T22:14:41.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:41 smithi050 bash[21866]: audit 2024-05-20T22:14:40.216894+0000 mon.a (mon.0) 2186 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:41.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:41 smithi050 bash[21866]: cluster 2024-05-20T22:14:40.223679+0000 mon.a (mon.0) 2187 : cluster 0 osdmap e284: 8 total, 8 up, 8 in 2024-05-20T22:14:41.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:41 smithi050 bash[21866]: audit 2024-05-20T22:14:40.226270+0000 mon.a (mon.0) 2188 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-37"}]: dispatch 2024-05-20T22:14:41.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:41 smithi050 bash[21866]: audit 2024-05-20T22:14:40.226627+0000 mon.c (mon.2) 327 : audit 1 from='client.? v1:172.21.15.50:0/3180505524' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:41.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:41 smithi050 bash[21866]: audit 2024-05-20T22:14:40.227722+0000 mon.a (mon.0) 2189 : audit 1 from='client.26177 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:41.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:41 smithi050 bash[28929]: cluster 2024-05-20T22:14:40.133615+0000 mgr.y (mgr.14592) 337 : cluster 0 pgmap v437: 396 pgs: 396 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 5.2 KiB/s wr, 4 op/s 2024-05-20T22:14:41.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:41 smithi050 bash[28929]: audit 2024-05-20T22:14:40.216894+0000 mon.a (mon.0) 2186 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:41.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:41 smithi050 bash[28929]: cluster 2024-05-20T22:14:40.223679+0000 mon.a (mon.0) 2187 : cluster 0 osdmap e284: 8 total, 8 up, 8 in 2024-05-20T22:14:41.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:41 smithi050 bash[28929]: audit 2024-05-20T22:14:40.226270+0000 mon.a (mon.0) 2188 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-37"}]: dispatch 2024-05-20T22:14:41.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:41 smithi050 bash[28929]: audit 2024-05-20T22:14:40.226627+0000 mon.c (mon.2) 327 : audit 1 from='client.? v1:172.21.15.50:0/3180505524' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:41.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:41 smithi050 bash[28929]: audit 2024-05-20T22:14:40.227722+0000 mon.a (mon.0) 2189 : audit 1 from='client.26177 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:42.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:42 smithi145 bash[23893]: cluster 2024-05-20T22:14:41.217453+0000 mon.a (mon.0) 2190 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:14:42.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:42 smithi145 bash[23893]: audit 2024-05-20T22:14:41.220075+0000 mon.a (mon.0) 2191 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-37"}]': finished 2024-05-20T22:14:42.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:42 smithi145 bash[23893]: audit 2024-05-20T22:14:41.220277+0000 mon.a (mon.0) 2192 : audit 1 from='client.26177 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53"}]': finished 2024-05-20T22:14:42.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:42 smithi145 bash[23893]: cluster 2024-05-20T22:14:41.227968+0000 mon.a (mon.0) 2193 : cluster 0 osdmap e285: 8 total, 8 up, 8 in 2024-05-20T22:14:42.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:42 smithi145 bash[23893]: audit 2024-05-20T22:14:41.231364+0000 mon.c (mon.2) 328 : audit 1 from='client.? v1:172.21.15.50:0/3180505524' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:42.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:42 smithi145 bash[23893]: audit 2024-05-20T22:14:41.247334+0000 mon.a (mon.0) 2194 : audit 1 from='client.26177 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:42.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:42 smithi050 bash[21866]: cluster 2024-05-20T22:14:41.217453+0000 mon.a (mon.0) 2190 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:14:42.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:42 smithi050 bash[21866]: audit 2024-05-20T22:14:41.220075+0000 mon.a (mon.0) 2191 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-37"}]': finished 2024-05-20T22:14:42.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:42 smithi050 bash[21866]: audit 2024-05-20T22:14:41.220277+0000 mon.a (mon.0) 2192 : audit 1 from='client.26177 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53"}]': finished 2024-05-20T22:14:42.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:42 smithi050 bash[21866]: cluster 2024-05-20T22:14:41.227968+0000 mon.a (mon.0) 2193 : cluster 0 osdmap e285: 8 total, 8 up, 8 in 2024-05-20T22:14:42.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:42 smithi050 bash[21866]: audit 2024-05-20T22:14:41.231364+0000 mon.c (mon.2) 328 : audit 1 from='client.? v1:172.21.15.50:0/3180505524' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:42.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:42 smithi050 bash[21866]: audit 2024-05-20T22:14:41.247334+0000 mon.a (mon.0) 2194 : audit 1 from='client.26177 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:42.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:42 smithi050 bash[28929]: cluster 2024-05-20T22:14:41.217453+0000 mon.a (mon.0) 2190 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:14:42.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:42 smithi050 bash[28929]: audit 2024-05-20T22:14:41.220075+0000 mon.a (mon.0) 2191 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-37"}]': finished 2024-05-20T22:14:42.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:42 smithi050 bash[28929]: audit 2024-05-20T22:14:41.220277+0000 mon.a (mon.0) 2192 : audit 1 from='client.26177 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi050-63944-53"}]': finished 2024-05-20T22:14:42.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:42 smithi050 bash[28929]: cluster 2024-05-20T22:14:41.227968+0000 mon.a (mon.0) 2193 : cluster 0 osdmap e285: 8 total, 8 up, 8 in 2024-05-20T22:14:42.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:42 smithi050 bash[28929]: audit 2024-05-20T22:14:41.231364+0000 mon.c (mon.2) 328 : audit 1 from='client.? v1:172.21.15.50:0/3180505524' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:42.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:42 smithi050 bash[28929]: audit 2024-05-20T22:14:41.247334+0000 mon.a (mon.0) 2194 : audit 1 from='client.26177 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi050-63944-53"}]: dispatch 2024-05-20T22:14:43.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:43 smithi145 bash[23893]: cluster 2024-05-20T22:14:42.134581+0000 mgr.y (mgr.14592) 338 : cluster 0 pgmap v440: 388 pgs: 388 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-05-20T22:14:43.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:43 smithi145 bash[23893]: audit 2024-05-20T22:14:42.242399+0000 mon.a (mon.0) 2195 : audit 1 from='client.26177 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi050-63944-53"}]': finished 2024-05-20T22:14:43.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:43 smithi145 bash[23893]: cluster 2024-05-20T22:14:42.251992+0000 mon.a (mon.0) 2196 : cluster 0 osdmap e286: 8 total, 8 up, 8 in 2024-05-20T22:14:43.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:43 smithi145 bash[23893]: audit 2024-05-20T22:14:42.290561+0000 mon.c (mon.2) 329 : audit 1 from='client.? v1:172.21.15.50:0/2102989386' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:43.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:43 smithi145 bash[23893]: audit 2024-05-20T22:14:42.724006+0000 mon.a (mon.0) 2197 : audit 1 from='client.26183 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:43.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:43 smithi145 bash[23893]: audit 2024-05-20T22:14:42.725198+0000 mon.c (mon.2) 330 : audit 1 from='client.? v1:172.21.15.50:0/2102989386' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:43.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:43 smithi145 bash[23893]: audit 2024-05-20T22:14:42.725878+0000 mon.a (mon.0) 2198 : audit 1 from='client.26183 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:43.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:43 smithi145 bash[23893]: audit 2024-05-20T22:14:42.726903+0000 mon.c (mon.2) 331 : audit 1 from='client.? v1:172.21.15.50:0/2102989386' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi050-63944-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:43.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:43 smithi145 bash[23893]: audit 2024-05-20T22:14:42.727486+0000 mon.a (mon.0) 2199 : audit 1 from='client.26183 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi050-63944-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:43.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:43 smithi050 bash[21866]: cluster 2024-05-20T22:14:42.134581+0000 mgr.y (mgr.14592) 338 : cluster 0 pgmap v440: 388 pgs: 388 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-05-20T22:14:43.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:43 smithi050 bash[21866]: audit 2024-05-20T22:14:42.242399+0000 mon.a (mon.0) 2195 : audit 1 from='client.26177 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi050-63944-53"}]': finished 2024-05-20T22:14:43.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:43 smithi050 bash[21866]: cluster 2024-05-20T22:14:42.251992+0000 mon.a (mon.0) 2196 : cluster 0 osdmap e286: 8 total, 8 up, 8 in 2024-05-20T22:14:43.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:43 smithi050 bash[21866]: audit 2024-05-20T22:14:42.290561+0000 mon.c (mon.2) 329 : audit 1 from='client.? v1:172.21.15.50:0/2102989386' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:43.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:43 smithi050 bash[21866]: audit 2024-05-20T22:14:42.724006+0000 mon.a (mon.0) 2197 : audit 1 from='client.26183 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:43.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:43 smithi050 bash[21866]: audit 2024-05-20T22:14:42.725198+0000 mon.c (mon.2) 330 : audit 1 from='client.? v1:172.21.15.50:0/2102989386' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:43.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:43 smithi050 bash[21866]: audit 2024-05-20T22:14:42.725878+0000 mon.a (mon.0) 2198 : audit 1 from='client.26183 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:43.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:43 smithi050 bash[21866]: audit 2024-05-20T22:14:42.726903+0000 mon.c (mon.2) 331 : audit 1 from='client.? v1:172.21.15.50:0/2102989386' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi050-63944-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:43.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:43 smithi050 bash[21866]: audit 2024-05-20T22:14:42.727486+0000 mon.a (mon.0) 2199 : audit 1 from='client.26183 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi050-63944-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:43.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:43 smithi050 bash[28929]: cluster 2024-05-20T22:14:42.134581+0000 mgr.y (mgr.14592) 338 : cluster 0 pgmap v440: 388 pgs: 388 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-05-20T22:14:43.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:43 smithi050 bash[28929]: audit 2024-05-20T22:14:42.242399+0000 mon.a (mon.0) 2195 : audit 1 from='client.26177 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi050-63944-53"}]': finished 2024-05-20T22:14:43.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:43 smithi050 bash[28929]: cluster 2024-05-20T22:14:42.251992+0000 mon.a (mon.0) 2196 : cluster 0 osdmap e286: 8 total, 8 up, 8 in 2024-05-20T22:14:43.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:43 smithi050 bash[28929]: audit 2024-05-20T22:14:42.290561+0000 mon.c (mon.2) 329 : audit 1 from='client.? v1:172.21.15.50:0/2102989386' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:43.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:43 smithi050 bash[28929]: audit 2024-05-20T22:14:42.724006+0000 mon.a (mon.0) 2197 : audit 1 from='client.26183 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:43.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:43 smithi050 bash[28929]: audit 2024-05-20T22:14:42.725198+0000 mon.c (mon.2) 330 : audit 1 from='client.? v1:172.21.15.50:0/2102989386' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:43.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:43 smithi050 bash[28929]: audit 2024-05-20T22:14:42.725878+0000 mon.a (mon.0) 2198 : audit 1 from='client.26183 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:43.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:43 smithi050 bash[28929]: audit 2024-05-20T22:14:42.726903+0000 mon.c (mon.2) 331 : audit 1 from='client.? v1:172.21.15.50:0/2102989386' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi050-63944-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:43.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:43 smithi050 bash[28929]: audit 2024-05-20T22:14:42.727486+0000 mon.a (mon.0) 2199 : audit 1 from='client.26183 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi050-63944-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:44.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:44 smithi145 bash[23893]: audit 2024-05-20T22:14:43.256366+0000 mon.a (mon.0) 2200 : audit 1 from='client.26183 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi050-63944-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:44.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:44 smithi145 bash[23893]: cluster 2024-05-20T22:14:43.263684+0000 mon.a (mon.0) 2201 : cluster 0 osdmap e287: 8 total, 8 up, 8 in 2024-05-20T22:14:44.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:44 smithi145 bash[23893]: audit 2024-05-20T22:14:43.267559+0000 mon.c (mon.2) 332 : audit 1 from='client.? v1:172.21.15.50:0/2102989386' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi050-63944-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:44.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:44 smithi145 bash[23893]: audit 2024-05-20T22:14:43.269066+0000 mon.a (mon.0) 2202 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:44.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:44 smithi145 bash[23893]: audit 2024-05-20T22:14:43.270157+0000 mon.a (mon.0) 2203 : audit 1 from='client.26183 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi050-63944-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:44.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:44 smithi145 bash[23893]: audit 2024-05-20T22:14:43.685433+0000 mon.a (mon.0) 2204 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:14:44.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:44 smithi050 bash[21866]: audit 2024-05-20T22:14:43.256366+0000 mon.a (mon.0) 2200 : audit 1 from='client.26183 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi050-63944-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:44.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:44 smithi050 bash[21866]: cluster 2024-05-20T22:14:43.263684+0000 mon.a (mon.0) 2201 : cluster 0 osdmap e287: 8 total, 8 up, 8 in 2024-05-20T22:14:44.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:44 smithi050 bash[21866]: audit 2024-05-20T22:14:43.267559+0000 mon.c (mon.2) 332 : audit 1 from='client.? v1:172.21.15.50:0/2102989386' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi050-63944-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:44.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:44 smithi050 bash[21866]: audit 2024-05-20T22:14:43.269066+0000 mon.a (mon.0) 2202 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:44.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:44 smithi050 bash[21866]: audit 2024-05-20T22:14:43.270157+0000 mon.a (mon.0) 2203 : audit 1 from='client.26183 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi050-63944-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:44.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:44 smithi050 bash[21866]: audit 2024-05-20T22:14:43.685433+0000 mon.a (mon.0) 2204 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:14:44.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:44 smithi050 bash[28929]: audit 2024-05-20T22:14:43.256366+0000 mon.a (mon.0) 2200 : audit 1 from='client.26183 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi050-63944-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:44.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:44 smithi050 bash[28929]: cluster 2024-05-20T22:14:43.263684+0000 mon.a (mon.0) 2201 : cluster 0 osdmap e287: 8 total, 8 up, 8 in 2024-05-20T22:14:44.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:44 smithi050 bash[28929]: audit 2024-05-20T22:14:43.267559+0000 mon.c (mon.2) 332 : audit 1 from='client.? v1:172.21.15.50:0/2102989386' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi050-63944-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:44.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:44 smithi050 bash[28929]: audit 2024-05-20T22:14:43.269066+0000 mon.a (mon.0) 2202 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:44.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:44 smithi050 bash[28929]: audit 2024-05-20T22:14:43.270157+0000 mon.a (mon.0) 2203 : audit 1 from='client.26183 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi050-63944-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:44.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:44 smithi050 bash[28929]: audit 2024-05-20T22:14:43.685433+0000 mon.a (mon.0) 2204 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:14:45.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:45 smithi145 bash[23893]: cluster 2024-05-20T22:14:44.135500+0000 mgr.y (mgr.14592) 339 : cluster 0 pgmap v443: 388 pgs: 32 unknown, 356 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:45.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:45 smithi145 bash[23893]: cluster 2024-05-20T22:14:44.256401+0000 mon.a (mon.0) 2205 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:45.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:45 smithi145 bash[23893]: audit 2024-05-20T22:14:44.265813+0000 mon.a (mon.0) 2206 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:45.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:45 smithi145 bash[23893]: cluster 2024-05-20T22:14:44.722149+0000 mon.a (mon.0) 2207 : cluster 0 osdmap e288: 8 total, 8 up, 8 in 2024-05-20T22:14:45.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:45 smithi145 bash[23893]: audit 2024-05-20T22:14:44.724303+0000 mon.a (mon.0) 2208 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:14:45.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:45 smithi145 bash[23893]: audit 2024-05-20T22:14:44.724589+0000 mon.a (mon.0) 2209 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:14:45.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:45 smithi145 bash[23893]: audit 2024-05-20T22:14:44.726122+0000 mon.a (mon.0) 2210 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:14:45.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:45 smithi145 bash[23893]: audit 2024-05-20T22:14:44.733310+0000 mon.a (mon.0) 2211 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:14:45.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:45 smithi050 bash[21866]: cluster 2024-05-20T22:14:44.135500+0000 mgr.y (mgr.14592) 339 : cluster 0 pgmap v443: 388 pgs: 32 unknown, 356 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:45.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:45 smithi050 bash[21866]: cluster 2024-05-20T22:14:44.256401+0000 mon.a (mon.0) 2205 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:45.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:45 smithi050 bash[21866]: audit 2024-05-20T22:14:44.265813+0000 mon.a (mon.0) 2206 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:45.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:45 smithi050 bash[21866]: cluster 2024-05-20T22:14:44.722149+0000 mon.a (mon.0) 2207 : cluster 0 osdmap e288: 8 total, 8 up, 8 in 2024-05-20T22:14:45.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:45 smithi050 bash[21866]: audit 2024-05-20T22:14:44.724303+0000 mon.a (mon.0) 2208 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:14:45.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:45 smithi050 bash[21866]: audit 2024-05-20T22:14:44.724589+0000 mon.a (mon.0) 2209 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:14:45.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:45 smithi050 bash[21866]: audit 2024-05-20T22:14:44.726122+0000 mon.a (mon.0) 2210 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:14:45.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:45 smithi050 bash[21866]: audit 2024-05-20T22:14:44.733310+0000 mon.a (mon.0) 2211 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:14:45.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:45 smithi050 bash[28929]: cluster 2024-05-20T22:14:44.135500+0000 mgr.y (mgr.14592) 339 : cluster 0 pgmap v443: 388 pgs: 32 unknown, 356 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:45.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:45 smithi050 bash[28929]: cluster 2024-05-20T22:14:44.256401+0000 mon.a (mon.0) 2205 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:45.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:45 smithi050 bash[28929]: audit 2024-05-20T22:14:44.265813+0000 mon.a (mon.0) 2206 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:45.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:45 smithi050 bash[28929]: cluster 2024-05-20T22:14:44.722149+0000 mon.a (mon.0) 2207 : cluster 0 osdmap e288: 8 total, 8 up, 8 in 2024-05-20T22:14:45.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:45 smithi050 bash[28929]: audit 2024-05-20T22:14:44.724303+0000 mon.a (mon.0) 2208 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:14:45.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:45 smithi050 bash[28929]: audit 2024-05-20T22:14:44.724589+0000 mon.a (mon.0) 2209 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:14:45.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:45 smithi050 bash[28929]: audit 2024-05-20T22:14:44.726122+0000 mon.a (mon.0) 2210 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:14:45.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:45 smithi050 bash[28929]: audit 2024-05-20T22:14:44.733310+0000 mon.a (mon.0) 2211 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:14:46.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:46 smithi145 bash[23893]: audit 2024-05-20T22:14:45.269013+0000 mon.a (mon.0) 2212 : audit 1 from='client.26183 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi050-63944-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi050-63944-54"}]': finished 2024-05-20T22:14:46.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:46 smithi145 bash[23893]: audit 2024-05-20T22:14:45.269258+0000 mon.a (mon.0) 2213 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-39", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:14:46.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:46 smithi145 bash[23893]: cluster 2024-05-20T22:14:45.276986+0000 mon.a (mon.0) 2214 : cluster 0 osdmap e289: 8 total, 8 up, 8 in 2024-05-20T22:14:46.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:46 smithi145 bash[23893]: audit 2024-05-20T22:14:45.278899+0000 mon.a (mon.0) 2215 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-39"}]: dispatch 2024-05-20T22:14:46.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:46 smithi145 bash[23893]: audit 2024-05-20T22:14:46.271540+0000 mon.a (mon.0) 2216 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-39"}]': finished 2024-05-20T22:14:46.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:46 smithi145 bash[23893]: cluster 2024-05-20T22:14:46.279121+0000 mon.a (mon.0) 2217 : cluster 0 osdmap e290: 8 total, 8 up, 8 in 2024-05-20T22:14:46.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:46 smithi145 bash[23893]: audit 2024-05-20T22:14:46.280393+0000 mon.a (mon.0) 2218 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-39", "mode": "writeback"}]: dispatch 2024-05-20T22:14:46.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:46 smithi050 bash[21866]: audit 2024-05-20T22:14:45.269013+0000 mon.a (mon.0) 2212 : audit 1 from='client.26183 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi050-63944-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi050-63944-54"}]': finished 2024-05-20T22:14:46.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:46 smithi050 bash[21866]: audit 2024-05-20T22:14:45.269258+0000 mon.a (mon.0) 2213 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-39", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:14:46.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:46 smithi050 bash[21866]: cluster 2024-05-20T22:14:45.276986+0000 mon.a (mon.0) 2214 : cluster 0 osdmap e289: 8 total, 8 up, 8 in 2024-05-20T22:14:46.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:46 smithi050 bash[21866]: audit 2024-05-20T22:14:45.278899+0000 mon.a (mon.0) 2215 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-39"}]: dispatch 2024-05-20T22:14:46.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:46 smithi050 bash[21866]: audit 2024-05-20T22:14:46.271540+0000 mon.a (mon.0) 2216 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-39"}]': finished 2024-05-20T22:14:46.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:46 smithi050 bash[21866]: cluster 2024-05-20T22:14:46.279121+0000 mon.a (mon.0) 2217 : cluster 0 osdmap e290: 8 total, 8 up, 8 in 2024-05-20T22:14:46.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:46 smithi050 bash[21866]: audit 2024-05-20T22:14:46.280393+0000 mon.a (mon.0) 2218 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-39", "mode": "writeback"}]: dispatch 2024-05-20T22:14:46.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:46 smithi050 bash[28929]: audit 2024-05-20T22:14:45.269013+0000 mon.a (mon.0) 2212 : audit 1 from='client.26183 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi050-63944-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi050-63944-54"}]': finished 2024-05-20T22:14:46.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:46 smithi050 bash[28929]: audit 2024-05-20T22:14:45.269258+0000 mon.a (mon.0) 2213 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-39", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:14:46.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:46 smithi050 bash[28929]: cluster 2024-05-20T22:14:45.276986+0000 mon.a (mon.0) 2214 : cluster 0 osdmap e289: 8 total, 8 up, 8 in 2024-05-20T22:14:46.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:46 smithi050 bash[28929]: audit 2024-05-20T22:14:45.278899+0000 mon.a (mon.0) 2215 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-39"}]: dispatch 2024-05-20T22:14:46.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:46 smithi050 bash[28929]: audit 2024-05-20T22:14:46.271540+0000 mon.a (mon.0) 2216 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-39"}]': finished 2024-05-20T22:14:46.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:46 smithi050 bash[28929]: cluster 2024-05-20T22:14:46.279121+0000 mon.a (mon.0) 2217 : cluster 0 osdmap e290: 8 total, 8 up, 8 in 2024-05-20T22:14:46.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:46 smithi050 bash[28929]: audit 2024-05-20T22:14:46.280393+0000 mon.a (mon.0) 2218 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-39", "mode": "writeback"}]: dispatch 2024-05-20T22:14:47.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:47 smithi145 bash[23893]: cluster 2024-05-20T22:14:46.136536+0000 mgr.y (mgr.14592) 340 : cluster 0 pgmap v446: 396 pgs: 8 unknown, 388 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:47.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:47 smithi145 bash[23893]: cluster 2024-05-20T22:14:47.271997+0000 mon.a (mon.0) 2219 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:14:47.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:47 smithi145 bash[23893]: audit 2024-05-20T22:14:47.274230+0000 mon.a (mon.0) 2220 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-39", "mode": "writeback"}]': finished 2024-05-20T22:14:47.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:47 smithi145 bash[23893]: cluster 2024-05-20T22:14:47.282320+0000 mon.a (mon.0) 2221 : cluster 0 osdmap e291: 8 total, 8 up, 8 in 2024-05-20T22:14:47.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:47 smithi145 bash[23893]: audit 2024-05-20T22:14:47.286902+0000 mon.c (mon.2) 333 : audit 1 from='client.? v1:172.21.15.50:0/2102989386' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:47.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:47 smithi145 bash[23893]: audit 2024-05-20T22:14:47.288791+0000 mon.a (mon.0) 2222 : audit 1 from='client.26183 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:47.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:47 smithi050 bash[21866]: cluster 2024-05-20T22:14:46.136536+0000 mgr.y (mgr.14592) 340 : cluster 0 pgmap v446: 396 pgs: 8 unknown, 388 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:47.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:47 smithi050 bash[21866]: cluster 2024-05-20T22:14:47.271997+0000 mon.a (mon.0) 2219 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:14:47.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:47 smithi050 bash[21866]: audit 2024-05-20T22:14:47.274230+0000 mon.a (mon.0) 2220 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-39", "mode": "writeback"}]': finished 2024-05-20T22:14:47.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:47 smithi050 bash[21866]: cluster 2024-05-20T22:14:47.282320+0000 mon.a (mon.0) 2221 : cluster 0 osdmap e291: 8 total, 8 up, 8 in 2024-05-20T22:14:47.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:47 smithi050 bash[21866]: audit 2024-05-20T22:14:47.286902+0000 mon.c (mon.2) 333 : audit 1 from='client.? v1:172.21.15.50:0/2102989386' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:47.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:47 smithi050 bash[21866]: audit 2024-05-20T22:14:47.288791+0000 mon.a (mon.0) 2222 : audit 1 from='client.26183 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:47.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:47 smithi050 bash[28929]: cluster 2024-05-20T22:14:46.136536+0000 mgr.y (mgr.14592) 340 : cluster 0 pgmap v446: 396 pgs: 8 unknown, 388 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:47.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:47 smithi050 bash[28929]: cluster 2024-05-20T22:14:47.271997+0000 mon.a (mon.0) 2219 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:14:47.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:47 smithi050 bash[28929]: audit 2024-05-20T22:14:47.274230+0000 mon.a (mon.0) 2220 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-39", "mode": "writeback"}]': finished 2024-05-20T22:14:47.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:47 smithi050 bash[28929]: cluster 2024-05-20T22:14:47.282320+0000 mon.a (mon.0) 2221 : cluster 0 osdmap e291: 8 total, 8 up, 8 in 2024-05-20T22:14:47.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:47 smithi050 bash[28929]: audit 2024-05-20T22:14:47.286902+0000 mon.c (mon.2) 333 : audit 1 from='client.? v1:172.21.15.50:0/2102989386' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:47.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:47 smithi050 bash[28929]: audit 2024-05-20T22:14:47.288791+0000 mon.a (mon.0) 2222 : audit 1 from='client.26183 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:48.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:14:47 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:14:48.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:48 smithi145 bash[23893]: audit 2024-05-20T22:14:47.475086+0000 mon.a (mon.0) 2223 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:48.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:48 smithi145 bash[23893]: audit 2024-05-20T22:14:48.276855+0000 mon.a (mon.0) 2224 : audit 1 from='client.26183 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi050-63944-54"}]': finished 2024-05-20T22:14:48.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:48 smithi145 bash[23893]: audit 2024-05-20T22:14:48.277010+0000 mon.a (mon.0) 2225 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:48.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:48 smithi145 bash[23893]: cluster 2024-05-20T22:14:48.284608+0000 mon.a (mon.0) 2226 : cluster 0 osdmap e292: 8 total, 8 up, 8 in 2024-05-20T22:14:48.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:48 smithi145 bash[23893]: audit 2024-05-20T22:14:48.287150+0000 mon.c (mon.2) 334 : audit 1 from='client.? v1:172.21.15.50:0/2102989386' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:48.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:48 smithi145 bash[23893]: audit 2024-05-20T22:14:48.287855+0000 mon.a (mon.0) 2227 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-39"}]: dispatch 2024-05-20T22:14:48.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:48 smithi145 bash[23893]: audit 2024-05-20T22:14:48.289204+0000 mon.a (mon.0) 2228 : audit 1 from='client.26183 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:48.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:48 smithi050 bash[21866]: audit 2024-05-20T22:14:47.475086+0000 mon.a (mon.0) 2223 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:48.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:48 smithi050 bash[21866]: audit 2024-05-20T22:14:48.276855+0000 mon.a (mon.0) 2224 : audit 1 from='client.26183 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi050-63944-54"}]': finished 2024-05-20T22:14:48.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:48 smithi050 bash[21866]: audit 2024-05-20T22:14:48.277010+0000 mon.a (mon.0) 2225 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:48.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:48 smithi050 bash[21866]: cluster 2024-05-20T22:14:48.284608+0000 mon.a (mon.0) 2226 : cluster 0 osdmap e292: 8 total, 8 up, 8 in 2024-05-20T22:14:48.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:48 smithi050 bash[21866]: audit 2024-05-20T22:14:48.287150+0000 mon.c (mon.2) 334 : audit 1 from='client.? v1:172.21.15.50:0/2102989386' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:48.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:48 smithi050 bash[21866]: audit 2024-05-20T22:14:48.287855+0000 mon.a (mon.0) 2227 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-39"}]: dispatch 2024-05-20T22:14:48.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:48 smithi050 bash[21866]: audit 2024-05-20T22:14:48.289204+0000 mon.a (mon.0) 2228 : audit 1 from='client.26183 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:48.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:48 smithi050 bash[28929]: audit 2024-05-20T22:14:47.475086+0000 mon.a (mon.0) 2223 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:48.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:48 smithi050 bash[28929]: audit 2024-05-20T22:14:48.276855+0000 mon.a (mon.0) 2224 : audit 1 from='client.26183 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi050-63944-54"}]': finished 2024-05-20T22:14:48.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:48 smithi050 bash[28929]: audit 2024-05-20T22:14:48.277010+0000 mon.a (mon.0) 2225 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:14:48.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:48 smithi050 bash[28929]: cluster 2024-05-20T22:14:48.284608+0000 mon.a (mon.0) 2226 : cluster 0 osdmap e292: 8 total, 8 up, 8 in 2024-05-20T22:14:48.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:48 smithi050 bash[28929]: audit 2024-05-20T22:14:48.287150+0000 mon.c (mon.2) 334 : audit 1 from='client.? v1:172.21.15.50:0/2102989386' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:48.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:48 smithi050 bash[28929]: audit 2024-05-20T22:14:48.287855+0000 mon.a (mon.0) 2227 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-39"}]: dispatch 2024-05-20T22:14:48.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:48 smithi050 bash[28929]: audit 2024-05-20T22:14:48.289204+0000 mon.a (mon.0) 2228 : audit 1 from='client.26183 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi050-63944-54"}]: dispatch 2024-05-20T22:14:49.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:49 smithi145 bash[23893]: audit 2024-05-20T22:14:47.854671+0000 mgr.y (mgr.14592) 341 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:14:49.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:49 smithi145 bash[23893]: cluster 2024-05-20T22:14:48.137505+0000 mgr.y (mgr.14592) 342 : cluster 0 pgmap v449: 388 pgs: 388 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:49.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:49 smithi145 bash[23893]: cluster 2024-05-20T22:14:49.278176+0000 mon.a (mon.0) 2229 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:14:49.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:49 smithi145 bash[23893]: audit 2024-05-20T22:14:49.280544+0000 mon.a (mon.0) 2230 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-39"}]': finished 2024-05-20T22:14:49.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:49 smithi145 bash[23893]: audit 2024-05-20T22:14:49.280713+0000 mon.a (mon.0) 2231 : audit 1 from='client.26183 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi050-63944-54"}]': finished 2024-05-20T22:14:49.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:49 smithi145 bash[23893]: cluster 2024-05-20T22:14:49.287771+0000 mon.a (mon.0) 2232 : cluster 0 osdmap e293: 8 total, 8 up, 8 in 2024-05-20T22:14:49.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:14:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:14:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:14:49.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:49 smithi050 bash[21866]: audit 2024-05-20T22:14:47.854671+0000 mgr.y (mgr.14592) 341 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:14:49.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:49 smithi050 bash[21866]: cluster 2024-05-20T22:14:48.137505+0000 mgr.y (mgr.14592) 342 : cluster 0 pgmap v449: 388 pgs: 388 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:49.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:49 smithi050 bash[21866]: cluster 2024-05-20T22:14:49.278176+0000 mon.a (mon.0) 2229 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:14:49.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:49 smithi050 bash[21866]: audit 2024-05-20T22:14:49.280544+0000 mon.a (mon.0) 2230 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-39"}]': finished 2024-05-20T22:14:49.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:49 smithi050 bash[21866]: audit 2024-05-20T22:14:49.280713+0000 mon.a (mon.0) 2231 : audit 1 from='client.26183 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi050-63944-54"}]': finished 2024-05-20T22:14:49.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:49 smithi050 bash[21866]: cluster 2024-05-20T22:14:49.287771+0000 mon.a (mon.0) 2232 : cluster 0 osdmap e293: 8 total, 8 up, 8 in 2024-05-20T22:14:49.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:49 smithi050 bash[28929]: audit 2024-05-20T22:14:47.854671+0000 mgr.y (mgr.14592) 341 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:14:49.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:49 smithi050 bash[28929]: cluster 2024-05-20T22:14:48.137505+0000 mgr.y (mgr.14592) 342 : cluster 0 pgmap v449: 388 pgs: 388 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:49.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:49 smithi050 bash[28929]: cluster 2024-05-20T22:14:49.278176+0000 mon.a (mon.0) 2229 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:14:49.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:49 smithi050 bash[28929]: audit 2024-05-20T22:14:49.280544+0000 mon.a (mon.0) 2230 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-39"}]': finished 2024-05-20T22:14:49.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:49 smithi050 bash[28929]: audit 2024-05-20T22:14:49.280713+0000 mon.a (mon.0) 2231 : audit 1 from='client.26183 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi050-63944-54"}]': finished 2024-05-20T22:14:49.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:49 smithi050 bash[28929]: cluster 2024-05-20T22:14:49.287771+0000 mon.a (mon.0) 2232 : cluster 0 osdmap e293: 8 total, 8 up, 8 in 2024-05-20T22:14:50.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2024-05-20T22:14:50.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] Global test environment set-up. 2024-05-20T22:14:50.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2024-05-20T22:14:50.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: seed 64110 2024-05-20T22:14:50.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2024-05-20T22:14:50.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (353 ms) 2024-05-20T22:14:50.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2024-05-20T22:14:50.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (22636 ms) 2024-05-20T22:14:50.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2024-05-20T22:14:50.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (6 ms) 2024-05-20T22:14:50.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (22995 ms total) 2024-05-20T22:14:50.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 2024-05-20T22:14:50.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2024-05-20T22:14:50.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2024-05-20T22:14:50.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (8364 ms) 2024-05-20T22:14:50.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2024-05-20T22:14:50.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (11208 ms) 2024-05-20T22:14:50.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-05-20T22:14:50.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (11822 ms) 2024-05-20T22:14:50.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-05-20T22:14:50.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: my_snaps [3] 2024-05-20T22:14:50.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: my_snaps [4,3] 2024-05-20T22:14:50.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: my_snaps [5,4,3] 2024-05-20T22:14:50.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: my_snaps [6,5,4,3] 2024-05-20T22:14:50.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: promoting some heads 2024-05-20T22:14:50.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: promoting from clones for snap 6 2024-05-20T22:14:50.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: promoting from clones for snap 5 2024-05-20T22:14:50.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: promoting from clones for snap 4 2024-05-20T22:14:50.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: promoting from clones for snap 3 2024-05-20T22:14:50.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: waiting for scrubs... 2024-05-20T22:14:50.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: done waiting 2024-05-20T22:14:50.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (46925 ms) 2024-05-20T22:14:50.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-05-20T22:14:50.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (9585 ms) 2024-05-20T22:14:50.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-05-20T22:14:50.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (7984 ms) 2024-05-20T22:14:50.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-05-20T22:14:50.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (8068 ms) 2024-05-20T22:14:50.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2024-05-20T22:14:50.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (8028 ms) 2024-05-20T22:14:50.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-05-20T22:14:50.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (10072 ms) 2024-05-20T22:14:50.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-05-20T22:14:50.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (9003 ms) 2024-05-20T22:14:50.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-05-20T22:14:50.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (11025 ms) 2024-05-20T22:14:50.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-05-20T22:14:50.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (12035 ms) 2024-05-20T22:14:50.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-05-20T22:14:50.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (8809 ms) 2024-05-20T22:14:50.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2024-05-20T22:14:50.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (7572 ms) 2024-05-20T22:14:50.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-05-20T22:14:50.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (13516 ms) 2024-05-20T22:14:50.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-05-20T22:14:50.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (7420 ms) 2024-05-20T22:14:50.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-05-20T22:14:50.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (8096 ms) 2024-05-20T22:14:50.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:50 smithi145 bash[23893]: audit 2024-05-20T22:14:49.339039+0000 mon.c (mon.2) 335 : audit 1 from='client.? v1:172.21.15.50:0/2866251961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:50.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:50 smithi145 bash[23893]: audit 2024-05-20T22:14:49.339948+0000 mon.a (mon.0) 2233 : audit 1 from='client.26189 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:50.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:50 smithi145 bash[23893]: audit 2024-05-20T22:14:49.341026+0000 mon.c (mon.2) 336 : audit 1 from='client.? v1:172.21.15.50:0/2866251961' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:50.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:50 smithi145 bash[23893]: audit 2024-05-20T22:14:49.341450+0000 mon.a (mon.0) 2234 : audit 1 from='client.26189 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:50.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:50 smithi145 bash[23893]: audit 2024-05-20T22:14:49.342695+0000 mon.c (mon.2) 337 : audit 1 from='client.? v1:172.21.15.50:0/2866251961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi050-63944-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:50.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:50 smithi145 bash[23893]: audit 2024-05-20T22:14:49.343152+0000 mon.a (mon.0) 2235 : audit 1 from='client.26189 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi050-63944-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:50.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:50 smithi050 bash[21866]: audit 2024-05-20T22:14:49.339039+0000 mon.c (mon.2) 335 : audit 1 from='client.? v1:172.21.15.50:0/2866251961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:50.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:50 smithi050 bash[21866]: audit 2024-05-20T22:14:49.339948+0000 mon.a (mon.0) 2233 : audit 1 from='client.26189 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:50.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:50 smithi050 bash[21866]: audit 2024-05-20T22:14:49.341026+0000 mon.c (mon.2) 336 : audit 1 from='client.? v1:172.21.15.50:0/2866251961' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:50.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:50 smithi050 bash[21866]: audit 2024-05-20T22:14:49.341450+0000 mon.a (mon.0) 2234 : audit 1 from='client.26189 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:50.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:50 smithi050 bash[21866]: audit 2024-05-20T22:14:49.342695+0000 mon.c (mon.2) 337 : audit 1 from='client.? v1:172.21.15.50:0/2866251961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi050-63944-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:50.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:50 smithi050 bash[21866]: audit 2024-05-20T22:14:49.343152+0000 mon.a (mon.0) 2235 : audit 1 from='client.26189 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi050-63944-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:50.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:50 smithi050 bash[28929]: audit 2024-05-20T22:14:49.339039+0000 mon.c (mon.2) 335 : audit 1 from='client.? v1:172.21.15.50:0/2866251961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:50.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:50 smithi050 bash[28929]: audit 2024-05-20T22:14:49.339948+0000 mon.a (mon.0) 2233 : audit 1 from='client.26189 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:50.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:50 smithi050 bash[28929]: audit 2024-05-20T22:14:49.341026+0000 mon.c (mon.2) 336 : audit 1 from='client.? v1:172.21.15.50:0/2866251961' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:50.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:50 smithi050 bash[28929]: audit 2024-05-20T22:14:49.341450+0000 mon.a (mon.0) 2234 : audit 1 from='client.26189 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:50.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:50 smithi050 bash[28929]: audit 2024-05-20T22:14:49.342695+0000 mon.c (mon.2) 337 : audit 1 from='client.? v1:172.21.15.50:0/2866251961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi050-63944-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:50.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:50 smithi050 bash[28929]: audit 2024-05-20T22:14:49.343152+0000 mon.a (mon.0) 2235 : audit 1 from='client.26189 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi050-63944-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:52.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:51 smithi145 bash[23893]: cluster 2024-05-20T22:14:50.140744+0000 mgr.y (mgr.14592) 343 : cluster 0 pgmap v452: 388 pgs: 388 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 65 op/s 2024-05-20T22:14:52.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:51 smithi145 bash[23893]: audit 2024-05-20T22:14:50.336370+0000 mon.a (mon.0) 2236 : audit 1 from='client.26189 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi050-63944-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:52.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:51 smithi145 bash[23893]: cluster 2024-05-20T22:14:50.347614+0000 mon.a (mon.0) 2237 : cluster 0 osdmap e294: 8 total, 8 up, 8 in 2024-05-20T22:14:52.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:51 smithi145 bash[23893]: audit 2024-05-20T22:14:50.348555+0000 mon.c (mon.2) 338 : audit 1 from='client.? v1:172.21.15.50:0/2866251961' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi050-63944-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:52.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:51 smithi145 bash[23893]: audit 2024-05-20T22:14:50.351492+0000 mon.a (mon.0) 2238 : audit 1 from='client.26189 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi050-63944-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:52.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:51 smithi050 bash[21866]: cluster 2024-05-20T22:14:50.140744+0000 mgr.y (mgr.14592) 343 : cluster 0 pgmap v452: 388 pgs: 388 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 65 op/s 2024-05-20T22:14:52.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:51 smithi050 bash[21866]: audit 2024-05-20T22:14:50.336370+0000 mon.a (mon.0) 2236 : audit 1 from='client.26189 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi050-63944-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:52.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:51 smithi050 bash[21866]: cluster 2024-05-20T22:14:50.347614+0000 mon.a (mon.0) 2237 : cluster 0 osdmap e294: 8 total, 8 up, 8 in 2024-05-20T22:14:52.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:51 smithi050 bash[21866]: audit 2024-05-20T22:14:50.348555+0000 mon.c (mon.2) 338 : audit 1 from='client.? v1:172.21.15.50:0/2866251961' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi050-63944-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:52.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:51 smithi050 bash[21866]: audit 2024-05-20T22:14:50.351492+0000 mon.a (mon.0) 2238 : audit 1 from='client.26189 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi050-63944-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:52.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:51 smithi050 bash[28929]: cluster 2024-05-20T22:14:50.140744+0000 mgr.y (mgr.14592) 343 : cluster 0 pgmap v452: 388 pgs: 388 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 65 op/s 2024-05-20T22:14:52.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:51 smithi050 bash[28929]: audit 2024-05-20T22:14:50.336370+0000 mon.a (mon.0) 2236 : audit 1 from='client.26189 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi050-63944-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:52.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:51 smithi050 bash[28929]: cluster 2024-05-20T22:14:50.347614+0000 mon.a (mon.0) 2237 : cluster 0 osdmap e294: 8 total, 8 up, 8 in 2024-05-20T22:14:52.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:51 smithi050 bash[28929]: audit 2024-05-20T22:14:50.348555+0000 mon.c (mon.2) 338 : audit 1 from='client.? v1:172.21.15.50:0/2866251961' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi050-63944-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:52.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:51 smithi050 bash[28929]: audit 2024-05-20T22:14:50.351492+0000 mon.a (mon.0) 2238 : audit 1 from='client.26189 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi050-63944-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:53.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:52 smithi145 bash[23893]: cluster 2024-05-20T22:14:51.812504+0000 mon.a (mon.0) 2239 : cluster 0 osdmap e295: 8 total, 8 up, 8 in 2024-05-20T22:14:53.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:52 smithi145 bash[23893]: audit 2024-05-20T22:14:51.823885+0000 mon.a (mon.0) 2240 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:53.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:52 smithi145 bash[23893]: audit 2024-05-20T22:14:51.974084+0000 mon.a (mon.0) 2241 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:14:53.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:52 smithi145 bash[23893]: cluster 2024-05-20T22:14:52.141702+0000 mgr.y (mgr.14592) 344 : cluster 0 pgmap v455: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-05-20T22:14:53.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:52 smithi145 bash[23893]: audit 2024-05-20T22:14:52.344708+0000 mon.a (mon.0) 2242 : audit 1 from='client.26189 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi050-63944-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi050-63944-55"}]': finished 2024-05-20T22:14:53.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:52 smithi145 bash[23893]: audit 2024-05-20T22:14:52.344976+0000 mon.a (mon.0) 2243 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:53.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:52 smithi145 bash[23893]: cluster 2024-05-20T22:14:52.353548+0000 mon.a (mon.0) 2244 : cluster 0 osdmap e296: 8 total, 8 up, 8 in 2024-05-20T22:14:53.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:52 smithi145 bash[23893]: audit 2024-05-20T22:14:52.373248+0000 mon.a (mon.0) 2245 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:14:53.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:52 smithi050 bash[28929]: cluster 2024-05-20T22:14:51.812504+0000 mon.a (mon.0) 2239 : cluster 0 osdmap e295: 8 total, 8 up, 8 in 2024-05-20T22:14:53.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:52 smithi050 bash[28929]: audit 2024-05-20T22:14:51.823885+0000 mon.a (mon.0) 2240 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:53.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:52 smithi050 bash[28929]: audit 2024-05-20T22:14:51.974084+0000 mon.a (mon.0) 2241 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:14:53.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:52 smithi050 bash[28929]: cluster 2024-05-20T22:14:52.141702+0000 mgr.y (mgr.14592) 344 : cluster 0 pgmap v455: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-05-20T22:14:53.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:52 smithi050 bash[28929]: audit 2024-05-20T22:14:52.344708+0000 mon.a (mon.0) 2242 : audit 1 from='client.26189 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi050-63944-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi050-63944-55"}]': finished 2024-05-20T22:14:53.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:52 smithi050 bash[28929]: audit 2024-05-20T22:14:52.344976+0000 mon.a (mon.0) 2243 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:53.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:52 smithi050 bash[28929]: cluster 2024-05-20T22:14:52.353548+0000 mon.a (mon.0) 2244 : cluster 0 osdmap e296: 8 total, 8 up, 8 in 2024-05-20T22:14:53.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:52 smithi050 bash[28929]: audit 2024-05-20T22:14:52.373248+0000 mon.a (mon.0) 2245 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:14:53.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:52 smithi050 bash[21866]: cluster 2024-05-20T22:14:51.812504+0000 mon.a (mon.0) 2239 : cluster 0 osdmap e295: 8 total, 8 up, 8 in 2024-05-20T22:14:53.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:52 smithi050 bash[21866]: audit 2024-05-20T22:14:51.823885+0000 mon.a (mon.0) 2240 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:14:53.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:52 smithi050 bash[21866]: audit 2024-05-20T22:14:51.974084+0000 mon.a (mon.0) 2241 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:14:53.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:52 smithi050 bash[21866]: cluster 2024-05-20T22:14:52.141702+0000 mgr.y (mgr.14592) 344 : cluster 0 pgmap v455: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-05-20T22:14:53.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:52 smithi050 bash[21866]: audit 2024-05-20T22:14:52.344708+0000 mon.a (mon.0) 2242 : audit 1 from='client.26189 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi050-63944-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi050-63944-55"}]': finished 2024-05-20T22:14:53.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:52 smithi050 bash[21866]: audit 2024-05-20T22:14:52.344976+0000 mon.a (mon.0) 2243 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:14:53.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:52 smithi050 bash[21866]: cluster 2024-05-20T22:14:52.353548+0000 mon.a (mon.0) 2244 : cluster 0 osdmap e296: 8 total, 8 up, 8 in 2024-05-20T22:14:53.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:52 smithi050 bash[21866]: audit 2024-05-20T22:14:52.373248+0000 mon.a (mon.0) 2245 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:14:54.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:53 smithi145 bash[23893]: cluster 2024-05-20T22:14:52.816747+0000 mon.a (mon.0) 2246 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:54.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:53 smithi145 bash[23893]: audit 2024-05-20T22:14:53.347238+0000 mon.a (mon.0) 2247 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-41", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:14:54.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:53 smithi145 bash[23893]: cluster 2024-05-20T22:14:53.351984+0000 mon.a (mon.0) 2248 : cluster 0 osdmap e297: 8 total, 8 up, 8 in 2024-05-20T22:14:54.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:53 smithi145 bash[23893]: audit 2024-05-20T22:14:53.354684+0000 mon.a (mon.0) 2249 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-41","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:14:54.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:53 smithi050 bash[21866]: cluster 2024-05-20T22:14:52.816747+0000 mon.a (mon.0) 2246 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:54.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:53 smithi050 bash[21866]: audit 2024-05-20T22:14:53.347238+0000 mon.a (mon.0) 2247 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-41", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:14:54.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:53 smithi050 bash[21866]: cluster 2024-05-20T22:14:53.351984+0000 mon.a (mon.0) 2248 : cluster 0 osdmap e297: 8 total, 8 up, 8 in 2024-05-20T22:14:54.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:53 smithi050 bash[21866]: audit 2024-05-20T22:14:53.354684+0000 mon.a (mon.0) 2249 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-41","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:14:54.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:53 smithi050 bash[28929]: cluster 2024-05-20T22:14:52.816747+0000 mon.a (mon.0) 2246 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:14:54.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:53 smithi050 bash[28929]: audit 2024-05-20T22:14:53.347238+0000 mon.a (mon.0) 2247 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-41", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:14:54.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:53 smithi050 bash[28929]: cluster 2024-05-20T22:14:53.351984+0000 mon.a (mon.0) 2248 : cluster 0 osdmap e297: 8 total, 8 up, 8 in 2024-05-20T22:14:54.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:53 smithi050 bash[28929]: audit 2024-05-20T22:14:53.354684+0000 mon.a (mon.0) 2249 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-41","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:14:55.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:55 smithi145 bash[23893]: cluster 2024-05-20T22:14:54.142684+0000 mgr.y (mgr.14592) 345 : cluster 0 pgmap v458: 396 pgs: 40 unknown, 356 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:55.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:55 smithi145 bash[23893]: audit 2024-05-20T22:14:54.349932+0000 mon.a (mon.0) 2250 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-41","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:14:55.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:55 smithi145 bash[23893]: cluster 2024-05-20T22:14:54.357830+0000 mon.a (mon.0) 2251 : cluster 0 osdmap e298: 8 total, 8 up, 8 in 2024-05-20T22:14:55.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:55 smithi145 bash[23893]: audit 2024-05-20T22:14:54.361151+0000 mon.c (mon.2) 339 : audit 1 from='client.? v1:172.21.15.50:0/2866251961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:55.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:55 smithi145 bash[23893]: audit 2024-05-20T22:14:54.365078+0000 mon.a (mon.0) 2252 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-41","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:14:55.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:55 smithi145 bash[23893]: audit 2024-05-20T22:14:54.366242+0000 mon.a (mon.0) 2253 : audit 1 from='client.26189 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:55.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:55 smithi050 bash[21866]: cluster 2024-05-20T22:14:54.142684+0000 mgr.y (mgr.14592) 345 : cluster 0 pgmap v458: 396 pgs: 40 unknown, 356 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:55.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:55 smithi050 bash[21866]: audit 2024-05-20T22:14:54.349932+0000 mon.a (mon.0) 2250 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-41","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:14:55.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:55 smithi050 bash[21866]: cluster 2024-05-20T22:14:54.357830+0000 mon.a (mon.0) 2251 : cluster 0 osdmap e298: 8 total, 8 up, 8 in 2024-05-20T22:14:55.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:55 smithi050 bash[21866]: audit 2024-05-20T22:14:54.361151+0000 mon.c (mon.2) 339 : audit 1 from='client.? v1:172.21.15.50:0/2866251961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:55.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:55 smithi050 bash[21866]: audit 2024-05-20T22:14:54.365078+0000 mon.a (mon.0) 2252 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-41","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:14:55.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:55 smithi050 bash[21866]: audit 2024-05-20T22:14:54.366242+0000 mon.a (mon.0) 2253 : audit 1 from='client.26189 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:55.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:55 smithi050 bash[28929]: cluster 2024-05-20T22:14:54.142684+0000 mgr.y (mgr.14592) 345 : cluster 0 pgmap v458: 396 pgs: 40 unknown, 356 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:14:55.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:55 smithi050 bash[28929]: audit 2024-05-20T22:14:54.349932+0000 mon.a (mon.0) 2250 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-41","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:14:55.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:55 smithi050 bash[28929]: cluster 2024-05-20T22:14:54.357830+0000 mon.a (mon.0) 2251 : cluster 0 osdmap e298: 8 total, 8 up, 8 in 2024-05-20T22:14:55.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:55 smithi050 bash[28929]: audit 2024-05-20T22:14:54.361151+0000 mon.c (mon.2) 339 : audit 1 from='client.? v1:172.21.15.50:0/2866251961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:55.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:55 smithi050 bash[28929]: audit 2024-05-20T22:14:54.365078+0000 mon.a (mon.0) 2252 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-41","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:14:55.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:55 smithi050 bash[28929]: audit 2024-05-20T22:14:54.366242+0000 mon.a (mon.0) 2253 : audit 1 from='client.26189 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:56.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:56 smithi145 bash[23893]: audit 2024-05-20T22:14:55.352769+0000 mon.a (mon.0) 2254 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-41","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:14:56.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:56 smithi145 bash[23893]: audit 2024-05-20T22:14:55.352892+0000 mon.a (mon.0) 2255 : audit 1 from='client.26189 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi050-63944-55"}]': finished 2024-05-20T22:14:56.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:56 smithi145 bash[23893]: cluster 2024-05-20T22:14:55.361240+0000 mon.a (mon.0) 2256 : cluster 0 osdmap e299: 8 total, 8 up, 8 in 2024-05-20T22:14:56.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:56 smithi145 bash[23893]: audit 2024-05-20T22:14:55.361835+0000 mon.c (mon.2) 340 : audit 1 from='client.? v1:172.21.15.50:0/2866251961' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:56.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:56 smithi145 bash[23893]: audit 2024-05-20T22:14:55.362629+0000 mon.a (mon.0) 2257 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-05-20T22:14:56.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:56 smithi145 bash[23893]: audit 2024-05-20T22:14:55.364671+0000 mon.a (mon.0) 2258 : audit 1 from='client.26189 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:56.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:56 smithi145 bash[23893]: audit 2024-05-20T22:14:56.356376+0000 mon.a (mon.0) 2259 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-05-20T22:14:56.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:56 smithi145 bash[23893]: audit 2024-05-20T22:14:56.356539+0000 mon.a (mon.0) 2260 : audit 1 from='client.26189 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi050-63944-55"}]': finished 2024-05-20T22:14:56.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:56 smithi145 bash[23893]: cluster 2024-05-20T22:14:56.364338+0000 mon.a (mon.0) 2261 : cluster 0 osdmap e300: 8 total, 8 up, 8 in 2024-05-20T22:14:56.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:56 smithi050 bash[21866]: audit 2024-05-20T22:14:55.352769+0000 mon.a (mon.0) 2254 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-41","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:14:56.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:56 smithi050 bash[21866]: audit 2024-05-20T22:14:55.352892+0000 mon.a (mon.0) 2255 : audit 1 from='client.26189 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi050-63944-55"}]': finished 2024-05-20T22:14:56.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:56 smithi050 bash[21866]: cluster 2024-05-20T22:14:55.361240+0000 mon.a (mon.0) 2256 : cluster 0 osdmap e299: 8 total, 8 up, 8 in 2024-05-20T22:14:56.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:56 smithi050 bash[21866]: audit 2024-05-20T22:14:55.361835+0000 mon.c (mon.2) 340 : audit 1 from='client.? v1:172.21.15.50:0/2866251961' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:56.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:56 smithi050 bash[21866]: audit 2024-05-20T22:14:55.362629+0000 mon.a (mon.0) 2257 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-05-20T22:14:56.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:56 smithi050 bash[21866]: audit 2024-05-20T22:14:55.364671+0000 mon.a (mon.0) 2258 : audit 1 from='client.26189 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:56.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:56 smithi050 bash[21866]: audit 2024-05-20T22:14:56.356376+0000 mon.a (mon.0) 2259 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-05-20T22:14:56.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:56 smithi050 bash[21866]: audit 2024-05-20T22:14:56.356539+0000 mon.a (mon.0) 2260 : audit 1 from='client.26189 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi050-63944-55"}]': finished 2024-05-20T22:14:56.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:56 smithi050 bash[21866]: cluster 2024-05-20T22:14:56.364338+0000 mon.a (mon.0) 2261 : cluster 0 osdmap e300: 8 total, 8 up, 8 in 2024-05-20T22:14:56.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:56 smithi050 bash[28929]: audit 2024-05-20T22:14:55.352769+0000 mon.a (mon.0) 2254 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-41","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:14:56.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:56 smithi050 bash[28929]: audit 2024-05-20T22:14:55.352892+0000 mon.a (mon.0) 2255 : audit 1 from='client.26189 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi050-63944-55"}]': finished 2024-05-20T22:14:56.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:56 smithi050 bash[28929]: cluster 2024-05-20T22:14:55.361240+0000 mon.a (mon.0) 2256 : cluster 0 osdmap e299: 8 total, 8 up, 8 in 2024-05-20T22:14:56.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:56 smithi050 bash[28929]: audit 2024-05-20T22:14:55.361835+0000 mon.c (mon.2) 340 : audit 1 from='client.? v1:172.21.15.50:0/2866251961' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:56.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:56 smithi050 bash[28929]: audit 2024-05-20T22:14:55.362629+0000 mon.a (mon.0) 2257 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-05-20T22:14:56.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:56 smithi050 bash[28929]: audit 2024-05-20T22:14:55.364671+0000 mon.a (mon.0) 2258 : audit 1 from='client.26189 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi050-63944-55"}]: dispatch 2024-05-20T22:14:56.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:56 smithi050 bash[28929]: audit 2024-05-20T22:14:56.356376+0000 mon.a (mon.0) 2259 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-05-20T22:14:56.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:56 smithi050 bash[28929]: audit 2024-05-20T22:14:56.356539+0000 mon.a (mon.0) 2260 : audit 1 from='client.26189 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi050-63944-55"}]': finished 2024-05-20T22:14:56.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:56 smithi050 bash[28929]: cluster 2024-05-20T22:14:56.364338+0000 mon.a (mon.0) 2261 : cluster 0 osdmap e300: 8 total, 8 up, 8 in 2024-05-20T22:14:57.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:57 smithi145 bash[23893]: cluster 2024-05-20T22:14:56.143669+0000 mgr.y (mgr.14592) 346 : cluster 0 pgmap v461: 388 pgs: 388 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:57.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:57 smithi145 bash[23893]: audit 2024-05-20T22:14:56.396101+0000 mon.a (mon.0) 2262 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi050-63944-56"}]: dispatch 2024-05-20T22:14:57.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:57 smithi145 bash[23893]: audit 2024-05-20T22:14:56.397476+0000 mon.a (mon.0) 2263 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi050-63944-56"}]: dispatch 2024-05-20T22:14:57.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:57 smithi145 bash[23893]: audit 2024-05-20T22:14:56.397832+0000 mon.a (mon.0) 2264 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi050-63944-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:57.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:57 smithi050 bash[21866]: cluster 2024-05-20T22:14:56.143669+0000 mgr.y (mgr.14592) 346 : cluster 0 pgmap v461: 388 pgs: 388 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:57.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:57 smithi050 bash[21866]: audit 2024-05-20T22:14:56.396101+0000 mon.a (mon.0) 2262 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi050-63944-56"}]: dispatch 2024-05-20T22:14:57.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:57 smithi050 bash[21866]: audit 2024-05-20T22:14:56.397476+0000 mon.a (mon.0) 2263 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi050-63944-56"}]: dispatch 2024-05-20T22:14:57.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:57 smithi050 bash[21866]: audit 2024-05-20T22:14:56.397832+0000 mon.a (mon.0) 2264 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi050-63944-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:57.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:57 smithi050 bash[28929]: cluster 2024-05-20T22:14:56.143669+0000 mgr.y (mgr.14592) 346 : cluster 0 pgmap v461: 388 pgs: 388 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:14:57.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:57 smithi050 bash[28929]: audit 2024-05-20T22:14:56.396101+0000 mon.a (mon.0) 2262 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi050-63944-56"}]: dispatch 2024-05-20T22:14:57.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:57 smithi050 bash[28929]: audit 2024-05-20T22:14:56.397476+0000 mon.a (mon.0) 2263 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi050-63944-56"}]: dispatch 2024-05-20T22:14:57.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:57 smithi050 bash[28929]: audit 2024-05-20T22:14:56.397832+0000 mon.a (mon.0) 2264 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi050-63944-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:14:58.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:14:57 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:14:58.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:58 smithi050 bash[21866]: audit 2024-05-20T22:14:57.397704+0000 mon.a (mon.0) 2265 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi050-63944-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:58.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:58 smithi050 bash[21866]: cluster 2024-05-20T22:14:57.405683+0000 mon.a (mon.0) 2266 : cluster 0 osdmap e301: 8 total, 8 up, 8 in 2024-05-20T22:14:58.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:58 smithi050 bash[21866]: audit 2024-05-20T22:14:57.410955+0000 mon.a (mon.0) 2267 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi050-63944-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi050-63944-56"}]: dispatch 2024-05-20T22:14:58.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:58 smithi050 bash[21866]: audit 2024-05-20T22:14:57.461727+0000 mon.a (mon.0) 2268 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:58.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:58 smithi050 bash[21866]: audit 2024-05-20T22:14:57.462598+0000 mon.a (mon.0) 2269 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-41"}]: dispatch 2024-05-20T22:14:58.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:58 smithi050 bash[28929]: audit 2024-05-20T22:14:57.397704+0000 mon.a (mon.0) 2265 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi050-63944-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:58.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:58 smithi050 bash[28929]: cluster 2024-05-20T22:14:57.405683+0000 mon.a (mon.0) 2266 : cluster 0 osdmap e301: 8 total, 8 up, 8 in 2024-05-20T22:14:58.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:58 smithi050 bash[28929]: audit 2024-05-20T22:14:57.410955+0000 mon.a (mon.0) 2267 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi050-63944-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi050-63944-56"}]: dispatch 2024-05-20T22:14:58.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:58 smithi050 bash[28929]: audit 2024-05-20T22:14:57.461727+0000 mon.a (mon.0) 2268 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:58.697 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:58 smithi050 bash[28929]: audit 2024-05-20T22:14:57.462598+0000 mon.a (mon.0) 2269 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-41"}]: dispatch 2024-05-20T22:14:58.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:58 smithi145 bash[23893]: audit 2024-05-20T22:14:57.397704+0000 mon.a (mon.0) 2265 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi050-63944-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:14:58.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:58 smithi145 bash[23893]: cluster 2024-05-20T22:14:57.405683+0000 mon.a (mon.0) 2266 : cluster 0 osdmap e301: 8 total, 8 up, 8 in 2024-05-20T22:14:58.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:58 smithi145 bash[23893]: audit 2024-05-20T22:14:57.410955+0000 mon.a (mon.0) 2267 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi050-63944-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi050-63944-56"}]: dispatch 2024-05-20T22:14:58.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:58 smithi145 bash[23893]: audit 2024-05-20T22:14:57.461727+0000 mon.a (mon.0) 2268 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:14:58.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:58 smithi145 bash[23893]: audit 2024-05-20T22:14:57.462598+0000 mon.a (mon.0) 2269 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-41"}]: dispatch 2024-05-20T22:14:59.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:14:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:14:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:15:00.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:59 smithi145 bash[23893]: audit 2024-05-20T22:14:57.865063+0000 mgr.y (mgr.14592) 347 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:00.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:59 smithi145 bash[23893]: cluster 2024-05-20T22:14:58.144697+0000 mgr.y (mgr.14592) 348 : cluster 0 pgmap v464: 388 pgs: 388 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:00.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:59 smithi145 bash[23893]: audit 2024-05-20T22:14:58.407489+0000 mon.a (mon.0) 2270 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-41"}]': finished 2024-05-20T22:15:00.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:59 smithi145 bash[23893]: cluster 2024-05-20T22:14:58.882736+0000 mon.a (mon.0) 2271 : cluster 0 osdmap e302: 8 total, 8 up, 8 in 2024-05-20T22:15:00.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:14:59 smithi145 bash[23893]: cluster 2024-05-20T22:14:59.225169+0000 mon.a (mon.0) 2272 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:00.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:59 smithi050 bash[21866]: audit 2024-05-20T22:14:57.865063+0000 mgr.y (mgr.14592) 347 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:00.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:59 smithi050 bash[21866]: cluster 2024-05-20T22:14:58.144697+0000 mgr.y (mgr.14592) 348 : cluster 0 pgmap v464: 388 pgs: 388 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:00.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:59 smithi050 bash[21866]: audit 2024-05-20T22:14:58.407489+0000 mon.a (mon.0) 2270 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-41"}]': finished 2024-05-20T22:15:00.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:59 smithi050 bash[21866]: cluster 2024-05-20T22:14:58.882736+0000 mon.a (mon.0) 2271 : cluster 0 osdmap e302: 8 total, 8 up, 8 in 2024-05-20T22:15:00.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:14:59 smithi050 bash[21866]: cluster 2024-05-20T22:14:59.225169+0000 mon.a (mon.0) 2272 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:59 smithi050 bash[28929]: audit 2024-05-20T22:14:57.865063+0000 mgr.y (mgr.14592) 347 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:59 smithi050 bash[28929]: cluster 2024-05-20T22:14:58.144697+0000 mgr.y (mgr.14592) 348 : cluster 0 pgmap v464: 388 pgs: 388 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:59 smithi050 bash[28929]: audit 2024-05-20T22:14:58.407489+0000 mon.a (mon.0) 2270 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-41"}]': finished 2024-05-20T22:15:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:59 smithi050 bash[28929]: cluster 2024-05-20T22:14:58.882736+0000 mon.a (mon.0) 2271 : cluster 0 osdmap e302: 8 total, 8 up, 8 in 2024-05-20T22:15:00.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:14:59 smithi050 bash[28929]: cluster 2024-05-20T22:14:59.225169+0000 mon.a (mon.0) 2272 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:00 smithi145 bash[23893]: audit 2024-05-20T22:14:59.410628+0000 mon.a (mon.0) 2273 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi050-63944-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi050-63944-56"}]': finished 2024-05-20T22:15:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:00 smithi145 bash[23893]: cluster 2024-05-20T22:14:59.421057+0000 mon.a (mon.0) 2274 : cluster 0 osdmap e303: 8 total, 8 up, 8 in 2024-05-20T22:15:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:00 smithi145 bash[23893]: cluster 2024-05-20T22:15:00.147785+0000 mgr.y (mgr.14592) 349 : cluster 0 pgmap v467: 364 pgs: 8 creating+peering, 356 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:00 smithi145 bash[23893]: cluster 2024-05-20T22:15:00.422608+0000 mon.a (mon.0) 2275 : cluster 0 osdmap e304: 8 total, 8 up, 8 in 2024-05-20T22:15:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:00 smithi145 bash[23893]: audit 2024-05-20T22:15:00.439905+0000 mon.a (mon.0) 2276 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:15:01.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:00 smithi050 bash[21866]: audit 2024-05-20T22:14:59.410628+0000 mon.a (mon.0) 2273 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi050-63944-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi050-63944-56"}]': finished 2024-05-20T22:15:01.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:00 smithi050 bash[21866]: cluster 2024-05-20T22:14:59.421057+0000 mon.a (mon.0) 2274 : cluster 0 osdmap e303: 8 total, 8 up, 8 in 2024-05-20T22:15:01.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:00 smithi050 bash[21866]: cluster 2024-05-20T22:15:00.147785+0000 mgr.y (mgr.14592) 349 : cluster 0 pgmap v467: 364 pgs: 8 creating+peering, 356 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:01.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:00 smithi050 bash[21866]: cluster 2024-05-20T22:15:00.422608+0000 mon.a (mon.0) 2275 : cluster 0 osdmap e304: 8 total, 8 up, 8 in 2024-05-20T22:15:01.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:00 smithi050 bash[21866]: audit 2024-05-20T22:15:00.439905+0000 mon.a (mon.0) 2276 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:15:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:00 smithi050 bash[28929]: audit 2024-05-20T22:14:59.410628+0000 mon.a (mon.0) 2273 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi050-63944-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi050-63944-56"}]': finished 2024-05-20T22:15:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:00 smithi050 bash[28929]: cluster 2024-05-20T22:14:59.421057+0000 mon.a (mon.0) 2274 : cluster 0 osdmap e303: 8 total, 8 up, 8 in 2024-05-20T22:15:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:00 smithi050 bash[28929]: cluster 2024-05-20T22:15:00.147785+0000 mgr.y (mgr.14592) 349 : cluster 0 pgmap v467: 364 pgs: 8 creating+peering, 356 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:00 smithi050 bash[28929]: cluster 2024-05-20T22:15:00.422608+0000 mon.a (mon.0) 2275 : cluster 0 osdmap e304: 8 total, 8 up, 8 in 2024-05-20T22:15:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:00 smithi050 bash[28929]: audit 2024-05-20T22:15:00.439905+0000 mon.a (mon.0) 2276 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:15:02.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:02 smithi050 bash[21866]: audit 2024-05-20T22:15:01.417586+0000 mon.a (mon.0) 2277 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:15:02.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:02 smithi050 bash[21866]: cluster 2024-05-20T22:15:01.428582+0000 mon.a (mon.0) 2278 : cluster 0 osdmap e305: 8 total, 8 up, 8 in 2024-05-20T22:15:02.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:02 smithi050 bash[21866]: audit 2024-05-20T22:15:01.433148+0000 mon.a (mon.0) 2279 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi050-63944-56"}]: dispatch 2024-05-20T22:15:02.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:02 smithi050 bash[21866]: audit 2024-05-20T22:15:01.435399+0000 mon.a (mon.0) 2280 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi050-64110-6","var": "pg_num","format": "json"}]: dispatch 2024-05-20T22:15:02.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:02 smithi050 bash[21866]: audit 2024-05-20T22:15:01.436754+0000 mon.a (mon.0) 2281 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:15:02.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:02 smithi050 bash[28929]: audit 2024-05-20T22:15:01.417586+0000 mon.a (mon.0) 2277 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:15:02.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:02 smithi050 bash[28929]: cluster 2024-05-20T22:15:01.428582+0000 mon.a (mon.0) 2278 : cluster 0 osdmap e305: 8 total, 8 up, 8 in 2024-05-20T22:15:02.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:02 smithi050 bash[28929]: audit 2024-05-20T22:15:01.433148+0000 mon.a (mon.0) 2279 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi050-63944-56"}]: dispatch 2024-05-20T22:15:02.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:02 smithi050 bash[28929]: audit 2024-05-20T22:15:01.435399+0000 mon.a (mon.0) 2280 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi050-64110-6","var": "pg_num","format": "json"}]: dispatch 2024-05-20T22:15:02.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:02 smithi050 bash[28929]: audit 2024-05-20T22:15:01.436754+0000 mon.a (mon.0) 2281 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:15:02.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:02 smithi145 bash[23893]: audit 2024-05-20T22:15:01.417586+0000 mon.a (mon.0) 2277 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:15:02.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:02 smithi145 bash[23893]: cluster 2024-05-20T22:15:01.428582+0000 mon.a (mon.0) 2278 : cluster 0 osdmap e305: 8 total, 8 up, 8 in 2024-05-20T22:15:02.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:02 smithi145 bash[23893]: audit 2024-05-20T22:15:01.433148+0000 mon.a (mon.0) 2279 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi050-63944-56"}]: dispatch 2024-05-20T22:15:02.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:02 smithi145 bash[23893]: audit 2024-05-20T22:15:01.435399+0000 mon.a (mon.0) 2280 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi050-64110-6","var": "pg_num","format": "json"}]: dispatch 2024-05-20T22:15:02.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:02 smithi145 bash[23893]: audit 2024-05-20T22:15:01.436754+0000 mon.a (mon.0) 2281 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:15:03.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:03 smithi050 bash[28929]: cluster 2024-05-20T22:15:02.148723+0000 mgr.y (mgr.14592) 350 : cluster 0 pgmap v470: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:03.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:03 smithi050 bash[28929]: audit 2024-05-20T22:15:02.427158+0000 mon.a (mon.0) 2282 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi050-63944-56"}]': finished 2024-05-20T22:15:03.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:03 smithi050 bash[28929]: audit 2024-05-20T22:15:02.427298+0000 mon.a (mon.0) 2283 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-43", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:15:03.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:03 smithi050 bash[28929]: cluster 2024-05-20T22:15:02.436162+0000 mon.a (mon.0) 2284 : cluster 0 osdmap e306: 8 total, 8 up, 8 in 2024-05-20T22:15:03.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:03 smithi050 bash[28929]: audit 2024-05-20T22:15:02.437045+0000 mon.a (mon.0) 2285 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi050-63944-56"}]: dispatch 2024-05-20T22:15:03.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:03 smithi050 bash[28929]: audit 2024-05-20T22:15:02.437879+0000 mon.a (mon.0) 2286 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-43","var": "hit_set_count","val": "8"}]: dispatch 2024-05-20T22:15:03.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:03 smithi050 bash[21866]: cluster 2024-05-20T22:15:02.148723+0000 mgr.y (mgr.14592) 350 : cluster 0 pgmap v470: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:03.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:03 smithi050 bash[21866]: audit 2024-05-20T22:15:02.427158+0000 mon.a (mon.0) 2282 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi050-63944-56"}]': finished 2024-05-20T22:15:03.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:03 smithi050 bash[21866]: audit 2024-05-20T22:15:02.427298+0000 mon.a (mon.0) 2283 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-43", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:15:03.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:03 smithi050 bash[21866]: cluster 2024-05-20T22:15:02.436162+0000 mon.a (mon.0) 2284 : cluster 0 osdmap e306: 8 total, 8 up, 8 in 2024-05-20T22:15:03.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:03 smithi050 bash[21866]: audit 2024-05-20T22:15:02.437045+0000 mon.a (mon.0) 2285 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi050-63944-56"}]: dispatch 2024-05-20T22:15:03.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:03 smithi050 bash[21866]: audit 2024-05-20T22:15:02.437879+0000 mon.a (mon.0) 2286 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-43","var": "hit_set_count","val": "8"}]: dispatch 2024-05-20T22:15:03.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:03 smithi145 bash[23893]: cluster 2024-05-20T22:15:02.148723+0000 mgr.y (mgr.14592) 350 : cluster 0 pgmap v470: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:03.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:03 smithi145 bash[23893]: audit 2024-05-20T22:15:02.427158+0000 mon.a (mon.0) 2282 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi050-63944-56"}]': finished 2024-05-20T22:15:03.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:03 smithi145 bash[23893]: audit 2024-05-20T22:15:02.427298+0000 mon.a (mon.0) 2283 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-43", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:15:03.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:03 smithi145 bash[23893]: cluster 2024-05-20T22:15:02.436162+0000 mon.a (mon.0) 2284 : cluster 0 osdmap e306: 8 total, 8 up, 8 in 2024-05-20T22:15:03.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:03 smithi145 bash[23893]: audit 2024-05-20T22:15:02.437045+0000 mon.a (mon.0) 2285 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi050-63944-56"}]: dispatch 2024-05-20T22:15:03.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:03 smithi145 bash[23893]: audit 2024-05-20T22:15:02.437879+0000 mon.a (mon.0) 2286 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-43","var": "hit_set_count","val": "8"}]: dispatch 2024-05-20T22:15:04.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:04 smithi050 bash[21866]: audit 2024-05-20T22:15:03.430747+0000 mon.a (mon.0) 2287 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi050-63944-56"}]': finished 2024-05-20T22:15:04.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:04 smithi050 bash[21866]: audit 2024-05-20T22:15:03.430867+0000 mon.a (mon.0) 2288 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-43","var": "hit_set_count","val": "8"}]': finished 2024-05-20T22:15:04.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:04 smithi050 bash[21866]: cluster 2024-05-20T22:15:03.438145+0000 mon.a (mon.0) 2289 : cluster 0 osdmap e307: 8 total, 8 up, 8 in 2024-05-20T22:15:04.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:04 smithi050 bash[21866]: audit 2024-05-20T22:15:03.440311+0000 mon.a (mon.0) 2290 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-43","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:15:04.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:04 smithi050 bash[21866]: audit 2024-05-20T22:15:03.475526+0000 mon.a (mon.0) 2291 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi050-63944-57"}]: dispatch 2024-05-20T22:15:04.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:04 smithi050 bash[21866]: audit 2024-05-20T22:15:03.476876+0000 mon.a (mon.0) 2292 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi050-63944-57"}]: dispatch 2024-05-20T22:15:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:04 smithi050 bash[21866]: audit 2024-05-20T22:15:03.477215+0000 mon.a (mon.0) 2293 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi050-63944-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:04 smithi050 bash[21866]: audit 2024-05-20T22:15:04.433545+0000 mon.a (mon.0) 2294 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-43","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:15:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:04 smithi050 bash[21866]: audit 2024-05-20T22:15:04.433762+0000 mon.a (mon.0) 2295 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi050-63944-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:04 smithi050 bash[21866]: cluster 2024-05-20T22:15:04.440147+0000 mon.a (mon.0) 2296 : cluster 0 osdmap e308: 8 total, 8 up, 8 in 2024-05-20T22:15:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:04 smithi050 bash[21866]: audit 2024-05-20T22:15:04.441883+0000 mon.a (mon.0) 2297 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-05-20T22:15:04.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:04 smithi050 bash[28929]: audit 2024-05-20T22:15:03.430747+0000 mon.a (mon.0) 2287 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi050-63944-56"}]': finished 2024-05-20T22:15:04.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:04 smithi050 bash[28929]: audit 2024-05-20T22:15:03.430867+0000 mon.a (mon.0) 2288 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-43","var": "hit_set_count","val": "8"}]': finished 2024-05-20T22:15:04.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:04 smithi050 bash[28929]: cluster 2024-05-20T22:15:03.438145+0000 mon.a (mon.0) 2289 : cluster 0 osdmap e307: 8 total, 8 up, 8 in 2024-05-20T22:15:04.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:04 smithi050 bash[28929]: audit 2024-05-20T22:15:03.440311+0000 mon.a (mon.0) 2290 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-43","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:15:04.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:04 smithi050 bash[28929]: audit 2024-05-20T22:15:03.475526+0000 mon.a (mon.0) 2291 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi050-63944-57"}]: dispatch 2024-05-20T22:15:04.700 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:04 smithi050 bash[28929]: audit 2024-05-20T22:15:03.476876+0000 mon.a (mon.0) 2292 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi050-63944-57"}]: dispatch 2024-05-20T22:15:04.701 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:04 smithi050 bash[28929]: audit 2024-05-20T22:15:03.477215+0000 mon.a (mon.0) 2293 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi050-63944-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:04.701 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:04 smithi050 bash[28929]: audit 2024-05-20T22:15:04.433545+0000 mon.a (mon.0) 2294 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-43","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:15:04.701 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:04 smithi050 bash[28929]: audit 2024-05-20T22:15:04.433762+0000 mon.a (mon.0) 2295 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi050-63944-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:04.701 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:04 smithi050 bash[28929]: cluster 2024-05-20T22:15:04.440147+0000 mon.a (mon.0) 2296 : cluster 0 osdmap e308: 8 total, 8 up, 8 in 2024-05-20T22:15:04.701 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:04 smithi050 bash[28929]: audit 2024-05-20T22:15:04.441883+0000 mon.a (mon.0) 2297 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-05-20T22:15:04.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:04 smithi145 bash[23893]: audit 2024-05-20T22:15:03.430747+0000 mon.a (mon.0) 2287 : audit 1 from='client.? v1:172.21.15.50:0/4033185257' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi050-63944-56"}]': finished 2024-05-20T22:15:04.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:04 smithi145 bash[23893]: audit 2024-05-20T22:15:03.430867+0000 mon.a (mon.0) 2288 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-43","var": "hit_set_count","val": "8"}]': finished 2024-05-20T22:15:04.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:04 smithi145 bash[23893]: cluster 2024-05-20T22:15:03.438145+0000 mon.a (mon.0) 2289 : cluster 0 osdmap e307: 8 total, 8 up, 8 in 2024-05-20T22:15:04.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:04 smithi145 bash[23893]: audit 2024-05-20T22:15:03.440311+0000 mon.a (mon.0) 2290 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-43","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:15:04.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:04 smithi145 bash[23893]: audit 2024-05-20T22:15:03.475526+0000 mon.a (mon.0) 2291 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi050-63944-57"}]: dispatch 2024-05-20T22:15:04.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:04 smithi145 bash[23893]: audit 2024-05-20T22:15:03.476876+0000 mon.a (mon.0) 2292 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi050-63944-57"}]: dispatch 2024-05-20T22:15:04.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:04 smithi145 bash[23893]: audit 2024-05-20T22:15:03.477215+0000 mon.a (mon.0) 2293 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi050-63944-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:04.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:04 smithi145 bash[23893]: audit 2024-05-20T22:15:04.433545+0000 mon.a (mon.0) 2294 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-43","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:15:04.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:04 smithi145 bash[23893]: audit 2024-05-20T22:15:04.433762+0000 mon.a (mon.0) 2295 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi050-63944-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:04.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:04 smithi145 bash[23893]: cluster 2024-05-20T22:15:04.440147+0000 mon.a (mon.0) 2296 : cluster 0 osdmap e308: 8 total, 8 up, 8 in 2024-05-20T22:15:04.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:04 smithi145 bash[23893]: audit 2024-05-20T22:15:04.441883+0000 mon.a (mon.0) 2297 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-05-20T22:15:06.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:05 smithi050 bash[21866]: cluster 2024-05-20T22:15:04.149705+0000 mgr.y (mgr.14592) 351 : cluster 0 pgmap v473: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:15:06.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:05 smithi050 bash[21866]: audit 2024-05-20T22:15:04.442535+0000 mon.a (mon.0) 2298 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi050-63944-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi050-63944-57"}]: dispatch 2024-05-20T22:15:06.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:05 smithi050 bash[21866]: audit 2024-05-20T22:15:05.437331+0000 mon.a (mon.0) 2299 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-05-20T22:15:06.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:05 smithi050 bash[28929]: cluster 2024-05-20T22:15:04.149705+0000 mgr.y (mgr.14592) 351 : cluster 0 pgmap v473: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:15:06.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:05 smithi050 bash[28929]: audit 2024-05-20T22:15:04.442535+0000 mon.a (mon.0) 2298 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi050-63944-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi050-63944-57"}]: dispatch 2024-05-20T22:15:06.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:05 smithi050 bash[28929]: audit 2024-05-20T22:15:05.437331+0000 mon.a (mon.0) 2299 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-05-20T22:15:06.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:05 smithi145 bash[23893]: cluster 2024-05-20T22:15:04.149705+0000 mgr.y (mgr.14592) 351 : cluster 0 pgmap v473: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:15:06.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:05 smithi145 bash[23893]: audit 2024-05-20T22:15:04.442535+0000 mon.a (mon.0) 2298 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi050-63944-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi050-63944-57"}]: dispatch 2024-05-20T22:15:06.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:05 smithi145 bash[23893]: audit 2024-05-20T22:15:05.437331+0000 mon.a (mon.0) 2299 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-05-20T22:15:06.547 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-05-20T22:15:06.547 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: hmm, no HitSet yet 2024-05-20T22:15:06.547 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: ok, hit_set contains 256:602f83fe:::foo:head 2024-05-20T22:15:06.547 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (9073 ms) 2024-05-20T22:15:06.547 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-05-20T22:15:06.547 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg_num = 32 2024-05-20T22:15:06.547 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 0 ls 1716243306,0 2024-05-20T22:15:06.548 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 1 ls 1716243306,0 2024-05-20T22:15:06.548 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 2 ls 1716243306,0 2024-05-20T22:15:06.548 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 3 ls 1716243306,0 2024-05-20T22:15:06.548 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 4 ls 1716243306,0 2024-05-20T22:15:06.548 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 5 ls 1716243306,0 2024-05-20T22:15:06.548 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 6 ls 1716243306,0 2024-05-20T22:15:06.548 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 7 ls 1716243306,0 2024-05-20T22:15:06.548 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 8 ls 1716243306,0 2024-05-20T22:15:06.548 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 9 ls 1716243306,0 2024-05-20T22:15:06.548 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 10 ls 1716243306,0 2024-05-20T22:15:06.548 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 11 ls 1716243306,0 2024-05-20T22:15:06.548 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 12 ls 1716243306,0 2024-05-20T22:15:06.549 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 13 ls 1716243306,0 2024-05-20T22:15:06.549 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 14 ls 1716243306,0 2024-05-20T22:15:06.549 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 15 ls 1716243306,0 2024-05-20T22:15:06.549 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 16 ls 1716243306,0 2024-05-20T22:15:06.549 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 17 ls 1716243306,0 2024-05-20T22:15:06.549 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 18 ls 1716243306,0 2024-05-20T22:15:06.549 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 19 ls 1716243306,0 2024-05-20T22:15:06.549 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 20 ls 1716243306,0 2024-05-20T22:15:06.549 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 21 ls 1716243306,0 2024-05-20T22:15:06.549 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 22 ls 1716243306,0 2024-05-20T22:15:06.549 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 23 ls 1716243306,0 2024-05-20T22:15:06.549 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 24 ls 1716243306,0 2024-05-20T22:15:06.549 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 25 ls 1716243306,0 2024-05-20T22:15:06.549 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 26 ls 1716243306,0 2024-05-20T22:15:06.549 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 27 ls 1716243306,0 2024-05-20T22:15:06.549 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 28 ls 1716243306,0 2024-05-20T22:15:06.550 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 29 ls 1716243306,0 2024-05-20T22:15:06.550 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 30 ls 1716243306,0 2024-05-20T22:15:06.550 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg 31 ls 1716243306,0 2024-05-20T22:15:06.550 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: pg_num = 32 2024-05-20T22:15:06.550 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:6cac518f:::0:head 2024-05-20T22:15:06.550 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:02547ec2:::1:head 2024-05-20T22:15:06.550 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:f905c69b:::2:head 2024-05-20T22:15:06.550 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:cfc208b3:::3:head 2024-05-20T22:15:06.550 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:d83876eb:::4:head 2024-05-20T22:15:06.550 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:b29083e3:::5:head 2024-05-20T22:15:06.550 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:c4fdafeb:::6:head 2024-05-20T22:15:06.550 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:5c6b0b28:::7:head 2024-05-20T22:15:06.550 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:bd63b0f1:::8:head 2024-05-20T22:15:06.551 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:e960b815:::9:head 2024-05-20T22:15:06.551 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:52ea6a34:::10:head 2024-05-20T22:15:06.551 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:89d3ae78:::11:head 2024-05-20T22:15:06.551 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:de5d7c5f:::12:head 2024-05-20T22:15:06.551 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:566253c9:::13:head 2024-05-20T22:15:06.551 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:62a1935d:::14:head 2024-05-20T22:15:06.551 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:863748b0:::15:head 2024-05-20T22:15:06.551 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:3958e169:::16:head 2024-05-20T22:15:06.551 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:4d4dabf9:::17:head 2024-05-20T22:15:06.551 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:8391935d:::18:head 2024-05-20T22:15:06.551 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:28883081:::19:head 2024-05-20T22:15:06.551 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:69259c59:::20:head 2024-05-20T22:15:06.551 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:4bdb80b7:::21:head 2024-05-20T22:15:06.551 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:a11c5d71:::22:head 2024-05-20T22:15:06.551 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:271af37b:::23:head 2024-05-20T22:15:06.552 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:95b121be:::24:head 2024-05-20T22:15:06.552 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:58d1031b:::25:head 2024-05-20T22:15:06.552 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:0a050783:::26:head 2024-05-20T22:15:06.552 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:c709704c:::27:head 2024-05-20T22:15:06.552 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:cbe56eaf:::28:head 2024-05-20T22:15:06.552 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:86b4b162:::29:head 2024-05-20T22:15:06.552 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:70d89383:::30:head 2024-05-20T22:15:06.552 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:dd450c7c:::31:head 2024-05-20T22:15:06.552 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:6d5729b1:::32:head 2024-05-20T22:15:06.552 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:c388f3fb:::33:head 2024-05-20T22:15:06.552 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:56cfea31:::34:head 2024-05-20T22:15:06.552 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:9dbc1bf7:::35:head 2024-05-20T22:15:06.552 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:40b74ccd:::36:head 2024-05-20T22:15:06.552 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:4d5aaf42:::37:head 2024-05-20T22:15:06.552 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:920f362c:::38:head 2024-05-20T22:15:06.553 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:6cc53222:::39:head 2024-05-20T22:15:06.553 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:9cad833f:::40:head 2024-05-20T22:15:06.553 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:1ea84d41:::41:head 2024-05-20T22:15:06.553 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:c4480ef6:::42:head 2024-05-20T22:15:06.553 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:a694361e:::43:head 2024-05-20T22:15:06.553 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:d1bd33e9:::44:head 2024-05-20T22:15:06.553 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:ddc2cd5d:::45:head 2024-05-20T22:15:06.553 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:2b782207:::46:head 2024-05-20T22:15:06.553 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:7b187fca:::47:head 2024-05-20T22:15:06.553 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:90ecdf6f:::48:head 2024-05-20T22:15:06.553 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:a5ed95fe:::49:head 2024-05-20T22:15:06.553 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:ea0eaa55:::50:head 2024-05-20T22:15:06.553 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:f33ef17b:::51:head 2024-05-20T22:15:06.553 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:a0d1b2f6:::52:head 2024-05-20T22:15:06.553 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:60c5229e:::53:head 2024-05-20T22:15:06.554 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:edcbc575:::54:head 2024-05-20T22:15:06.554 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:102cf253:::55:head 2024-05-20T22:15:06.554 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:efb7fb0b:::56:head 2024-05-20T22:15:06.554 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:50d0a326:::57:head 2024-05-20T22:15:06.554 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:d4dc5daf:::58:head 2024-05-20T22:15:06.554 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:3a130462:::59:head 2024-05-20T22:15:06.554 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:ec87ed71:::60:head 2024-05-20T22:15:06.554 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:d5bc9454:::61:head 2024-05-20T22:15:06.554 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:3ddfe313:::62:head 2024-05-20T22:15:06.554 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:7c2816b9:::63:head 2024-05-20T22:15:06.554 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:47e00e4d:::64:head 2024-05-20T22:15:06.554 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:c6410c18:::65:head 2024-05-20T22:15:06.554 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:b48ed237:::66:head 2024-05-20T22:15:06.554 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:cd63ad31:::67:head 2024-05-20T22:15:06.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:b179e92b:::68:head 2024-05-20T22:15:06.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:0d9f741a:::69:head 2024-05-20T22:15:06.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:6d3352ae:::70:head 2024-05-20T22:15:06.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:c6d5c19e:::71:head 2024-05-20T22:15:06.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:bc4729c3:::72:head 2024-05-20T22:15:06.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:77e930b9:::73:head 2024-05-20T22:15:06.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:0abeecfd:::74:head 2024-05-20T22:15:06.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:b7c37e15:::75:head 2024-05-20T22:15:06.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:b6378398:::76:head 2024-05-20T22:15:06.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:02bd68de:::77:head 2024-05-20T22:15:06.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:cc795d2d:::78:head 2024-05-20T22:15:06.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:630d4fea:::79:head 2024-05-20T22:15:06.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:e0d29ef5:::80:head 2024-05-20T22:15:06.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:fd6f13d2:::81:head 2024-05-20T22:15:06.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:606461d5:::82:head 2024-05-20T22:15:06.555 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:eadbdc43:::83:head 2024-05-20T22:15:06.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:8761d0bb:::84:head 2024-05-20T22:15:06.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:9ef0186f:::85:head 2024-05-20T22:15:06.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:e0d41294:::86:head 2024-05-20T22:15:06.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:961de695:::87:head 2024-05-20T22:15:06.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:1423148f:::88:head 2024-05-20T22:15:06.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:633a8fa2:::89:head 2024-05-20T22:15:06.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:a8653809:::90:head 2024-05-20T22:15:06.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:3dac8b33:::91:head 2024-05-20T22:15:06.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:35aad435:::92:head 2024-05-20T22:15:06.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:f6dcc343:::93:head 2024-05-20T22:15:06.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:dbbdad87:::94:head 2024-05-20T22:15:06.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:1cb48ce0:::95:head 2024-05-20T22:15:06.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:03cd461c:::96:head 2024-05-20T22:15:06.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:17a4ea99:::97:head 2024-05-20T22:15:06.556 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:9993c9a7:::98:head 2024-05-20T22:15:06.557 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:6394211c:::99:head 2024-05-20T22:15:06.557 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:94c7ae57:::100:head 2024-05-20T22:15:06.557 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:6fdee5bb:::101:head 2024-05-20T22:15:06.557 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:9a477fd1:::102:head 2024-05-20T22:15:06.557 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:eb850916:::103:head 2024-05-20T22:15:06.557 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:affc56b9:::104:head 2024-05-20T22:15:06.557 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:b42dc814:::105:head 2024-05-20T22:15:06.557 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:f319f8f0:::106:head 2024-05-20T22:15:06.557 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:9a40b9de:::107:head 2024-05-20T22:15:06.557 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:8b524f28:::108:head 2024-05-20T22:15:06.557 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:e3de589f:::109:head 2024-05-20T22:15:06.557 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:90f90a5b:::110:head 2024-05-20T22:15:06.557 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:a7b4f1d7:::111:head 2024-05-20T22:15:06.558 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:af51766e:::112:head 2024-05-20T22:15:06.558 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:b6f90bd1:::113:head 2024-05-20T22:15:06.558 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:e0261208:::114:head 2024-05-20T22:15:06.558 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:c9569ef7:::115:head 2024-05-20T22:15:06.558 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:61bebe50:::116:head 2024-05-20T22:15:06.558 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:fe93412b:::117:head 2024-05-20T22:15:06.558 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:d3d38bee:::118:head 2024-05-20T22:15:06.558 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:3100ba0c:::119:head 2024-05-20T22:15:06.558 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:d0560ada:::120:head 2024-05-20T22:15:06.558 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:f0ea8b35:::121:head 2024-05-20T22:15:06.558 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:766f231a:::122:head 2024-05-20T22:15:06.559 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:a07a2582:::123:head 2024-05-20T22:15:06.559 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:bd7c6b3a:::124:head 2024-05-20T22:15:06.559 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:fb2ddaff:::125:head 2024-05-20T22:15:06.559 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:4408e1fe:::126:head 2024-05-20T22:15:06.559 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:ee1df7a7:::127:head 2024-05-20T22:15:06.559 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:c3002909:::128:head 2024-05-20T22:15:06.559 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:4f48ffa9:::129:head 2024-05-20T22:15:06.559 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:edf38733:::130:head 2024-05-20T22:15:06.559 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:c08425c0:::131:head 2024-05-20T22:15:06.559 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:5f902d98:::132:head 2024-05-20T22:15:06.559 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:41ea2c93:::133:head 2024-05-20T22:15:06.559 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:813cee13:::134:head 2024-05-20T22:15:06.559 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:0131818d:::135:head 2024-05-20T22:15:06.559 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:26ba5a85:::136:head 2024-05-20T22:15:06.559 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:381b8a5a:::137:head 2024-05-20T22:15:06.560 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:28797e47:::138:head 2024-05-20T22:15:06.560 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:bfca7f22:::139:head 2024-05-20T22:15:06.560 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:36807075:::140:head 2024-05-20T22:15:06.560 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:80b03975:::141:head 2024-05-20T22:15:06.560 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:5c15709b:::142:head 2024-05-20T22:15:06.560 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:f39ea15e:::143:head 2024-05-20T22:15:06.560 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:ea992956:::144:head 2024-05-20T22:15:06.560 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:48887b1c:::145:head 2024-05-20T22:15:06.560 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:9f24a9dd:::146:head 2024-05-20T22:15:06.560 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:987f100b:::147:head 2024-05-20T22:15:06.560 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:d2dd3581:::148:head 2024-05-20T22:15:06.560 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:7fed1808:::149:head 2024-05-20T22:15:06.560 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:c80b70e9:::150:head 2024-05-20T22:15:06.560 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:85ed90f9:::151:head 2024-05-20T22:15:06.560 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:36428b24:::152:head 2024-05-20T22:15:06.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:d044c34a:::153:head 2024-05-20T22:15:06.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:7c18bf58:::154:head 2024-05-20T22:15:06.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:d1c21232:::155:head 2024-05-20T22:15:06.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:a7a3c575:::156:head 2024-05-20T22:15:06.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:87da0633:::157:head 2024-05-20T22:15:06.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:d5ac3822:::158:head 2024-05-20T22:15:06.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:3f20522d:::159:head 2024-05-20T22:15:06.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:6ca26563:::160:head 2024-05-20T22:15:06.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:532ce135:::161:head 2024-05-20T22:15:06.561 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:c78863e6:::162:head 2024-05-20T22:15:07.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:06 smithi050 bash[21866]: cluster 2024-05-20T22:15:05.903313+0000 mon.a (mon.0) 2300 : cluster 0 osdmap e309: 8 total, 8 up, 8 in 2024-05-20T22:15:07.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:06 smithi050 bash[21866]: cluster 2024-05-20T22:15:06.150733+0000 mgr.y (mgr.14592) 352 : cluster 0 pgmap v476: 388 pgs: 388 active+clean; 8.4 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:07.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:06 smithi050 bash[21866]: audit 2024-05-20T22:15:06.440381+0000 mon.a (mon.0) 2301 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi050-63944-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi050-63944-57"}]': finished 2024-05-20T22:15:07.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:06 smithi050 bash[21866]: cluster 2024-05-20T22:15:06.448504+0000 mon.a (mon.0) 2302 : cluster 0 osdmap e310: 8 total, 8 up, 8 in 2024-05-20T22:15:07.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:06 smithi050 bash[21866]: audit 2024-05-20T22:15:06.552419+0000 mon.a (mon.0) 2303 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi050-64110-43","var": "pg_num","format": "json"}]: dispatch 2024-05-20T22:15:07.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:06 smithi050 bash[21866]: audit 2024-05-20T22:15:06.886597+0000 mon.a (mon.0) 2304 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:15:07.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:06 smithi050 bash[21866]: audit 2024-05-20T22:15:06.887517+0000 mon.a (mon.0) 2305 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-43"}]: dispatch 2024-05-20T22:15:07.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:06 smithi050 bash[28929]: cluster 2024-05-20T22:15:05.903313+0000 mon.a (mon.0) 2300 : cluster 0 osdmap e309: 8 total, 8 up, 8 in 2024-05-20T22:15:07.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:06 smithi050 bash[28929]: cluster 2024-05-20T22:15:06.150733+0000 mgr.y (mgr.14592) 352 : cluster 0 pgmap v476: 388 pgs: 388 active+clean; 8.4 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:07.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:06 smithi050 bash[28929]: audit 2024-05-20T22:15:06.440381+0000 mon.a (mon.0) 2301 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi050-63944-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi050-63944-57"}]': finished 2024-05-20T22:15:07.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:06 smithi050 bash[28929]: cluster 2024-05-20T22:15:06.448504+0000 mon.a (mon.0) 2302 : cluster 0 osdmap e310: 8 total, 8 up, 8 in 2024-05-20T22:15:07.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:06 smithi050 bash[28929]: audit 2024-05-20T22:15:06.552419+0000 mon.a (mon.0) 2303 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi050-64110-43","var": "pg_num","format": "json"}]: dispatch 2024-05-20T22:15:07.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:06 smithi050 bash[28929]: audit 2024-05-20T22:15:06.886597+0000 mon.a (mon.0) 2304 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:15:07.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:06 smithi050 bash[28929]: audit 2024-05-20T22:15:06.887517+0000 mon.a (mon.0) 2305 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-43"}]: dispatch 2024-05-20T22:15:07.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:06 smithi145 bash[23893]: cluster 2024-05-20T22:15:05.903313+0000 mon.a (mon.0) 2300 : cluster 0 osdmap e309: 8 total, 8 up, 8 in 2024-05-20T22:15:07.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:06 smithi145 bash[23893]: cluster 2024-05-20T22:15:06.150733+0000 mgr.y (mgr.14592) 352 : cluster 0 pgmap v476: 388 pgs: 388 active+clean; 8.4 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:07.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:06 smithi145 bash[23893]: audit 2024-05-20T22:15:06.440381+0000 mon.a (mon.0) 2301 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi050-63944-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi050-63944-57"}]': finished 2024-05-20T22:15:07.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:06 smithi145 bash[23893]: cluster 2024-05-20T22:15:06.448504+0000 mon.a (mon.0) 2302 : cluster 0 osdmap e310: 8 total, 8 up, 8 in 2024-05-20T22:15:07.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:06 smithi145 bash[23893]: audit 2024-05-20T22:15:06.552419+0000 mon.a (mon.0) 2303 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi050-64110-43","var": "pg_num","format": "json"}]: dispatch 2024-05-20T22:15:07.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:06 smithi145 bash[23893]: audit 2024-05-20T22:15:06.886597+0000 mon.a (mon.0) 2304 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:15:07.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:06 smithi145 bash[23893]: audit 2024-05-20T22:15:06.887517+0000 mon.a (mon.0) 2305 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-43"}]: dispatch 2024-05-20T22:15:08.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:07 smithi145 bash[23893]: audit 2024-05-20T22:15:07.008414+0000 mon.a (mon.0) 2306 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:15:08.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:07 smithi145 bash[23893]: audit 2024-05-20T22:15:07.442908+0000 mon.a (mon.0) 2307 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-43"}]': finished 2024-05-20T22:15:08.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:07 smithi145 bash[23893]: cluster 2024-05-20T22:15:07.451079+0000 mon.a (mon.0) 2308 : cluster 0 osdmap e311: 8 total, 8 up, 8 in 2024-05-20T22:15:08.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:15:07 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:15:08.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:07 smithi050 bash[21866]: audit 2024-05-20T22:15:07.008414+0000 mon.a (mon.0) 2306 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:15:08.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:07 smithi050 bash[21866]: audit 2024-05-20T22:15:07.442908+0000 mon.a (mon.0) 2307 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-43"}]': finished 2024-05-20T22:15:08.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:07 smithi050 bash[21866]: cluster 2024-05-20T22:15:07.451079+0000 mon.a (mon.0) 2308 : cluster 0 osdmap e311: 8 total, 8 up, 8 in 2024-05-20T22:15:08.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:07 smithi050 bash[28929]: audit 2024-05-20T22:15:07.008414+0000 mon.a (mon.0) 2306 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:15:08.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:07 smithi050 bash[28929]: audit 2024-05-20T22:15:07.442908+0000 mon.a (mon.0) 2307 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-43"}]': finished 2024-05-20T22:15:08.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:07 smithi050 bash[28929]: cluster 2024-05-20T22:15:07.451079+0000 mon.a (mon.0) 2308 : cluster 0 osdmap e311: 8 total, 8 up, 8 in 2024-05-20T22:15:09.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:15:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:15:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:15:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:09 smithi050 bash[21866]: audit 2024-05-20T22:15:07.875321+0000 mgr.y (mgr.14592) 353 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:09.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:09 smithi050 bash[21866]: cluster 2024-05-20T22:15:08.151770+0000 mgr.y (mgr.14592) 354 : cluster 0 pgmap v479: 396 pgs: 8 unknown, 388 active+clean; 8.4 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:09.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:09 smithi050 bash[21866]: cluster 2024-05-20T22:15:08.452657+0000 mon.a (mon.0) 2309 : cluster 0 osdmap e312: 8 total, 8 up, 8 in 2024-05-20T22:15:09.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:09 smithi050 bash[21866]: audit 2024-05-20T22:15:08.917863+0000 mon.a (mon.0) 2310 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi050-63944-57"}]: dispatch 2024-05-20T22:15:09.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:09 smithi050 bash[21866]: cluster 2024-05-20T22:15:08.918568+0000 mon.a (mon.0) 2311 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:09.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:09 smithi050 bash[28929]: audit 2024-05-20T22:15:07.875321+0000 mgr.y (mgr.14592) 353 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:09.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:09 smithi050 bash[28929]: cluster 2024-05-20T22:15:08.151770+0000 mgr.y (mgr.14592) 354 : cluster 0 pgmap v479: 396 pgs: 8 unknown, 388 active+clean; 8.4 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:09.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:09 smithi050 bash[28929]: cluster 2024-05-20T22:15:08.452657+0000 mon.a (mon.0) 2309 : cluster 0 osdmap e312: 8 total, 8 up, 8 in 2024-05-20T22:15:09.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:09 smithi050 bash[28929]: audit 2024-05-20T22:15:08.917863+0000 mon.a (mon.0) 2310 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi050-63944-57"}]: dispatch 2024-05-20T22:15:09.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:09 smithi050 bash[28929]: cluster 2024-05-20T22:15:08.918568+0000 mon.a (mon.0) 2311 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:09.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:09 smithi145 bash[23893]: audit 2024-05-20T22:15:07.875321+0000 mgr.y (mgr.14592) 353 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:09.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:09 smithi145 bash[23893]: cluster 2024-05-20T22:15:08.151770+0000 mgr.y (mgr.14592) 354 : cluster 0 pgmap v479: 396 pgs: 8 unknown, 388 active+clean; 8.4 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:09.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:09 smithi145 bash[23893]: cluster 2024-05-20T22:15:08.452657+0000 mon.a (mon.0) 2309 : cluster 0 osdmap e312: 8 total, 8 up, 8 in 2024-05-20T22:15:09.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:09 smithi145 bash[23893]: audit 2024-05-20T22:15:08.917863+0000 mon.a (mon.0) 2310 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi050-63944-57"}]: dispatch 2024-05-20T22:15:09.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:09 smithi145 bash[23893]: cluster 2024-05-20T22:15:08.918568+0000 mon.a (mon.0) 2311 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:10.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:10 smithi145 bash[23893]: audit 2024-05-20T22:15:09.449076+0000 mon.a (mon.0) 2312 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi050-63944-57"}]': finished 2024-05-20T22:15:10.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:10 smithi145 bash[23893]: cluster 2024-05-20T22:15:09.456282+0000 mon.a (mon.0) 2313 : cluster 0 osdmap e313: 8 total, 8 up, 8 in 2024-05-20T22:15:10.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:10 smithi145 bash[23893]: audit 2024-05-20T22:15:09.468916+0000 mon.a (mon.0) 2314 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi050-63944-57"}]: dispatch 2024-05-20T22:15:10.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:10 smithi145 bash[23893]: audit 2024-05-20T22:15:09.471390+0000 mon.a (mon.0) 2315 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:15:10.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:10 smithi145 bash[23893]: audit 2024-05-20T22:15:10.453058+0000 mon.a (mon.0) 2316 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi050-63944-57"}]': finished 2024-05-20T22:15:10.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:10 smithi145 bash[23893]: audit 2024-05-20T22:15:10.453212+0000 mon.a (mon.0) 2317 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:15:10.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:10 smithi145 bash[23893]: cluster 2024-05-20T22:15:10.462368+0000 mon.a (mon.0) 2318 : cluster 0 osdmap e314: 8 total, 8 up, 8 in 2024-05-20T22:15:10.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:10 smithi145 bash[23893]: audit 2024-05-20T22:15:10.466345+0000 mon.a (mon.0) 2319 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:15:10.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:10 smithi050 bash[21866]: audit 2024-05-20T22:15:09.449076+0000 mon.a (mon.0) 2312 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi050-63944-57"}]': finished 2024-05-20T22:15:10.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:10 smithi050 bash[21866]: cluster 2024-05-20T22:15:09.456282+0000 mon.a (mon.0) 2313 : cluster 0 osdmap e313: 8 total, 8 up, 8 in 2024-05-20T22:15:10.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:10 smithi050 bash[21866]: audit 2024-05-20T22:15:09.468916+0000 mon.a (mon.0) 2314 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi050-63944-57"}]: dispatch 2024-05-20T22:15:10.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:10 smithi050 bash[21866]: audit 2024-05-20T22:15:09.471390+0000 mon.a (mon.0) 2315 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:15:10.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:10 smithi050 bash[21866]: audit 2024-05-20T22:15:10.453058+0000 mon.a (mon.0) 2316 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi050-63944-57"}]': finished 2024-05-20T22:15:10.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:10 smithi050 bash[21866]: audit 2024-05-20T22:15:10.453212+0000 mon.a (mon.0) 2317 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:15:10.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:10 smithi050 bash[21866]: cluster 2024-05-20T22:15:10.462368+0000 mon.a (mon.0) 2318 : cluster 0 osdmap e314: 8 total, 8 up, 8 in 2024-05-20T22:15:10.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:10 smithi050 bash[21866]: audit 2024-05-20T22:15:10.466345+0000 mon.a (mon.0) 2319 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:15:10.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:10 smithi050 bash[28929]: audit 2024-05-20T22:15:09.449076+0000 mon.a (mon.0) 2312 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi050-63944-57"}]': finished 2024-05-20T22:15:10.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:10 smithi050 bash[28929]: cluster 2024-05-20T22:15:09.456282+0000 mon.a (mon.0) 2313 : cluster 0 osdmap e313: 8 total, 8 up, 8 in 2024-05-20T22:15:10.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:10 smithi050 bash[28929]: audit 2024-05-20T22:15:09.468916+0000 mon.a (mon.0) 2314 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi050-63944-57"}]: dispatch 2024-05-20T22:15:10.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:10 smithi050 bash[28929]: audit 2024-05-20T22:15:09.471390+0000 mon.a (mon.0) 2315 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:15:10.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:10 smithi050 bash[28929]: audit 2024-05-20T22:15:10.453058+0000 mon.a (mon.0) 2316 : audit 1 from='client.? v1:172.21.15.50:0/1930120008' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi050-63944-57"}]': finished 2024-05-20T22:15:10.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:10 smithi050 bash[28929]: audit 2024-05-20T22:15:10.453212+0000 mon.a (mon.0) 2317 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:15:10.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:10 smithi050 bash[28929]: cluster 2024-05-20T22:15:10.462368+0000 mon.a (mon.0) 2318 : cluster 0 osdmap e314: 8 total, 8 up, 8 in 2024-05-20T22:15:10.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:10 smithi050 bash[28929]: audit 2024-05-20T22:15:10.466345+0000 mon.a (mon.0) 2319 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:15:11.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:11 smithi145 bash[23893]: cluster 2024-05-20T22:15:10.154895+0000 mgr.y (mgr.14592) 355 : cluster 0 pgmap v482: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:11.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:11 smithi145 bash[23893]: audit 2024-05-20T22:15:10.523675+0000 mon.c (mon.2) 341 : audit 1 from='client.? v1:172.21.15.50:0/596260378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:11.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:11 smithi145 bash[23893]: audit 2024-05-20T22:15:10.524461+0000 mon.a (mon.0) 2320 : audit 1 from='client.26204 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:11.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:11 smithi145 bash[23893]: audit 2024-05-20T22:15:10.525448+0000 mon.c (mon.2) 342 : audit 1 from='client.? v1:172.21.15.50:0/596260378' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:11.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:11 smithi145 bash[23893]: audit 2024-05-20T22:15:10.525695+0000 mon.a (mon.0) 2321 : audit 1 from='client.26204 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:11.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:11 smithi145 bash[23893]: audit 2024-05-20T22:15:10.526120+0000 mon.c (mon.2) 343 : audit 1 from='client.? v1:172.21.15.50:0/596260378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi050-63944-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:11.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:11 smithi145 bash[23893]: audit 2024-05-20T22:15:10.526366+0000 mon.a (mon.0) 2322 : audit 1 from='client.26204 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi050-63944-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:11.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:11 smithi145 bash[23893]: audit 2024-05-20T22:15:11.456044+0000 mon.a (mon.0) 2323 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-45", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:15:11.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:11 smithi145 bash[23893]: audit 2024-05-20T22:15:11.456220+0000 mon.a (mon.0) 2324 : audit 1 from='client.26204 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi050-63944-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:11.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:11 smithi145 bash[23893]: cluster 2024-05-20T22:15:11.463031+0000 mon.a (mon.0) 2325 : cluster 0 osdmap e315: 8 total, 8 up, 8 in 2024-05-20T22:15:11.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:11 smithi145 bash[23893]: audit 2024-05-20T22:15:11.464193+0000 mon.a (mon.0) 2326 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_count","val": "3"}]: dispatch 2024-05-20T22:15:11.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:11 smithi145 bash[23893]: audit 2024-05-20T22:15:11.465636+0000 mon.c (mon.2) 344 : audit 1 from='client.? v1:172.21.15.50:0/596260378' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi050-63944-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:11.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:11 smithi145 bash[23893]: audit 2024-05-20T22:15:11.466411+0000 mon.a (mon.0) 2327 : audit 1 from='client.26204 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi050-63944-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:11.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:11 smithi050 bash[21866]: cluster 2024-05-20T22:15:10.154895+0000 mgr.y (mgr.14592) 355 : cluster 0 pgmap v482: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:11.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:11 smithi050 bash[21866]: audit 2024-05-20T22:15:10.523675+0000 mon.c (mon.2) 341 : audit 1 from='client.? v1:172.21.15.50:0/596260378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:11.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:11 smithi050 bash[21866]: audit 2024-05-20T22:15:10.524461+0000 mon.a (mon.0) 2320 : audit 1 from='client.26204 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:11.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:11 smithi050 bash[21866]: audit 2024-05-20T22:15:10.525448+0000 mon.c (mon.2) 342 : audit 1 from='client.? v1:172.21.15.50:0/596260378' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:11.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:11 smithi050 bash[21866]: audit 2024-05-20T22:15:10.525695+0000 mon.a (mon.0) 2321 : audit 1 from='client.26204 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:11.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:11 smithi050 bash[21866]: audit 2024-05-20T22:15:10.526120+0000 mon.c (mon.2) 343 : audit 1 from='client.? v1:172.21.15.50:0/596260378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi050-63944-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:11.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:11 smithi050 bash[21866]: audit 2024-05-20T22:15:10.526366+0000 mon.a (mon.0) 2322 : audit 1 from='client.26204 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi050-63944-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:11.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:11 smithi050 bash[21866]: audit 2024-05-20T22:15:11.456044+0000 mon.a (mon.0) 2323 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-45", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:15:11.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:11 smithi050 bash[21866]: audit 2024-05-20T22:15:11.456220+0000 mon.a (mon.0) 2324 : audit 1 from='client.26204 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi050-63944-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:11.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:11 smithi050 bash[21866]: cluster 2024-05-20T22:15:11.463031+0000 mon.a (mon.0) 2325 : cluster 0 osdmap e315: 8 total, 8 up, 8 in 2024-05-20T22:15:11.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:11 smithi050 bash[21866]: audit 2024-05-20T22:15:11.464193+0000 mon.a (mon.0) 2326 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_count","val": "3"}]: dispatch 2024-05-20T22:15:11.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:11 smithi050 bash[21866]: audit 2024-05-20T22:15:11.465636+0000 mon.c (mon.2) 344 : audit 1 from='client.? v1:172.21.15.50:0/596260378' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi050-63944-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:11.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:11 smithi050 bash[21866]: audit 2024-05-20T22:15:11.466411+0000 mon.a (mon.0) 2327 : audit 1 from='client.26204 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi050-63944-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:11.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:11 smithi050 bash[28929]: cluster 2024-05-20T22:15:10.154895+0000 mgr.y (mgr.14592) 355 : cluster 0 pgmap v482: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:11.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:11 smithi050 bash[28929]: audit 2024-05-20T22:15:10.523675+0000 mon.c (mon.2) 341 : audit 1 from='client.? v1:172.21.15.50:0/596260378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:11.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:11 smithi050 bash[28929]: audit 2024-05-20T22:15:10.524461+0000 mon.a (mon.0) 2320 : audit 1 from='client.26204 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:11.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:11 smithi050 bash[28929]: audit 2024-05-20T22:15:10.525448+0000 mon.c (mon.2) 342 : audit 1 from='client.? v1:172.21.15.50:0/596260378' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:11.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:11 smithi050 bash[28929]: audit 2024-05-20T22:15:10.525695+0000 mon.a (mon.0) 2321 : audit 1 from='client.26204 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:11.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:11 smithi050 bash[28929]: audit 2024-05-20T22:15:10.526120+0000 mon.c (mon.2) 343 : audit 1 from='client.? v1:172.21.15.50:0/596260378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi050-63944-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:11.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:11 smithi050 bash[28929]: audit 2024-05-20T22:15:10.526366+0000 mon.a (mon.0) 2322 : audit 1 from='client.26204 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi050-63944-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:11.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:11 smithi050 bash[28929]: audit 2024-05-20T22:15:11.456044+0000 mon.a (mon.0) 2323 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-45", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:15:11.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:11 smithi050 bash[28929]: audit 2024-05-20T22:15:11.456220+0000 mon.a (mon.0) 2324 : audit 1 from='client.26204 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi050-63944-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:11.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:11 smithi050 bash[28929]: cluster 2024-05-20T22:15:11.463031+0000 mon.a (mon.0) 2325 : cluster 0 osdmap e315: 8 total, 8 up, 8 in 2024-05-20T22:15:11.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:11 smithi050 bash[28929]: audit 2024-05-20T22:15:11.464193+0000 mon.a (mon.0) 2326 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_count","val": "3"}]: dispatch 2024-05-20T22:15:11.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:11 smithi050 bash[28929]: audit 2024-05-20T22:15:11.465636+0000 mon.c (mon.2) 344 : audit 1 from='client.? v1:172.21.15.50:0/596260378' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi050-63944-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:11.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:11 smithi050 bash[28929]: audit 2024-05-20T22:15:11.466411+0000 mon.a (mon.0) 2327 : audit 1 from='client.26204 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi050-63944-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:13.895 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:13 smithi145 bash[23893]: cluster 2024-05-20T22:15:12.155897+0000 mgr.y (mgr.14592) 356 : cluster 0 pgmap v485: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:13.895 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:13 smithi145 bash[23893]: audit 2024-05-20T22:15:12.459950+0000 mon.a (mon.0) 2328 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_count","val": "3"}]': finished 2024-05-20T22:15:13.895 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:13 smithi145 bash[23893]: cluster 2024-05-20T22:15:12.930691+0000 mon.a (mon.0) 2329 : cluster 0 osdmap e316: 8 total, 8 up, 8 in 2024-05-20T22:15:13.895 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:13 smithi145 bash[23893]: audit 2024-05-20T22:15:12.932301+0000 mon.a (mon.0) 2330 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_period","val": "3"}]: dispatch 2024-05-20T22:15:13.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:13 smithi050 bash[21866]: cluster 2024-05-20T22:15:12.155897+0000 mgr.y (mgr.14592) 356 : cluster 0 pgmap v485: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:13.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:13 smithi050 bash[21866]: audit 2024-05-20T22:15:12.459950+0000 mon.a (mon.0) 2328 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_count","val": "3"}]': finished 2024-05-20T22:15:13.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:13 smithi050 bash[21866]: cluster 2024-05-20T22:15:12.930691+0000 mon.a (mon.0) 2329 : cluster 0 osdmap e316: 8 total, 8 up, 8 in 2024-05-20T22:15:13.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:13 smithi050 bash[21866]: audit 2024-05-20T22:15:12.932301+0000 mon.a (mon.0) 2330 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_period","val": "3"}]: dispatch 2024-05-20T22:15:13.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:13 smithi050 bash[28929]: cluster 2024-05-20T22:15:12.155897+0000 mgr.y (mgr.14592) 356 : cluster 0 pgmap v485: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:13.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:13 smithi050 bash[28929]: audit 2024-05-20T22:15:12.459950+0000 mon.a (mon.0) 2328 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_count","val": "3"}]': finished 2024-05-20T22:15:13.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:13 smithi050 bash[28929]: cluster 2024-05-20T22:15:12.930691+0000 mon.a (mon.0) 2329 : cluster 0 osdmap e316: 8 total, 8 up, 8 in 2024-05-20T22:15:13.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:13 smithi050 bash[28929]: audit 2024-05-20T22:15:12.932301+0000 mon.a (mon.0) 2330 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_period","val": "3"}]: dispatch 2024-05-20T22:15:14.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:14 smithi145 bash[23893]: audit 2024-05-20T22:15:13.469716+0000 mon.a (mon.0) 2331 : audit 1 from='client.26204 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi050-63944-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi050-63944-58"}]': finished 2024-05-20T22:15:14.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:14 smithi145 bash[23893]: audit 2024-05-20T22:15:13.469885+0000 mon.a (mon.0) 2332 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_period","val": "3"}]': finished 2024-05-20T22:15:14.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:14 smithi145 bash[23893]: cluster 2024-05-20T22:15:13.477073+0000 mon.a (mon.0) 2333 : cluster 0 osdmap e317: 8 total, 8 up, 8 in 2024-05-20T22:15:14.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:14 smithi145 bash[23893]: audit 2024-05-20T22:15:13.480268+0000 mon.a (mon.0) 2334 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:15:14.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:14 smithi145 bash[23893]: cluster 2024-05-20T22:15:14.230264+0000 mon.a (mon.0) 2335 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:14.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:14 smithi050 bash[21866]: audit 2024-05-20T22:15:13.469716+0000 mon.a (mon.0) 2331 : audit 1 from='client.26204 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi050-63944-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi050-63944-58"}]': finished 2024-05-20T22:15:14.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:14 smithi050 bash[21866]: audit 2024-05-20T22:15:13.469885+0000 mon.a (mon.0) 2332 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_period","val": "3"}]': finished 2024-05-20T22:15:14.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:14 smithi050 bash[21866]: cluster 2024-05-20T22:15:13.477073+0000 mon.a (mon.0) 2333 : cluster 0 osdmap e317: 8 total, 8 up, 8 in 2024-05-20T22:15:14.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:14 smithi050 bash[21866]: audit 2024-05-20T22:15:13.480268+0000 mon.a (mon.0) 2334 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:15:14.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:14 smithi050 bash[21866]: cluster 2024-05-20T22:15:14.230264+0000 mon.a (mon.0) 2335 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:14.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:14 smithi050 bash[28929]: audit 2024-05-20T22:15:13.469716+0000 mon.a (mon.0) 2331 : audit 1 from='client.26204 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi050-63944-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi050-63944-58"}]': finished 2024-05-20T22:15:14.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:14 smithi050 bash[28929]: audit 2024-05-20T22:15:13.469885+0000 mon.a (mon.0) 2332 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_period","val": "3"}]': finished 2024-05-20T22:15:14.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:14 smithi050 bash[28929]: cluster 2024-05-20T22:15:13.477073+0000 mon.a (mon.0) 2333 : cluster 0 osdmap e317: 8 total, 8 up, 8 in 2024-05-20T22:15:14.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:14 smithi050 bash[28929]: audit 2024-05-20T22:15:13.480268+0000 mon.a (mon.0) 2334 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:15:14.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:14 smithi050 bash[28929]: cluster 2024-05-20T22:15:14.230264+0000 mon.a (mon.0) 2335 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:15.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:15 smithi145 bash[23893]: cluster 2024-05-20T22:15:14.156890+0000 mgr.y (mgr.14592) 357 : cluster 0 pgmap v488: 396 pgs: 8 unknown, 32 creating+peering, 356 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:15:15.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:15 smithi145 bash[23893]: audit 2024-05-20T22:15:14.479590+0000 mon.a (mon.0) 2336 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:15:15.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:15 smithi145 bash[23893]: cluster 2024-05-20T22:15:14.489220+0000 mon.a (mon.0) 2337 : cluster 0 osdmap e318: 8 total, 8 up, 8 in 2024-05-20T22:15:15.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:15 smithi145 bash[23893]: audit 2024-05-20T22:15:14.490253+0000 mon.a (mon.0) 2338 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-05-20T22:15:15.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:15 smithi050 bash[21866]: cluster 2024-05-20T22:15:14.156890+0000 mgr.y (mgr.14592) 357 : cluster 0 pgmap v488: 396 pgs: 8 unknown, 32 creating+peering, 356 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:15:15.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:15 smithi050 bash[21866]: audit 2024-05-20T22:15:14.479590+0000 mon.a (mon.0) 2336 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:15:15.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:15 smithi050 bash[21866]: cluster 2024-05-20T22:15:14.489220+0000 mon.a (mon.0) 2337 : cluster 0 osdmap e318: 8 total, 8 up, 8 in 2024-05-20T22:15:15.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:15 smithi050 bash[21866]: audit 2024-05-20T22:15:14.490253+0000 mon.a (mon.0) 2338 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-05-20T22:15:15.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:15 smithi050 bash[28929]: cluster 2024-05-20T22:15:14.156890+0000 mgr.y (mgr.14592) 357 : cluster 0 pgmap v488: 396 pgs: 8 unknown, 32 creating+peering, 356 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:15:15.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:15 smithi050 bash[28929]: audit 2024-05-20T22:15:14.479590+0000 mon.a (mon.0) 2336 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:15:15.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:15 smithi050 bash[28929]: cluster 2024-05-20T22:15:14.489220+0000 mon.a (mon.0) 2337 : cluster 0 osdmap e318: 8 total, 8 up, 8 in 2024-05-20T22:15:15.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:15 smithi050 bash[28929]: audit 2024-05-20T22:15:14.490253+0000 mon.a (mon.0) 2338 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-05-20T22:15:16.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:16 smithi145 bash[23893]: audit 2024-05-20T22:15:15.482510+0000 mon.a (mon.0) 2339 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-05-20T22:15:16.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:16 smithi145 bash[23893]: cluster 2024-05-20T22:15:15.489838+0000 mon.a (mon.0) 2340 : cluster 0 osdmap e319: 8 total, 8 up, 8 in 2024-05-20T22:15:16.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:16 smithi145 bash[23893]: audit 2024-05-20T22:15:15.516214+0000 mon.c (mon.2) 345 : audit 1 from='client.? v1:172.21.15.50:0/596260378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:16.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:16 smithi145 bash[23893]: audit 2024-05-20T22:15:15.517591+0000 mon.a (mon.0) 2341 : audit 1 from='client.26204 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:16.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:16 smithi050 bash[28929]: audit 2024-05-20T22:15:15.482510+0000 mon.a (mon.0) 2339 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-05-20T22:15:16.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:16 smithi050 bash[28929]: cluster 2024-05-20T22:15:15.489838+0000 mon.a (mon.0) 2340 : cluster 0 osdmap e319: 8 total, 8 up, 8 in 2024-05-20T22:15:16.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:16 smithi050 bash[28929]: audit 2024-05-20T22:15:15.516214+0000 mon.c (mon.2) 345 : audit 1 from='client.? v1:172.21.15.50:0/596260378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:16.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:16 smithi050 bash[28929]: audit 2024-05-20T22:15:15.517591+0000 mon.a (mon.0) 2341 : audit 1 from='client.26204 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:16.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:16 smithi050 bash[21866]: audit 2024-05-20T22:15:15.482510+0000 mon.a (mon.0) 2339 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-05-20T22:15:16.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:16 smithi050 bash[21866]: cluster 2024-05-20T22:15:15.489838+0000 mon.a (mon.0) 2340 : cluster 0 osdmap e319: 8 total, 8 up, 8 in 2024-05-20T22:15:16.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:16 smithi050 bash[21866]: audit 2024-05-20T22:15:15.516214+0000 mon.c (mon.2) 345 : audit 1 from='client.? v1:172.21.15.50:0/596260378' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:16.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:16 smithi050 bash[21866]: audit 2024-05-20T22:15:15.517591+0000 mon.a (mon.0) 2341 : audit 1 from='client.26204 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:17.877 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:17 smithi145 bash[23893]: cluster 2024-05-20T22:15:16.158047+0000 mgr.y (mgr.14592) 358 : cluster 0 pgmap v491: 388 pgs: 388 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:17.878 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:17 smithi145 bash[23893]: audit 2024-05-20T22:15:16.507238+0000 mon.a (mon.0) 2342 : audit 1 from='client.26204 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi050-63944-58"}]': finished 2024-05-20T22:15:17.878 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:17 smithi145 bash[23893]: cluster 2024-05-20T22:15:16.516687+0000 mon.a (mon.0) 2343 : cluster 0 osdmap e320: 8 total, 8 up, 8 in 2024-05-20T22:15:17.878 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:17 smithi145 bash[23893]: audit 2024-05-20T22:15:16.517594+0000 mon.c (mon.2) 346 : audit 1 from='client.? v1:172.21.15.50:0/596260378' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:17.878 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:17 smithi145 bash[23893]: audit 2024-05-20T22:15:16.518937+0000 mon.a (mon.0) 2344 : audit 1 from='client.26204 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:17.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:17 smithi050 bash[21866]: cluster 2024-05-20T22:15:16.158047+0000 mgr.y (mgr.14592) 358 : cluster 0 pgmap v491: 388 pgs: 388 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:17.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:17 smithi050 bash[21866]: audit 2024-05-20T22:15:16.507238+0000 mon.a (mon.0) 2342 : audit 1 from='client.26204 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi050-63944-58"}]': finished 2024-05-20T22:15:17.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:17 smithi050 bash[21866]: cluster 2024-05-20T22:15:16.516687+0000 mon.a (mon.0) 2343 : cluster 0 osdmap e320: 8 total, 8 up, 8 in 2024-05-20T22:15:17.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:17 smithi050 bash[21866]: audit 2024-05-20T22:15:16.517594+0000 mon.c (mon.2) 346 : audit 1 from='client.? v1:172.21.15.50:0/596260378' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:17.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:17 smithi050 bash[21866]: audit 2024-05-20T22:15:16.518937+0000 mon.a (mon.0) 2344 : audit 1 from='client.26204 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:17.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:17 smithi050 bash[28929]: cluster 2024-05-20T22:15:16.158047+0000 mgr.y (mgr.14592) 358 : cluster 0 pgmap v491: 388 pgs: 388 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:17.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:17 smithi050 bash[28929]: audit 2024-05-20T22:15:16.507238+0000 mon.a (mon.0) 2342 : audit 1 from='client.26204 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi050-63944-58"}]': finished 2024-05-20T22:15:17.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:17 smithi050 bash[28929]: cluster 2024-05-20T22:15:16.516687+0000 mon.a (mon.0) 2343 : cluster 0 osdmap e320: 8 total, 8 up, 8 in 2024-05-20T22:15:17.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:17 smithi050 bash[28929]: audit 2024-05-20T22:15:16.517594+0000 mon.c (mon.2) 346 : audit 1 from='client.? v1:172.21.15.50:0/596260378' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:17.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:17 smithi050 bash[28929]: audit 2024-05-20T22:15:16.518937+0000 mon.a (mon.0) 2344 : audit 1 from='client.26204 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi050-63944-58"}]: dispatch 2024-05-20T22:15:18.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:15:17 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:15:18.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:18 smithi145 bash[23893]: audit 2024-05-20T22:15:17.519457+0000 mon.a (mon.0) 2345 : audit 1 from='client.26204 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi050-63944-58"}]': finished 2024-05-20T22:15:18.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:18 smithi145 bash[23893]: cluster 2024-05-20T22:15:17.525960+0000 mon.a (mon.0) 2346 : cluster 0 osdmap e321: 8 total, 8 up, 8 in 2024-05-20T22:15:18.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:18 smithi145 bash[23893]: audit 2024-05-20T22:15:17.558453+0000 mon.a (mon.0) 2347 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi050-63944-59"}]: dispatch 2024-05-20T22:15:18.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:18 smithi145 bash[23893]: audit 2024-05-20T22:15:17.559931+0000 mon.a (mon.0) 2348 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi050-63944-59"}]: dispatch 2024-05-20T22:15:18.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:18 smithi145 bash[23893]: audit 2024-05-20T22:15:17.560317+0000 mon.a (mon.0) 2349 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi050-63944-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:18.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:18 smithi050 bash[21866]: audit 2024-05-20T22:15:17.519457+0000 mon.a (mon.0) 2345 : audit 1 from='client.26204 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi050-63944-58"}]': finished 2024-05-20T22:15:18.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:18 smithi050 bash[21866]: cluster 2024-05-20T22:15:17.525960+0000 mon.a (mon.0) 2346 : cluster 0 osdmap e321: 8 total, 8 up, 8 in 2024-05-20T22:15:18.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:18 smithi050 bash[21866]: audit 2024-05-20T22:15:17.558453+0000 mon.a (mon.0) 2347 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi050-63944-59"}]: dispatch 2024-05-20T22:15:18.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:18 smithi050 bash[21866]: audit 2024-05-20T22:15:17.559931+0000 mon.a (mon.0) 2348 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi050-63944-59"}]: dispatch 2024-05-20T22:15:18.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:18 smithi050 bash[21866]: audit 2024-05-20T22:15:17.560317+0000 mon.a (mon.0) 2349 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi050-63944-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:18.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:18 smithi050 bash[28929]: audit 2024-05-20T22:15:17.519457+0000 mon.a (mon.0) 2345 : audit 1 from='client.26204 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi050-63944-58"}]': finished 2024-05-20T22:15:18.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:18 smithi050 bash[28929]: cluster 2024-05-20T22:15:17.525960+0000 mon.a (mon.0) 2346 : cluster 0 osdmap e321: 8 total, 8 up, 8 in 2024-05-20T22:15:18.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:18 smithi050 bash[28929]: audit 2024-05-20T22:15:17.558453+0000 mon.a (mon.0) 2347 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi050-63944-59"}]: dispatch 2024-05-20T22:15:18.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:18 smithi050 bash[28929]: audit 2024-05-20T22:15:17.559931+0000 mon.a (mon.0) 2348 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi050-63944-59"}]: dispatch 2024-05-20T22:15:18.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:18 smithi050 bash[28929]: audit 2024-05-20T22:15:17.560317+0000 mon.a (mon.0) 2349 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi050-63944-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:19.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:15:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:15:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:15:20.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:20 smithi145 bash[23893]: audit 2024-05-20T22:15:17.882327+0000 mgr.y (mgr.14592) 359 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:20.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:20 smithi145 bash[23893]: cluster 2024-05-20T22:15:18.159189+0000 mgr.y (mgr.14592) 360 : cluster 0 pgmap v494: 388 pgs: 388 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:20.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:20 smithi145 bash[23893]: audit 2024-05-20T22:15:18.530359+0000 mon.a (mon.0) 2350 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi050-63944-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:20.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:20 smithi145 bash[23893]: cluster 2024-05-20T22:15:18.537798+0000 mon.a (mon.0) 2351 : cluster 0 osdmap e322: 8 total, 8 up, 8 in 2024-05-20T22:15:20.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:20 smithi145 bash[23893]: audit 2024-05-20T22:15:18.539643+0000 mon.a (mon.0) 2352 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi050-63944-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi050-63944-59"}]: dispatch 2024-05-20T22:15:20.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:20 smithi050 bash[28929]: audit 2024-05-20T22:15:17.882327+0000 mgr.y (mgr.14592) 359 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:20.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:20 smithi050 bash[28929]: cluster 2024-05-20T22:15:18.159189+0000 mgr.y (mgr.14592) 360 : cluster 0 pgmap v494: 388 pgs: 388 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:20.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:20 smithi050 bash[28929]: audit 2024-05-20T22:15:18.530359+0000 mon.a (mon.0) 2350 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi050-63944-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:20.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:20 smithi050 bash[28929]: cluster 2024-05-20T22:15:18.537798+0000 mon.a (mon.0) 2351 : cluster 0 osdmap e322: 8 total, 8 up, 8 in 2024-05-20T22:15:20.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:20 smithi050 bash[28929]: audit 2024-05-20T22:15:18.539643+0000 mon.a (mon.0) 2352 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi050-63944-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi050-63944-59"}]: dispatch 2024-05-20T22:15:20.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:20 smithi050 bash[21866]: audit 2024-05-20T22:15:17.882327+0000 mgr.y (mgr.14592) 359 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:20.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:20 smithi050 bash[21866]: cluster 2024-05-20T22:15:18.159189+0000 mgr.y (mgr.14592) 360 : cluster 0 pgmap v494: 388 pgs: 388 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:20.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:20 smithi050 bash[21866]: audit 2024-05-20T22:15:18.530359+0000 mon.a (mon.0) 2350 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi050-63944-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:20.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:20 smithi050 bash[21866]: cluster 2024-05-20T22:15:18.537798+0000 mon.a (mon.0) 2351 : cluster 0 osdmap e322: 8 total, 8 up, 8 in 2024-05-20T22:15:20.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:20 smithi050 bash[21866]: audit 2024-05-20T22:15:18.539643+0000 mon.a (mon.0) 2352 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi050-63944-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi050-63944-59"}]: dispatch 2024-05-20T22:15:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:21 smithi145 bash[23893]: cluster 2024-05-20T22:15:20.009527+0000 mon.a (mon.0) 2353 : cluster 0 osdmap e323: 8 total, 8 up, 8 in 2024-05-20T22:15:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:21 smithi145 bash[23893]: cluster 2024-05-20T22:15:20.162584+0000 mgr.y (mgr.14592) 361 : cluster 0 pgmap v497: 388 pgs: 388 active+clean; 8.4 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-05-20T22:15:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:21 smithi145 bash[23893]: audit 2024-05-20T22:15:20.537404+0000 mon.a (mon.0) 2354 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi050-63944-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi050-63944-59"}]': finished 2024-05-20T22:15:21.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:21 smithi145 bash[23893]: cluster 2024-05-20T22:15:20.544875+0000 mon.a (mon.0) 2355 : cluster 0 osdmap e324: 8 total, 8 up, 8 in 2024-05-20T22:15:21.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:21 smithi050 bash[28929]: cluster 2024-05-20T22:15:20.009527+0000 mon.a (mon.0) 2353 : cluster 0 osdmap e323: 8 total, 8 up, 8 in 2024-05-20T22:15:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:21 smithi050 bash[28929]: cluster 2024-05-20T22:15:20.162584+0000 mgr.y (mgr.14592) 361 : cluster 0 pgmap v497: 388 pgs: 388 active+clean; 8.4 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-05-20T22:15:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:21 smithi050 bash[28929]: audit 2024-05-20T22:15:20.537404+0000 mon.a (mon.0) 2354 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi050-63944-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi050-63944-59"}]': finished 2024-05-20T22:15:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:21 smithi050 bash[28929]: cluster 2024-05-20T22:15:20.544875+0000 mon.a (mon.0) 2355 : cluster 0 osdmap e324: 8 total, 8 up, 8 in 2024-05-20T22:15:21.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:21 smithi050 bash[21866]: cluster 2024-05-20T22:15:20.009527+0000 mon.a (mon.0) 2353 : cluster 0 osdmap e323: 8 total, 8 up, 8 in 2024-05-20T22:15:21.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:21 smithi050 bash[21866]: cluster 2024-05-20T22:15:20.162584+0000 mgr.y (mgr.14592) 361 : cluster 0 pgmap v497: 388 pgs: 388 active+clean; 8.4 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-05-20T22:15:21.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:21 smithi050 bash[21866]: audit 2024-05-20T22:15:20.537404+0000 mon.a (mon.0) 2354 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi050-63944-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi050-63944-59"}]': finished 2024-05-20T22:15:21.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:21 smithi050 bash[21866]: cluster 2024-05-20T22:15:20.544875+0000 mon.a (mon.0) 2355 : cluster 0 osdmap e324: 8 total, 8 up, 8 in 2024-05-20T22:15:22.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:22 smithi145 bash[23893]: cluster 2024-05-20T22:15:21.547352+0000 mon.a (mon.0) 2356 : cluster 0 osdmap e325: 8 total, 8 up, 8 in 2024-05-20T22:15:22.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:22 smithi145 bash[23893]: audit 2024-05-20T22:15:22.041952+0000 mon.a (mon.0) 2357 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:15:22.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:22 smithi050 bash[28929]: cluster 2024-05-20T22:15:21.547352+0000 mon.a (mon.0) 2356 : cluster 0 osdmap e325: 8 total, 8 up, 8 in 2024-05-20T22:15:22.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:22 smithi050 bash[28929]: audit 2024-05-20T22:15:22.041952+0000 mon.a (mon.0) 2357 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:15:22.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:22 smithi050 bash[21866]: cluster 2024-05-20T22:15:21.547352+0000 mon.a (mon.0) 2356 : cluster 0 osdmap e325: 8 total, 8 up, 8 in 2024-05-20T22:15:22.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:22 smithi050 bash[21866]: audit 2024-05-20T22:15:22.041952+0000 mon.a (mon.0) 2357 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:15:23.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:23 smithi145 bash[23893]: cluster 2024-05-20T22:15:22.163648+0000 mgr.y (mgr.14592) 362 : cluster 0 pgmap v500: 396 pgs: 8 unknown, 388 active+clean; 8.4 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-05-20T22:15:23.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:23 smithi145 bash[23893]: cluster 2024-05-20T22:15:22.540264+0000 mon.a (mon.0) 2358 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:23.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:23 smithi145 bash[23893]: cluster 2024-05-20T22:15:22.558753+0000 mon.a (mon.0) 2359 : cluster 0 osdmap e326: 8 total, 8 up, 8 in 2024-05-20T22:15:23.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:23 smithi145 bash[23893]: audit 2024-05-20T22:15:22.561825+0000 mon.a (mon.0) 2360 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi050-63944-59"}]: dispatch 2024-05-20T22:15:23.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:23 smithi050 bash[21866]: cluster 2024-05-20T22:15:22.163648+0000 mgr.y (mgr.14592) 362 : cluster 0 pgmap v500: 396 pgs: 8 unknown, 388 active+clean; 8.4 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-05-20T22:15:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:23 smithi050 bash[21866]: cluster 2024-05-20T22:15:22.540264+0000 mon.a (mon.0) 2358 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:23 smithi050 bash[21866]: cluster 2024-05-20T22:15:22.558753+0000 mon.a (mon.0) 2359 : cluster 0 osdmap e326: 8 total, 8 up, 8 in 2024-05-20T22:15:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:23 smithi050 bash[21866]: audit 2024-05-20T22:15:22.561825+0000 mon.a (mon.0) 2360 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi050-63944-59"}]: dispatch 2024-05-20T22:15:23.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:23 smithi050 bash[28929]: cluster 2024-05-20T22:15:22.163648+0000 mgr.y (mgr.14592) 362 : cluster 0 pgmap v500: 396 pgs: 8 unknown, 388 active+clean; 8.4 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-05-20T22:15:23.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:23 smithi050 bash[28929]: cluster 2024-05-20T22:15:22.540264+0000 mon.a (mon.0) 2358 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:23.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:23 smithi050 bash[28929]: cluster 2024-05-20T22:15:22.558753+0000 mon.a (mon.0) 2359 : cluster 0 osdmap e326: 8 total, 8 up, 8 in 2024-05-20T22:15:23.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:23 smithi050 bash[28929]: audit 2024-05-20T22:15:22.561825+0000 mon.a (mon.0) 2360 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi050-63944-59"}]: dispatch 2024-05-20T22:15:24.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:24 smithi145 bash[23893]: audit 2024-05-20T22:15:23.560130+0000 mon.a (mon.0) 2361 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi050-63944-59"}]': finished 2024-05-20T22:15:24.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:24 smithi145 bash[23893]: cluster 2024-05-20T22:15:23.566740+0000 mon.a (mon.0) 2362 : cluster 0 osdmap e327: 8 total, 8 up, 8 in 2024-05-20T22:15:24.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:24 smithi145 bash[23893]: audit 2024-05-20T22:15:23.568440+0000 mon.a (mon.0) 2363 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi050-63944-59"}]: dispatch 2024-05-20T22:15:24.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:24 smithi050 bash[21866]: audit 2024-05-20T22:15:23.560130+0000 mon.a (mon.0) 2361 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi050-63944-59"}]': finished 2024-05-20T22:15:24.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:24 smithi050 bash[21866]: cluster 2024-05-20T22:15:23.566740+0000 mon.a (mon.0) 2362 : cluster 0 osdmap e327: 8 total, 8 up, 8 in 2024-05-20T22:15:24.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:24 smithi050 bash[21866]: audit 2024-05-20T22:15:23.568440+0000 mon.a (mon.0) 2363 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi050-63944-59"}]: dispatch 2024-05-20T22:15:24.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:24 smithi050 bash[28929]: audit 2024-05-20T22:15:23.560130+0000 mon.a (mon.0) 2361 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi050-63944-59"}]': finished 2024-05-20T22:15:24.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:24 smithi050 bash[28929]: cluster 2024-05-20T22:15:23.566740+0000 mon.a (mon.0) 2362 : cluster 0 osdmap e327: 8 total, 8 up, 8 in 2024-05-20T22:15:24.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:24 smithi050 bash[28929]: audit 2024-05-20T22:15:23.568440+0000 mon.a (mon.0) 2363 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi050-63944-59"}]: dispatch 2024-05-20T22:15:25.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:25 smithi145 bash[23893]: cluster 2024-05-20T22:15:24.164652+0000 mgr.y (mgr.14592) 363 : cluster 0 pgmap v503: 388 pgs: 388 active+clean; 8.4 MiB data, 602 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:15:25.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:25 smithi145 bash[23893]: audit 2024-05-20T22:15:24.574157+0000 mon.a (mon.0) 2364 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi050-63944-59"}]': finished 2024-05-20T22:15:25.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:25 smithi145 bash[23893]: cluster 2024-05-20T22:15:24.583933+0000 mon.a (mon.0) 2365 : cluster 0 osdmap e328: 8 total, 8 up, 8 in 2024-05-20T22:15:25.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:25 smithi050 bash[28929]: cluster 2024-05-20T22:15:24.164652+0000 mgr.y (mgr.14592) 363 : cluster 0 pgmap v503: 388 pgs: 388 active+clean; 8.4 MiB data, 602 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:15:25.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:25 smithi050 bash[28929]: audit 2024-05-20T22:15:24.574157+0000 mon.a (mon.0) 2364 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi050-63944-59"}]': finished 2024-05-20T22:15:25.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:25 smithi050 bash[28929]: cluster 2024-05-20T22:15:24.583933+0000 mon.a (mon.0) 2365 : cluster 0 osdmap e328: 8 total, 8 up, 8 in 2024-05-20T22:15:25.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:25 smithi050 bash[21866]: cluster 2024-05-20T22:15:24.164652+0000 mgr.y (mgr.14592) 363 : cluster 0 pgmap v503: 388 pgs: 388 active+clean; 8.4 MiB data, 602 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:15:25.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:25 smithi050 bash[21866]: audit 2024-05-20T22:15:24.574157+0000 mon.a (mon.0) 2364 : audit 1 from='client.? v1:172.21.15.50:0/4084770884' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi050-63944-59"}]': finished 2024-05-20T22:15:25.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:25 smithi050 bash[21866]: cluster 2024-05-20T22:15:24.583933+0000 mon.a (mon.0) 2365 : cluster 0 osdmap e328: 8 total, 8 up, 8 in 2024-05-20T22:15:26.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:26 smithi145 bash[23893]: cluster 2024-05-20T22:15:25.589355+0000 mon.a (mon.0) 2366 : cluster 0 osdmap e329: 8 total, 8 up, 8 in 2024-05-20T22:15:26.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:26 smithi145 bash[23893]: audit 2024-05-20T22:15:25.600545+0000 mon.a (mon.0) 2367 : audit 1 from='client.? v1:172.21.15.50:0/742258054' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi050-63944-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:15:26.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:26 smithi145 bash[23893]: audit 2024-05-20T22:15:26.581267+0000 mon.a (mon.0) 2368 : audit 1 from='client.? v1:172.21.15.50:0/742258054' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi050-63944-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:15:26.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:26 smithi145 bash[23893]: cluster 2024-05-20T22:15:26.587932+0000 mon.a (mon.0) 2369 : cluster 0 osdmap e330: 8 total, 8 up, 8 in 2024-05-20T22:15:26.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:26 smithi050 bash[21866]: cluster 2024-05-20T22:15:25.589355+0000 mon.a (mon.0) 2366 : cluster 0 osdmap e329: 8 total, 8 up, 8 in 2024-05-20T22:15:26.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:26 smithi050 bash[21866]: audit 2024-05-20T22:15:25.600545+0000 mon.a (mon.0) 2367 : audit 1 from='client.? v1:172.21.15.50:0/742258054' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi050-63944-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:15:26.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:26 smithi050 bash[21866]: audit 2024-05-20T22:15:26.581267+0000 mon.a (mon.0) 2368 : audit 1 from='client.? v1:172.21.15.50:0/742258054' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi050-63944-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:15:26.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:26 smithi050 bash[21866]: cluster 2024-05-20T22:15:26.587932+0000 mon.a (mon.0) 2369 : cluster 0 osdmap e330: 8 total, 8 up, 8 in 2024-05-20T22:15:26.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:26 smithi050 bash[28929]: cluster 2024-05-20T22:15:25.589355+0000 mon.a (mon.0) 2366 : cluster 0 osdmap e329: 8 total, 8 up, 8 in 2024-05-20T22:15:26.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:26 smithi050 bash[28929]: audit 2024-05-20T22:15:25.600545+0000 mon.a (mon.0) 2367 : audit 1 from='client.? v1:172.21.15.50:0/742258054' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi050-63944-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:15:26.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:26 smithi050 bash[28929]: audit 2024-05-20T22:15:26.581267+0000 mon.a (mon.0) 2368 : audit 1 from='client.? v1:172.21.15.50:0/742258054' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi050-63944-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:15:26.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:26 smithi050 bash[28929]: cluster 2024-05-20T22:15:26.587932+0000 mon.a (mon.0) 2369 : cluster 0 osdmap e330: 8 total, 8 up, 8 in 2024-05-20T22:15:27.619 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:7462ddf6:::o.RoundTripAppendPP (3018 ms) 2024-05-20T22:15:27.619 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2024-05-20T22:15:27.619 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (2935 ms) 2024-05-20T22:15:27.619 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-05-20T22:15:27.619 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3035 ms) 2024-05-20T22:15:27.620 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-05-20T22:15:27.620 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3479 ms) 2024-05-20T22:15:27.620 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2024-05-20T22:15:27.620 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: setting pool EIO 2024-05-20T22:15:27.620 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: max_success 98, min_failed 99 2024-05-20T22:15:27.620 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (3557 ms) 2024-05-20T22:15:27.620 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2024-05-20T22:15:27.620 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3495 ms) 2024-05-20T22:15:27.620 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (150522 ms total) 2024-05-20T22:15:27.620 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: 2024-05-20T22:15:27.621 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2024-05-20T22:15:27.621 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-05-20T22:15:27.621 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (2556 ms) 2024-05-20T22:15:27.621 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-05-20T22:15:27.621 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (9052 ms) 2024-05-20T22:15:27.621 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2024-05-20T22:15:27.621 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (15062 ms) 2024-05-20T22:15:27.621 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2024-05-20T22:15:27.621 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3047 ms) 2024-05-20T22:15:27.621 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (29718 ms total) 2024-05-20T22:15:27.622 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: 2024-05-20T22:15:27.622 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2024-05-20T22:15:27.622 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-05-20T22:15:27.622 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3024 ms) 2024-05-20T22:15:27.622 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3024 ms total) 2024-05-20T22:15:27.622 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: 2024-05-20T22:15:27.622 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2024-05-20T22:15:27.622 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2024-05-20T22:15:27.623 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (13910 ms) 2024-05-20T22:15:27.623 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2024-05-20T22:15:27.623 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (6967 ms) 2024-05-20T22:15:27.623 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2024-05-20T22:15:27.623 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (7400 ms) 2024-05-20T22:15:27.623 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2024-05-20T22:15:27.623 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7083 ms) 2024-05-20T22:15:27.623 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2024-05-20T22:15:27.623 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3011 ms) 2024-05-20T22:15:27.623 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-05-20T22:15:27.624 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (7026 ms) 2024-05-20T22:15:27.624 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-05-20T22:15:27.624 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (6879 ms) 2024-05-20T22:15:27.624 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2024-05-20T22:15:27.624 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (7034 ms) 2024-05-20T22:15:27.624 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2024-05-20T22:15:27.624 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7080 ms) 2024-05-20T22:15:27.625 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2024-05-20T22:15:27.625 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7071 ms) 2024-05-20T22:15:27.625 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2024-05-20T22:15:27.625 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (7032 ms) 2024-05-20T22:15:27.625 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2024-05-20T22:15:27.625 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7055 ms) 2024-05-20T22:15:27.625 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-05-20T22:15:27.625 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7058 ms) 2024-05-20T22:15:27.625 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-05-20T22:15:27.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:27 smithi145 bash[23893]: cluster 2024-05-20T22:15:26.165700+0000 mgr.y (mgr.14592) 364 : cluster 0 pgmap v506: 420 pgs: 32 unknown, 388 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-05-20T22:15:27.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:27 smithi145 bash[23893]: cluster 2024-05-20T22:15:27.617870+0000 mon.a (mon.0) 2370 : cluster 0 osdmap e331: 8 total, 8 up, 8 in 2024-05-20T22:15:27.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:27 smithi050 bash[21866]: cluster 2024-05-20T22:15:26.165700+0000 mgr.y (mgr.14592) 364 : cluster 0 pgmap v506: 420 pgs: 32 unknown, 388 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-05-20T22:15:27.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:27 smithi050 bash[21866]: cluster 2024-05-20T22:15:27.617870+0000 mon.a (mon.0) 2370 : cluster 0 osdmap e331: 8 total, 8 up, 8 in 2024-05-20T22:15:27.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:27 smithi050 bash[28929]: cluster 2024-05-20T22:15:26.165700+0000 mgr.y (mgr.14592) 364 : cluster 0 pgmap v506: 420 pgs: 32 unknown, 388 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-05-20T22:15:27.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:27 smithi050 bash[28929]: cluster 2024-05-20T22:15:27.617870+0000 mon.a (mon.0) 2370 : cluster 0 osdmap e331: 8 total, 8 up, 8 in 2024-05-20T22:15:28.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:15:27 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:15:28.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:28 smithi050 bash[21866]: audit 2024-05-20T22:15:27.659786+0000 mon.c (mon.2) 347 : audit 1 from='client.? v1:172.21.15.50:0/302281298' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:28.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:28 smithi050 bash[21866]: audit 2024-05-20T22:15:27.660447+0000 mon.a (mon.0) 2371 : audit 1 from='client.26222 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:28.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:28 smithi050 bash[21866]: audit 2024-05-20T22:15:27.661351+0000 mon.c (mon.2) 348 : audit 1 from='client.? v1:172.21.15.50:0/302281298' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:28.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:28 smithi050 bash[21866]: audit 2024-05-20T22:15:27.661596+0000 mon.a (mon.0) 2372 : audit 1 from='client.26222 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:28.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:28 smithi050 bash[21866]: audit 2024-05-20T22:15:27.662046+0000 mon.c (mon.2) 349 : audit 1 from='client.? v1:172.21.15.50:0/302281298' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi050-63944-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:28.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:28 smithi050 bash[21866]: audit 2024-05-20T22:15:27.662304+0000 mon.a (mon.0) 2373 : audit 1 from='client.26222 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi050-63944-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:28.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:28 smithi050 bash[21866]: audit 2024-05-20T22:15:27.726438+0000 mon.a (mon.0) 2374 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:15:28.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:28 smithi050 bash[21866]: audit 2024-05-20T22:15:27.726942+0000 mon.a (mon.0) 2375 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-45"}]: dispatch 2024-05-20T22:15:28.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:28 smithi050 bash[28929]: audit 2024-05-20T22:15:27.659786+0000 mon.c (mon.2) 347 : audit 1 from='client.? v1:172.21.15.50:0/302281298' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:28.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:28 smithi050 bash[28929]: audit 2024-05-20T22:15:27.660447+0000 mon.a (mon.0) 2371 : audit 1 from='client.26222 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:28.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:28 smithi050 bash[28929]: audit 2024-05-20T22:15:27.661351+0000 mon.c (mon.2) 348 : audit 1 from='client.? v1:172.21.15.50:0/302281298' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:28.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:28 smithi050 bash[28929]: audit 2024-05-20T22:15:27.661596+0000 mon.a (mon.0) 2372 : audit 1 from='client.26222 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:28.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:28 smithi050 bash[28929]: audit 2024-05-20T22:15:27.662046+0000 mon.c (mon.2) 349 : audit 1 from='client.? v1:172.21.15.50:0/302281298' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi050-63944-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:28.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:28 smithi050 bash[28929]: audit 2024-05-20T22:15:27.662304+0000 mon.a (mon.0) 2373 : audit 1 from='client.26222 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi050-63944-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:28.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:28 smithi050 bash[28929]: audit 2024-05-20T22:15:27.726438+0000 mon.a (mon.0) 2374 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:15:28.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:28 smithi050 bash[28929]: audit 2024-05-20T22:15:27.726942+0000 mon.a (mon.0) 2375 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-45"}]: dispatch 2024-05-20T22:15:29.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:28 smithi145 bash[23893]: audit 2024-05-20T22:15:27.659786+0000 mon.c (mon.2) 347 : audit 1 from='client.? v1:172.21.15.50:0/302281298' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:29.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:28 smithi145 bash[23893]: audit 2024-05-20T22:15:27.660447+0000 mon.a (mon.0) 2371 : audit 1 from='client.26222 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:29.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:28 smithi145 bash[23893]: audit 2024-05-20T22:15:27.661351+0000 mon.c (mon.2) 348 : audit 1 from='client.? v1:172.21.15.50:0/302281298' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:29.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:28 smithi145 bash[23893]: audit 2024-05-20T22:15:27.661596+0000 mon.a (mon.0) 2372 : audit 1 from='client.26222 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:29.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:28 smithi145 bash[23893]: audit 2024-05-20T22:15:27.662046+0000 mon.c (mon.2) 349 : audit 1 from='client.? v1:172.21.15.50:0/302281298' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi050-63944-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:29.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:28 smithi145 bash[23893]: audit 2024-05-20T22:15:27.662304+0000 mon.a (mon.0) 2373 : audit 1 from='client.26222 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi050-63944-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:29.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:28 smithi145 bash[23893]: audit 2024-05-20T22:15:27.726438+0000 mon.a (mon.0) 2374 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:15:29.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:28 smithi145 bash[23893]: audit 2024-05-20T22:15:27.726942+0000 mon.a (mon.0) 2375 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-45"}]: dispatch 2024-05-20T22:15:29.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:15:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:15:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:15:30.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:30 smithi145 bash[23893]: audit 2024-05-20T22:15:27.891276+0000 mgr.y (mgr.14592) 365 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:30.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:30 smithi145 bash[23893]: cluster 2024-05-20T22:15:28.166694+0000 mgr.y (mgr.14592) 366 : cluster 0 pgmap v509: 388 pgs: 388 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-05-20T22:15:30.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:30 smithi145 bash[23893]: cluster 2024-05-20T22:15:28.628741+0000 mon.a (mon.0) 2376 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:30.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:30 smithi145 bash[23893]: audit 2024-05-20T22:15:28.630265+0000 mon.a (mon.0) 2377 : audit 1 from='client.26222 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi050-63944-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:30.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:30 smithi145 bash[23893]: audit 2024-05-20T22:15:28.630487+0000 mon.a (mon.0) 2378 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-45"}]': finished 2024-05-20T22:15:30.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:30 smithi145 bash[23893]: cluster 2024-05-20T22:15:28.637356+0000 mon.a (mon.0) 2379 : cluster 0 osdmap e332: 8 total, 8 up, 8 in 2024-05-20T22:15:30.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:30 smithi145 bash[23893]: audit 2024-05-20T22:15:28.640880+0000 mon.c (mon.2) 350 : audit 1 from='client.? v1:172.21.15.50:0/302281298' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi050-63944-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:30.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:30 smithi145 bash[23893]: audit 2024-05-20T22:15:28.646739+0000 mon.a (mon.0) 2380 : audit 1 from='client.26222 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi050-63944-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:30.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:30 smithi050 bash[21866]: audit 2024-05-20T22:15:27.891276+0000 mgr.y (mgr.14592) 365 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:30.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:30 smithi050 bash[21866]: cluster 2024-05-20T22:15:28.166694+0000 mgr.y (mgr.14592) 366 : cluster 0 pgmap v509: 388 pgs: 388 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-05-20T22:15:30.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:30 smithi050 bash[21866]: cluster 2024-05-20T22:15:28.628741+0000 mon.a (mon.0) 2376 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:30.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:30 smithi050 bash[21866]: audit 2024-05-20T22:15:28.630265+0000 mon.a (mon.0) 2377 : audit 1 from='client.26222 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi050-63944-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:30.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:30 smithi050 bash[21866]: audit 2024-05-20T22:15:28.630487+0000 mon.a (mon.0) 2378 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-45"}]': finished 2024-05-20T22:15:30.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:30 smithi050 bash[21866]: cluster 2024-05-20T22:15:28.637356+0000 mon.a (mon.0) 2379 : cluster 0 osdmap e332: 8 total, 8 up, 8 in 2024-05-20T22:15:30.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:30 smithi050 bash[21866]: audit 2024-05-20T22:15:28.640880+0000 mon.c (mon.2) 350 : audit 1 from='client.? v1:172.21.15.50:0/302281298' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi050-63944-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:30.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:30 smithi050 bash[21866]: audit 2024-05-20T22:15:28.646739+0000 mon.a (mon.0) 2380 : audit 1 from='client.26222 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi050-63944-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:30.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:30 smithi050 bash[28929]: audit 2024-05-20T22:15:27.891276+0000 mgr.y (mgr.14592) 365 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:30.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:30 smithi050 bash[28929]: cluster 2024-05-20T22:15:28.166694+0000 mgr.y (mgr.14592) 366 : cluster 0 pgmap v509: 388 pgs: 388 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-05-20T22:15:30.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:30 smithi050 bash[28929]: cluster 2024-05-20T22:15:28.628741+0000 mon.a (mon.0) 2376 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:30.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:30 smithi050 bash[28929]: audit 2024-05-20T22:15:28.630265+0000 mon.a (mon.0) 2377 : audit 1 from='client.26222 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi050-63944-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:30.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:30 smithi050 bash[28929]: audit 2024-05-20T22:15:28.630487+0000 mon.a (mon.0) 2378 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-45"}]': finished 2024-05-20T22:15:30.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:30 smithi050 bash[28929]: cluster 2024-05-20T22:15:28.637356+0000 mon.a (mon.0) 2379 : cluster 0 osdmap e332: 8 total, 8 up, 8 in 2024-05-20T22:15:30.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:30 smithi050 bash[28929]: audit 2024-05-20T22:15:28.640880+0000 mon.c (mon.2) 350 : audit 1 from='client.? v1:172.21.15.50:0/302281298' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi050-63944-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:30.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:30 smithi050 bash[28929]: audit 2024-05-20T22:15:28.646739+0000 mon.a (mon.0) 2380 : audit 1 from='client.26222 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi050-63944-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:31.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:31 smithi145 bash[23893]: cluster 2024-05-20T22:15:30.105087+0000 mon.a (mon.0) 2381 : cluster 0 osdmap e333: 8 total, 8 up, 8 in 2024-05-20T22:15:31.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:31 smithi145 bash[23893]: cluster 2024-05-20T22:15:30.169439+0000 mgr.y (mgr.14592) 367 : cluster 0 pgmap v512: 356 pgs: 356 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:31.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:31 smithi145 bash[23893]: audit 2024-05-20T22:15:30.637860+0000 mon.a (mon.0) 2382 : audit 1 from='client.26222 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi050-63944-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi050-63944-61"}]': finished 2024-05-20T22:15:31.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:31 smithi145 bash[23893]: cluster 2024-05-20T22:15:30.645475+0000 mon.a (mon.0) 2383 : cluster 0 osdmap e334: 8 total, 8 up, 8 in 2024-05-20T22:15:31.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:31 smithi145 bash[23893]: audit 2024-05-20T22:15:30.655827+0000 mon.a (mon.0) 2384 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:15:31.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:31 smithi050 bash[21866]: cluster 2024-05-20T22:15:30.105087+0000 mon.a (mon.0) 2381 : cluster 0 osdmap e333: 8 total, 8 up, 8 in 2024-05-20T22:15:31.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:31 smithi050 bash[21866]: cluster 2024-05-20T22:15:30.169439+0000 mgr.y (mgr.14592) 367 : cluster 0 pgmap v512: 356 pgs: 356 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:31.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:31 smithi050 bash[21866]: audit 2024-05-20T22:15:30.637860+0000 mon.a (mon.0) 2382 : audit 1 from='client.26222 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi050-63944-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi050-63944-61"}]': finished 2024-05-20T22:15:31.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:31 smithi050 bash[21866]: cluster 2024-05-20T22:15:30.645475+0000 mon.a (mon.0) 2383 : cluster 0 osdmap e334: 8 total, 8 up, 8 in 2024-05-20T22:15:31.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:31 smithi050 bash[21866]: audit 2024-05-20T22:15:30.655827+0000 mon.a (mon.0) 2384 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:15:31.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:31 smithi050 bash[28929]: cluster 2024-05-20T22:15:30.105087+0000 mon.a (mon.0) 2381 : cluster 0 osdmap e333: 8 total, 8 up, 8 in 2024-05-20T22:15:31.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:31 smithi050 bash[28929]: cluster 2024-05-20T22:15:30.169439+0000 mgr.y (mgr.14592) 367 : cluster 0 pgmap v512: 356 pgs: 356 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:31.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:31 smithi050 bash[28929]: audit 2024-05-20T22:15:30.637860+0000 mon.a (mon.0) 2382 : audit 1 from='client.26222 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi050-63944-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi050-63944-61"}]': finished 2024-05-20T22:15:31.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:31 smithi050 bash[28929]: cluster 2024-05-20T22:15:30.645475+0000 mon.a (mon.0) 2383 : cluster 0 osdmap e334: 8 total, 8 up, 8 in 2024-05-20T22:15:31.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:31 smithi050 bash[28929]: audit 2024-05-20T22:15:30.655827+0000 mon.a (mon.0) 2384 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:15:32.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:32 smithi050 bash[21866]: audit 2024-05-20T22:15:31.640866+0000 mon.a (mon.0) 2385 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:15:32.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:32 smithi050 bash[21866]: cluster 2024-05-20T22:15:31.648996+0000 mon.a (mon.0) 2386 : cluster 0 osdmap e335: 8 total, 8 up, 8 in 2024-05-20T22:15:32.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:32 smithi050 bash[21866]: audit 2024-05-20T22:15:31.742167+0000 mon.a (mon.0) 2387 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:15:32.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:32 smithi050 bash[28929]: audit 2024-05-20T22:15:31.640866+0000 mon.a (mon.0) 2385 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:15:32.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:32 smithi050 bash[28929]: cluster 2024-05-20T22:15:31.648996+0000 mon.a (mon.0) 2386 : cluster 0 osdmap e335: 8 total, 8 up, 8 in 2024-05-20T22:15:32.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:32 smithi050 bash[28929]: audit 2024-05-20T22:15:31.742167+0000 mon.a (mon.0) 2387 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:15:33.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:32 smithi145 bash[23893]: audit 2024-05-20T22:15:31.640866+0000 mon.a (mon.0) 2385 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:15:33.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:32 smithi145 bash[23893]: cluster 2024-05-20T22:15:31.648996+0000 mon.a (mon.0) 2386 : cluster 0 osdmap e335: 8 total, 8 up, 8 in 2024-05-20T22:15:33.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:32 smithi145 bash[23893]: audit 2024-05-20T22:15:31.742167+0000 mon.a (mon.0) 2387 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:15:33.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:33 smithi050 bash[21866]: cluster 2024-05-20T22:15:32.170440+0000 mgr.y (mgr.14592) 368 : cluster 0 pgmap v515: 396 pgs: 40 unknown, 356 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:33.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:33 smithi050 bash[21866]: audit 2024-05-20T22:15:32.650399+0000 mon.a (mon.0) 2388 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-47", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:15:33.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:33 smithi050 bash[21866]: cluster 2024-05-20T22:15:32.660167+0000 mon.a (mon.0) 2389 : cluster 0 osdmap e336: 8 total, 8 up, 8 in 2024-05-20T22:15:33.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:33 smithi050 bash[21866]: audit 2024-05-20T22:15:32.661996+0000 mon.c (mon.2) 351 : audit 1 from='client.? v1:172.21.15.50:0/302281298' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:33.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:33 smithi050 bash[21866]: audit 2024-05-20T22:15:32.663432+0000 mon.a (mon.0) 2390 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-47"}]: dispatch 2024-05-20T22:15:33.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:33 smithi050 bash[21866]: audit 2024-05-20T22:15:32.664098+0000 mon.a (mon.0) 2391 : audit 1 from='client.26222 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:33.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:33 smithi050 bash[28929]: cluster 2024-05-20T22:15:32.170440+0000 mgr.y (mgr.14592) 368 : cluster 0 pgmap v515: 396 pgs: 40 unknown, 356 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:33.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:33 smithi050 bash[28929]: audit 2024-05-20T22:15:32.650399+0000 mon.a (mon.0) 2388 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-47", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:15:33.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:33 smithi050 bash[28929]: cluster 2024-05-20T22:15:32.660167+0000 mon.a (mon.0) 2389 : cluster 0 osdmap e336: 8 total, 8 up, 8 in 2024-05-20T22:15:33.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:33 smithi050 bash[28929]: audit 2024-05-20T22:15:32.661996+0000 mon.c (mon.2) 351 : audit 1 from='client.? v1:172.21.15.50:0/302281298' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:33.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:33 smithi050 bash[28929]: audit 2024-05-20T22:15:32.663432+0000 mon.a (mon.0) 2390 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-47"}]: dispatch 2024-05-20T22:15:33.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:33 smithi050 bash[28929]: audit 2024-05-20T22:15:32.664098+0000 mon.a (mon.0) 2391 : audit 1 from='client.26222 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:34.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:33 smithi145 bash[23893]: cluster 2024-05-20T22:15:32.170440+0000 mgr.y (mgr.14592) 368 : cluster 0 pgmap v515: 396 pgs: 40 unknown, 356 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:34.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:33 smithi145 bash[23893]: audit 2024-05-20T22:15:32.650399+0000 mon.a (mon.0) 2388 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-47", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:15:34.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:33 smithi145 bash[23893]: cluster 2024-05-20T22:15:32.660167+0000 mon.a (mon.0) 2389 : cluster 0 osdmap e336: 8 total, 8 up, 8 in 2024-05-20T22:15:34.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:33 smithi145 bash[23893]: audit 2024-05-20T22:15:32.661996+0000 mon.c (mon.2) 351 : audit 1 from='client.? v1:172.21.15.50:0/302281298' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:34.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:33 smithi145 bash[23893]: audit 2024-05-20T22:15:32.663432+0000 mon.a (mon.0) 2390 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-47"}]: dispatch 2024-05-20T22:15:34.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:33 smithi145 bash[23893]: audit 2024-05-20T22:15:32.664098+0000 mon.a (mon.0) 2391 : audit 1 from='client.26222 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:34.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:34 smithi050 bash[21866]: audit 2024-05-20T22:15:33.653207+0000 mon.a (mon.0) 2392 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-47"}]': finished 2024-05-20T22:15:34.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:34 smithi050 bash[21866]: audit 2024-05-20T22:15:33.653419+0000 mon.a (mon.0) 2393 : audit 1 from='client.26222 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi050-63944-61"}]': finished 2024-05-20T22:15:34.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:34 smithi050 bash[21866]: cluster 2024-05-20T22:15:33.660667+0000 mon.a (mon.0) 2394 : cluster 0 osdmap e337: 8 total, 8 up, 8 in 2024-05-20T22:15:34.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:34 smithi050 bash[21866]: audit 2024-05-20T22:15:33.661898+0000 mon.a (mon.0) 2395 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-47", "mode": "writeback"}]: dispatch 2024-05-20T22:15:34.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:34 smithi050 bash[21866]: audit 2024-05-20T22:15:33.662746+0000 mon.c (mon.2) 352 : audit 1 from='client.? v1:172.21.15.50:0/302281298' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:34.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:34 smithi050 bash[21866]: audit 2024-05-20T22:15:33.665452+0000 mon.a (mon.0) 2396 : audit 1 from='client.26222 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:34.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:34 smithi050 bash[21866]: cluster 2024-05-20T22:15:34.235011+0000 mon.a (mon.0) 2397 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:34.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:34 smithi050 bash[21866]: cluster 2024-05-20T22:15:34.654499+0000 mon.a (mon.0) 2398 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:15:34.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:34 smithi050 bash[21866]: audit 2024-05-20T22:15:34.656859+0000 mon.a (mon.0) 2399 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-47", "mode": "writeback"}]': finished 2024-05-20T22:15:34.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:34 smithi050 bash[21866]: audit 2024-05-20T22:15:34.656981+0000 mon.a (mon.0) 2400 : audit 1 from='client.26222 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi050-63944-61"}]': finished 2024-05-20T22:15:34.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:34 smithi050 bash[21866]: cluster 2024-05-20T22:15:34.665398+0000 mon.a (mon.0) 2401 : cluster 0 osdmap e338: 8 total, 8 up, 8 in 2024-05-20T22:15:34.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:34 smithi050 bash[28929]: audit 2024-05-20T22:15:33.653207+0000 mon.a (mon.0) 2392 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-47"}]': finished 2024-05-20T22:15:34.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:34 smithi050 bash[28929]: audit 2024-05-20T22:15:33.653419+0000 mon.a (mon.0) 2393 : audit 1 from='client.26222 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi050-63944-61"}]': finished 2024-05-20T22:15:34.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:34 smithi050 bash[28929]: cluster 2024-05-20T22:15:33.660667+0000 mon.a (mon.0) 2394 : cluster 0 osdmap e337: 8 total, 8 up, 8 in 2024-05-20T22:15:34.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:34 smithi050 bash[28929]: audit 2024-05-20T22:15:33.661898+0000 mon.a (mon.0) 2395 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-47", "mode": "writeback"}]: dispatch 2024-05-20T22:15:34.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:34 smithi050 bash[28929]: audit 2024-05-20T22:15:33.662746+0000 mon.c (mon.2) 352 : audit 1 from='client.? v1:172.21.15.50:0/302281298' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:34.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:34 smithi050 bash[28929]: audit 2024-05-20T22:15:33.665452+0000 mon.a (mon.0) 2396 : audit 1 from='client.26222 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:34.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:34 smithi050 bash[28929]: cluster 2024-05-20T22:15:34.235011+0000 mon.a (mon.0) 2397 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:34.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:34 smithi050 bash[28929]: cluster 2024-05-20T22:15:34.654499+0000 mon.a (mon.0) 2398 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:15:34.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:34 smithi050 bash[28929]: audit 2024-05-20T22:15:34.656859+0000 mon.a (mon.0) 2399 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-47", "mode": "writeback"}]': finished 2024-05-20T22:15:34.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:34 smithi050 bash[28929]: audit 2024-05-20T22:15:34.656981+0000 mon.a (mon.0) 2400 : audit 1 from='client.26222 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi050-63944-61"}]': finished 2024-05-20T22:15:34.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:34 smithi050 bash[28929]: cluster 2024-05-20T22:15:34.665398+0000 mon.a (mon.0) 2401 : cluster 0 osdmap e338: 8 total, 8 up, 8 in 2024-05-20T22:15:35.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:34 smithi145 bash[23893]: audit 2024-05-20T22:15:33.653207+0000 mon.a (mon.0) 2392 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-47"}]': finished 2024-05-20T22:15:35.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:34 smithi145 bash[23893]: audit 2024-05-20T22:15:33.653419+0000 mon.a (mon.0) 2393 : audit 1 from='client.26222 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi050-63944-61"}]': finished 2024-05-20T22:15:35.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:34 smithi145 bash[23893]: cluster 2024-05-20T22:15:33.660667+0000 mon.a (mon.0) 2394 : cluster 0 osdmap e337: 8 total, 8 up, 8 in 2024-05-20T22:15:35.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:34 smithi145 bash[23893]: audit 2024-05-20T22:15:33.661898+0000 mon.a (mon.0) 2395 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-47", "mode": "writeback"}]: dispatch 2024-05-20T22:15:35.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:34 smithi145 bash[23893]: audit 2024-05-20T22:15:33.662746+0000 mon.c (mon.2) 352 : audit 1 from='client.? v1:172.21.15.50:0/302281298' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:35.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:34 smithi145 bash[23893]: audit 2024-05-20T22:15:33.665452+0000 mon.a (mon.0) 2396 : audit 1 from='client.26222 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi050-63944-61"}]: dispatch 2024-05-20T22:15:35.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:34 smithi145 bash[23893]: cluster 2024-05-20T22:15:34.235011+0000 mon.a (mon.0) 2397 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:35.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:34 smithi145 bash[23893]: cluster 2024-05-20T22:15:34.654499+0000 mon.a (mon.0) 2398 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:15:35.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:34 smithi145 bash[23893]: audit 2024-05-20T22:15:34.656859+0000 mon.a (mon.0) 2399 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-47", "mode": "writeback"}]': finished 2024-05-20T22:15:35.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:34 smithi145 bash[23893]: audit 2024-05-20T22:15:34.656981+0000 mon.a (mon.0) 2400 : audit 1 from='client.26222 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi050-63944-61"}]': finished 2024-05-20T22:15:35.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:34 smithi145 bash[23893]: cluster 2024-05-20T22:15:34.665398+0000 mon.a (mon.0) 2401 : cluster 0 osdmap e338: 8 total, 8 up, 8 in 2024-05-20T22:15:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:35 smithi050 bash[21866]: cluster 2024-05-20T22:15:34.171704+0000 mgr.y (mgr.14592) 369 : cluster 0 pgmap v518: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:15:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:35 smithi050 bash[21866]: audit 2024-05-20T22:15:34.668033+0000 mon.a (mon.0) 2402 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:15:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:35 smithi050 bash[21866]: audit 2024-05-20T22:15:34.704268+0000 mon.a (mon.0) 2403 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi050-63944-62"}]: dispatch 2024-05-20T22:15:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:35 smithi050 bash[21866]: audit 2024-05-20T22:15:34.705814+0000 mon.a (mon.0) 2404 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi050-63944-62"}]: dispatch 2024-05-20T22:15:35.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:35 smithi050 bash[21866]: audit 2024-05-20T22:15:34.706191+0000 mon.a (mon.0) 2405 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi050-63944-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:35.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:35 smithi050 bash[21866]: audit 2024-05-20T22:15:35.659737+0000 mon.a (mon.0) 2406 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:15:35.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:35 smithi050 bash[21866]: audit 2024-05-20T22:15:35.659958+0000 mon.a (mon.0) 2407 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi050-63944-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:35.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:35 smithi050 bash[21866]: cluster 2024-05-20T22:15:35.667345+0000 mon.a (mon.0) 2408 : cluster 0 osdmap e339: 8 total, 8 up, 8 in 2024-05-20T22:15:35.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:35 smithi050 bash[21866]: audit 2024-05-20T22:15:35.668299+0000 mon.a (mon.0) 2409 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:15:35.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:35 smithi050 bash[21866]: audit 2024-05-20T22:15:35.668874+0000 mon.a (mon.0) 2410 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi050-63944-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi050-63944-62"}]: dispatch 2024-05-20T22:15:35.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:35 smithi050 bash[28929]: cluster 2024-05-20T22:15:34.171704+0000 mgr.y (mgr.14592) 369 : cluster 0 pgmap v518: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:15:35.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:35 smithi050 bash[28929]: audit 2024-05-20T22:15:34.668033+0000 mon.a (mon.0) 2402 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:15:35.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:35 smithi050 bash[28929]: audit 2024-05-20T22:15:34.704268+0000 mon.a (mon.0) 2403 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi050-63944-62"}]: dispatch 2024-05-20T22:15:35.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:35 smithi050 bash[28929]: audit 2024-05-20T22:15:34.705814+0000 mon.a (mon.0) 2404 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi050-63944-62"}]: dispatch 2024-05-20T22:15:35.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:35 smithi050 bash[28929]: audit 2024-05-20T22:15:34.706191+0000 mon.a (mon.0) 2405 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi050-63944-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:35.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:35 smithi050 bash[28929]: audit 2024-05-20T22:15:35.659737+0000 mon.a (mon.0) 2406 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:15:35.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:35 smithi050 bash[28929]: audit 2024-05-20T22:15:35.659958+0000 mon.a (mon.0) 2407 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi050-63944-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:35.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:35 smithi050 bash[28929]: cluster 2024-05-20T22:15:35.667345+0000 mon.a (mon.0) 2408 : cluster 0 osdmap e339: 8 total, 8 up, 8 in 2024-05-20T22:15:35.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:35 smithi050 bash[28929]: audit 2024-05-20T22:15:35.668299+0000 mon.a (mon.0) 2409 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:15:35.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:35 smithi050 bash[28929]: audit 2024-05-20T22:15:35.668874+0000 mon.a (mon.0) 2410 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi050-63944-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi050-63944-62"}]: dispatch 2024-05-20T22:15:36.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:35 smithi145 bash[23893]: cluster 2024-05-20T22:15:34.171704+0000 mgr.y (mgr.14592) 369 : cluster 0 pgmap v518: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:15:36.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:35 smithi145 bash[23893]: audit 2024-05-20T22:15:34.668033+0000 mon.a (mon.0) 2402 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:15:36.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:35 smithi145 bash[23893]: audit 2024-05-20T22:15:34.704268+0000 mon.a (mon.0) 2403 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi050-63944-62"}]: dispatch 2024-05-20T22:15:36.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:35 smithi145 bash[23893]: audit 2024-05-20T22:15:34.705814+0000 mon.a (mon.0) 2404 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi050-63944-62"}]: dispatch 2024-05-20T22:15:36.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:35 smithi145 bash[23893]: audit 2024-05-20T22:15:34.706191+0000 mon.a (mon.0) 2405 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi050-63944-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:36.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:35 smithi145 bash[23893]: audit 2024-05-20T22:15:35.659737+0000 mon.a (mon.0) 2406 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:15:36.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:35 smithi145 bash[23893]: audit 2024-05-20T22:15:35.659958+0000 mon.a (mon.0) 2407 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi050-63944-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:36.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:35 smithi145 bash[23893]: cluster 2024-05-20T22:15:35.667345+0000 mon.a (mon.0) 2408 : cluster 0 osdmap e339: 8 total, 8 up, 8 in 2024-05-20T22:15:36.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:35 smithi145 bash[23893]: audit 2024-05-20T22:15:35.668299+0000 mon.a (mon.0) 2409 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:15:36.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:35 smithi145 bash[23893]: audit 2024-05-20T22:15:35.668874+0000 mon.a (mon.0) 2410 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi050-63944-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi050-63944-62"}]: dispatch 2024-05-20T22:15:37.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:37 smithi050 bash[21866]: cluster 2024-05-20T22:15:36.172683+0000 mgr.y (mgr.14592) 370 : cluster 0 pgmap v521: 388 pgs: 388 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-05-20T22:15:37.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:37 smithi050 bash[21866]: audit 2024-05-20T22:15:36.663341+0000 mon.a (mon.0) 2411 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:15:37.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:37 smithi050 bash[21866]: cluster 2024-05-20T22:15:37.138641+0000 mon.a (mon.0) 2412 : cluster 0 osdmap e340: 8 total, 8 up, 8 in 2024-05-20T22:15:37.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:37 smithi050 bash[21866]: audit 2024-05-20T22:15:37.140393+0000 mon.a (mon.0) 2413 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:15:37.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:37 smithi050 bash[21866]: audit 2024-05-20T22:15:37.153835+0000 mon.a (mon.0) 2414 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:15:37.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:37 smithi050 bash[21866]: audit 2024-05-20T22:15:37.155354+0000 mon.a (mon.0) 2415 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:15:37.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:37 smithi050 bash[28929]: cluster 2024-05-20T22:15:36.172683+0000 mgr.y (mgr.14592) 370 : cluster 0 pgmap v521: 388 pgs: 388 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-05-20T22:15:37.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:37 smithi050 bash[28929]: audit 2024-05-20T22:15:36.663341+0000 mon.a (mon.0) 2411 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:15:37.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:37 smithi050 bash[28929]: cluster 2024-05-20T22:15:37.138641+0000 mon.a (mon.0) 2412 : cluster 0 osdmap e340: 8 total, 8 up, 8 in 2024-05-20T22:15:37.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:37 smithi050 bash[28929]: audit 2024-05-20T22:15:37.140393+0000 mon.a (mon.0) 2413 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:15:37.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:37 smithi050 bash[28929]: audit 2024-05-20T22:15:37.153835+0000 mon.a (mon.0) 2414 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:15:37.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:37 smithi050 bash[28929]: audit 2024-05-20T22:15:37.155354+0000 mon.a (mon.0) 2415 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:15:38.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:15:37 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:15:38.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:37 smithi145 bash[23893]: cluster 2024-05-20T22:15:36.172683+0000 mgr.y (mgr.14592) 370 : cluster 0 pgmap v521: 388 pgs: 388 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-05-20T22:15:38.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:37 smithi145 bash[23893]: audit 2024-05-20T22:15:36.663341+0000 mon.a (mon.0) 2411 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:15:38.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:37 smithi145 bash[23893]: cluster 2024-05-20T22:15:37.138641+0000 mon.a (mon.0) 2412 : cluster 0 osdmap e340: 8 total, 8 up, 8 in 2024-05-20T22:15:38.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:37 smithi145 bash[23893]: audit 2024-05-20T22:15:37.140393+0000 mon.a (mon.0) 2413 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:15:38.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:37 smithi145 bash[23893]: audit 2024-05-20T22:15:37.153835+0000 mon.a (mon.0) 2414 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:15:38.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:37 smithi145 bash[23893]: audit 2024-05-20T22:15:37.155354+0000 mon.a (mon.0) 2415 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:15:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:38 smithi050 bash[21866]: cluster 2024-05-20T22:15:37.666352+0000 mon.a (mon.0) 2416 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:15:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:38 smithi050 bash[21866]: audit 2024-05-20T22:15:37.676980+0000 mon.a (mon.0) 2417 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi050-63944-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi050-63944-62"}]': finished 2024-05-20T22:15:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:38 smithi050 bash[21866]: audit 2024-05-20T22:15:37.677157+0000 mon.a (mon.0) 2418 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:15:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:38 smithi050 bash[21866]: cluster 2024-05-20T22:15:37.685641+0000 mon.a (mon.0) 2419 : cluster 0 osdmap e341: 8 total, 8 up, 8 in 2024-05-20T22:15:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:38 smithi050 bash[21866]: audit 2024-05-20T22:15:37.687318+0000 mon.a (mon.0) 2420 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-05-20T22:15:38.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:38 smithi050 bash[28929]: cluster 2024-05-20T22:15:37.666352+0000 mon.a (mon.0) 2416 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:15:38.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:38 smithi050 bash[28929]: audit 2024-05-20T22:15:37.676980+0000 mon.a (mon.0) 2417 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi050-63944-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi050-63944-62"}]': finished 2024-05-20T22:15:38.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:38 smithi050 bash[28929]: audit 2024-05-20T22:15:37.677157+0000 mon.a (mon.0) 2418 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:15:38.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:38 smithi050 bash[28929]: cluster 2024-05-20T22:15:37.685641+0000 mon.a (mon.0) 2419 : cluster 0 osdmap e341: 8 total, 8 up, 8 in 2024-05-20T22:15:38.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:38 smithi050 bash[28929]: audit 2024-05-20T22:15:37.687318+0000 mon.a (mon.0) 2420 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-05-20T22:15:39.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:38 smithi145 bash[23893]: cluster 2024-05-20T22:15:37.666352+0000 mon.a (mon.0) 2416 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:15:39.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:38 smithi145 bash[23893]: audit 2024-05-20T22:15:37.676980+0000 mon.a (mon.0) 2417 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi050-63944-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi050-63944-62"}]': finished 2024-05-20T22:15:39.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:38 smithi145 bash[23893]: audit 2024-05-20T22:15:37.677157+0000 mon.a (mon.0) 2418 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:15:39.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:38 smithi145 bash[23893]: cluster 2024-05-20T22:15:37.685641+0000 mon.a (mon.0) 2419 : cluster 0 osdmap e341: 8 total, 8 up, 8 in 2024-05-20T22:15:39.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:38 smithi145 bash[23893]: audit 2024-05-20T22:15:37.687318+0000 mon.a (mon.0) 2420 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-05-20T22:15:39.684 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:15:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:15:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:15:39.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:39 smithi050 bash[21866]: audit 2024-05-20T22:15:37.899316+0000 mgr.y (mgr.14592) 371 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:39.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:39 smithi050 bash[21866]: cluster 2024-05-20T22:15:38.173719+0000 mgr.y (mgr.14592) 372 : cluster 0 pgmap v524: 396 pgs: 8 unknown, 388 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-05-20T22:15:39.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:39 smithi050 bash[21866]: audit 2024-05-20T22:15:38.687163+0000 mon.a (mon.0) 2421 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-05-20T22:15:39.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:39 smithi050 bash[21866]: cluster 2024-05-20T22:15:38.694452+0000 mon.a (mon.0) 2422 : cluster 0 osdmap e342: 8 total, 8 up, 8 in 2024-05-20T22:15:39.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:39 smithi050 bash[21866]: audit 2024-05-20T22:15:38.699250+0000 mon.a (mon.0) 2423 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-05-20T22:15:39.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:39 smithi050 bash[28929]: audit 2024-05-20T22:15:37.899316+0000 mgr.y (mgr.14592) 371 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:39.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:39 smithi050 bash[28929]: cluster 2024-05-20T22:15:38.173719+0000 mgr.y (mgr.14592) 372 : cluster 0 pgmap v524: 396 pgs: 8 unknown, 388 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-05-20T22:15:39.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:39 smithi050 bash[28929]: audit 2024-05-20T22:15:38.687163+0000 mon.a (mon.0) 2421 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-05-20T22:15:39.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:39 smithi050 bash[28929]: cluster 2024-05-20T22:15:38.694452+0000 mon.a (mon.0) 2422 : cluster 0 osdmap e342: 8 total, 8 up, 8 in 2024-05-20T22:15:39.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:39 smithi050 bash[28929]: audit 2024-05-20T22:15:38.699250+0000 mon.a (mon.0) 2423 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-05-20T22:15:40.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:39 smithi145 bash[23893]: audit 2024-05-20T22:15:37.899316+0000 mgr.y (mgr.14592) 371 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:40.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:39 smithi145 bash[23893]: cluster 2024-05-20T22:15:38.173719+0000 mgr.y (mgr.14592) 372 : cluster 0 pgmap v524: 396 pgs: 8 unknown, 388 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-05-20T22:15:40.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:39 smithi145 bash[23893]: audit 2024-05-20T22:15:38.687163+0000 mon.a (mon.0) 2421 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-05-20T22:15:40.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:39 smithi145 bash[23893]: cluster 2024-05-20T22:15:38.694452+0000 mon.a (mon.0) 2422 : cluster 0 osdmap e342: 8 total, 8 up, 8 in 2024-05-20T22:15:40.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:39 smithi145 bash[23893]: audit 2024-05-20T22:15:38.699250+0000 mon.a (mon.0) 2423 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-05-20T22:15:41.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:40 smithi145 bash[23893]: audit 2024-05-20T22:15:39.699326+0000 mon.a (mon.0) 2424 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-05-20T22:15:41.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:40 smithi145 bash[23893]: cluster 2024-05-20T22:15:39.707284+0000 mon.a (mon.0) 2425 : cluster 0 osdmap e343: 8 total, 8 up, 8 in 2024-05-20T22:15:41.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:40 smithi145 bash[23893]: audit 2024-05-20T22:15:39.708878+0000 mon.a (mon.0) 2426 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-05-20T22:15:41.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:40 smithi145 bash[23893]: audit 2024-05-20T22:15:39.713131+0000 mon.a (mon.0) 2427 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi050-63944-62"}]: dispatch 2024-05-20T22:15:41.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:40 smithi050 bash[21866]: audit 2024-05-20T22:15:39.699326+0000 mon.a (mon.0) 2424 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-05-20T22:15:41.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:40 smithi050 bash[21866]: cluster 2024-05-20T22:15:39.707284+0000 mon.a (mon.0) 2425 : cluster 0 osdmap e343: 8 total, 8 up, 8 in 2024-05-20T22:15:41.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:40 smithi050 bash[21866]: audit 2024-05-20T22:15:39.708878+0000 mon.a (mon.0) 2426 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-05-20T22:15:41.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:40 smithi050 bash[21866]: audit 2024-05-20T22:15:39.713131+0000 mon.a (mon.0) 2427 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi050-63944-62"}]: dispatch 2024-05-20T22:15:41.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:40 smithi050 bash[28929]: audit 2024-05-20T22:15:39.699326+0000 mon.a (mon.0) 2424 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-05-20T22:15:41.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:40 smithi050 bash[28929]: cluster 2024-05-20T22:15:39.707284+0000 mon.a (mon.0) 2425 : cluster 0 osdmap e343: 8 total, 8 up, 8 in 2024-05-20T22:15:41.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:40 smithi050 bash[28929]: audit 2024-05-20T22:15:39.708878+0000 mon.a (mon.0) 2426 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-05-20T22:15:41.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:40 smithi050 bash[28929]: audit 2024-05-20T22:15:39.713131+0000 mon.a (mon.0) 2427 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi050-63944-62"}]: dispatch 2024-05-20T22:15:42.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:41 smithi145 bash[23893]: cluster 2024-05-20T22:15:40.177147+0000 mgr.y (mgr.14592) 373 : cluster 0 pgmap v527: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:42.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:41 smithi145 bash[23893]: cluster 2024-05-20T22:15:40.699274+0000 mon.a (mon.0) 2428 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:42.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:41 smithi145 bash[23893]: audit 2024-05-20T22:15:40.708447+0000 mon.a (mon.0) 2429 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-05-20T22:15:42.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:41 smithi145 bash[23893]: audit 2024-05-20T22:15:40.708645+0000 mon.a (mon.0) 2430 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi050-63944-62"}]': finished 2024-05-20T22:15:42.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:41 smithi145 bash[23893]: cluster 2024-05-20T22:15:40.718192+0000 mon.a (mon.0) 2431 : cluster 0 osdmap e344: 8 total, 8 up, 8 in 2024-05-20T22:15:42.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:41 smithi145 bash[23893]: audit 2024-05-20T22:15:40.720451+0000 mon.a (mon.0) 2432 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi050-63944-62"}]: dispatch 2024-05-20T22:15:42.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:41 smithi145 bash[23893]: audit 2024-05-20T22:15:40.827023+0000 mon.a (mon.0) 2433 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:15:42.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:41 smithi050 bash[28929]: cluster 2024-05-20T22:15:40.177147+0000 mgr.y (mgr.14592) 373 : cluster 0 pgmap v527: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:42.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:41 smithi050 bash[28929]: cluster 2024-05-20T22:15:40.699274+0000 mon.a (mon.0) 2428 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:42.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:41 smithi050 bash[28929]: audit 2024-05-20T22:15:40.708447+0000 mon.a (mon.0) 2429 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-05-20T22:15:42.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:41 smithi050 bash[28929]: audit 2024-05-20T22:15:40.708645+0000 mon.a (mon.0) 2430 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi050-63944-62"}]': finished 2024-05-20T22:15:42.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:41 smithi050 bash[28929]: cluster 2024-05-20T22:15:40.718192+0000 mon.a (mon.0) 2431 : cluster 0 osdmap e344: 8 total, 8 up, 8 in 2024-05-20T22:15:42.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:41 smithi050 bash[28929]: audit 2024-05-20T22:15:40.720451+0000 mon.a (mon.0) 2432 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi050-63944-62"}]: dispatch 2024-05-20T22:15:42.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:41 smithi050 bash[28929]: audit 2024-05-20T22:15:40.827023+0000 mon.a (mon.0) 2433 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:15:42.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:41 smithi050 bash[21866]: cluster 2024-05-20T22:15:40.177147+0000 mgr.y (mgr.14592) 373 : cluster 0 pgmap v527: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:42.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:41 smithi050 bash[21866]: cluster 2024-05-20T22:15:40.699274+0000 mon.a (mon.0) 2428 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:42.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:41 smithi050 bash[21866]: audit 2024-05-20T22:15:40.708447+0000 mon.a (mon.0) 2429 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-05-20T22:15:42.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:41 smithi050 bash[21866]: audit 2024-05-20T22:15:40.708645+0000 mon.a (mon.0) 2430 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi050-63944-62"}]': finished 2024-05-20T22:15:42.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:41 smithi050 bash[21866]: cluster 2024-05-20T22:15:40.718192+0000 mon.a (mon.0) 2431 : cluster 0 osdmap e344: 8 total, 8 up, 8 in 2024-05-20T22:15:42.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:41 smithi050 bash[21866]: audit 2024-05-20T22:15:40.720451+0000 mon.a (mon.0) 2432 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi050-63944-62"}]: dispatch 2024-05-20T22:15:42.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:41 smithi050 bash[21866]: audit 2024-05-20T22:15:40.827023+0000 mon.a (mon.0) 2433 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:15:43.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:42 smithi145 bash[23893]: audit 2024-05-20T22:15:41.711929+0000 mon.a (mon.0) 2434 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi050-63944-62"}]': finished 2024-05-20T22:15:43.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:42 smithi145 bash[23893]: audit 2024-05-20T22:15:41.712077+0000 mon.a (mon.0) 2435 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:15:43.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:42 smithi145 bash[23893]: cluster 2024-05-20T22:15:41.720065+0000 mon.a (mon.0) 2436 : cluster 0 osdmap e345: 8 total, 8 up, 8 in 2024-05-20T22:15:43.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:42 smithi145 bash[23893]: audit 2024-05-20T22:15:41.723473+0000 mon.a (mon.0) 2437 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-47"}]: dispatch 2024-05-20T22:15:43.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:42 smithi145 bash[23893]: audit 2024-05-20T22:15:41.768569+0000 mon.c (mon.2) 353 : audit 1 from='client.? v1:172.21.15.50:0/3028528331' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:43.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:42 smithi145 bash[23893]: audit 2024-05-20T22:15:41.769184+0000 mon.a (mon.0) 2438 : audit 1 from='client.26234 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:43.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:42 smithi145 bash[23893]: audit 2024-05-20T22:15:41.770119+0000 mon.c (mon.2) 354 : audit 1 from='client.? v1:172.21.15.50:0/3028528331' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:43.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:42 smithi145 bash[23893]: audit 2024-05-20T22:15:41.770436+0000 mon.a (mon.0) 2439 : audit 1 from='client.26234 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:43.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:42 smithi145 bash[23893]: audit 2024-05-20T22:15:41.770953+0000 mon.c (mon.2) 355 : audit 1 from='client.? v1:172.21.15.50:0/3028528331' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi050-63944-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:43.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:42 smithi145 bash[23893]: audit 2024-05-20T22:15:41.771248+0000 mon.a (mon.0) 2440 : audit 1 from='client.26234 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi050-63944-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:43.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:42 smithi145 bash[23893]: cluster 2024-05-20T22:15:42.178097+0000 mgr.y (mgr.14592) 374 : cluster 0 pgmap v530: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:43.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:42 smithi145 bash[23893]: audit 2024-05-20T22:15:42.714723+0000 mon.a (mon.0) 2441 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-47"}]': finished 2024-05-20T22:15:43.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:42 smithi145 bash[23893]: audit 2024-05-20T22:15:42.714888+0000 mon.a (mon.0) 2442 : audit 1 from='client.26234 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi050-63944-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:43.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:42 smithi145 bash[23893]: cluster 2024-05-20T22:15:42.722733+0000 mon.a (mon.0) 2443 : cluster 0 osdmap e346: 8 total, 8 up, 8 in 2024-05-20T22:15:43.143 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:42 smithi145 bash[23893]: audit 2024-05-20T22:15:42.724869+0000 mon.c (mon.2) 356 : audit 1 from='client.? v1:172.21.15.50:0/3028528331' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi050-63944-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:43.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:42 smithi050 bash[21866]: audit 2024-05-20T22:15:41.711929+0000 mon.a (mon.0) 2434 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi050-63944-62"}]': finished 2024-05-20T22:15:43.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:42 smithi050 bash[21866]: audit 2024-05-20T22:15:41.712077+0000 mon.a (mon.0) 2435 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:15:43.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:42 smithi050 bash[21866]: cluster 2024-05-20T22:15:41.720065+0000 mon.a (mon.0) 2436 : cluster 0 osdmap e345: 8 total, 8 up, 8 in 2024-05-20T22:15:43.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:42 smithi050 bash[21866]: audit 2024-05-20T22:15:41.723473+0000 mon.a (mon.0) 2437 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-47"}]: dispatch 2024-05-20T22:15:43.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:42 smithi050 bash[21866]: audit 2024-05-20T22:15:41.768569+0000 mon.c (mon.2) 353 : audit 1 from='client.? v1:172.21.15.50:0/3028528331' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:43.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:42 smithi050 bash[21866]: audit 2024-05-20T22:15:41.769184+0000 mon.a (mon.0) 2438 : audit 1 from='client.26234 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:43.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:42 smithi050 bash[21866]: audit 2024-05-20T22:15:41.770119+0000 mon.c (mon.2) 354 : audit 1 from='client.? v1:172.21.15.50:0/3028528331' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:43.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:42 smithi050 bash[21866]: audit 2024-05-20T22:15:41.770436+0000 mon.a (mon.0) 2439 : audit 1 from='client.26234 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:43.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:42 smithi050 bash[21866]: audit 2024-05-20T22:15:41.770953+0000 mon.c (mon.2) 355 : audit 1 from='client.? v1:172.21.15.50:0/3028528331' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi050-63944-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:43.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:42 smithi050 bash[21866]: audit 2024-05-20T22:15:41.771248+0000 mon.a (mon.0) 2440 : audit 1 from='client.26234 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi050-63944-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:43.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:42 smithi050 bash[21866]: cluster 2024-05-20T22:15:42.178097+0000 mgr.y (mgr.14592) 374 : cluster 0 pgmap v530: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:43.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:42 smithi050 bash[21866]: audit 2024-05-20T22:15:42.714723+0000 mon.a (mon.0) 2441 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-47"}]': finished 2024-05-20T22:15:43.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:42 smithi050 bash[21866]: audit 2024-05-20T22:15:42.714888+0000 mon.a (mon.0) 2442 : audit 1 from='client.26234 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi050-63944-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:43.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:42 smithi050 bash[21866]: cluster 2024-05-20T22:15:42.722733+0000 mon.a (mon.0) 2443 : cluster 0 osdmap e346: 8 total, 8 up, 8 in 2024-05-20T22:15:43.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:42 smithi050 bash[21866]: audit 2024-05-20T22:15:42.724869+0000 mon.c (mon.2) 356 : audit 1 from='client.? v1:172.21.15.50:0/3028528331' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi050-63944-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:43.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:42 smithi050 bash[28929]: audit 2024-05-20T22:15:41.711929+0000 mon.a (mon.0) 2434 : audit 1 from='client.? v1:172.21.15.50:0/1789540695' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi050-63944-62"}]': finished 2024-05-20T22:15:43.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:42 smithi050 bash[28929]: audit 2024-05-20T22:15:41.712077+0000 mon.a (mon.0) 2435 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:15:43.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:42 smithi050 bash[28929]: cluster 2024-05-20T22:15:41.720065+0000 mon.a (mon.0) 2436 : cluster 0 osdmap e345: 8 total, 8 up, 8 in 2024-05-20T22:15:43.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:42 smithi050 bash[28929]: audit 2024-05-20T22:15:41.723473+0000 mon.a (mon.0) 2437 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-47"}]: dispatch 2024-05-20T22:15:43.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:42 smithi050 bash[28929]: audit 2024-05-20T22:15:41.768569+0000 mon.c (mon.2) 353 : audit 1 from='client.? v1:172.21.15.50:0/3028528331' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:43.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:42 smithi050 bash[28929]: audit 2024-05-20T22:15:41.769184+0000 mon.a (mon.0) 2438 : audit 1 from='client.26234 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:43.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:42 smithi050 bash[28929]: audit 2024-05-20T22:15:41.770119+0000 mon.c (mon.2) 354 : audit 1 from='client.? v1:172.21.15.50:0/3028528331' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:43.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:42 smithi050 bash[28929]: audit 2024-05-20T22:15:41.770436+0000 mon.a (mon.0) 2439 : audit 1 from='client.26234 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:43.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:42 smithi050 bash[28929]: audit 2024-05-20T22:15:41.770953+0000 mon.c (mon.2) 355 : audit 1 from='client.? v1:172.21.15.50:0/3028528331' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi050-63944-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:43.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:42 smithi050 bash[28929]: audit 2024-05-20T22:15:41.771248+0000 mon.a (mon.0) 2440 : audit 1 from='client.26234 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi050-63944-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:43.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:42 smithi050 bash[28929]: cluster 2024-05-20T22:15:42.178097+0000 mgr.y (mgr.14592) 374 : cluster 0 pgmap v530: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:43.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:42 smithi050 bash[28929]: audit 2024-05-20T22:15:42.714723+0000 mon.a (mon.0) 2441 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-47"}]': finished 2024-05-20T22:15:43.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:42 smithi050 bash[28929]: audit 2024-05-20T22:15:42.714888+0000 mon.a (mon.0) 2442 : audit 1 from='client.26234 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi050-63944-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:43.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:42 smithi050 bash[28929]: cluster 2024-05-20T22:15:42.722733+0000 mon.a (mon.0) 2443 : cluster 0 osdmap e346: 8 total, 8 up, 8 in 2024-05-20T22:15:43.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:42 smithi050 bash[28929]: audit 2024-05-20T22:15:42.724869+0000 mon.c (mon.2) 356 : audit 1 from='client.? v1:172.21.15.50:0/3028528331' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi050-63944-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:44.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:44 smithi050 bash[21866]: audit 2024-05-20T22:15:42.725574+0000 mon.a (mon.0) 2444 : audit 1 from='client.26234 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi050-63944-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:44.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:44 smithi050 bash[21866]: audit 2024-05-20T22:15:42.816649+0000 mon.a (mon.0) 2445 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:15:44.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:44 smithi050 bash[21866]: audit 2024-05-20T22:15:42.817636+0000 mon.a (mon.0) 2446 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-47"}]: dispatch 2024-05-20T22:15:44.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:44 smithi050 bash[28929]: audit 2024-05-20T22:15:42.725574+0000 mon.a (mon.0) 2444 : audit 1 from='client.26234 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi050-63944-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:44.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:44 smithi050 bash[28929]: audit 2024-05-20T22:15:42.816649+0000 mon.a (mon.0) 2445 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:15:44.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:44 smithi050 bash[28929]: audit 2024-05-20T22:15:42.817636+0000 mon.a (mon.0) 2446 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-47"}]: dispatch 2024-05-20T22:15:44.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:44 smithi145 bash[23893]: audit 2024-05-20T22:15:42.725574+0000 mon.a (mon.0) 2444 : audit 1 from='client.26234 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi050-63944-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:44.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:44 smithi145 bash[23893]: audit 2024-05-20T22:15:42.816649+0000 mon.a (mon.0) 2445 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:15:44.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:44 smithi145 bash[23893]: audit 2024-05-20T22:15:42.817636+0000 mon.a (mon.0) 2446 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-47"}]: dispatch 2024-05-20T22:15:45.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:45 smithi050 bash[21866]: cluster 2024-05-20T22:15:44.179046+0000 mgr.y (mgr.14592) 375 : cluster 0 pgmap v533: 356 pgs: 356 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:15:45.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:45 smithi050 bash[21866]: cluster 2024-05-20T22:15:44.186481+0000 mon.a (mon.0) 2447 : cluster 0 osdmap e347: 8 total, 8 up, 8 in 2024-05-20T22:15:45.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:45 smithi050 bash[21866]: audit 2024-05-20T22:15:44.728996+0000 mon.a (mon.0) 2448 : audit 1 from='client.26234 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi050-63944-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi050-63944-63"}]': finished 2024-05-20T22:15:45.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:45 smithi050 bash[21866]: cluster 2024-05-20T22:15:44.735777+0000 mon.a (mon.0) 2449 : cluster 0 osdmap e348: 8 total, 8 up, 8 in 2024-05-20T22:15:45.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:45 smithi050 bash[21866]: audit 2024-05-20T22:15:44.748926+0000 mon.a (mon.0) 2450 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:15:45.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:45 smithi050 bash[21866]: audit 2024-05-20T22:15:44.857300+0000 mon.a (mon.0) 2451 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:15:45.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:45 smithi050 bash[28929]: cluster 2024-05-20T22:15:44.179046+0000 mgr.y (mgr.14592) 375 : cluster 0 pgmap v533: 356 pgs: 356 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:15:45.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:45 smithi050 bash[28929]: cluster 2024-05-20T22:15:44.186481+0000 mon.a (mon.0) 2447 : cluster 0 osdmap e347: 8 total, 8 up, 8 in 2024-05-20T22:15:45.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:45 smithi050 bash[28929]: audit 2024-05-20T22:15:44.728996+0000 mon.a (mon.0) 2448 : audit 1 from='client.26234 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi050-63944-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi050-63944-63"}]': finished 2024-05-20T22:15:45.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:45 smithi050 bash[28929]: cluster 2024-05-20T22:15:44.735777+0000 mon.a (mon.0) 2449 : cluster 0 osdmap e348: 8 total, 8 up, 8 in 2024-05-20T22:15:45.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:45 smithi050 bash[28929]: audit 2024-05-20T22:15:44.748926+0000 mon.a (mon.0) 2450 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:15:45.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:45 smithi050 bash[28929]: audit 2024-05-20T22:15:44.857300+0000 mon.a (mon.0) 2451 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:15:45.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:45 smithi145 bash[23893]: cluster 2024-05-20T22:15:44.179046+0000 mgr.y (mgr.14592) 375 : cluster 0 pgmap v533: 356 pgs: 356 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:15:45.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:45 smithi145 bash[23893]: cluster 2024-05-20T22:15:44.186481+0000 mon.a (mon.0) 2447 : cluster 0 osdmap e347: 8 total, 8 up, 8 in 2024-05-20T22:15:45.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:45 smithi145 bash[23893]: audit 2024-05-20T22:15:44.728996+0000 mon.a (mon.0) 2448 : audit 1 from='client.26234 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi050-63944-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi050-63944-63"}]': finished 2024-05-20T22:15:45.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:45 smithi145 bash[23893]: cluster 2024-05-20T22:15:44.735777+0000 mon.a (mon.0) 2449 : cluster 0 osdmap e348: 8 total, 8 up, 8 in 2024-05-20T22:15:45.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:45 smithi145 bash[23893]: audit 2024-05-20T22:15:44.748926+0000 mon.a (mon.0) 2450 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:15:45.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:45 smithi145 bash[23893]: audit 2024-05-20T22:15:44.857300+0000 mon.a (mon.0) 2451 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:15:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:46 smithi050 bash[21866]: audit 2024-05-20T22:15:45.597490+0000 mon.a (mon.0) 2452 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:15:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:46 smithi050 bash[21866]: audit 2024-05-20T22:15:45.598350+0000 mon.a (mon.0) 2453 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:15:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:46 smithi050 bash[21866]: audit 2024-05-20T22:15:45.606293+0000 mon.a (mon.0) 2454 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:15:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:46 smithi050 bash[21866]: audit 2024-05-20T22:15:45.732149+0000 mon.a (mon.0) 2455 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:15:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:46 smithi050 bash[21866]: cluster 2024-05-20T22:15:45.740259+0000 mon.a (mon.0) 2456 : cluster 0 osdmap e349: 8 total, 8 up, 8 in 2024-05-20T22:15:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:46 smithi050 bash[21866]: audit 2024-05-20T22:15:45.806333+0000 mon.a (mon.0) 2457 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:15:46.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:46 smithi050 bash[28929]: audit 2024-05-20T22:15:45.597490+0000 mon.a (mon.0) 2452 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:15:46.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:46 smithi050 bash[28929]: audit 2024-05-20T22:15:45.598350+0000 mon.a (mon.0) 2453 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:15:46.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:46 smithi050 bash[28929]: audit 2024-05-20T22:15:45.606293+0000 mon.a (mon.0) 2454 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:15:46.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:46 smithi050 bash[28929]: audit 2024-05-20T22:15:45.732149+0000 mon.a (mon.0) 2455 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:15:46.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:46 smithi050 bash[28929]: cluster 2024-05-20T22:15:45.740259+0000 mon.a (mon.0) 2456 : cluster 0 osdmap e349: 8 total, 8 up, 8 in 2024-05-20T22:15:46.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:46 smithi050 bash[28929]: audit 2024-05-20T22:15:45.806333+0000 mon.a (mon.0) 2457 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:15:46.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:46 smithi145 bash[23893]: audit 2024-05-20T22:15:45.597490+0000 mon.a (mon.0) 2452 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:15:46.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:46 smithi145 bash[23893]: audit 2024-05-20T22:15:45.598350+0000 mon.a (mon.0) 2453 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:15:46.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:46 smithi145 bash[23893]: audit 2024-05-20T22:15:45.606293+0000 mon.a (mon.0) 2454 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:15:46.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:46 smithi145 bash[23893]: audit 2024-05-20T22:15:45.732149+0000 mon.a (mon.0) 2455 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:15:46.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:46 smithi145 bash[23893]: cluster 2024-05-20T22:15:45.740259+0000 mon.a (mon.0) 2456 : cluster 0 osdmap e349: 8 total, 8 up, 8 in 2024-05-20T22:15:46.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:46 smithi145 bash[23893]: audit 2024-05-20T22:15:45.806333+0000 mon.a (mon.0) 2457 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:15:47.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:47 smithi050 bash[21866]: cluster 2024-05-20T22:15:46.180091+0000 mgr.y (mgr.14592) 376 : cluster 0 pgmap v536: 396 pgs: 40 creating+peering, 356 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-20T22:15:47.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:47 smithi050 bash[21866]: cluster 2024-05-20T22:15:46.732102+0000 mon.a (mon.0) 2458 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:47.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:47 smithi050 bash[21866]: audit 2024-05-20T22:15:46.741622+0000 mon.a (mon.0) 2459 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-49", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:15:47.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:47 smithi050 bash[21866]: cluster 2024-05-20T22:15:46.748275+0000 mon.a (mon.0) 2460 : cluster 0 osdmap e350: 8 total, 8 up, 8 in 2024-05-20T22:15:47.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:47 smithi050 bash[21866]: audit 2024-05-20T22:15:46.750380+0000 mon.a (mon.0) 2461 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-49"}]: dispatch 2024-05-20T22:15:47.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:47 smithi050 bash[21866]: audit 2024-05-20T22:15:46.752946+0000 mon.c (mon.2) 357 : audit 1 from='client.? v1:172.21.15.50:0/3028528331' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:47.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:47 smithi050 bash[21866]: audit 2024-05-20T22:15:46.756427+0000 mon.a (mon.0) 2462 : audit 1 from='client.26234 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:47.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:47 smithi050 bash[28929]: cluster 2024-05-20T22:15:46.180091+0000 mgr.y (mgr.14592) 376 : cluster 0 pgmap v536: 396 pgs: 40 creating+peering, 356 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-20T22:15:47.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:47 smithi050 bash[28929]: cluster 2024-05-20T22:15:46.732102+0000 mon.a (mon.0) 2458 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:47.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:47 smithi050 bash[28929]: audit 2024-05-20T22:15:46.741622+0000 mon.a (mon.0) 2459 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-49", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:15:47.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:47 smithi050 bash[28929]: cluster 2024-05-20T22:15:46.748275+0000 mon.a (mon.0) 2460 : cluster 0 osdmap e350: 8 total, 8 up, 8 in 2024-05-20T22:15:47.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:47 smithi050 bash[28929]: audit 2024-05-20T22:15:46.750380+0000 mon.a (mon.0) 2461 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-49"}]: dispatch 2024-05-20T22:15:47.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:47 smithi050 bash[28929]: audit 2024-05-20T22:15:46.752946+0000 mon.c (mon.2) 357 : audit 1 from='client.? v1:172.21.15.50:0/3028528331' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:47.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:47 smithi050 bash[28929]: audit 2024-05-20T22:15:46.756427+0000 mon.a (mon.0) 2462 : audit 1 from='client.26234 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:47.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:47 smithi145 bash[23893]: cluster 2024-05-20T22:15:46.180091+0000 mgr.y (mgr.14592) 376 : cluster 0 pgmap v536: 396 pgs: 40 creating+peering, 356 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-20T22:15:47.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:47 smithi145 bash[23893]: cluster 2024-05-20T22:15:46.732102+0000 mon.a (mon.0) 2458 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:47.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:47 smithi145 bash[23893]: audit 2024-05-20T22:15:46.741622+0000 mon.a (mon.0) 2459 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-49", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:15:47.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:47 smithi145 bash[23893]: cluster 2024-05-20T22:15:46.748275+0000 mon.a (mon.0) 2460 : cluster 0 osdmap e350: 8 total, 8 up, 8 in 2024-05-20T22:15:47.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:47 smithi145 bash[23893]: audit 2024-05-20T22:15:46.750380+0000 mon.a (mon.0) 2461 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-49"}]: dispatch 2024-05-20T22:15:47.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:47 smithi145 bash[23893]: audit 2024-05-20T22:15:46.752946+0000 mon.c (mon.2) 357 : audit 1 from='client.? v1:172.21.15.50:0/3028528331' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:47.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:47 smithi145 bash[23893]: audit 2024-05-20T22:15:46.756427+0000 mon.a (mon.0) 2462 : audit 1 from='client.26234 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:48.391 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:15:47 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:15:49.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:48 smithi145 bash[23893]: audit 2024-05-20T22:15:47.744461+0000 mon.a (mon.0) 2463 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-49"}]': finished 2024-05-20T22:15:49.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:48 smithi145 bash[23893]: audit 2024-05-20T22:15:47.744623+0000 mon.a (mon.0) 2464 : audit 1 from='client.26234 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi050-63944-63"}]': finished 2024-05-20T22:15:49.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:48 smithi145 bash[23893]: cluster 2024-05-20T22:15:47.752697+0000 mon.a (mon.0) 2465 : cluster 0 osdmap e351: 8 total, 8 up, 8 in 2024-05-20T22:15:49.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:48 smithi145 bash[23893]: audit 2024-05-20T22:15:47.753538+0000 mon.a (mon.0) 2466 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-49", "mode": "readproxy"}]: dispatch 2024-05-20T22:15:49.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:48 smithi145 bash[23893]: audit 2024-05-20T22:15:47.757479+0000 mon.c (mon.2) 358 : audit 1 from='client.? v1:172.21.15.50:0/3028528331' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:49.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:48 smithi145 bash[23893]: audit 2024-05-20T22:15:47.758673+0000 mon.a (mon.0) 2467 : audit 1 from='client.26234 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:49.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:48 smithi145 bash[23893]: audit 2024-05-20T22:15:47.903153+0000 mgr.y (mgr.14592) 377 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:49.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:48 smithi145 bash[23893]: cluster 2024-05-20T22:15:48.181020+0000 mgr.y (mgr.14592) 378 : cluster 0 pgmap v539: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-20T22:15:49.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:48 smithi050 bash[21866]: audit 2024-05-20T22:15:47.744461+0000 mon.a (mon.0) 2463 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-49"}]': finished 2024-05-20T22:15:49.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:48 smithi050 bash[21866]: audit 2024-05-20T22:15:47.744623+0000 mon.a (mon.0) 2464 : audit 1 from='client.26234 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi050-63944-63"}]': finished 2024-05-20T22:15:49.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:48 smithi050 bash[21866]: cluster 2024-05-20T22:15:47.752697+0000 mon.a (mon.0) 2465 : cluster 0 osdmap e351: 8 total, 8 up, 8 in 2024-05-20T22:15:49.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:48 smithi050 bash[21866]: audit 2024-05-20T22:15:47.753538+0000 mon.a (mon.0) 2466 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-49", "mode": "readproxy"}]: dispatch 2024-05-20T22:15:49.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:48 smithi050 bash[21866]: audit 2024-05-20T22:15:47.757479+0000 mon.c (mon.2) 358 : audit 1 from='client.? v1:172.21.15.50:0/3028528331' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:49.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:48 smithi050 bash[21866]: audit 2024-05-20T22:15:47.758673+0000 mon.a (mon.0) 2467 : audit 1 from='client.26234 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:49.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:48 smithi050 bash[21866]: audit 2024-05-20T22:15:47.903153+0000 mgr.y (mgr.14592) 377 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:49.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:48 smithi050 bash[21866]: cluster 2024-05-20T22:15:48.181020+0000 mgr.y (mgr.14592) 378 : cluster 0 pgmap v539: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-20T22:15:49.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:48 smithi050 bash[28929]: audit 2024-05-20T22:15:47.744461+0000 mon.a (mon.0) 2463 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-49"}]': finished 2024-05-20T22:15:49.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:48 smithi050 bash[28929]: audit 2024-05-20T22:15:47.744623+0000 mon.a (mon.0) 2464 : audit 1 from='client.26234 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi050-63944-63"}]': finished 2024-05-20T22:15:49.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:48 smithi050 bash[28929]: cluster 2024-05-20T22:15:47.752697+0000 mon.a (mon.0) 2465 : cluster 0 osdmap e351: 8 total, 8 up, 8 in 2024-05-20T22:15:49.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:48 smithi050 bash[28929]: audit 2024-05-20T22:15:47.753538+0000 mon.a (mon.0) 2466 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-49", "mode": "readproxy"}]: dispatch 2024-05-20T22:15:49.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:48 smithi050 bash[28929]: audit 2024-05-20T22:15:47.757479+0000 mon.c (mon.2) 358 : audit 1 from='client.? v1:172.21.15.50:0/3028528331' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:49.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:48 smithi050 bash[28929]: audit 2024-05-20T22:15:47.758673+0000 mon.a (mon.0) 2467 : audit 1 from='client.26234 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi050-63944-63"}]: dispatch 2024-05-20T22:15:49.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:48 smithi050 bash[28929]: audit 2024-05-20T22:15:47.903153+0000 mgr.y (mgr.14592) 377 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:49.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:48 smithi050 bash[28929]: cluster 2024-05-20T22:15:48.181020+0000 mgr.y (mgr.14592) 378 : cluster 0 pgmap v539: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-20T22:15:49.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:15:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:15:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:15:50.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:49 smithi145 bash[23893]: cluster 2024-05-20T22:15:48.746544+0000 mon.a (mon.0) 2468 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:15:50.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:49 smithi145 bash[23893]: audit 2024-05-20T22:15:48.754930+0000 mon.a (mon.0) 2469 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-49", "mode": "readproxy"}]': finished 2024-05-20T22:15:50.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:49 smithi145 bash[23893]: audit 2024-05-20T22:15:48.755112+0000 mon.a (mon.0) 2470 : audit 1 from='client.26234 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi050-63944-63"}]': finished 2024-05-20T22:15:50.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:49 smithi145 bash[23893]: cluster 2024-05-20T22:15:48.765269+0000 mon.a (mon.0) 2471 : cluster 0 osdmap e352: 8 total, 8 up, 8 in 2024-05-20T22:15:50.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:49 smithi145 bash[23893]: audit 2024-05-20T22:15:48.796150+0000 mon.a (mon.0) 2472 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi050-63944-64"}]: dispatch 2024-05-20T22:15:50.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:49 smithi145 bash[23893]: audit 2024-05-20T22:15:48.798289+0000 mon.a (mon.0) 2473 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi050-63944-64"}]: dispatch 2024-05-20T22:15:50.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:49 smithi145 bash[23893]: audit 2024-05-20T22:15:48.798653+0000 mon.a (mon.0) 2474 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi050-63944-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:50.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:49 smithi050 bash[21866]: cluster 2024-05-20T22:15:48.746544+0000 mon.a (mon.0) 2468 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:15:50.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:49 smithi050 bash[21866]: audit 2024-05-20T22:15:48.754930+0000 mon.a (mon.0) 2469 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-49", "mode": "readproxy"}]': finished 2024-05-20T22:15:50.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:49 smithi050 bash[21866]: audit 2024-05-20T22:15:48.755112+0000 mon.a (mon.0) 2470 : audit 1 from='client.26234 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi050-63944-63"}]': finished 2024-05-20T22:15:50.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:49 smithi050 bash[21866]: cluster 2024-05-20T22:15:48.765269+0000 mon.a (mon.0) 2471 : cluster 0 osdmap e352: 8 total, 8 up, 8 in 2024-05-20T22:15:50.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:49 smithi050 bash[21866]: audit 2024-05-20T22:15:48.796150+0000 mon.a (mon.0) 2472 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi050-63944-64"}]: dispatch 2024-05-20T22:15:50.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:49 smithi050 bash[21866]: audit 2024-05-20T22:15:48.798289+0000 mon.a (mon.0) 2473 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi050-63944-64"}]: dispatch 2024-05-20T22:15:50.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:49 smithi050 bash[21866]: audit 2024-05-20T22:15:48.798653+0000 mon.a (mon.0) 2474 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi050-63944-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:50.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:49 smithi050 bash[28929]: cluster 2024-05-20T22:15:48.746544+0000 mon.a (mon.0) 2468 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:15:50.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:49 smithi050 bash[28929]: audit 2024-05-20T22:15:48.754930+0000 mon.a (mon.0) 2469 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-49", "mode": "readproxy"}]': finished 2024-05-20T22:15:50.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:49 smithi050 bash[28929]: audit 2024-05-20T22:15:48.755112+0000 mon.a (mon.0) 2470 : audit 1 from='client.26234 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi050-63944-63"}]': finished 2024-05-20T22:15:50.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:49 smithi050 bash[28929]: cluster 2024-05-20T22:15:48.765269+0000 mon.a (mon.0) 2471 : cluster 0 osdmap e352: 8 total, 8 up, 8 in 2024-05-20T22:15:50.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:49 smithi050 bash[28929]: audit 2024-05-20T22:15:48.796150+0000 mon.a (mon.0) 2472 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi050-63944-64"}]: dispatch 2024-05-20T22:15:50.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:49 smithi050 bash[28929]: audit 2024-05-20T22:15:48.798289+0000 mon.a (mon.0) 2473 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi050-63944-64"}]: dispatch 2024-05-20T22:15:50.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:49 smithi050 bash[28929]: audit 2024-05-20T22:15:48.798653+0000 mon.a (mon.0) 2474 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi050-63944-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:51.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:51 smithi145 bash[23893]: audit 2024-05-20T22:15:49.757598+0000 mon.a (mon.0) 2475 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi050-63944-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:51.681 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:51 smithi145 bash[23893]: cluster 2024-05-20T22:15:49.764934+0000 mon.a (mon.0) 2476 : cluster 0 osdmap e353: 8 total, 8 up, 8 in 2024-05-20T22:15:51.681 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:51 smithi145 bash[23893]: audit 2024-05-20T22:15:49.767196+0000 mon.a (mon.0) 2477 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi050-63944-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi050-63944-64"}]: dispatch 2024-05-20T22:15:51.681 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:51 smithi145 bash[23893]: cluster 2024-05-20T22:15:50.184331+0000 mgr.y (mgr.14592) 379 : cluster 0 pgmap v542: 388 pgs: 388 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:15:51.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:51 smithi050 bash[21866]: audit 2024-05-20T22:15:49.757598+0000 mon.a (mon.0) 2475 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi050-63944-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:51.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:51 smithi050 bash[21866]: cluster 2024-05-20T22:15:49.764934+0000 mon.a (mon.0) 2476 : cluster 0 osdmap e353: 8 total, 8 up, 8 in 2024-05-20T22:15:51.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:51 smithi050 bash[21866]: audit 2024-05-20T22:15:49.767196+0000 mon.a (mon.0) 2477 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi050-63944-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi050-63944-64"}]: dispatch 2024-05-20T22:15:51.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:51 smithi050 bash[21866]: cluster 2024-05-20T22:15:50.184331+0000 mgr.y (mgr.14592) 379 : cluster 0 pgmap v542: 388 pgs: 388 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:15:51.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:51 smithi050 bash[28929]: audit 2024-05-20T22:15:49.757598+0000 mon.a (mon.0) 2475 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi050-63944-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:51.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:51 smithi050 bash[28929]: cluster 2024-05-20T22:15:49.764934+0000 mon.a (mon.0) 2476 : cluster 0 osdmap e353: 8 total, 8 up, 8 in 2024-05-20T22:15:51.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:51 smithi050 bash[28929]: audit 2024-05-20T22:15:49.767196+0000 mon.a (mon.0) 2477 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi050-63944-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi050-63944-64"}]: dispatch 2024-05-20T22:15:51.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:51 smithi050 bash[28929]: cluster 2024-05-20T22:15:50.184331+0000 mgr.y (mgr.14592) 379 : cluster 0 pgmap v542: 388 pgs: 388 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:15:52.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:52 smithi145 bash[23893]: cluster 2024-05-20T22:15:51.241636+0000 mon.a (mon.0) 2478 : cluster 0 osdmap e354: 8 total, 8 up, 8 in 2024-05-20T22:15:52.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:52 smithi145 bash[23893]: audit 2024-05-20T22:15:51.764513+0000 mon.a (mon.0) 2479 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi050-63944-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi050-63944-64"}]': finished 2024-05-20T22:15:52.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:52 smithi145 bash[23893]: cluster 2024-05-20T22:15:51.771199+0000 mon.a (mon.0) 2480 : cluster 0 osdmap e355: 8 total, 8 up, 8 in 2024-05-20T22:15:52.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:52 smithi145 bash[23893]: audit 2024-05-20T22:15:52.171511+0000 mon.a (mon.0) 2481 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:15:52.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:52 smithi050 bash[28929]: cluster 2024-05-20T22:15:51.241636+0000 mon.a (mon.0) 2478 : cluster 0 osdmap e354: 8 total, 8 up, 8 in 2024-05-20T22:15:52.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:52 smithi050 bash[28929]: audit 2024-05-20T22:15:51.764513+0000 mon.a (mon.0) 2479 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi050-63944-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi050-63944-64"}]': finished 2024-05-20T22:15:52.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:52 smithi050 bash[28929]: cluster 2024-05-20T22:15:51.771199+0000 mon.a (mon.0) 2480 : cluster 0 osdmap e355: 8 total, 8 up, 8 in 2024-05-20T22:15:52.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:52 smithi050 bash[28929]: audit 2024-05-20T22:15:52.171511+0000 mon.a (mon.0) 2481 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:15:52.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:52 smithi050 bash[21866]: cluster 2024-05-20T22:15:51.241636+0000 mon.a (mon.0) 2478 : cluster 0 osdmap e354: 8 total, 8 up, 8 in 2024-05-20T22:15:52.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:52 smithi050 bash[21866]: audit 2024-05-20T22:15:51.764513+0000 mon.a (mon.0) 2479 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi050-63944-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi050-63944-64"}]': finished 2024-05-20T22:15:52.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:52 smithi050 bash[21866]: cluster 2024-05-20T22:15:51.771199+0000 mon.a (mon.0) 2480 : cluster 0 osdmap e355: 8 total, 8 up, 8 in 2024-05-20T22:15:52.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:52 smithi050 bash[21866]: audit 2024-05-20T22:15:52.171511+0000 mon.a (mon.0) 2481 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:15:53.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:53 smithi145 bash[23893]: cluster 2024-05-20T22:15:52.200162+0000 mgr.y (mgr.14592) 380 : cluster 0 pgmap v545: 396 pgs: 8 unknown, 388 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 254 B/s wr, 1 op/s 2024-05-20T22:15:53.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:53 smithi145 bash[23893]: cluster 2024-05-20T22:15:52.764412+0000 mon.a (mon.0) 2482 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:53.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:53 smithi145 bash[23893]: cluster 2024-05-20T22:15:52.781550+0000 mon.a (mon.0) 2483 : cluster 0 osdmap e356: 8 total, 8 up, 8 in 2024-05-20T22:15:53.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:53 smithi050 bash[21866]: cluster 2024-05-20T22:15:52.200162+0000 mgr.y (mgr.14592) 380 : cluster 0 pgmap v545: 396 pgs: 8 unknown, 388 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 254 B/s wr, 1 op/s 2024-05-20T22:15:53.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:53 smithi050 bash[21866]: cluster 2024-05-20T22:15:52.764412+0000 mon.a (mon.0) 2482 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:53.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:53 smithi050 bash[21866]: cluster 2024-05-20T22:15:52.781550+0000 mon.a (mon.0) 2483 : cluster 0 osdmap e356: 8 total, 8 up, 8 in 2024-05-20T22:15:53.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:53 smithi050 bash[28929]: cluster 2024-05-20T22:15:52.200162+0000 mgr.y (mgr.14592) 380 : cluster 0 pgmap v545: 396 pgs: 8 unknown, 388 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 254 B/s wr, 1 op/s 2024-05-20T22:15:53.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:53 smithi050 bash[28929]: cluster 2024-05-20T22:15:52.764412+0000 mon.a (mon.0) 2482 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:15:53.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:53 smithi050 bash[28929]: cluster 2024-05-20T22:15:52.781550+0000 mon.a (mon.0) 2483 : cluster 0 osdmap e356: 8 total, 8 up, 8 in 2024-05-20T22:15:55.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:54 smithi145 bash[23893]: cluster 2024-05-20T22:15:53.784446+0000 mon.a (mon.0) 2484 : cluster 0 osdmap e357: 8 total, 8 up, 8 in 2024-05-20T22:15:55.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:54 smithi145 bash[23893]: audit 2024-05-20T22:15:53.786123+0000 mon.a (mon.0) 2485 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi050-63944-64"}]: dispatch 2024-05-20T22:15:55.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:54 smithi145 bash[23893]: cluster 2024-05-20T22:15:54.201096+0000 mgr.y (mgr.14592) 381 : cluster 0 pgmap v548: 388 pgs: 388 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:15:55.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:54 smithi050 bash[28929]: cluster 2024-05-20T22:15:53.784446+0000 mon.a (mon.0) 2484 : cluster 0 osdmap e357: 8 total, 8 up, 8 in 2024-05-20T22:15:55.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:54 smithi050 bash[28929]: audit 2024-05-20T22:15:53.786123+0000 mon.a (mon.0) 2485 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi050-63944-64"}]: dispatch 2024-05-20T22:15:55.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:54 smithi050 bash[28929]: cluster 2024-05-20T22:15:54.201096+0000 mgr.y (mgr.14592) 381 : cluster 0 pgmap v548: 388 pgs: 388 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:15:55.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:54 smithi050 bash[21866]: cluster 2024-05-20T22:15:53.784446+0000 mon.a (mon.0) 2484 : cluster 0 osdmap e357: 8 total, 8 up, 8 in 2024-05-20T22:15:55.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:54 smithi050 bash[21866]: audit 2024-05-20T22:15:53.786123+0000 mon.a (mon.0) 2485 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi050-63944-64"}]: dispatch 2024-05-20T22:15:55.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:54 smithi050 bash[21866]: cluster 2024-05-20T22:15:54.201096+0000 mgr.y (mgr.14592) 381 : cluster 0 pgmap v548: 388 pgs: 388 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:15:56.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:55 smithi145 bash[23893]: audit 2024-05-20T22:15:54.786019+0000 mon.a (mon.0) 2486 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi050-63944-64"}]': finished 2024-05-20T22:15:56.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:55 smithi145 bash[23893]: cluster 2024-05-20T22:15:54.795892+0000 mon.a (mon.0) 2487 : cluster 0 osdmap e358: 8 total, 8 up, 8 in 2024-05-20T22:15:56.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:55 smithi145 bash[23893]: audit 2024-05-20T22:15:54.796866+0000 mon.a (mon.0) 2488 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi050-63944-64"}]: dispatch 2024-05-20T22:15:56.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:55 smithi050 bash[21866]: audit 2024-05-20T22:15:54.786019+0000 mon.a (mon.0) 2486 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi050-63944-64"}]': finished 2024-05-20T22:15:56.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:55 smithi050 bash[21866]: cluster 2024-05-20T22:15:54.795892+0000 mon.a (mon.0) 2487 : cluster 0 osdmap e358: 8 total, 8 up, 8 in 2024-05-20T22:15:56.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:55 smithi050 bash[21866]: audit 2024-05-20T22:15:54.796866+0000 mon.a (mon.0) 2488 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi050-63944-64"}]: dispatch 2024-05-20T22:15:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:55 smithi050 bash[28929]: audit 2024-05-20T22:15:54.786019+0000 mon.a (mon.0) 2486 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi050-63944-64"}]': finished 2024-05-20T22:15:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:55 smithi050 bash[28929]: cluster 2024-05-20T22:15:54.795892+0000 mon.a (mon.0) 2487 : cluster 0 osdmap e358: 8 total, 8 up, 8 in 2024-05-20T22:15:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:55 smithi050 bash[28929]: audit 2024-05-20T22:15:54.796866+0000 mon.a (mon.0) 2488 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi050-63944-64"}]: dispatch 2024-05-20T22:15:57.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:56 smithi145 bash[23893]: audit 2024-05-20T22:15:55.796676+0000 mon.a (mon.0) 2489 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi050-63944-64"}]': finished 2024-05-20T22:15:57.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:56 smithi145 bash[23893]: cluster 2024-05-20T22:15:55.803550+0000 mon.a (mon.0) 2490 : cluster 0 osdmap e359: 8 total, 8 up, 8 in 2024-05-20T22:15:57.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:56 smithi145 bash[23893]: audit 2024-05-20T22:15:55.839594+0000 mon.a (mon.0) 2491 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi050-63944-65"}]: dispatch 2024-05-20T22:15:57.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:56 smithi145 bash[23893]: audit 2024-05-20T22:15:55.841195+0000 mon.a (mon.0) 2492 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi050-63944-65"}]: dispatch 2024-05-20T22:15:57.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:56 smithi145 bash[23893]: audit 2024-05-20T22:15:55.841557+0000 mon.a (mon.0) 2493 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi050-63944-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:57.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:56 smithi145 bash[23893]: cluster 2024-05-20T22:15:56.202026+0000 mgr.y (mgr.14592) 382 : cluster 0 pgmap v551: 388 pgs: 388 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:57.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:56 smithi050 bash[28929]: audit 2024-05-20T22:15:55.796676+0000 mon.a (mon.0) 2489 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi050-63944-64"}]': finished 2024-05-20T22:15:57.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:56 smithi050 bash[28929]: cluster 2024-05-20T22:15:55.803550+0000 mon.a (mon.0) 2490 : cluster 0 osdmap e359: 8 total, 8 up, 8 in 2024-05-20T22:15:57.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:56 smithi050 bash[28929]: audit 2024-05-20T22:15:55.839594+0000 mon.a (mon.0) 2491 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi050-63944-65"}]: dispatch 2024-05-20T22:15:57.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:56 smithi050 bash[28929]: audit 2024-05-20T22:15:55.841195+0000 mon.a (mon.0) 2492 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi050-63944-65"}]: dispatch 2024-05-20T22:15:57.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:56 smithi050 bash[28929]: audit 2024-05-20T22:15:55.841557+0000 mon.a (mon.0) 2493 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi050-63944-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:57.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:56 smithi050 bash[28929]: cluster 2024-05-20T22:15:56.202026+0000 mgr.y (mgr.14592) 382 : cluster 0 pgmap v551: 388 pgs: 388 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:57.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:56 smithi050 bash[21866]: audit 2024-05-20T22:15:55.796676+0000 mon.a (mon.0) 2489 : audit 1 from='client.? v1:172.21.15.50:0/540076540' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi050-63944-64"}]': finished 2024-05-20T22:15:57.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:56 smithi050 bash[21866]: cluster 2024-05-20T22:15:55.803550+0000 mon.a (mon.0) 2490 : cluster 0 osdmap e359: 8 total, 8 up, 8 in 2024-05-20T22:15:57.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:56 smithi050 bash[21866]: audit 2024-05-20T22:15:55.839594+0000 mon.a (mon.0) 2491 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi050-63944-65"}]: dispatch 2024-05-20T22:15:57.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:56 smithi050 bash[21866]: audit 2024-05-20T22:15:55.841195+0000 mon.a (mon.0) 2492 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi050-63944-65"}]: dispatch 2024-05-20T22:15:57.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:56 smithi050 bash[21866]: audit 2024-05-20T22:15:55.841557+0000 mon.a (mon.0) 2493 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi050-63944-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:15:57.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:56 smithi050 bash[21866]: cluster 2024-05-20T22:15:56.202026+0000 mgr.y (mgr.14592) 382 : cluster 0 pgmap v551: 388 pgs: 388 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:58.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:15:57 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:15:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:57 smithi145 bash[23893]: audit 2024-05-20T22:15:56.805943+0000 mon.a (mon.0) 2494 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi050-63944-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:57 smithi145 bash[23893]: cluster 2024-05-20T22:15:56.815348+0000 mon.a (mon.0) 2495 : cluster 0 osdmap e360: 8 total, 8 up, 8 in 2024-05-20T22:15:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:57 smithi145 bash[23893]: audit 2024-05-20T22:15:56.817215+0000 mon.a (mon.0) 2496 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi050-63944-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi050-63944-65"}]: dispatch 2024-05-20T22:15:58.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:57 smithi050 bash[21866]: audit 2024-05-20T22:15:56.805943+0000 mon.a (mon.0) 2494 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi050-63944-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:58.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:57 smithi050 bash[21866]: cluster 2024-05-20T22:15:56.815348+0000 mon.a (mon.0) 2495 : cluster 0 osdmap e360: 8 total, 8 up, 8 in 2024-05-20T22:15:58.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:57 smithi050 bash[21866]: audit 2024-05-20T22:15:56.817215+0000 mon.a (mon.0) 2496 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi050-63944-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi050-63944-65"}]: dispatch 2024-05-20T22:15:58.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:57 smithi050 bash[28929]: audit 2024-05-20T22:15:56.805943+0000 mon.a (mon.0) 2494 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi050-63944-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:15:58.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:57 smithi050 bash[28929]: cluster 2024-05-20T22:15:56.815348+0000 mon.a (mon.0) 2495 : cluster 0 osdmap e360: 8 total, 8 up, 8 in 2024-05-20T22:15:58.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:57 smithi050 bash[28929]: audit 2024-05-20T22:15:56.817215+0000 mon.a (mon.0) 2496 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi050-63944-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi050-63944-65"}]: dispatch 2024-05-20T22:15:59.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:58 smithi145 bash[23893]: audit 2024-05-20T22:15:57.914486+0000 mgr.y (mgr.14592) 383 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:59.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:58 smithi145 bash[23893]: cluster 2024-05-20T22:15:58.202963+0000 mgr.y (mgr.14592) 384 : cluster 0 pgmap v554: 388 pgs: 388 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:59.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:58 smithi145 bash[23893]: cluster 2024-05-20T22:15:58.282830+0000 mon.a (mon.0) 2497 : cluster 0 osdmap e361: 8 total, 8 up, 8 in 2024-05-20T22:15:59.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:58 smithi050 bash[21866]: audit 2024-05-20T22:15:57.914486+0000 mgr.y (mgr.14592) 383 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:59.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:58 smithi050 bash[21866]: cluster 2024-05-20T22:15:58.202963+0000 mgr.y (mgr.14592) 384 : cluster 0 pgmap v554: 388 pgs: 388 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:59.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:58 smithi050 bash[21866]: cluster 2024-05-20T22:15:58.282830+0000 mon.a (mon.0) 2497 : cluster 0 osdmap e361: 8 total, 8 up, 8 in 2024-05-20T22:15:59.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:58 smithi050 bash[28929]: audit 2024-05-20T22:15:57.914486+0000 mgr.y (mgr.14592) 383 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:15:59.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:58 smithi050 bash[28929]: cluster 2024-05-20T22:15:58.202963+0000 mgr.y (mgr.14592) 384 : cluster 0 pgmap v554: 388 pgs: 388 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:15:59.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:58 smithi050 bash[28929]: cluster 2024-05-20T22:15:58.282830+0000 mon.a (mon.0) 2497 : cluster 0 osdmap e361: 8 total, 8 up, 8 in 2024-05-20T22:15:59.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:15:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:15:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:16:00.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:59 smithi145 bash[23893]: audit 2024-05-20T22:15:58.830366+0000 mon.a (mon.0) 2498 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi050-63944-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi050-63944-65"}]': finished 2024-05-20T22:16:00.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:59 smithi145 bash[23893]: cluster 2024-05-20T22:15:58.837747+0000 mon.a (mon.0) 2499 : cluster 0 osdmap e362: 8 total, 8 up, 8 in 2024-05-20T22:16:00.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:59 smithi145 bash[23893]: audit 2024-05-20T22:15:59.615533+0000 mon.a (mon.0) 2500 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:00.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:15:59 smithi145 bash[23893]: cluster 2024-05-20T22:15:59.658248+0000 mon.a (mon.0) 2501 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:59 smithi050 bash[28929]: audit 2024-05-20T22:15:58.830366+0000 mon.a (mon.0) 2498 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi050-63944-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi050-63944-65"}]': finished 2024-05-20T22:16:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:59 smithi050 bash[28929]: cluster 2024-05-20T22:15:58.837747+0000 mon.a (mon.0) 2499 : cluster 0 osdmap e362: 8 total, 8 up, 8 in 2024-05-20T22:16:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:59 smithi050 bash[28929]: audit 2024-05-20T22:15:59.615533+0000 mon.a (mon.0) 2500 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:15:59 smithi050 bash[28929]: cluster 2024-05-20T22:15:59.658248+0000 mon.a (mon.0) 2501 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:00.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:59 smithi050 bash[21866]: audit 2024-05-20T22:15:58.830366+0000 mon.a (mon.0) 2498 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi050-63944-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi050-63944-65"}]': finished 2024-05-20T22:16:00.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:59 smithi050 bash[21866]: cluster 2024-05-20T22:15:58.837747+0000 mon.a (mon.0) 2499 : cluster 0 osdmap e362: 8 total, 8 up, 8 in 2024-05-20T22:16:00.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:59 smithi050 bash[21866]: audit 2024-05-20T22:15:59.615533+0000 mon.a (mon.0) 2500 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:00.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:15:59 smithi050 bash[21866]: cluster 2024-05-20T22:15:59.658248+0000 mon.a (mon.0) 2501 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:00 smithi145 bash[23893]: audit 2024-05-20T22:15:59.833303+0000 mon.a (mon.0) 2502 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:16:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:00 smithi145 bash[23893]: cluster 2024-05-20T22:15:59.841477+0000 mon.a (mon.0) 2503 : cluster 0 osdmap e363: 8 total, 8 up, 8 in 2024-05-20T22:16:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:00 smithi145 bash[23893]: audit 2024-05-20T22:15:59.849160+0000 mon.a (mon.0) 2504 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-49"}]: dispatch 2024-05-20T22:16:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:00 smithi145 bash[23893]: cluster 2024-05-20T22:16:00.206298+0000 mgr.y (mgr.14592) 385 : cluster 0 pgmap v557: 396 pgs: 4 creating+activating, 392 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:16:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:00 smithi145 bash[23893]: cluster 2024-05-20T22:16:00.833896+0000 mon.a (mon.0) 2505 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:16:01.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:00 smithi145 bash[23893]: audit 2024-05-20T22:16:00.836327+0000 mon.a (mon.0) 2506 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-49"}]': finished 2024-05-20T22:16:01.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:00 smithi145 bash[23893]: cluster 2024-05-20T22:16:00.844084+0000 mon.a (mon.0) 2507 : cluster 0 osdmap e364: 8 total, 8 up, 8 in 2024-05-20T22:16:01.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:00 smithi145 bash[23893]: audit 2024-05-20T22:16:00.853868+0000 mon.a (mon.0) 2508 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi050-63944-65"}]: dispatch 2024-05-20T22:16:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:00 smithi050 bash[28929]: audit 2024-05-20T22:15:59.833303+0000 mon.a (mon.0) 2502 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:16:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:00 smithi050 bash[28929]: cluster 2024-05-20T22:15:59.841477+0000 mon.a (mon.0) 2503 : cluster 0 osdmap e363: 8 total, 8 up, 8 in 2024-05-20T22:16:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:00 smithi050 bash[28929]: audit 2024-05-20T22:15:59.849160+0000 mon.a (mon.0) 2504 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-49"}]: dispatch 2024-05-20T22:16:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:00 smithi050 bash[28929]: cluster 2024-05-20T22:16:00.206298+0000 mgr.y (mgr.14592) 385 : cluster 0 pgmap v557: 396 pgs: 4 creating+activating, 392 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:16:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:00 smithi050 bash[28929]: cluster 2024-05-20T22:16:00.833896+0000 mon.a (mon.0) 2505 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:16:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:00 smithi050 bash[28929]: audit 2024-05-20T22:16:00.836327+0000 mon.a (mon.0) 2506 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-49"}]': finished 2024-05-20T22:16:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:00 smithi050 bash[28929]: cluster 2024-05-20T22:16:00.844084+0000 mon.a (mon.0) 2507 : cluster 0 osdmap e364: 8 total, 8 up, 8 in 2024-05-20T22:16:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:00 smithi050 bash[28929]: audit 2024-05-20T22:16:00.853868+0000 mon.a (mon.0) 2508 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi050-63944-65"}]: dispatch 2024-05-20T22:16:01.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:00 smithi050 bash[21866]: audit 2024-05-20T22:15:59.833303+0000 mon.a (mon.0) 2502 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:16:01.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:00 smithi050 bash[21866]: cluster 2024-05-20T22:15:59.841477+0000 mon.a (mon.0) 2503 : cluster 0 osdmap e363: 8 total, 8 up, 8 in 2024-05-20T22:16:01.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:00 smithi050 bash[21866]: audit 2024-05-20T22:15:59.849160+0000 mon.a (mon.0) 2504 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-49"}]: dispatch 2024-05-20T22:16:01.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:00 smithi050 bash[21866]: cluster 2024-05-20T22:16:00.206298+0000 mgr.y (mgr.14592) 385 : cluster 0 pgmap v557: 396 pgs: 4 creating+activating, 392 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:16:01.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:00 smithi050 bash[21866]: cluster 2024-05-20T22:16:00.833896+0000 mon.a (mon.0) 2505 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:16:01.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:00 smithi050 bash[21866]: audit 2024-05-20T22:16:00.836327+0000 mon.a (mon.0) 2506 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-49"}]': finished 2024-05-20T22:16:01.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:00 smithi050 bash[21866]: cluster 2024-05-20T22:16:00.844084+0000 mon.a (mon.0) 2507 : cluster 0 osdmap e364: 8 total, 8 up, 8 in 2024-05-20T22:16:01.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:00 smithi050 bash[21866]: audit 2024-05-20T22:16:00.853868+0000 mon.a (mon.0) 2508 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi050-63944-65"}]: dispatch 2024-05-20T22:16:01.843 INFO:tasks.workunit.client.0.smithi050.stdout:163:head 2024-05-20T22:16:01.844 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:5d165639:::164:head 2024-05-20T22:16:01.844 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:f43765fc:::165:head 2024-05-20T22:16:01.844 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:b4c720e9:::166:head 2024-05-20T22:16:01.844 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:e694b040:::167:head 2024-05-20T22:16:01.844 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:afa38db2:::168:head 2024-05-20T22:16:01.844 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:77ba9f53:::169:head 2024-05-20T22:16:01.844 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:87495034:::170:head 2024-05-20T22:16:01.844 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:7c96bf0e:::171:head 2024-05-20T22:16:01.844 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:dbe346cc:::172:head 2024-05-20T22:16:01.844 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:e943ec24:::173:head 2024-05-20T22:16:01.844 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:f97a9c0c:::174:head 2024-05-20T22:16:01.845 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:6f26e74d:::175:head 2024-05-20T22:16:01.845 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:4f95e106:::176:head 2024-05-20T22:16:01.845 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:0e6f2f8f:::177:head 2024-05-20T22:16:01.845 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:05db05f1:::178:head 2024-05-20T22:16:01.845 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:38a78d66:::179:head 2024-05-20T22:16:01.845 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:d095610b:::180:head 2024-05-20T22:16:01.845 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:a1a9d709:::181:head 2024-05-20T22:16:01.845 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:1e5d39db:::182:head 2024-05-20T22:16:01.845 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:f7df4fb9:::183:head 2024-05-20T22:16:01.845 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:03a7f161:::184:head 2024-05-20T22:16:01.845 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:ba70721e:::185:head 2024-05-20T22:16:01.845 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:28e5662d:::186:head 2024-05-20T22:16:01.845 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:973d52de:::187:head 2024-05-20T22:16:01.845 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:4303eb1c:::188:head 2024-05-20T22:16:01.846 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:b990b48e:::189:head 2024-05-20T22:16:01.846 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:29b8165b:::190:head 2024-05-20T22:16:01.846 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:3547f197:::191:head 2024-05-20T22:16:01.846 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:7e260936:::192:head 2024-05-20T22:16:01.846 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:1abec7b1:::193:head 2024-05-20T22:16:01.846 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:10fdda93:::194:head 2024-05-20T22:16:01.846 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:15817eea:::195:head 2024-05-20T22:16:01.846 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:770bab57:::196:head 2024-05-20T22:16:01.846 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:ed9e13e7:::197:head 2024-05-20T22:16:01.846 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:71471a8f:::198:head 2024-05-20T22:16:01.846 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: checking for 259:10fb1d02:::199:head 2024-05-20T22:16:01.846 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (9029 ms) 2024-05-20T22:16:01.846 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-05-20T22:16:01.847 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243316,0 2024-05-20T22:16:01.847 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: first is 1716243316 2024-05-20T22:16:01.847 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243316,0 2024-05-20T22:16:01.847 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243316,0 2024-05-20T22:16:01.847 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243316,1716243318,1716243319,0 2024-05-20T22:16:01.847 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243316,1716243318,1716243319,0 2024-05-20T22:16:01.847 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243316,1716243318,1716243319,0 2024-05-20T22:16:01.847 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243316,1716243318,1716243319,1716243321,1716243322,0 2024-05-20T22:16:01.847 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243316,1716243318,1716243319,1716243321,1716243322,0 2024-05-20T22:16:01.847 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243316,1716243318,1716243319,1716243321,1716243322,0 2024-05-20T22:16:01.847 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243316,1716243318,1716243319,1716243321,1716243322,1716243324,1716243325,0 2024-05-20T22:16:01.847 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243316,1716243318,1716243319,1716243321,1716243322,1716243324,1716243325,0 2024-05-20T22:16:01.847 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243316,1716243318,1716243319,1716243321,1716243322,1716243324,1716243325,0 2024-05-20T22:16:01.847 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243319,1716243321,1716243322,1716243324,1716243325,1716243327,1716243328,0 2024-05-20T22:16:01.847 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: first now 1716243319, trimmed 2024-05-20T22:16:01.848 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (21652 ms) 2024-05-20T22:16:01.848 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-05-20T22:16:01.848 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: foo0 2024-05-20T22:16:01.848 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-05-20T22:16:01.848 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (14084 ms) 2024-05-20T22:16:01.848 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-05-20T22:16:02.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:02 smithi145 bash[23893]: audit 2024-05-20T22:16:00.925121+0000 mon.a (mon.0) 2509 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:02.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:02 smithi145 bash[23893]: audit 2024-05-20T22:16:00.925993+0000 mon.a (mon.0) 2510 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-49"}]: dispatch 2024-05-20T22:16:02.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:02 smithi145 bash[23893]: audit 2024-05-20T22:16:01.839146+0000 mon.a (mon.0) 2511 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi050-63944-65"}]': finished 2024-05-20T22:16:02.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:02 smithi145 bash[23893]: cluster 2024-05-20T22:16:01.845832+0000 mon.a (mon.0) 2512 : cluster 0 osdmap e365: 8 total, 8 up, 8 in 2024-05-20T22:16:02.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:02 smithi145 bash[23893]: audit 2024-05-20T22:16:01.848263+0000 mon.a (mon.0) 2513 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi050-63944-65"}]: dispatch 2024-05-20T22:16:02.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:02 smithi050 bash[21866]: audit 2024-05-20T22:16:00.925121+0000 mon.a (mon.0) 2509 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:02.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:02 smithi050 bash[21866]: audit 2024-05-20T22:16:00.925993+0000 mon.a (mon.0) 2510 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-49"}]: dispatch 2024-05-20T22:16:02.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:02 smithi050 bash[21866]: audit 2024-05-20T22:16:01.839146+0000 mon.a (mon.0) 2511 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi050-63944-65"}]': finished 2024-05-20T22:16:02.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:02 smithi050 bash[21866]: cluster 2024-05-20T22:16:01.845832+0000 mon.a (mon.0) 2512 : cluster 0 osdmap e365: 8 total, 8 up, 8 in 2024-05-20T22:16:02.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:02 smithi050 bash[21866]: audit 2024-05-20T22:16:01.848263+0000 mon.a (mon.0) 2513 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi050-63944-65"}]: dispatch 2024-05-20T22:16:02.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:02 smithi050 bash[28929]: audit 2024-05-20T22:16:00.925121+0000 mon.a (mon.0) 2509 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:02.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:02 smithi050 bash[28929]: audit 2024-05-20T22:16:00.925993+0000 mon.a (mon.0) 2510 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-49"}]: dispatch 2024-05-20T22:16:02.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:02 smithi050 bash[28929]: audit 2024-05-20T22:16:01.839146+0000 mon.a (mon.0) 2511 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi050-63944-65"}]': finished 2024-05-20T22:16:02.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:02 smithi050 bash[28929]: cluster 2024-05-20T22:16:01.845832+0000 mon.a (mon.0) 2512 : cluster 0 osdmap e365: 8 total, 8 up, 8 in 2024-05-20T22:16:02.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:02 smithi050 bash[28929]: audit 2024-05-20T22:16:01.848263+0000 mon.a (mon.0) 2513 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi050-63944-65"}]: dispatch 2024-05-20T22:16:03.101 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ started 0x5574088679f0 2024-05-20T22:16:03.101 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408867430 2024-05-20T22:16:03.102 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408867560 2024-05-20T22:16:03.102 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408867690 2024-05-20T22:16:03.102 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088677c0 2024-05-20T22:16:03.102 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408867fd0 2024-05-20T22:16:03.102 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408867b20 2024-05-20T22:16:03.102 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408867c50 2024-05-20T22:16:03.102 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408867da0 2024-05-20T22:16:03.102 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408868100 2024-05-20T22:16:03.102 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408868620 2024-05-20T22:16:03.102 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408868750 2024-05-20T22:16:03.102 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408867eb0 2024-05-20T22:16:03.102 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408868230 2024-05-20T22:16:03.103 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408868360 2024-05-20T22:16:03.103 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408868490 2024-05-20T22:16:03.103 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408868d30 2024-05-20T22:16:03.103 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408868880 2024-05-20T22:16:03.103 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408865190 2024-05-20T22:16:03.103 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088652c0 2024-05-20T22:16:03.103 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088653f0 2024-05-20T22:16:03.103 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408869310 2024-05-20T22:16:03.103 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408868e60 2024-05-20T22:16:03.103 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408868fb0 2024-05-20T22:16:03.103 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408869100 2024-05-20T22:16:03.103 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408869460 2024-05-20T22:16:03.103 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088695b0 2024-05-20T22:16:03.104 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408869bb0 2024-05-20T22:16:03.104 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408869700 2024-05-20T22:16:03.104 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408869830 2024-05-20T22:16:03.104 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408869940 2024-05-20T22:16:03.104 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408869a70 2024-05-20T22:16:03.104 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886a170 2024-05-20T22:16:03.104 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408869cc0 2024-05-20T22:16:03.104 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408869e10 2024-05-20T22:16:03.104 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408869f20 2024-05-20T22:16:03.104 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886a2c0 2024-05-20T22:16:03.104 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886a790 2024-05-20T22:16:03.104 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886a8c0 2024-05-20T22:16:03.104 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886a050 2024-05-20T22:16:03.104 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886a9f0 2024-05-20T22:16:03.105 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886ab40 2024-05-20T22:16:03.105 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886b140 2024-05-20T22:16:03.105 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408868990 2024-05-20T22:16:03.105 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408868ac0 2024-05-20T22:16:03.105 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408868bf0 2024-05-20T22:16:03.105 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886b270 2024-05-20T22:16:03.105 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886ac90 2024-05-20T22:16:03.105 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886adc0 2024-05-20T22:16:03.105 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886af10 2024-05-20T22:16:03.105 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886b3a0 2024-05-20T22:16:03.105 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886b890 2024-05-20T22:16:03.105 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886b9c0 2024-05-20T22:16:03.105 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886b020 2024-05-20T22:16:03.105 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886baf0 2024-05-20T22:16:03.105 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886bc40 2024-05-20T22:16:03.106 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886b4f0 2024-05-20T22:16:03.106 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886b620 2024-05-20T22:16:03.106 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886b730 2024-05-20T22:16:03.106 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886bd90 2024-05-20T22:16:03.106 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886c280 2024-05-20T22:16:03.106 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886c3b0 2024-05-20T22:16:03.106 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886c990 2024-05-20T22:16:03.106 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886bee0 2024-05-20T22:16:03.106 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886c010 2024-05-20T22:16:03.106 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886c160 2024-05-20T22:16:03.106 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886cac0 2024-05-20T22:16:03.106 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886c4e0 2024-05-20T22:16:03.106 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886c610 2024-05-20T22:16:03.106 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886c760 2024-05-20T22:16:03.107 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886cbf0 2024-05-20T22:16:03.107 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886d0a0 2024-05-20T22:16:03.107 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886d1f0 2024-05-20T22:16:03.107 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886d7b0 2024-05-20T22:16:03.107 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886cd00 2024-05-20T22:16:03.107 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886ce50 2024-05-20T22:16:03.107 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886cf80 2024-05-20T22:16:03.107 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886d8c0 2024-05-20T22:16:03.107 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886d300 2024-05-20T22:16:03.107 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886d430 2024-05-20T22:16:03.107 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886d560 2024-05-20T22:16:03.107 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886d9f0 2024-05-20T22:16:03.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:03 smithi145 bash[23893]: cluster 2024-05-20T22:16:02.207227+0000 mgr.y (mgr.14592) 386 : cluster 0 pgmap v560: 356 pgs: 356 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:16:03.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:03 smithi145 bash[23893]: audit 2024-05-20T22:16:02.849892+0000 mon.a (mon.0) 2514 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi050-63944-65"}]': finished 2024-05-20T22:16:03.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:03 smithi145 bash[23893]: cluster 2024-05-20T22:16:02.857195+0000 mon.a (mon.0) 2515 : cluster 0 osdmap e366: 8 total, 8 up, 8 in 2024-05-20T22:16:03.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:03 smithi145 bash[23893]: audit 2024-05-20T22:16:02.864126+0000 mon.a (mon.0) 2516 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:03.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:03 smithi145 bash[23893]: audit 2024-05-20T22:16:02.914241+0000 mon.c (mon.2) 359 : audit 1 from='client.? v1:172.21.15.50:0/2643978082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:03.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:03 smithi145 bash[23893]: audit 2024-05-20T22:16:02.914921+0000 mon.a (mon.0) 2517 : audit 1 from='client.26252 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:03.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:03 smithi145 bash[23893]: audit 2024-05-20T22:16:02.915824+0000 mon.c (mon.2) 360 : audit 1 from='client.? v1:172.21.15.50:0/2643978082' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:03.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:03 smithi145 bash[23893]: audit 2024-05-20T22:16:02.916152+0000 mon.a (mon.0) 2518 : audit 1 from='client.26252 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:03.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:03 smithi145 bash[23893]: audit 2024-05-20T22:16:02.916628+0000 mon.c (mon.2) 361 : audit 1 from='client.? v1:172.21.15.50:0/2643978082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi050-63944-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:16:03.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:03 smithi145 bash[23893]: audit 2024-05-20T22:16:02.916929+0000 mon.a (mon.0) 2519 : audit 1 from='client.26252 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi050-63944-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:16:03.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:03 smithi050 bash[21866]: cluster 2024-05-20T22:16:02.207227+0000 mgr.y (mgr.14592) 386 : cluster 0 pgmap v560: 356 pgs: 356 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:16:03.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:03 smithi050 bash[21866]: audit 2024-05-20T22:16:02.849892+0000 mon.a (mon.0) 2514 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi050-63944-65"}]': finished 2024-05-20T22:16:03.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:03 smithi050 bash[21866]: cluster 2024-05-20T22:16:02.857195+0000 mon.a (mon.0) 2515 : cluster 0 osdmap e366: 8 total, 8 up, 8 in 2024-05-20T22:16:03.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:03 smithi050 bash[21866]: audit 2024-05-20T22:16:02.864126+0000 mon.a (mon.0) 2516 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:03.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:03 smithi050 bash[21866]: audit 2024-05-20T22:16:02.914241+0000 mon.c (mon.2) 359 : audit 1 from='client.? v1:172.21.15.50:0/2643978082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:03.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:03 smithi050 bash[21866]: audit 2024-05-20T22:16:02.914921+0000 mon.a (mon.0) 2517 : audit 1 from='client.26252 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:03.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:03 smithi050 bash[21866]: audit 2024-05-20T22:16:02.915824+0000 mon.c (mon.2) 360 : audit 1 from='client.? v1:172.21.15.50:0/2643978082' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:03.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:03 smithi050 bash[21866]: audit 2024-05-20T22:16:02.916152+0000 mon.a (mon.0) 2518 : audit 1 from='client.26252 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:03.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:03 smithi050 bash[21866]: audit 2024-05-20T22:16:02.916628+0000 mon.c (mon.2) 361 : audit 1 from='client.? v1:172.21.15.50:0/2643978082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi050-63944-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:16:03.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:03 smithi050 bash[21866]: audit 2024-05-20T22:16:02.916929+0000 mon.a (mon.0) 2519 : audit 1 from='client.26252 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi050-63944-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:16:03.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:03 smithi050 bash[28929]: cluster 2024-05-20T22:16:02.207227+0000 mgr.y (mgr.14592) 386 : cluster 0 pgmap v560: 356 pgs: 356 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:16:03.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:03 smithi050 bash[28929]: audit 2024-05-20T22:16:02.849892+0000 mon.a (mon.0) 2514 : audit 1 from='client.? v1:172.21.15.50:0/2824739800' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi050-63944-65"}]': finished 2024-05-20T22:16:03.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:03 smithi050 bash[28929]: cluster 2024-05-20T22:16:02.857195+0000 mon.a (mon.0) 2515 : cluster 0 osdmap e366: 8 total, 8 up, 8 in 2024-05-20T22:16:03.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:03 smithi050 bash[28929]: audit 2024-05-20T22:16:02.864126+0000 mon.a (mon.0) 2516 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:03.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:03 smithi050 bash[28929]: audit 2024-05-20T22:16:02.914241+0000 mon.c (mon.2) 359 : audit 1 from='client.? v1:172.21.15.50:0/2643978082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:03.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:03 smithi050 bash[28929]: audit 2024-05-20T22:16:02.914921+0000 mon.a (mon.0) 2517 : audit 1 from='client.26252 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:03.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:03 smithi050 bash[28929]: audit 2024-05-20T22:16:02.915824+0000 mon.c (mon.2) 360 : audit 1 from='client.? v1:172.21.15.50:0/2643978082' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:03.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:03 smithi050 bash[28929]: audit 2024-05-20T22:16:02.916152+0000 mon.a (mon.0) 2518 : audit 1 from='client.26252 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:03.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:03 smithi050 bash[28929]: audit 2024-05-20T22:16:02.916628+0000 mon.c (mon.2) 361 : audit 1 from='client.? v1:172.21.15.50:0/2643978082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi050-63944-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:16:03.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:03 smithi050 bash[28929]: audit 2024-05-20T22:16:02.916929+0000 mon.a (mon.0) 2519 : audit 1 from='client.26252 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi050-63944-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:16:05.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:04 smithi145 bash[23893]: audit 2024-05-20T22:16:03.853399+0000 mon.a (mon.0) 2520 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:05.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:04 smithi145 bash[23893]: audit 2024-05-20T22:16:03.853597+0000 mon.a (mon.0) 2521 : audit 1 from='client.26252 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi050-63944-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:16:05.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:04 smithi145 bash[23893]: cluster 2024-05-20T22:16:03.861468+0000 mon.a (mon.0) 2522 : cluster 0 osdmap e367: 8 total, 8 up, 8 in 2024-05-20T22:16:05.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:04 smithi145 bash[23893]: audit 2024-05-20T22:16:03.864739+0000 mon.c (mon.2) 362 : audit 1 from='client.? v1:172.21.15.50:0/2643978082' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi050-63944-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:05.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:04 smithi145 bash[23893]: audit 2024-05-20T22:16:03.869840+0000 mon.a (mon.0) 2523 : audit 1 from='client.26252 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi050-63944-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:05.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:04 smithi145 bash[23893]: audit 2024-05-20T22:16:03.925773+0000 mon.a (mon.0) 2524 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:16:05.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:04 smithi145 bash[23893]: cluster 2024-05-20T22:16:04.208234+0000 mgr.y (mgr.14592) 387 : cluster 0 pgmap v563: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:16:05.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:04 smithi050 bash[21866]: audit 2024-05-20T22:16:03.853399+0000 mon.a (mon.0) 2520 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:05.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:04 smithi050 bash[21866]: audit 2024-05-20T22:16:03.853597+0000 mon.a (mon.0) 2521 : audit 1 from='client.26252 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi050-63944-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:16:05.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:04 smithi050 bash[21866]: cluster 2024-05-20T22:16:03.861468+0000 mon.a (mon.0) 2522 : cluster 0 osdmap e367: 8 total, 8 up, 8 in 2024-05-20T22:16:05.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:04 smithi050 bash[21866]: audit 2024-05-20T22:16:03.864739+0000 mon.c (mon.2) 362 : audit 1 from='client.? v1:172.21.15.50:0/2643978082' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi050-63944-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:05.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:04 smithi050 bash[21866]: audit 2024-05-20T22:16:03.869840+0000 mon.a (mon.0) 2523 : audit 1 from='client.26252 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi050-63944-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:05.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:04 smithi050 bash[21866]: audit 2024-05-20T22:16:03.925773+0000 mon.a (mon.0) 2524 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:16:05.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:04 smithi050 bash[21866]: cluster 2024-05-20T22:16:04.208234+0000 mgr.y (mgr.14592) 387 : cluster 0 pgmap v563: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:16:05.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:04 smithi050 bash[28929]: audit 2024-05-20T22:16:03.853399+0000 mon.a (mon.0) 2520 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:05.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:04 smithi050 bash[28929]: audit 2024-05-20T22:16:03.853597+0000 mon.a (mon.0) 2521 : audit 1 from='client.26252 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi050-63944-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:16:05.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:04 smithi050 bash[28929]: cluster 2024-05-20T22:16:03.861468+0000 mon.a (mon.0) 2522 : cluster 0 osdmap e367: 8 total, 8 up, 8 in 2024-05-20T22:16:05.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:04 smithi050 bash[28929]: audit 2024-05-20T22:16:03.864739+0000 mon.c (mon.2) 362 : audit 1 from='client.? v1:172.21.15.50:0/2643978082' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi050-63944-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:05.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:04 smithi050 bash[28929]: audit 2024-05-20T22:16:03.869840+0000 mon.a (mon.0) 2523 : audit 1 from='client.26252 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi050-63944-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:05.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:04 smithi050 bash[28929]: audit 2024-05-20T22:16:03.925773+0000 mon.a (mon.0) 2524 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:16:05.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:04 smithi050 bash[28929]: cluster 2024-05-20T22:16:04.208234+0000 mgr.y (mgr.14592) 387 : cluster 0 pgmap v563: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:16:06.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:05 smithi145 bash[23893]: audit 2024-05-20T22:16:04.863097+0000 mon.a (mon.0) 2525 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-51", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:16:06.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:05 smithi145 bash[23893]: cluster 2024-05-20T22:16:05.340869+0000 mon.a (mon.0) 2526 : cluster 0 osdmap e368: 8 total, 8 up, 8 in 2024-05-20T22:16:06.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:05 smithi145 bash[23893]: audit 2024-05-20T22:16:05.342384+0000 mon.a (mon.0) 2527 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-51"}]: dispatch 2024-05-20T22:16:06.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:05 smithi050 bash[21866]: audit 2024-05-20T22:16:04.863097+0000 mon.a (mon.0) 2525 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-51", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:16:06.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:05 smithi050 bash[21866]: cluster 2024-05-20T22:16:05.340869+0000 mon.a (mon.0) 2526 : cluster 0 osdmap e368: 8 total, 8 up, 8 in 2024-05-20T22:16:06.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:05 smithi050 bash[21866]: audit 2024-05-20T22:16:05.342384+0000 mon.a (mon.0) 2527 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-51"}]: dispatch 2024-05-20T22:16:06.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:05 smithi050 bash[28929]: audit 2024-05-20T22:16:04.863097+0000 mon.a (mon.0) 2525 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-51", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:16:06.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:05 smithi050 bash[28929]: cluster 2024-05-20T22:16:05.340869+0000 mon.a (mon.0) 2526 : cluster 0 osdmap e368: 8 total, 8 up, 8 in 2024-05-20T22:16:06.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:05 smithi050 bash[28929]: audit 2024-05-20T22:16:05.342384+0000 mon.a (mon.0) 2527 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-51"}]: dispatch 2024-05-20T22:16:07.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:06 smithi050 bash[21866]: audit 2024-05-20T22:16:05.876075+0000 mon.a (mon.0) 2528 : audit 1 from='client.26252 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi050-63944-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi050-63944-66"}]': finished 2024-05-20T22:16:07.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:06 smithi050 bash[21866]: audit 2024-05-20T22:16:05.876347+0000 mon.a (mon.0) 2529 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-51"}]': finished 2024-05-20T22:16:07.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:06 smithi050 bash[21866]: cluster 2024-05-20T22:16:05.884463+0000 mon.a (mon.0) 2530 : cluster 0 osdmap e369: 8 total, 8 up, 8 in 2024-05-20T22:16:07.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:06 smithi050 bash[21866]: audit 2024-05-20T22:16:05.888849+0000 mon.a (mon.0) 2531 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-51", "mode": "writeback"}]: dispatch 2024-05-20T22:16:07.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:06 smithi050 bash[21866]: cluster 2024-05-20T22:16:06.209229+0000 mgr.y (mgr.14592) 388 : cluster 0 pgmap v566: 396 pgs: 8 unknown, 388 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-05-20T22:16:07.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:06 smithi050 bash[28929]: audit 2024-05-20T22:16:05.876075+0000 mon.a (mon.0) 2528 : audit 1 from='client.26252 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi050-63944-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi050-63944-66"}]': finished 2024-05-20T22:16:07.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:06 smithi050 bash[28929]: audit 2024-05-20T22:16:05.876347+0000 mon.a (mon.0) 2529 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-51"}]': finished 2024-05-20T22:16:07.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:06 smithi050 bash[28929]: cluster 2024-05-20T22:16:05.884463+0000 mon.a (mon.0) 2530 : cluster 0 osdmap e369: 8 total, 8 up, 8 in 2024-05-20T22:16:07.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:06 smithi050 bash[28929]: audit 2024-05-20T22:16:05.888849+0000 mon.a (mon.0) 2531 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-51", "mode": "writeback"}]: dispatch 2024-05-20T22:16:07.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:06 smithi050 bash[28929]: cluster 2024-05-20T22:16:06.209229+0000 mgr.y (mgr.14592) 388 : cluster 0 pgmap v566: 396 pgs: 8 unknown, 388 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-05-20T22:16:07.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:06 smithi145 bash[23893]: audit 2024-05-20T22:16:05.876075+0000 mon.a (mon.0) 2528 : audit 1 from='client.26252 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi050-63944-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi050-63944-66"}]': finished 2024-05-20T22:16:07.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:06 smithi145 bash[23893]: audit 2024-05-20T22:16:05.876347+0000 mon.a (mon.0) 2529 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-51"}]': finished 2024-05-20T22:16:07.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:06 smithi145 bash[23893]: cluster 2024-05-20T22:16:05.884463+0000 mon.a (mon.0) 2530 : cluster 0 osdmap e369: 8 total, 8 up, 8 in 2024-05-20T22:16:07.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:06 smithi145 bash[23893]: audit 2024-05-20T22:16:05.888849+0000 mon.a (mon.0) 2531 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-51", "mode": "writeback"}]: dispatch 2024-05-20T22:16:07.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:06 smithi145 bash[23893]: cluster 2024-05-20T22:16:06.209229+0000 mgr.y (mgr.14592) 388 : cluster 0 pgmap v566: 396 pgs: 8 unknown, 388 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-05-20T22:16:08.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:07 smithi050 bash[21866]: cluster 2024-05-20T22:16:06.876700+0000 mon.a (mon.0) 2532 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:16:08.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:07 smithi050 bash[21866]: cluster 2024-05-20T22:16:06.877581+0000 mon.a (mon.0) 2533 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:08.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:07 smithi050 bash[21866]: audit 2024-05-20T22:16:06.879277+0000 mon.a (mon.0) 2534 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-51", "mode": "writeback"}]': finished 2024-05-20T22:16:08.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:07 smithi050 bash[21866]: cluster 2024-05-20T22:16:06.887109+0000 mon.a (mon.0) 2535 : cluster 0 osdmap e370: 8 total, 8 up, 8 in 2024-05-20T22:16:08.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:07 smithi050 bash[21866]: audit 2024-05-20T22:16:06.986287+0000 mon.a (mon.0) 2536 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:16:08.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:07 smithi050 bash[21866]: audit 2024-05-20T22:16:07.224537+0000 mon.a (mon.0) 2537 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:16:08.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:07 smithi050 bash[28929]: cluster 2024-05-20T22:16:06.876700+0000 mon.a (mon.0) 2532 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:16:08.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:07 smithi050 bash[28929]: cluster 2024-05-20T22:16:06.877581+0000 mon.a (mon.0) 2533 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:08.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:07 smithi050 bash[28929]: audit 2024-05-20T22:16:06.879277+0000 mon.a (mon.0) 2534 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-51", "mode": "writeback"}]': finished 2024-05-20T22:16:08.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:07 smithi050 bash[28929]: cluster 2024-05-20T22:16:06.887109+0000 mon.a (mon.0) 2535 : cluster 0 osdmap e370: 8 total, 8 up, 8 in 2024-05-20T22:16:08.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:07 smithi050 bash[28929]: audit 2024-05-20T22:16:06.986287+0000 mon.a (mon.0) 2536 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:16:08.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:07 smithi050 bash[28929]: audit 2024-05-20T22:16:07.224537+0000 mon.a (mon.0) 2537 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:16:08.391 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:16:07 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:16:08.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:07 smithi145 bash[23893]: cluster 2024-05-20T22:16:06.876700+0000 mon.a (mon.0) 2532 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:16:08.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:07 smithi145 bash[23893]: cluster 2024-05-20T22:16:06.877581+0000 mon.a (mon.0) 2533 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:08.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:07 smithi145 bash[23893]: audit 2024-05-20T22:16:06.879277+0000 mon.a (mon.0) 2534 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-51", "mode": "writeback"}]': finished 2024-05-20T22:16:08.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:07 smithi145 bash[23893]: cluster 2024-05-20T22:16:06.887109+0000 mon.a (mon.0) 2535 : cluster 0 osdmap e370: 8 total, 8 up, 8 in 2024-05-20T22:16:08.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:07 smithi145 bash[23893]: audit 2024-05-20T22:16:06.986287+0000 mon.a (mon.0) 2536 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:16:08.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:07 smithi145 bash[23893]: audit 2024-05-20T22:16:07.224537+0000 mon.a (mon.0) 2537 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:16:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:08 smithi050 bash[21866]: audit 2024-05-20T22:16:07.912595+0000 mon.a (mon.0) 2538 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:16:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:08 smithi050 bash[21866]: cluster 2024-05-20T22:16:07.920215+0000 mon.a (mon.0) 2539 : cluster 0 osdmap e371: 8 total, 8 up, 8 in 2024-05-20T22:16:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:08 smithi050 bash[21866]: audit 2024-05-20T22:16:07.923046+0000 mgr.y (mgr.14592) 389 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:16:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:08 smithi050 bash[21866]: audit 2024-05-20T22:16:07.926476+0000 mon.c (mon.2) 363 : audit 1 from='client.? v1:172.21.15.50:0/2643978082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:08 smithi050 bash[21866]: audit 2024-05-20T22:16:07.927239+0000 mon.a (mon.0) 2540 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:16:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:08 smithi050 bash[21866]: audit 2024-05-20T22:16:07.928192+0000 mon.a (mon.0) 2541 : audit 1 from='client.26252 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:08 smithi050 bash[21866]: cluster 2024-05-20T22:16:08.210199+0000 mgr.y (mgr.14592) 390 : cluster 0 pgmap v569: 388 pgs: 388 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-05-20T22:16:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:08 smithi050 bash[28929]: audit 2024-05-20T22:16:07.912595+0000 mon.a (mon.0) 2538 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:16:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:08 smithi050 bash[28929]: cluster 2024-05-20T22:16:07.920215+0000 mon.a (mon.0) 2539 : cluster 0 osdmap e371: 8 total, 8 up, 8 in 2024-05-20T22:16:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:08 smithi050 bash[28929]: audit 2024-05-20T22:16:07.923046+0000 mgr.y (mgr.14592) 389 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:16:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:08 smithi050 bash[28929]: audit 2024-05-20T22:16:07.926476+0000 mon.c (mon.2) 363 : audit 1 from='client.? v1:172.21.15.50:0/2643978082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:08 smithi050 bash[28929]: audit 2024-05-20T22:16:07.927239+0000 mon.a (mon.0) 2540 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:16:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:08 smithi050 bash[28929]: audit 2024-05-20T22:16:07.928192+0000 mon.a (mon.0) 2541 : audit 1 from='client.26252 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:08 smithi050 bash[28929]: cluster 2024-05-20T22:16:08.210199+0000 mgr.y (mgr.14592) 390 : cluster 0 pgmap v569: 388 pgs: 388 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-05-20T22:16:09.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:08 smithi145 bash[23893]: audit 2024-05-20T22:16:07.912595+0000 mon.a (mon.0) 2538 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:16:09.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:08 smithi145 bash[23893]: cluster 2024-05-20T22:16:07.920215+0000 mon.a (mon.0) 2539 : cluster 0 osdmap e371: 8 total, 8 up, 8 in 2024-05-20T22:16:09.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:08 smithi145 bash[23893]: audit 2024-05-20T22:16:07.923046+0000 mgr.y (mgr.14592) 389 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:16:09.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:08 smithi145 bash[23893]: audit 2024-05-20T22:16:07.926476+0000 mon.c (mon.2) 363 : audit 1 from='client.? v1:172.21.15.50:0/2643978082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:09.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:08 smithi145 bash[23893]: audit 2024-05-20T22:16:07.927239+0000 mon.a (mon.0) 2540 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:16:09.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:08 smithi145 bash[23893]: audit 2024-05-20T22:16:07.928192+0000 mon.a (mon.0) 2541 : audit 1 from='client.26252 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:09.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:08 smithi145 bash[23893]: cluster 2024-05-20T22:16:08.210199+0000 mgr.y (mgr.14592) 390 : cluster 0 pgmap v569: 388 pgs: 388 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-05-20T22:16:09.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:16:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:16:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:16:09.956 INFO:tasks.workunit.client.0.smithi050.stdout: api_m api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3034 ms) 2024-05-20T22:16:09.956 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2024-05-20T22:16:09.956 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (7047 ms) 2024-05-20T22:16:09.956 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-05-20T22:16:09.957 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (7057 ms) 2024-05-20T22:16:09.957 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2024-05-20T22:16:09.957 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7041 ms) 2024-05-20T22:16:09.957 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2024-05-20T22:16:09.957 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7039 ms) 2024-05-20T22:16:09.957 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2024-05-20T22:16:09.957 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7061 ms) 2024-05-20T22:16:09.957 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2024-05-20T22:16:09.958 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (7087 ms) 2024-05-20T22:16:09.958 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (139974 ms total) 2024-05-20T22:16:09.958 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: 2024-05-20T22:16:09.958 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [----------] Global test environment tear-down 2024-05-20T22:16:09.958 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [==========] 57 tests from 4 test suites ran. (323238 ms total) 2024-05-20T22:16:09.958 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ PASSED ] 57 tests. 2024-05-20T22:16:10.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:09 smithi050 bash[21866]: audit 2024-05-20T22:16:08.924875+0000 mon.a (mon.0) 2542 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:16:10.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:09 smithi050 bash[21866]: audit 2024-05-20T22:16:08.925092+0000 mon.a (mon.0) 2543 : audit 1 from='client.26252 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi050-63944-66"}]': finished 2024-05-20T22:16:10.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:09 smithi050 bash[21866]: cluster 2024-05-20T22:16:08.934584+0000 mon.a (mon.0) 2544 : cluster 0 osdmap e372: 8 total, 8 up, 8 in 2024-05-20T22:16:10.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:09 smithi050 bash[21866]: audit 2024-05-20T22:16:08.938326+0000 mon.a (mon.0) 2545 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:16:10.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:09 smithi050 bash[21866]: audit 2024-05-20T22:16:08.938475+0000 mon.c (mon.2) 364 : audit 1 from='client.? v1:172.21.15.50:0/2643978082' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:10.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:09 smithi050 bash[21866]: audit 2024-05-20T22:16:08.942312+0000 mon.a (mon.0) 2546 : audit 1 from='client.26252 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:10.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:09 smithi050 bash[28929]: audit 2024-05-20T22:16:08.924875+0000 mon.a (mon.0) 2542 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:16:10.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:09 smithi050 bash[28929]: audit 2024-05-20T22:16:08.925092+0000 mon.a (mon.0) 2543 : audit 1 from='client.26252 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi050-63944-66"}]': finished 2024-05-20T22:16:10.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:09 smithi050 bash[28929]: cluster 2024-05-20T22:16:08.934584+0000 mon.a (mon.0) 2544 : cluster 0 osdmap e372: 8 total, 8 up, 8 in 2024-05-20T22:16:10.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:09 smithi050 bash[28929]: audit 2024-05-20T22:16:08.938326+0000 mon.a (mon.0) 2545 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:16:10.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:09 smithi050 bash[28929]: audit 2024-05-20T22:16:08.938475+0000 mon.c (mon.2) 364 : audit 1 from='client.? v1:172.21.15.50:0/2643978082' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:10.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:09 smithi050 bash[28929]: audit 2024-05-20T22:16:08.942312+0000 mon.a (mon.0) 2546 : audit 1 from='client.26252 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:10.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:09 smithi145 bash[23893]: audit 2024-05-20T22:16:08.924875+0000 mon.a (mon.0) 2542 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:16:10.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:09 smithi145 bash[23893]: audit 2024-05-20T22:16:08.925092+0000 mon.a (mon.0) 2543 : audit 1 from='client.26252 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi050-63944-66"}]': finished 2024-05-20T22:16:10.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:09 smithi145 bash[23893]: cluster 2024-05-20T22:16:08.934584+0000 mon.a (mon.0) 2544 : cluster 0 osdmap e372: 8 total, 8 up, 8 in 2024-05-20T22:16:10.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:09 smithi145 bash[23893]: audit 2024-05-20T22:16:08.938326+0000 mon.a (mon.0) 2545 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:16:10.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:09 smithi145 bash[23893]: audit 2024-05-20T22:16:08.938475+0000 mon.c (mon.2) 364 : audit 1 from='client.? v1:172.21.15.50:0/2643978082' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:10.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:09 smithi145 bash[23893]: audit 2024-05-20T22:16:08.942312+0000 mon.a (mon.0) 2546 : audit 1 from='client.26252 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi050-63944-66"}]: dispatch 2024-05-20T22:16:11.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:10 smithi050 bash[21866]: cluster 2024-05-20T22:16:09.926230+0000 mon.a (mon.0) 2547 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:16:11.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:10 smithi050 bash[21866]: audit 2024-05-20T22:16:09.928645+0000 mon.a (mon.0) 2548 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:16:11.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:10 smithi050 bash[21866]: audit 2024-05-20T22:16:09.928884+0000 mon.a (mon.0) 2549 : audit 1 from='client.26252 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi050-63944-66"}]': finished 2024-05-20T22:16:11.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:10 smithi050 bash[21866]: cluster 2024-05-20T22:16:09.935911+0000 mon.a (mon.0) 2550 : cluster 0 osdmap e373: 8 total, 8 up, 8 in 2024-05-20T22:16:11.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:10 smithi050 bash[21866]: audit 2024-05-20T22:16:09.938184+0000 mon.a (mon.0) 2551 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-05-20T22:16:11.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:10 smithi050 bash[21866]: cluster 2024-05-20T22:16:10.213495+0000 mgr.y (mgr.14592) 391 : cluster 0 pgmap v572: 388 pgs: 388 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-20T22:16:11.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:10 smithi050 bash[21866]: audit 2024-05-20T22:16:10.931426+0000 mon.a (mon.0) 2552 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-05-20T22:16:11.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:10 smithi050 bash[21866]: cluster 2024-05-20T22:16:10.938380+0000 mon.a (mon.0) 2553 : cluster 0 osdmap e374: 8 total, 8 up, 8 in 2024-05-20T22:16:11.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:10 smithi050 bash[21866]: audit 2024-05-20T22:16:10.939770+0000 mon.a (mon.0) 2554 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "target_max_objects","val": "1"}]: dispatch 2024-05-20T22:16:11.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:10 smithi050 bash[28929]: cluster 2024-05-20T22:16:09.926230+0000 mon.a (mon.0) 2547 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:16:11.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:10 smithi050 bash[28929]: audit 2024-05-20T22:16:09.928645+0000 mon.a (mon.0) 2548 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:16:11.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:10 smithi050 bash[28929]: audit 2024-05-20T22:16:09.928884+0000 mon.a (mon.0) 2549 : audit 1 from='client.26252 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi050-63944-66"}]': finished 2024-05-20T22:16:11.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:10 smithi050 bash[28929]: cluster 2024-05-20T22:16:09.935911+0000 mon.a (mon.0) 2550 : cluster 0 osdmap e373: 8 total, 8 up, 8 in 2024-05-20T22:16:11.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:10 smithi050 bash[28929]: audit 2024-05-20T22:16:09.938184+0000 mon.a (mon.0) 2551 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-05-20T22:16:11.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:10 smithi050 bash[28929]: cluster 2024-05-20T22:16:10.213495+0000 mgr.y (mgr.14592) 391 : cluster 0 pgmap v572: 388 pgs: 388 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-20T22:16:11.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:10 smithi050 bash[28929]: audit 2024-05-20T22:16:10.931426+0000 mon.a (mon.0) 2552 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-05-20T22:16:11.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:10 smithi050 bash[28929]: cluster 2024-05-20T22:16:10.938380+0000 mon.a (mon.0) 2553 : cluster 0 osdmap e374: 8 total, 8 up, 8 in 2024-05-20T22:16:11.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:10 smithi050 bash[28929]: audit 2024-05-20T22:16:10.939770+0000 mon.a (mon.0) 2554 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "target_max_objects","val": "1"}]: dispatch 2024-05-20T22:16:11.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:10 smithi145 bash[23893]: cluster 2024-05-20T22:16:09.926230+0000 mon.a (mon.0) 2547 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:16:11.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:10 smithi145 bash[23893]: audit 2024-05-20T22:16:09.928645+0000 mon.a (mon.0) 2548 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:16:11.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:10 smithi145 bash[23893]: audit 2024-05-20T22:16:09.928884+0000 mon.a (mon.0) 2549 : audit 1 from='client.26252 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi050-63944-66"}]': finished 2024-05-20T22:16:11.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:10 smithi145 bash[23893]: cluster 2024-05-20T22:16:09.935911+0000 mon.a (mon.0) 2550 : cluster 0 osdmap e373: 8 total, 8 up, 8 in 2024-05-20T22:16:11.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:10 smithi145 bash[23893]: audit 2024-05-20T22:16:09.938184+0000 mon.a (mon.0) 2551 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-05-20T22:16:11.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:10 smithi145 bash[23893]: cluster 2024-05-20T22:16:10.213495+0000 mgr.y (mgr.14592) 391 : cluster 0 pgmap v572: 388 pgs: 388 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-20T22:16:11.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:10 smithi145 bash[23893]: audit 2024-05-20T22:16:10.931426+0000 mon.a (mon.0) 2552 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-05-20T22:16:11.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:10 smithi145 bash[23893]: cluster 2024-05-20T22:16:10.938380+0000 mon.a (mon.0) 2553 : cluster 0 osdmap e374: 8 total, 8 up, 8 in 2024-05-20T22:16:11.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:10 smithi145 bash[23893]: audit 2024-05-20T22:16:10.939770+0000 mon.a (mon.0) 2554 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "target_max_objects","val": "1"}]: dispatch 2024-05-20T22:16:13.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:12 smithi050 bash[21866]: audit 2024-05-20T22:16:11.934181+0000 mon.a (mon.0) 2555 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "target_max_objects","val": "1"}]': finished 2024-05-20T22:16:13.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:12 smithi050 bash[21866]: cluster 2024-05-20T22:16:11.942248+0000 mon.a (mon.0) 2556 : cluster 0 osdmap e375: 8 total, 8 up, 8 in 2024-05-20T22:16:13.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:12 smithi050 bash[21866]: cluster 2024-05-20T22:16:12.214501+0000 mgr.y (mgr.14592) 392 : cluster 0 pgmap v575: 388 pgs: 388 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-20T22:16:13.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:12 smithi050 bash[28929]: audit 2024-05-20T22:16:11.934181+0000 mon.a (mon.0) 2555 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "target_max_objects","val": "1"}]': finished 2024-05-20T22:16:13.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:12 smithi050 bash[28929]: cluster 2024-05-20T22:16:11.942248+0000 mon.a (mon.0) 2556 : cluster 0 osdmap e375: 8 total, 8 up, 8 in 2024-05-20T22:16:13.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:12 smithi050 bash[28929]: cluster 2024-05-20T22:16:12.214501+0000 mgr.y (mgr.14592) 392 : cluster 0 pgmap v575: 388 pgs: 388 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-20T22:16:13.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:12 smithi145 bash[23893]: audit 2024-05-20T22:16:11.934181+0000 mon.a (mon.0) 2555 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-51","var": "target_max_objects","val": "1"}]': finished 2024-05-20T22:16:13.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:12 smithi145 bash[23893]: cluster 2024-05-20T22:16:11.942248+0000 mon.a (mon.0) 2556 : cluster 0 osdmap e375: 8 total, 8 up, 8 in 2024-05-20T22:16:13.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:12 smithi145 bash[23893]: cluster 2024-05-20T22:16:12.214501+0000 mgr.y (mgr.14592) 392 : cluster 0 pgmap v575: 388 pgs: 388 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-20T22:16:14.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:13 smithi050 bash[21866]: cluster 2024-05-20T22:16:12.934195+0000 mon.a (mon.0) 2557 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-05-20T22:16:14.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:13 smithi050 bash[28929]: cluster 2024-05-20T22:16:12.934195+0000 mon.a (mon.0) 2557 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-05-20T22:16:14.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:13 smithi145 bash[23893]: cluster 2024-05-20T22:16:12.934195+0000 mon.a (mon.0) 2557 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-05-20T22:16:15.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:14 smithi145 bash[23893]: cluster 2024-05-20T22:16:14.215551+0000 mgr.y (mgr.14592) 393 : cluster 0 pgmap v576: 388 pgs: 388 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-20T22:16:15.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:14 smithi145 bash[23893]: cluster 2024-05-20T22:16:14.661939+0000 mon.a (mon.0) 2558 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:15.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:14 smithi050 bash[21866]: cluster 2024-05-20T22:16:14.215551+0000 mgr.y (mgr.14592) 393 : cluster 0 pgmap v576: 388 pgs: 388 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-20T22:16:15.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:14 smithi050 bash[21866]: cluster 2024-05-20T22:16:14.661939+0000 mon.a (mon.0) 2558 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:15.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:14 smithi050 bash[28929]: cluster 2024-05-20T22:16:14.215551+0000 mgr.y (mgr.14592) 393 : cluster 0 pgmap v576: 388 pgs: 388 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-20T22:16:15.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:14 smithi050 bash[28929]: cluster 2024-05-20T22:16:14.661939+0000 mon.a (mon.0) 2558 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:17.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:17 smithi145 bash[23893]: cluster 2024-05-20T22:16:16.218965+0000 mgr.y (mgr.14592) 394 : cluster 0 pgmap v577: 388 pgs: 388 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-20T22:16:17.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:17 smithi050 bash[21866]: cluster 2024-05-20T22:16:16.218965+0000 mgr.y (mgr.14592) 394 : cluster 0 pgmap v577: 388 pgs: 388 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-20T22:16:17.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:17 smithi050 bash[28929]: cluster 2024-05-20T22:16:16.218965+0000 mgr.y (mgr.14592) 394 : cluster 0 pgmap v577: 388 pgs: 388 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-20T22:16:18.391 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:16:17 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:16:19.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:19 smithi145 bash[23893]: audit 2024-05-20T22:16:17.934398+0000 mgr.y (mgr.14592) 395 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:16:19.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:19 smithi145 bash[23893]: cluster 2024-05-20T22:16:18.220005+0000 mgr.y (mgr.14592) 396 : cluster 0 pgmap v578: 388 pgs: 388 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-05-20T22:16:19.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:16:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:16:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:16:19.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:19 smithi050 bash[21866]: audit 2024-05-20T22:16:17.934398+0000 mgr.y (mgr.14592) 395 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:16:19.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:19 smithi050 bash[21866]: cluster 2024-05-20T22:16:18.220005+0000 mgr.y (mgr.14592) 396 : cluster 0 pgmap v578: 388 pgs: 388 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-05-20T22:16:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:19 smithi050 bash[28929]: audit 2024-05-20T22:16:17.934398+0000 mgr.y (mgr.14592) 395 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:16:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:19 smithi050 bash[28929]: cluster 2024-05-20T22:16:18.220005+0000 mgr.y (mgr.14592) 396 : cluster 0 pgmap v578: 388 pgs: 388 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-05-20T22:16:21.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:21 smithi145 bash[23893]: cluster 2024-05-20T22:16:20.223334+0000 mgr.y (mgr.14592) 397 : cluster 0 pgmap v579: 388 pgs: 388 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:16:21.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:21 smithi050 bash[21866]: cluster 2024-05-20T22:16:20.223334+0000 mgr.y (mgr.14592) 397 : cluster 0 pgmap v579: 388 pgs: 388 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:16:21.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:21 smithi050 bash[28929]: cluster 2024-05-20T22:16:20.223334+0000 mgr.y (mgr.14592) 397 : cluster 0 pgmap v579: 388 pgs: 388 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:16:22.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:22 smithi145 bash[23893]: audit 2024-05-20T22:16:21.966546+0000 mon.a (mon.0) 2559 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:22.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:22 smithi145 bash[23893]: audit 2024-05-20T22:16:22.264787+0000 mon.a (mon.0) 2560 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:16:22.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:22 smithi145 bash[23893]: audit 2024-05-20T22:16:22.267327+0000 mon.a (mon.0) 2561 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:16:22.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:22 smithi050 bash[21866]: audit 2024-05-20T22:16:21.966546+0000 mon.a (mon.0) 2559 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:22.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:22 smithi050 bash[21866]: audit 2024-05-20T22:16:22.264787+0000 mon.a (mon.0) 2560 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:16:22.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:22 smithi050 bash[21866]: audit 2024-05-20T22:16:22.267327+0000 mon.a (mon.0) 2561 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:16:22.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:22 smithi050 bash[28929]: audit 2024-05-20T22:16:21.966546+0000 mon.a (mon.0) 2559 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:22.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:22 smithi050 bash[28929]: audit 2024-05-20T22:16:22.264787+0000 mon.a (mon.0) 2560 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:16:22.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:22 smithi050 bash[28929]: audit 2024-05-20T22:16:22.267327+0000 mon.a (mon.0) 2561 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:16:23.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:23 smithi145 bash[23893]: cluster 2024-05-20T22:16:22.224369+0000 mgr.y (mgr.14592) 398 : cluster 0 pgmap v580: 388 pgs: 388 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 995 B/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:16:23.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:23 smithi145 bash[23893]: audit 2024-05-20T22:16:22.298367+0000 mon.a (mon.0) 2562 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:16:23.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:23 smithi145 bash[23893]: cluster 2024-05-20T22:16:22.307303+0000 mon.a (mon.0) 2563 : cluster 0 osdmap e376: 8 total, 8 up, 8 in 2024-05-20T22:16:23.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:23 smithi145 bash[23893]: audit 2024-05-20T22:16:22.314326+0000 mon.a (mon.0) 2564 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-51"}]: dispatch 2024-05-20T22:16:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:23 smithi050 bash[21866]: cluster 2024-05-20T22:16:22.224369+0000 mgr.y (mgr.14592) 398 : cluster 0 pgmap v580: 388 pgs: 388 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 995 B/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:16:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:23 smithi050 bash[21866]: audit 2024-05-20T22:16:22.298367+0000 mon.a (mon.0) 2562 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:16:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:23 smithi050 bash[21866]: cluster 2024-05-20T22:16:22.307303+0000 mon.a (mon.0) 2563 : cluster 0 osdmap e376: 8 total, 8 up, 8 in 2024-05-20T22:16:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:23 smithi050 bash[21866]: audit 2024-05-20T22:16:22.314326+0000 mon.a (mon.0) 2564 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-51"}]: dispatch 2024-05-20T22:16:23.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:23 smithi050 bash[28929]: cluster 2024-05-20T22:16:22.224369+0000 mgr.y (mgr.14592) 398 : cluster 0 pgmap v580: 388 pgs: 388 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 995 B/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:16:23.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:23 smithi050 bash[28929]: audit 2024-05-20T22:16:22.298367+0000 mon.a (mon.0) 2562 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:16:23.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:23 smithi050 bash[28929]: cluster 2024-05-20T22:16:22.307303+0000 mon.a (mon.0) 2563 : cluster 0 osdmap e376: 8 total, 8 up, 8 in 2024-05-20T22:16:23.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:23 smithi050 bash[28929]: audit 2024-05-20T22:16:22.314326+0000 mon.a (mon.0) 2564 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-51"}]: dispatch 2024-05-20T22:16:24.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:24 smithi145 bash[23893]: audit 2024-05-20T22:16:23.300944+0000 mon.a (mon.0) 2565 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-51"}]': finished 2024-05-20T22:16:24.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:24 smithi145 bash[23893]: cluster 2024-05-20T22:16:23.310225+0000 mon.a (mon.0) 2566 : cluster 0 osdmap e377: 8 total, 8 up, 8 in 2024-05-20T22:16:24.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:24 smithi145 bash[23893]: audit 2024-05-20T22:16:23.390778+0000 mon.a (mon.0) 2567 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:24.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:24 smithi145 bash[23893]: audit 2024-05-20T22:16:23.391556+0000 mon.a (mon.0) 2568 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-51"}]: dispatch 2024-05-20T22:16:24.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:24 smithi050 bash[21866]: audit 2024-05-20T22:16:23.300944+0000 mon.a (mon.0) 2565 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-51"}]': finished 2024-05-20T22:16:24.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:24 smithi050 bash[21866]: cluster 2024-05-20T22:16:23.310225+0000 mon.a (mon.0) 2566 : cluster 0 osdmap e377: 8 total, 8 up, 8 in 2024-05-20T22:16:24.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:24 smithi050 bash[21866]: audit 2024-05-20T22:16:23.390778+0000 mon.a (mon.0) 2567 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:24.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:24 smithi050 bash[21866]: audit 2024-05-20T22:16:23.391556+0000 mon.a (mon.0) 2568 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-51"}]: dispatch 2024-05-20T22:16:24.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:24 smithi050 bash[28929]: audit 2024-05-20T22:16:23.300944+0000 mon.a (mon.0) 2565 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-51"}]': finished 2024-05-20T22:16:24.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:24 smithi050 bash[28929]: cluster 2024-05-20T22:16:23.310225+0000 mon.a (mon.0) 2566 : cluster 0 osdmap e377: 8 total, 8 up, 8 in 2024-05-20T22:16:24.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:24 smithi050 bash[28929]: audit 2024-05-20T22:16:23.390778+0000 mon.a (mon.0) 2567 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:24.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:24 smithi050 bash[28929]: audit 2024-05-20T22:16:23.391556+0000 mon.a (mon.0) 2568 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-51"}]: dispatch 2024-05-20T22:16:25.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:25 smithi145 bash[23893]: cluster 2024-05-20T22:16:24.225445+0000 mgr.y (mgr.14592) 399 : cluster 0 pgmap v583: 388 pgs: 388 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:16:25.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:25 smithi145 bash[23893]: cluster 2024-05-20T22:16:24.315701+0000 mon.a (mon.0) 2569 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-05-20T22:16:25.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:25 smithi145 bash[23893]: cluster 2024-05-20T22:16:24.352852+0000 mon.a (mon.0) 2570 : cluster 0 osdmap e378: 8 total, 8 up, 8 in 2024-05-20T22:16:25.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:25 smithi050 bash[21866]: cluster 2024-05-20T22:16:24.225445+0000 mgr.y (mgr.14592) 399 : cluster 0 pgmap v583: 388 pgs: 388 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:16:25.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:25 smithi050 bash[21866]: cluster 2024-05-20T22:16:24.315701+0000 mon.a (mon.0) 2569 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-05-20T22:16:25.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:25 smithi050 bash[21866]: cluster 2024-05-20T22:16:24.352852+0000 mon.a (mon.0) 2570 : cluster 0 osdmap e378: 8 total, 8 up, 8 in 2024-05-20T22:16:25.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:25 smithi050 bash[28929]: cluster 2024-05-20T22:16:24.225445+0000 mgr.y (mgr.14592) 399 : cluster 0 pgmap v583: 388 pgs: 388 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:16:25.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:25 smithi050 bash[28929]: cluster 2024-05-20T22:16:24.315701+0000 mon.a (mon.0) 2569 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-05-20T22:16:25.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:25 smithi050 bash[28929]: cluster 2024-05-20T22:16:24.352852+0000 mon.a (mon.0) 2570 : cluster 0 osdmap e378: 8 total, 8 up, 8 in 2024-05-20T22:16:26.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:26 smithi145 bash[23893]: cluster 2024-05-20T22:16:25.345597+0000 mon.a (mon.0) 2571 : cluster 0 osdmap e379: 8 total, 8 up, 8 in 2024-05-20T22:16:26.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:26 smithi145 bash[23893]: audit 2024-05-20T22:16:25.350802+0000 mon.a (mon.0) 2572 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:26.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:26 smithi050 bash[28929]: cluster 2024-05-20T22:16:25.345597+0000 mon.a (mon.0) 2571 : cluster 0 osdmap e379: 8 total, 8 up, 8 in 2024-05-20T22:16:26.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:26 smithi050 bash[28929]: audit 2024-05-20T22:16:25.350802+0000 mon.a (mon.0) 2572 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:26.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:26 smithi050 bash[21866]: cluster 2024-05-20T22:16:25.345597+0000 mon.a (mon.0) 2571 : cluster 0 osdmap e379: 8 total, 8 up, 8 in 2024-05-20T22:16:26.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:26 smithi050 bash[21866]: audit 2024-05-20T22:16:25.350802+0000 mon.a (mon.0) 2572 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:27.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:27 smithi145 bash[23893]: cluster 2024-05-20T22:16:26.226595+0000 mgr.y (mgr.14592) 400 : cluster 0 pgmap v586: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-20T22:16:27.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:27 smithi145 bash[23893]: cluster 2024-05-20T22:16:26.339402+0000 mon.a (mon.0) 2573 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:27.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:27 smithi145 bash[23893]: audit 2024-05-20T22:16:26.349351+0000 mon.a (mon.0) 2574 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:27.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:27 smithi145 bash[23893]: cluster 2024-05-20T22:16:26.358362+0000 mon.a (mon.0) 2575 : cluster 0 osdmap e380: 8 total, 8 up, 8 in 2024-05-20T22:16:27.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:27 smithi145 bash[23893]: audit 2024-05-20T22:16:26.438457+0000 mon.a (mon.0) 2576 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:27.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:27 smithi145 bash[23893]: audit 2024-05-20T22:16:26.439021+0000 mon.a (mon.0) 2577 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-53"}]: dispatch 2024-05-20T22:16:27.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:27 smithi050 bash[21866]: cluster 2024-05-20T22:16:26.226595+0000 mgr.y (mgr.14592) 400 : cluster 0 pgmap v586: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-20T22:16:27.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:27 smithi050 bash[21866]: cluster 2024-05-20T22:16:26.339402+0000 mon.a (mon.0) 2573 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:27.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:27 smithi050 bash[21866]: audit 2024-05-20T22:16:26.349351+0000 mon.a (mon.0) 2574 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:27.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:27 smithi050 bash[21866]: cluster 2024-05-20T22:16:26.358362+0000 mon.a (mon.0) 2575 : cluster 0 osdmap e380: 8 total, 8 up, 8 in 2024-05-20T22:16:27.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:27 smithi050 bash[21866]: audit 2024-05-20T22:16:26.438457+0000 mon.a (mon.0) 2576 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:27.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:27 smithi050 bash[21866]: audit 2024-05-20T22:16:26.439021+0000 mon.a (mon.0) 2577 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-53"}]: dispatch 2024-05-20T22:16:27.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:27 smithi050 bash[28929]: cluster 2024-05-20T22:16:26.226595+0000 mgr.y (mgr.14592) 400 : cluster 0 pgmap v586: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-20T22:16:27.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:27 smithi050 bash[28929]: cluster 2024-05-20T22:16:26.339402+0000 mon.a (mon.0) 2573 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:27.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:27 smithi050 bash[28929]: audit 2024-05-20T22:16:26.349351+0000 mon.a (mon.0) 2574 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:27.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:27 smithi050 bash[28929]: cluster 2024-05-20T22:16:26.358362+0000 mon.a (mon.0) 2575 : cluster 0 osdmap e380: 8 total, 8 up, 8 in 2024-05-20T22:16:27.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:27 smithi050 bash[28929]: audit 2024-05-20T22:16:26.438457+0000 mon.a (mon.0) 2576 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:27.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:27 smithi050 bash[28929]: audit 2024-05-20T22:16:26.439021+0000 mon.a (mon.0) 2577 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-53"}]: dispatch 2024-05-20T22:16:28.370 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:16:27 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:16:28.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:28 smithi145 bash[23893]: cluster 2024-05-20T22:16:27.366678+0000 mon.a (mon.0) 2578 : cluster 0 osdmap e381: 8 total, 8 up, 8 in 2024-05-20T22:16:28.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:28 smithi050 bash[21866]: cluster 2024-05-20T22:16:27.366678+0000 mon.a (mon.0) 2578 : cluster 0 osdmap e381: 8 total, 8 up, 8 in 2024-05-20T22:16:28.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:28 smithi050 bash[28929]: cluster 2024-05-20T22:16:27.366678+0000 mon.a (mon.0) 2578 : cluster 0 osdmap e381: 8 total, 8 up, 8 in 2024-05-20T22:16:29.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:16:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:16:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:16:29.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:29 smithi050 bash[21866]: audit 2024-05-20T22:16:27.945516+0000 mgr.y (mgr.14592) 401 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:16:29.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:29 smithi050 bash[21866]: cluster 2024-05-20T22:16:28.227594+0000 mgr.y (mgr.14592) 402 : cluster 0 pgmap v589: 356 pgs: 356 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-20T22:16:29.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:29 smithi050 bash[21866]: cluster 2024-05-20T22:16:28.382688+0000 mon.a (mon.0) 2579 : cluster 0 osdmap e382: 8 total, 8 up, 8 in 2024-05-20T22:16:29.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:29 smithi050 bash[21866]: audit 2024-05-20T22:16:28.395302+0000 mon.a (mon.0) 2580 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:29.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:29 smithi050 bash[28929]: audit 2024-05-20T22:16:27.945516+0000 mgr.y (mgr.14592) 401 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:16:29.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:29 smithi050 bash[28929]: cluster 2024-05-20T22:16:28.227594+0000 mgr.y (mgr.14592) 402 : cluster 0 pgmap v589: 356 pgs: 356 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-20T22:16:29.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:29 smithi050 bash[28929]: cluster 2024-05-20T22:16:28.382688+0000 mon.a (mon.0) 2579 : cluster 0 osdmap e382: 8 total, 8 up, 8 in 2024-05-20T22:16:29.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:29 smithi050 bash[28929]: audit 2024-05-20T22:16:28.395302+0000 mon.a (mon.0) 2580 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:29.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:29 smithi145 bash[23893]: audit 2024-05-20T22:16:27.945516+0000 mgr.y (mgr.14592) 401 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:16:29.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:29 smithi145 bash[23893]: cluster 2024-05-20T22:16:28.227594+0000 mgr.y (mgr.14592) 402 : cluster 0 pgmap v589: 356 pgs: 356 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-20T22:16:29.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:29 smithi145 bash[23893]: cluster 2024-05-20T22:16:28.382688+0000 mon.a (mon.0) 2579 : cluster 0 osdmap e382: 8 total, 8 up, 8 in 2024-05-20T22:16:29.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:29 smithi145 bash[23893]: audit 2024-05-20T22:16:28.395302+0000 mon.a (mon.0) 2580 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:31.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:30 smithi145 bash[23893]: audit 2024-05-20T22:16:29.376403+0000 mon.a (mon.0) 2581 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:31.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:30 smithi145 bash[23893]: cluster 2024-05-20T22:16:29.385197+0000 mon.a (mon.0) 2582 : cluster 0 osdmap e383: 8 total, 8 up, 8 in 2024-05-20T22:16:31.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:30 smithi145 bash[23893]: audit 2024-05-20T22:16:29.392173+0000 mon.a (mon.0) 2583 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:16:31.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:30 smithi145 bash[23893]: audit 2024-05-20T22:16:29.479293+0000 mon.a (mon.0) 2584 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:31.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:30 smithi145 bash[23893]: audit 2024-05-20T22:16:29.479952+0000 mon.a (mon.0) 2585 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-55"}]: dispatch 2024-05-20T22:16:31.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:30 smithi145 bash[23893]: cluster 2024-05-20T22:16:30.385884+0000 mon.a (mon.0) 2586 : cluster 0 osdmap e384: 8 total, 8 up, 8 in 2024-05-20T22:16:31.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:30 smithi050 bash[28929]: audit 2024-05-20T22:16:29.376403+0000 mon.a (mon.0) 2581 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:31.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:30 smithi050 bash[28929]: cluster 2024-05-20T22:16:29.385197+0000 mon.a (mon.0) 2582 : cluster 0 osdmap e383: 8 total, 8 up, 8 in 2024-05-20T22:16:31.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:30 smithi050 bash[28929]: audit 2024-05-20T22:16:29.392173+0000 mon.a (mon.0) 2583 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:16:31.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:30 smithi050 bash[28929]: audit 2024-05-20T22:16:29.479293+0000 mon.a (mon.0) 2584 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:31.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:30 smithi050 bash[28929]: audit 2024-05-20T22:16:29.479952+0000 mon.a (mon.0) 2585 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-55"}]: dispatch 2024-05-20T22:16:31.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:30 smithi050 bash[28929]: cluster 2024-05-20T22:16:30.385884+0000 mon.a (mon.0) 2586 : cluster 0 osdmap e384: 8 total, 8 up, 8 in 2024-05-20T22:16:31.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:30 smithi050 bash[21866]: audit 2024-05-20T22:16:29.376403+0000 mon.a (mon.0) 2581 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:31.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:30 smithi050 bash[21866]: cluster 2024-05-20T22:16:29.385197+0000 mon.a (mon.0) 2582 : cluster 0 osdmap e383: 8 total, 8 up, 8 in 2024-05-20T22:16:31.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:30 smithi050 bash[21866]: audit 2024-05-20T22:16:29.392173+0000 mon.a (mon.0) 2583 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:16:31.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:30 smithi050 bash[21866]: audit 2024-05-20T22:16:29.479293+0000 mon.a (mon.0) 2584 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:31.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:30 smithi050 bash[21866]: audit 2024-05-20T22:16:29.479952+0000 mon.a (mon.0) 2585 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-55"}]: dispatch 2024-05-20T22:16:31.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:30 smithi050 bash[21866]: cluster 2024-05-20T22:16:30.385884+0000 mon.a (mon.0) 2586 : cluster 0 osdmap e384: 8 total, 8 up, 8 in 2024-05-20T22:16:32.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:31 smithi145 bash[23893]: cluster 2024-05-20T22:16:30.230725+0000 mgr.y (mgr.14592) 403 : cluster 0 pgmap v592: 388 pgs: 388 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-05-20T22:16:32.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:31 smithi145 bash[23893]: cluster 2024-05-20T22:16:31.391896+0000 mon.a (mon.0) 2587 : cluster 0 osdmap e385: 8 total, 8 up, 8 in 2024-05-20T22:16:32.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:31 smithi145 bash[23893]: audit 2024-05-20T22:16:31.397427+0000 mon.a (mon.0) 2588 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:32.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:31 smithi050 bash[21866]: cluster 2024-05-20T22:16:30.230725+0000 mgr.y (mgr.14592) 403 : cluster 0 pgmap v592: 388 pgs: 388 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-05-20T22:16:32.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:31 smithi050 bash[21866]: cluster 2024-05-20T22:16:31.391896+0000 mon.a (mon.0) 2587 : cluster 0 osdmap e385: 8 total, 8 up, 8 in 2024-05-20T22:16:32.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:31 smithi050 bash[21866]: audit 2024-05-20T22:16:31.397427+0000 mon.a (mon.0) 2588 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:32.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:31 smithi050 bash[28929]: cluster 2024-05-20T22:16:30.230725+0000 mgr.y (mgr.14592) 403 : cluster 0 pgmap v592: 388 pgs: 388 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-05-20T22:16:32.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:31 smithi050 bash[28929]: cluster 2024-05-20T22:16:31.391896+0000 mon.a (mon.0) 2587 : cluster 0 osdmap e385: 8 total, 8 up, 8 in 2024-05-20T22:16:32.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:31 smithi050 bash[28929]: audit 2024-05-20T22:16:31.397427+0000 mon.a (mon.0) 2588 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:33 smithi145 bash[23893]: cluster 2024-05-20T22:16:32.231752+0000 mgr.y (mgr.14592) 404 : cluster 0 pgmap v595: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-05-20T22:16:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:33 smithi145 bash[23893]: audit 2024-05-20T22:16:32.386143+0000 mon.a (mon.0) 2589 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:33 smithi145 bash[23893]: cluster 2024-05-20T22:16:32.393578+0000 mon.a (mon.0) 2590 : cluster 0 osdmap e386: 8 total, 8 up, 8 in 2024-05-20T22:16:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:33 smithi145 bash[23893]: audit 2024-05-20T22:16:32.494158+0000 mon.a (mon.0) 2591 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:33.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:33 smithi145 bash[23893]: audit 2024-05-20T22:16:32.494758+0000 mon.a (mon.0) 2592 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-57"}]: dispatch 2024-05-20T22:16:33.642 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:33 smithi145 bash[23893]: cluster 2024-05-20T22:16:32.862210+0000 mon.a (mon.0) 2593 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:33.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:33 smithi050 bash[21866]: cluster 2024-05-20T22:16:32.231752+0000 mgr.y (mgr.14592) 404 : cluster 0 pgmap v595: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-05-20T22:16:33.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:33 smithi050 bash[21866]: audit 2024-05-20T22:16:32.386143+0000 mon.a (mon.0) 2589 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:33.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:33 smithi050 bash[21866]: cluster 2024-05-20T22:16:32.393578+0000 mon.a (mon.0) 2590 : cluster 0 osdmap e386: 8 total, 8 up, 8 in 2024-05-20T22:16:33.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:33 smithi050 bash[21866]: audit 2024-05-20T22:16:32.494158+0000 mon.a (mon.0) 2591 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:33.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:33 smithi050 bash[21866]: audit 2024-05-20T22:16:32.494758+0000 mon.a (mon.0) 2592 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-57"}]: dispatch 2024-05-20T22:16:33.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:33 smithi050 bash[21866]: cluster 2024-05-20T22:16:32.862210+0000 mon.a (mon.0) 2593 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:33.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:33 smithi050 bash[28929]: cluster 2024-05-20T22:16:32.231752+0000 mgr.y (mgr.14592) 404 : cluster 0 pgmap v595: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-05-20T22:16:33.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:33 smithi050 bash[28929]: audit 2024-05-20T22:16:32.386143+0000 mon.a (mon.0) 2589 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:33.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:33 smithi050 bash[28929]: cluster 2024-05-20T22:16:32.393578+0000 mon.a (mon.0) 2590 : cluster 0 osdmap e386: 8 total, 8 up, 8 in 2024-05-20T22:16:33.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:33 smithi050 bash[28929]: audit 2024-05-20T22:16:32.494158+0000 mon.a (mon.0) 2591 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:33.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:33 smithi050 bash[28929]: audit 2024-05-20T22:16:32.494758+0000 mon.a (mon.0) 2592 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-57"}]: dispatch 2024-05-20T22:16:33.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:33 smithi050 bash[28929]: cluster 2024-05-20T22:16:32.862210+0000 mon.a (mon.0) 2593 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:34.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:34 smithi050 bash[21866]: cluster 2024-05-20T22:16:33.404298+0000 mon.a (mon.0) 2594 : cluster 0 osdmap e387: 8 total, 8 up, 8 in 2024-05-20T22:16:34.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:34 smithi050 bash[28929]: cluster 2024-05-20T22:16:33.404298+0000 mon.a (mon.0) 2594 : cluster 0 osdmap e387: 8 total, 8 up, 8 in 2024-05-20T22:16:34.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:34 smithi145 bash[23893]: cluster 2024-05-20T22:16:33.404298+0000 mon.a (mon.0) 2594 : cluster 0 osdmap e387: 8 total, 8 up, 8 in 2024-05-20T22:16:35.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:35 smithi145 bash[23893]: cluster 2024-05-20T22:16:34.232803+0000 mgr.y (mgr.14592) 405 : cluster 0 pgmap v598: 356 pgs: 356 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:16:35.894 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:35 smithi145 bash[23893]: cluster 2024-05-20T22:16:34.421219+0000 mon.a (mon.0) 2595 : cluster 0 osdmap e388: 8 total, 8 up, 8 in 2024-05-20T22:16:35.895 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:35 smithi145 bash[23893]: audit 2024-05-20T22:16:34.425650+0000 mon.a (mon.0) 2596 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:35 smithi050 bash[21866]: cluster 2024-05-20T22:16:34.232803+0000 mgr.y (mgr.14592) 405 : cluster 0 pgmap v598: 356 pgs: 356 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:16:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:35 smithi050 bash[21866]: cluster 2024-05-20T22:16:34.421219+0000 mon.a (mon.0) 2595 : cluster 0 osdmap e388: 8 total, 8 up, 8 in 2024-05-20T22:16:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:35 smithi050 bash[21866]: audit 2024-05-20T22:16:34.425650+0000 mon.a (mon.0) 2596 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:35.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:35 smithi050 bash[28929]: cluster 2024-05-20T22:16:34.232803+0000 mgr.y (mgr.14592) 405 : cluster 0 pgmap v598: 356 pgs: 356 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:16:35.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:35 smithi050 bash[28929]: cluster 2024-05-20T22:16:34.421219+0000 mon.a (mon.0) 2595 : cluster 0 osdmap e388: 8 total, 8 up, 8 in 2024-05-20T22:16:35.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:35 smithi050 bash[28929]: audit 2024-05-20T22:16:34.425650+0000 mon.a (mon.0) 2596 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:36.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:36 smithi145 bash[23893]: audit 2024-05-20T22:16:35.413990+0000 mon.a (mon.0) 2597 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:36.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:36 smithi145 bash[23893]: cluster 2024-05-20T22:16:35.423249+0000 mon.a (mon.0) 2598 : cluster 0 osdmap e389: 8 total, 8 up, 8 in 2024-05-20T22:16:36.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:36 smithi145 bash[23893]: audit 2024-05-20T22:16:35.431227+0000 mon.a (mon.0) 2599 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:16:36.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:36 smithi145 bash[23893]: audit 2024-05-20T22:16:35.522393+0000 mon.a (mon.0) 2600 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:36.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:36 smithi145 bash[23893]: audit 2024-05-20T22:16:35.522932+0000 mon.a (mon.0) 2601 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-59"}]: dispatch 2024-05-20T22:16:36.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:36 smithi050 bash[21866]: audit 2024-05-20T22:16:35.413990+0000 mon.a (mon.0) 2597 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:36.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:36 smithi050 bash[21866]: cluster 2024-05-20T22:16:35.423249+0000 mon.a (mon.0) 2598 : cluster 0 osdmap e389: 8 total, 8 up, 8 in 2024-05-20T22:16:36.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:36 smithi050 bash[21866]: audit 2024-05-20T22:16:35.431227+0000 mon.a (mon.0) 2599 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:16:36.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:36 smithi050 bash[21866]: audit 2024-05-20T22:16:35.522393+0000 mon.a (mon.0) 2600 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:36.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:36 smithi050 bash[21866]: audit 2024-05-20T22:16:35.522932+0000 mon.a (mon.0) 2601 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-59"}]: dispatch 2024-05-20T22:16:36.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:36 smithi050 bash[28929]: audit 2024-05-20T22:16:35.413990+0000 mon.a (mon.0) 2597 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:36.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:36 smithi050 bash[28929]: cluster 2024-05-20T22:16:35.423249+0000 mon.a (mon.0) 2598 : cluster 0 osdmap e389: 8 total, 8 up, 8 in 2024-05-20T22:16:36.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:36 smithi050 bash[28929]: audit 2024-05-20T22:16:35.431227+0000 mon.a (mon.0) 2599 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:16:36.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:36 smithi050 bash[28929]: audit 2024-05-20T22:16:35.522393+0000 mon.a (mon.0) 2600 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:36.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:36 smithi050 bash[28929]: audit 2024-05-20T22:16:35.522932+0000 mon.a (mon.0) 2601 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-59"}]: dispatch 2024-05-20T22:16:37.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:37 smithi145 bash[23893]: cluster 2024-05-20T22:16:36.233840+0000 mgr.y (mgr.14592) 406 : cluster 0 pgmap v601: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 767 B/s wr, 180 op/s 2024-05-20T22:16:37.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:37 smithi145 bash[23893]: cluster 2024-05-20T22:16:36.470379+0000 mon.a (mon.0) 2602 : cluster 0 osdmap e390: 8 total, 8 up, 8 in 2024-05-20T22:16:37.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:37 smithi145 bash[23893]: audit 2024-05-20T22:16:37.320967+0000 mon.a (mon.0) 2603 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:16:37.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:37 smithi145 bash[23893]: audit 2024-05-20T22:16:37.324985+0000 mon.a (mon.0) 2604 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:16:37.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:37 smithi050 bash[21866]: cluster 2024-05-20T22:16:36.233840+0000 mgr.y (mgr.14592) 406 : cluster 0 pgmap v601: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 767 B/s wr, 180 op/s 2024-05-20T22:16:37.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:37 smithi050 bash[21866]: cluster 2024-05-20T22:16:36.470379+0000 mon.a (mon.0) 2602 : cluster 0 osdmap e390: 8 total, 8 up, 8 in 2024-05-20T22:16:37.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:37 smithi050 bash[21866]: audit 2024-05-20T22:16:37.320967+0000 mon.a (mon.0) 2603 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:16:37.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:37 smithi050 bash[21866]: audit 2024-05-20T22:16:37.324985+0000 mon.a (mon.0) 2604 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:16:37.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:37 smithi050 bash[28929]: cluster 2024-05-20T22:16:36.233840+0000 mgr.y (mgr.14592) 406 : cluster 0 pgmap v601: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 767 B/s wr, 180 op/s 2024-05-20T22:16:37.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:37 smithi050 bash[28929]: cluster 2024-05-20T22:16:36.470379+0000 mon.a (mon.0) 2602 : cluster 0 osdmap e390: 8 total, 8 up, 8 in 2024-05-20T22:16:37.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:37 smithi050 bash[28929]: audit 2024-05-20T22:16:37.320967+0000 mon.a (mon.0) 2603 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:16:37.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:37 smithi050 bash[28929]: audit 2024-05-20T22:16:37.324985+0000 mon.a (mon.0) 2604 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:16:38.391 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:16:37 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:16:38.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:38 smithi145 bash[23893]: cluster 2024-05-20T22:16:37.480522+0000 mon.a (mon.0) 2605 : cluster 0 osdmap e391: 8 total, 8 up, 8 in 2024-05-20T22:16:38.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:38 smithi145 bash[23893]: audit 2024-05-20T22:16:37.489759+0000 mon.a (mon.0) 2606 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:38 smithi050 bash[21866]: cluster 2024-05-20T22:16:37.480522+0000 mon.a (mon.0) 2605 : cluster 0 osdmap e391: 8 total, 8 up, 8 in 2024-05-20T22:16:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:38 smithi050 bash[21866]: audit 2024-05-20T22:16:37.489759+0000 mon.a (mon.0) 2606 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:38.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:38 smithi050 bash[28929]: cluster 2024-05-20T22:16:37.480522+0000 mon.a (mon.0) 2605 : cluster 0 osdmap e391: 8 total, 8 up, 8 in 2024-05-20T22:16:38.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:38 smithi050 bash[28929]: audit 2024-05-20T22:16:37.489759+0000 mon.a (mon.0) 2606 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:39.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:16:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:16:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:16:39.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:39 smithi050 bash[21866]: audit 2024-05-20T22:16:37.956840+0000 mgr.y (mgr.14592) 407 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:16:39.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:39 smithi050 bash[21866]: cluster 2024-05-20T22:16:38.234839+0000 mgr.y (mgr.14592) 408 : cluster 0 pgmap v604: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 767 B/s wr, 180 op/s 2024-05-20T22:16:39.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:39 smithi050 bash[21866]: cluster 2024-05-20T22:16:38.474226+0000 mon.a (mon.0) 2607 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:39.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:39 smithi050 bash[21866]: audit 2024-05-20T22:16:38.476057+0000 mon.a (mon.0) 2608 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:39.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:39 smithi050 bash[21866]: cluster 2024-05-20T22:16:38.484450+0000 mon.a (mon.0) 2609 : cluster 0 osdmap e392: 8 total, 8 up, 8 in 2024-05-20T22:16:39.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:39 smithi050 bash[21866]: audit 2024-05-20T22:16:38.515540+0000 mon.a (mon.0) 2610 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:16:39.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:39 smithi050 bash[21866]: audit 2024-05-20T22:16:38.534753+0000 mon.a (mon.0) 2611 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:16:39.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:39 smithi050 bash[28929]: audit 2024-05-20T22:16:37.956840+0000 mgr.y (mgr.14592) 407 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:16:39.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:39 smithi050 bash[28929]: cluster 2024-05-20T22:16:38.234839+0000 mgr.y (mgr.14592) 408 : cluster 0 pgmap v604: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 767 B/s wr, 180 op/s 2024-05-20T22:16:39.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:39 smithi050 bash[28929]: cluster 2024-05-20T22:16:38.474226+0000 mon.a (mon.0) 2607 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:39.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:39 smithi050 bash[28929]: audit 2024-05-20T22:16:38.476057+0000 mon.a (mon.0) 2608 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:39.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:39 smithi050 bash[28929]: cluster 2024-05-20T22:16:38.484450+0000 mon.a (mon.0) 2609 : cluster 0 osdmap e392: 8 total, 8 up, 8 in 2024-05-20T22:16:39.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:39 smithi050 bash[28929]: audit 2024-05-20T22:16:38.515540+0000 mon.a (mon.0) 2610 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:16:39.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:39 smithi050 bash[28929]: audit 2024-05-20T22:16:38.534753+0000 mon.a (mon.0) 2611 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:16:39.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:39 smithi145 bash[23893]: audit 2024-05-20T22:16:37.956840+0000 mgr.y (mgr.14592) 407 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:16:39.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:39 smithi145 bash[23893]: cluster 2024-05-20T22:16:38.234839+0000 mgr.y (mgr.14592) 408 : cluster 0 pgmap v604: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 767 B/s wr, 180 op/s 2024-05-20T22:16:39.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:39 smithi145 bash[23893]: cluster 2024-05-20T22:16:38.474226+0000 mon.a (mon.0) 2607 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:39.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:39 smithi145 bash[23893]: audit 2024-05-20T22:16:38.476057+0000 mon.a (mon.0) 2608 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:39.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:39 smithi145 bash[23893]: cluster 2024-05-20T22:16:38.484450+0000 mon.a (mon.0) 2609 : cluster 0 osdmap e392: 8 total, 8 up, 8 in 2024-05-20T22:16:39.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:39 smithi145 bash[23893]: audit 2024-05-20T22:16:38.515540+0000 mon.a (mon.0) 2610 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:16:39.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:39 smithi145 bash[23893]: audit 2024-05-20T22:16:38.534753+0000 mon.a (mon.0) 2611 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:16:40.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:40 smithi145 bash[23893]: audit 2024-05-20T22:16:39.504082+0000 mon.a (mon.0) 2612 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:16:40.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:40 smithi145 bash[23893]: cluster 2024-05-20T22:16:39.511069+0000 mon.a (mon.0) 2613 : cluster 0 osdmap e393: 8 total, 8 up, 8 in 2024-05-20T22:16:40.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:40 smithi145 bash[23893]: audit 2024-05-20T22:16:39.619395+0000 mon.a (mon.0) 2614 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:40.892 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:40 smithi145 bash[23893]: audit 2024-05-20T22:16:39.620232+0000 mon.a (mon.0) 2615 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-61"}]: dispatch 2024-05-20T22:16:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:40 smithi050 bash[21866]: audit 2024-05-20T22:16:39.504082+0000 mon.a (mon.0) 2612 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:16:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:40 smithi050 bash[21866]: cluster 2024-05-20T22:16:39.511069+0000 mon.a (mon.0) 2613 : cluster 0 osdmap e393: 8 total, 8 up, 8 in 2024-05-20T22:16:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:40 smithi050 bash[21866]: audit 2024-05-20T22:16:39.619395+0000 mon.a (mon.0) 2614 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:40 smithi050 bash[21866]: audit 2024-05-20T22:16:39.620232+0000 mon.a (mon.0) 2615 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-61"}]: dispatch 2024-05-20T22:16:40.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:40 smithi050 bash[28929]: audit 2024-05-20T22:16:39.504082+0000 mon.a (mon.0) 2612 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:16:40.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:40 smithi050 bash[28929]: cluster 2024-05-20T22:16:39.511069+0000 mon.a (mon.0) 2613 : cluster 0 osdmap e393: 8 total, 8 up, 8 in 2024-05-20T22:16:40.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:40 smithi050 bash[28929]: audit 2024-05-20T22:16:39.619395+0000 mon.a (mon.0) 2614 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:16:40.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:40 smithi050 bash[28929]: audit 2024-05-20T22:16:39.620232+0000 mon.a (mon.0) 2615 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-61"}]: dispatch 2024-05-20T22:16:41.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:41 smithi145 bash[23893]: cluster 2024-05-20T22:16:40.238045+0000 mgr.y (mgr.14592) 409 : cluster 0 pgmap v607: 388 pgs: 388 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-05-20T22:16:41.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:41 smithi145 bash[23893]: cluster 2024-05-20T22:16:40.547166+0000 mon.a (mon.0) 2616 : cluster 0 osdmap e394: 8 total, 8 up, 8 in 2024-05-20T22:16:41.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:41 smithi050 bash[21866]: cluster 2024-05-20T22:16:40.238045+0000 mgr.y (mgr.14592) 409 : cluster 0 pgmap v607: 388 pgs: 388 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-05-20T22:16:41.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:41 smithi050 bash[21866]: cluster 2024-05-20T22:16:40.547166+0000 mon.a (mon.0) 2616 : cluster 0 osdmap e394: 8 total, 8 up, 8 in 2024-05-20T22:16:41.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:41 smithi050 bash[28929]: cluster 2024-05-20T22:16:40.238045+0000 mgr.y (mgr.14592) 409 : cluster 0 pgmap v607: 388 pgs: 388 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-05-20T22:16:41.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:41 smithi050 bash[28929]: cluster 2024-05-20T22:16:40.547166+0000 mon.a (mon.0) 2616 : cluster 0 osdmap e394: 8 total, 8 up, 8 in 2024-05-20T22:16:42.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:42 smithi145 bash[23893]: cluster 2024-05-20T22:16:41.549364+0000 mon.a (mon.0) 2617 : cluster 0 osdmap e395: 8 total, 8 up, 8 in 2024-05-20T22:16:42.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:42 smithi145 bash[23893]: audit 2024-05-20T22:16:41.557835+0000 mon.a (mon.0) 2618 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:42.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:42 smithi145 bash[23893]: audit 2024-05-20T22:16:42.543445+0000 mon.a (mon.0) 2619 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:42.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:42 smithi145 bash[23893]: cluster 2024-05-20T22:16:42.551039+0000 mon.a (mon.0) 2620 : cluster 0 osdmap e396: 8 total, 8 up, 8 in 2024-05-20T22:16:42.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:42 smithi050 bash[21866]: cluster 2024-05-20T22:16:41.549364+0000 mon.a (mon.0) 2617 : cluster 0 osdmap e395: 8 total, 8 up, 8 in 2024-05-20T22:16:42.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:42 smithi050 bash[21866]: audit 2024-05-20T22:16:41.557835+0000 mon.a (mon.0) 2618 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:42.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:42 smithi050 bash[21866]: audit 2024-05-20T22:16:42.543445+0000 mon.a (mon.0) 2619 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:42.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:42 smithi050 bash[21866]: cluster 2024-05-20T22:16:42.551039+0000 mon.a (mon.0) 2620 : cluster 0 osdmap e396: 8 total, 8 up, 8 in 2024-05-20T22:16:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:42 smithi050 bash[28929]: cluster 2024-05-20T22:16:41.549364+0000 mon.a (mon.0) 2617 : cluster 0 osdmap e395: 8 total, 8 up, 8 in 2024-05-20T22:16:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:42 smithi050 bash[28929]: audit 2024-05-20T22:16:41.557835+0000 mon.a (mon.0) 2618 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:16:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:42 smithi050 bash[28929]: audit 2024-05-20T22:16:42.543445+0000 mon.a (mon.0) 2619 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:16:42.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:42 smithi050 bash[28929]: cluster 2024-05-20T22:16:42.551039+0000 mon.a (mon.0) 2620 : cluster 0 osdmap e396: 8 total, 8 up, 8 in 2024-05-20T22:16:43.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:43 smithi145 bash[23893]: cluster 2024-05-20T22:16:42.239020+0000 mgr.y (mgr.14592) 410 : cluster 0 pgmap v610: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:16:43.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:43 smithi145 bash[23893]: audit 2024-05-20T22:16:42.560430+0000 mon.a (mon.0) 2621 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:16:43.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:43 smithi145 bash[23893]: audit 2024-05-20T22:16:42.594441+0000 mon.a (mon.0) 2622 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:16:43.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:43 smithi145 bash[23893]: audit 2024-05-20T22:16:43.547472+0000 mon.a (mon.0) 2623 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:16:43.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:43 smithi145 bash[23893]: cluster 2024-05-20T22:16:43.553592+0000 mon.a (mon.0) 2624 : cluster 0 osdmap e397: 8 total, 8 up, 8 in 2024-05-20T22:16:43.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:43 smithi050 bash[21866]: cluster 2024-05-20T22:16:42.239020+0000 mgr.y (mgr.14592) 410 : cluster 0 pgmap v610: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:16:43.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:43 smithi050 bash[21866]: audit 2024-05-20T22:16:42.560430+0000 mon.a (mon.0) 2621 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:16:43.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:43 smithi050 bash[21866]: audit 2024-05-20T22:16:42.594441+0000 mon.a (mon.0) 2622 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:16:43.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:43 smithi050 bash[21866]: audit 2024-05-20T22:16:43.547472+0000 mon.a (mon.0) 2623 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:16:43.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:43 smithi050 bash[21866]: cluster 2024-05-20T22:16:43.553592+0000 mon.a (mon.0) 2624 : cluster 0 osdmap e397: 8 total, 8 up, 8 in 2024-05-20T22:16:43.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:43 smithi050 bash[28929]: cluster 2024-05-20T22:16:42.239020+0000 mgr.y (mgr.14592) 410 : cluster 0 pgmap v610: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:16:43.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:43 smithi050 bash[28929]: audit 2024-05-20T22:16:42.560430+0000 mon.a (mon.0) 2621 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:16:43.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:43 smithi050 bash[28929]: audit 2024-05-20T22:16:42.594441+0000 mon.a (mon.0) 2622 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:16:43.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:43 smithi050 bash[28929]: audit 2024-05-20T22:16:43.547472+0000 mon.a (mon.0) 2623 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:16:43.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:43 smithi050 bash[28929]: cluster 2024-05-20T22:16:43.553592+0000 mon.a (mon.0) 2624 : cluster 0 osdmap e397: 8 total, 8 up, 8 in 2024-05-20T22:16:44.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:44 smithi050 bash[28929]: cluster 2024-05-20T22:16:44.612844+0000 mon.a (mon.0) 2625 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:44.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:44 smithi050 bash[28929]: cluster 2024-05-20T22:16:44.631158+0000 mon.a (mon.0) 2626 : cluster 0 osdmap e398: 8 total, 8 up, 8 in 2024-05-20T22:16:44.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:44 smithi050 bash[21866]: cluster 2024-05-20T22:16:44.612844+0000 mon.a (mon.0) 2625 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:44.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:44 smithi050 bash[21866]: cluster 2024-05-20T22:16:44.631158+0000 mon.a (mon.0) 2626 : cluster 0 osdmap e398: 8 total, 8 up, 8 in 2024-05-20T22:16:45.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:44 smithi145 bash[23893]: cluster 2024-05-20T22:16:44.612844+0000 mon.a (mon.0) 2625 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:16:45.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:44 smithi145 bash[23893]: cluster 2024-05-20T22:16:44.631158+0000 mon.a (mon.0) 2626 : cluster 0 osdmap e398: 8 total, 8 up, 8 in 2024-05-20T22:16:45.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:45 smithi050 bash[21866]: cluster 2024-05-20T22:16:44.240020+0000 mgr.y (mgr.14592) 411 : cluster 0 pgmap v613: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:16:45.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:45 smithi050 bash[28929]: cluster 2024-05-20T22:16:44.240020+0000 mgr.y (mgr.14592) 411 : cluster 0 pgmap v613: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:16:46.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:45 smithi145 bash[23893]: cluster 2024-05-20T22:16:44.240020+0000 mgr.y (mgr.14592) 411 : cluster 0 pgmap v613: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:16:46.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:46 smithi050 bash[21866]: cluster 2024-05-20T22:16:45.682137+0000 mon.a (mon.0) 2627 : cluster 0 osdmap e399: 8 total, 8 up, 8 in 2024-05-20T22:16:46.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:46 smithi050 bash[21866]: audit 2024-05-20T22:16:45.744154+0000 mon.a (mon.0) 2628 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:16:46.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:46 smithi050 bash[21866]: audit 2024-05-20T22:16:46.443838+0000 mon.a (mon.0) 2629 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:16:46.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:46 smithi050 bash[21866]: audit 2024-05-20T22:16:46.445204+0000 mon.a (mon.0) 2630 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:16:46.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:46 smithi050 bash[21866]: audit 2024-05-20T22:16:46.453346+0000 mon.a (mon.0) 2631 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:16:46.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:46 smithi050 bash[28929]: cluster 2024-05-20T22:16:45.682137+0000 mon.a (mon.0) 2627 : cluster 0 osdmap e399: 8 total, 8 up, 8 in 2024-05-20T22:16:46.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:46 smithi050 bash[28929]: audit 2024-05-20T22:16:45.744154+0000 mon.a (mon.0) 2628 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:16:46.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:46 smithi050 bash[28929]: audit 2024-05-20T22:16:46.443838+0000 mon.a (mon.0) 2629 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:16:46.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:46 smithi050 bash[28929]: audit 2024-05-20T22:16:46.445204+0000 mon.a (mon.0) 2630 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:16:46.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:46 smithi050 bash[28929]: audit 2024-05-20T22:16:46.453346+0000 mon.a (mon.0) 2631 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:16:47.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:46 smithi145 bash[23893]: cluster 2024-05-20T22:16:45.682137+0000 mon.a (mon.0) 2627 : cluster 0 osdmap e399: 8 total, 8 up, 8 in 2024-05-20T22:16:47.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:46 smithi145 bash[23893]: audit 2024-05-20T22:16:45.744154+0000 mon.a (mon.0) 2628 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:16:47.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:46 smithi145 bash[23893]: audit 2024-05-20T22:16:46.443838+0000 mon.a (mon.0) 2629 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:16:47.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:46 smithi145 bash[23893]: audit 2024-05-20T22:16:46.445204+0000 mon.a (mon.0) 2630 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:16:47.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:46 smithi145 bash[23893]: audit 2024-05-20T22:16:46.453346+0000 mon.a (mon.0) 2631 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:16:47.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:47 smithi050 bash[21866]: cluster 2024-05-20T22:16:46.240612+0000 mgr.y (mgr.14592) 412 : cluster 0 pgmap v616: 388 pgs: 388 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-05-20T22:16:47.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:47 smithi050 bash[21866]: cluster 2024-05-20T22:16:46.694497+0000 mon.a (mon.0) 2632 : cluster 0 osdmap e400: 8 total, 8 up, 8 in 2024-05-20T22:16:47.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:47 smithi050 bash[28929]: cluster 2024-05-20T22:16:46.240612+0000 mgr.y (mgr.14592) 412 : cluster 0 pgmap v616: 388 pgs: 388 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-05-20T22:16:47.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:47 smithi050 bash[28929]: cluster 2024-05-20T22:16:46.694497+0000 mon.a (mon.0) 2632 : cluster 0 osdmap e400: 8 total, 8 up, 8 in 2024-05-20T22:16:47.963 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:47 smithi145 bash[23893]: cluster 2024-05-20T22:16:46.240612+0000 mgr.y (mgr.14592) 412 : cluster 0 pgmap v616: 388 pgs: 388 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-05-20T22:16:47.963 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:47 smithi145 bash[23893]: cluster 2024-05-20T22:16:46.694497+0000 mon.a (mon.0) 2632 : cluster 0 osdmap e400: 8 total, 8 up, 8 in 2024-05-20T22:16:48.391 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:16:47 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:16:49.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:48 smithi145 bash[23893]: cluster 2024-05-20T22:16:47.694162+0000 mon.a (mon.0) 2633 : cluster 0 osdmap e401: 8 total, 8 up, 8 in 2024-05-20T22:16:49.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:48 smithi050 bash[21866]: cluster 2024-05-20T22:16:47.694162+0000 mon.a (mon.0) 2633 : cluster 0 osdmap e401: 8 total, 8 up, 8 in 2024-05-20T22:16:49.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:48 smithi050 bash[28929]: cluster 2024-05-20T22:16:47.694162+0000 mon.a (mon.0) 2633 : cluster 0 osdmap e401: 8 total, 8 up, 8 in 2024-05-20T22:16:49.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:16:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:16:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:16:50.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:49 smithi145 bash[23893]: audit 2024-05-20T22:16:47.968080+0000 mgr.y (mgr.14592) 413 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:16:50.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:49 smithi145 bash[23893]: cluster 2024-05-20T22:16:48.241568+0000 mgr.y (mgr.14592) 414 : cluster 0 pgmap v619: 388 pgs: 388 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-05-20T22:16:50.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:49 smithi050 bash[21866]: audit 2024-05-20T22:16:47.968080+0000 mgr.y (mgr.14592) 413 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:16:50.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:49 smithi050 bash[21866]: cluster 2024-05-20T22:16:48.241568+0000 mgr.y (mgr.14592) 414 : cluster 0 pgmap v619: 388 pgs: 388 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-05-20T22:16:50.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:49 smithi050 bash[28929]: audit 2024-05-20T22:16:47.968080+0000 mgr.y (mgr.14592) 413 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:16:50.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:49 smithi050 bash[28929]: cluster 2024-05-20T22:16:48.241568+0000 mgr.y (mgr.14592) 414 : cluster 0 pgmap v619: 388 pgs: 388 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-05-20T22:16:52.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:51 smithi145 bash[23893]: cluster 2024-05-20T22:16:50.244897+0000 mgr.y (mgr.14592) 415 : cluster 0 pgmap v620: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-05-20T22:16:52.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:51 smithi050 bash[21866]: cluster 2024-05-20T22:16:50.244897+0000 mgr.y (mgr.14592) 415 : cluster 0 pgmap v620: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-05-20T22:16:52.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:51 smithi050 bash[28929]: cluster 2024-05-20T22:16:50.244897+0000 mgr.y (mgr.14592) 415 : cluster 0 pgmap v620: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-05-20T22:16:53.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:52 smithi145 bash[23893]: audit 2024-05-20T22:16:52.358454+0000 mon.a (mon.0) 2634 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:16:53.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:52 smithi050 bash[21866]: audit 2024-05-20T22:16:52.358454+0000 mon.a (mon.0) 2634 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:16:53.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:52 smithi050 bash[28929]: audit 2024-05-20T22:16:52.358454+0000 mon.a (mon.0) 2634 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:16:54.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:53 smithi145 bash[23893]: cluster 2024-05-20T22:16:52.246036+0000 mgr.y (mgr.14592) 416 : cluster 0 pgmap v621: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 623 B/s wr, 2 op/s 2024-05-20T22:16:54.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:53 smithi050 bash[21866]: cluster 2024-05-20T22:16:52.246036+0000 mgr.y (mgr.14592) 416 : cluster 0 pgmap v621: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 623 B/s wr, 2 op/s 2024-05-20T22:16:54.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:53 smithi050 bash[28929]: cluster 2024-05-20T22:16:52.246036+0000 mgr.y (mgr.14592) 416 : cluster 0 pgmap v621: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 623 B/s wr, 2 op/s 2024-05-20T22:16:56.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:55 smithi145 bash[23893]: cluster 2024-05-20T22:16:54.247055+0000 mgr.y (mgr.14592) 417 : cluster 0 pgmap v622: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 511 B/s wr, 2 op/s 2024-05-20T22:16:56.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:55 smithi145 bash[23893]: cluster 2024-05-20T22:16:54.841654+0000 mon.a (mon.0) 2635 : cluster 0 osdmap e402: 8 total, 8 up, 8 in 2024-05-20T22:16:56.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:55 smithi050 bash[21866]: cluster 2024-05-20T22:16:54.247055+0000 mgr.y (mgr.14592) 417 : cluster 0 pgmap v622: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 511 B/s wr, 2 op/s 2024-05-20T22:16:56.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:55 smithi050 bash[21866]: cluster 2024-05-20T22:16:54.841654+0000 mon.a (mon.0) 2635 : cluster 0 osdmap e402: 8 total, 8 up, 8 in 2024-05-20T22:16:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:55 smithi050 bash[28929]: cluster 2024-05-20T22:16:54.247055+0000 mgr.y (mgr.14592) 417 : cluster 0 pgmap v622: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 511 B/s wr, 2 op/s 2024-05-20T22:16:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:55 smithi050 bash[28929]: cluster 2024-05-20T22:16:54.841654+0000 mon.a (mon.0) 2635 : cluster 0 osdmap e402: 8 total, 8 up, 8 in 2024-05-20T22:16:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:57 smithi145 bash[23893]: cluster 2024-05-20T22:16:56.250451+0000 mgr.y (mgr.14592) 418 : cluster 0 pgmap v624: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 478 B/s wr, 2 op/s 2024-05-20T22:16:58.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:16:57 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:16:58.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:57 smithi050 bash[21866]: cluster 2024-05-20T22:16:56.250451+0000 mgr.y (mgr.14592) 418 : cluster 0 pgmap v624: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 478 B/s wr, 2 op/s 2024-05-20T22:16:58.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:57 smithi050 bash[28929]: cluster 2024-05-20T22:16:56.250451+0000 mgr.y (mgr.14592) 418 : cluster 0 pgmap v624: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 478 B/s wr, 2 op/s 2024-05-20T22:16:59.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:58 smithi145 bash[23893]: cluster 2024-05-20T22:16:57.746907+0000 mon.a (mon.0) 2636 : cluster 0 osdmap e403: 8 total, 8 up, 8 in 2024-05-20T22:16:59.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:58 smithi145 bash[23893]: audit 2024-05-20T22:16:57.979386+0000 mgr.y (mgr.14592) 419 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:16:59.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:16:58 smithi145 bash[23893]: cluster 2024-05-20T22:16:58.251598+0000 mgr.y (mgr.14592) 420 : cluster 0 pgmap v626: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:16:59.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:58 smithi050 bash[21866]: cluster 2024-05-20T22:16:57.746907+0000 mon.a (mon.0) 2636 : cluster 0 osdmap e403: 8 total, 8 up, 8 in 2024-05-20T22:16:59.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:58 smithi050 bash[21866]: audit 2024-05-20T22:16:57.979386+0000 mgr.y (mgr.14592) 419 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:16:59.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:16:58 smithi050 bash[21866]: cluster 2024-05-20T22:16:58.251598+0000 mgr.y (mgr.14592) 420 : cluster 0 pgmap v626: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:16:59.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:58 smithi050 bash[28929]: cluster 2024-05-20T22:16:57.746907+0000 mon.a (mon.0) 2636 : cluster 0 osdmap e403: 8 total, 8 up, 8 in 2024-05-20T22:16:59.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:58 smithi050 bash[28929]: audit 2024-05-20T22:16:57.979386+0000 mgr.y (mgr.14592) 419 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:16:59.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:16:58 smithi050 bash[28929]: cluster 2024-05-20T22:16:58.251598+0000 mgr.y (mgr.14592) 420 : cluster 0 pgmap v626: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:16:59.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:16:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:16:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:17:01.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:01 smithi145 bash[23893]: cluster 2024-05-20T22:17:00.254983+0000 mgr.y (mgr.14592) 421 : cluster 0 pgmap v627: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:17:01.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:01 smithi050 bash[21866]: cluster 2024-05-20T22:17:00.254983+0000 mgr.y (mgr.14592) 421 : cluster 0 pgmap v627: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:17:01.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:01 smithi050 bash[28929]: cluster 2024-05-20T22:17:00.254983+0000 mgr.y (mgr.14592) 421 : cluster 0 pgmap v627: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:17:03.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:03 smithi145 bash[23893]: cluster 2024-05-20T22:17:02.256160+0000 mgr.y (mgr.14592) 422 : cluster 0 pgmap v628: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:17:03.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:03 smithi050 bash[21866]: cluster 2024-05-20T22:17:02.256160+0000 mgr.y (mgr.14592) 422 : cluster 0 pgmap v628: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:17:03.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:03 smithi050 bash[28929]: cluster 2024-05-20T22:17:02.256160+0000 mgr.y (mgr.14592) 422 : cluster 0 pgmap v628: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:17:05.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:05 smithi145 bash[23893]: cluster 2024-05-20T22:17:04.257187+0000 mgr.y (mgr.14592) 423 : cluster 0 pgmap v629: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:17:05.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:05 smithi145 bash[23893]: cluster 2024-05-20T22:17:04.844748+0000 mon.a (mon.0) 2637 : cluster 0 osdmap e404: 8 total, 8 up, 8 in 2024-05-20T22:17:05.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:05 smithi050 bash[21866]: cluster 2024-05-20T22:17:04.257187+0000 mgr.y (mgr.14592) 423 : cluster 0 pgmap v629: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:17:05.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:05 smithi050 bash[21866]: cluster 2024-05-20T22:17:04.844748+0000 mon.a (mon.0) 2637 : cluster 0 osdmap e404: 8 total, 8 up, 8 in 2024-05-20T22:17:05.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:05 smithi050 bash[28929]: cluster 2024-05-20T22:17:04.257187+0000 mgr.y (mgr.14592) 423 : cluster 0 pgmap v629: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:17:05.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:05 smithi050 bash[28929]: cluster 2024-05-20T22:17:04.844748+0000 mon.a (mon.0) 2637 : cluster 0 osdmap e404: 8 total, 8 up, 8 in 2024-05-20T22:17:07.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:07 smithi145 bash[23893]: cluster 2024-05-20T22:17:06.260732+0000 mgr.y (mgr.14592) 424 : cluster 0 pgmap v631: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:17:07.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:07 smithi050 bash[21866]: cluster 2024-05-20T22:17:06.260732+0000 mgr.y (mgr.14592) 424 : cluster 0 pgmap v631: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:17:07.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:07 smithi050 bash[28929]: cluster 2024-05-20T22:17:06.260732+0000 mgr.y (mgr.14592) 424 : cluster 0 pgmap v631: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:17:08.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:17:07 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:17:08.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:08 smithi145 bash[23893]: audit 2024-05-20T22:17:07.391691+0000 mon.a (mon.0) 2638 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:17:08.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:08 smithi050 bash[28929]: audit 2024-05-20T22:17:07.391691+0000 mon.a (mon.0) 2638 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:17:08.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:08 smithi050 bash[21866]: audit 2024-05-20T22:17:07.391691+0000 mon.a (mon.0) 2638 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:17:09.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:09 smithi145 bash[23893]: audit 2024-05-20T22:17:07.986812+0000 mgr.y (mgr.14592) 425 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:17:09.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:09 smithi145 bash[23893]: cluster 2024-05-20T22:17:08.261878+0000 mgr.y (mgr.14592) 426 : cluster 0 pgmap v632: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:17:09.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:09 smithi145 bash[23893]: cluster 2024-05-20T22:17:08.342769+0000 mon.a (mon.0) 2639 : cluster 0 osdmap e405: 8 total, 8 up, 8 in 2024-05-20T22:17:09.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:17:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:17:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:17:09.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:09 smithi050 bash[28929]: audit 2024-05-20T22:17:07.986812+0000 mgr.y (mgr.14592) 425 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:17:09.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:09 smithi050 bash[28929]: cluster 2024-05-20T22:17:08.261878+0000 mgr.y (mgr.14592) 426 : cluster 0 pgmap v632: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:17:09.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:09 smithi050 bash[28929]: cluster 2024-05-20T22:17:08.342769+0000 mon.a (mon.0) 2639 : cluster 0 osdmap e405: 8 total, 8 up, 8 in 2024-05-20T22:17:09.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:09 smithi050 bash[21866]: audit 2024-05-20T22:17:07.986812+0000 mgr.y (mgr.14592) 425 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:17:09.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:09 smithi050 bash[21866]: cluster 2024-05-20T22:17:08.261878+0000 mgr.y (mgr.14592) 426 : cluster 0 pgmap v632: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:17:09.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:09 smithi050 bash[21866]: cluster 2024-05-20T22:17:08.342769+0000 mon.a (mon.0) 2639 : cluster 0 osdmap e405: 8 total, 8 up, 8 in 2024-05-20T22:17:11.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:11 smithi145 bash[23893]: cluster 2024-05-20T22:17:10.265231+0000 mgr.y (mgr.14592) 427 : cluster 0 pgmap v634: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-20T22:17:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:11 smithi050 bash[21866]: cluster 2024-05-20T22:17:10.265231+0000 mgr.y (mgr.14592) 427 : cluster 0 pgmap v634: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-20T22:17:11.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:11 smithi050 bash[28929]: cluster 2024-05-20T22:17:10.265231+0000 mgr.y (mgr.14592) 427 : cluster 0 pgmap v634: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-20T22:17:13.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:13 smithi145 bash[23893]: cluster 2024-05-20T22:17:12.266347+0000 mgr.y (mgr.14592) 428 : cluster 0 pgmap v635: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-20T22:17:13.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:13 smithi050 bash[21866]: cluster 2024-05-20T22:17:12.266347+0000 mgr.y (mgr.14592) 428 : cluster 0 pgmap v635: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-20T22:17:13.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:13 smithi050 bash[28929]: cluster 2024-05-20T22:17:12.266347+0000 mgr.y (mgr.14592) 428 : cluster 0 pgmap v635: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-20T22:17:15.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:15 smithi145 bash[23893]: cluster 2024-05-20T22:17:14.267493+0000 mgr.y (mgr.14592) 429 : cluster 0 pgmap v636: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:17:15.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:15 smithi145 bash[23893]: cluster 2024-05-20T22:17:14.847882+0000 mon.a (mon.0) 2640 : cluster 0 osdmap e406: 8 total, 8 up, 8 in 2024-05-20T22:17:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:15 smithi050 bash[21866]: cluster 2024-05-20T22:17:14.267493+0000 mgr.y (mgr.14592) 429 : cluster 0 pgmap v636: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:17:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:15 smithi050 bash[21866]: cluster 2024-05-20T22:17:14.847882+0000 mon.a (mon.0) 2640 : cluster 0 osdmap e406: 8 total, 8 up, 8 in 2024-05-20T22:17:15.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:15 smithi050 bash[28929]: cluster 2024-05-20T22:17:14.267493+0000 mgr.y (mgr.14592) 429 : cluster 0 pgmap v636: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:17:15.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:15 smithi050 bash[28929]: cluster 2024-05-20T22:17:14.847882+0000 mon.a (mon.0) 2640 : cluster 0 osdmap e406: 8 total, 8 up, 8 in 2024-05-20T22:17:17.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:17 smithi145 bash[23893]: cluster 2024-05-20T22:17:16.270909+0000 mgr.y (mgr.14592) 430 : cluster 0 pgmap v638: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-20T22:17:17.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:17 smithi050 bash[21866]: cluster 2024-05-20T22:17:16.270909+0000 mgr.y (mgr.14592) 430 : cluster 0 pgmap v638: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-20T22:17:17.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:17 smithi050 bash[28929]: cluster 2024-05-20T22:17:16.270909+0000 mgr.y (mgr.14592) 430 : cluster 0 pgmap v638: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-20T22:17:18.390 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:17:17 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:17:19.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:19 smithi145 bash[23893]: audit 2024-05-20T22:17:17.994838+0000 mgr.y (mgr.14592) 431 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:17:19.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:19 smithi145 bash[23893]: cluster 2024-05-20T22:17:18.271898+0000 mgr.y (mgr.14592) 432 : cluster 0 pgmap v639: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-20T22:17:19.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:19 smithi145 bash[23893]: audit 2024-05-20T22:17:18.388926+0000 mon.a (mon.0) 2641 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:17:19.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:19 smithi145 bash[23893]: audit 2024-05-20T22:17:18.389745+0000 mon.a (mon.0) 2642 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-63"}]: dispatch 2024-05-20T22:17:19.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:17:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:17:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:17:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:19 smithi050 bash[28929]: audit 2024-05-20T22:17:17.994838+0000 mgr.y (mgr.14592) 431 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:17:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:19 smithi050 bash[28929]: cluster 2024-05-20T22:17:18.271898+0000 mgr.y (mgr.14592) 432 : cluster 0 pgmap v639: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-20T22:17:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:19 smithi050 bash[28929]: audit 2024-05-20T22:17:18.388926+0000 mon.a (mon.0) 2641 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:17:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:19 smithi050 bash[28929]: audit 2024-05-20T22:17:18.389745+0000 mon.a (mon.0) 2642 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-63"}]: dispatch 2024-05-20T22:17:19.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:19 smithi050 bash[21866]: audit 2024-05-20T22:17:17.994838+0000 mgr.y (mgr.14592) 431 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:17:19.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:19 smithi050 bash[21866]: cluster 2024-05-20T22:17:18.271898+0000 mgr.y (mgr.14592) 432 : cluster 0 pgmap v639: 388 pgs: 388 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-20T22:17:19.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:19 smithi050 bash[21866]: audit 2024-05-20T22:17:18.388926+0000 mon.a (mon.0) 2641 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:17:19.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:19 smithi050 bash[21866]: audit 2024-05-20T22:17:18.389745+0000 mon.a (mon.0) 2642 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-63"}]: dispatch 2024-05-20T22:17:20.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:20 smithi145 bash[23893]: cluster 2024-05-20T22:17:19.372878+0000 mon.a (mon.0) 2643 : cluster 0 osdmap e407: 8 total, 8 up, 8 in 2024-05-20T22:17:20.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:20 smithi050 bash[21866]: cluster 2024-05-20T22:17:19.372878+0000 mon.a (mon.0) 2643 : cluster 0 osdmap e407: 8 total, 8 up, 8 in 2024-05-20T22:17:20.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:20 smithi050 bash[28929]: cluster 2024-05-20T22:17:19.372878+0000 mon.a (mon.0) 2643 : cluster 0 osdmap e407: 8 total, 8 up, 8 in 2024-05-20T22:17:21.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:21 smithi145 bash[23893]: cluster 2024-05-20T22:17:20.274981+0000 mgr.y (mgr.14592) 433 : cluster 0 pgmap v641: 356 pgs: 356 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:17:21.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:21 smithi145 bash[23893]: cluster 2024-05-20T22:17:20.386966+0000 mon.a (mon.0) 2644 : cluster 0 osdmap e408: 8 total, 8 up, 8 in 2024-05-20T22:17:21.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:21 smithi145 bash[23893]: audit 2024-05-20T22:17:20.392422+0000 mon.a (mon.0) 2645 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:17:21.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:21 smithi050 bash[21866]: cluster 2024-05-20T22:17:20.274981+0000 mgr.y (mgr.14592) 433 : cluster 0 pgmap v641: 356 pgs: 356 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:17:21.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:21 smithi050 bash[21866]: cluster 2024-05-20T22:17:20.386966+0000 mon.a (mon.0) 2644 : cluster 0 osdmap e408: 8 total, 8 up, 8 in 2024-05-20T22:17:21.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:21 smithi050 bash[21866]: audit 2024-05-20T22:17:20.392422+0000 mon.a (mon.0) 2645 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:17:21.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:21 smithi050 bash[28929]: cluster 2024-05-20T22:17:20.274981+0000 mgr.y (mgr.14592) 433 : cluster 0 pgmap v641: 356 pgs: 356 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:17:21.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:21 smithi050 bash[28929]: cluster 2024-05-20T22:17:20.386966+0000 mon.a (mon.0) 2644 : cluster 0 osdmap e408: 8 total, 8 up, 8 in 2024-05-20T22:17:21.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:21 smithi050 bash[28929]: audit 2024-05-20T22:17:20.392422+0000 mon.a (mon.0) 2645 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:17:22.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:22 smithi050 bash[21866]: audit 2024-05-20T22:17:21.387065+0000 mon.a (mon.0) 2646 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:17:22.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:22 smithi050 bash[21866]: cluster 2024-05-20T22:17:21.394648+0000 mon.a (mon.0) 2647 : cluster 0 osdmap e409: 8 total, 8 up, 8 in 2024-05-20T22:17:22.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:22 smithi050 bash[21866]: audit 2024-05-20T22:17:21.405830+0000 mon.a (mon.0) 2648 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:17:22.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:22 smithi050 bash[21866]: audit 2024-05-20T22:17:21.431552+0000 mon.a (mon.0) 2649 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:17:22.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:22 smithi050 bash[28929]: audit 2024-05-20T22:17:21.387065+0000 mon.a (mon.0) 2646 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:17:22.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:22 smithi050 bash[28929]: cluster 2024-05-20T22:17:21.394648+0000 mon.a (mon.0) 2647 : cluster 0 osdmap e409: 8 total, 8 up, 8 in 2024-05-20T22:17:22.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:22 smithi050 bash[28929]: audit 2024-05-20T22:17:21.405830+0000 mon.a (mon.0) 2648 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:17:22.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:22 smithi050 bash[28929]: audit 2024-05-20T22:17:21.431552+0000 mon.a (mon.0) 2649 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:17:22.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:22 smithi145 bash[23893]: audit 2024-05-20T22:17:21.387065+0000 mon.a (mon.0) 2646 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:17:22.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:22 smithi145 bash[23893]: cluster 2024-05-20T22:17:21.394648+0000 mon.a (mon.0) 2647 : cluster 0 osdmap e409: 8 total, 8 up, 8 in 2024-05-20T22:17:22.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:22 smithi145 bash[23893]: audit 2024-05-20T22:17:21.405830+0000 mon.a (mon.0) 2648 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:17:22.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:22 smithi145 bash[23893]: audit 2024-05-20T22:17:21.431552+0000 mon.a (mon.0) 2649 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:17:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:23 smithi050 bash[21866]: cluster 2024-05-20T22:17:22.275981+0000 mgr.y (mgr.14592) 434 : cluster 0 pgmap v644: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:17:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:23 smithi050 bash[21866]: audit 2024-05-20T22:17:22.396221+0000 mon.a (mon.0) 2650 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:17:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:23 smithi050 bash[21866]: cluster 2024-05-20T22:17:22.405701+0000 mon.a (mon.0) 2651 : cluster 0 osdmap e410: 8 total, 8 up, 8 in 2024-05-20T22:17:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:23 smithi050 bash[21866]: audit 2024-05-20T22:17:22.426837+0000 mon.a (mon.0) 2652 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:17:23.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:23 smithi050 bash[28929]: cluster 2024-05-20T22:17:22.275981+0000 mgr.y (mgr.14592) 434 : cluster 0 pgmap v644: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:17:23.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:23 smithi050 bash[28929]: audit 2024-05-20T22:17:22.396221+0000 mon.a (mon.0) 2650 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:17:23.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:23 smithi050 bash[28929]: cluster 2024-05-20T22:17:22.405701+0000 mon.a (mon.0) 2651 : cluster 0 osdmap e410: 8 total, 8 up, 8 in 2024-05-20T22:17:23.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:23 smithi050 bash[28929]: audit 2024-05-20T22:17:22.426837+0000 mon.a (mon.0) 2652 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:17:23.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:23 smithi145 bash[23893]: cluster 2024-05-20T22:17:22.275981+0000 mgr.y (mgr.14592) 434 : cluster 0 pgmap v644: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:17:23.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:23 smithi145 bash[23893]: audit 2024-05-20T22:17:22.396221+0000 mon.a (mon.0) 2650 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:17:23.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:23 smithi145 bash[23893]: cluster 2024-05-20T22:17:22.405701+0000 mon.a (mon.0) 2651 : cluster 0 osdmap e410: 8 total, 8 up, 8 in 2024-05-20T22:17:23.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:23 smithi145 bash[23893]: audit 2024-05-20T22:17:22.426837+0000 mon.a (mon.0) 2652 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:17:24.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:24 smithi050 bash[21866]: cluster 2024-05-20T22:17:23.414076+0000 mon.a (mon.0) 2653 : cluster 0 osdmap e411: 8 total, 8 up, 8 in 2024-05-20T22:17:24.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:24 smithi050 bash[28929]: cluster 2024-05-20T22:17:23.414076+0000 mon.a (mon.0) 2653 : cluster 0 osdmap e411: 8 total, 8 up, 8 in 2024-05-20T22:17:24.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:24 smithi145 bash[23893]: cluster 2024-05-20T22:17:23.414076+0000 mon.a (mon.0) 2653 : cluster 0 osdmap e411: 8 total, 8 up, 8 in 2024-05-20T22:17:25.120 INFO:tasks.workunit.client.0.smithi050.stdout:isc: started 0x55740886dec0 2024-05-20T22:17:25.120 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886dff0 2024-05-20T22:17:25.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886d690 2024-05-20T22:17:25.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886e120 2024-05-20T22:17:25.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886e270 2024-05-20T22:17:25.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886e870 2024-05-20T22:17:25.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886a3f0 2024-05-20T22:17:25.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886a520 2024-05-20T22:17:25.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886a650 2024-05-20T22:17:25.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886e980 2024-05-20T22:17:25.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886e3c0 2024-05-20T22:17:25.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886e4f0 2024-05-20T22:17:25.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886e620 2024-05-20T22:17:25.122 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886ead0 2024-05-20T22:17:25.122 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886efa0 2024-05-20T22:17:25.122 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886f120 2024-05-20T22:17:25.122 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886f700 2024-05-20T22:17:25.122 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886ec00 2024-05-20T22:17:25.122 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886ed30 2024-05-20T22:17:25.122 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886ee60 2024-05-20T22:17:25.122 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886f830 2024-05-20T22:17:25.122 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886f250 2024-05-20T22:17:25.122 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886f3a0 2024-05-20T22:17:25.122 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886f4d0 2024-05-20T22:17:25.123 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886f960 2024-05-20T22:17:25.123 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886fe30 2024-05-20T22:17:25.123 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886ff60 2024-05-20T22:17:25.123 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886f5e0 2024-05-20T22:17:25.123 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408870090 2024-05-20T22:17:25.123 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408870230 2024-05-20T22:17:25.123 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408870830 2024-05-20T22:17:25.123 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886db20 2024-05-20T22:17:25.123 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886dc50 2024-05-20T22:17:25.124 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886dda0 2024-05-20T22:17:25.124 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408870980 2024-05-20T22:17:25.124 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408870380 2024-05-20T22:17:25.124 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088704b0 2024-05-20T22:17:25.124 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408870600 2024-05-20T22:17:25.124 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408870ab0 2024-05-20T22:17:25.124 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408870fa0 2024-05-20T22:17:25.124 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088710d0 2024-05-20T22:17:25.124 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408870710 2024-05-20T22:17:25.124 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408871200 2024-05-20T22:17:25.124 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408871350 2024-05-20T22:17:25.125 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408870c00 2024-05-20T22:17:25.125 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408870d50 2024-05-20T22:17:25.125 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408871930 2024-05-20T22:17:25.125 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408871480 2024-05-20T22:17:25.125 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088715d0 2024-05-20T22:17:25.125 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408871700 2024-05-20T22:17:25.125 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408871a60 2024-05-20T22:17:25.125 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408871f80 2024-05-20T22:17:25.125 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408872100 2024-05-20T22:17:25.125 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886fa90 2024-05-20T22:17:25.125 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886fba0 2024-05-20T22:17:25.125 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740886fcd0 2024-05-20T22:17:25.125 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408872230 2024-05-20T22:17:25.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408872700 2024-05-20T22:17:25.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408872850 2024-05-20T22:17:25.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408871b90 2024-05-20T22:17:25.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408871cc0 2024-05-20T22:17:25.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408871df0 2024-05-20T22:17:25.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408872980 2024-05-20T22:17:25.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408872e50 2024-05-20T22:17:25.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408872f80 2024-05-20T22:17:25.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408872360 2024-05-20T22:17:25.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408872490 2024-05-20T22:17:25.127 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088725c0 2024-05-20T22:17:25.127 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088730b0 2024-05-20T22:17:25.127 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088735f0 2024-05-20T22:17:25.127 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408873740 2024-05-20T22:17:25.127 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408872ab0 2024-05-20T22:17:25.127 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408872be0 2024-05-20T22:17:25.127 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408872d10 2024-05-20T22:17:25.127 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408873870 2024-05-20T22:17:25.127 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408873d90 2024-05-20T22:17:25.127 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408873ec0 2024-05-20T22:17:25.127 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408873200 2024-05-20T22:17:25.127 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408873330 2024-05-20T22:17:25.127 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408873460 2024-05-20T22:17:25.128 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408873ff0 2024-05-20T22:17:25.128 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088744c0 2024-05-20T22:17:25.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:25 smithi050 bash[21866]: cluster 2024-05-20T22:17:24.276994+0000 mgr.y (mgr.14592) 435 : cluster 0 pgmap v647: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:17:25.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:25 smithi050 bash[21866]: cluster 2024-05-20T22:17:24.426411+0000 mon.a (mon.0) 2654 : cluster 0 osdmap e412: 8 total, 8 up, 8 in 2024-05-20T22:17:25.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:25 smithi050 bash[28929]: cluster 2024-05-20T22:17:24.276994+0000 mgr.y (mgr.14592) 435 : cluster 0 pgmap v647: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:17:25.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:25 smithi050 bash[28929]: cluster 2024-05-20T22:17:24.426411+0000 mon.a (mon.0) 2654 : cluster 0 osdmap e412: 8 total, 8 up, 8 in 2024-05-20T22:17:25.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:25 smithi145 bash[23893]: cluster 2024-05-20T22:17:24.276994+0000 mgr.y (mgr.14592) 435 : cluster 0 pgmap v647: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:17:25.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:25 smithi145 bash[23893]: cluster 2024-05-20T22:17:24.426411+0000 mon.a (mon.0) 2654 : cluster 0 osdmap e412: 8 total, 8 up, 8 in 2024-05-20T22:17:26.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:26 smithi050 bash[21866]: cluster 2024-05-20T22:17:25.432306+0000 mon.a (mon.0) 2655 : cluster 0 osdmap e413: 8 total, 8 up, 8 in 2024-05-20T22:17:26.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:26 smithi050 bash[28929]: cluster 2024-05-20T22:17:25.432306+0000 mon.a (mon.0) 2655 : cluster 0 osdmap e413: 8 total, 8 up, 8 in 2024-05-20T22:17:26.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:26 smithi145 bash[23893]: cluster 2024-05-20T22:17:25.432306+0000 mon.a (mon.0) 2655 : cluster 0 osdmap e413: 8 total, 8 up, 8 in 2024-05-20T22:17:27.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:27 smithi050 bash[21866]: cluster 2024-05-20T22:17:26.278081+0000 mgr.y (mgr.14592) 436 : cluster 0 pgmap v650: 388 pgs: 388 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-05-20T22:17:27.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:27 smithi050 bash[28929]: cluster 2024-05-20T22:17:26.278081+0000 mgr.y (mgr.14592) 436 : cluster 0 pgmap v650: 388 pgs: 388 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-05-20T22:17:27.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:27 smithi145 bash[23893]: cluster 2024-05-20T22:17:26.278081+0000 mgr.y (mgr.14592) 436 : cluster 0 pgmap v650: 388 pgs: 388 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-05-20T22:17:28.390 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:17:28 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:17:29.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:17:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:17:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:17:29.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:29 smithi050 bash[21866]: audit 2024-05-20T22:17:28.004971+0000 mgr.y (mgr.14592) 437 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:17:29.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:29 smithi050 bash[21866]: cluster 2024-05-20T22:17:28.279167+0000 mgr.y (mgr.14592) 438 : cluster 0 pgmap v651: 388 pgs: 388 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-05-20T22:17:29.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:29 smithi050 bash[28929]: audit 2024-05-20T22:17:28.004971+0000 mgr.y (mgr.14592) 437 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:17:29.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:29 smithi050 bash[28929]: cluster 2024-05-20T22:17:28.279167+0000 mgr.y (mgr.14592) 438 : cluster 0 pgmap v651: 388 pgs: 388 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-05-20T22:17:29.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:29 smithi145 bash[23893]: audit 2024-05-20T22:17:28.004971+0000 mgr.y (mgr.14592) 437 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:17:29.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:29 smithi145 bash[23893]: cluster 2024-05-20T22:17:28.279167+0000 mgr.y (mgr.14592) 438 : cluster 0 pgmap v651: 388 pgs: 388 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-05-20T22:17:31.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:31 smithi050 bash[21866]: cluster 2024-05-20T22:17:30.282618+0000 mgr.y (mgr.14592) 439 : cluster 0 pgmap v652: 388 pgs: 388 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-05-20T22:17:31.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:31 smithi050 bash[28929]: cluster 2024-05-20T22:17:30.282618+0000 mgr.y (mgr.14592) 439 : cluster 0 pgmap v652: 388 pgs: 388 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-05-20T22:17:31.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:31 smithi145 bash[23893]: cluster 2024-05-20T22:17:30.282618+0000 mgr.y (mgr.14592) 439 : cluster 0 pgmap v652: 388 pgs: 388 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-05-20T22:17:33.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:33 smithi145 bash[23893]: cluster 2024-05-20T22:17:32.283698+0000 mgr.y (mgr.14592) 440 : cluster 0 pgmap v653: 388 pgs: 388 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-05-20T22:17:33.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:33 smithi050 bash[21866]: cluster 2024-05-20T22:17:32.283698+0000 mgr.y (mgr.14592) 440 : cluster 0 pgmap v653: 388 pgs: 388 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-05-20T22:17:33.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:33 smithi050 bash[28929]: cluster 2024-05-20T22:17:32.283698+0000 mgr.y (mgr.14592) 440 : cluster 0 pgmap v653: 388 pgs: 388 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-05-20T22:17:35.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:35 smithi145 bash[23893]: cluster 2024-05-20T22:17:34.284663+0000 mgr.y (mgr.14592) 441 : cluster 0 pgmap v654: 388 pgs: 388 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2024-05-20T22:17:35.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:35 smithi145 bash[23893]: cluster 2024-05-20T22:17:34.854343+0000 mon.a (mon.0) 2656 : cluster 0 osdmap e414: 8 total, 8 up, 8 in 2024-05-20T22:17:35.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:35 smithi050 bash[21866]: cluster 2024-05-20T22:17:34.284663+0000 mgr.y (mgr.14592) 441 : cluster 0 pgmap v654: 388 pgs: 388 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2024-05-20T22:17:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:35 smithi050 bash[21866]: cluster 2024-05-20T22:17:34.854343+0000 mon.a (mon.0) 2656 : cluster 0 osdmap e414: 8 total, 8 up, 8 in 2024-05-20T22:17:35.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:35 smithi050 bash[28929]: cluster 2024-05-20T22:17:34.284663+0000 mgr.y (mgr.14592) 441 : cluster 0 pgmap v654: 388 pgs: 388 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2024-05-20T22:17:35.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:35 smithi050 bash[28929]: cluster 2024-05-20T22:17:34.854343+0000 mon.a (mon.0) 2656 : cluster 0 osdmap e414: 8 total, 8 up, 8 in 2024-05-20T22:17:36.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:36 smithi145 bash[23893]: audit 2024-05-20T22:17:35.491653+0000 mon.a (mon.0) 2657 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:17:36.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:36 smithi145 bash[23893]: audit 2024-05-20T22:17:35.492487+0000 mon.a (mon.0) 2658 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-65"}]: dispatch 2024-05-20T22:17:36.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:36 smithi050 bash[21866]: audit 2024-05-20T22:17:35.491653+0000 mon.a (mon.0) 2657 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:17:36.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:36 smithi050 bash[21866]: audit 2024-05-20T22:17:35.492487+0000 mon.a (mon.0) 2658 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-65"}]: dispatch 2024-05-20T22:17:36.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:36 smithi050 bash[28929]: audit 2024-05-20T22:17:35.491653+0000 mon.a (mon.0) 2657 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:17:36.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:36 smithi050 bash[28929]: audit 2024-05-20T22:17:35.492487+0000 mon.a (mon.0) 2658 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-65"}]: dispatch 2024-05-20T22:17:37.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:37 smithi145 bash[23893]: cluster 2024-05-20T22:17:36.288337+0000 mgr.y (mgr.14592) 442 : cluster 0 pgmap v656: 388 pgs: 388 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:17:37.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:37 smithi145 bash[23893]: cluster 2024-05-20T22:17:36.473461+0000 mon.a (mon.0) 2659 : cluster 0 osdmap e415: 8 total, 8 up, 8 in 2024-05-20T22:17:37.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:37 smithi050 bash[21866]: cluster 2024-05-20T22:17:36.288337+0000 mgr.y (mgr.14592) 442 : cluster 0 pgmap v656: 388 pgs: 388 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:17:37.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:37 smithi050 bash[21866]: cluster 2024-05-20T22:17:36.473461+0000 mon.a (mon.0) 2659 : cluster 0 osdmap e415: 8 total, 8 up, 8 in 2024-05-20T22:17:37.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:37 smithi050 bash[28929]: cluster 2024-05-20T22:17:36.288337+0000 mgr.y (mgr.14592) 442 : cluster 0 pgmap v656: 388 pgs: 388 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:17:37.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:37 smithi050 bash[28929]: cluster 2024-05-20T22:17:36.473461+0000 mon.a (mon.0) 2659 : cluster 0 osdmap e415: 8 total, 8 up, 8 in 2024-05-20T22:17:38.390 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:17:38 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:17:38.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:38 smithi145 bash[23893]: audit 2024-05-20T22:17:37.467111+0000 mon.a (mon.0) 2660 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:17:38.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:38 smithi145 bash[23893]: cluster 2024-05-20T22:17:37.478753+0000 mon.a (mon.0) 2661 : cluster 0 osdmap e416: 8 total, 8 up, 8 in 2024-05-20T22:17:38.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:38 smithi145 bash[23893]: audit 2024-05-20T22:17:37.482255+0000 mon.a (mon.0) 2662 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:17:38.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:38 smithi145 bash[23893]: audit 2024-05-20T22:17:38.472237+0000 mon.a (mon.0) 2663 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:17:38.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:38 smithi145 bash[23893]: cluster 2024-05-20T22:17:38.479921+0000 mon.a (mon.0) 2664 : cluster 0 osdmap e417: 8 total, 8 up, 8 in 2024-05-20T22:17:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:38 smithi050 bash[21866]: audit 2024-05-20T22:17:37.467111+0000 mon.a (mon.0) 2660 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:17:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:38 smithi050 bash[21866]: cluster 2024-05-20T22:17:37.478753+0000 mon.a (mon.0) 2661 : cluster 0 osdmap e416: 8 total, 8 up, 8 in 2024-05-20T22:17:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:38 smithi050 bash[21866]: audit 2024-05-20T22:17:37.482255+0000 mon.a (mon.0) 2662 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:17:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:38 smithi050 bash[21866]: audit 2024-05-20T22:17:38.472237+0000 mon.a (mon.0) 2663 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:17:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:38 smithi050 bash[21866]: cluster 2024-05-20T22:17:38.479921+0000 mon.a (mon.0) 2664 : cluster 0 osdmap e417: 8 total, 8 up, 8 in 2024-05-20T22:17:38.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:38 smithi050 bash[28929]: audit 2024-05-20T22:17:37.467111+0000 mon.a (mon.0) 2660 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:17:38.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:38 smithi050 bash[28929]: cluster 2024-05-20T22:17:37.478753+0000 mon.a (mon.0) 2661 : cluster 0 osdmap e416: 8 total, 8 up, 8 in 2024-05-20T22:17:38.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:38 smithi050 bash[28929]: audit 2024-05-20T22:17:37.482255+0000 mon.a (mon.0) 2662 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:17:38.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:38 smithi050 bash[28929]: audit 2024-05-20T22:17:38.472237+0000 mon.a (mon.0) 2663 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:17:38.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:38 smithi050 bash[28929]: cluster 2024-05-20T22:17:38.479921+0000 mon.a (mon.0) 2664 : cluster 0 osdmap e417: 8 total, 8 up, 8 in 2024-05-20T22:17:39.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:17:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:17:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:17:39.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:39 smithi050 bash[28929]: audit 2024-05-20T22:17:38.016206+0000 mgr.y (mgr.14592) 443 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:17:39.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:39 smithi050 bash[28929]: cluster 2024-05-20T22:17:38.289331+0000 mgr.y (mgr.14592) 444 : cluster 0 pgmap v659: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:17:39.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:39 smithi050 bash[28929]: cluster 2024-05-20T22:17:38.486523+0000 mon.a (mon.0) 2665 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:17:39.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:39 smithi050 bash[28929]: audit 2024-05-20T22:17:38.488896+0000 mon.a (mon.0) 2666 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:17:39.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:39 smithi050 bash[28929]: cluster 2024-05-20T22:17:39.482304+0000 mon.a (mon.0) 2667 : cluster 0 osdmap e418: 8 total, 8 up, 8 in 2024-05-20T22:17:39.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:39 smithi050 bash[21866]: audit 2024-05-20T22:17:38.016206+0000 mgr.y (mgr.14592) 443 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:17:39.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:39 smithi050 bash[21866]: cluster 2024-05-20T22:17:38.289331+0000 mgr.y (mgr.14592) 444 : cluster 0 pgmap v659: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:17:39.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:39 smithi050 bash[21866]: cluster 2024-05-20T22:17:38.486523+0000 mon.a (mon.0) 2665 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:17:39.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:39 smithi050 bash[21866]: audit 2024-05-20T22:17:38.488896+0000 mon.a (mon.0) 2666 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:17:39.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:39 smithi050 bash[21866]: cluster 2024-05-20T22:17:39.482304+0000 mon.a (mon.0) 2667 : cluster 0 osdmap e418: 8 total, 8 up, 8 in 2024-05-20T22:17:39.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:39 smithi145 bash[23893]: audit 2024-05-20T22:17:38.016206+0000 mgr.y (mgr.14592) 443 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:17:39.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:39 smithi145 bash[23893]: cluster 2024-05-20T22:17:38.289331+0000 mgr.y (mgr.14592) 444 : cluster 0 pgmap v659: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:17:39.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:39 smithi145 bash[23893]: cluster 2024-05-20T22:17:38.486523+0000 mon.a (mon.0) 2665 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:17:39.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:39 smithi145 bash[23893]: audit 2024-05-20T22:17:38.488896+0000 mon.a (mon.0) 2666 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:17:39.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:39 smithi145 bash[23893]: cluster 2024-05-20T22:17:39.482304+0000 mon.a (mon.0) 2667 : cluster 0 osdmap e418: 8 total, 8 up, 8 in 2024-05-20T22:17:40.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:40 smithi145 bash[23893]: audit 2024-05-20T22:17:39.560360+0000 mon.a (mon.0) 2668 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:17:40.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:40 smithi145 bash[23893]: audit 2024-05-20T22:17:39.561248+0000 mon.a (mon.0) 2669 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-67"}]: dispatch 2024-05-20T22:17:40.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:40 smithi050 bash[28929]: audit 2024-05-20T22:17:39.560360+0000 mon.a (mon.0) 2668 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:17:40.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:40 smithi050 bash[28929]: audit 2024-05-20T22:17:39.561248+0000 mon.a (mon.0) 2669 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-67"}]: dispatch 2024-05-20T22:17:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:40 smithi050 bash[21866]: audit 2024-05-20T22:17:39.560360+0000 mon.a (mon.0) 2668 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:17:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:40 smithi050 bash[21866]: audit 2024-05-20T22:17:39.561248+0000 mon.a (mon.0) 2669 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-67"}]: dispatch 2024-05-20T22:17:41.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:41 smithi145 bash[23893]: cluster 2024-05-20T22:17:40.293340+0000 mgr.y (mgr.14592) 445 : cluster 0 pgmap v662: 388 pgs: 388 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:17:41.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:41 smithi145 bash[23893]: cluster 2024-05-20T22:17:40.551953+0000 mon.a (mon.0) 2670 : cluster 0 osdmap e419: 8 total, 8 up, 8 in 2024-05-20T22:17:41.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:41 smithi050 bash[21866]: cluster 2024-05-20T22:17:40.293340+0000 mgr.y (mgr.14592) 445 : cluster 0 pgmap v662: 388 pgs: 388 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:17:41.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:41 smithi050 bash[21866]: cluster 2024-05-20T22:17:40.551953+0000 mon.a (mon.0) 2670 : cluster 0 osdmap e419: 8 total, 8 up, 8 in 2024-05-20T22:17:41.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:41 smithi050 bash[28929]: cluster 2024-05-20T22:17:40.293340+0000 mgr.y (mgr.14592) 445 : cluster 0 pgmap v662: 388 pgs: 388 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:17:41.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:41 smithi050 bash[28929]: cluster 2024-05-20T22:17:40.551953+0000 mon.a (mon.0) 2670 : cluster 0 osdmap e419: 8 total, 8 up, 8 in 2024-05-20T22:17:42.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:42 smithi145 bash[23893]: cluster 2024-05-20T22:17:41.562809+0000 mon.a (mon.0) 2671 : cluster 0 osdmap e420: 8 total, 8 up, 8 in 2024-05-20T22:17:42.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:42 smithi145 bash[23893]: audit 2024-05-20T22:17:41.565721+0000 mon.a (mon.0) 2672 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:17:42.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:42 smithi050 bash[21866]: cluster 2024-05-20T22:17:41.562809+0000 mon.a (mon.0) 2671 : cluster 0 osdmap e420: 8 total, 8 up, 8 in 2024-05-20T22:17:42.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:42 smithi050 bash[21866]: audit 2024-05-20T22:17:41.565721+0000 mon.a (mon.0) 2672 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:17:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:42 smithi050 bash[28929]: cluster 2024-05-20T22:17:41.562809+0000 mon.a (mon.0) 2671 : cluster 0 osdmap e420: 8 total, 8 up, 8 in 2024-05-20T22:17:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:42 smithi050 bash[28929]: audit 2024-05-20T22:17:41.565721+0000 mon.a (mon.0) 2672 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:17:44.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:44 smithi145 bash[23893]: cluster 2024-05-20T22:17:42.294328+0000 mgr.y (mgr.14592) 446 : cluster 0 pgmap v665: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:17:44.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:44 smithi145 bash[23893]: audit 2024-05-20T22:17:42.567187+0000 mon.a (mon.0) 2673 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:17:44.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:44 smithi145 bash[23893]: cluster 2024-05-20T22:17:42.577267+0000 mon.a (mon.0) 2674 : cluster 0 osdmap e421: 8 total, 8 up, 8 in 2024-05-20T22:17:44.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:44 smithi145 bash[23893]: audit 2024-05-20T22:17:42.581525+0000 mon.a (mon.0) 2675 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:17:44.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:44 smithi145 bash[23893]: audit 2024-05-20T22:17:42.665376+0000 mon.a (mon.0) 2676 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:17:44.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:44 smithi145 bash[23893]: audit 2024-05-20T22:17:42.665959+0000 mon.a (mon.0) 2677 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-69"}]: dispatch 2024-05-20T22:17:44.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:44 smithi050 bash[21866]: cluster 2024-05-20T22:17:42.294328+0000 mgr.y (mgr.14592) 446 : cluster 0 pgmap v665: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:17:44.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:44 smithi050 bash[21866]: audit 2024-05-20T22:17:42.567187+0000 mon.a (mon.0) 2673 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:17:44.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:44 smithi050 bash[21866]: cluster 2024-05-20T22:17:42.577267+0000 mon.a (mon.0) 2674 : cluster 0 osdmap e421: 8 total, 8 up, 8 in 2024-05-20T22:17:44.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:44 smithi050 bash[21866]: audit 2024-05-20T22:17:42.581525+0000 mon.a (mon.0) 2675 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:17:44.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:44 smithi050 bash[21866]: audit 2024-05-20T22:17:42.665376+0000 mon.a (mon.0) 2676 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:17:44.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:44 smithi050 bash[21866]: audit 2024-05-20T22:17:42.665959+0000 mon.a (mon.0) 2677 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-69"}]: dispatch 2024-05-20T22:17:44.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:44 smithi050 bash[28929]: cluster 2024-05-20T22:17:42.294328+0000 mgr.y (mgr.14592) 446 : cluster 0 pgmap v665: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:17:44.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:44 smithi050 bash[28929]: audit 2024-05-20T22:17:42.567187+0000 mon.a (mon.0) 2673 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:17:44.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:44 smithi050 bash[28929]: cluster 2024-05-20T22:17:42.577267+0000 mon.a (mon.0) 2674 : cluster 0 osdmap e421: 8 total, 8 up, 8 in 2024-05-20T22:17:44.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:44 smithi050 bash[28929]: audit 2024-05-20T22:17:42.581525+0000 mon.a (mon.0) 2675 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:17:44.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:44 smithi050 bash[28929]: audit 2024-05-20T22:17:42.665376+0000 mon.a (mon.0) 2676 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:17:44.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:44 smithi050 bash[28929]: audit 2024-05-20T22:17:42.665959+0000 mon.a (mon.0) 2677 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-69"}]: dispatch 2024-05-20T22:17:45.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:45 smithi145 bash[23893]: cluster 2024-05-20T22:17:43.576976+0000 mon.a (mon.0) 2678 : cluster 0 osdmap e422: 8 total, 8 up, 8 in 2024-05-20T22:17:45.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:45 smithi145 bash[23893]: cluster 2024-05-20T22:17:44.295258+0000 mgr.y (mgr.14592) 447 : cluster 0 pgmap v668: 356 pgs: 356 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:17:45.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:45 smithi145 bash[23893]: cluster 2024-05-20T22:17:44.581398+0000 mon.a (mon.0) 2679 : cluster 0 osdmap e423: 8 total, 8 up, 8 in 2024-05-20T22:17:45.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:45 smithi145 bash[23893]: audit 2024-05-20T22:17:44.583781+0000 mon.a (mon.0) 2680 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:17:45.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:45 smithi050 bash[21866]: cluster 2024-05-20T22:17:43.576976+0000 mon.a (mon.0) 2678 : cluster 0 osdmap e422: 8 total, 8 up, 8 in 2024-05-20T22:17:45.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:45 smithi050 bash[21866]: cluster 2024-05-20T22:17:44.295258+0000 mgr.y (mgr.14592) 447 : cluster 0 pgmap v668: 356 pgs: 356 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:17:45.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:45 smithi050 bash[21866]: cluster 2024-05-20T22:17:44.581398+0000 mon.a (mon.0) 2679 : cluster 0 osdmap e423: 8 total, 8 up, 8 in 2024-05-20T22:17:45.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:45 smithi050 bash[21866]: audit 2024-05-20T22:17:44.583781+0000 mon.a (mon.0) 2680 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:17:45.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:45 smithi050 bash[28929]: cluster 2024-05-20T22:17:43.576976+0000 mon.a (mon.0) 2678 : cluster 0 osdmap e422: 8 total, 8 up, 8 in 2024-05-20T22:17:45.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:45 smithi050 bash[28929]: cluster 2024-05-20T22:17:44.295258+0000 mgr.y (mgr.14592) 447 : cluster 0 pgmap v668: 356 pgs: 356 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:17:45.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:45 smithi050 bash[28929]: cluster 2024-05-20T22:17:44.581398+0000 mon.a (mon.0) 2679 : cluster 0 osdmap e423: 8 total, 8 up, 8 in 2024-05-20T22:17:45.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:45 smithi050 bash[28929]: audit 2024-05-20T22:17:44.583781+0000 mon.a (mon.0) 2680 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:17:46.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:46 smithi145 bash[23893]: cluster 2024-05-20T22:17:45.044008+0000 mon.a (mon.0) 2681 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:17:46.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:46 smithi145 bash[23893]: audit 2024-05-20T22:17:45.576908+0000 mon.a (mon.0) 2682 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:17:46.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:46 smithi145 bash[23893]: cluster 2024-05-20T22:17:45.585018+0000 mon.a (mon.0) 2683 : cluster 0 osdmap e424: 8 total, 8 up, 8 in 2024-05-20T22:17:46.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:46 smithi145 bash[23893]: audit 2024-05-20T22:17:45.588548+0000 mon.a (mon.0) 2684 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:17:46.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:46 smithi145 bash[23893]: audit 2024-05-20T22:17:45.606693+0000 mon.a (mon.0) 2685 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:17:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:46 smithi050 bash[21866]: cluster 2024-05-20T22:17:45.044008+0000 mon.a (mon.0) 2681 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:17:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:46 smithi050 bash[21866]: audit 2024-05-20T22:17:45.576908+0000 mon.a (mon.0) 2682 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:17:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:46 smithi050 bash[21866]: cluster 2024-05-20T22:17:45.585018+0000 mon.a (mon.0) 2683 : cluster 0 osdmap e424: 8 total, 8 up, 8 in 2024-05-20T22:17:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:46 smithi050 bash[21866]: audit 2024-05-20T22:17:45.588548+0000 mon.a (mon.0) 2684 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:17:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:46 smithi050 bash[21866]: audit 2024-05-20T22:17:45.606693+0000 mon.a (mon.0) 2685 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:17:46.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:46 smithi050 bash[28929]: cluster 2024-05-20T22:17:45.044008+0000 mon.a (mon.0) 2681 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:17:46.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:46 smithi050 bash[28929]: audit 2024-05-20T22:17:45.576908+0000 mon.a (mon.0) 2682 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:17:46.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:46 smithi050 bash[28929]: cluster 2024-05-20T22:17:45.585018+0000 mon.a (mon.0) 2683 : cluster 0 osdmap e424: 8 total, 8 up, 8 in 2024-05-20T22:17:46.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:46 smithi050 bash[28929]: audit 2024-05-20T22:17:45.588548+0000 mon.a (mon.0) 2684 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:17:46.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:46 smithi050 bash[28929]: audit 2024-05-20T22:17:45.606693+0000 mon.a (mon.0) 2685 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:17:47.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:47 smithi145 bash[23893]: cluster 2024-05-20T22:17:46.296269+0000 mgr.y (mgr.14592) 448 : cluster 0 pgmap v671: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:17:47.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:47 smithi145 bash[23893]: audit 2024-05-20T22:17:46.578521+0000 mon.a (mon.0) 2686 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:17:47.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:47 smithi145 bash[23893]: audit 2024-05-20T22:17:46.580198+0000 mon.a (mon.0) 2687 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:17:47.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:47 smithi145 bash[23893]: cluster 2024-05-20T22:17:46.587497+0000 mon.a (mon.0) 2688 : cluster 0 osdmap e425: 8 total, 8 up, 8 in 2024-05-20T22:17:47.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:47 smithi050 bash[21866]: cluster 2024-05-20T22:17:46.296269+0000 mgr.y (mgr.14592) 448 : cluster 0 pgmap v671: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:17:47.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:47 smithi050 bash[21866]: audit 2024-05-20T22:17:46.578521+0000 mon.a (mon.0) 2686 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:17:47.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:47 smithi050 bash[21866]: audit 2024-05-20T22:17:46.580198+0000 mon.a (mon.0) 2687 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:17:47.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:47 smithi050 bash[21866]: cluster 2024-05-20T22:17:46.587497+0000 mon.a (mon.0) 2688 : cluster 0 osdmap e425: 8 total, 8 up, 8 in 2024-05-20T22:17:47.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:47 smithi050 bash[28929]: cluster 2024-05-20T22:17:46.296269+0000 mgr.y (mgr.14592) 448 : cluster 0 pgmap v671: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:17:47.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:47 smithi050 bash[28929]: audit 2024-05-20T22:17:46.578521+0000 mon.a (mon.0) 2686 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:17:47.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:47 smithi050 bash[28929]: audit 2024-05-20T22:17:46.580198+0000 mon.a (mon.0) 2687 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:17:47.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:47 smithi050 bash[28929]: cluster 2024-05-20T22:17:46.587497+0000 mon.a (mon.0) 2688 : cluster 0 osdmap e425: 8 total, 8 up, 8 in 2024-05-20T22:17:48.390 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:17:48 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:17:48.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:48 smithi145 bash[23893]: audit 2024-05-20T22:17:47.139908+0000 mon.a (mon.0) 2689 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:17:48.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:48 smithi145 bash[23893]: audit 2024-05-20T22:17:47.144677+0000 mon.a (mon.0) 2690 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:17:48.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:48 smithi145 bash[23893]: audit 2024-05-20T22:17:47.223744+0000 mon.a (mon.0) 2691 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:48 smithi145 bash[23893]: audit 2024-05-20T22:17:47.224925+0000 mon.a (mon.0) 2692 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:48 smithi145 bash[23893]: audit 2024-05-20T22:17:47.226002+0000 mon.a (mon.0) 2693 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:48 smithi145 bash[23893]: audit 2024-05-20T22:17:47.226974+0000 mon.a (mon.0) 2694 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:48 smithi145 bash[23893]: cephadm 2024-05-20T22:17:47.227609+0000 mgr.y (mgr.14592) 449 : cephadm 1 Adjusting osd_memory_target on smithi145 to 3292M 2024-05-20T22:17:48.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:48 smithi145 bash[23893]: audit 2024-05-20T22:17:47.234211+0000 mon.a (mon.0) 2695 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:17:48.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:48 smithi145 bash[23893]: cluster 2024-05-20T22:17:47.590907+0000 mon.a (mon.0) 2696 : cluster 0 osdmap e426: 8 total, 8 up, 8 in 2024-05-20T22:17:48.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:48 smithi145 bash[23893]: audit 2024-05-20T22:17:47.811189+0000 mon.a (mon.0) 2697 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:48 smithi145 bash[23893]: audit 2024-05-20T22:17:47.812754+0000 mon.a (mon.0) 2698 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:48 smithi145 bash[23893]: audit 2024-05-20T22:17:47.814147+0000 mon.a (mon.0) 2699 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:48 smithi145 bash[23893]: audit 2024-05-20T22:17:47.815149+0000 mon.a (mon.0) 2700 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:48 smithi145 bash[23893]: audit 2024-05-20T22:17:47.822274+0000 mon.a (mon.0) 2701 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:17:48.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:48 smithi145 bash[23893]: audit 2024-05-20T22:17:47.826502+0000 mon.a (mon.0) 2702 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:17:48.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:48 smithi145 bash[23893]: audit 2024-05-20T22:17:47.827713+0000 mon.a (mon.0) 2703 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:17:48.392 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:48 smithi145 bash[23893]: audit 2024-05-20T22:17:47.834660+0000 mon.a (mon.0) 2704 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:17:48.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:48 smithi050 bash[21866]: audit 2024-05-20T22:17:47.139908+0000 mon.a (mon.0) 2689 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:17:48.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:48 smithi050 bash[21866]: audit 2024-05-20T22:17:47.144677+0000 mon.a (mon.0) 2690 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:17:48.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:48 smithi050 bash[21866]: audit 2024-05-20T22:17:47.223744+0000 mon.a (mon.0) 2691 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:48 smithi050 bash[21866]: audit 2024-05-20T22:17:47.224925+0000 mon.a (mon.0) 2692 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:48 smithi050 bash[21866]: audit 2024-05-20T22:17:47.226002+0000 mon.a (mon.0) 2693 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:48 smithi050 bash[21866]: audit 2024-05-20T22:17:47.226974+0000 mon.a (mon.0) 2694 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:48 smithi050 bash[21866]: cephadm 2024-05-20T22:17:47.227609+0000 mgr.y (mgr.14592) 449 : cephadm 1 Adjusting osd_memory_target on smithi145 to 3292M 2024-05-20T22:17:48.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:48 smithi050 bash[21866]: audit 2024-05-20T22:17:47.234211+0000 mon.a (mon.0) 2695 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:17:48.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:48 smithi050 bash[21866]: cluster 2024-05-20T22:17:47.590907+0000 mon.a (mon.0) 2696 : cluster 0 osdmap e426: 8 total, 8 up, 8 in 2024-05-20T22:17:48.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:48 smithi050 bash[21866]: audit 2024-05-20T22:17:47.811189+0000 mon.a (mon.0) 2697 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:48 smithi050 bash[21866]: audit 2024-05-20T22:17:47.812754+0000 mon.a (mon.0) 2698 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:48 smithi050 bash[21866]: audit 2024-05-20T22:17:47.814147+0000 mon.a (mon.0) 2699 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:48 smithi050 bash[21866]: audit 2024-05-20T22:17:47.815149+0000 mon.a (mon.0) 2700 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:48 smithi050 bash[21866]: audit 2024-05-20T22:17:47.822274+0000 mon.a (mon.0) 2701 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:17:48.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:48 smithi050 bash[21866]: audit 2024-05-20T22:17:47.826502+0000 mon.a (mon.0) 2702 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:17:48.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:48 smithi050 bash[21866]: audit 2024-05-20T22:17:47.827713+0000 mon.a (mon.0) 2703 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:17:48.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:48 smithi050 bash[21866]: audit 2024-05-20T22:17:47.834660+0000 mon.a (mon.0) 2704 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:17:48.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:48 smithi050 bash[28929]: audit 2024-05-20T22:17:47.139908+0000 mon.a (mon.0) 2689 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:17:48.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:48 smithi050 bash[28929]: audit 2024-05-20T22:17:47.144677+0000 mon.a (mon.0) 2690 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:17:48.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:48 smithi050 bash[28929]: audit 2024-05-20T22:17:47.223744+0000 mon.a (mon.0) 2691 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:48 smithi050 bash[28929]: audit 2024-05-20T22:17:47.224925+0000 mon.a (mon.0) 2692 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:48 smithi050 bash[28929]: audit 2024-05-20T22:17:47.226002+0000 mon.a (mon.0) 2693 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:48 smithi050 bash[28929]: audit 2024-05-20T22:17:47.226974+0000 mon.a (mon.0) 2694 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:48 smithi050 bash[28929]: cephadm 2024-05-20T22:17:47.227609+0000 mgr.y (mgr.14592) 449 : cephadm 1 Adjusting osd_memory_target on smithi145 to 3292M 2024-05-20T22:17:48.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:48 smithi050 bash[28929]: audit 2024-05-20T22:17:47.234211+0000 mon.a (mon.0) 2695 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:17:48.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:48 smithi050 bash[28929]: cluster 2024-05-20T22:17:47.590907+0000 mon.a (mon.0) 2696 : cluster 0 osdmap e426: 8 total, 8 up, 8 in 2024-05-20T22:17:48.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:48 smithi050 bash[28929]: audit 2024-05-20T22:17:47.811189+0000 mon.a (mon.0) 2697 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:48 smithi050 bash[28929]: audit 2024-05-20T22:17:47.812754+0000 mon.a (mon.0) 2698 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:48 smithi050 bash[28929]: audit 2024-05-20T22:17:47.814147+0000 mon.a (mon.0) 2699 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:48 smithi050 bash[28929]: audit 2024-05-20T22:17:47.815149+0000 mon.a (mon.0) 2700 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T22:17:48.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:48 smithi050 bash[28929]: audit 2024-05-20T22:17:47.822274+0000 mon.a (mon.0) 2701 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:17:48.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:48 smithi050 bash[28929]: audit 2024-05-20T22:17:47.826502+0000 mon.a (mon.0) 2702 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:17:48.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:48 smithi050 bash[28929]: audit 2024-05-20T22:17:47.827713+0000 mon.a (mon.0) 2703 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:17:48.447 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:48 smithi050 bash[28929]: audit 2024-05-20T22:17:47.834660+0000 mon.a (mon.0) 2704 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:17:49.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:49 smithi145 bash[23893]: cephadm 2024-05-20T22:17:47.815887+0000 mgr.y (mgr.14592) 450 : cephadm 1 Adjusting osd_memory_target on smithi050 to 3293M 2024-05-20T22:17:49.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:49 smithi145 bash[23893]: audit 2024-05-20T22:17:48.027527+0000 mgr.y (mgr.14592) 451 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:17:49.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:49 smithi145 bash[23893]: cluster 2024-05-20T22:17:48.297333+0000 mgr.y (mgr.14592) 452 : cluster 0 pgmap v674: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:17:49.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:49 smithi050 bash[21866]: cephadm 2024-05-20T22:17:47.815887+0000 mgr.y (mgr.14592) 450 : cephadm 1 Adjusting osd_memory_target on smithi050 to 3293M 2024-05-20T22:17:49.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:49 smithi050 bash[21866]: audit 2024-05-20T22:17:48.027527+0000 mgr.y (mgr.14592) 451 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:17:49.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:49 smithi050 bash[21866]: cluster 2024-05-20T22:17:48.297333+0000 mgr.y (mgr.14592) 452 : cluster 0 pgmap v674: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:17:49.393 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:49 smithi050 bash[28929]: cephadm 2024-05-20T22:17:47.815887+0000 mgr.y (mgr.14592) 450 : cephadm 1 Adjusting osd_memory_target on smithi050 to 3293M 2024-05-20T22:17:49.393 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:49 smithi050 bash[28929]: audit 2024-05-20T22:17:48.027527+0000 mgr.y (mgr.14592) 451 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:17:49.393 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:49 smithi050 bash[28929]: cluster 2024-05-20T22:17:48.297333+0000 mgr.y (mgr.14592) 452 : cluster 0 pgmap v674: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:17:49.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:17:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:17:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:17:51.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:50 smithi145 bash[23893]: cluster 2024-05-20T22:17:50.300743+0000 mgr.y (mgr.14592) 453 : cluster 0 pgmap v675: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-05-20T22:17:51.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:50 smithi050 bash[21866]: cluster 2024-05-20T22:17:50.300743+0000 mgr.y (mgr.14592) 453 : cluster 0 pgmap v675: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-05-20T22:17:51.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:50 smithi050 bash[28929]: cluster 2024-05-20T22:17:50.300743+0000 mgr.y (mgr.14592) 453 : cluster 0 pgmap v675: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-05-20T22:17:53.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:53 smithi145 bash[23893]: cluster 2024-05-20T22:17:52.301712+0000 mgr.y (mgr.14592) 454 : cluster 0 pgmap v676: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 913 B/s rd, 1.9 KiB/s wr, 4 op/s 2024-05-20T22:17:53.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:53 smithi145 bash[23893]: audit 2024-05-20T22:17:52.520884+0000 mon.a (mon.0) 2705 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:17:53.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:53 smithi050 bash[28929]: cluster 2024-05-20T22:17:52.301712+0000 mgr.y (mgr.14592) 454 : cluster 0 pgmap v676: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 913 B/s rd, 1.9 KiB/s wr, 4 op/s 2024-05-20T22:17:53.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:53 smithi050 bash[28929]: audit 2024-05-20T22:17:52.520884+0000 mon.a (mon.0) 2705 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:17:53.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:53 smithi050 bash[21866]: cluster 2024-05-20T22:17:52.301712+0000 mgr.y (mgr.14592) 454 : cluster 0 pgmap v676: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 913 B/s rd, 1.9 KiB/s wr, 4 op/s 2024-05-20T22:17:53.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:53 smithi050 bash[21866]: audit 2024-05-20T22:17:52.520884+0000 mon.a (mon.0) 2705 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:17:55.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:55 smithi145 bash[23893]: cluster 2024-05-20T22:17:54.302712+0000 mgr.y (mgr.14592) 455 : cluster 0 pgmap v677: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1.6 KiB/s wr, 3 op/s 2024-05-20T22:17:56.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:55 smithi050 bash[21866]: cluster 2024-05-20T22:17:54.302712+0000 mgr.y (mgr.14592) 455 : cluster 0 pgmap v677: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1.6 KiB/s wr, 3 op/s 2024-05-20T22:17:56.201 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:55 smithi050 bash[28929]: cluster 2024-05-20T22:17:54.302712+0000 mgr.y (mgr.14592) 455 : cluster 0 pgmap v677: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1.6 KiB/s wr, 3 op/s 2024-05-20T22:17:57.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:57 smithi145 bash[23893]: cluster 2024-05-20T22:17:56.306815+0000 mgr.y (mgr.14592) 456 : cluster 0 pgmap v678: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-05-20T22:17:57.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:57 smithi050 bash[21866]: cluster 2024-05-20T22:17:56.306815+0000 mgr.y (mgr.14592) 456 : cluster 0 pgmap v678: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-05-20T22:17:57.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:57 smithi050 bash[28929]: cluster 2024-05-20T22:17:56.306815+0000 mgr.y (mgr.14592) 456 : cluster 0 pgmap v678: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-05-20T22:17:58.390 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:17:58 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:17:59.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:59 smithi145 bash[23893]: audit 2024-05-20T22:17:58.033402+0000 mgr.y (mgr.14592) 457 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:17:59.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:17:59 smithi145 bash[23893]: cluster 2024-05-20T22:17:58.307816+0000 mgr.y (mgr.14592) 458 : cluster 0 pgmap v679: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-05-20T22:17:59.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:17:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:17:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:17:59.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:59 smithi050 bash[21866]: audit 2024-05-20T22:17:58.033402+0000 mgr.y (mgr.14592) 457 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:17:59.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:17:59 smithi050 bash[21866]: cluster 2024-05-20T22:17:58.307816+0000 mgr.y (mgr.14592) 458 : cluster 0 pgmap v679: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-05-20T22:17:59.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:59 smithi050 bash[28929]: audit 2024-05-20T22:17:58.033402+0000 mgr.y (mgr.14592) 457 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:17:59.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:17:59 smithi050 bash[28929]: cluster 2024-05-20T22:17:58.307816+0000 mgr.y (mgr.14592) 458 : cluster 0 pgmap v679: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-05-20T22:18:01.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:01 smithi145 bash[23893]: cluster 2024-05-20T22:18:00.311209+0000 mgr.y (mgr.14592) 459 : cluster 0 pgmap v680: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-05-20T22:18:01.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:01 smithi050 bash[21866]: cluster 2024-05-20T22:18:00.311209+0000 mgr.y (mgr.14592) 459 : cluster 0 pgmap v680: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-05-20T22:18:01.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:01 smithi050 bash[28929]: cluster 2024-05-20T22:18:00.311209+0000 mgr.y (mgr.14592) 459 : cluster 0 pgmap v680: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-05-20T22:18:03.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:03 smithi145 bash[23893]: cluster 2024-05-20T22:18:02.312254+0000 mgr.y (mgr.14592) 460 : cluster 0 pgmap v681: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:18:03.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:03 smithi050 bash[21866]: cluster 2024-05-20T22:18:02.312254+0000 mgr.y (mgr.14592) 460 : cluster 0 pgmap v681: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:18:03.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:03 smithi050 bash[28929]: cluster 2024-05-20T22:18:02.312254+0000 mgr.y (mgr.14592) 460 : cluster 0 pgmap v681: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:18:05.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:05 smithi145 bash[23893]: cluster 2024-05-20T22:18:04.313331+0000 mgr.y (mgr.14592) 461 : cluster 0 pgmap v682: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:18:05.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:05 smithi050 bash[21866]: cluster 2024-05-20T22:18:04.313331+0000 mgr.y (mgr.14592) 461 : cluster 0 pgmap v682: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:18:05.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:05 smithi050 bash[28929]: cluster 2024-05-20T22:18:04.313331+0000 mgr.y (mgr.14592) 461 : cluster 0 pgmap v682: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:18:07.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:07 smithi145 bash[23893]: cluster 2024-05-20T22:18:06.316788+0000 mgr.y (mgr.14592) 462 : cluster 0 pgmap v683: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:18:07.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:07 smithi050 bash[21866]: cluster 2024-05-20T22:18:06.316788+0000 mgr.y (mgr.14592) 462 : cluster 0 pgmap v683: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:18:07.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:07 smithi050 bash[28929]: cluster 2024-05-20T22:18:06.316788+0000 mgr.y (mgr.14592) 462 : cluster 0 pgmap v683: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:18:08.390 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:18:08 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:18:08.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:08 smithi050 bash[21866]: audit 2024-05-20T22:18:07.554107+0000 mon.a (mon.0) 2706 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:18:08.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:08 smithi050 bash[21866]: audit 2024-05-20T22:18:07.706834+0000 mon.a (mon.0) 2707 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:18:08.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:08 smithi050 bash[21866]: audit 2024-05-20T22:18:07.707694+0000 mon.a (mon.0) 2708 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-71"}]: dispatch 2024-05-20T22:18:08.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:08 smithi050 bash[28929]: audit 2024-05-20T22:18:07.554107+0000 mon.a (mon.0) 2706 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:18:08.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:08 smithi050 bash[28929]: audit 2024-05-20T22:18:07.706834+0000 mon.a (mon.0) 2707 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:18:08.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:08 smithi050 bash[28929]: audit 2024-05-20T22:18:07.707694+0000 mon.a (mon.0) 2708 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-71"}]: dispatch 2024-05-20T22:18:08.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:08 smithi145 bash[23893]: audit 2024-05-20T22:18:07.554107+0000 mon.a (mon.0) 2706 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:18:08.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:08 smithi145 bash[23893]: audit 2024-05-20T22:18:07.706834+0000 mon.a (mon.0) 2707 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:18:08.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:08 smithi145 bash[23893]: audit 2024-05-20T22:18:07.707694+0000 mon.a (mon.0) 2708 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-71"}]: dispatch 2024-05-20T22:18:09.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:18:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:18:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:18:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:09 smithi050 bash[21866]: audit 2024-05-20T22:18:08.044768+0000 mgr.y (mgr.14592) 463 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:18:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:09 smithi050 bash[21866]: cluster 2024-05-20T22:18:08.317893+0000 mgr.y (mgr.14592) 464 : cluster 0 pgmap v684: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:18:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:09 smithi050 bash[21866]: cluster 2024-05-20T22:18:08.407649+0000 mon.a (mon.0) 2709 : cluster 0 osdmap e427: 8 total, 8 up, 8 in 2024-05-20T22:18:09.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:09 smithi050 bash[28929]: audit 2024-05-20T22:18:08.044768+0000 mgr.y (mgr.14592) 463 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:18:09.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:09 smithi050 bash[28929]: cluster 2024-05-20T22:18:08.317893+0000 mgr.y (mgr.14592) 464 : cluster 0 pgmap v684: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:18:09.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:09 smithi050 bash[28929]: cluster 2024-05-20T22:18:08.407649+0000 mon.a (mon.0) 2709 : cluster 0 osdmap e427: 8 total, 8 up, 8 in 2024-05-20T22:18:09.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:09 smithi145 bash[23893]: audit 2024-05-20T22:18:08.044768+0000 mgr.y (mgr.14592) 463 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:18:09.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:09 smithi145 bash[23893]: cluster 2024-05-20T22:18:08.317893+0000 mgr.y (mgr.14592) 464 : cluster 0 pgmap v684: 388 pgs: 388 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:18:09.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:09 smithi145 bash[23893]: cluster 2024-05-20T22:18:08.407649+0000 mon.a (mon.0) 2709 : cluster 0 osdmap e427: 8 total, 8 up, 8 in 2024-05-20T22:18:10.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:10 smithi050 bash[21866]: cluster 2024-05-20T22:18:09.420205+0000 mon.a (mon.0) 2710 : cluster 0 osdmap e428: 8 total, 8 up, 8 in 2024-05-20T22:18:10.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:10 smithi050 bash[21866]: audit 2024-05-20T22:18:09.424795+0000 mon.a (mon.0) 2711 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:18:10.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:10 smithi050 bash[28929]: cluster 2024-05-20T22:18:09.420205+0000 mon.a (mon.0) 2710 : cluster 0 osdmap e428: 8 total, 8 up, 8 in 2024-05-20T22:18:10.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:10 smithi050 bash[28929]: audit 2024-05-20T22:18:09.424795+0000 mon.a (mon.0) 2711 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:18:10.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:10 smithi145 bash[23893]: cluster 2024-05-20T22:18:09.420205+0000 mon.a (mon.0) 2710 : cluster 0 osdmap e428: 8 total, 8 up, 8 in 2024-05-20T22:18:10.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:10 smithi145 bash[23893]: audit 2024-05-20T22:18:09.424795+0000 mon.a (mon.0) 2711 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:18:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:11 smithi050 bash[21866]: cluster 2024-05-20T22:18:10.321116+0000 mgr.y (mgr.14592) 465 : cluster 0 pgmap v687: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:18:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:11 smithi050 bash[21866]: cluster 2024-05-20T22:18:10.412748+0000 mon.a (mon.0) 2712 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:18:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:11 smithi050 bash[21866]: audit 2024-05-20T22:18:10.424970+0000 mon.a (mon.0) 2713 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:18:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:11 smithi050 bash[21866]: cluster 2024-05-20T22:18:10.435425+0000 mon.a (mon.0) 2714 : cluster 0 osdmap e429: 8 total, 8 up, 8 in 2024-05-20T22:18:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:11 smithi050 bash[21866]: audit 2024-05-20T22:18:10.439103+0000 mon.a (mon.0) 2715 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:18:11.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:11 smithi050 bash[28929]: cluster 2024-05-20T22:18:10.321116+0000 mgr.y (mgr.14592) 465 : cluster 0 pgmap v687: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:18:11.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:11 smithi050 bash[28929]: cluster 2024-05-20T22:18:10.412748+0000 mon.a (mon.0) 2712 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:18:11.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:11 smithi050 bash[28929]: audit 2024-05-20T22:18:10.424970+0000 mon.a (mon.0) 2713 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:18:11.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:11 smithi050 bash[28929]: cluster 2024-05-20T22:18:10.435425+0000 mon.a (mon.0) 2714 : cluster 0 osdmap e429: 8 total, 8 up, 8 in 2024-05-20T22:18:11.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:11 smithi050 bash[28929]: audit 2024-05-20T22:18:10.439103+0000 mon.a (mon.0) 2715 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:18:11.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:11 smithi145 bash[23893]: cluster 2024-05-20T22:18:10.321116+0000 mgr.y (mgr.14592) 465 : cluster 0 pgmap v687: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:18:11.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:11 smithi145 bash[23893]: cluster 2024-05-20T22:18:10.412748+0000 mon.a (mon.0) 2712 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:18:11.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:11 smithi145 bash[23893]: audit 2024-05-20T22:18:10.424970+0000 mon.a (mon.0) 2713 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:18:11.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:11 smithi145 bash[23893]: cluster 2024-05-20T22:18:10.435425+0000 mon.a (mon.0) 2714 : cluster 0 osdmap e429: 8 total, 8 up, 8 in 2024-05-20T22:18:11.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:11 smithi145 bash[23893]: audit 2024-05-20T22:18:10.439103+0000 mon.a (mon.0) 2715 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:18:12.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:12 smithi050 bash[21866]: cluster 2024-05-20T22:18:11.443578+0000 mon.a (mon.0) 2716 : cluster 0 osdmap e430: 8 total, 8 up, 8 in 2024-05-20T22:18:12.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:12 smithi050 bash[28929]: cluster 2024-05-20T22:18:11.443578+0000 mon.a (mon.0) 2716 : cluster 0 osdmap e430: 8 total, 8 up, 8 in 2024-05-20T22:18:12.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:12 smithi145 bash[23893]: cluster 2024-05-20T22:18:11.443578+0000 mon.a (mon.0) 2716 : cluster 0 osdmap e430: 8 total, 8 up, 8 in 2024-05-20T22:18:13.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:13 smithi050 bash[21866]: cluster 2024-05-20T22:18:12.322040+0000 mgr.y (mgr.14592) 466 : cluster 0 pgmap v690: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:18:13.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:13 smithi050 bash[21866]: cluster 2024-05-20T22:18:12.453410+0000 mon.a (mon.0) 2717 : cluster 0 osdmap e431: 8 total, 8 up, 8 in 2024-05-20T22:18:13.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:13 smithi050 bash[28929]: cluster 2024-05-20T22:18:12.322040+0000 mgr.y (mgr.14592) 466 : cluster 0 pgmap v690: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:18:13.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:13 smithi050 bash[28929]: cluster 2024-05-20T22:18:12.453410+0000 mon.a (mon.0) 2717 : cluster 0 osdmap e431: 8 total, 8 up, 8 in 2024-05-20T22:18:13.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:13 smithi145 bash[23893]: cluster 2024-05-20T22:18:12.322040+0000 mgr.y (mgr.14592) 466 : cluster 0 pgmap v690: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:18:13.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:13 smithi145 bash[23893]: cluster 2024-05-20T22:18:12.453410+0000 mon.a (mon.0) 2717 : cluster 0 osdmap e431: 8 total, 8 up, 8 in 2024-05-20T22:18:15.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:15 smithi145 bash[23893]: cluster 2024-05-20T22:18:14.322992+0000 mgr.y (mgr.14592) 467 : cluster 0 pgmap v692: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-20T22:18:15.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:15 smithi050 bash[21866]: cluster 2024-05-20T22:18:14.322992+0000 mgr.y (mgr.14592) 467 : cluster 0 pgmap v692: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-20T22:18:15.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:15 smithi050 bash[28929]: cluster 2024-05-20T22:18:14.322992+0000 mgr.y (mgr.14592) 467 : cluster 0 pgmap v692: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-20T22:18:17.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:17 smithi145 bash[23893]: cluster 2024-05-20T22:18:16.326431+0000 mgr.y (mgr.14592) 468 : cluster 0 pgmap v693: 388 pgs: 388 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-05-20T22:18:17.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:17 smithi050 bash[21866]: cluster 2024-05-20T22:18:16.326431+0000 mgr.y (mgr.14592) 468 : cluster 0 pgmap v693: 388 pgs: 388 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-05-20T22:18:17.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:17 smithi050 bash[28929]: cluster 2024-05-20T22:18:16.326431+0000 mgr.y (mgr.14592) 468 : cluster 0 pgmap v693: 388 pgs: 388 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-05-20T22:18:18.390 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:18:18 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:18:19.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:18:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:18:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:18:19.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:19 smithi050 bash[21866]: audit 2024-05-20T22:18:18.054731+0000 mgr.y (mgr.14592) 469 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:18:19.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:19 smithi050 bash[21866]: cluster 2024-05-20T22:18:18.327401+0000 mgr.y (mgr.14592) 470 : cluster 0 pgmap v694: 388 pgs: 388 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 907 B/s wr, 3 op/s 2024-05-20T22:18:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:19 smithi050 bash[28929]: audit 2024-05-20T22:18:18.054731+0000 mgr.y (mgr.14592) 469 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:18:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:19 smithi050 bash[28929]: cluster 2024-05-20T22:18:18.327401+0000 mgr.y (mgr.14592) 470 : cluster 0 pgmap v694: 388 pgs: 388 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 907 B/s wr, 3 op/s 2024-05-20T22:18:19.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:19 smithi145 bash[23893]: audit 2024-05-20T22:18:18.054731+0000 mgr.y (mgr.14592) 469 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:18:19.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:19 smithi145 bash[23893]: cluster 2024-05-20T22:18:18.327401+0000 mgr.y (mgr.14592) 470 : cluster 0 pgmap v694: 388 pgs: 388 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 907 B/s wr, 3 op/s 2024-05-20T22:18:20.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:20 smithi145 bash[23893]: cluster 2024-05-20T22:18:19.861083+0000 mon.a (mon.0) 2718 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:18:20.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:20 smithi050 bash[21866]: cluster 2024-05-20T22:18:19.861083+0000 mon.a (mon.0) 2718 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:18:20.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:20 smithi050 bash[28929]: cluster 2024-05-20T22:18:19.861083+0000 mon.a (mon.0) 2718 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:18:21.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:21 smithi145 bash[23893]: cluster 2024-05-20T22:18:20.330759+0000 mgr.y (mgr.14592) 471 : cluster 0 pgmap v695: 388 pgs: 388 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 806 B/s wr, 3 op/s 2024-05-20T22:18:21.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:21 smithi050 bash[21866]: cluster 2024-05-20T22:18:20.330759+0000 mgr.y (mgr.14592) 471 : cluster 0 pgmap v695: 388 pgs: 388 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 806 B/s wr, 3 op/s 2024-05-20T22:18:21.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:21 smithi050 bash[28929]: cluster 2024-05-20T22:18:20.330759+0000 mgr.y (mgr.14592) 471 : cluster 0 pgmap v695: 388 pgs: 388 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 806 B/s wr, 3 op/s 2024-05-20T22:18:22.390 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:18:21 smithi145 bash[51536]: logger=cleanup t=2024-05-20T22:18:21.992696769Z level=info msg="Completed cleanup jobs" duration=3.99841ms 2024-05-20T22:18:22.390 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:18:22 smithi145 bash[51536]: logger=sqlstore.transactions t=2024-05-20T22:18:22.000381989Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-05-20T22:18:23.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:23 smithi145 bash[23893]: cluster 2024-05-20T22:18:22.331744+0000 mgr.y (mgr.14592) 472 : cluster 0 pgmap v696: 388 pgs: 388 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 716 B/s wr, 3 op/s 2024-05-20T22:18:23.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:23 smithi145 bash[23893]: audit 2024-05-20T22:18:22.568491+0000 mon.a (mon.0) 2719 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:18:23.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:23 smithi145 bash[23893]: audit 2024-05-20T22:18:22.569376+0000 mon.a (mon.0) 2720 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-73"}]: dispatch 2024-05-20T22:18:23.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:23 smithi145 bash[23893]: audit 2024-05-20T22:18:22.587418+0000 mon.a (mon.0) 2721 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:18:23.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:23 smithi050 bash[21866]: cluster 2024-05-20T22:18:22.331744+0000 mgr.y (mgr.14592) 472 : cluster 0 pgmap v696: 388 pgs: 388 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 716 B/s wr, 3 op/s 2024-05-20T22:18:23.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:23 smithi050 bash[21866]: audit 2024-05-20T22:18:22.568491+0000 mon.a (mon.0) 2719 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:18:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:23 smithi050 bash[21866]: audit 2024-05-20T22:18:22.569376+0000 mon.a (mon.0) 2720 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-73"}]: dispatch 2024-05-20T22:18:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:23 smithi050 bash[21866]: audit 2024-05-20T22:18:22.587418+0000 mon.a (mon.0) 2721 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:18:23.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:23 smithi050 bash[28929]: cluster 2024-05-20T22:18:22.331744+0000 mgr.y (mgr.14592) 472 : cluster 0 pgmap v696: 388 pgs: 388 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 716 B/s wr, 3 op/s 2024-05-20T22:18:23.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:23 smithi050 bash[28929]: audit 2024-05-20T22:18:22.568491+0000 mon.a (mon.0) 2719 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:18:23.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:23 smithi050 bash[28929]: audit 2024-05-20T22:18:22.569376+0000 mon.a (mon.0) 2720 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-73"}]: dispatch 2024-05-20T22:18:23.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:23 smithi050 bash[28929]: audit 2024-05-20T22:18:22.587418+0000 mon.a (mon.0) 2721 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:18:24.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:24 smithi145 bash[23893]: cluster 2024-05-20T22:18:23.484823+0000 mon.a (mon.0) 2722 : cluster 0 osdmap e432: 8 total, 8 up, 8 in 2024-05-20T22:18:24.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:24 smithi050 bash[21866]: cluster 2024-05-20T22:18:23.484823+0000 mon.a (mon.0) 2722 : cluster 0 osdmap e432: 8 total, 8 up, 8 in 2024-05-20T22:18:24.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:24 smithi050 bash[28929]: cluster 2024-05-20T22:18:23.484823+0000 mon.a (mon.0) 2722 : cluster 0 osdmap e432: 8 total, 8 up, 8 in 2024-05-20T22:18:25.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:25 smithi145 bash[23893]: cluster 2024-05-20T22:18:24.332808+0000 mgr.y (mgr.14592) 473 : cluster 0 pgmap v698: 356 pgs: 356 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 306 B/s wr, 1 op/s 2024-05-20T22:18:25.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:25 smithi145 bash[23893]: cluster 2024-05-20T22:18:24.497376+0000 mon.a (mon.0) 2723 : cluster 0 osdmap e433: 8 total, 8 up, 8 in 2024-05-20T22:18:25.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:25 smithi145 bash[23893]: audit 2024-05-20T22:18:24.501388+0000 mon.a (mon.0) 2724 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:18:25.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:25 smithi050 bash[21866]: cluster 2024-05-20T22:18:24.332808+0000 mgr.y (mgr.14592) 473 : cluster 0 pgmap v698: 356 pgs: 356 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 306 B/s wr, 1 op/s 2024-05-20T22:18:25.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:25 smithi050 bash[21866]: cluster 2024-05-20T22:18:24.497376+0000 mon.a (mon.0) 2723 : cluster 0 osdmap e433: 8 total, 8 up, 8 in 2024-05-20T22:18:25.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:25 smithi050 bash[21866]: audit 2024-05-20T22:18:24.501388+0000 mon.a (mon.0) 2724 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:18:25.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:25 smithi050 bash[28929]: cluster 2024-05-20T22:18:24.332808+0000 mgr.y (mgr.14592) 473 : cluster 0 pgmap v698: 356 pgs: 356 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 306 B/s wr, 1 op/s 2024-05-20T22:18:25.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:25 smithi050 bash[28929]: cluster 2024-05-20T22:18:24.497376+0000 mon.a (mon.0) 2723 : cluster 0 osdmap e433: 8 total, 8 up, 8 in 2024-05-20T22:18:25.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:25 smithi050 bash[28929]: audit 2024-05-20T22:18:24.501388+0000 mon.a (mon.0) 2724 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:18:26.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:26 smithi145 bash[23893]: audit 2024-05-20T22:18:25.498836+0000 mon.a (mon.0) 2725 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:18:26.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:26 smithi145 bash[23893]: cluster 2024-05-20T22:18:25.506588+0000 mon.a (mon.0) 2726 : cluster 0 osdmap e434: 8 total, 8 up, 8 in 2024-05-20T22:18:26.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:26 smithi145 bash[23893]: audit 2024-05-20T22:18:25.512818+0000 mon.a (mon.0) 2727 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:18:26.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:26 smithi050 bash[21866]: audit 2024-05-20T22:18:25.498836+0000 mon.a (mon.0) 2725 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:18:26.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:26 smithi050 bash[21866]: cluster 2024-05-20T22:18:25.506588+0000 mon.a (mon.0) 2726 : cluster 0 osdmap e434: 8 total, 8 up, 8 in 2024-05-20T22:18:26.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:26 smithi050 bash[21866]: audit 2024-05-20T22:18:25.512818+0000 mon.a (mon.0) 2727 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:18:26.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:26 smithi050 bash[28929]: audit 2024-05-20T22:18:25.498836+0000 mon.a (mon.0) 2725 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:18:26.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:26 smithi050 bash[28929]: cluster 2024-05-20T22:18:25.506588+0000 mon.a (mon.0) 2726 : cluster 0 osdmap e434: 8 total, 8 up, 8 in 2024-05-20T22:18:26.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:26 smithi050 bash[28929]: audit 2024-05-20T22:18:25.512818+0000 mon.a (mon.0) 2727 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:18:27.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:27 smithi145 bash[23893]: cluster 2024-05-20T22:18:26.333824+0000 mgr.y (mgr.14592) 474 : cluster 0 pgmap v701: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:18:27.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:27 smithi145 bash[23893]: cluster 2024-05-20T22:18:26.516429+0000 mon.a (mon.0) 2728 : cluster 0 osdmap e435: 8 total, 8 up, 8 in 2024-05-20T22:18:27.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:27 smithi050 bash[21866]: cluster 2024-05-20T22:18:26.333824+0000 mgr.y (mgr.14592) 474 : cluster 0 pgmap v701: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:18:27.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:27 smithi050 bash[21866]: cluster 2024-05-20T22:18:26.516429+0000 mon.a (mon.0) 2728 : cluster 0 osdmap e435: 8 total, 8 up, 8 in 2024-05-20T22:18:27.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:27 smithi050 bash[28929]: cluster 2024-05-20T22:18:26.333824+0000 mgr.y (mgr.14592) 474 : cluster 0 pgmap v701: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:18:27.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:27 smithi050 bash[28929]: cluster 2024-05-20T22:18:26.516429+0000 mon.a (mon.0) 2728 : cluster 0 osdmap e435: 8 total, 8 up, 8 in 2024-05-20T22:18:28.390 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:18:28 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:18:28.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:28 smithi145 bash[23893]: cluster 2024-05-20T22:18:27.524136+0000 mon.a (mon.0) 2729 : cluster 0 osdmap e436: 8 total, 8 up, 8 in 2024-05-20T22:18:28.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:28 smithi145 bash[23893]: audit 2024-05-20T22:18:27.656000+0000 mon.a (mon.0) 2730 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:18:28.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:28 smithi145 bash[23893]: audit 2024-05-20T22:18:27.656910+0000 mon.a (mon.0) 2731 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-75"}]: dispatch 2024-05-20T22:18:28.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:28 smithi050 bash[21866]: cluster 2024-05-20T22:18:27.524136+0000 mon.a (mon.0) 2729 : cluster 0 osdmap e436: 8 total, 8 up, 8 in 2024-05-20T22:18:28.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:28 smithi050 bash[21866]: audit 2024-05-20T22:18:27.656000+0000 mon.a (mon.0) 2730 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:18:28.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:28 smithi050 bash[21866]: audit 2024-05-20T22:18:27.656910+0000 mon.a (mon.0) 2731 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-75"}]: dispatch 2024-05-20T22:18:28.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:28 smithi050 bash[28929]: cluster 2024-05-20T22:18:27.524136+0000 mon.a (mon.0) 2729 : cluster 0 osdmap e436: 8 total, 8 up, 8 in 2024-05-20T22:18:28.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:28 smithi050 bash[28929]: audit 2024-05-20T22:18:27.656000+0000 mon.a (mon.0) 2730 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:18:28.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:28 smithi050 bash[28929]: audit 2024-05-20T22:18:27.656910+0000 mon.a (mon.0) 2731 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-75"}]: dispatch 2024-05-20T22:18:29.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:18:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:18:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:18:29.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:29 smithi050 bash[28929]: audit 2024-05-20T22:18:28.065994+0000 mgr.y (mgr.14592) 475 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:18:29.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:29 smithi050 bash[28929]: cluster 2024-05-20T22:18:28.334821+0000 mgr.y (mgr.14592) 476 : cluster 0 pgmap v704: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:18:29.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:29 smithi050 bash[28929]: cluster 2024-05-20T22:18:28.533666+0000 mon.a (mon.0) 2732 : cluster 0 osdmap e437: 8 total, 8 up, 8 in 2024-05-20T22:18:29.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:29 smithi050 bash[21866]: audit 2024-05-20T22:18:28.065994+0000 mgr.y (mgr.14592) 475 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:18:29.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:29 smithi050 bash[21866]: cluster 2024-05-20T22:18:28.334821+0000 mgr.y (mgr.14592) 476 : cluster 0 pgmap v704: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:18:29.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:29 smithi050 bash[21866]: cluster 2024-05-20T22:18:28.533666+0000 mon.a (mon.0) 2732 : cluster 0 osdmap e437: 8 total, 8 up, 8 in 2024-05-20T22:18:29.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:29 smithi145 bash[23893]: audit 2024-05-20T22:18:28.065994+0000 mgr.y (mgr.14592) 475 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:18:29.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:29 smithi145 bash[23893]: cluster 2024-05-20T22:18:28.334821+0000 mgr.y (mgr.14592) 476 : cluster 0 pgmap v704: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:18:29.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:29 smithi145 bash[23893]: cluster 2024-05-20T22:18:28.533666+0000 mon.a (mon.0) 2732 : cluster 0 osdmap e437: 8 total, 8 up, 8 in 2024-05-20T22:18:30.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:30 smithi145 bash[23893]: cluster 2024-05-20T22:18:29.539721+0000 mon.a (mon.0) 2733 : cluster 0 osdmap e438: 8 total, 8 up, 8 in 2024-05-20T22:18:30.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:30 smithi145 bash[23893]: audit 2024-05-20T22:18:29.543983+0000 mon.a (mon.0) 2734 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:18:30.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:30 smithi145 bash[23893]: audit 2024-05-20T22:18:30.533453+0000 mon.a (mon.0) 2735 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:18:30.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:30 smithi145 bash[23893]: cluster 2024-05-20T22:18:30.542017+0000 mon.a (mon.0) 2736 : cluster 0 osdmap e439: 8 total, 8 up, 8 in 2024-05-20T22:18:30.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:30 smithi050 bash[21866]: cluster 2024-05-20T22:18:29.539721+0000 mon.a (mon.0) 2733 : cluster 0 osdmap e438: 8 total, 8 up, 8 in 2024-05-20T22:18:30.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:30 smithi050 bash[21866]: audit 2024-05-20T22:18:29.543983+0000 mon.a (mon.0) 2734 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:18:30.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:30 smithi050 bash[21866]: audit 2024-05-20T22:18:30.533453+0000 mon.a (mon.0) 2735 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:18:30.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:30 smithi050 bash[21866]: cluster 2024-05-20T22:18:30.542017+0000 mon.a (mon.0) 2736 : cluster 0 osdmap e439: 8 total, 8 up, 8 in 2024-05-20T22:18:30.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:30 smithi050 bash[28929]: cluster 2024-05-20T22:18:29.539721+0000 mon.a (mon.0) 2733 : cluster 0 osdmap e438: 8 total, 8 up, 8 in 2024-05-20T22:18:30.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:30 smithi050 bash[28929]: audit 2024-05-20T22:18:29.543983+0000 mon.a (mon.0) 2734 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:18:30.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:30 smithi050 bash[28929]: audit 2024-05-20T22:18:30.533453+0000 mon.a (mon.0) 2735 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:18:30.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:30 smithi050 bash[28929]: cluster 2024-05-20T22:18:30.542017+0000 mon.a (mon.0) 2736 : cluster 0 osdmap e439: 8 total, 8 up, 8 in 2024-05-20T22:18:31.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:31 smithi145 bash[23893]: cluster 2024-05-20T22:18:30.338104+0000 mgr.y (mgr.14592) 477 : cluster 0 pgmap v707: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:18:31.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:31 smithi145 bash[23893]: cluster 2024-05-20T22:18:30.547804+0000 mon.a (mon.0) 2737 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:18:31.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:31 smithi145 bash[23893]: audit 2024-05-20T22:18:30.548201+0000 mon.a (mon.0) 2738 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:18:31.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:31 smithi050 bash[21866]: cluster 2024-05-20T22:18:30.338104+0000 mgr.y (mgr.14592) 477 : cluster 0 pgmap v707: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:18:31.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:31 smithi050 bash[21866]: cluster 2024-05-20T22:18:30.547804+0000 mon.a (mon.0) 2737 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:18:31.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:31 smithi050 bash[21866]: audit 2024-05-20T22:18:30.548201+0000 mon.a (mon.0) 2738 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:18:31.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:31 smithi050 bash[28929]: cluster 2024-05-20T22:18:30.338104+0000 mgr.y (mgr.14592) 477 : cluster 0 pgmap v707: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:18:31.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:31 smithi050 bash[28929]: cluster 2024-05-20T22:18:30.547804+0000 mon.a (mon.0) 2737 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:18:31.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:31 smithi050 bash[28929]: audit 2024-05-20T22:18:30.548201+0000 mon.a (mon.0) 2738 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:18:32.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:32 smithi145 bash[23893]: cluster 2024-05-20T22:18:31.580495+0000 mon.a (mon.0) 2739 : cluster 0 osdmap e440: 8 total, 8 up, 8 in 2024-05-20T22:18:32.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:32 smithi145 bash[23893]: audit 2024-05-20T22:18:31.691296+0000 mon.a (mon.0) 2740 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:18:32.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:32 smithi145 bash[23893]: audit 2024-05-20T22:18:31.692298+0000 mon.a (mon.0) 2741 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-77"}]: dispatch 2024-05-20T22:18:32.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:32 smithi050 bash[21866]: cluster 2024-05-20T22:18:31.580495+0000 mon.a (mon.0) 2739 : cluster 0 osdmap e440: 8 total, 8 up, 8 in 2024-05-20T22:18:32.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:32 smithi050 bash[21866]: audit 2024-05-20T22:18:31.691296+0000 mon.a (mon.0) 2740 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:18:32.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:32 smithi050 bash[21866]: audit 2024-05-20T22:18:31.692298+0000 mon.a (mon.0) 2741 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-77"}]: dispatch 2024-05-20T22:18:32.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:32 smithi050 bash[28929]: cluster 2024-05-20T22:18:31.580495+0000 mon.a (mon.0) 2739 : cluster 0 osdmap e440: 8 total, 8 up, 8 in 2024-05-20T22:18:32.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:32 smithi050 bash[28929]: audit 2024-05-20T22:18:31.691296+0000 mon.a (mon.0) 2740 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:18:32.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:32 smithi050 bash[28929]: audit 2024-05-20T22:18:31.692298+0000 mon.a (mon.0) 2741 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-77"}]: dispatch 2024-05-20T22:18:33.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:33 smithi145 bash[23893]: cluster 2024-05-20T22:18:32.339075+0000 mgr.y (mgr.14592) 478 : cluster 0 pgmap v710: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:18:33.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:33 smithi145 bash[23893]: cluster 2024-05-20T22:18:32.596226+0000 mon.a (mon.0) 2742 : cluster 0 osdmap e441: 8 total, 8 up, 8 in 2024-05-20T22:18:33.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:33 smithi050 bash[21866]: cluster 2024-05-20T22:18:32.339075+0000 mgr.y (mgr.14592) 478 : cluster 0 pgmap v710: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:18:33.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:33 smithi050 bash[21866]: cluster 2024-05-20T22:18:32.596226+0000 mon.a (mon.0) 2742 : cluster 0 osdmap e441: 8 total, 8 up, 8 in 2024-05-20T22:18:33.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:33 smithi050 bash[28929]: cluster 2024-05-20T22:18:32.339075+0000 mgr.y (mgr.14592) 478 : cluster 0 pgmap v710: 388 pgs: 32 creating+peering, 356 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:18:33.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:33 smithi050 bash[28929]: cluster 2024-05-20T22:18:32.596226+0000 mon.a (mon.0) 2742 : cluster 0 osdmap e441: 8 total, 8 up, 8 in 2024-05-20T22:18:34.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:34 smithi145 bash[23893]: cluster 2024-05-20T22:18:33.605209+0000 mon.a (mon.0) 2743 : cluster 0 osdmap e442: 8 total, 8 up, 8 in 2024-05-20T22:18:34.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:34 smithi145 bash[23893]: audit 2024-05-20T22:18:33.614981+0000 mon.a (mon.0) 2744 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:18:34.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:34 smithi050 bash[21866]: cluster 2024-05-20T22:18:33.605209+0000 mon.a (mon.0) 2743 : cluster 0 osdmap e442: 8 total, 8 up, 8 in 2024-05-20T22:18:34.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:34 smithi050 bash[21866]: audit 2024-05-20T22:18:33.614981+0000 mon.a (mon.0) 2744 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:18:34.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:34 smithi050 bash[28929]: cluster 2024-05-20T22:18:33.605209+0000 mon.a (mon.0) 2743 : cluster 0 osdmap e442: 8 total, 8 up, 8 in 2024-05-20T22:18:34.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:34 smithi050 bash[28929]: audit 2024-05-20T22:18:33.614981+0000 mon.a (mon.0) 2744 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:18:35.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:35 smithi145 bash[23893]: cluster 2024-05-20T22:18:34.340185+0000 mgr.y (mgr.14592) 479 : cluster 0 pgmap v713: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:18:35.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:35 smithi145 bash[23893]: audit 2024-05-20T22:18:34.607719+0000 mon.a (mon.0) 2745 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:18:35.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:35 smithi145 bash[23893]: cluster 2024-05-20T22:18:34.616938+0000 mon.a (mon.0) 2746 : cluster 0 osdmap e443: 8 total, 8 up, 8 in 2024-05-20T22:18:35.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:35 smithi145 bash[23893]: audit 2024-05-20T22:18:34.621342+0000 mon.a (mon.0) 2747 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:18:35.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:35 smithi050 bash[21866]: cluster 2024-05-20T22:18:34.340185+0000 mgr.y (mgr.14592) 479 : cluster 0 pgmap v713: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:18:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:35 smithi050 bash[21866]: audit 2024-05-20T22:18:34.607719+0000 mon.a (mon.0) 2745 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:18:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:35 smithi050 bash[21866]: cluster 2024-05-20T22:18:34.616938+0000 mon.a (mon.0) 2746 : cluster 0 osdmap e443: 8 total, 8 up, 8 in 2024-05-20T22:18:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:35 smithi050 bash[21866]: audit 2024-05-20T22:18:34.621342+0000 mon.a (mon.0) 2747 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:18:35.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:35 smithi050 bash[28929]: cluster 2024-05-20T22:18:34.340185+0000 mgr.y (mgr.14592) 479 : cluster 0 pgmap v713: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:18:35.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:35 smithi050 bash[28929]: audit 2024-05-20T22:18:34.607719+0000 mon.a (mon.0) 2745 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:18:35.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:35 smithi050 bash[28929]: cluster 2024-05-20T22:18:34.616938+0000 mon.a (mon.0) 2746 : cluster 0 osdmap e443: 8 total, 8 up, 8 in 2024-05-20T22:18:35.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:35 smithi050 bash[28929]: audit 2024-05-20T22:18:34.621342+0000 mon.a (mon.0) 2747 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:18:36.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:36 smithi145 bash[23893]: cluster 2024-05-20T22:18:35.625032+0000 mon.a (mon.0) 2748 : cluster 0 osdmap e444: 8 total, 8 up, 8 in 2024-05-20T22:18:36.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:36 smithi050 bash[21866]: cluster 2024-05-20T22:18:35.625032+0000 mon.a (mon.0) 2748 : cluster 0 osdmap e444: 8 total, 8 up, 8 in 2024-05-20T22:18:36.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:36 smithi050 bash[28929]: cluster 2024-05-20T22:18:35.625032+0000 mon.a (mon.0) 2748 : cluster 0 osdmap e444: 8 total, 8 up, 8 in 2024-05-20T22:18:37.896 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:37 smithi145 bash[23893]: cluster 2024-05-20T22:18:36.341167+0000 mgr.y (mgr.14592) 480 : cluster 0 pgmap v716: 388 pgs: 388 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-05-20T22:18:37.896 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:37 smithi145 bash[23893]: cluster 2024-05-20T22:18:36.618945+0000 mon.a (mon.0) 2749 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:18:37.896 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:37 smithi145 bash[23893]: cluster 2024-05-20T22:18:36.637558+0000 mon.a (mon.0) 2750 : cluster 0 osdmap e445: 8 total, 8 up, 8 in 2024-05-20T22:18:37.897 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:37 smithi145 bash[23893]: audit 2024-05-20T22:18:36.679526+0000 mon.a (mon.0) 2751 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "287.b"}]: dispatch 2024-05-20T22:18:37.897 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:37 smithi145 bash[23893]: audit 2024-05-20T22:18:36.679837+0000 mgr.y (mgr.14592) 481 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "287.b"}]: dispatch 2024-05-20T22:18:37.897 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:37 smithi145 bash[23893]: cluster 2024-05-20T22:18:36.929620+0000 osd.0 (osd.0) 21 : cluster 0 287.b deep-scrub starts 2024-05-20T22:18:37.897 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:37 smithi145 bash[23893]: cluster 2024-05-20T22:18:36.934241+0000 osd.0 (osd.0) 22 : cluster 0 287.b deep-scrub ok 2024-05-20T22:18:37.897 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:37 smithi145 bash[23893]: audit 2024-05-20T22:18:37.624434+0000 mon.a (mon.0) 2752 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:18:37.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:37 smithi050 bash[21866]: cluster 2024-05-20T22:18:36.341167+0000 mgr.y (mgr.14592) 480 : cluster 0 pgmap v716: 388 pgs: 388 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-05-20T22:18:37.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:37 smithi050 bash[21866]: cluster 2024-05-20T22:18:36.618945+0000 mon.a (mon.0) 2749 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:18:37.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:37 smithi050 bash[21866]: cluster 2024-05-20T22:18:36.637558+0000 mon.a (mon.0) 2750 : cluster 0 osdmap e445: 8 total, 8 up, 8 in 2024-05-20T22:18:37.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:37 smithi050 bash[21866]: audit 2024-05-20T22:18:36.679526+0000 mon.a (mon.0) 2751 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "287.b"}]: dispatch 2024-05-20T22:18:37.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:37 smithi050 bash[21866]: audit 2024-05-20T22:18:36.679837+0000 mgr.y (mgr.14592) 481 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "287.b"}]: dispatch 2024-05-20T22:18:37.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:37 smithi050 bash[21866]: cluster 2024-05-20T22:18:36.929620+0000 osd.0 (osd.0) 21 : cluster 0 287.b deep-scrub starts 2024-05-20T22:18:37.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:37 smithi050 bash[21866]: cluster 2024-05-20T22:18:36.934241+0000 osd.0 (osd.0) 22 : cluster 0 287.b deep-scrub ok 2024-05-20T22:18:37.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:37 smithi050 bash[21866]: audit 2024-05-20T22:18:37.624434+0000 mon.a (mon.0) 2752 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:18:37.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:37 smithi050 bash[28929]: cluster 2024-05-20T22:18:36.341167+0000 mgr.y (mgr.14592) 480 : cluster 0 pgmap v716: 388 pgs: 388 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-05-20T22:18:37.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:37 smithi050 bash[28929]: cluster 2024-05-20T22:18:36.618945+0000 mon.a (mon.0) 2749 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:18:37.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:37 smithi050 bash[28929]: cluster 2024-05-20T22:18:36.637558+0000 mon.a (mon.0) 2750 : cluster 0 osdmap e445: 8 total, 8 up, 8 in 2024-05-20T22:18:37.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:37 smithi050 bash[28929]: audit 2024-05-20T22:18:36.679526+0000 mon.a (mon.0) 2751 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "287.b"}]: dispatch 2024-05-20T22:18:37.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:37 smithi050 bash[28929]: audit 2024-05-20T22:18:36.679837+0000 mgr.y (mgr.14592) 481 : audit 0 from='mon.0 v1:172.21.15.50:0/4086177449' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "287.b"}]: dispatch 2024-05-20T22:18:37.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:37 smithi050 bash[28929]: cluster 2024-05-20T22:18:36.929620+0000 osd.0 (osd.0) 21 : cluster 0 287.b deep-scrub starts 2024-05-20T22:18:37.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:37 smithi050 bash[28929]: cluster 2024-05-20T22:18:36.934241+0000 osd.0 (osd.0) 22 : cluster 0 287.b deep-scrub ok 2024-05-20T22:18:37.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:37 smithi050 bash[28929]: audit 2024-05-20T22:18:37.624434+0000 mon.a (mon.0) 2752 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:18:38.390 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:18:38 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:18:39.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:18:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:18:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:18:39.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:39 smithi050 bash[21866]: audit 2024-05-20T22:18:38.077153+0000 mgr.y (mgr.14592) 482 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:18:39.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:39 smithi050 bash[21866]: cluster 2024-05-20T22:18:38.342199+0000 mgr.y (mgr.14592) 483 : cluster 0 pgmap v718: 388 pgs: 388 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-05-20T22:18:39.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:39 smithi050 bash[28929]: audit 2024-05-20T22:18:38.077153+0000 mgr.y (mgr.14592) 482 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:18:39.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:39 smithi050 bash[28929]: cluster 2024-05-20T22:18:38.342199+0000 mgr.y (mgr.14592) 483 : cluster 0 pgmap v718: 388 pgs: 388 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-05-20T22:18:39.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:39 smithi145 bash[23893]: audit 2024-05-20T22:18:38.077153+0000 mgr.y (mgr.14592) 482 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:18:39.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:39 smithi145 bash[23893]: cluster 2024-05-20T22:18:38.342199+0000 mgr.y (mgr.14592) 483 : cluster 0 pgmap v718: 388 pgs: 388 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-05-20T22:18:41.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:41 smithi145 bash[23893]: cluster 2024-05-20T22:18:40.345524+0000 mgr.y (mgr.14592) 484 : cluster 0 pgmap v719: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-05-20T22:18:41.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:41 smithi050 bash[21866]: cluster 2024-05-20T22:18:40.345524+0000 mgr.y (mgr.14592) 484 : cluster 0 pgmap v719: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-05-20T22:18:41.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:41 smithi050 bash[28929]: cluster 2024-05-20T22:18:40.345524+0000 mgr.y (mgr.14592) 484 : cluster 0 pgmap v719: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-05-20T22:18:43.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:43 smithi145 bash[23893]: cluster 2024-05-20T22:18:42.346466+0000 mgr.y (mgr.14592) 485 : cluster 0 pgmap v720: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 926 B/s wr, 3 op/s 2024-05-20T22:18:43.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:43 smithi050 bash[21866]: cluster 2024-05-20T22:18:42.346466+0000 mgr.y (mgr.14592) 485 : cluster 0 pgmap v720: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 926 B/s wr, 3 op/s 2024-05-20T22:18:43.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:43 smithi050 bash[28929]: cluster 2024-05-20T22:18:42.346466+0000 mgr.y (mgr.14592) 485 : cluster 0 pgmap v720: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 926 B/s wr, 3 op/s 2024-05-20T22:18:45.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:45 smithi050 bash[21866]: cluster 2024-05-20T22:18:44.347419+0000 mgr.y (mgr.14592) 486 : cluster 0 pgmap v721: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 586 B/s rd, 234 B/s wr, 1 op/s 2024-05-20T22:18:45.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:45 smithi050 bash[28929]: cluster 2024-05-20T22:18:44.347419+0000 mgr.y (mgr.14592) 486 : cluster 0 pgmap v721: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 586 B/s rd, 234 B/s wr, 1 op/s 2024-05-20T22:18:46.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:45 smithi145 bash[23893]: cluster 2024-05-20T22:18:44.347419+0000 mgr.y (mgr.14592) 486 : cluster 0 pgmap v721: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 586 B/s rd, 234 B/s wr, 1 op/s 2024-05-20T22:18:47.139 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408874990 2024-05-20T22:18:47.139 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408874ac0 2024-05-20T22:18:47.139 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408874120 2024-05-20T22:18:47.139 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408874250 2024-05-20T22:18:47.139 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088743a0 2024-05-20T22:18:47.139 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088739a0 2024-05-20T22:18:47.139 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408873ad0 2024-05-20T22:18:47.140 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408873c20 2024-05-20T22:18:47.140 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088750a0 2024-05-20T22:18:47.140 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408874bf0 2024-05-20T22:18:47.140 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408874d40 2024-05-20T22:18:47.140 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408874e70 2024-05-20T22:18:47.140 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408874f80 2024-05-20T22:18:47.140 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408875680 2024-05-20T22:18:47.140 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088751d0 2024-05-20T22:18:47.140 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408875320 2024-05-20T22:18:47.140 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408875430 2024-05-20T22:18:47.140 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088757b0 2024-05-20T22:18:47.141 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408875c80 2024-05-20T22:18:47.141 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408875db0 2024-05-20T22:18:47.141 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408876370 2024-05-20T22:18:47.141 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088758e0 2024-05-20T22:18:47.141 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408875560 2024-05-20T22:18:47.141 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408875a10 2024-05-20T22:18:47.141 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408875b40 2024-05-20T22:18:47.141 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408875ec0 2024-05-20T22:18:47.141 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408876010 2024-05-20T22:18:47.141 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408876180 2024-05-20T22:18:47.141 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088764a0 2024-05-20T22:18:47.141 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088769c0 2024-05-20T22:18:47.142 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408876b40 2024-05-20T22:18:47.142 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088745f0 2024-05-20T22:18:47.142 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408874720 2024-05-20T22:18:47.142 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408874850 2024-05-20T22:18:47.142 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408876c70 2024-05-20T22:18:47.142 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408877140 2024-05-20T22:18:47.142 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408877290 2024-05-20T22:18:47.142 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088765d0 2024-05-20T22:18:47.142 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408876700 2024-05-20T22:18:47.142 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408876830 2024-05-20T22:18:47.142 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088773c0 2024-05-20T22:18:47.142 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408877890 2024-05-20T22:18:47.143 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088779e0 2024-05-20T22:18:47.143 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408876da0 2024-05-20T22:18:47.143 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408876ed0 2024-05-20T22:18:47.143 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408877000 2024-05-20T22:18:47.143 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408877b10 2024-05-20T22:18:47.143 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408877fe0 2024-05-20T22:18:47.143 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408878130 2024-05-20T22:18:47.143 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408878710 2024-05-20T22:18:47.143 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408877c40 2024-05-20T22:18:47.143 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408877d70 2024-05-20T22:18:47.143 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408877ea0 2024-05-20T22:18:47.143 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408878840 2024-05-20T22:18:47.143 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408878260 2024-05-20T22:18:47.143 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088783b0 2024-05-20T22:18:47.144 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088784e0 2024-05-20T22:18:47.144 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408878970 2024-05-20T22:18:47.144 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408878e40 2024-05-20T22:18:47.144 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408878f70 2024-05-20T22:18:47.144 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088774f0 2024-05-20T22:18:47.144 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408877620 2024-05-20T22:18:47.144 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408877750 2024-05-20T22:18:47.144 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088790a0 2024-05-20T22:18:47.144 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408879570 2024-05-20T22:18:47.144 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088796a0 2024-05-20T22:18:47.144 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408878aa0 2024-05-20T22:18:47.144 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408878bd0 2024-05-20T22:18:47.144 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408878d00 2024-05-20T22:18:47.144 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088797f0 2024-05-20T22:18:47.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408879cc0 2024-05-20T22:18:47.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408879e10 2024-05-20T22:18:47.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x5574088791d0 2024-05-20T22:18:47.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408879320 2024-05-20T22:18:47.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408879450 2024-05-20T22:18:47.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408879f20 2024-05-20T22:18:47.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887a430 2024-05-20T22:18:47.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887a580 2024-05-20T22:18:47.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408879920 2024-05-20T22:18:47.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408879a50 2024-05-20T22:18:47.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x557408879b80 2024-05-20T22:18:47.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887a6b0 2024-05-20T22:18:47.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:47 smithi050 bash[21866]: cluster 2024-05-20T22:18:46.350791+0000 mgr.y (mgr.14592) 487 : cluster 0 pgmap v722: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 204 B/s wr, 1 op/s 2024-05-20T22:18:47.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:47 smithi050 bash[28929]: cluster 2024-05-20T22:18:46.350791+0000 mgr.y (mgr.14592) 487 : cluster 0 pgmap v722: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 204 B/s wr, 1 op/s 2024-05-20T22:18:48.081 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:47 smithi145 bash[23893]: cluster 2024-05-20T22:18:46.350791+0000 mgr.y (mgr.14592) 487 : cluster 0 pgmap v722: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 204 B/s wr, 1 op/s 2024-05-20T22:18:48.390 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:18:48 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:18:48.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:48 smithi050 bash[21866]: audit 2024-05-20T22:18:47.959833+0000 mon.a (mon.0) 2753 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:18:48.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:48 smithi050 bash[21866]: audit 2024-05-20T22:18:48.500169+0000 mon.a (mon.0) 2754 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:48.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:48 smithi050 bash[21866]: audit 2024-05-20T22:18:48.505894+0000 mon.a (mon.0) 2755 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:48.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:48 smithi050 bash[28929]: audit 2024-05-20T22:18:47.959833+0000 mon.a (mon.0) 2753 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:18:48.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:48 smithi050 bash[28929]: audit 2024-05-20T22:18:48.500169+0000 mon.a (mon.0) 2754 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:48.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:48 smithi050 bash[28929]: audit 2024-05-20T22:18:48.505894+0000 mon.a (mon.0) 2755 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:49.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:48 smithi145 bash[23893]: audit 2024-05-20T22:18:47.959833+0000 mon.a (mon.0) 2753 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:18:49.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:48 smithi145 bash[23893]: audit 2024-05-20T22:18:48.500169+0000 mon.a (mon.0) 2754 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:49.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:48 smithi145 bash[23893]: audit 2024-05-20T22:18:48.505894+0000 mon.a (mon.0) 2755 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:49.658 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:18:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:18:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:18:49.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:49 smithi050 bash[21866]: audit 2024-05-20T22:18:48.086656+0000 mgr.y (mgr.14592) 488 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:18:49.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:49 smithi050 bash[21866]: cluster 2024-05-20T22:18:48.351494+0000 mgr.y (mgr.14592) 489 : cluster 0 pgmap v723: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 873 B/s rd, 174 B/s wr, 1 op/s 2024-05-20T22:18:49.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:49 smithi050 bash[28929]: audit 2024-05-20T22:18:48.086656+0000 mgr.y (mgr.14592) 488 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:18:49.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:49 smithi050 bash[28929]: cluster 2024-05-20T22:18:48.351494+0000 mgr.y (mgr.14592) 489 : cluster 0 pgmap v723: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 873 B/s rd, 174 B/s wr, 1 op/s 2024-05-20T22:18:50.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:49 smithi145 bash[23893]: audit 2024-05-20T22:18:48.086656+0000 mgr.y (mgr.14592) 488 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:18:50.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:49 smithi145 bash[23893]: cluster 2024-05-20T22:18:48.351494+0000 mgr.y (mgr.14592) 489 : cluster 0 pgmap v723: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 873 B/s rd, 174 B/s wr, 1 op/s 2024-05-20T22:18:51.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:51 smithi050 bash[21866]: cluster 2024-05-20T22:18:50.354747+0000 mgr.y (mgr.14592) 490 : cluster 0 pgmap v724: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 1 op/s 2024-05-20T22:18:51.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:51 smithi050 bash[28929]: cluster 2024-05-20T22:18:50.354747+0000 mgr.y (mgr.14592) 490 : cluster 0 pgmap v724: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 1 op/s 2024-05-20T22:18:52.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:51 smithi145 bash[23893]: cluster 2024-05-20T22:18:50.354747+0000 mgr.y (mgr.14592) 490 : cluster 0 pgmap v724: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 1 op/s 2024-05-20T22:18:52.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:52 smithi050 bash[21866]: audit 2024-05-20T22:18:52.661644+0000 mon.a (mon.0) 2756 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:18:52.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:52 smithi050 bash[28929]: audit 2024-05-20T22:18:52.661644+0000 mon.a (mon.0) 2756 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:18:53.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:52 smithi145 bash[23893]: audit 2024-05-20T22:18:52.661644+0000 mon.a (mon.0) 2756 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:18:53.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:53 smithi050 bash[28929]: cluster 2024-05-20T22:18:52.355842+0000 mgr.y (mgr.14592) 491 : cluster 0 pgmap v725: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:18:53.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:53 smithi050 bash[28929]: audit 2024-05-20T22:18:53.621904+0000 mon.a (mon.0) 2757 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:53.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:53 smithi050 bash[28929]: audit 2024-05-20T22:18:53.626226+0000 mon.a (mon.0) 2758 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:53.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:53 smithi050 bash[21866]: cluster 2024-05-20T22:18:52.355842+0000 mgr.y (mgr.14592) 491 : cluster 0 pgmap v725: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:18:53.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:53 smithi050 bash[21866]: audit 2024-05-20T22:18:53.621904+0000 mon.a (mon.0) 2757 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:53.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:53 smithi050 bash[21866]: audit 2024-05-20T22:18:53.626226+0000 mon.a (mon.0) 2758 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:54.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:53 smithi145 bash[23893]: cluster 2024-05-20T22:18:52.355842+0000 mgr.y (mgr.14592) 491 : cluster 0 pgmap v725: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:18:54.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:53 smithi145 bash[23893]: audit 2024-05-20T22:18:53.621904+0000 mon.a (mon.0) 2757 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:54.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:53 smithi145 bash[23893]: audit 2024-05-20T22:18:53.626226+0000 mon.a (mon.0) 2758 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:55.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:55 smithi145 bash[23893]: cluster 2024-05-20T22:18:54.356786+0000 mgr.y (mgr.14592) 492 : cluster 0 pgmap v726: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:18:55.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:55 smithi145 bash[23893]: audit 2024-05-20T22:18:54.458525+0000 mon.a (mon.0) 2759 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:55.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:55 smithi145 bash[23893]: audit 2024-05-20T22:18:54.470809+0000 mon.a (mon.0) 2760 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:55.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:55 smithi145 bash[23893]: audit 2024-05-20T22:18:55.074222+0000 mon.a (mon.0) 2761 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:18:55.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:55 smithi145 bash[23893]: audit 2024-05-20T22:18:55.075989+0000 mon.a (mon.0) 2762 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:18:55.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:55 smithi145 bash[23893]: audit 2024-05-20T22:18:55.085969+0000 mon.a (mon.0) 2763 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:55.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:55 smithi050 bash[21866]: cluster 2024-05-20T22:18:54.356786+0000 mgr.y (mgr.14592) 492 : cluster 0 pgmap v726: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:18:55.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:55 smithi050 bash[21866]: audit 2024-05-20T22:18:54.458525+0000 mon.a (mon.0) 2759 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:55.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:55 smithi050 bash[21866]: audit 2024-05-20T22:18:54.470809+0000 mon.a (mon.0) 2760 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:55.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:55 smithi050 bash[21866]: audit 2024-05-20T22:18:55.074222+0000 mon.a (mon.0) 2761 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:18:55.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:55 smithi050 bash[21866]: audit 2024-05-20T22:18:55.075989+0000 mon.a (mon.0) 2762 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:18:55.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:55 smithi050 bash[21866]: audit 2024-05-20T22:18:55.085969+0000 mon.a (mon.0) 2763 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:55.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:55 smithi050 bash[28929]: cluster 2024-05-20T22:18:54.356786+0000 mgr.y (mgr.14592) 492 : cluster 0 pgmap v726: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:18:55.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:55 smithi050 bash[28929]: audit 2024-05-20T22:18:54.458525+0000 mon.a (mon.0) 2759 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:55.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:55 smithi050 bash[28929]: audit 2024-05-20T22:18:54.470809+0000 mon.a (mon.0) 2760 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:55.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:55 smithi050 bash[28929]: audit 2024-05-20T22:18:55.074222+0000 mon.a (mon.0) 2761 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:18:55.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:55 smithi050 bash[28929]: audit 2024-05-20T22:18:55.075989+0000 mon.a (mon.0) 2762 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:18:55.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:55 smithi050 bash[28929]: audit 2024-05-20T22:18:55.085969+0000 mon.a (mon.0) 2763 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:18:57.141 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:18:56 smithi145 bash[27334]: debug 2024-05-20T22:18:56.708+0000 7f48f847c640 -1 snap_mapper.add_oid found existing snaps mapped on 287:d1e728d6:test-rados-api-smithi050-64110-80::foo:2, removing 2024-05-20T22:18:57.193 INFO:journalctl@ceph.osd.0.smithi050.stdout:May 20 22:18:56 smithi050 bash[31928]: debug 2024-05-20T22:18:56.714+0000 7fc5d6653640 -1 snap_mapper.add_oid found existing snaps mapped on 287:d1e728d6:test-rados-api-smithi050-64110-80::foo:2, removing 2024-05-20T22:18:57.194 INFO:journalctl@ceph.osd.1.smithi050.stdout:May 20 22:18:56 smithi050 bash[37268]: debug 2024-05-20T22:18:56.714+0000 7fe6c4aa9640 -1 snap_mapper.add_oid found existing snaps mapped on 287:d1e728d6:test-rados-api-smithi050-64110-80::foo:2, removing 2024-05-20T22:18:58.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:57 smithi050 bash[21866]: cluster 2024-05-20T22:18:56.360512+0000 mgr.y (mgr.14592) 493 : cluster 0 pgmap v727: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:18:58.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:57 smithi050 bash[21866]: audit 2024-05-20T22:18:56.719181+0000 mon.a (mon.0) 2764 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:18:58.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:57 smithi050 bash[21866]: audit 2024-05-20T22:18:56.720050+0000 mon.a (mon.0) 2765 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-79"}]: dispatch 2024-05-20T22:18:58.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:57 smithi050 bash[28929]: cluster 2024-05-20T22:18:56.360512+0000 mgr.y (mgr.14592) 493 : cluster 0 pgmap v727: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:18:58.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:57 smithi050 bash[28929]: audit 2024-05-20T22:18:56.719181+0000 mon.a (mon.0) 2764 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:18:58.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:57 smithi050 bash[28929]: audit 2024-05-20T22:18:56.720050+0000 mon.a (mon.0) 2765 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-79"}]: dispatch 2024-05-20T22:18:58.390 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:18:58 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:18:58.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:57 smithi145 bash[23893]: cluster 2024-05-20T22:18:56.360512+0000 mgr.y (mgr.14592) 493 : cluster 0 pgmap v727: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:18:58.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:57 smithi145 bash[23893]: audit 2024-05-20T22:18:56.719181+0000 mon.a (mon.0) 2764 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:18:58.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:57 smithi145 bash[23893]: audit 2024-05-20T22:18:56.720050+0000 mon.a (mon.0) 2765 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-79"}]: dispatch 2024-05-20T22:18:59.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:58 smithi050 bash[21866]: cluster 2024-05-20T22:18:57.466776+0000 mon.a (mon.0) 2766 : cluster 0 osdmap e446: 8 total, 8 up, 8 in 2024-05-20T22:18:59.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:58 smithi050 bash[21866]: audit 2024-05-20T22:18:58.093937+0000 mgr.y (mgr.14592) 494 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:18:59.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:58 smithi050 bash[21866]: cluster 2024-05-20T22:18:58.361636+0000 mgr.y (mgr.14592) 495 : cluster 0 pgmap v729: 356 pgs: 356 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1022 B/s rd, 0 op/s 2024-05-20T22:18:59.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:58 smithi050 bash[21866]: cluster 2024-05-20T22:18:58.470593+0000 mon.a (mon.0) 2767 : cluster 0 osdmap e447: 8 total, 8 up, 8 in 2024-05-20T22:18:59.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:18:58 smithi050 bash[21866]: audit 2024-05-20T22:18:58.481585+0000 mon.a (mon.0) 2768 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:18:59.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:58 smithi050 bash[28929]: cluster 2024-05-20T22:18:57.466776+0000 mon.a (mon.0) 2766 : cluster 0 osdmap e446: 8 total, 8 up, 8 in 2024-05-20T22:18:59.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:58 smithi050 bash[28929]: audit 2024-05-20T22:18:58.093937+0000 mgr.y (mgr.14592) 494 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:18:59.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:58 smithi050 bash[28929]: cluster 2024-05-20T22:18:58.361636+0000 mgr.y (mgr.14592) 495 : cluster 0 pgmap v729: 356 pgs: 356 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1022 B/s rd, 0 op/s 2024-05-20T22:18:59.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:58 smithi050 bash[28929]: cluster 2024-05-20T22:18:58.470593+0000 mon.a (mon.0) 2767 : cluster 0 osdmap e447: 8 total, 8 up, 8 in 2024-05-20T22:18:59.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:18:58 smithi050 bash[28929]: audit 2024-05-20T22:18:58.481585+0000 mon.a (mon.0) 2768 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:18:59.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:58 smithi145 bash[23893]: cluster 2024-05-20T22:18:57.466776+0000 mon.a (mon.0) 2766 : cluster 0 osdmap e446: 8 total, 8 up, 8 in 2024-05-20T22:18:59.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:58 smithi145 bash[23893]: audit 2024-05-20T22:18:58.093937+0000 mgr.y (mgr.14592) 494 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:18:59.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:58 smithi145 bash[23893]: cluster 2024-05-20T22:18:58.361636+0000 mgr.y (mgr.14592) 495 : cluster 0 pgmap v729: 356 pgs: 356 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1022 B/s rd, 0 op/s 2024-05-20T22:18:59.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:58 smithi145 bash[23893]: cluster 2024-05-20T22:18:58.470593+0000 mon.a (mon.0) 2767 : cluster 0 osdmap e447: 8 total, 8 up, 8 in 2024-05-20T22:18:59.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:18:58 smithi145 bash[23893]: audit 2024-05-20T22:18:58.481585+0000 mon.a (mon.0) 2768 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:18:59.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:18:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:18:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:19:00.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:00 smithi145 bash[23893]: audit 2024-05-20T22:18:59.466043+0000 mon.a (mon.0) 2769 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:00.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:00 smithi145 bash[23893]: cluster 2024-05-20T22:18:59.473538+0000 mon.a (mon.0) 2770 : cluster 0 osdmap e448: 8 total, 8 up, 8 in 2024-05-20T22:19:00.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:00 smithi145 bash[23893]: audit 2024-05-20T22:18:59.478991+0000 mon.a (mon.0) 2771 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:00.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:00 smithi145 bash[23893]: audit 2024-05-20T22:18:59.500365+0000 mon.a (mon.0) 2772 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:19:00.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:00 smithi050 bash[28929]: audit 2024-05-20T22:18:59.466043+0000 mon.a (mon.0) 2769 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:00.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:00 smithi050 bash[28929]: cluster 2024-05-20T22:18:59.473538+0000 mon.a (mon.0) 2770 : cluster 0 osdmap e448: 8 total, 8 up, 8 in 2024-05-20T22:19:00.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:00 smithi050 bash[28929]: audit 2024-05-20T22:18:59.478991+0000 mon.a (mon.0) 2771 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:00.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:00 smithi050 bash[28929]: audit 2024-05-20T22:18:59.500365+0000 mon.a (mon.0) 2772 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:19:00.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:00 smithi050 bash[21866]: audit 2024-05-20T22:18:59.466043+0000 mon.a (mon.0) 2769 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:00.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:00 smithi050 bash[21866]: cluster 2024-05-20T22:18:59.473538+0000 mon.a (mon.0) 2770 : cluster 0 osdmap e448: 8 total, 8 up, 8 in 2024-05-20T22:19:00.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:00 smithi050 bash[21866]: audit 2024-05-20T22:18:59.478991+0000 mon.a (mon.0) 2771 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:00.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:00 smithi050 bash[21866]: audit 2024-05-20T22:18:59.500365+0000 mon.a (mon.0) 2772 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:19:01.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:01 smithi145 bash[23893]: cluster 2024-05-20T22:19:00.365002+0000 mgr.y (mgr.14592) 496 : cluster 0 pgmap v732: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-05-20T22:19:01.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:01 smithi145 bash[23893]: audit 2024-05-20T22:19:00.474904+0000 mon.a (mon.0) 2773 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:19:01.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:01 smithi145 bash[23893]: cluster 2024-05-20T22:19:00.484296+0000 mon.a (mon.0) 2774 : cluster 0 osdmap e449: 8 total, 8 up, 8 in 2024-05-20T22:19:01.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:01 smithi145 bash[23893]: audit 2024-05-20T22:19:00.487531+0000 mon.a (mon.0) 2775 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_tier","val": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:01.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:01 smithi050 bash[28929]: cluster 2024-05-20T22:19:00.365002+0000 mgr.y (mgr.14592) 496 : cluster 0 pgmap v732: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-05-20T22:19:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:01 smithi050 bash[28929]: audit 2024-05-20T22:19:00.474904+0000 mon.a (mon.0) 2773 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:19:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:01 smithi050 bash[28929]: cluster 2024-05-20T22:19:00.484296+0000 mon.a (mon.0) 2774 : cluster 0 osdmap e449: 8 total, 8 up, 8 in 2024-05-20T22:19:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:01 smithi050 bash[28929]: audit 2024-05-20T22:19:00.487531+0000 mon.a (mon.0) 2775 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_tier","val": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:01.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:01 smithi050 bash[21866]: cluster 2024-05-20T22:19:00.365002+0000 mgr.y (mgr.14592) 496 : cluster 0 pgmap v732: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-05-20T22:19:01.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:01 smithi050 bash[21866]: audit 2024-05-20T22:19:00.474904+0000 mon.a (mon.0) 2773 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:19:01.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:01 smithi050 bash[21866]: cluster 2024-05-20T22:19:00.484296+0000 mon.a (mon.0) 2774 : cluster 0 osdmap e449: 8 total, 8 up, 8 in 2024-05-20T22:19:01.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:01 smithi050 bash[21866]: audit 2024-05-20T22:19:00.487531+0000 mon.a (mon.0) 2775 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_tier","val": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:02.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:02 smithi145 bash[23893]: audit 2024-05-20T22:19:01.477688+0000 mon.a (mon.0) 2776 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_tier","val": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:19:02.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:02 smithi145 bash[23893]: cluster 2024-05-20T22:19:01.485016+0000 mon.a (mon.0) 2777 : cluster 0 osdmap e450: 8 total, 8 up, 8 in 2024-05-20T22:19:02.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:02 smithi145 bash[23893]: audit 2024-05-20T22:19:01.491686+0000 mon.a (mon.0) 2778 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-05-20T22:19:02.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:02 smithi050 bash[21866]: audit 2024-05-20T22:19:01.477688+0000 mon.a (mon.0) 2776 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_tier","val": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:19:02.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:02 smithi050 bash[21866]: cluster 2024-05-20T22:19:01.485016+0000 mon.a (mon.0) 2777 : cluster 0 osdmap e450: 8 total, 8 up, 8 in 2024-05-20T22:19:02.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:02 smithi050 bash[21866]: audit 2024-05-20T22:19:01.491686+0000 mon.a (mon.0) 2778 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-05-20T22:19:02.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:02 smithi050 bash[28929]: audit 2024-05-20T22:19:01.477688+0000 mon.a (mon.0) 2776 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_tier","val": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:19:02.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:02 smithi050 bash[28929]: cluster 2024-05-20T22:19:01.485016+0000 mon.a (mon.0) 2777 : cluster 0 osdmap e450: 8 total, 8 up, 8 in 2024-05-20T22:19:02.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:02 smithi050 bash[28929]: audit 2024-05-20T22:19:01.491686+0000 mon.a (mon.0) 2778 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-05-20T22:19:03.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:03 smithi145 bash[23893]: cluster 2024-05-20T22:19:02.365999+0000 mgr.y (mgr.14592) 497 : cluster 0 pgmap v735: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-20T22:19:03.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:03 smithi145 bash[23893]: audit 2024-05-20T22:19:02.480384+0000 mon.a (mon.0) 2779 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-05-20T22:19:03.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:03 smithi145 bash[23893]: cluster 2024-05-20T22:19:02.487806+0000 mon.a (mon.0) 2780 : cluster 0 osdmap e451: 8 total, 8 up, 8 in 2024-05-20T22:19:03.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:03 smithi145 bash[23893]: audit 2024-05-20T22:19:02.496607+0000 mon.a (mon.0) 2781 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-05-20T22:19:03.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:03 smithi145 bash[23893]: audit 2024-05-20T22:19:03.482954+0000 mon.a (mon.0) 2782 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-05-20T22:19:03.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:03 smithi145 bash[23893]: cluster 2024-05-20T22:19:03.490904+0000 mon.a (mon.0) 2783 : cluster 0 osdmap e452: 8 total, 8 up, 8 in 2024-05-20T22:19:03.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:03 smithi050 bash[21866]: cluster 2024-05-20T22:19:02.365999+0000 mgr.y (mgr.14592) 497 : cluster 0 pgmap v735: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-20T22:19:03.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:03 smithi050 bash[21866]: audit 2024-05-20T22:19:02.480384+0000 mon.a (mon.0) 2779 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-05-20T22:19:03.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:03 smithi050 bash[21866]: cluster 2024-05-20T22:19:02.487806+0000 mon.a (mon.0) 2780 : cluster 0 osdmap e451: 8 total, 8 up, 8 in 2024-05-20T22:19:03.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:03 smithi050 bash[21866]: audit 2024-05-20T22:19:02.496607+0000 mon.a (mon.0) 2781 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-05-20T22:19:03.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:03 smithi050 bash[21866]: audit 2024-05-20T22:19:03.482954+0000 mon.a (mon.0) 2782 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-05-20T22:19:03.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:03 smithi050 bash[21866]: cluster 2024-05-20T22:19:03.490904+0000 mon.a (mon.0) 2783 : cluster 0 osdmap e452: 8 total, 8 up, 8 in 2024-05-20T22:19:03.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:03 smithi050 bash[28929]: cluster 2024-05-20T22:19:02.365999+0000 mgr.y (mgr.14592) 497 : cluster 0 pgmap v735: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-20T22:19:03.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:03 smithi050 bash[28929]: audit 2024-05-20T22:19:02.480384+0000 mon.a (mon.0) 2779 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-05-20T22:19:03.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:03 smithi050 bash[28929]: cluster 2024-05-20T22:19:02.487806+0000 mon.a (mon.0) 2780 : cluster 0 osdmap e451: 8 total, 8 up, 8 in 2024-05-20T22:19:03.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:03 smithi050 bash[28929]: audit 2024-05-20T22:19:02.496607+0000 mon.a (mon.0) 2781 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-05-20T22:19:03.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:03 smithi050 bash[28929]: audit 2024-05-20T22:19:03.482954+0000 mon.a (mon.0) 2782 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-05-20T22:19:03.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:03 smithi050 bash[28929]: cluster 2024-05-20T22:19:03.490904+0000 mon.a (mon.0) 2783 : cluster 0 osdmap e452: 8 total, 8 up, 8 in 2024-05-20T22:19:04.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:04 smithi145 bash[23893]: audit 2024-05-20T22:19:03.547570+0000 mon.a (mon.0) 2784 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-05-20T22:19:04.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:04 smithi050 bash[21866]: audit 2024-05-20T22:19:03.547570+0000 mon.a (mon.0) 2784 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-05-20T22:19:04.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:04 smithi050 bash[28929]: audit 2024-05-20T22:19:03.547570+0000 mon.a (mon.0) 2784 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-05-20T22:19:05.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:05 smithi145 bash[23893]: cluster 2024-05-20T22:19:04.366961+0000 mgr.y (mgr.14592) 498 : cluster 0 pgmap v738: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:19:05.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:05 smithi145 bash[23893]: audit 2024-05-20T22:19:04.516738+0000 mon.a (mon.0) 2785 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-05-20T22:19:05.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:05 smithi145 bash[23893]: cluster 2024-05-20T22:19:04.522993+0000 mon.a (mon.0) 2786 : cluster 0 osdmap e453: 8 total, 8 up, 8 in 2024-05-20T22:19:05.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:05 smithi145 bash[23893]: audit 2024-05-20T22:19:04.573403+0000 mon.a (mon.0) 2787 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-05-20T22:19:05.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:05 smithi050 bash[21866]: cluster 2024-05-20T22:19:04.366961+0000 mgr.y (mgr.14592) 498 : cluster 0 pgmap v738: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:19:05.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:05 smithi050 bash[21866]: audit 2024-05-20T22:19:04.516738+0000 mon.a (mon.0) 2785 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-05-20T22:19:05.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:05 smithi050 bash[21866]: cluster 2024-05-20T22:19:04.522993+0000 mon.a (mon.0) 2786 : cluster 0 osdmap e453: 8 total, 8 up, 8 in 2024-05-20T22:19:05.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:05 smithi050 bash[21866]: audit 2024-05-20T22:19:04.573403+0000 mon.a (mon.0) 2787 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-05-20T22:19:05.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:05 smithi050 bash[28929]: cluster 2024-05-20T22:19:04.366961+0000 mgr.y (mgr.14592) 498 : cluster 0 pgmap v738: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:19:05.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:05 smithi050 bash[28929]: audit 2024-05-20T22:19:04.516738+0000 mon.a (mon.0) 2785 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-05-20T22:19:05.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:05 smithi050 bash[28929]: cluster 2024-05-20T22:19:04.522993+0000 mon.a (mon.0) 2786 : cluster 0 osdmap e453: 8 total, 8 up, 8 in 2024-05-20T22:19:05.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:05 smithi050 bash[28929]: audit 2024-05-20T22:19:04.573403+0000 mon.a (mon.0) 2787 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-05-20T22:19:06.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:06 smithi145 bash[23893]: audit 2024-05-20T22:19:05.519346+0000 mon.a (mon.0) 2788 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-05-20T22:19:06.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:06 smithi145 bash[23893]: cluster 2024-05-20T22:19:05.526401+0000 mon.a (mon.0) 2789 : cluster 0 osdmap e454: 8 total, 8 up, 8 in 2024-05-20T22:19:06.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:06 smithi145 bash[23893]: audit 2024-05-20T22:19:05.564998+0000 mon.a (mon.0) 2790 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-05-20T22:19:06.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:06 smithi050 bash[28929]: audit 2024-05-20T22:19:05.519346+0000 mon.a (mon.0) 2788 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-05-20T22:19:06.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:06 smithi050 bash[28929]: cluster 2024-05-20T22:19:05.526401+0000 mon.a (mon.0) 2789 : cluster 0 osdmap e454: 8 total, 8 up, 8 in 2024-05-20T22:19:06.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:06 smithi050 bash[28929]: audit 2024-05-20T22:19:05.564998+0000 mon.a (mon.0) 2790 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-05-20T22:19:06.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:06 smithi050 bash[21866]: audit 2024-05-20T22:19:05.519346+0000 mon.a (mon.0) 2788 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-05-20T22:19:06.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:06 smithi050 bash[21866]: cluster 2024-05-20T22:19:05.526401+0000 mon.a (mon.0) 2789 : cluster 0 osdmap e454: 8 total, 8 up, 8 in 2024-05-20T22:19:06.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:06 smithi050 bash[21866]: audit 2024-05-20T22:19:05.564998+0000 mon.a (mon.0) 2790 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-05-20T22:19:07.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:07 smithi145 bash[23893]: cluster 2024-05-20T22:19:06.367970+0000 mgr.y (mgr.14592) 499 : cluster 0 pgmap v741: 388 pgs: 388 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 9.2 KiB/s wr, 21 op/s 2024-05-20T22:19:07.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:07 smithi145 bash[23893]: audit 2024-05-20T22:19:06.542499+0000 mon.a (mon.0) 2791 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-05-20T22:19:07.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:07 smithi145 bash[23893]: cluster 2024-05-20T22:19:06.552056+0000 mon.a (mon.0) 2792 : cluster 0 osdmap e455: 8 total, 8 up, 8 in 2024-05-20T22:19:07.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:07 smithi145 bash[23893]: audit 2024-05-20T22:19:06.642635+0000 mon.a (mon.0) 2793 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:07.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:07 smithi145 bash[23893]: audit 2024-05-20T22:19:06.643537+0000 mon.a (mon.0) 2794 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-81"}]: dispatch 2024-05-20T22:19:07.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:07 smithi050 bash[21866]: cluster 2024-05-20T22:19:06.367970+0000 mgr.y (mgr.14592) 499 : cluster 0 pgmap v741: 388 pgs: 388 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 9.2 KiB/s wr, 21 op/s 2024-05-20T22:19:07.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:07 smithi050 bash[21866]: audit 2024-05-20T22:19:06.542499+0000 mon.a (mon.0) 2791 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-05-20T22:19:07.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:07 smithi050 bash[21866]: cluster 2024-05-20T22:19:06.552056+0000 mon.a (mon.0) 2792 : cluster 0 osdmap e455: 8 total, 8 up, 8 in 2024-05-20T22:19:07.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:07 smithi050 bash[21866]: audit 2024-05-20T22:19:06.642635+0000 mon.a (mon.0) 2793 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:07.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:07 smithi050 bash[21866]: audit 2024-05-20T22:19:06.643537+0000 mon.a (mon.0) 2794 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-81"}]: dispatch 2024-05-20T22:19:07.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:07 smithi050 bash[28929]: cluster 2024-05-20T22:19:06.367970+0000 mgr.y (mgr.14592) 499 : cluster 0 pgmap v741: 388 pgs: 388 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 9.2 KiB/s wr, 21 op/s 2024-05-20T22:19:07.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:07 smithi050 bash[28929]: audit 2024-05-20T22:19:06.542499+0000 mon.a (mon.0) 2791 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-05-20T22:19:07.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:07 smithi050 bash[28929]: cluster 2024-05-20T22:19:06.552056+0000 mon.a (mon.0) 2792 : cluster 0 osdmap e455: 8 total, 8 up, 8 in 2024-05-20T22:19:07.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:07 smithi050 bash[28929]: audit 2024-05-20T22:19:06.642635+0000 mon.a (mon.0) 2793 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:07.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:07 smithi050 bash[28929]: audit 2024-05-20T22:19:06.643537+0000 mon.a (mon.0) 2794 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-81"}]: dispatch 2024-05-20T22:19:08.390 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:19:08 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:19:08.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:08 smithi145 bash[23893]: cluster 2024-05-20T22:19:07.558734+0000 mon.a (mon.0) 2795 : cluster 0 osdmap e456: 8 total, 8 up, 8 in 2024-05-20T22:19:08.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:08 smithi145 bash[23893]: audit 2024-05-20T22:19:08.035478+0000 mon.a (mon.0) 2796 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:19:08.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:08 smithi050 bash[21866]: cluster 2024-05-20T22:19:07.558734+0000 mon.a (mon.0) 2795 : cluster 0 osdmap e456: 8 total, 8 up, 8 in 2024-05-20T22:19:08.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:08 smithi050 bash[21866]: audit 2024-05-20T22:19:08.035478+0000 mon.a (mon.0) 2796 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:19:08.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:08 smithi050 bash[28929]: cluster 2024-05-20T22:19:07.558734+0000 mon.a (mon.0) 2795 : cluster 0 osdmap e456: 8 total, 8 up, 8 in 2024-05-20T22:19:08.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:08 smithi050 bash[28929]: audit 2024-05-20T22:19:08.035478+0000 mon.a (mon.0) 2796 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:19:09.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:19:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:19:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:19:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:09 smithi050 bash[21866]: audit 2024-05-20T22:19:08.102641+0000 mgr.y (mgr.14592) 500 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:19:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:09 smithi050 bash[21866]: cluster 2024-05-20T22:19:08.368926+0000 mgr.y (mgr.14592) 501 : cluster 0 pgmap v744: 356 pgs: 356 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 7.0 KiB/s wr, 21 op/s 2024-05-20T22:19:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:09 smithi050 bash[21866]: cluster 2024-05-20T22:19:08.573579+0000 mon.a (mon.0) 2797 : cluster 0 osdmap e457: 8 total, 8 up, 8 in 2024-05-20T22:19:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:09 smithi050 bash[21866]: audit 2024-05-20T22:19:08.577829+0000 mon.a (mon.0) 2798 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:19:09.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:09 smithi050 bash[28929]: audit 2024-05-20T22:19:08.102641+0000 mgr.y (mgr.14592) 500 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:19:09.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:09 smithi050 bash[28929]: cluster 2024-05-20T22:19:08.368926+0000 mgr.y (mgr.14592) 501 : cluster 0 pgmap v744: 356 pgs: 356 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 7.0 KiB/s wr, 21 op/s 2024-05-20T22:19:09.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:09 smithi050 bash[28929]: cluster 2024-05-20T22:19:08.573579+0000 mon.a (mon.0) 2797 : cluster 0 osdmap e457: 8 total, 8 up, 8 in 2024-05-20T22:19:09.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:09 smithi050 bash[28929]: audit 2024-05-20T22:19:08.577829+0000 mon.a (mon.0) 2798 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:19:09.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:09 smithi145 bash[23893]: audit 2024-05-20T22:19:08.102641+0000 mgr.y (mgr.14592) 500 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:19:09.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:09 smithi145 bash[23893]: cluster 2024-05-20T22:19:08.368926+0000 mgr.y (mgr.14592) 501 : cluster 0 pgmap v744: 356 pgs: 356 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 7.0 KiB/s wr, 21 op/s 2024-05-20T22:19:09.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:09 smithi145 bash[23893]: cluster 2024-05-20T22:19:08.573579+0000 mon.a (mon.0) 2797 : cluster 0 osdmap e457: 8 total, 8 up, 8 in 2024-05-20T22:19:09.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:09 smithi145 bash[23893]: audit 2024-05-20T22:19:08.577829+0000 mon.a (mon.0) 2798 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:19:10.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:10 smithi145 bash[23893]: audit 2024-05-20T22:19:09.574011+0000 mon.a (mon.0) 2799 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:10.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:10 smithi145 bash[23893]: cluster 2024-05-20T22:19:09.581041+0000 mon.a (mon.0) 2800 : cluster 0 osdmap e458: 8 total, 8 up, 8 in 2024-05-20T22:19:10.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:10 smithi145 bash[23893]: audit 2024-05-20T22:19:09.585766+0000 mon.a (mon.0) 2801 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:10.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:10 smithi145 bash[23893]: audit 2024-05-20T22:19:09.609862+0000 mon.a (mon.0) 2802 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:19:10.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:10 smithi050 bash[21866]: audit 2024-05-20T22:19:09.574011+0000 mon.a (mon.0) 2799 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:10.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:10 smithi050 bash[21866]: cluster 2024-05-20T22:19:09.581041+0000 mon.a (mon.0) 2800 : cluster 0 osdmap e458: 8 total, 8 up, 8 in 2024-05-20T22:19:10.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:10 smithi050 bash[21866]: audit 2024-05-20T22:19:09.585766+0000 mon.a (mon.0) 2801 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:10.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:10 smithi050 bash[21866]: audit 2024-05-20T22:19:09.609862+0000 mon.a (mon.0) 2802 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:19:10.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:10 smithi050 bash[28929]: audit 2024-05-20T22:19:09.574011+0000 mon.a (mon.0) 2799 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:10.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:10 smithi050 bash[28929]: cluster 2024-05-20T22:19:09.581041+0000 mon.a (mon.0) 2800 : cluster 0 osdmap e458: 8 total, 8 up, 8 in 2024-05-20T22:19:10.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:10 smithi050 bash[28929]: audit 2024-05-20T22:19:09.585766+0000 mon.a (mon.0) 2801 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:10.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:10 smithi050 bash[28929]: audit 2024-05-20T22:19:09.609862+0000 mon.a (mon.0) 2802 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:19:11.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:11 smithi145 bash[23893]: cluster 2024-05-20T22:19:10.372200+0000 mgr.y (mgr.14592) 502 : cluster 0 pgmap v747: 388 pgs: 388 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 3.0 KiB/s wr, 18 op/s 2024-05-20T22:19:11.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:11 smithi145 bash[23893]: audit 2024-05-20T22:19:10.585812+0000 mon.a (mon.0) 2803 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:19:11.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:11 smithi145 bash[23893]: cluster 2024-05-20T22:19:10.593136+0000 mon.a (mon.0) 2804 : cluster 0 osdmap e459: 8 total, 8 up, 8 in 2024-05-20T22:19:11.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:11 smithi145 bash[23893]: audit 2024-05-20T22:19:10.595143+0000 mon.a (mon.0) 2805 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "dedup_tier","val": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:11.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:11 smithi050 bash[21866]: cluster 2024-05-20T22:19:10.372200+0000 mgr.y (mgr.14592) 502 : cluster 0 pgmap v747: 388 pgs: 388 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 3.0 KiB/s wr, 18 op/s 2024-05-20T22:19:11.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:11 smithi050 bash[21866]: audit 2024-05-20T22:19:10.585812+0000 mon.a (mon.0) 2803 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:19:11.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:11 smithi050 bash[21866]: cluster 2024-05-20T22:19:10.593136+0000 mon.a (mon.0) 2804 : cluster 0 osdmap e459: 8 total, 8 up, 8 in 2024-05-20T22:19:11.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:11 smithi050 bash[21866]: audit 2024-05-20T22:19:10.595143+0000 mon.a (mon.0) 2805 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "dedup_tier","val": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:11.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:11 smithi050 bash[28929]: cluster 2024-05-20T22:19:10.372200+0000 mgr.y (mgr.14592) 502 : cluster 0 pgmap v747: 388 pgs: 388 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 3.0 KiB/s wr, 18 op/s 2024-05-20T22:19:11.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:11 smithi050 bash[28929]: audit 2024-05-20T22:19:10.585812+0000 mon.a (mon.0) 2803 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:19:11.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:11 smithi050 bash[28929]: cluster 2024-05-20T22:19:10.593136+0000 mon.a (mon.0) 2804 : cluster 0 osdmap e459: 8 total, 8 up, 8 in 2024-05-20T22:19:11.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:11 smithi050 bash[28929]: audit 2024-05-20T22:19:10.595143+0000 mon.a (mon.0) 2805 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "dedup_tier","val": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:12.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:12 smithi145 bash[23893]: audit 2024-05-20T22:19:11.588704+0000 mon.a (mon.0) 2806 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "dedup_tier","val": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:19:12.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:12 smithi145 bash[23893]: cluster 2024-05-20T22:19:11.596578+0000 mon.a (mon.0) 2807 : cluster 0 osdmap e460: 8 total, 8 up, 8 in 2024-05-20T22:19:12.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:12 smithi145 bash[23893]: audit 2024-05-20T22:19:11.599225+0000 mon.a (mon.0) 2808 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-05-20T22:19:12.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:12 smithi145 bash[23893]: audit 2024-05-20T22:19:12.591650+0000 mon.a (mon.0) 2809 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-05-20T22:19:12.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:12 smithi145 bash[23893]: cluster 2024-05-20T22:19:12.598690+0000 mon.a (mon.0) 2810 : cluster 0 osdmap e461: 8 total, 8 up, 8 in 2024-05-20T22:19:12.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:12 smithi145 bash[23893]: audit 2024-05-20T22:19:12.603198+0000 mon.a (mon.0) 2811 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-05-20T22:19:12.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:12 smithi050 bash[21866]: audit 2024-05-20T22:19:11.588704+0000 mon.a (mon.0) 2806 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "dedup_tier","val": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:19:12.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:12 smithi050 bash[21866]: cluster 2024-05-20T22:19:11.596578+0000 mon.a (mon.0) 2807 : cluster 0 osdmap e460: 8 total, 8 up, 8 in 2024-05-20T22:19:12.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:12 smithi050 bash[21866]: audit 2024-05-20T22:19:11.599225+0000 mon.a (mon.0) 2808 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-05-20T22:19:12.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:12 smithi050 bash[21866]: audit 2024-05-20T22:19:12.591650+0000 mon.a (mon.0) 2809 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-05-20T22:19:12.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:12 smithi050 bash[21866]: cluster 2024-05-20T22:19:12.598690+0000 mon.a (mon.0) 2810 : cluster 0 osdmap e461: 8 total, 8 up, 8 in 2024-05-20T22:19:12.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:12 smithi050 bash[21866]: audit 2024-05-20T22:19:12.603198+0000 mon.a (mon.0) 2811 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-05-20T22:19:12.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:12 smithi050 bash[28929]: audit 2024-05-20T22:19:11.588704+0000 mon.a (mon.0) 2806 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "dedup_tier","val": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:19:12.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:12 smithi050 bash[28929]: cluster 2024-05-20T22:19:11.596578+0000 mon.a (mon.0) 2807 : cluster 0 osdmap e460: 8 total, 8 up, 8 in 2024-05-20T22:19:12.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:12 smithi050 bash[28929]: audit 2024-05-20T22:19:11.599225+0000 mon.a (mon.0) 2808 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-05-20T22:19:12.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:12 smithi050 bash[28929]: audit 2024-05-20T22:19:12.591650+0000 mon.a (mon.0) 2809 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-05-20T22:19:12.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:12 smithi050 bash[28929]: cluster 2024-05-20T22:19:12.598690+0000 mon.a (mon.0) 2810 : cluster 0 osdmap e461: 8 total, 8 up, 8 in 2024-05-20T22:19:12.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:12 smithi050 bash[28929]: audit 2024-05-20T22:19:12.603198+0000 mon.a (mon.0) 2811 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-05-20T22:19:13.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:13 smithi145 bash[23893]: cluster 2024-05-20T22:19:12.373209+0000 mgr.y (mgr.14592) 503 : cluster 0 pgmap v750: 388 pgs: 388 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 19 op/s 2024-05-20T22:19:13.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:13 smithi145 bash[23893]: audit 2024-05-20T22:19:13.594199+0000 mon.a (mon.0) 2812 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-05-20T22:19:13.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:13 smithi145 bash[23893]: cluster 2024-05-20T22:19:13.602169+0000 mon.a (mon.0) 2813 : cluster 0 osdmap e462: 8 total, 8 up, 8 in 2024-05-20T22:19:13.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:13 smithi050 bash[21866]: cluster 2024-05-20T22:19:12.373209+0000 mgr.y (mgr.14592) 503 : cluster 0 pgmap v750: 388 pgs: 388 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 19 op/s 2024-05-20T22:19:13.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:13 smithi050 bash[21866]: audit 2024-05-20T22:19:13.594199+0000 mon.a (mon.0) 2812 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-05-20T22:19:13.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:13 smithi050 bash[21866]: cluster 2024-05-20T22:19:13.602169+0000 mon.a (mon.0) 2813 : cluster 0 osdmap e462: 8 total, 8 up, 8 in 2024-05-20T22:19:13.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:13 smithi050 bash[28929]: cluster 2024-05-20T22:19:12.373209+0000 mgr.y (mgr.14592) 503 : cluster 0 pgmap v750: 388 pgs: 388 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 19 op/s 2024-05-20T22:19:13.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:13 smithi050 bash[28929]: audit 2024-05-20T22:19:13.594199+0000 mon.a (mon.0) 2812 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-05-20T22:19:13.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:13 smithi050 bash[28929]: cluster 2024-05-20T22:19:13.602169+0000 mon.a (mon.0) 2813 : cluster 0 osdmap e462: 8 total, 8 up, 8 in 2024-05-20T22:19:15.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:15 smithi050 bash[21866]: cluster 2024-05-20T22:19:14.374186+0000 mgr.y (mgr.14592) 504 : cluster 0 pgmap v753: 388 pgs: 388 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:19:15.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:15 smithi050 bash[21866]: cluster 2024-05-20T22:19:14.643319+0000 mon.a (mon.0) 2814 : cluster 0 osdmap e463: 8 total, 8 up, 8 in 2024-05-20T22:19:15.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:15 smithi050 bash[28929]: cluster 2024-05-20T22:19:14.374186+0000 mgr.y (mgr.14592) 504 : cluster 0 pgmap v753: 388 pgs: 388 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:19:15.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:15 smithi050 bash[28929]: cluster 2024-05-20T22:19:14.643319+0000 mon.a (mon.0) 2814 : cluster 0 osdmap e463: 8 total, 8 up, 8 in 2024-05-20T22:19:16.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:15 smithi145 bash[23893]: cluster 2024-05-20T22:19:14.374186+0000 mgr.y (mgr.14592) 504 : cluster 0 pgmap v753: 388 pgs: 388 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:19:16.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:15 smithi145 bash[23893]: cluster 2024-05-20T22:19:14.643319+0000 mon.a (mon.0) 2814 : cluster 0 osdmap e463: 8 total, 8 up, 8 in 2024-05-20T22:19:16.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:16 smithi050 bash[21866]: cluster 2024-05-20T22:19:15.646126+0000 mon.a (mon.0) 2815 : cluster 0 osdmap e464: 8 total, 8 up, 8 in 2024-05-20T22:19:16.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:16 smithi050 bash[21866]: audit 2024-05-20T22:19:15.736627+0000 mon.a (mon.0) 2816 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:16.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:16 smithi050 bash[21866]: audit 2024-05-20T22:19:15.737761+0000 mon.a (mon.0) 2817 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-83"}]: dispatch 2024-05-20T22:19:16.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:16 smithi050 bash[28929]: cluster 2024-05-20T22:19:15.646126+0000 mon.a (mon.0) 2815 : cluster 0 osdmap e464: 8 total, 8 up, 8 in 2024-05-20T22:19:16.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:16 smithi050 bash[28929]: audit 2024-05-20T22:19:15.736627+0000 mon.a (mon.0) 2816 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:16.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:16 smithi050 bash[28929]: audit 2024-05-20T22:19:15.737761+0000 mon.a (mon.0) 2817 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-83"}]: dispatch 2024-05-20T22:19:17.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:16 smithi145 bash[23893]: cluster 2024-05-20T22:19:15.646126+0000 mon.a (mon.0) 2815 : cluster 0 osdmap e464: 8 total, 8 up, 8 in 2024-05-20T22:19:17.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:16 smithi145 bash[23893]: audit 2024-05-20T22:19:15.736627+0000 mon.a (mon.0) 2816 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:17.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:16 smithi145 bash[23893]: audit 2024-05-20T22:19:15.737761+0000 mon.a (mon.0) 2817 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-83"}]: dispatch 2024-05-20T22:19:17.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:17 smithi050 bash[21866]: cluster 2024-05-20T22:19:16.375187+0000 mgr.y (mgr.14592) 505 : cluster 0 pgmap v756: 388 pgs: 388 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.5 KiB/s wr, 2 op/s 2024-05-20T22:19:17.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:17 smithi050 bash[21866]: cluster 2024-05-20T22:19:16.668560+0000 mon.a (mon.0) 2818 : cluster 0 osdmap e465: 8 total, 8 up, 8 in 2024-05-20T22:19:17.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:17 smithi050 bash[28929]: cluster 2024-05-20T22:19:16.375187+0000 mgr.y (mgr.14592) 505 : cluster 0 pgmap v756: 388 pgs: 388 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.5 KiB/s wr, 2 op/s 2024-05-20T22:19:17.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:17 smithi050 bash[28929]: cluster 2024-05-20T22:19:16.668560+0000 mon.a (mon.0) 2818 : cluster 0 osdmap e465: 8 total, 8 up, 8 in 2024-05-20T22:19:18.108 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:17 smithi145 bash[23893]: cluster 2024-05-20T22:19:16.375187+0000 mgr.y (mgr.14592) 505 : cluster 0 pgmap v756: 388 pgs: 388 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.5 KiB/s wr, 2 op/s 2024-05-20T22:19:18.108 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:17 smithi145 bash[23893]: cluster 2024-05-20T22:19:16.668560+0000 mon.a (mon.0) 2818 : cluster 0 osdmap e465: 8 total, 8 up, 8 in 2024-05-20T22:19:18.390 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:19:18 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:19:19.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:18 smithi145 bash[23893]: cluster 2024-05-20T22:19:17.680015+0000 mon.a (mon.0) 2819 : cluster 0 osdmap e466: 8 total, 8 up, 8 in 2024-05-20T22:19:19.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:18 smithi145 bash[23893]: audit 2024-05-20T22:19:17.684187+0000 mon.a (mon.0) 2820 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:19:19.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:18 smithi050 bash[21866]: cluster 2024-05-20T22:19:17.680015+0000 mon.a (mon.0) 2819 : cluster 0 osdmap e466: 8 total, 8 up, 8 in 2024-05-20T22:19:19.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:18 smithi050 bash[21866]: audit 2024-05-20T22:19:17.684187+0000 mon.a (mon.0) 2820 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:19:19.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:18 smithi050 bash[28929]: cluster 2024-05-20T22:19:17.680015+0000 mon.a (mon.0) 2819 : cluster 0 osdmap e466: 8 total, 8 up, 8 in 2024-05-20T22:19:19.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:18 smithi050 bash[28929]: audit 2024-05-20T22:19:17.684187+0000 mon.a (mon.0) 2820 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:19:19.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:19:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:19:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:19:20.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:19 smithi145 bash[23893]: audit 2024-05-20T22:19:18.113979+0000 mgr.y (mgr.14592) 506 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:19:20.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:19 smithi145 bash[23893]: cluster 2024-05-20T22:19:18.376242+0000 mgr.y (mgr.14592) 507 : cluster 0 pgmap v759: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:19:20.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:19 smithi145 bash[23893]: cluster 2024-05-20T22:19:18.673843+0000 mon.a (mon.0) 2821 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:19:20.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:19 smithi145 bash[23893]: audit 2024-05-20T22:19:18.675632+0000 mon.a (mon.0) 2822 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:20.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:19 smithi145 bash[23893]: cluster 2024-05-20T22:19:18.684409+0000 mon.a (mon.0) 2823 : cluster 0 osdmap e467: 8 total, 8 up, 8 in 2024-05-20T22:19:20.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:19 smithi145 bash[23893]: audit 2024-05-20T22:19:18.697053+0000 mon.a (mon.0) 2824 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:20.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:19 smithi145 bash[23893]: audit 2024-05-20T22:19:18.733391+0000 mon.a (mon.0) 2825 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:19:20.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:19 smithi050 bash[21866]: audit 2024-05-20T22:19:18.113979+0000 mgr.y (mgr.14592) 506 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:19:20.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:19 smithi050 bash[21866]: cluster 2024-05-20T22:19:18.376242+0000 mgr.y (mgr.14592) 507 : cluster 0 pgmap v759: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:19:20.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:19 smithi050 bash[21866]: cluster 2024-05-20T22:19:18.673843+0000 mon.a (mon.0) 2821 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:19:20.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:19 smithi050 bash[21866]: audit 2024-05-20T22:19:18.675632+0000 mon.a (mon.0) 2822 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:20.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:19 smithi050 bash[21866]: cluster 2024-05-20T22:19:18.684409+0000 mon.a (mon.0) 2823 : cluster 0 osdmap e467: 8 total, 8 up, 8 in 2024-05-20T22:19:20.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:19 smithi050 bash[21866]: audit 2024-05-20T22:19:18.697053+0000 mon.a (mon.0) 2824 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:20.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:19 smithi050 bash[21866]: audit 2024-05-20T22:19:18.733391+0000 mon.a (mon.0) 2825 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:19:20.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:19 smithi050 bash[28929]: audit 2024-05-20T22:19:18.113979+0000 mgr.y (mgr.14592) 506 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:19:20.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:19 smithi050 bash[28929]: cluster 2024-05-20T22:19:18.376242+0000 mgr.y (mgr.14592) 507 : cluster 0 pgmap v759: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:19:20.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:19 smithi050 bash[28929]: cluster 2024-05-20T22:19:18.673843+0000 mon.a (mon.0) 2821 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:19:20.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:19 smithi050 bash[28929]: audit 2024-05-20T22:19:18.675632+0000 mon.a (mon.0) 2822 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:20.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:19 smithi050 bash[28929]: cluster 2024-05-20T22:19:18.684409+0000 mon.a (mon.0) 2823 : cluster 0 osdmap e467: 8 total, 8 up, 8 in 2024-05-20T22:19:20.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:19 smithi050 bash[28929]: audit 2024-05-20T22:19:18.697053+0000 mon.a (mon.0) 2824 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:20.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:19 smithi050 bash[28929]: audit 2024-05-20T22:19:18.733391+0000 mon.a (mon.0) 2825 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:19:21.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:20 smithi145 bash[23893]: audit 2024-05-20T22:19:19.723829+0000 mon.a (mon.0) 2826 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:19:21.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:20 smithi145 bash[23893]: cluster 2024-05-20T22:19:19.731330+0000 mon.a (mon.0) 2827 : cluster 0 osdmap e468: 8 total, 8 up, 8 in 2024-05-20T22:19:21.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:20 smithi145 bash[23893]: audit 2024-05-20T22:19:19.733050+0000 mon.a (mon.0) 2828 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "dedup_tier","val": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:21.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:20 smithi145 bash[23893]: audit 2024-05-20T22:19:20.726529+0000 mon.a (mon.0) 2829 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "dedup_tier","val": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:19:21.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:20 smithi050 bash[21866]: audit 2024-05-20T22:19:19.723829+0000 mon.a (mon.0) 2826 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:19:21.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:20 smithi050 bash[21866]: cluster 2024-05-20T22:19:19.731330+0000 mon.a (mon.0) 2827 : cluster 0 osdmap e468: 8 total, 8 up, 8 in 2024-05-20T22:19:21.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:20 smithi050 bash[21866]: audit 2024-05-20T22:19:19.733050+0000 mon.a (mon.0) 2828 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "dedup_tier","val": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:21.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:20 smithi050 bash[21866]: audit 2024-05-20T22:19:20.726529+0000 mon.a (mon.0) 2829 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "dedup_tier","val": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:19:21.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:20 smithi050 bash[28929]: audit 2024-05-20T22:19:19.723829+0000 mon.a (mon.0) 2826 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:19:21.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:20 smithi050 bash[28929]: cluster 2024-05-20T22:19:19.731330+0000 mon.a (mon.0) 2827 : cluster 0 osdmap e468: 8 total, 8 up, 8 in 2024-05-20T22:19:21.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:20 smithi050 bash[28929]: audit 2024-05-20T22:19:19.733050+0000 mon.a (mon.0) 2828 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "dedup_tier","val": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:21.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:20 smithi050 bash[28929]: audit 2024-05-20T22:19:20.726529+0000 mon.a (mon.0) 2829 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "dedup_tier","val": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:19:22.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:21 smithi145 bash[23893]: cluster 2024-05-20T22:19:20.379553+0000 mgr.y (mgr.14592) 508 : cluster 0 pgmap v762: 388 pgs: 388 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-05-20T22:19:22.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:21 smithi145 bash[23893]: cluster 2024-05-20T22:19:20.735099+0000 mon.a (mon.0) 2830 : cluster 0 osdmap e469: 8 total, 8 up, 8 in 2024-05-20T22:19:22.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:21 smithi145 bash[23893]: audit 2024-05-20T22:19:20.736868+0000 mon.a (mon.0) 2831 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-05-20T22:19:22.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:21 smithi145 bash[23893]: audit 2024-05-20T22:19:21.729197+0000 mon.a (mon.0) 2832 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-05-20T22:19:22.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:21 smithi145 bash[23893]: cluster 2024-05-20T22:19:21.736028+0000 mon.a (mon.0) 2833 : cluster 0 osdmap e470: 8 total, 8 up, 8 in 2024-05-20T22:19:22.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:21 smithi145 bash[23893]: audit 2024-05-20T22:19:21.737114+0000 mon.a (mon.0) 2834 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-05-20T22:19:22.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:21 smithi050 bash[21866]: cluster 2024-05-20T22:19:20.379553+0000 mgr.y (mgr.14592) 508 : cluster 0 pgmap v762: 388 pgs: 388 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-05-20T22:19:22.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:21 smithi050 bash[21866]: cluster 2024-05-20T22:19:20.735099+0000 mon.a (mon.0) 2830 : cluster 0 osdmap e469: 8 total, 8 up, 8 in 2024-05-20T22:19:22.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:21 smithi050 bash[21866]: audit 2024-05-20T22:19:20.736868+0000 mon.a (mon.0) 2831 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-05-20T22:19:22.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:21 smithi050 bash[21866]: audit 2024-05-20T22:19:21.729197+0000 mon.a (mon.0) 2832 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-05-20T22:19:22.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:21 smithi050 bash[21866]: cluster 2024-05-20T22:19:21.736028+0000 mon.a (mon.0) 2833 : cluster 0 osdmap e470: 8 total, 8 up, 8 in 2024-05-20T22:19:22.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:21 smithi050 bash[21866]: audit 2024-05-20T22:19:21.737114+0000 mon.a (mon.0) 2834 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-05-20T22:19:22.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:21 smithi050 bash[28929]: cluster 2024-05-20T22:19:20.379553+0000 mgr.y (mgr.14592) 508 : cluster 0 pgmap v762: 388 pgs: 388 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-05-20T22:19:22.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:21 smithi050 bash[28929]: cluster 2024-05-20T22:19:20.735099+0000 mon.a (mon.0) 2830 : cluster 0 osdmap e469: 8 total, 8 up, 8 in 2024-05-20T22:19:22.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:21 smithi050 bash[28929]: audit 2024-05-20T22:19:20.736868+0000 mon.a (mon.0) 2831 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-05-20T22:19:22.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:21 smithi050 bash[28929]: audit 2024-05-20T22:19:21.729197+0000 mon.a (mon.0) 2832 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-05-20T22:19:22.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:21 smithi050 bash[28929]: cluster 2024-05-20T22:19:21.736028+0000 mon.a (mon.0) 2833 : cluster 0 osdmap e470: 8 total, 8 up, 8 in 2024-05-20T22:19:22.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:21 smithi050 bash[28929]: audit 2024-05-20T22:19:21.737114+0000 mon.a (mon.0) 2834 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-05-20T22:19:24.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:23 smithi145 bash[23893]: cluster 2024-05-20T22:19:22.380605+0000 mgr.y (mgr.14592) 509 : cluster 0 pgmap v765: 388 pgs: 388 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-05-20T22:19:24.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:23 smithi145 bash[23893]: audit 2024-05-20T22:19:22.731972+0000 mon.a (mon.0) 2835 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-05-20T22:19:24.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:23 smithi145 bash[23893]: cluster 2024-05-20T22:19:22.739834+0000 mon.a (mon.0) 2836 : cluster 0 osdmap e471: 8 total, 8 up, 8 in 2024-05-20T22:19:24.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:23 smithi145 bash[23893]: audit 2024-05-20T22:19:23.072702+0000 mon.a (mon.0) 2837 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:19:24.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:23 smithi050 bash[21866]: cluster 2024-05-20T22:19:22.380605+0000 mgr.y (mgr.14592) 509 : cluster 0 pgmap v765: 388 pgs: 388 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-05-20T22:19:24.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:23 smithi050 bash[21866]: audit 2024-05-20T22:19:22.731972+0000 mon.a (mon.0) 2835 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-05-20T22:19:24.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:23 smithi050 bash[21866]: cluster 2024-05-20T22:19:22.739834+0000 mon.a (mon.0) 2836 : cluster 0 osdmap e471: 8 total, 8 up, 8 in 2024-05-20T22:19:24.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:23 smithi050 bash[21866]: audit 2024-05-20T22:19:23.072702+0000 mon.a (mon.0) 2837 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:19:24.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:23 smithi050 bash[28929]: cluster 2024-05-20T22:19:22.380605+0000 mgr.y (mgr.14592) 509 : cluster 0 pgmap v765: 388 pgs: 388 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-05-20T22:19:24.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:23 smithi050 bash[28929]: audit 2024-05-20T22:19:22.731972+0000 mon.a (mon.0) 2835 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-05-20T22:19:24.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:23 smithi050 bash[28929]: cluster 2024-05-20T22:19:22.739834+0000 mon.a (mon.0) 2836 : cluster 0 osdmap e471: 8 total, 8 up, 8 in 2024-05-20T22:19:24.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:23 smithi050 bash[28929]: audit 2024-05-20T22:19:23.072702+0000 mon.a (mon.0) 2837 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:19:25.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:24 smithi145 bash[23893]: cluster 2024-05-20T22:19:23.769222+0000 mon.a (mon.0) 2838 : cluster 0 osdmap e472: 8 total, 8 up, 8 in 2024-05-20T22:19:25.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:24 smithi050 bash[21866]: cluster 2024-05-20T22:19:23.769222+0000 mon.a (mon.0) 2838 : cluster 0 osdmap e472: 8 total, 8 up, 8 in 2024-05-20T22:19:25.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:24 smithi050 bash[28929]: cluster 2024-05-20T22:19:23.769222+0000 mon.a (mon.0) 2838 : cluster 0 osdmap e472: 8 total, 8 up, 8 in 2024-05-20T22:19:26.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:26 smithi145 bash[23893]: cluster 2024-05-20T22:19:24.381546+0000 mgr.y (mgr.14592) 510 : cluster 0 pgmap v768: 388 pgs: 388 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:19:26.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:26 smithi145 bash[23893]: cluster 2024-05-20T22:19:24.779097+0000 mon.a (mon.0) 2839 : cluster 0 osdmap e473: 8 total, 8 up, 8 in 2024-05-20T22:19:26.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:26 smithi145 bash[23893]: audit 2024-05-20T22:19:24.877107+0000 mon.a (mon.0) 2840 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:26.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:26 smithi145 bash[23893]: audit 2024-05-20T22:19:24.878002+0000 mon.a (mon.0) 2841 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-85"}]: dispatch 2024-05-20T22:19:26.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:26 smithi145 bash[23893]: cluster 2024-05-20T22:19:24.878872+0000 mon.a (mon.0) 2842 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:19:26.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:26 smithi050 bash[21866]: cluster 2024-05-20T22:19:24.381546+0000 mgr.y (mgr.14592) 510 : cluster 0 pgmap v768: 388 pgs: 388 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:19:26.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:26 smithi050 bash[21866]: cluster 2024-05-20T22:19:24.779097+0000 mon.a (mon.0) 2839 : cluster 0 osdmap e473: 8 total, 8 up, 8 in 2024-05-20T22:19:26.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:26 smithi050 bash[21866]: audit 2024-05-20T22:19:24.877107+0000 mon.a (mon.0) 2840 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:26.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:26 smithi050 bash[21866]: audit 2024-05-20T22:19:24.878002+0000 mon.a (mon.0) 2841 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-85"}]: dispatch 2024-05-20T22:19:26.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:26 smithi050 bash[21866]: cluster 2024-05-20T22:19:24.878872+0000 mon.a (mon.0) 2842 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:19:26.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:26 smithi050 bash[28929]: cluster 2024-05-20T22:19:24.381546+0000 mgr.y (mgr.14592) 510 : cluster 0 pgmap v768: 388 pgs: 388 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:19:26.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:26 smithi050 bash[28929]: cluster 2024-05-20T22:19:24.779097+0000 mon.a (mon.0) 2839 : cluster 0 osdmap e473: 8 total, 8 up, 8 in 2024-05-20T22:19:26.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:26 smithi050 bash[28929]: audit 2024-05-20T22:19:24.877107+0000 mon.a (mon.0) 2840 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:26.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:26 smithi050 bash[28929]: audit 2024-05-20T22:19:24.878002+0000 mon.a (mon.0) 2841 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-85"}]: dispatch 2024-05-20T22:19:26.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:26 smithi050 bash[28929]: cluster 2024-05-20T22:19:24.878872+0000 mon.a (mon.0) 2842 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:19:27.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:27 smithi145 bash[23893]: cluster 2024-05-20T22:19:25.781286+0000 mon.a (mon.0) 2843 : cluster 0 osdmap e474: 8 total, 8 up, 8 in 2024-05-20T22:19:27.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:27 smithi145 bash[23893]: cluster 2024-05-20T22:19:26.382521+0000 mgr.y (mgr.14592) 511 : cluster 0 pgmap v771: 356 pgs: 356 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-05-20T22:19:27.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:27 smithi145 bash[23893]: cluster 2024-05-20T22:19:26.785683+0000 mon.a (mon.0) 2844 : cluster 0 osdmap e475: 8 total, 8 up, 8 in 2024-05-20T22:19:27.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:27 smithi145 bash[23893]: audit 2024-05-20T22:19:26.794104+0000 mon.a (mon.0) 2845 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:19:27.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:27 smithi050 bash[21866]: cluster 2024-05-20T22:19:25.781286+0000 mon.a (mon.0) 2843 : cluster 0 osdmap e474: 8 total, 8 up, 8 in 2024-05-20T22:19:27.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:27 smithi050 bash[21866]: cluster 2024-05-20T22:19:26.382521+0000 mgr.y (mgr.14592) 511 : cluster 0 pgmap v771: 356 pgs: 356 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-05-20T22:19:27.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:27 smithi050 bash[21866]: cluster 2024-05-20T22:19:26.785683+0000 mon.a (mon.0) 2844 : cluster 0 osdmap e475: 8 total, 8 up, 8 in 2024-05-20T22:19:27.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:27 smithi050 bash[21866]: audit 2024-05-20T22:19:26.794104+0000 mon.a (mon.0) 2845 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:19:27.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:27 smithi050 bash[28929]: cluster 2024-05-20T22:19:25.781286+0000 mon.a (mon.0) 2843 : cluster 0 osdmap e474: 8 total, 8 up, 8 in 2024-05-20T22:19:27.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:27 smithi050 bash[28929]: cluster 2024-05-20T22:19:26.382521+0000 mgr.y (mgr.14592) 511 : cluster 0 pgmap v771: 356 pgs: 356 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-05-20T22:19:27.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:27 smithi050 bash[28929]: cluster 2024-05-20T22:19:26.785683+0000 mon.a (mon.0) 2844 : cluster 0 osdmap e475: 8 total, 8 up, 8 in 2024-05-20T22:19:27.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:27 smithi050 bash[28929]: audit 2024-05-20T22:19:26.794104+0000 mon.a (mon.0) 2845 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:19:27.804 INFO:tasks.workunit.client.0.smithi050.stdout: OK ] LibRadosTwoPoolsPP.ProxyRead (17659 ms) 2024-05-20T22:19:27.805 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2024-05-20T22:19:27.805 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (22509 ms) 2024-05-20T22:19:27.805 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-05-20T22:19:27.805 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (3012 ms) 2024-05-20T22:19:27.805 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-05-20T22:19:27.805 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: require_osd_release = squid 2024-05-20T22:19:27.805 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (3024 ms) 2024-05-20T22:19:27.805 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-05-20T22:19:27.805 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (3013 ms) 2024-05-20T22:19:27.805 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-05-20T22:19:27.805 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: require_osd_release = squid 2024-05-20T22:19:27.805 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (3067 ms) 2024-05-20T22:19:27.806 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-05-20T22:19:27.806 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: require_osd_release = squid 2024-05-20T22:19:27.806 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (4080 ms) 2024-05-20T22:19:27.806 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-05-20T22:19:27.806 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: require_osd_release = squid 2024-05-20T22:19:27.806 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (38822 ms) 2024-05-20T22:19:27.806 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-05-20T22:19:27.806 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: require_osd_release = squid 2024-05-20T22:19:27.806 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (17101 ms) 2024-05-20T22:19:27.806 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-05-20T22:19:27.806 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: require_osd_release = squid 2024-05-20T22:19:27.807 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (4079 ms) 2024-05-20T22:19:27.807 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-05-20T22:19:27.807 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: require_osd_release = squid 2024-05-20T22:19:27.807 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (3025 ms) 2024-05-20T22:19:27.807 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-05-20T22:19:27.807 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: require_osd_release = squid 2024-05-20T22:19:27.807 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (24831 ms) 2024-05-20T22:19:27.807 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-05-20T22:19:27.807 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: require_osd_release = squid 2024-05-20T22:19:27.807 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (15080 ms) 2024-05-20T22:19:27.807 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-05-20T22:19:27.807 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: require_osd_release = squid 2024-05-20T22:19:27.807 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (5043 ms) 2024-05-20T22:19:27.808 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-05-20T22:19:27.808 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: require_osd_release = squid 2024-05-20T22:19:27.808 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictPromote (4065 ms) 2024-05-20T22:19:27.808 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-05-20T22:19:27.808 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: require_osd_release = squid 2024-05-20T22:19:27.808 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: waiting for scrubs... 2024-05-20T22:19:27.808 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: done waiting 2024-05-20T22:19:27.808 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (24872 ms) 2024-05-20T22:19:27.808 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-05-20T22:19:27.808 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: require_osd_release = squid 2024-05-20T22:19:27.808 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (10089 ms) 2024-05-20T22:19:27.808 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-05-20T22:19:27.808 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: require_osd_release = squid 2024-05-20T22:19:27.809 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (9116 ms) 2024-05-20T22:19:27.809 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-05-20T22:19:27.809 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: require_osd_release = squid 2024-05-20T22:19:27.809 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (9107 ms) 2024-05-20T22:19:27.809 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-05-20T22:19:28.390 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:19:28 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:19:29.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:28 smithi145 bash[23893]: audit 2024-05-20T22:19:27.781198+0000 mon.a (mon.0) 2846 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:29.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:28 smithi145 bash[23893]: cluster 2024-05-20T22:19:27.789019+0000 mon.a (mon.0) 2847 : cluster 0 osdmap e476: 8 total, 8 up, 8 in 2024-05-20T22:19:29.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:28 smithi145 bash[23893]: audit 2024-05-20T22:19:27.794771+0000 mon.a (mon.0) 2848 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:29.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:28 smithi145 bash[23893]: audit 2024-05-20T22:19:28.125102+0000 mgr.y (mgr.14592) 512 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:19:29.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:28 smithi145 bash[23893]: cluster 2024-05-20T22:19:28.383479+0000 mgr.y (mgr.14592) 513 : cluster 0 pgmap v774: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-05-20T22:19:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:28 smithi050 bash[21866]: audit 2024-05-20T22:19:27.781198+0000 mon.a (mon.0) 2846 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:28 smithi050 bash[21866]: cluster 2024-05-20T22:19:27.789019+0000 mon.a (mon.0) 2847 : cluster 0 osdmap e476: 8 total, 8 up, 8 in 2024-05-20T22:19:29.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:28 smithi050 bash[21866]: audit 2024-05-20T22:19:27.794771+0000 mon.a (mon.0) 2848 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:29.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:28 smithi050 bash[21866]: audit 2024-05-20T22:19:28.125102+0000 mgr.y (mgr.14592) 512 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:19:29.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:28 smithi050 bash[21866]: cluster 2024-05-20T22:19:28.383479+0000 mgr.y (mgr.14592) 513 : cluster 0 pgmap v774: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-05-20T22:19:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:28 smithi050 bash[28929]: audit 2024-05-20T22:19:27.781198+0000 mon.a (mon.0) 2846 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:28 smithi050 bash[28929]: cluster 2024-05-20T22:19:27.789019+0000 mon.a (mon.0) 2847 : cluster 0 osdmap e476: 8 total, 8 up, 8 in 2024-05-20T22:19:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:28 smithi050 bash[28929]: audit 2024-05-20T22:19:27.794771+0000 mon.a (mon.0) 2848 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:28 smithi050 bash[28929]: audit 2024-05-20T22:19:28.125102+0000 mgr.y (mgr.14592) 512 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:19:29.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:28 smithi050 bash[28929]: cluster 2024-05-20T22:19:28.383479+0000 mgr.y (mgr.14592) 513 : cluster 0 pgmap v774: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-05-20T22:19:29.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:19:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:19:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:19:30.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:29 smithi145 bash[23893]: cluster 2024-05-20T22:19:28.802018+0000 mon.a (mon.0) 2849 : cluster 0 osdmap e477: 8 total, 8 up, 8 in 2024-05-20T22:19:30.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:29 smithi145 bash[23893]: audit 2024-05-20T22:19:28.806368+0000 mon.a (mon.0) 2850 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:19:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:29 smithi050 bash[21866]: cluster 2024-05-20T22:19:28.802018+0000 mon.a (mon.0) 2849 : cluster 0 osdmap e477: 8 total, 8 up, 8 in 2024-05-20T22:19:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:29 smithi050 bash[21866]: audit 2024-05-20T22:19:28.806368+0000 mon.a (mon.0) 2850 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:19:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:29 smithi050 bash[28929]: cluster 2024-05-20T22:19:28.802018+0000 mon.a (mon.0) 2849 : cluster 0 osdmap e477: 8 total, 8 up, 8 in 2024-05-20T22:19:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:29 smithi050 bash[28929]: audit 2024-05-20T22:19:28.806368+0000 mon.a (mon.0) 2850 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:19:31.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:30 smithi145 bash[23893]: audit 2024-05-20T22:19:29.795985+0000 mon.a (mon.0) 2851 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:19:31.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:30 smithi145 bash[23893]: cluster 2024-05-20T22:19:29.803772+0000 mon.a (mon.0) 2852 : cluster 0 osdmap e478: 8 total, 8 up, 8 in 2024-05-20T22:19:31.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:30 smithi145 bash[23893]: audit 2024-05-20T22:19:29.806176+0000 mon.a (mon.0) 2853 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "dedup_tier","val": "test-rados-api-smithi050-64110-89-test-flush"}]: dispatch 2024-05-20T22:19:31.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:30 smithi145 bash[23893]: cluster 2024-05-20T22:19:30.386936+0000 mgr.y (mgr.14592) 514 : cluster 0 pgmap v777: 420 pgs: 420 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:19:31.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:30 smithi050 bash[21866]: audit 2024-05-20T22:19:29.795985+0000 mon.a (mon.0) 2851 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:19:31.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:30 smithi050 bash[21866]: cluster 2024-05-20T22:19:29.803772+0000 mon.a (mon.0) 2852 : cluster 0 osdmap e478: 8 total, 8 up, 8 in 2024-05-20T22:19:31.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:30 smithi050 bash[21866]: audit 2024-05-20T22:19:29.806176+0000 mon.a (mon.0) 2853 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "dedup_tier","val": "test-rados-api-smithi050-64110-89-test-flush"}]: dispatch 2024-05-20T22:19:31.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:30 smithi050 bash[21866]: cluster 2024-05-20T22:19:30.386936+0000 mgr.y (mgr.14592) 514 : cluster 0 pgmap v777: 420 pgs: 420 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:19:31.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:30 smithi050 bash[28929]: audit 2024-05-20T22:19:29.795985+0000 mon.a (mon.0) 2851 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:19:31.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:30 smithi050 bash[28929]: cluster 2024-05-20T22:19:29.803772+0000 mon.a (mon.0) 2852 : cluster 0 osdmap e478: 8 total, 8 up, 8 in 2024-05-20T22:19:31.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:30 smithi050 bash[28929]: audit 2024-05-20T22:19:29.806176+0000 mon.a (mon.0) 2853 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "dedup_tier","val": "test-rados-api-smithi050-64110-89-test-flush"}]: dispatch 2024-05-20T22:19:31.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:30 smithi050 bash[28929]: cluster 2024-05-20T22:19:30.386936+0000 mgr.y (mgr.14592) 514 : cluster 0 pgmap v777: 420 pgs: 420 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:19:32.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:31 smithi145 bash[23893]: audit 2024-05-20T22:19:30.798869+0000 mon.a (mon.0) 2854 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "dedup_tier","val": "test-rados-api-smithi050-64110-89-test-flush"}]': finished 2024-05-20T22:19:32.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:31 smithi145 bash[23893]: cluster 2024-05-20T22:19:30.806035+0000 mon.a (mon.0) 2855 : cluster 0 osdmap e479: 8 total, 8 up, 8 in 2024-05-20T22:19:32.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:31 smithi145 bash[23893]: cluster 2024-05-20T22:19:30.807567+0000 mon.a (mon.0) 2856 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:19:32.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:31 smithi145 bash[23893]: audit 2024-05-20T22:19:30.809089+0000 mon.a (mon.0) 2857 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-05-20T22:19:32.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:31 smithi145 bash[23893]: audit 2024-05-20T22:19:31.801792+0000 mon.a (mon.0) 2858 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-05-20T22:19:32.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:31 smithi145 bash[23893]: cluster 2024-05-20T22:19:31.816705+0000 mon.a (mon.0) 2859 : cluster 0 osdmap e480: 8 total, 8 up, 8 in 2024-05-20T22:19:32.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:31 smithi145 bash[23893]: audit 2024-05-20T22:19:31.817552+0000 mon.a (mon.0) 2860 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-05-20T22:19:32.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:31 smithi050 bash[28929]: audit 2024-05-20T22:19:30.798869+0000 mon.a (mon.0) 2854 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "dedup_tier","val": "test-rados-api-smithi050-64110-89-test-flush"}]': finished 2024-05-20T22:19:32.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:31 smithi050 bash[28929]: cluster 2024-05-20T22:19:30.806035+0000 mon.a (mon.0) 2855 : cluster 0 osdmap e479: 8 total, 8 up, 8 in 2024-05-20T22:19:32.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:31 smithi050 bash[28929]: cluster 2024-05-20T22:19:30.807567+0000 mon.a (mon.0) 2856 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:19:32.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:31 smithi050 bash[28929]: audit 2024-05-20T22:19:30.809089+0000 mon.a (mon.0) 2857 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-05-20T22:19:32.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:31 smithi050 bash[28929]: audit 2024-05-20T22:19:31.801792+0000 mon.a (mon.0) 2858 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-05-20T22:19:32.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:31 smithi050 bash[28929]: cluster 2024-05-20T22:19:31.816705+0000 mon.a (mon.0) 2859 : cluster 0 osdmap e480: 8 total, 8 up, 8 in 2024-05-20T22:19:32.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:31 smithi050 bash[28929]: audit 2024-05-20T22:19:31.817552+0000 mon.a (mon.0) 2860 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-05-20T22:19:32.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:31 smithi050 bash[21866]: audit 2024-05-20T22:19:30.798869+0000 mon.a (mon.0) 2854 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "dedup_tier","val": "test-rados-api-smithi050-64110-89-test-flush"}]': finished 2024-05-20T22:19:32.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:31 smithi050 bash[21866]: cluster 2024-05-20T22:19:30.806035+0000 mon.a (mon.0) 2855 : cluster 0 osdmap e479: 8 total, 8 up, 8 in 2024-05-20T22:19:32.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:31 smithi050 bash[21866]: cluster 2024-05-20T22:19:30.807567+0000 mon.a (mon.0) 2856 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:19:32.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:31 smithi050 bash[21866]: audit 2024-05-20T22:19:30.809089+0000 mon.a (mon.0) 2857 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-05-20T22:19:32.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:31 smithi050 bash[21866]: audit 2024-05-20T22:19:31.801792+0000 mon.a (mon.0) 2858 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-05-20T22:19:32.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:31 smithi050 bash[21866]: cluster 2024-05-20T22:19:31.816705+0000 mon.a (mon.0) 2859 : cluster 0 osdmap e480: 8 total, 8 up, 8 in 2024-05-20T22:19:32.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:31 smithi050 bash[21866]: audit 2024-05-20T22:19:31.817552+0000 mon.a (mon.0) 2860 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-05-20T22:19:33.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:32 smithi145 bash[23893]: cluster 2024-05-20T22:19:32.388022+0000 mgr.y (mgr.14592) 515 : cluster 0 pgmap v780: 420 pgs: 420 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:19:33.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:32 smithi145 bash[23893]: audit 2024-05-20T22:19:32.804512+0000 mon.a (mon.0) 2861 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-05-20T22:19:33.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:32 smithi145 bash[23893]: cluster 2024-05-20T22:19:32.812387+0000 mon.a (mon.0) 2862 : cluster 0 osdmap e481: 8 total, 8 up, 8 in 2024-05-20T22:19:33.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:32 smithi050 bash[21866]: cluster 2024-05-20T22:19:32.388022+0000 mgr.y (mgr.14592) 515 : cluster 0 pgmap v780: 420 pgs: 420 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:19:33.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:32 smithi050 bash[21866]: audit 2024-05-20T22:19:32.804512+0000 mon.a (mon.0) 2861 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-05-20T22:19:33.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:32 smithi050 bash[21866]: cluster 2024-05-20T22:19:32.812387+0000 mon.a (mon.0) 2862 : cluster 0 osdmap e481: 8 total, 8 up, 8 in 2024-05-20T22:19:33.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:32 smithi050 bash[28929]: cluster 2024-05-20T22:19:32.388022+0000 mgr.y (mgr.14592) 515 : cluster 0 pgmap v780: 420 pgs: 420 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:19:33.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:32 smithi050 bash[28929]: audit 2024-05-20T22:19:32.804512+0000 mon.a (mon.0) 2861 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-05-20T22:19:33.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:32 smithi050 bash[28929]: cluster 2024-05-20T22:19:32.812387+0000 mon.a (mon.0) 2862 : cluster 0 osdmap e481: 8 total, 8 up, 8 in 2024-05-20T22:19:35.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:34 smithi145 bash[23893]: cluster 2024-05-20T22:19:33.852614+0000 mon.a (mon.0) 2863 : cluster 0 osdmap e482: 8 total, 8 up, 8 in 2024-05-20T22:19:35.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:34 smithi145 bash[23893]: audit 2024-05-20T22:19:33.950911+0000 mon.a (mon.0) 2864 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:35.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:34 smithi145 bash[23893]: audit 2024-05-20T22:19:33.951422+0000 mon.a (mon.0) 2865 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-87"}]: dispatch 2024-05-20T22:19:35.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:34 smithi145 bash[23893]: cluster 2024-05-20T22:19:34.388973+0000 mgr.y (mgr.14592) 516 : cluster 0 pgmap v783: 388 pgs: 388 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:19:35.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:34 smithi050 bash[28929]: cluster 2024-05-20T22:19:33.852614+0000 mon.a (mon.0) 2863 : cluster 0 osdmap e482: 8 total, 8 up, 8 in 2024-05-20T22:19:35.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:34 smithi050 bash[28929]: audit 2024-05-20T22:19:33.950911+0000 mon.a (mon.0) 2864 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:35.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:34 smithi050 bash[28929]: audit 2024-05-20T22:19:33.951422+0000 mon.a (mon.0) 2865 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-87"}]: dispatch 2024-05-20T22:19:35.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:34 smithi050 bash[28929]: cluster 2024-05-20T22:19:34.388973+0000 mgr.y (mgr.14592) 516 : cluster 0 pgmap v783: 388 pgs: 388 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:19:35.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:34 smithi050 bash[21866]: cluster 2024-05-20T22:19:33.852614+0000 mon.a (mon.0) 2863 : cluster 0 osdmap e482: 8 total, 8 up, 8 in 2024-05-20T22:19:35.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:34 smithi050 bash[21866]: audit 2024-05-20T22:19:33.950911+0000 mon.a (mon.0) 2864 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:35.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:34 smithi050 bash[21866]: audit 2024-05-20T22:19:33.951422+0000 mon.a (mon.0) 2865 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-87"}]: dispatch 2024-05-20T22:19:35.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:34 smithi050 bash[21866]: cluster 2024-05-20T22:19:34.388973+0000 mgr.y (mgr.14592) 516 : cluster 0 pgmap v783: 388 pgs: 388 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:19:36.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:35 smithi145 bash[23893]: cluster 2024-05-20T22:19:34.864408+0000 mon.a (mon.0) 2866 : cluster 0 osdmap e483: 8 total, 8 up, 8 in 2024-05-20T22:19:36.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:35 smithi050 bash[21866]: cluster 2024-05-20T22:19:34.864408+0000 mon.a (mon.0) 2866 : cluster 0 osdmap e483: 8 total, 8 up, 8 in 2024-05-20T22:19:36.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:35 smithi050 bash[28929]: cluster 2024-05-20T22:19:34.864408+0000 mon.a (mon.0) 2866 : cluster 0 osdmap e483: 8 total, 8 up, 8 in 2024-05-20T22:19:37.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:36 smithi145 bash[23893]: cluster 2024-05-20T22:19:35.874844+0000 mon.a (mon.0) 2867 : cluster 0 osdmap e484: 8 total, 8 up, 8 in 2024-05-20T22:19:37.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:36 smithi145 bash[23893]: audit 2024-05-20T22:19:35.885341+0000 mon.a (mon.0) 2868 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:19:37.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:36 smithi145 bash[23893]: cluster 2024-05-20T22:19:36.389969+0000 mgr.y (mgr.14592) 517 : cluster 0 pgmap v786: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:19:37.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:36 smithi050 bash[21866]: cluster 2024-05-20T22:19:35.874844+0000 mon.a (mon.0) 2867 : cluster 0 osdmap e484: 8 total, 8 up, 8 in 2024-05-20T22:19:37.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:36 smithi050 bash[21866]: audit 2024-05-20T22:19:35.885341+0000 mon.a (mon.0) 2868 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:19:37.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:36 smithi050 bash[21866]: cluster 2024-05-20T22:19:36.389969+0000 mgr.y (mgr.14592) 517 : cluster 0 pgmap v786: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:19:37.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:36 smithi050 bash[28929]: cluster 2024-05-20T22:19:35.874844+0000 mon.a (mon.0) 2867 : cluster 0 osdmap e484: 8 total, 8 up, 8 in 2024-05-20T22:19:37.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:36 smithi050 bash[28929]: audit 2024-05-20T22:19:35.885341+0000 mon.a (mon.0) 2868 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:19:37.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:36 smithi050 bash[28929]: cluster 2024-05-20T22:19:36.389969+0000 mgr.y (mgr.14592) 517 : cluster 0 pgmap v786: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:19:38.141 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:19:38 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:19:38.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:37 smithi145 bash[23893]: cluster 2024-05-20T22:19:36.867258+0000 mon.a (mon.0) 2869 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:19:38.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:37 smithi145 bash[23893]: audit 2024-05-20T22:19:36.876970+0000 mon.a (mon.0) 2870 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:38.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:37 smithi145 bash[23893]: cluster 2024-05-20T22:19:36.887151+0000 mon.a (mon.0) 2871 : cluster 0 osdmap e485: 8 total, 8 up, 8 in 2024-05-20T22:19:38.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:37 smithi145 bash[23893]: audit 2024-05-20T22:19:36.892130+0000 mon.a (mon.0) 2872 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:38.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:37 smithi145 bash[23893]: audit 2024-05-20T22:19:36.917512+0000 mon.a (mon.0) 2873 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:19:38.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:37 smithi050 bash[21866]: cluster 2024-05-20T22:19:36.867258+0000 mon.a (mon.0) 2869 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:19:38.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:37 smithi050 bash[21866]: audit 2024-05-20T22:19:36.876970+0000 mon.a (mon.0) 2870 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:38.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:37 smithi050 bash[21866]: cluster 2024-05-20T22:19:36.887151+0000 mon.a (mon.0) 2871 : cluster 0 osdmap e485: 8 total, 8 up, 8 in 2024-05-20T22:19:38.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:37 smithi050 bash[21866]: audit 2024-05-20T22:19:36.892130+0000 mon.a (mon.0) 2872 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:38.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:37 smithi050 bash[21866]: audit 2024-05-20T22:19:36.917512+0000 mon.a (mon.0) 2873 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:19:38.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:37 smithi050 bash[28929]: cluster 2024-05-20T22:19:36.867258+0000 mon.a (mon.0) 2869 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:19:38.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:37 smithi050 bash[28929]: audit 2024-05-20T22:19:36.876970+0000 mon.a (mon.0) 2870 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:38.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:37 smithi050 bash[28929]: cluster 2024-05-20T22:19:36.887151+0000 mon.a (mon.0) 2871 : cluster 0 osdmap e485: 8 total, 8 up, 8 in 2024-05-20T22:19:38.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:37 smithi050 bash[28929]: audit 2024-05-20T22:19:36.892130+0000 mon.a (mon.0) 2872 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:38.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:37 smithi050 bash[28929]: audit 2024-05-20T22:19:36.917512+0000 mon.a (mon.0) 2873 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:19:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:38 smithi050 bash[21866]: audit 2024-05-20T22:19:37.879644+0000 mon.a (mon.0) 2874 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:19:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:38 smithi050 bash[21866]: cluster 2024-05-20T22:19:37.887688+0000 mon.a (mon.0) 2875 : cluster 0 osdmap e486: 8 total, 8 up, 8 in 2024-05-20T22:19:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:38 smithi050 bash[21866]: audit 2024-05-20T22:19:38.106777+0000 mon.a (mon.0) 2876 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:19:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:38 smithi050 bash[21866]: audit 2024-05-20T22:19:38.134394+0000 mgr.y (mgr.14592) 518 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:19:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:38 smithi050 bash[21866]: cluster 2024-05-20T22:19:38.390952+0000 mgr.y (mgr.14592) 519 : cluster 0 pgmap v789: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:19:39.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:38 smithi050 bash[28929]: audit 2024-05-20T22:19:37.879644+0000 mon.a (mon.0) 2874 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:19:39.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:38 smithi050 bash[28929]: cluster 2024-05-20T22:19:37.887688+0000 mon.a (mon.0) 2875 : cluster 0 osdmap e486: 8 total, 8 up, 8 in 2024-05-20T22:19:39.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:38 smithi050 bash[28929]: audit 2024-05-20T22:19:38.106777+0000 mon.a (mon.0) 2876 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:19:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:38 smithi050 bash[28929]: audit 2024-05-20T22:19:38.134394+0000 mgr.y (mgr.14592) 518 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:19:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:38 smithi050 bash[28929]: cluster 2024-05-20T22:19:38.390952+0000 mgr.y (mgr.14592) 519 : cluster 0 pgmap v789: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:19:39.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:38 smithi145 bash[23893]: audit 2024-05-20T22:19:37.879644+0000 mon.a (mon.0) 2874 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:19:39.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:38 smithi145 bash[23893]: cluster 2024-05-20T22:19:37.887688+0000 mon.a (mon.0) 2875 : cluster 0 osdmap e486: 8 total, 8 up, 8 in 2024-05-20T22:19:39.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:38 smithi145 bash[23893]: audit 2024-05-20T22:19:38.106777+0000 mon.a (mon.0) 2876 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:19:39.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:38 smithi145 bash[23893]: audit 2024-05-20T22:19:38.134394+0000 mgr.y (mgr.14592) 518 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:19:39.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:38 smithi145 bash[23893]: cluster 2024-05-20T22:19:38.390952+0000 mgr.y (mgr.14592) 519 : cluster 0 pgmap v789: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:19:39.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:19:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:19:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:19:40.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:39 smithi050 bash[21866]: cluster 2024-05-20T22:19:38.909370+0000 mon.a (mon.0) 2877 : cluster 0 osdmap e487: 8 total, 8 up, 8 in 2024-05-20T22:19:40.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:39 smithi050 bash[28929]: cluster 2024-05-20T22:19:38.909370+0000 mon.a (mon.0) 2877 : cluster 0 osdmap e487: 8 total, 8 up, 8 in 2024-05-20T22:19:40.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:39 smithi145 bash[23893]: cluster 2024-05-20T22:19:38.909370+0000 mon.a (mon.0) 2877 : cluster 0 osdmap e487: 8 total, 8 up, 8 in 2024-05-20T22:19:41.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:41 smithi145 bash[23893]: cluster 2024-05-20T22:19:39.909207+0000 mon.a (mon.0) 2878 : cluster 0 osdmap e488: 8 total, 8 up, 8 in 2024-05-20T22:19:41.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:41 smithi145 bash[23893]: audit 2024-05-20T22:19:40.012793+0000 mon.a (mon.0) 2879 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:41.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:41 smithi145 bash[23893]: audit 2024-05-20T22:19:40.013703+0000 mon.a (mon.0) 2880 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-90"}]: dispatch 2024-05-20T22:19:41.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:41 smithi145 bash[23893]: cluster 2024-05-20T22:19:40.394298+0000 mgr.y (mgr.14592) 520 : cluster 0 pgmap v792: 388 pgs: 388 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.5 KiB/s wr, 7 op/s 2024-05-20T22:19:41.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:41 smithi050 bash[21866]: cluster 2024-05-20T22:19:39.909207+0000 mon.a (mon.0) 2878 : cluster 0 osdmap e488: 8 total, 8 up, 8 in 2024-05-20T22:19:41.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:41 smithi050 bash[21866]: audit 2024-05-20T22:19:40.012793+0000 mon.a (mon.0) 2879 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:41.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:41 smithi050 bash[21866]: audit 2024-05-20T22:19:40.013703+0000 mon.a (mon.0) 2880 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-90"}]: dispatch 2024-05-20T22:19:41.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:41 smithi050 bash[21866]: cluster 2024-05-20T22:19:40.394298+0000 mgr.y (mgr.14592) 520 : cluster 0 pgmap v792: 388 pgs: 388 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.5 KiB/s wr, 7 op/s 2024-05-20T22:19:41.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:41 smithi050 bash[28929]: cluster 2024-05-20T22:19:39.909207+0000 mon.a (mon.0) 2878 : cluster 0 osdmap e488: 8 total, 8 up, 8 in 2024-05-20T22:19:41.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:41 smithi050 bash[28929]: audit 2024-05-20T22:19:40.012793+0000 mon.a (mon.0) 2879 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:41.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:41 smithi050 bash[28929]: audit 2024-05-20T22:19:40.013703+0000 mon.a (mon.0) 2880 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-90"}]: dispatch 2024-05-20T22:19:41.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:41 smithi050 bash[28929]: cluster 2024-05-20T22:19:40.394298+0000 mgr.y (mgr.14592) 520 : cluster 0 pgmap v792: 388 pgs: 388 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.5 KiB/s wr, 7 op/s 2024-05-20T22:19:42.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:42 smithi145 bash[23893]: cluster 2024-05-20T22:19:40.924633+0000 mon.a (mon.0) 2881 : cluster 0 osdmap e489: 8 total, 8 up, 8 in 2024-05-20T22:19:42.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:42 smithi145 bash[23893]: cluster 2024-05-20T22:19:41.928371+0000 mon.a (mon.0) 2882 : cluster 0 osdmap e490: 8 total, 8 up, 8 in 2024-05-20T22:19:42.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:42 smithi145 bash[23893]: audit 2024-05-20T22:19:41.932286+0000 mon.a (mon.0) 2883 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:19:42.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:42 smithi050 bash[21866]: cluster 2024-05-20T22:19:40.924633+0000 mon.a (mon.0) 2881 : cluster 0 osdmap e489: 8 total, 8 up, 8 in 2024-05-20T22:19:42.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:42 smithi050 bash[21866]: cluster 2024-05-20T22:19:41.928371+0000 mon.a (mon.0) 2882 : cluster 0 osdmap e490: 8 total, 8 up, 8 in 2024-05-20T22:19:42.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:42 smithi050 bash[21866]: audit 2024-05-20T22:19:41.932286+0000 mon.a (mon.0) 2883 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:19:42.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:42 smithi050 bash[28929]: cluster 2024-05-20T22:19:40.924633+0000 mon.a (mon.0) 2881 : cluster 0 osdmap e489: 8 total, 8 up, 8 in 2024-05-20T22:19:42.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:42 smithi050 bash[28929]: cluster 2024-05-20T22:19:41.928371+0000 mon.a (mon.0) 2882 : cluster 0 osdmap e490: 8 total, 8 up, 8 in 2024-05-20T22:19:42.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:42 smithi050 bash[28929]: audit 2024-05-20T22:19:41.932286+0000 mon.a (mon.0) 2883 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:19:43.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:43 smithi050 bash[21866]: cluster 2024-05-20T22:19:42.395345+0000 mgr.y (mgr.14592) 521 : cluster 0 pgmap v795: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-05-20T22:19:43.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:43 smithi050 bash[21866]: audit 2024-05-20T22:19:42.924203+0000 mon.a (mon.0) 2884 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:43.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:43 smithi050 bash[21866]: cluster 2024-05-20T22:19:42.932578+0000 mon.a (mon.0) 2885 : cluster 0 osdmap e491: 8 total, 8 up, 8 in 2024-05-20T22:19:43.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:43 smithi050 bash[21866]: audit 2024-05-20T22:19:42.936661+0000 mon.a (mon.0) 2886 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:43.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:43 smithi050 bash[28929]: cluster 2024-05-20T22:19:42.395345+0000 mgr.y (mgr.14592) 521 : cluster 0 pgmap v795: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-05-20T22:19:43.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:43 smithi050 bash[28929]: audit 2024-05-20T22:19:42.924203+0000 mon.a (mon.0) 2884 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:43.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:43 smithi050 bash[28929]: cluster 2024-05-20T22:19:42.932578+0000 mon.a (mon.0) 2885 : cluster 0 osdmap e491: 8 total, 8 up, 8 in 2024-05-20T22:19:43.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:43 smithi050 bash[28929]: audit 2024-05-20T22:19:42.936661+0000 mon.a (mon.0) 2886 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:43.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:43 smithi145 bash[23893]: cluster 2024-05-20T22:19:42.395345+0000 mgr.y (mgr.14592) 521 : cluster 0 pgmap v795: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-05-20T22:19:43.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:43 smithi145 bash[23893]: audit 2024-05-20T22:19:42.924203+0000 mon.a (mon.0) 2884 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:43.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:43 smithi145 bash[23893]: cluster 2024-05-20T22:19:42.932578+0000 mon.a (mon.0) 2885 : cluster 0 osdmap e491: 8 total, 8 up, 8 in 2024-05-20T22:19:43.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:43 smithi145 bash[23893]: audit 2024-05-20T22:19:42.936661+0000 mon.a (mon.0) 2886 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:44.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:44 smithi050 bash[21866]: cluster 2024-05-20T22:19:43.392637+0000 mon.a (mon.0) 2887 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:19:44.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:44 smithi050 bash[21866]: cluster 2024-05-20T22:19:43.933877+0000 mon.a (mon.0) 2888 : cluster 0 osdmap e492: 8 total, 8 up, 8 in 2024-05-20T22:19:44.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:44 smithi050 bash[28929]: cluster 2024-05-20T22:19:43.392637+0000 mon.a (mon.0) 2887 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:19:44.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:44 smithi050 bash[28929]: cluster 2024-05-20T22:19:43.933877+0000 mon.a (mon.0) 2888 : cluster 0 osdmap e492: 8 total, 8 up, 8 in 2024-05-20T22:19:44.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:44 smithi145 bash[23893]: cluster 2024-05-20T22:19:43.392637+0000 mon.a (mon.0) 2887 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:19:44.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:44 smithi145 bash[23893]: cluster 2024-05-20T22:19:43.933877+0000 mon.a (mon.0) 2888 : cluster 0 osdmap e492: 8 total, 8 up, 8 in 2024-05-20T22:19:45.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:45 smithi050 bash[21866]: cluster 2024-05-20T22:19:44.396368+0000 mgr.y (mgr.14592) 522 : cluster 0 pgmap v798: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:19:45.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:45 smithi050 bash[21866]: cluster 2024-05-20T22:19:44.942906+0000 mon.a (mon.0) 2889 : cluster 0 osdmap e493: 8 total, 8 up, 8 in 2024-05-20T22:19:45.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:45 smithi050 bash[21866]: audit 2024-05-20T22:19:45.044309+0000 mon.a (mon.0) 2890 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:45.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:45 smithi050 bash[21866]: audit 2024-05-20T22:19:45.045086+0000 mon.a (mon.0) 2891 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-92"}]: dispatch 2024-05-20T22:19:45.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:45 smithi050 bash[28929]: cluster 2024-05-20T22:19:44.396368+0000 mgr.y (mgr.14592) 522 : cluster 0 pgmap v798: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:19:45.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:45 smithi050 bash[28929]: cluster 2024-05-20T22:19:44.942906+0000 mon.a (mon.0) 2889 : cluster 0 osdmap e493: 8 total, 8 up, 8 in 2024-05-20T22:19:45.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:45 smithi050 bash[28929]: audit 2024-05-20T22:19:45.044309+0000 mon.a (mon.0) 2890 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:45.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:45 smithi050 bash[28929]: audit 2024-05-20T22:19:45.045086+0000 mon.a (mon.0) 2891 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-92"}]: dispatch 2024-05-20T22:19:45.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:45 smithi145 bash[23893]: cluster 2024-05-20T22:19:44.396368+0000 mgr.y (mgr.14592) 522 : cluster 0 pgmap v798: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:19:45.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:45 smithi145 bash[23893]: cluster 2024-05-20T22:19:44.942906+0000 mon.a (mon.0) 2889 : cluster 0 osdmap e493: 8 total, 8 up, 8 in 2024-05-20T22:19:45.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:45 smithi145 bash[23893]: audit 2024-05-20T22:19:45.044309+0000 mon.a (mon.0) 2890 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:19:45.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:45 smithi145 bash[23893]: audit 2024-05-20T22:19:45.045086+0000 mon.a (mon.0) 2891 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-92"}]: dispatch 2024-05-20T22:19:47.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:46 smithi145 bash[23893]: cluster 2024-05-20T22:19:45.946201+0000 mon.a (mon.0) 2892 : cluster 0 osdmap e494: 8 total, 8 up, 8 in 2024-05-20T22:19:47.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:46 smithi145 bash[23893]: cluster 2024-05-20T22:19:46.397256+0000 mgr.y (mgr.14592) 523 : cluster 0 pgmap v801: 356 pgs: 356 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:19:47.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:46 smithi050 bash[21866]: cluster 2024-05-20T22:19:45.946201+0000 mon.a (mon.0) 2892 : cluster 0 osdmap e494: 8 total, 8 up, 8 in 2024-05-20T22:19:47.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:46 smithi050 bash[21866]: cluster 2024-05-20T22:19:46.397256+0000 mgr.y (mgr.14592) 523 : cluster 0 pgmap v801: 356 pgs: 356 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:19:47.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:46 smithi050 bash[28929]: cluster 2024-05-20T22:19:45.946201+0000 mon.a (mon.0) 2892 : cluster 0 osdmap e494: 8 total, 8 up, 8 in 2024-05-20T22:19:47.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:46 smithi050 bash[28929]: cluster 2024-05-20T22:19:46.397256+0000 mgr.y (mgr.14592) 523 : cluster 0 pgmap v801: 356 pgs: 356 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:19:48.390 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:19:48 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:19:48.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:47 smithi145 bash[23893]: cluster 2024-05-20T22:19:46.958667+0000 mon.a (mon.0) 2893 : cluster 0 osdmap e495: 8 total, 8 up, 8 in 2024-05-20T22:19:48.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:47 smithi145 bash[23893]: audit 2024-05-20T22:19:46.976175+0000 mon.a (mon.0) 2894 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:19:48.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:47 smithi050 bash[21866]: cluster 2024-05-20T22:19:46.958667+0000 mon.a (mon.0) 2893 : cluster 0 osdmap e495: 8 total, 8 up, 8 in 2024-05-20T22:19:48.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:47 smithi050 bash[21866]: audit 2024-05-20T22:19:46.976175+0000 mon.a (mon.0) 2894 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:19:48.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:47 smithi050 bash[28929]: cluster 2024-05-20T22:19:46.958667+0000 mon.a (mon.0) 2893 : cluster 0 osdmap e495: 8 total, 8 up, 8 in 2024-05-20T22:19:48.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:47 smithi050 bash[28929]: audit 2024-05-20T22:19:46.976175+0000 mon.a (mon.0) 2894 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:19:49.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:48 smithi145 bash[23893]: audit 2024-05-20T22:19:47.953454+0000 mon.a (mon.0) 2895 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:49.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:48 smithi145 bash[23893]: cluster 2024-05-20T22:19:47.961233+0000 mon.a (mon.0) 2896 : cluster 0 osdmap e496: 8 total, 8 up, 8 in 2024-05-20T22:19:49.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:48 smithi145 bash[23893]: audit 2024-05-20T22:19:47.964516+0000 mon.a (mon.0) 2897 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:49.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:48 smithi145 bash[23893]: audit 2024-05-20T22:19:48.145566+0000 mgr.y (mgr.14592) 524 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:19:49.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:48 smithi145 bash[23893]: cluster 2024-05-20T22:19:48.398256+0000 mgr.y (mgr.14592) 525 : cluster 0 pgmap v804: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:19:49.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:48 smithi050 bash[21866]: audit 2024-05-20T22:19:47.953454+0000 mon.a (mon.0) 2895 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:49.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:48 smithi050 bash[21866]: cluster 2024-05-20T22:19:47.961233+0000 mon.a (mon.0) 2896 : cluster 0 osdmap e496: 8 total, 8 up, 8 in 2024-05-20T22:19:49.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:48 smithi050 bash[21866]: audit 2024-05-20T22:19:47.964516+0000 mon.a (mon.0) 2897 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:49.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:48 smithi050 bash[21866]: audit 2024-05-20T22:19:48.145566+0000 mgr.y (mgr.14592) 524 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:19:49.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:48 smithi050 bash[21866]: cluster 2024-05-20T22:19:48.398256+0000 mgr.y (mgr.14592) 525 : cluster 0 pgmap v804: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:19:49.392 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:48 smithi050 bash[28929]: audit 2024-05-20T22:19:47.953454+0000 mon.a (mon.0) 2895 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:19:49.392 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:48 smithi050 bash[28929]: cluster 2024-05-20T22:19:47.961233+0000 mon.a (mon.0) 2896 : cluster 0 osdmap e496: 8 total, 8 up, 8 in 2024-05-20T22:19:49.392 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:48 smithi050 bash[28929]: audit 2024-05-20T22:19:47.964516+0000 mon.a (mon.0) 2897 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:19:49.393 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:48 smithi050 bash[28929]: audit 2024-05-20T22:19:48.145566+0000 mgr.y (mgr.14592) 524 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:19:49.393 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:48 smithi050 bash[28929]: cluster 2024-05-20T22:19:48.398256+0000 mgr.y (mgr.14592) 525 : cluster 0 pgmap v804: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:19:49.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:19:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:19:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:19:50.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:50 smithi145 bash[23893]: cluster 2024-05-20T22:19:48.997644+0000 mon.a (mon.0) 2898 : cluster 0 osdmap e497: 8 total, 8 up, 8 in 2024-05-20T22:19:50.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:50 smithi050 bash[21866]: cluster 2024-05-20T22:19:48.997644+0000 mon.a (mon.0) 2898 : cluster 0 osdmap e497: 8 total, 8 up, 8 in 2024-05-20T22:19:50.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:50 smithi050 bash[28929]: cluster 2024-05-20T22:19:48.997644+0000 mon.a (mon.0) 2898 : cluster 0 osdmap e497: 8 total, 8 up, 8 in 2024-05-20T22:19:51.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:51 smithi145 bash[23893]: cluster 2024-05-20T22:19:49.999008+0000 mon.a (mon.0) 2899 : cluster 0 osdmap e498: 8 total, 8 up, 8 in 2024-05-20T22:19:51.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:51 smithi145 bash[23893]: cluster 2024-05-20T22:19:50.335784+0000 mon.a (mon.0) 2900 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:19:51.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:51 smithi145 bash[23893]: cluster 2024-05-20T22:19:50.401539+0000 mgr.y (mgr.14592) 526 : cluster 0 pgmap v807: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-05-20T22:19:51.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:51 smithi050 bash[21866]: cluster 2024-05-20T22:19:49.999008+0000 mon.a (mon.0) 2899 : cluster 0 osdmap e498: 8 total, 8 up, 8 in 2024-05-20T22:19:51.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:51 smithi050 bash[21866]: cluster 2024-05-20T22:19:50.335784+0000 mon.a (mon.0) 2900 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:19:51.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:51 smithi050 bash[21866]: cluster 2024-05-20T22:19:50.401539+0000 mgr.y (mgr.14592) 526 : cluster 0 pgmap v807: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-05-20T22:19:51.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:51 smithi050 bash[28929]: cluster 2024-05-20T22:19:49.999008+0000 mon.a (mon.0) 2899 : cluster 0 osdmap e498: 8 total, 8 up, 8 in 2024-05-20T22:19:51.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:51 smithi050 bash[28929]: cluster 2024-05-20T22:19:50.335784+0000 mon.a (mon.0) 2900 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:19:51.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:51 smithi050 bash[28929]: cluster 2024-05-20T22:19:50.401539+0000 mgr.y (mgr.14592) 526 : cluster 0 pgmap v807: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-05-20T22:19:53.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:53 smithi145 bash[23893]: cluster 2024-05-20T22:19:52.402496+0000 mgr.y (mgr.14592) 527 : cluster 0 pgmap v808: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-05-20T22:19:53.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:53 smithi145 bash[23893]: audit 2024-05-20T22:19:53.140071+0000 mon.a (mon.0) 2901 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:19:53.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:53 smithi050 bash[21866]: cluster 2024-05-20T22:19:52.402496+0000 mgr.y (mgr.14592) 527 : cluster 0 pgmap v808: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-05-20T22:19:53.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:53 smithi050 bash[21866]: audit 2024-05-20T22:19:53.140071+0000 mon.a (mon.0) 2901 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:19:53.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:53 smithi050 bash[28929]: cluster 2024-05-20T22:19:52.402496+0000 mgr.y (mgr.14592) 527 : cluster 0 pgmap v808: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-05-20T22:19:53.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:53 smithi050 bash[28929]: audit 2024-05-20T22:19:53.140071+0000 mon.a (mon.0) 2901 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:19:55.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:55 smithi145 bash[23893]: cluster 2024-05-20T22:19:54.403458+0000 mgr.y (mgr.14592) 528 : cluster 0 pgmap v809: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 952 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:19:55.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:55 smithi145 bash[23893]: audit 2024-05-20T22:19:55.173654+0000 mon.a (mon.0) 2902 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:19:55.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:55 smithi050 bash[21866]: cluster 2024-05-20T22:19:54.403458+0000 mgr.y (mgr.14592) 528 : cluster 0 pgmap v809: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 952 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:19:55.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:55 smithi050 bash[21866]: audit 2024-05-20T22:19:55.173654+0000 mon.a (mon.0) 2902 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:19:55.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:55 smithi050 bash[28929]: cluster 2024-05-20T22:19:54.403458+0000 mgr.y (mgr.14592) 528 : cluster 0 pgmap v809: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 952 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:19:55.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:55 smithi050 bash[28929]: audit 2024-05-20T22:19:55.173654+0000 mon.a (mon.0) 2902 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:19:56.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:56 smithi145 bash[23893]: audit 2024-05-20T22:19:55.898921+0000 mon.a (mon.0) 2903 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:19:56.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:56 smithi145 bash[23893]: audit 2024-05-20T22:19:55.900546+0000 mon.a (mon.0) 2904 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:19:56.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:56 smithi145 bash[23893]: audit 2024-05-20T22:19:55.908276+0000 mon.a (mon.0) 2905 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:19:56.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:56 smithi050 bash[21866]: audit 2024-05-20T22:19:55.898921+0000 mon.a (mon.0) 2903 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:19:56.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:56 smithi050 bash[21866]: audit 2024-05-20T22:19:55.900546+0000 mon.a (mon.0) 2904 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:19:56.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:56 smithi050 bash[21866]: audit 2024-05-20T22:19:55.908276+0000 mon.a (mon.0) 2905 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:19:56.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:56 smithi050 bash[28929]: audit 2024-05-20T22:19:55.898921+0000 mon.a (mon.0) 2903 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:19:56.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:56 smithi050 bash[28929]: audit 2024-05-20T22:19:55.900546+0000 mon.a (mon.0) 2904 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:19:56.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:56 smithi050 bash[28929]: audit 2024-05-20T22:19:55.908276+0000 mon.a (mon.0) 2905 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:19:57.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:57 smithi145 bash[23893]: cluster 2024-05-20T22:19:56.406858+0000 mgr.y (mgr.14592) 529 : cluster 0 pgmap v810: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1023 B/s wr, 4 op/s 2024-05-20T22:19:57.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:57 smithi050 bash[21866]: cluster 2024-05-20T22:19:56.406858+0000 mgr.y (mgr.14592) 529 : cluster 0 pgmap v810: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1023 B/s wr, 4 op/s 2024-05-20T22:19:57.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:57 smithi050 bash[28929]: cluster 2024-05-20T22:19:56.406858+0000 mgr.y (mgr.14592) 529 : cluster 0 pgmap v810: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1023 B/s wr, 4 op/s 2024-05-20T22:19:58.640 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:19:58 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:19:59.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:19:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:19:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:19:59.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:59 smithi050 bash[21866]: audit 2024-05-20T22:19:58.156767+0000 mgr.y (mgr.14592) 530 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:19:59.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:19:59 smithi050 bash[21866]: cluster 2024-05-20T22:19:58.407826+0000 mgr.y (mgr.14592) 531 : cluster 0 pgmap v811: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 869 B/s wr, 3 op/s 2024-05-20T22:19:59.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:59 smithi050 bash[28929]: audit 2024-05-20T22:19:58.156767+0000 mgr.y (mgr.14592) 530 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:19:59.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:19:59 smithi050 bash[28929]: cluster 2024-05-20T22:19:58.407826+0000 mgr.y (mgr.14592) 531 : cluster 0 pgmap v811: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 869 B/s wr, 3 op/s 2024-05-20T22:19:59.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:59 smithi145 bash[23893]: audit 2024-05-20T22:19:58.156767+0000 mgr.y (mgr.14592) 530 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:19:59.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:19:59 smithi145 bash[23893]: cluster 2024-05-20T22:19:58.407826+0000 mgr.y (mgr.14592) 531 : cluster 0 pgmap v811: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 869 B/s wr, 3 op/s 2024-05-20T22:20:00.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:00 smithi145 bash[23893]: cluster 2024-05-20T22:20:00.000170+0000 mon.a (mon.0) 2906 : cluster 3 Health detail: HEALTH_WARN 6 pool(s) do not have an application enabled 2024-05-20T22:20:00.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:00 smithi145 bash[23893]: cluster 2024-05-20T22:20:00.000210+0000 mon.a (mon.0) 2907 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 6 pool(s) do not have an application enabled 2024-05-20T22:20:00.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:00 smithi145 bash[23893]: cluster 2024-05-20T22:20:00.000227+0000 mon.a (mon.0) 2908 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-05-20T22:20:00.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:00 smithi145 bash[23893]: cluster 2024-05-20T22:20:00.000240+0000 mon.a (mon.0) 2909 : cluster 3 application not enabled on pool 'SnapListsmithi050-64861-1' 2024-05-20T22:20:00.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:00 smithi145 bash[23893]: cluster 2024-05-20T22:20:00.000257+0000 mon.a (mon.0) 2910 : cluster 3 application not enabled on pool 'WatchNotifysmithi050-64898-1' 2024-05-20T22:20:00.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:00 smithi145 bash[23893]: cluster 2024-05-20T22:20:00.000273+0000 mon.a (mon.0) 2911 : cluster 3 application not enabled on pool 'AssertExistssmithi050-64913-1' 2024-05-20T22:20:00.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:00 smithi145 bash[23893]: cluster 2024-05-20T22:20:00.000289+0000 mon.a (mon.0) 2912 : cluster 3 application not enabled on pool 'poolrace.1804289383' 2024-05-20T22:20:00.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:00 smithi145 bash[23893]: cluster 2024-05-20T22:20:00.000309+0000 mon.a (mon.0) 2913 : cluster 3 application not enabled on pool 'poolrace2.846930886' 2024-05-20T22:20:00.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:00 smithi145 bash[23893]: cluster 2024-05-20T22:20:00.000328+0000 mon.a (mon.0) 2914 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-05-20T22:20:00.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:00 smithi050 bash[21866]: cluster 2024-05-20T22:20:00.000170+0000 mon.a (mon.0) 2906 : cluster 3 Health detail: HEALTH_WARN 6 pool(s) do not have an application enabled 2024-05-20T22:20:00.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:00 smithi050 bash[21866]: cluster 2024-05-20T22:20:00.000210+0000 mon.a (mon.0) 2907 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 6 pool(s) do not have an application enabled 2024-05-20T22:20:00.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:00 smithi050 bash[21866]: cluster 2024-05-20T22:20:00.000227+0000 mon.a (mon.0) 2908 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-05-20T22:20:00.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:00 smithi050 bash[21866]: cluster 2024-05-20T22:20:00.000240+0000 mon.a (mon.0) 2909 : cluster 3 application not enabled on pool 'SnapListsmithi050-64861-1' 2024-05-20T22:20:00.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:00 smithi050 bash[21866]: cluster 2024-05-20T22:20:00.000257+0000 mon.a (mon.0) 2910 : cluster 3 application not enabled on pool 'WatchNotifysmithi050-64898-1' 2024-05-20T22:20:00.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:00 smithi050 bash[21866]: cluster 2024-05-20T22:20:00.000273+0000 mon.a (mon.0) 2911 : cluster 3 application not enabled on pool 'AssertExistssmithi050-64913-1' 2024-05-20T22:20:00.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:00 smithi050 bash[21866]: cluster 2024-05-20T22:20:00.000289+0000 mon.a (mon.0) 2912 : cluster 3 application not enabled on pool 'poolrace.1804289383' 2024-05-20T22:20:00.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:00 smithi050 bash[21866]: cluster 2024-05-20T22:20:00.000309+0000 mon.a (mon.0) 2913 : cluster 3 application not enabled on pool 'poolrace2.846930886' 2024-05-20T22:20:00.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:00 smithi050 bash[21866]: cluster 2024-05-20T22:20:00.000328+0000 mon.a (mon.0) 2914 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-05-20T22:20:00.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:00 smithi050 bash[28929]: cluster 2024-05-20T22:20:00.000170+0000 mon.a (mon.0) 2906 : cluster 3 Health detail: HEALTH_WARN 6 pool(s) do not have an application enabled 2024-05-20T22:20:00.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:00 smithi050 bash[28929]: cluster 2024-05-20T22:20:00.000210+0000 mon.a (mon.0) 2907 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 6 pool(s) do not have an application enabled 2024-05-20T22:20:00.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:00 smithi050 bash[28929]: cluster 2024-05-20T22:20:00.000227+0000 mon.a (mon.0) 2908 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-05-20T22:20:00.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:00 smithi050 bash[28929]: cluster 2024-05-20T22:20:00.000240+0000 mon.a (mon.0) 2909 : cluster 3 application not enabled on pool 'SnapListsmithi050-64861-1' 2024-05-20T22:20:00.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:00 smithi050 bash[28929]: cluster 2024-05-20T22:20:00.000257+0000 mon.a (mon.0) 2910 : cluster 3 application not enabled on pool 'WatchNotifysmithi050-64898-1' 2024-05-20T22:20:00.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:00 smithi050 bash[28929]: cluster 2024-05-20T22:20:00.000273+0000 mon.a (mon.0) 2911 : cluster 3 application not enabled on pool 'AssertExistssmithi050-64913-1' 2024-05-20T22:20:00.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:00 smithi050 bash[28929]: cluster 2024-05-20T22:20:00.000289+0000 mon.a (mon.0) 2912 : cluster 3 application not enabled on pool 'poolrace.1804289383' 2024-05-20T22:20:00.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:00 smithi050 bash[28929]: cluster 2024-05-20T22:20:00.000309+0000 mon.a (mon.0) 2913 : cluster 3 application not enabled on pool 'poolrace2.846930886' 2024-05-20T22:20:00.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:00 smithi050 bash[28929]: cluster 2024-05-20T22:20:00.000328+0000 mon.a (mon.0) 2914 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-05-20T22:20:01.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:01 smithi145 bash[23893]: cluster 2024-05-20T22:20:00.411159+0000 mgr.y (mgr.14592) 532 : cluster 0 pgmap v812: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 786 B/s wr, 4 op/s 2024-05-20T22:20:01.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:01 smithi145 bash[23893]: cluster 2024-05-20T22:20:00.490401+0000 mon.a (mon.0) 2915 : cluster 0 osdmap e499: 8 total, 8 up, 8 in 2024-05-20T22:20:01.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:01 smithi050 bash[21866]: cluster 2024-05-20T22:20:00.411159+0000 mgr.y (mgr.14592) 532 : cluster 0 pgmap v812: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 786 B/s wr, 4 op/s 2024-05-20T22:20:01.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:01 smithi050 bash[21866]: cluster 2024-05-20T22:20:00.490401+0000 mon.a (mon.0) 2915 : cluster 0 osdmap e499: 8 total, 8 up, 8 in 2024-05-20T22:20:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:01 smithi050 bash[28929]: cluster 2024-05-20T22:20:00.411159+0000 mgr.y (mgr.14592) 532 : cluster 0 pgmap v812: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 786 B/s wr, 4 op/s 2024-05-20T22:20:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:01 smithi050 bash[28929]: cluster 2024-05-20T22:20:00.490401+0000 mon.a (mon.0) 2915 : cluster 0 osdmap e499: 8 total, 8 up, 8 in 2024-05-20T22:20:03.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:03 smithi145 bash[23893]: cluster 2024-05-20T22:20:02.412145+0000 mgr.y (mgr.14592) 533 : cluster 0 pgmap v814: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-20T22:20:03.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:03 smithi050 bash[21866]: cluster 2024-05-20T22:20:02.412145+0000 mgr.y (mgr.14592) 533 : cluster 0 pgmap v814: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-20T22:20:03.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:03 smithi050 bash[28929]: cluster 2024-05-20T22:20:02.412145+0000 mgr.y (mgr.14592) 533 : cluster 0 pgmap v814: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-20T22:20:05.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:05 smithi145 bash[23893]: cluster 2024-05-20T22:20:04.413094+0000 mgr.y (mgr.14592) 534 : cluster 0 pgmap v815: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-20T22:20:05.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:05 smithi050 bash[21866]: cluster 2024-05-20T22:20:04.413094+0000 mgr.y (mgr.14592) 534 : cluster 0 pgmap v815: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-20T22:20:05.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:05 smithi050 bash[28929]: cluster 2024-05-20T22:20:04.413094+0000 mgr.y (mgr.14592) 534 : cluster 0 pgmap v815: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-20T22:20:07.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:07 smithi145 bash[23893]: cluster 2024-05-20T22:20:06.416500+0000 mgr.y (mgr.14592) 535 : cluster 0 pgmap v816: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:20:07.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:07 smithi050 bash[21866]: cluster 2024-05-20T22:20:06.416500+0000 mgr.y (mgr.14592) 535 : cluster 0 pgmap v816: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:20:07.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:07 smithi050 bash[28929]: cluster 2024-05-20T22:20:06.416500+0000 mgr.y (mgr.14592) 535 : cluster 0 pgmap v816: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:20:08.502 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:20:08 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:20:08.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:08 smithi145 bash[23893]: audit 2024-05-20T22:20:08.175730+0000 mon.a (mon.0) 2916 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:20:08.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:08 smithi050 bash[21866]: audit 2024-05-20T22:20:08.175730+0000 mon.a (mon.0) 2916 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:20:08.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:08 smithi050 bash[28929]: audit 2024-05-20T22:20:08.175730+0000 mon.a (mon.0) 2916 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:20:09.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:20:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:20:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:20:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:09 smithi050 bash[21866]: audit 2024-05-20T22:20:08.168013+0000 mgr.y (mgr.14592) 536 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:20:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:09 smithi050 bash[21866]: cluster 2024-05-20T22:20:08.417433+0000 mgr.y (mgr.14592) 537 : cluster 0 pgmap v817: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:20:09.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:09 smithi050 bash[28929]: audit 2024-05-20T22:20:08.168013+0000 mgr.y (mgr.14592) 536 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:20:09.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:09 smithi050 bash[28929]: cluster 2024-05-20T22:20:08.417433+0000 mgr.y (mgr.14592) 537 : cluster 0 pgmap v817: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:20:09.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:09 smithi145 bash[23893]: audit 2024-05-20T22:20:08.168013+0000 mgr.y (mgr.14592) 536 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:20:09.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:09 smithi145 bash[23893]: cluster 2024-05-20T22:20:08.417433+0000 mgr.y (mgr.14592) 537 : cluster 0 pgmap v817: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:20:11.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:11 smithi145 bash[23893]: cluster 2024-05-20T22:20:10.351205+0000 mon.a (mon.0) 2917 : cluster 0 osdmap e500: 8 total, 8 up, 8 in 2024-05-20T22:20:11.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:11 smithi145 bash[23893]: cluster 2024-05-20T22:20:10.418434+0000 mgr.y (mgr.14592) 538 : cluster 0 pgmap v819: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:20:11.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:11 smithi145 bash[23893]: audit 2024-05-20T22:20:10.576282+0000 mon.a (mon.0) 2918 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:20:11.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:11 smithi145 bash[23893]: audit 2024-05-20T22:20:10.577143+0000 mon.a (mon.0) 2919 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-94"}]: dispatch 2024-05-20T22:20:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:11 smithi050 bash[21866]: cluster 2024-05-20T22:20:10.351205+0000 mon.a (mon.0) 2917 : cluster 0 osdmap e500: 8 total, 8 up, 8 in 2024-05-20T22:20:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:11 smithi050 bash[21866]: cluster 2024-05-20T22:20:10.418434+0000 mgr.y (mgr.14592) 538 : cluster 0 pgmap v819: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:20:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:11 smithi050 bash[21866]: audit 2024-05-20T22:20:10.576282+0000 mon.a (mon.0) 2918 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:20:11.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:11 smithi050 bash[21866]: audit 2024-05-20T22:20:10.577143+0000 mon.a (mon.0) 2919 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-94"}]: dispatch 2024-05-20T22:20:11.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:11 smithi050 bash[28929]: cluster 2024-05-20T22:20:10.351205+0000 mon.a (mon.0) 2917 : cluster 0 osdmap e500: 8 total, 8 up, 8 in 2024-05-20T22:20:11.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:11 smithi050 bash[28929]: cluster 2024-05-20T22:20:10.418434+0000 mgr.y (mgr.14592) 538 : cluster 0 pgmap v819: 388 pgs: 388 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:20:11.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:11 smithi050 bash[28929]: audit 2024-05-20T22:20:10.576282+0000 mon.a (mon.0) 2918 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:20:11.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:11 smithi050 bash[28929]: audit 2024-05-20T22:20:10.577143+0000 mon.a (mon.0) 2919 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-94"}]: dispatch 2024-05-20T22:20:12.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:12 smithi145 bash[23893]: cluster 2024-05-20T22:20:11.361885+0000 mon.a (mon.0) 2920 : cluster 0 osdmap e501: 8 total, 8 up, 8 in 2024-05-20T22:20:12.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:12 smithi050 bash[21866]: cluster 2024-05-20T22:20:11.361885+0000 mon.a (mon.0) 2920 : cluster 0 osdmap e501: 8 total, 8 up, 8 in 2024-05-20T22:20:12.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:12 smithi050 bash[28929]: cluster 2024-05-20T22:20:11.361885+0000 mon.a (mon.0) 2920 : cluster 0 osdmap e501: 8 total, 8 up, 8 in 2024-05-20T22:20:13.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:13 smithi050 bash[21866]: cluster 2024-05-20T22:20:12.367588+0000 mon.a (mon.0) 2921 : cluster 0 osdmap e502: 8 total, 8 up, 8 in 2024-05-20T22:20:13.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:13 smithi050 bash[21866]: audit 2024-05-20T22:20:12.377090+0000 mon.a (mon.0) 2922 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:20:13.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:13 smithi050 bash[21866]: cluster 2024-05-20T22:20:12.419446+0000 mgr.y (mgr.14592) 539 : cluster 0 pgmap v822: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:20:13.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:13 smithi050 bash[21866]: audit 2024-05-20T22:20:13.360480+0000 mon.a (mon.0) 2923 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:20:13.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:13 smithi050 bash[21866]: cluster 2024-05-20T22:20:13.368447+0000 mon.a (mon.0) 2924 : cluster 0 osdmap e503: 8 total, 8 up, 8 in 2024-05-20T22:20:13.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:13 smithi050 bash[28929]: cluster 2024-05-20T22:20:12.367588+0000 mon.a (mon.0) 2921 : cluster 0 osdmap e502: 8 total, 8 up, 8 in 2024-05-20T22:20:13.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:13 smithi050 bash[28929]: audit 2024-05-20T22:20:12.377090+0000 mon.a (mon.0) 2922 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:20:13.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:13 smithi050 bash[28929]: cluster 2024-05-20T22:20:12.419446+0000 mgr.y (mgr.14592) 539 : cluster 0 pgmap v822: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:20:13.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:13 smithi050 bash[28929]: audit 2024-05-20T22:20:13.360480+0000 mon.a (mon.0) 2923 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:20:13.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:13 smithi050 bash[28929]: cluster 2024-05-20T22:20:13.368447+0000 mon.a (mon.0) 2924 : cluster 0 osdmap e503: 8 total, 8 up, 8 in 2024-05-20T22:20:13.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:13 smithi145 bash[23893]: cluster 2024-05-20T22:20:12.367588+0000 mon.a (mon.0) 2921 : cluster 0 osdmap e502: 8 total, 8 up, 8 in 2024-05-20T22:20:13.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:13 smithi145 bash[23893]: audit 2024-05-20T22:20:12.377090+0000 mon.a (mon.0) 2922 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:20:13.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:13 smithi145 bash[23893]: cluster 2024-05-20T22:20:12.419446+0000 mgr.y (mgr.14592) 539 : cluster 0 pgmap v822: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:20:13.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:13 smithi145 bash[23893]: audit 2024-05-20T22:20:13.360480+0000 mon.a (mon.0) 2923 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:20:13.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:13 smithi145 bash[23893]: cluster 2024-05-20T22:20:13.368447+0000 mon.a (mon.0) 2924 : cluster 0 osdmap e503: 8 total, 8 up, 8 in 2024-05-20T22:20:14.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:14 smithi050 bash[21866]: audit 2024-05-20T22:20:13.375218+0000 mon.a (mon.0) 2925 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:20:14.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:14 smithi050 bash[21866]: cluster 2024-05-20T22:20:13.395605+0000 mon.a (mon.0) 2926 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:20:14.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:14 smithi050 bash[21866]: cluster 2024-05-20T22:20:14.380161+0000 mon.a (mon.0) 2927 : cluster 0 osdmap e504: 8 total, 8 up, 8 in 2024-05-20T22:20:14.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:14 smithi050 bash[28929]: audit 2024-05-20T22:20:13.375218+0000 mon.a (mon.0) 2925 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:20:14.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:14 smithi050 bash[28929]: cluster 2024-05-20T22:20:13.395605+0000 mon.a (mon.0) 2926 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:20:14.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:14 smithi050 bash[28929]: cluster 2024-05-20T22:20:14.380161+0000 mon.a (mon.0) 2927 : cluster 0 osdmap e504: 8 total, 8 up, 8 in 2024-05-20T22:20:14.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:14 smithi145 bash[23893]: audit 2024-05-20T22:20:13.375218+0000 mon.a (mon.0) 2925 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:20:14.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:14 smithi145 bash[23893]: cluster 2024-05-20T22:20:13.395605+0000 mon.a (mon.0) 2926 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:20:14.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:14 smithi145 bash[23893]: cluster 2024-05-20T22:20:14.380161+0000 mon.a (mon.0) 2927 : cluster 0 osdmap e504: 8 total, 8 up, 8 in 2024-05-20T22:20:15.155 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887ab80 2024-05-20T22:20:15.155 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887ad20 2024-05-20T22:20:15.155 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887a070 2024-05-20T22:20:15.156 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887a1a0 2024-05-20T22:20:15.156 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887a2d0 2024-05-20T22:20:15.156 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887ae50 2024-05-20T22:20:15.156 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887b320 2024-05-20T22:20:15.156 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887b470 2024-05-20T22:20:15.156 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887a7e0 2024-05-20T22:20:15.156 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887a910 2024-05-20T22:20:15.156 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887aa40 2024-05-20T22:20:15.156 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887b5a0 2024-05-20T22:20:15.156 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887ba70 2024-05-20T22:20:15.156 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887bbc0 2024-05-20T22:20:15.156 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887af80 2024-05-20T22:20:15.156 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887b0b0 2024-05-20T22:20:15.157 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887b1e0 2024-05-20T22:20:15.157 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887bcf0 2024-05-20T22:20:15.157 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887c1c0 2024-05-20T22:20:15.157 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887c2f0 2024-05-20T22:20:15.157 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887b6b0 2024-05-20T22:20:15.157 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887b7e0 2024-05-20T22:20:15.157 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887b910 2024-05-20T22:20:15.157 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887c440 2024-05-20T22:20:15.157 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887c910 2024-05-20T22:20:15.157 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887ca40 2024-05-20T22:20:15.157 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887d040 2024-05-20T22:20:15.157 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887c570 2024-05-20T22:20:15.157 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887c6a0 2024-05-20T22:20:15.157 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887c7d0 2024-05-20T22:20:15.158 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887d150 2024-05-20T22:20:15.158 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887cb90 2024-05-20T22:20:15.158 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887ccc0 2024-05-20T22:20:15.158 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887ce10 2024-05-20T22:20:15.158 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887d2a0 2024-05-20T22:20:15.158 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887d770 2024-05-20T22:20:15.158 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887d8a0 2024-05-20T22:20:15.158 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887cf20 2024-05-20T22:20:15.158 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887d9d0 2024-05-20T22:20:15.158 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887db20 2024-05-20T22:20:15.158 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887d3d0 2024-05-20T22:20:15.158 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887d500 2024-05-20T22:20:15.158 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887d630 2024-05-20T22:20:15.159 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887dc70 2024-05-20T22:20:15.159 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887e160 2024-05-20T22:20:15.159 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887e290 2024-05-20T22:20:15.159 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887be00 2024-05-20T22:20:15.159 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887bf30 2024-05-20T22:20:15.159 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887c060 2024-05-20T22:20:15.159 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887e3c0 2024-05-20T22:20:15.159 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x55740887e8b0 2024-05-20T22:20:15.159 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.159 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.159 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.159 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.159 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.159 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.160 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.160 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.160 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.160 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.160 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.160 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.160 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.160 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.160 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.160 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.160 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.160 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.160 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.160 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.160 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.161 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.161 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.161 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.161 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.161 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.161 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.161 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.161 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.161 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.161 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.161 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.161 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.161 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.161 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.161 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.162 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.162 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:20:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:15 smithi050 bash[21866]: cluster 2024-05-20T22:20:14.420731+0000 mgr.y (mgr.14592) 540 : cluster 0 pgmap v825: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:20:15.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:15 smithi050 bash[28929]: cluster 2024-05-20T22:20:14.420731+0000 mgr.y (mgr.14592) 540 : cluster 0 pgmap v825: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:20:15.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:15 smithi145 bash[23893]: cluster 2024-05-20T22:20:14.420731+0000 mgr.y (mgr.14592) 540 : cluster 0 pgmap v825: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:20:17.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:17 smithi050 bash[21866]: cluster 2024-05-20T22:20:16.424160+0000 mgr.y (mgr.14592) 541 : cluster 0 pgmap v826: 388 pgs: 388 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1010 B/s rd, 1.2 KiB/s wr, 3 op/s 2024-05-20T22:20:17.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:17 smithi050 bash[28929]: cluster 2024-05-20T22:20:16.424160+0000 mgr.y (mgr.14592) 541 : cluster 0 pgmap v826: 388 pgs: 388 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1010 B/s rd, 1.2 KiB/s wr, 3 op/s 2024-05-20T22:20:17.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:17 smithi145 bash[23893]: cluster 2024-05-20T22:20:16.424160+0000 mgr.y (mgr.14592) 541 : cluster 0 pgmap v826: 388 pgs: 388 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1010 B/s rd, 1.2 KiB/s wr, 3 op/s 2024-05-20T22:20:18.640 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:20:18 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:20:19.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:20:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:20:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:20:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:19 smithi050 bash[28929]: audit 2024-05-20T22:20:18.179223+0000 mgr.y (mgr.14592) 542 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:20:19.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:19 smithi050 bash[28929]: cluster 2024-05-20T22:20:18.425254+0000 mgr.y (mgr.14592) 543 : cluster 0 pgmap v827: 388 pgs: 388 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 844 B/s rd, 1012 B/s wr, 2 op/s 2024-05-20T22:20:19.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:19 smithi050 bash[21866]: audit 2024-05-20T22:20:18.179223+0000 mgr.y (mgr.14592) 542 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:20:19.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:19 smithi050 bash[21866]: cluster 2024-05-20T22:20:18.425254+0000 mgr.y (mgr.14592) 543 : cluster 0 pgmap v827: 388 pgs: 388 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 844 B/s rd, 1012 B/s wr, 2 op/s 2024-05-20T22:20:19.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:19 smithi145 bash[23893]: audit 2024-05-20T22:20:18.179223+0000 mgr.y (mgr.14592) 542 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:20:19.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:19 smithi145 bash[23893]: cluster 2024-05-20T22:20:18.425254+0000 mgr.y (mgr.14592) 543 : cluster 0 pgmap v827: 388 pgs: 388 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 844 B/s rd, 1012 B/s wr, 2 op/s 2024-05-20T22:20:20.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:20 smithi145 bash[23893]: cluster 2024-05-20T22:20:20.348671+0000 mon.a (mon.0) 2928 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:20:20.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:20 smithi050 bash[21866]: cluster 2024-05-20T22:20:20.348671+0000 mon.a (mon.0) 2928 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:20:20.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:20 smithi050 bash[28929]: cluster 2024-05-20T22:20:20.348671+0000 mon.a (mon.0) 2928 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:20:21.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:21 smithi145 bash[23893]: cluster 2024-05-20T22:20:20.428674+0000 mgr.y (mgr.14592) 544 : cluster 0 pgmap v828: 388 pgs: 388 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:20:21.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:21 smithi050 bash[21866]: cluster 2024-05-20T22:20:20.428674+0000 mgr.y (mgr.14592) 544 : cluster 0 pgmap v828: 388 pgs: 388 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:20:21.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:21 smithi050 bash[28929]: cluster 2024-05-20T22:20:20.428674+0000 mgr.y (mgr.14592) 544 : cluster 0 pgmap v828: 388 pgs: 388 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-05-20T22:20:23.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:23 smithi145 bash[23893]: cluster 2024-05-20T22:20:22.429818+0000 mgr.y (mgr.14592) 545 : cluster 0 pgmap v829: 388 pgs: 388 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 677 B/s wr, 2 op/s 2024-05-20T22:20:23.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:23 smithi145 bash[23893]: audit 2024-05-20T22:20:23.209634+0000 mon.a (mon.0) 2929 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:20:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:23 smithi050 bash[21866]: cluster 2024-05-20T22:20:22.429818+0000 mgr.y (mgr.14592) 545 : cluster 0 pgmap v829: 388 pgs: 388 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 677 B/s wr, 2 op/s 2024-05-20T22:20:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:23 smithi050 bash[21866]: audit 2024-05-20T22:20:23.209634+0000 mon.a (mon.0) 2929 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:20:23.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:23 smithi050 bash[28929]: cluster 2024-05-20T22:20:22.429818+0000 mgr.y (mgr.14592) 545 : cluster 0 pgmap v829: 388 pgs: 388 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 677 B/s wr, 2 op/s 2024-05-20T22:20:23.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:23 smithi050 bash[28929]: audit 2024-05-20T22:20:23.209634+0000 mon.a (mon.0) 2929 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:20:24.694 INFO:journalctl@ceph.osd.2.smithi050.stdout:May 20 22:20:24 smithi050 bash[43014]: debug 2024-05-20T22:20:24.443+0000 7f17f265f640 -1 snap_mapper.add_oid found existing snaps mapped on 94:dd4fb8c1:test-rados-api-smithi050-64110-97::foo:21, removing 2024-05-20T22:20:24.890 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:20:24 smithi145 bash[27334]: debug 2024-05-20T22:20:24.443+0000 7f490048c640 -1 snap_mapper.add_oid found existing snaps mapped on 94:dd4fb8c1:test-rados-api-smithi050-64110-97::foo:21, removing 2024-05-20T22:20:24.890 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:20:24 smithi145 bash[38546]: debug 2024-05-20T22:20:24.443+0000 7f048d721640 -1 snap_mapper.add_oid found existing snaps mapped on 94:dd4fb8c1:test-rados-api-smithi050-64110-97::foo:21, removing 2024-05-20T22:20:26.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:25 smithi145 bash[23893]: cluster 2024-05-20T22:20:24.430943+0000 mgr.y (mgr.14592) 546 : cluster 0 pgmap v830: 388 pgs: 388 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1017 B/s rd, 610 B/s wr, 2 op/s 2024-05-20T22:20:26.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:25 smithi145 bash[23893]: audit 2024-05-20T22:20:24.484130+0000 mon.a (mon.0) 2930 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:20:26.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:25 smithi145 bash[23893]: audit 2024-05-20T22:20:24.485041+0000 mon.a (mon.0) 2931 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-96"}]: dispatch 2024-05-20T22:20:26.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:25 smithi050 bash[28929]: cluster 2024-05-20T22:20:24.430943+0000 mgr.y (mgr.14592) 546 : cluster 0 pgmap v830: 388 pgs: 388 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1017 B/s rd, 610 B/s wr, 2 op/s 2024-05-20T22:20:26.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:25 smithi050 bash[28929]: audit 2024-05-20T22:20:24.484130+0000 mon.a (mon.0) 2930 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:20:26.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:25 smithi050 bash[28929]: audit 2024-05-20T22:20:24.485041+0000 mon.a (mon.0) 2931 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-96"}]: dispatch 2024-05-20T22:20:26.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:25 smithi050 bash[21866]: cluster 2024-05-20T22:20:24.430943+0000 mgr.y (mgr.14592) 546 : cluster 0 pgmap v830: 388 pgs: 388 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1017 B/s rd, 610 B/s wr, 2 op/s 2024-05-20T22:20:26.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:25 smithi050 bash[21866]: audit 2024-05-20T22:20:24.484130+0000 mon.a (mon.0) 2930 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:20:26.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:25 smithi050 bash[21866]: audit 2024-05-20T22:20:24.485041+0000 mon.a (mon.0) 2931 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-96"}]: dispatch 2024-05-20T22:20:27.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:26 smithi145 bash[23893]: cluster 2024-05-20T22:20:25.472590+0000 mon.a (mon.0) 2932 : cluster 0 osdmap e505: 8 total, 8 up, 8 in 2024-05-20T22:20:27.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:26 smithi145 bash[23893]: cluster 2024-05-20T22:20:26.431969+0000 mgr.y (mgr.14592) 547 : cluster 0 pgmap v832: 356 pgs: 356 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-05-20T22:20:27.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:26 smithi145 bash[23893]: cluster 2024-05-20T22:20:26.475130+0000 mon.a (mon.0) 2933 : cluster 0 osdmap e506: 8 total, 8 up, 8 in 2024-05-20T22:20:27.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:26 smithi145 bash[23893]: audit 2024-05-20T22:20:26.488909+0000 mon.a (mon.0) 2934 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:20:27.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:26 smithi050 bash[21866]: cluster 2024-05-20T22:20:25.472590+0000 mon.a (mon.0) 2932 : cluster 0 osdmap e505: 8 total, 8 up, 8 in 2024-05-20T22:20:27.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:26 smithi050 bash[21866]: cluster 2024-05-20T22:20:26.431969+0000 mgr.y (mgr.14592) 547 : cluster 0 pgmap v832: 356 pgs: 356 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-05-20T22:20:27.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:26 smithi050 bash[21866]: cluster 2024-05-20T22:20:26.475130+0000 mon.a (mon.0) 2933 : cluster 0 osdmap e506: 8 total, 8 up, 8 in 2024-05-20T22:20:27.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:26 smithi050 bash[21866]: audit 2024-05-20T22:20:26.488909+0000 mon.a (mon.0) 2934 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:20:27.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:26 smithi050 bash[28929]: cluster 2024-05-20T22:20:25.472590+0000 mon.a (mon.0) 2932 : cluster 0 osdmap e505: 8 total, 8 up, 8 in 2024-05-20T22:20:27.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:26 smithi050 bash[28929]: cluster 2024-05-20T22:20:26.431969+0000 mgr.y (mgr.14592) 547 : cluster 0 pgmap v832: 356 pgs: 356 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-05-20T22:20:27.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:26 smithi050 bash[28929]: cluster 2024-05-20T22:20:26.475130+0000 mon.a (mon.0) 2933 : cluster 0 osdmap e506: 8 total, 8 up, 8 in 2024-05-20T22:20:27.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:26 smithi050 bash[28929]: audit 2024-05-20T22:20:26.488909+0000 mon.a (mon.0) 2934 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:20:28.480 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:20:28 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:20:28.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:28 smithi145 bash[23893]: audit 2024-05-20T22:20:27.470698+0000 mon.a (mon.0) 2935 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:20:28.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:28 smithi145 bash[23893]: cluster 2024-05-20T22:20:27.478604+0000 mon.a (mon.0) 2936 : cluster 0 osdmap e507: 8 total, 8 up, 8 in 2024-05-20T22:20:28.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:28 smithi145 bash[23893]: audit 2024-05-20T22:20:27.520984+0000 mon.a (mon.0) 2937 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:20:28.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:28 smithi050 bash[21866]: audit 2024-05-20T22:20:27.470698+0000 mon.a (mon.0) 2935 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:20:28.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:28 smithi050 bash[21866]: cluster 2024-05-20T22:20:27.478604+0000 mon.a (mon.0) 2936 : cluster 0 osdmap e507: 8 total, 8 up, 8 in 2024-05-20T22:20:28.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:28 smithi050 bash[21866]: audit 2024-05-20T22:20:27.520984+0000 mon.a (mon.0) 2937 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:20:28.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:28 smithi050 bash[28929]: audit 2024-05-20T22:20:27.470698+0000 mon.a (mon.0) 2935 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:20:28.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:28 smithi050 bash[28929]: cluster 2024-05-20T22:20:27.478604+0000 mon.a (mon.0) 2936 : cluster 0 osdmap e507: 8 total, 8 up, 8 in 2024-05-20T22:20:28.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:28 smithi050 bash[28929]: audit 2024-05-20T22:20:27.520984+0000 mon.a (mon.0) 2937 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:20:29.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:20:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:20:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:20:29.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:29 smithi050 bash[21866]: audit 2024-05-20T22:20:28.190530+0000 mgr.y (mgr.14592) 548 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:20:29.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:29 smithi050 bash[21866]: cluster 2024-05-20T22:20:28.433103+0000 mgr.y (mgr.14592) 549 : cluster 0 pgmap v835: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:20:29.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:29 smithi050 bash[21866]: audit 2024-05-20T22:20:28.481297+0000 mon.a (mon.0) 2938 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-98", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:20:29.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:29 smithi050 bash[21866]: cluster 2024-05-20T22:20:28.490951+0000 mon.a (mon.0) 2939 : cluster 0 osdmap e508: 8 total, 8 up, 8 in 2024-05-20T22:20:29.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:29 smithi050 bash[21866]: audit 2024-05-20T22:20:28.494439+0000 mon.a (mon.0) 2940 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-98", "mode": "writeback"}]: dispatch 2024-05-20T22:20:29.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:29 smithi050 bash[28929]: audit 2024-05-20T22:20:28.190530+0000 mgr.y (mgr.14592) 548 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:20:29.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:29 smithi050 bash[28929]: cluster 2024-05-20T22:20:28.433103+0000 mgr.y (mgr.14592) 549 : cluster 0 pgmap v835: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:20:29.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:29 smithi050 bash[28929]: audit 2024-05-20T22:20:28.481297+0000 mon.a (mon.0) 2938 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-98", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:20:29.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:29 smithi050 bash[28929]: cluster 2024-05-20T22:20:28.490951+0000 mon.a (mon.0) 2939 : cluster 0 osdmap e508: 8 total, 8 up, 8 in 2024-05-20T22:20:29.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:29 smithi050 bash[28929]: audit 2024-05-20T22:20:28.494439+0000 mon.a (mon.0) 2940 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-98", "mode": "writeback"}]: dispatch 2024-05-20T22:20:29.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:29 smithi145 bash[23893]: audit 2024-05-20T22:20:28.190530+0000 mgr.y (mgr.14592) 548 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:20:29.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:29 smithi145 bash[23893]: cluster 2024-05-20T22:20:28.433103+0000 mgr.y (mgr.14592) 549 : cluster 0 pgmap v835: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:20:29.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:29 smithi145 bash[23893]: audit 2024-05-20T22:20:28.481297+0000 mon.a (mon.0) 2938 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-98", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:20:29.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:29 smithi145 bash[23893]: cluster 2024-05-20T22:20:28.490951+0000 mon.a (mon.0) 2939 : cluster 0 osdmap e508: 8 total, 8 up, 8 in 2024-05-20T22:20:29.891 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:29 smithi145 bash[23893]: audit 2024-05-20T22:20:28.494439+0000 mon.a (mon.0) 2940 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-98", "mode": "writeback"}]: dispatch 2024-05-20T22:20:30.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:30 smithi145 bash[23893]: cluster 2024-05-20T22:20:29.481669+0000 mon.a (mon.0) 2941 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:20:30.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:30 smithi145 bash[23893]: audit 2024-05-20T22:20:29.483909+0000 mon.a (mon.0) 2942 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-98", "mode": "writeback"}]': finished 2024-05-20T22:20:30.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:30 smithi145 bash[23893]: cluster 2024-05-20T22:20:29.492142+0000 mon.a (mon.0) 2943 : cluster 0 osdmap e509: 8 total, 8 up, 8 in 2024-05-20T22:20:30.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:30 smithi145 bash[23893]: audit 2024-05-20T22:20:29.497883+0000 mon.a (mon.0) 2944 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-98"}]: dispatch 2024-05-20T22:20:30.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:30 smithi145 bash[23893]: audit 2024-05-20T22:20:30.486455+0000 mon.a (mon.0) 2945 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-98"}]': finished 2024-05-20T22:20:30.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:30 smithi050 bash[21866]: cluster 2024-05-20T22:20:29.481669+0000 mon.a (mon.0) 2941 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:20:30.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:30 smithi050 bash[21866]: audit 2024-05-20T22:20:29.483909+0000 mon.a (mon.0) 2942 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-98", "mode": "writeback"}]': finished 2024-05-20T22:20:30.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:30 smithi050 bash[21866]: cluster 2024-05-20T22:20:29.492142+0000 mon.a (mon.0) 2943 : cluster 0 osdmap e509: 8 total, 8 up, 8 in 2024-05-20T22:20:30.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:30 smithi050 bash[21866]: audit 2024-05-20T22:20:29.497883+0000 mon.a (mon.0) 2944 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-98"}]: dispatch 2024-05-20T22:20:30.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:30 smithi050 bash[21866]: audit 2024-05-20T22:20:30.486455+0000 mon.a (mon.0) 2945 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-98"}]': finished 2024-05-20T22:20:30.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:30 smithi050 bash[28929]: cluster 2024-05-20T22:20:29.481669+0000 mon.a (mon.0) 2941 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:20:30.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:30 smithi050 bash[28929]: audit 2024-05-20T22:20:29.483909+0000 mon.a (mon.0) 2942 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-98", "mode": "writeback"}]': finished 2024-05-20T22:20:30.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:30 smithi050 bash[28929]: cluster 2024-05-20T22:20:29.492142+0000 mon.a (mon.0) 2943 : cluster 0 osdmap e509: 8 total, 8 up, 8 in 2024-05-20T22:20:30.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:30 smithi050 bash[28929]: audit 2024-05-20T22:20:29.497883+0000 mon.a (mon.0) 2944 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-98"}]: dispatch 2024-05-20T22:20:30.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:30 smithi050 bash[28929]: audit 2024-05-20T22:20:30.486455+0000 mon.a (mon.0) 2945 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-98"}]': finished 2024-05-20T22:20:31.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:31 smithi145 bash[23893]: cluster 2024-05-20T22:20:30.436325+0000 mgr.y (mgr.14592) 550 : cluster 0 pgmap v838: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:20:31.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:31 smithi145 bash[23893]: cluster 2024-05-20T22:20:30.493160+0000 mon.a (mon.0) 2946 : cluster 0 osdmap e510: 8 total, 8 up, 8 in 2024-05-20T22:20:31.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:31 smithi145 bash[23893]: audit 2024-05-20T22:20:30.503618+0000 mon.a (mon.0) 2947 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:20:31.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:31 smithi145 bash[23893]: cluster 2024-05-20T22:20:31.486900+0000 mon.a (mon.0) 2948 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:20:31.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:31 smithi145 bash[23893]: audit 2024-05-20T22:20:31.489284+0000 mon.a (mon.0) 2949 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:20:31.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:31 smithi145 bash[23893]: cluster 2024-05-20T22:20:31.497173+0000 mon.a (mon.0) 2950 : cluster 0 osdmap e511: 8 total, 8 up, 8 in 2024-05-20T22:20:31.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:31 smithi145 bash[23893]: audit 2024-05-20T22:20:31.499621+0000 mon.a (mon.0) 2951 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "hit_set_count","val": "1"}]: dispatch 2024-05-20T22:20:31.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:31 smithi050 bash[21866]: cluster 2024-05-20T22:20:30.436325+0000 mgr.y (mgr.14592) 550 : cluster 0 pgmap v838: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:20:31.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:31 smithi050 bash[21866]: cluster 2024-05-20T22:20:30.493160+0000 mon.a (mon.0) 2946 : cluster 0 osdmap e510: 8 total, 8 up, 8 in 2024-05-20T22:20:31.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:31 smithi050 bash[21866]: audit 2024-05-20T22:20:30.503618+0000 mon.a (mon.0) 2947 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:20:31.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:31 smithi050 bash[21866]: cluster 2024-05-20T22:20:31.486900+0000 mon.a (mon.0) 2948 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:20:31.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:31 smithi050 bash[21866]: audit 2024-05-20T22:20:31.489284+0000 mon.a (mon.0) 2949 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:20:31.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:31 smithi050 bash[21866]: cluster 2024-05-20T22:20:31.497173+0000 mon.a (mon.0) 2950 : cluster 0 osdmap e511: 8 total, 8 up, 8 in 2024-05-20T22:20:31.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:31 smithi050 bash[21866]: audit 2024-05-20T22:20:31.499621+0000 mon.a (mon.0) 2951 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "hit_set_count","val": "1"}]: dispatch 2024-05-20T22:20:31.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:31 smithi050 bash[28929]: cluster 2024-05-20T22:20:30.436325+0000 mgr.y (mgr.14592) 550 : cluster 0 pgmap v838: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:20:31.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:31 smithi050 bash[28929]: cluster 2024-05-20T22:20:30.493160+0000 mon.a (mon.0) 2946 : cluster 0 osdmap e510: 8 total, 8 up, 8 in 2024-05-20T22:20:31.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:31 smithi050 bash[28929]: audit 2024-05-20T22:20:30.503618+0000 mon.a (mon.0) 2947 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:20:31.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:31 smithi050 bash[28929]: cluster 2024-05-20T22:20:31.486900+0000 mon.a (mon.0) 2948 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:20:31.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:31 smithi050 bash[28929]: audit 2024-05-20T22:20:31.489284+0000 mon.a (mon.0) 2949 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:20:31.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:31 smithi050 bash[28929]: cluster 2024-05-20T22:20:31.497173+0000 mon.a (mon.0) 2950 : cluster 0 osdmap e511: 8 total, 8 up, 8 in 2024-05-20T22:20:31.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:31 smithi050 bash[28929]: audit 2024-05-20T22:20:31.499621+0000 mon.a (mon.0) 2951 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "hit_set_count","val": "1"}]: dispatch 2024-05-20T22:20:33.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:33 smithi145 bash[23893]: cluster 2024-05-20T22:20:32.437305+0000 mgr.y (mgr.14592) 551 : cluster 0 pgmap v841: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:20:33.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:33 smithi145 bash[23893]: audit 2024-05-20T22:20:32.492042+0000 mon.a (mon.0) 2952 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "hit_set_count","val": "1"}]': finished 2024-05-20T22:20:33.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:33 smithi145 bash[23893]: cluster 2024-05-20T22:20:32.499597+0000 mon.a (mon.0) 2953 : cluster 0 osdmap e512: 8 total, 8 up, 8 in 2024-05-20T22:20:33.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:33 smithi145 bash[23893]: audit 2024-05-20T22:20:32.504496+0000 mon.a (mon.0) 2954 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:20:33.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:33 smithi050 bash[21866]: cluster 2024-05-20T22:20:32.437305+0000 mgr.y (mgr.14592) 551 : cluster 0 pgmap v841: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:20:33.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:33 smithi050 bash[21866]: audit 2024-05-20T22:20:32.492042+0000 mon.a (mon.0) 2952 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "hit_set_count","val": "1"}]': finished 2024-05-20T22:20:33.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:33 smithi050 bash[21866]: cluster 2024-05-20T22:20:32.499597+0000 mon.a (mon.0) 2953 : cluster 0 osdmap e512: 8 total, 8 up, 8 in 2024-05-20T22:20:33.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:33 smithi050 bash[21866]: audit 2024-05-20T22:20:32.504496+0000 mon.a (mon.0) 2954 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:20:33.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:33 smithi050 bash[28929]: cluster 2024-05-20T22:20:32.437305+0000 mgr.y (mgr.14592) 551 : cluster 0 pgmap v841: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:20:33.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:33 smithi050 bash[28929]: audit 2024-05-20T22:20:32.492042+0000 mon.a (mon.0) 2952 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "hit_set_count","val": "1"}]': finished 2024-05-20T22:20:33.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:33 smithi050 bash[28929]: cluster 2024-05-20T22:20:32.499597+0000 mon.a (mon.0) 2953 : cluster 0 osdmap e512: 8 total, 8 up, 8 in 2024-05-20T22:20:33.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:33 smithi050 bash[28929]: audit 2024-05-20T22:20:32.504496+0000 mon.a (mon.0) 2954 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:20:34.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:34 smithi145 bash[23893]: audit 2024-05-20T22:20:33.494722+0000 mon.a (mon.0) 2955 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:20:34.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:34 smithi145 bash[23893]: cluster 2024-05-20T22:20:33.502869+0000 mon.a (mon.0) 2956 : cluster 0 osdmap e513: 8 total, 8 up, 8 in 2024-05-20T22:20:34.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:34 smithi145 bash[23893]: audit 2024-05-20T22:20:33.505309+0000 mon.a (mon.0) 2957 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "target_max_objects","val": "250"}]: dispatch 2024-05-20T22:20:34.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:34 smithi145 bash[23893]: audit 2024-05-20T22:20:34.497630+0000 mon.a (mon.0) 2958 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "target_max_objects","val": "250"}]': finished 2024-05-20T22:20:34.893 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:34 smithi145 bash[23893]: cluster 2024-05-20T22:20:34.505018+0000 mon.a (mon.0) 2959 : cluster 0 osdmap e514: 8 total, 8 up, 8 in 2024-05-20T22:20:34.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:34 smithi050 bash[21866]: audit 2024-05-20T22:20:33.494722+0000 mon.a (mon.0) 2955 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:20:34.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:34 smithi050 bash[21866]: cluster 2024-05-20T22:20:33.502869+0000 mon.a (mon.0) 2956 : cluster 0 osdmap e513: 8 total, 8 up, 8 in 2024-05-20T22:20:34.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:34 smithi050 bash[21866]: audit 2024-05-20T22:20:33.505309+0000 mon.a (mon.0) 2957 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "target_max_objects","val": "250"}]: dispatch 2024-05-20T22:20:34.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:34 smithi050 bash[21866]: audit 2024-05-20T22:20:34.497630+0000 mon.a (mon.0) 2958 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "target_max_objects","val": "250"}]': finished 2024-05-20T22:20:34.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:34 smithi050 bash[21866]: cluster 2024-05-20T22:20:34.505018+0000 mon.a (mon.0) 2959 : cluster 0 osdmap e514: 8 total, 8 up, 8 in 2024-05-20T22:20:34.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:34 smithi050 bash[28929]: audit 2024-05-20T22:20:33.494722+0000 mon.a (mon.0) 2955 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:20:34.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:34 smithi050 bash[28929]: cluster 2024-05-20T22:20:33.502869+0000 mon.a (mon.0) 2956 : cluster 0 osdmap e513: 8 total, 8 up, 8 in 2024-05-20T22:20:34.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:34 smithi050 bash[28929]: audit 2024-05-20T22:20:33.505309+0000 mon.a (mon.0) 2957 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "target_max_objects","val": "250"}]: dispatch 2024-05-20T22:20:34.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:34 smithi050 bash[28929]: audit 2024-05-20T22:20:34.497630+0000 mon.a (mon.0) 2958 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-98","var": "target_max_objects","val": "250"}]': finished 2024-05-20T22:20:34.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:34 smithi050 bash[28929]: cluster 2024-05-20T22:20:34.505018+0000 mon.a (mon.0) 2959 : cluster 0 osdmap e514: 8 total, 8 up, 8 in 2024-05-20T22:20:35.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:35 smithi145 bash[23893]: cluster 2024-05-20T22:20:34.438288+0000 mgr.y (mgr.14592) 552 : cluster 0 pgmap v844: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:20:35.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:35 smithi145 bash[23893]: audit 2024-05-20T22:20:34.574328+0000 mon.a (mon.0) 2960 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:20:35.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:35 smithi050 bash[28929]: cluster 2024-05-20T22:20:34.438288+0000 mgr.y (mgr.14592) 552 : cluster 0 pgmap v844: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:20:35.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:35 smithi050 bash[28929]: audit 2024-05-20T22:20:34.574328+0000 mon.a (mon.0) 2960 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:20:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:35 smithi050 bash[21866]: cluster 2024-05-20T22:20:34.438288+0000 mgr.y (mgr.14592) 552 : cluster 0 pgmap v844: 388 pgs: 388 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:20:35.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:35 smithi050 bash[21866]: audit 2024-05-20T22:20:34.574328+0000 mon.a (mon.0) 2960 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:20:36.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:36 smithi145 bash[23893]: audit 2024-05-20T22:20:35.543998+0000 mon.a (mon.0) 2961 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:20:36.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:36 smithi145 bash[23893]: cluster 2024-05-20T22:20:35.551271+0000 mon.a (mon.0) 2962 : cluster 0 osdmap e515: 8 total, 8 up, 8 in 2024-05-20T22:20:36.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:36 smithi145 bash[23893]: audit 2024-05-20T22:20:35.556947+0000 mon.a (mon.0) 2963 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-98"}]: dispatch 2024-05-20T22:20:36.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:36 smithi050 bash[28929]: audit 2024-05-20T22:20:35.543998+0000 mon.a (mon.0) 2961 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:20:36.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:36 smithi050 bash[28929]: cluster 2024-05-20T22:20:35.551271+0000 mon.a (mon.0) 2962 : cluster 0 osdmap e515: 8 total, 8 up, 8 in 2024-05-20T22:20:36.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:36 smithi050 bash[28929]: audit 2024-05-20T22:20:35.556947+0000 mon.a (mon.0) 2963 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-98"}]: dispatch 2024-05-20T22:20:36.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:36 smithi050 bash[21866]: audit 2024-05-20T22:20:35.543998+0000 mon.a (mon.0) 2961 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:20:36.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:36 smithi050 bash[21866]: cluster 2024-05-20T22:20:35.551271+0000 mon.a (mon.0) 2962 : cluster 0 osdmap e515: 8 total, 8 up, 8 in 2024-05-20T22:20:36.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:36 smithi050 bash[21866]: audit 2024-05-20T22:20:35.556947+0000 mon.a (mon.0) 2963 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-98"}]: dispatch 2024-05-20T22:20:38.390 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:20:38 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:20:38.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:38 smithi145 bash[23893]: cluster 2024-05-20T22:20:36.439286+0000 mgr.y (mgr.14592) 553 : cluster 0 pgmap v847: 388 pgs: 388 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:20:38.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:38 smithi145 bash[23893]: audit 2024-05-20T22:20:36.546590+0000 mon.a (mon.0) 2964 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-98"}]': finished 2024-05-20T22:20:38.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:38 smithi145 bash[23893]: cluster 2024-05-20T22:20:36.553860+0000 mon.a (mon.0) 2965 : cluster 0 osdmap e516: 8 total, 8 up, 8 in 2024-05-20T22:20:38.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:38 smithi050 bash[28929]: cluster 2024-05-20T22:20:36.439286+0000 mgr.y (mgr.14592) 553 : cluster 0 pgmap v847: 388 pgs: 388 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:20:38.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:38 smithi050 bash[28929]: audit 2024-05-20T22:20:36.546590+0000 mon.a (mon.0) 2964 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-98"}]': finished 2024-05-20T22:20:38.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:38 smithi050 bash[28929]: cluster 2024-05-20T22:20:36.553860+0000 mon.a (mon.0) 2965 : cluster 0 osdmap e516: 8 total, 8 up, 8 in 2024-05-20T22:20:38.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:38 smithi050 bash[21866]: cluster 2024-05-20T22:20:36.439286+0000 mgr.y (mgr.14592) 553 : cluster 0 pgmap v847: 388 pgs: 388 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:20:38.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:38 smithi050 bash[21866]: audit 2024-05-20T22:20:36.546590+0000 mon.a (mon.0) 2964 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-98"}]': finished 2024-05-20T22:20:38.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:38 smithi050 bash[21866]: cluster 2024-05-20T22:20:36.553860+0000 mon.a (mon.0) 2965 : cluster 0 osdmap e516: 8 total, 8 up, 8 in 2024-05-20T22:20:39.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:39 smithi145 bash[23893]: cluster 2024-05-20T22:20:37.572921+0000 mon.a (mon.0) 2966 : cluster 0 osdmap e517: 8 total, 8 up, 8 in 2024-05-20T22:20:39.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:39 smithi145 bash[23893]: audit 2024-05-20T22:20:38.196547+0000 mgr.y (mgr.14592) 554 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:20:39.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:39 smithi145 bash[23893]: audit 2024-05-20T22:20:38.243741+0000 mon.a (mon.0) 2967 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:20:39.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:39 smithi145 bash[23893]: cluster 2024-05-20T22:20:38.440353+0000 mgr.y (mgr.14592) 555 : cluster 0 pgmap v850: 356 pgs: 356 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:20:39.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:39 smithi145 bash[23893]: cluster 2024-05-20T22:20:38.578086+0000 mon.a (mon.0) 2968 : cluster 0 osdmap e518: 8 total, 8 up, 8 in 2024-05-20T22:20:39.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:39 smithi145 bash[23893]: audit 2024-05-20T22:20:38.588681+0000 mon.a (mon.0) 2969 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:20:39.391 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:39 smithi050 bash[21866]: cluster 2024-05-20T22:20:37.572921+0000 mon.a (mon.0) 2966 : cluster 0 osdmap e517: 8 total, 8 up, 8 in 2024-05-20T22:20:39.391 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:39 smithi050 bash[21866]: audit 2024-05-20T22:20:38.196547+0000 mgr.y (mgr.14592) 554 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:20:39.391 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:39 smithi050 bash[21866]: audit 2024-05-20T22:20:38.243741+0000 mon.a (mon.0) 2967 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:20:39.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:39 smithi050 bash[21866]: cluster 2024-05-20T22:20:38.440353+0000 mgr.y (mgr.14592) 555 : cluster 0 pgmap v850: 356 pgs: 356 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:20:39.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:39 smithi050 bash[21866]: cluster 2024-05-20T22:20:38.578086+0000 mon.a (mon.0) 2968 : cluster 0 osdmap e518: 8 total, 8 up, 8 in 2024-05-20T22:20:39.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:39 smithi050 bash[21866]: audit 2024-05-20T22:20:38.588681+0000 mon.a (mon.0) 2969 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:20:39.392 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:39 smithi050 bash[28929]: cluster 2024-05-20T22:20:37.572921+0000 mon.a (mon.0) 2966 : cluster 0 osdmap e517: 8 total, 8 up, 8 in 2024-05-20T22:20:39.392 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:39 smithi050 bash[28929]: audit 2024-05-20T22:20:38.196547+0000 mgr.y (mgr.14592) 554 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:20:39.392 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:39 smithi050 bash[28929]: audit 2024-05-20T22:20:38.243741+0000 mon.a (mon.0) 2967 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:20:39.392 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:39 smithi050 bash[28929]: cluster 2024-05-20T22:20:38.440353+0000 mgr.y (mgr.14592) 555 : cluster 0 pgmap v850: 356 pgs: 356 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:20:39.392 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:39 smithi050 bash[28929]: cluster 2024-05-20T22:20:38.578086+0000 mon.a (mon.0) 2968 : cluster 0 osdmap e518: 8 total, 8 up, 8 in 2024-05-20T22:20:39.392 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:39 smithi050 bash[28929]: audit 2024-05-20T22:20:38.588681+0000 mon.a (mon.0) 2969 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:20:39.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:20:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:20:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:20:40.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:40 smithi145 bash[23893]: audit 2024-05-20T22:20:39.573297+0000 mon.a (mon.0) 2970 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:20:40.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:40 smithi145 bash[23893]: cluster 2024-05-20T22:20:39.584012+0000 mon.a (mon.0) 2971 : cluster 0 osdmap e519: 8 total, 8 up, 8 in 2024-05-20T22:20:40.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:40 smithi145 bash[23893]: audit 2024-05-20T22:20:39.586430+0000 mon.a (mon.0) 2972 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:20:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:40 smithi050 bash[21866]: audit 2024-05-20T22:20:39.573297+0000 mon.a (mon.0) 2970 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:20:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:40 smithi050 bash[21866]: cluster 2024-05-20T22:20:39.584012+0000 mon.a (mon.0) 2971 : cluster 0 osdmap e519: 8 total, 8 up, 8 in 2024-05-20T22:20:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:40 smithi050 bash[21866]: audit 2024-05-20T22:20:39.586430+0000 mon.a (mon.0) 2972 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:20:40.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:40 smithi050 bash[28929]: audit 2024-05-20T22:20:39.573297+0000 mon.a (mon.0) 2970 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:20:40.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:40 smithi050 bash[28929]: cluster 2024-05-20T22:20:39.584012+0000 mon.a (mon.0) 2971 : cluster 0 osdmap e519: 8 total, 8 up, 8 in 2024-05-20T22:20:40.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:40 smithi050 bash[28929]: audit 2024-05-20T22:20:39.586430+0000 mon.a (mon.0) 2972 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:20:41.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:41 smithi145 bash[23893]: cluster 2024-05-20T22:20:40.443604+0000 mgr.y (mgr.14592) 556 : cluster 0 pgmap v853: 388 pgs: 388 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:20:41.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:41 smithi145 bash[23893]: audit 2024-05-20T22:20:40.582192+0000 mon.a (mon.0) 2973 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-100", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:20:41.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:41 smithi145 bash[23893]: cluster 2024-05-20T22:20:40.591573+0000 mon.a (mon.0) 2974 : cluster 0 osdmap e520: 8 total, 8 up, 8 in 2024-05-20T22:20:41.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:41 smithi145 bash[23893]: audit 2024-05-20T22:20:40.595471+0000 mon.a (mon.0) 2975 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-100"}]: dispatch 2024-05-20T22:20:41.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:41 smithi050 bash[21866]: cluster 2024-05-20T22:20:40.443604+0000 mgr.y (mgr.14592) 556 : cluster 0 pgmap v853: 388 pgs: 388 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:20:41.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:41 smithi050 bash[21866]: audit 2024-05-20T22:20:40.582192+0000 mon.a (mon.0) 2973 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-100", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:20:41.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:41 smithi050 bash[21866]: cluster 2024-05-20T22:20:40.591573+0000 mon.a (mon.0) 2974 : cluster 0 osdmap e520: 8 total, 8 up, 8 in 2024-05-20T22:20:41.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:41 smithi050 bash[21866]: audit 2024-05-20T22:20:40.595471+0000 mon.a (mon.0) 2975 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-100"}]: dispatch 2024-05-20T22:20:41.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:41 smithi050 bash[28929]: cluster 2024-05-20T22:20:40.443604+0000 mgr.y (mgr.14592) 556 : cluster 0 pgmap v853: 388 pgs: 388 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:20:41.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:41 smithi050 bash[28929]: audit 2024-05-20T22:20:40.582192+0000 mon.a (mon.0) 2973 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-100", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:20:41.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:41 smithi050 bash[28929]: cluster 2024-05-20T22:20:40.591573+0000 mon.a (mon.0) 2974 : cluster 0 osdmap e520: 8 total, 8 up, 8 in 2024-05-20T22:20:41.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:41 smithi050 bash[28929]: audit 2024-05-20T22:20:40.595471+0000 mon.a (mon.0) 2975 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-100"}]: dispatch 2024-05-20T22:20:42.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:42 smithi145 bash[23893]: audit 2024-05-20T22:20:41.593161+0000 mon.a (mon.0) 2976 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-100"}]': finished 2024-05-20T22:20:42.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:42 smithi145 bash[23893]: cluster 2024-05-20T22:20:41.600673+0000 mon.a (mon.0) 2977 : cluster 0 osdmap e521: 8 total, 8 up, 8 in 2024-05-20T22:20:42.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:42 smithi145 bash[23893]: audit 2024-05-20T22:20:41.601425+0000 mon.a (mon.0) 2978 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-100", "mode": "writeback"}]: dispatch 2024-05-20T22:20:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:42 smithi050 bash[28929]: audit 2024-05-20T22:20:41.593161+0000 mon.a (mon.0) 2976 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-100"}]': finished 2024-05-20T22:20:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:42 smithi050 bash[28929]: cluster 2024-05-20T22:20:41.600673+0000 mon.a (mon.0) 2977 : cluster 0 osdmap e521: 8 total, 8 up, 8 in 2024-05-20T22:20:42.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:42 smithi050 bash[28929]: audit 2024-05-20T22:20:41.601425+0000 mon.a (mon.0) 2978 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-100", "mode": "writeback"}]: dispatch 2024-05-20T22:20:42.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:42 smithi050 bash[21866]: audit 2024-05-20T22:20:41.593161+0000 mon.a (mon.0) 2976 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-6", "overlaypool": "test-rados-api-smithi050-64110-100"}]': finished 2024-05-20T22:20:42.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:42 smithi050 bash[21866]: cluster 2024-05-20T22:20:41.600673+0000 mon.a (mon.0) 2977 : cluster 0 osdmap e521: 8 total, 8 up, 8 in 2024-05-20T22:20:42.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:42 smithi050 bash[21866]: audit 2024-05-20T22:20:41.601425+0000 mon.a (mon.0) 2978 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-100", "mode": "writeback"}]: dispatch 2024-05-20T22:20:43.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:43 smithi145 bash[23893]: cluster 2024-05-20T22:20:42.444661+0000 mgr.y (mgr.14592) 557 : cluster 0 pgmap v856: 388 pgs: 388 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:20:43.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:43 smithi145 bash[23893]: cluster 2024-05-20T22:20:42.594238+0000 mon.a (mon.0) 2979 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:20:43.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:43 smithi145 bash[23893]: audit 2024-05-20T22:20:42.602039+0000 mon.a (mon.0) 2980 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-100", "mode": "writeback"}]': finished 2024-05-20T22:20:43.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:43 smithi145 bash[23893]: cluster 2024-05-20T22:20:42.611440+0000 mon.a (mon.0) 2981 : cluster 0 osdmap e522: 8 total, 8 up, 8 in 2024-05-20T22:20:43.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:43 smithi145 bash[23893]: audit 2024-05-20T22:20:42.616436+0000 mon.a (mon.0) 2982 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:20:43.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:43 smithi050 bash[21866]: cluster 2024-05-20T22:20:42.444661+0000 mgr.y (mgr.14592) 557 : cluster 0 pgmap v856: 388 pgs: 388 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:20:43.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:43 smithi050 bash[21866]: cluster 2024-05-20T22:20:42.594238+0000 mon.a (mon.0) 2979 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:20:43.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:43 smithi050 bash[21866]: audit 2024-05-20T22:20:42.602039+0000 mon.a (mon.0) 2980 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-100", "mode": "writeback"}]': finished 2024-05-20T22:20:43.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:43 smithi050 bash[21866]: cluster 2024-05-20T22:20:42.611440+0000 mon.a (mon.0) 2981 : cluster 0 osdmap e522: 8 total, 8 up, 8 in 2024-05-20T22:20:43.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:43 smithi050 bash[21866]: audit 2024-05-20T22:20:42.616436+0000 mon.a (mon.0) 2982 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:20:43.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:43 smithi050 bash[28929]: cluster 2024-05-20T22:20:42.444661+0000 mgr.y (mgr.14592) 557 : cluster 0 pgmap v856: 388 pgs: 388 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:20:43.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:43 smithi050 bash[28929]: cluster 2024-05-20T22:20:42.594238+0000 mon.a (mon.0) 2979 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:20:43.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:43 smithi050 bash[28929]: audit 2024-05-20T22:20:42.602039+0000 mon.a (mon.0) 2980 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-100", "mode": "writeback"}]': finished 2024-05-20T22:20:43.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:43 smithi050 bash[28929]: cluster 2024-05-20T22:20:42.611440+0000 mon.a (mon.0) 2981 : cluster 0 osdmap e522: 8 total, 8 up, 8 in 2024-05-20T22:20:43.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:43 smithi050 bash[28929]: audit 2024-05-20T22:20:42.616436+0000 mon.a (mon.0) 2982 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:20:44.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:44 smithi145 bash[23893]: audit 2024-05-20T22:20:43.604932+0000 mon.a (mon.0) 2983 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:20:44.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:44 smithi145 bash[23893]: cluster 2024-05-20T22:20:43.611992+0000 mon.a (mon.0) 2984 : cluster 0 osdmap e523: 8 total, 8 up, 8 in 2024-05-20T22:20:44.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:44 smithi145 bash[23893]: audit 2024-05-20T22:20:43.614829+0000 mon.a (mon.0) 2985 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:20:44.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:44 smithi145 bash[23893]: audit 2024-05-20T22:20:44.608233+0000 mon.a (mon.0) 2986 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:20:44.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:44 smithi050 bash[28929]: audit 2024-05-20T22:20:43.604932+0000 mon.a (mon.0) 2983 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:20:44.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:44 smithi050 bash[28929]: cluster 2024-05-20T22:20:43.611992+0000 mon.a (mon.0) 2984 : cluster 0 osdmap e523: 8 total, 8 up, 8 in 2024-05-20T22:20:44.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:44 smithi050 bash[28929]: audit 2024-05-20T22:20:43.614829+0000 mon.a (mon.0) 2985 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:20:44.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:44 smithi050 bash[28929]: audit 2024-05-20T22:20:44.608233+0000 mon.a (mon.0) 2986 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:20:44.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:44 smithi050 bash[21866]: audit 2024-05-20T22:20:43.604932+0000 mon.a (mon.0) 2983 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:20:44.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:44 smithi050 bash[21866]: cluster 2024-05-20T22:20:43.611992+0000 mon.a (mon.0) 2984 : cluster 0 osdmap e523: 8 total, 8 up, 8 in 2024-05-20T22:20:44.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:44 smithi050 bash[21866]: audit 2024-05-20T22:20:43.614829+0000 mon.a (mon.0) 2985 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:20:44.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:44 smithi050 bash[21866]: audit 2024-05-20T22:20:44.608233+0000 mon.a (mon.0) 2986 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:20:45.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:45 smithi145 bash[23893]: cluster 2024-05-20T22:20:44.445645+0000 mgr.y (mgr.14592) 558 : cluster 0 pgmap v859: 388 pgs: 388 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:20:45.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:45 smithi145 bash[23893]: cluster 2024-05-20T22:20:44.616653+0000 mon.a (mon.0) 2987 : cluster 0 osdmap e524: 8 total, 8 up, 8 in 2024-05-20T22:20:45.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:45 smithi145 bash[23893]: audit 2024-05-20T22:20:44.619539+0000 mon.a (mon.0) 2988 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-05-20T22:20:45.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:45 smithi145 bash[23893]: cluster 2024-05-20T22:20:45.608592+0000 mon.a (mon.0) 2989 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:20:45.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:45 smithi145 bash[23893]: audit 2024-05-20T22:20:45.610794+0000 mon.a (mon.0) 2990 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-05-20T22:20:45.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:45 smithi145 bash[23893]: cluster 2024-05-20T22:20:45.619124+0000 mon.a (mon.0) 2991 : cluster 0 osdmap e525: 8 total, 8 up, 8 in 2024-05-20T22:20:45.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:45 smithi145 bash[23893]: audit 2024-05-20T22:20:45.622073+0000 mon.a (mon.0) 2992 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-05-20T22:20:45.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:45 smithi050 bash[21866]: cluster 2024-05-20T22:20:44.445645+0000 mgr.y (mgr.14592) 558 : cluster 0 pgmap v859: 388 pgs: 388 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:20:45.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:45 smithi050 bash[21866]: cluster 2024-05-20T22:20:44.616653+0000 mon.a (mon.0) 2987 : cluster 0 osdmap e524: 8 total, 8 up, 8 in 2024-05-20T22:20:45.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:45 smithi050 bash[21866]: audit 2024-05-20T22:20:44.619539+0000 mon.a (mon.0) 2988 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-05-20T22:20:45.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:45 smithi050 bash[21866]: cluster 2024-05-20T22:20:45.608592+0000 mon.a (mon.0) 2989 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:20:45.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:45 smithi050 bash[21866]: audit 2024-05-20T22:20:45.610794+0000 mon.a (mon.0) 2990 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-05-20T22:20:45.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:45 smithi050 bash[21866]: cluster 2024-05-20T22:20:45.619124+0000 mon.a (mon.0) 2991 : cluster 0 osdmap e525: 8 total, 8 up, 8 in 2024-05-20T22:20:45.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:45 smithi050 bash[21866]: audit 2024-05-20T22:20:45.622073+0000 mon.a (mon.0) 2992 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-05-20T22:20:45.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:45 smithi050 bash[28929]: cluster 2024-05-20T22:20:44.445645+0000 mgr.y (mgr.14592) 558 : cluster 0 pgmap v859: 388 pgs: 388 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:20:45.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:45 smithi050 bash[28929]: cluster 2024-05-20T22:20:44.616653+0000 mon.a (mon.0) 2987 : cluster 0 osdmap e524: 8 total, 8 up, 8 in 2024-05-20T22:20:45.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:45 smithi050 bash[28929]: audit 2024-05-20T22:20:44.619539+0000 mon.a (mon.0) 2988 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-05-20T22:20:45.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:45 smithi050 bash[28929]: cluster 2024-05-20T22:20:45.608592+0000 mon.a (mon.0) 2989 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:20:45.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:45 smithi050 bash[28929]: audit 2024-05-20T22:20:45.610794+0000 mon.a (mon.0) 2990 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-05-20T22:20:45.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:45 smithi050 bash[28929]: cluster 2024-05-20T22:20:45.619124+0000 mon.a (mon.0) 2991 : cluster 0 osdmap e525: 8 total, 8 up, 8 in 2024-05-20T22:20:45.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:45 smithi050 bash[28929]: audit 2024-05-20T22:20:45.622073+0000 mon.a (mon.0) 2992 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-05-20T22:20:47.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:47 smithi145 bash[23893]: cluster 2024-05-20T22:20:46.446813+0000 mgr.y (mgr.14592) 559 : cluster 0 pgmap v862: 388 pgs: 388 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:20:47.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:47 smithi145 bash[23893]: audit 2024-05-20T22:20:46.613657+0000 mon.a (mon.0) 2993 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-05-20T22:20:47.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:47 smithi145 bash[23893]: cluster 2024-05-20T22:20:46.623549+0000 mon.a (mon.0) 2994 : cluster 0 osdmap e526: 8 total, 8 up, 8 in 2024-05-20T22:20:47.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:47 smithi145 bash[23893]: audit 2024-05-20T22:20:46.734895+0000 mon.a (mon.0) 2995 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:20:47.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:47 smithi050 bash[21866]: cluster 2024-05-20T22:20:46.446813+0000 mgr.y (mgr.14592) 559 : cluster 0 pgmap v862: 388 pgs: 388 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:20:47.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:47 smithi050 bash[21866]: audit 2024-05-20T22:20:46.613657+0000 mon.a (mon.0) 2993 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-05-20T22:20:47.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:47 smithi050 bash[21866]: cluster 2024-05-20T22:20:46.623549+0000 mon.a (mon.0) 2994 : cluster 0 osdmap e526: 8 total, 8 up, 8 in 2024-05-20T22:20:47.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:47 smithi050 bash[21866]: audit 2024-05-20T22:20:46.734895+0000 mon.a (mon.0) 2995 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:20:47.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:47 smithi050 bash[28929]: cluster 2024-05-20T22:20:46.446813+0000 mgr.y (mgr.14592) 559 : cluster 0 pgmap v862: 388 pgs: 388 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:20:47.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:47 smithi050 bash[28929]: audit 2024-05-20T22:20:46.613657+0000 mon.a (mon.0) 2993 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-05-20T22:20:47.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:47 smithi050 bash[28929]: cluster 2024-05-20T22:20:46.623549+0000 mon.a (mon.0) 2994 : cluster 0 osdmap e526: 8 total, 8 up, 8 in 2024-05-20T22:20:47.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:47 smithi050 bash[28929]: audit 2024-05-20T22:20:46.734895+0000 mon.a (mon.0) 2995 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:20:48.640 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:20:48 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:20:48.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:48 smithi050 bash[21866]: audit 2024-05-20T22:20:47.641088+0000 mon.a (mon.0) 2996 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:20:48.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:48 smithi050 bash[21866]: cluster 2024-05-20T22:20:47.648056+0000 mon.a (mon.0) 2997 : cluster 0 osdmap e527: 8 total, 8 up, 8 in 2024-05-20T22:20:48.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:48 smithi050 bash[21866]: audit 2024-05-20T22:20:47.649569+0000 mon.a (mon.0) 2998 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-100"}]: dispatch 2024-05-20T22:20:48.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:48 smithi050 bash[28929]: audit 2024-05-20T22:20:47.641088+0000 mon.a (mon.0) 2996 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:20:48.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:48 smithi050 bash[28929]: cluster 2024-05-20T22:20:47.648056+0000 mon.a (mon.0) 2997 : cluster 0 osdmap e527: 8 total, 8 up, 8 in 2024-05-20T22:20:48.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:48 smithi050 bash[28929]: audit 2024-05-20T22:20:47.649569+0000 mon.a (mon.0) 2998 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-100"}]: dispatch 2024-05-20T22:20:49.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:48 smithi145 bash[23893]: audit 2024-05-20T22:20:47.641088+0000 mon.a (mon.0) 2996 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]': finished 2024-05-20T22:20:49.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:48 smithi145 bash[23893]: cluster 2024-05-20T22:20:47.648056+0000 mon.a (mon.0) 2997 : cluster 0 osdmap e527: 8 total, 8 up, 8 in 2024-05-20T22:20:49.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:48 smithi145 bash[23893]: audit 2024-05-20T22:20:47.649569+0000 mon.a (mon.0) 2998 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-100"}]: dispatch 2024-05-20T22:20:49.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:20:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:20:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:20:50.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:50 smithi145 bash[23893]: audit 2024-05-20T22:20:48.208085+0000 mgr.y (mgr.14592) 560 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:20:50.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:50 smithi145 bash[23893]: cluster 2024-05-20T22:20:48.447886+0000 mgr.y (mgr.14592) 561 : cluster 0 pgmap v865: 388 pgs: 388 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:20:50.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:50 smithi145 bash[23893]: audit 2024-05-20T22:20:48.651126+0000 mon.a (mon.0) 2999 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-100"}]': finished 2024-05-20T22:20:50.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:50 smithi145 bash[23893]: cluster 2024-05-20T22:20:48.660167+0000 mon.a (mon.0) 3000 : cluster 0 osdmap e528: 8 total, 8 up, 8 in 2024-05-20T22:20:50.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:50 smithi050 bash[28929]: audit 2024-05-20T22:20:48.208085+0000 mgr.y (mgr.14592) 560 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:20:50.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:50 smithi050 bash[28929]: cluster 2024-05-20T22:20:48.447886+0000 mgr.y (mgr.14592) 561 : cluster 0 pgmap v865: 388 pgs: 388 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:20:50.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:50 smithi050 bash[28929]: audit 2024-05-20T22:20:48.651126+0000 mon.a (mon.0) 2999 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-100"}]': finished 2024-05-20T22:20:50.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:50 smithi050 bash[28929]: cluster 2024-05-20T22:20:48.660167+0000 mon.a (mon.0) 3000 : cluster 0 osdmap e528: 8 total, 8 up, 8 in 2024-05-20T22:20:50.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:50 smithi050 bash[21866]: audit 2024-05-20T22:20:48.208085+0000 mgr.y (mgr.14592) 560 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:20:50.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:50 smithi050 bash[21866]: cluster 2024-05-20T22:20:48.447886+0000 mgr.y (mgr.14592) 561 : cluster 0 pgmap v865: 388 pgs: 388 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:20:50.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:50 smithi050 bash[21866]: audit 2024-05-20T22:20:48.651126+0000 mon.a (mon.0) 2999 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-100"}]': finished 2024-05-20T22:20:50.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:50 smithi050 bash[21866]: cluster 2024-05-20T22:20:48.660167+0000 mon.a (mon.0) 3000 : cluster 0 osdmap e528: 8 total, 8 up, 8 in 2024-05-20T22:20:51.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:51 smithi145 bash[23893]: cluster 2024-05-20T22:20:49.661013+0000 mon.a (mon.0) 3001 : cluster 0 osdmap e529: 8 total, 8 up, 8 in 2024-05-20T22:20:51.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:51 smithi145 bash[23893]: cluster 2024-05-20T22:20:50.451283+0000 mgr.y (mgr.14592) 562 : cluster 0 pgmap v868: 356 pgs: 356 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:20:51.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:51 smithi145 bash[23893]: cluster 2024-05-20T22:20:50.665202+0000 mon.a (mon.0) 3002 : cluster 0 osdmap e530: 8 total, 8 up, 8 in 2024-05-20T22:20:51.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:51 smithi145 bash[23893]: audit 2024-05-20T22:20:50.671434+0000 mon.a (mon.0) 3003 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:20:51.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:51 smithi050 bash[21866]: cluster 2024-05-20T22:20:49.661013+0000 mon.a (mon.0) 3001 : cluster 0 osdmap e529: 8 total, 8 up, 8 in 2024-05-20T22:20:51.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:51 smithi050 bash[21866]: cluster 2024-05-20T22:20:50.451283+0000 mgr.y (mgr.14592) 562 : cluster 0 pgmap v868: 356 pgs: 356 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:20:51.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:51 smithi050 bash[21866]: cluster 2024-05-20T22:20:50.665202+0000 mon.a (mon.0) 3002 : cluster 0 osdmap e530: 8 total, 8 up, 8 in 2024-05-20T22:20:51.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:51 smithi050 bash[21866]: audit 2024-05-20T22:20:50.671434+0000 mon.a (mon.0) 3003 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:20:51.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:51 smithi050 bash[28929]: cluster 2024-05-20T22:20:49.661013+0000 mon.a (mon.0) 3001 : cluster 0 osdmap e529: 8 total, 8 up, 8 in 2024-05-20T22:20:51.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:51 smithi050 bash[28929]: cluster 2024-05-20T22:20:50.451283+0000 mgr.y (mgr.14592) 562 : cluster 0 pgmap v868: 356 pgs: 356 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:20:51.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:51 smithi050 bash[28929]: cluster 2024-05-20T22:20:50.665202+0000 mon.a (mon.0) 3002 : cluster 0 osdmap e530: 8 total, 8 up, 8 in 2024-05-20T22:20:51.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:51 smithi050 bash[28929]: audit 2024-05-20T22:20:50.671434+0000 mon.a (mon.0) 3003 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:20:52.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:52 smithi050 bash[21866]: audit 2024-05-20T22:20:51.661077+0000 mon.a (mon.0) 3004 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:20:52.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:52 smithi050 bash[21866]: cluster 2024-05-20T22:20:51.668630+0000 mon.a (mon.0) 3005 : cluster 0 osdmap e531: 8 total, 8 up, 8 in 2024-05-20T22:20:52.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:52 smithi050 bash[21866]: audit 2024-05-20T22:20:51.674533+0000 mon.a (mon.0) 3006 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:20:52.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:52 smithi050 bash[21866]: audit 2024-05-20T22:20:51.693783+0000 mon.a (mon.0) 3007 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:20:52.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:52 smithi050 bash[28929]: audit 2024-05-20T22:20:51.661077+0000 mon.a (mon.0) 3004 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:20:52.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:52 smithi050 bash[28929]: cluster 2024-05-20T22:20:51.668630+0000 mon.a (mon.0) 3005 : cluster 0 osdmap e531: 8 total, 8 up, 8 in 2024-05-20T22:20:52.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:52 smithi050 bash[28929]: audit 2024-05-20T22:20:51.674533+0000 mon.a (mon.0) 3006 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:20:52.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:52 smithi050 bash[28929]: audit 2024-05-20T22:20:51.693783+0000 mon.a (mon.0) 3007 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:20:53.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:52 smithi145 bash[23893]: audit 2024-05-20T22:20:51.661077+0000 mon.a (mon.0) 3004 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:20:53.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:52 smithi145 bash[23893]: cluster 2024-05-20T22:20:51.668630+0000 mon.a (mon.0) 3005 : cluster 0 osdmap e531: 8 total, 8 up, 8 in 2024-05-20T22:20:53.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:52 smithi145 bash[23893]: audit 2024-05-20T22:20:51.674533+0000 mon.a (mon.0) 3006 : audit 0 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-05-20T22:20:53.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:52 smithi145 bash[23893]: audit 2024-05-20T22:20:51.693783+0000 mon.a (mon.0) 3007 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-05-20T22:20:53.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:53 smithi050 bash[21866]: cluster 2024-05-20T22:20:52.452275+0000 mgr.y (mgr.14592) 563 : cluster 0 pgmap v871: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:20:53.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:53 smithi050 bash[21866]: audit 2024-05-20T22:20:52.670394+0000 mon.a (mon.0) 3008 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:20:53.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:53 smithi050 bash[21866]: cluster 2024-05-20T22:20:52.679395+0000 mon.a (mon.0) 3009 : cluster 0 osdmap e532: 8 total, 8 up, 8 in 2024-05-20T22:20:53.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:53 smithi050 bash[21866]: audit 2024-05-20T22:20:52.680401+0000 mon.a (mon.0) 3010 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-05-20T22:20:53.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:53 smithi050 bash[21866]: audit 2024-05-20T22:20:53.276567+0000 mon.a (mon.0) 3011 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:20:53.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:53 smithi050 bash[28929]: cluster 2024-05-20T22:20:52.452275+0000 mgr.y (mgr.14592) 563 : cluster 0 pgmap v871: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:20:53.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:53 smithi050 bash[28929]: audit 2024-05-20T22:20:52.670394+0000 mon.a (mon.0) 3008 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:20:53.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:53 smithi050 bash[28929]: cluster 2024-05-20T22:20:52.679395+0000 mon.a (mon.0) 3009 : cluster 0 osdmap e532: 8 total, 8 up, 8 in 2024-05-20T22:20:53.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:53 smithi050 bash[28929]: audit 2024-05-20T22:20:52.680401+0000 mon.a (mon.0) 3010 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-05-20T22:20:53.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:53 smithi050 bash[28929]: audit 2024-05-20T22:20:53.276567+0000 mon.a (mon.0) 3011 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:20:54.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:53 smithi145 bash[23893]: cluster 2024-05-20T22:20:52.452275+0000 mgr.y (mgr.14592) 563 : cluster 0 pgmap v871: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:20:54.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:53 smithi145 bash[23893]: audit 2024-05-20T22:20:52.670394+0000 mon.a (mon.0) 3008 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-05-20T22:20:54.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:53 smithi145 bash[23893]: cluster 2024-05-20T22:20:52.679395+0000 mon.a (mon.0) 3009 : cluster 0 osdmap e532: 8 total, 8 up, 8 in 2024-05-20T22:20:54.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:53 smithi145 bash[23893]: audit 2024-05-20T22:20:52.680401+0000 mon.a (mon.0) 3010 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-05-20T22:20:54.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:53 smithi145 bash[23893]: audit 2024-05-20T22:20:53.276567+0000 mon.a (mon.0) 3011 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:20:54.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:54 smithi050 bash[21866]: audit 2024-05-20T22:20:53.681507+0000 mon.a (mon.0) 3012 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-05-20T22:20:54.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:54 smithi050 bash[21866]: cluster 2024-05-20T22:20:53.689084+0000 mon.a (mon.0) 3013 : cluster 0 osdmap e533: 8 total, 8 up, 8 in 2024-05-20T22:20:54.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:54 smithi050 bash[21866]: audit 2024-05-20T22:20:53.690176+0000 mon.a (mon.0) 3014 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-05-20T22:20:54.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:54 smithi050 bash[28929]: audit 2024-05-20T22:20:53.681507+0000 mon.a (mon.0) 3012 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-05-20T22:20:54.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:54 smithi050 bash[28929]: cluster 2024-05-20T22:20:53.689084+0000 mon.a (mon.0) 3013 : cluster 0 osdmap e533: 8 total, 8 up, 8 in 2024-05-20T22:20:54.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:54 smithi050 bash[28929]: audit 2024-05-20T22:20:53.690176+0000 mon.a (mon.0) 3014 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-05-20T22:20:55.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:54 smithi145 bash[23893]: audit 2024-05-20T22:20:53.681507+0000 mon.a (mon.0) 3012 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-05-20T22:20:55.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:54 smithi145 bash[23893]: cluster 2024-05-20T22:20:53.689084+0000 mon.a (mon.0) 3013 : cluster 0 osdmap e533: 8 total, 8 up, 8 in 2024-05-20T22:20:55.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:54 smithi145 bash[23893]: audit 2024-05-20T22:20:53.690176+0000 mon.a (mon.0) 3014 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-05-20T22:20:55.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:55 smithi050 bash[21866]: cluster 2024-05-20T22:20:54.453261+0000 mgr.y (mgr.14592) 564 : cluster 0 pgmap v874: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:20:55.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:55 smithi050 bash[21866]: audit 2024-05-20T22:20:54.690295+0000 mon.a (mon.0) 3015 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-05-20T22:20:55.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:55 smithi050 bash[21866]: cluster 2024-05-20T22:20:54.700590+0000 mon.a (mon.0) 3016 : cluster 0 osdmap e534: 8 total, 8 up, 8 in 2024-05-20T22:20:55.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:55 smithi050 bash[21866]: audit 2024-05-20T22:20:54.773744+0000 mon.a (mon.0) 3017 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:20:55.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:55 smithi050 bash[21866]: audit 2024-05-20T22:20:54.774626+0000 mon.a (mon.0) 3018 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-102"}]: dispatch 2024-05-20T22:20:55.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:55 smithi050 bash[28929]: cluster 2024-05-20T22:20:54.453261+0000 mgr.y (mgr.14592) 564 : cluster 0 pgmap v874: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:20:55.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:55 smithi050 bash[28929]: audit 2024-05-20T22:20:54.690295+0000 mon.a (mon.0) 3015 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-05-20T22:20:55.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:55 smithi050 bash[28929]: cluster 2024-05-20T22:20:54.700590+0000 mon.a (mon.0) 3016 : cluster 0 osdmap e534: 8 total, 8 up, 8 in 2024-05-20T22:20:55.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:55 smithi050 bash[28929]: audit 2024-05-20T22:20:54.773744+0000 mon.a (mon.0) 3017 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:20:55.947 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:55 smithi050 bash[28929]: audit 2024-05-20T22:20:54.774626+0000 mon.a (mon.0) 3018 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-102"}]: dispatch 2024-05-20T22:20:56.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:55 smithi145 bash[23893]: cluster 2024-05-20T22:20:54.453261+0000 mgr.y (mgr.14592) 564 : cluster 0 pgmap v874: 388 pgs: 32 unknown, 356 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:20:56.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:55 smithi145 bash[23893]: audit 2024-05-20T22:20:54.690295+0000 mon.a (mon.0) 3015 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-05-20T22:20:56.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:55 smithi145 bash[23893]: cluster 2024-05-20T22:20:54.700590+0000 mon.a (mon.0) 3016 : cluster 0 osdmap e534: 8 total, 8 up, 8 in 2024-05-20T22:20:56.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:55 smithi145 bash[23893]: audit 2024-05-20T22:20:54.773744+0000 mon.a (mon.0) 3017 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-6"}]: dispatch 2024-05-20T22:20:56.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:55 smithi145 bash[23893]: audit 2024-05-20T22:20:54.774626+0000 mon.a (mon.0) 3018 : audit 1 from='client.? v1:172.21.15.50:0/2648777421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-6", "tierpool": "test-rados-api-smithi050-64110-102"}]: dispatch 2024-05-20T22:20:57.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:56 smithi145 bash[23893]: cluster 2024-05-20T22:20:55.706776+0000 mon.a (mon.0) 3019 : cluster 0 osdmap e535: 8 total, 8 up, 8 in 2024-05-20T22:20:57.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:56 smithi145 bash[23893]: audit 2024-05-20T22:20:55.985810+0000 mon.a (mon.0) 3020 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:20:57.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:56 smithi050 bash[21866]: cluster 2024-05-20T22:20:55.706776+0000 mon.a (mon.0) 3019 : cluster 0 osdmap e535: 8 total, 8 up, 8 in 2024-05-20T22:20:57.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:56 smithi050 bash[21866]: audit 2024-05-20T22:20:55.985810+0000 mon.a (mon.0) 3020 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:20:57.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:56 smithi050 bash[28929]: cluster 2024-05-20T22:20:55.706776+0000 mon.a (mon.0) 3019 : cluster 0 osdmap e535: 8 total, 8 up, 8 in 2024-05-20T22:20:57.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:56 smithi050 bash[28929]: audit 2024-05-20T22:20:55.985810+0000 mon.a (mon.0) 3020 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:20:58.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:57 smithi145 bash[23893]: cluster 2024-05-20T22:20:56.454150+0000 mgr.y (mgr.14592) 565 : cluster 0 pgmap v877: 356 pgs: 356 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:20:58.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:57 smithi145 bash[23893]: cluster 2024-05-20T22:20:56.718942+0000 mon.a (mon.0) 3021 : cluster 0 osdmap e536: 8 total, 8 up, 8 in 2024-05-20T22:20:58.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:57 smithi145 bash[23893]: audit 2024-05-20T22:20:56.734647+0000 mon.a (mon.0) 3022 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:20:58.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:57 smithi145 bash[23893]: audit 2024-05-20T22:20:56.736017+0000 mon.a (mon.0) 3023 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:20:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:57 smithi145 bash[23893]: audit 2024-05-20T22:20:56.747404+0000 mon.a (mon.0) 3024 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:20:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:57 smithi145 bash[23893]: audit 2024-05-20T22:20:56.774638+0000 mon.c (mon.2) 365 : audit 1 from='client.? v1:172.21.15.50:0/1720024892' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:20:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:57 smithi145 bash[23893]: audit 2024-05-20T22:20:56.775343+0000 mon.a (mon.0) 3025 : audit 1 from='client.26258 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:20:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:57 smithi145 bash[23893]: audit 2024-05-20T22:20:56.776025+0000 mon.c (mon.2) 366 : audit 1 from='client.? v1:172.21.15.50:0/1720024892' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:20:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:57 smithi145 bash[23893]: audit 2024-05-20T22:20:56.776313+0000 mon.a (mon.0) 3026 : audit 1 from='client.26258 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:20:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:57 smithi145 bash[23893]: audit 2024-05-20T22:20:56.776786+0000 mon.c (mon.2) 367 : audit 1 from='client.? v1:172.21.15.50:0/1720024892' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:20:58.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:57 smithi145 bash[23893]: audit 2024-05-20T22:20:56.777102+0000 mon.a (mon.0) 3027 : audit 1 from='client.26258 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:20:58.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:57 smithi050 bash[21866]: cluster 2024-05-20T22:20:56.454150+0000 mgr.y (mgr.14592) 565 : cluster 0 pgmap v877: 356 pgs: 356 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:20:58.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:57 smithi050 bash[21866]: cluster 2024-05-20T22:20:56.718942+0000 mon.a (mon.0) 3021 : cluster 0 osdmap e536: 8 total, 8 up, 8 in 2024-05-20T22:20:58.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:57 smithi050 bash[21866]: audit 2024-05-20T22:20:56.734647+0000 mon.a (mon.0) 3022 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:20:58.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:57 smithi050 bash[21866]: audit 2024-05-20T22:20:56.736017+0000 mon.a (mon.0) 3023 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:20:58.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:57 smithi050 bash[21866]: audit 2024-05-20T22:20:56.747404+0000 mon.a (mon.0) 3024 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:20:58.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:57 smithi050 bash[21866]: audit 2024-05-20T22:20:56.774638+0000 mon.c (mon.2) 365 : audit 1 from='client.? v1:172.21.15.50:0/1720024892' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:20:58.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:57 smithi050 bash[21866]: audit 2024-05-20T22:20:56.775343+0000 mon.a (mon.0) 3025 : audit 1 from='client.26258 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:20:58.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:57 smithi050 bash[21866]: audit 2024-05-20T22:20:56.776025+0000 mon.c (mon.2) 366 : audit 1 from='client.? v1:172.21.15.50:0/1720024892' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:20:58.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:57 smithi050 bash[21866]: audit 2024-05-20T22:20:56.776313+0000 mon.a (mon.0) 3026 : audit 1 from='client.26258 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:20:58.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:57 smithi050 bash[21866]: audit 2024-05-20T22:20:56.776786+0000 mon.c (mon.2) 367 : audit 1 from='client.? v1:172.21.15.50:0/1720024892' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:20:58.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:57 smithi050 bash[21866]: audit 2024-05-20T22:20:56.777102+0000 mon.a (mon.0) 3027 : audit 1 from='client.26258 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:20:58.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:57 smithi050 bash[28929]: cluster 2024-05-20T22:20:56.454150+0000 mgr.y (mgr.14592) 565 : cluster 0 pgmap v877: 356 pgs: 356 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:20:58.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:57 smithi050 bash[28929]: cluster 2024-05-20T22:20:56.718942+0000 mon.a (mon.0) 3021 : cluster 0 osdmap e536: 8 total, 8 up, 8 in 2024-05-20T22:20:58.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:57 smithi050 bash[28929]: audit 2024-05-20T22:20:56.734647+0000 mon.a (mon.0) 3022 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:20:58.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:57 smithi050 bash[28929]: audit 2024-05-20T22:20:56.736017+0000 mon.a (mon.0) 3023 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:20:58.197 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:57 smithi050 bash[28929]: audit 2024-05-20T22:20:56.747404+0000 mon.a (mon.0) 3024 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:20:58.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:57 smithi050 bash[28929]: audit 2024-05-20T22:20:56.774638+0000 mon.c (mon.2) 365 : audit 1 from='client.? v1:172.21.15.50:0/1720024892' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:20:58.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:57 smithi050 bash[28929]: audit 2024-05-20T22:20:56.775343+0000 mon.a (mon.0) 3025 : audit 1 from='client.26258 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:20:58.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:57 smithi050 bash[28929]: audit 2024-05-20T22:20:56.776025+0000 mon.c (mon.2) 366 : audit 1 from='client.? v1:172.21.15.50:0/1720024892' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:20:58.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:57 smithi050 bash[28929]: audit 2024-05-20T22:20:56.776313+0000 mon.a (mon.0) 3026 : audit 1 from='client.26258 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:20:58.198 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:57 smithi050 bash[28929]: audit 2024-05-20T22:20:56.776786+0000 mon.c (mon.2) 367 : audit 1 from='client.? v1:172.21.15.50:0/1720024892' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:20:58.201 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:57 smithi050 bash[28929]: audit 2024-05-20T22:20:56.777102+0000 mon.a (mon.0) 3027 : audit 1 from='client.26258 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:20:58.640 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:20:58 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:20:59.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:58 smithi145 bash[23893]: audit 2024-05-20T22:20:57.747819+0000 mon.a (mon.0) 3028 : audit 1 from='client.26258 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:20:59.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:58 smithi145 bash[23893]: cluster 2024-05-20T22:20:57.755413+0000 mon.a (mon.0) 3029 : cluster 0 osdmap e537: 8 total, 8 up, 8 in 2024-05-20T22:20:59.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:58 smithi145 bash[23893]: audit 2024-05-20T22:20:57.759369+0000 mon.c (mon.2) 368 : audit 1 from='client.? v1:172.21.15.50:0/1720024892' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi050-64110-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:20:59.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:58 smithi145 bash[23893]: audit 2024-05-20T22:20:57.760227+0000 mon.a (mon.0) 3030 : audit 1 from='client.26258 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi050-64110-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:20:59.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:58 smithi050 bash[21866]: audit 2024-05-20T22:20:57.747819+0000 mon.a (mon.0) 3028 : audit 1 from='client.26258 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:20:59.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:58 smithi050 bash[21866]: cluster 2024-05-20T22:20:57.755413+0000 mon.a (mon.0) 3029 : cluster 0 osdmap e537: 8 total, 8 up, 8 in 2024-05-20T22:20:59.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:58 smithi050 bash[21866]: audit 2024-05-20T22:20:57.759369+0000 mon.c (mon.2) 368 : audit 1 from='client.? v1:172.21.15.50:0/1720024892' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi050-64110-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:20:59.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:58 smithi050 bash[21866]: audit 2024-05-20T22:20:57.760227+0000 mon.a (mon.0) 3030 : audit 1 from='client.26258 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi050-64110-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:20:59.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:58 smithi050 bash[28929]: audit 2024-05-20T22:20:57.747819+0000 mon.a (mon.0) 3028 : audit 1 from='client.26258 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:20:59.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:58 smithi050 bash[28929]: cluster 2024-05-20T22:20:57.755413+0000 mon.a (mon.0) 3029 : cluster 0 osdmap e537: 8 total, 8 up, 8 in 2024-05-20T22:20:59.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:58 smithi050 bash[28929]: audit 2024-05-20T22:20:57.759369+0000 mon.c (mon.2) 368 : audit 1 from='client.? v1:172.21.15.50:0/1720024892' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi050-64110-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:20:59.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:58 smithi050 bash[28929]: audit 2024-05-20T22:20:57.760227+0000 mon.a (mon.0) 3030 : audit 1 from='client.26258 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi050-64110-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:20:59.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:20:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:20:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:21:00.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:59 smithi145 bash[23893]: audit 2024-05-20T22:20:58.219563+0000 mgr.y (mgr.14592) 566 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:00.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:59 smithi145 bash[23893]: cluster 2024-05-20T22:20:58.455068+0000 mgr.y (mgr.14592) 567 : cluster 0 pgmap v880: 324 pgs: 324 active+clean; 583 KiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:00.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:20:59 smithi145 bash[23893]: cluster 2024-05-20T22:20:59.229264+0000 mon.a (mon.0) 3031 : cluster 0 osdmap e538: 8 total, 8 up, 8 in 2024-05-20T22:21:00.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:59 smithi050 bash[21866]: audit 2024-05-20T22:20:58.219563+0000 mgr.y (mgr.14592) 566 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:00.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:59 smithi050 bash[21866]: cluster 2024-05-20T22:20:58.455068+0000 mgr.y (mgr.14592) 567 : cluster 0 pgmap v880: 324 pgs: 324 active+clean; 583 KiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:00.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:20:59 smithi050 bash[21866]: cluster 2024-05-20T22:20:59.229264+0000 mon.a (mon.0) 3031 : cluster 0 osdmap e538: 8 total, 8 up, 8 in 2024-05-20T22:21:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:59 smithi050 bash[28929]: audit 2024-05-20T22:20:58.219563+0000 mgr.y (mgr.14592) 566 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:59 smithi050 bash[28929]: cluster 2024-05-20T22:20:58.455068+0000 mgr.y (mgr.14592) 567 : cluster 0 pgmap v880: 324 pgs: 324 active+clean; 583 KiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:00.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:20:59 smithi050 bash[28929]: cluster 2024-05-20T22:20:59.229264+0000 mon.a (mon.0) 3031 : cluster 0 osdmap e538: 8 total, 8 up, 8 in 2024-05-20T22:21:01.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:00 smithi145 bash[23893]: audit 2024-05-20T22:20:59.760572+0000 mon.a (mon.0) 3032 : audit 1 from='client.26258 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi050-64110-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi050-64110-104"}]': finished 2024-05-20T22:21:01.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:00 smithi145 bash[23893]: cluster 2024-05-20T22:20:59.770795+0000 mon.a (mon.0) 3033 : cluster 0 osdmap e539: 8 total, 8 up, 8 in 2024-05-20T22:21:01.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:00 smithi145 bash[23893]: cluster 2024-05-20T22:21:00.771482+0000 mon.a (mon.0) 3034 : cluster 0 osdmap e540: 8 total, 8 up, 8 in 2024-05-20T22:21:01.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:00 smithi050 bash[21866]: audit 2024-05-20T22:20:59.760572+0000 mon.a (mon.0) 3032 : audit 1 from='client.26258 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi050-64110-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi050-64110-104"}]': finished 2024-05-20T22:21:01.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:00 smithi050 bash[21866]: cluster 2024-05-20T22:20:59.770795+0000 mon.a (mon.0) 3033 : cluster 0 osdmap e539: 8 total, 8 up, 8 in 2024-05-20T22:21:01.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:00 smithi050 bash[21866]: cluster 2024-05-20T22:21:00.771482+0000 mon.a (mon.0) 3034 : cluster 0 osdmap e540: 8 total, 8 up, 8 in 2024-05-20T22:21:01.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:00 smithi050 bash[28929]: audit 2024-05-20T22:20:59.760572+0000 mon.a (mon.0) 3032 : audit 1 from='client.26258 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi050-64110-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi050-64110-104"}]': finished 2024-05-20T22:21:01.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:00 smithi050 bash[28929]: cluster 2024-05-20T22:20:59.770795+0000 mon.a (mon.0) 3033 : cluster 0 osdmap e539: 8 total, 8 up, 8 in 2024-05-20T22:21:01.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:00 smithi050 bash[28929]: cluster 2024-05-20T22:21:00.771482+0000 mon.a (mon.0) 3034 : cluster 0 osdmap e540: 8 total, 8 up, 8 in 2024-05-20T22:21:02.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:01 smithi145 bash[23893]: cluster 2024-05-20T22:21:00.458114+0000 mgr.y (mgr.14592) 568 : cluster 0 pgmap v883: 332 pgs: 8 creating+peering, 324 active+clean; 583 KiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:02.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:01 smithi145 bash[23893]: cluster 2024-05-20T22:21:00.778026+0000 mon.a (mon.0) 3035 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:02.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:01 smithi050 bash[21866]: cluster 2024-05-20T22:21:00.458114+0000 mgr.y (mgr.14592) 568 : cluster 0 pgmap v883: 332 pgs: 8 creating+peering, 324 active+clean; 583 KiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:02.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:01 smithi050 bash[21866]: cluster 2024-05-20T22:21:00.778026+0000 mon.a (mon.0) 3035 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:02.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:01 smithi050 bash[28929]: cluster 2024-05-20T22:21:00.458114+0000 mgr.y (mgr.14592) 568 : cluster 0 pgmap v883: 332 pgs: 8 creating+peering, 324 active+clean; 583 KiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:02.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:01 smithi050 bash[28929]: cluster 2024-05-20T22:21:00.778026+0000 mon.a (mon.0) 3035 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:03.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:02 smithi145 bash[23893]: cluster 2024-05-20T22:21:01.805324+0000 mon.a (mon.0) 3036 : cluster 0 osdmap e541: 8 total, 8 up, 8 in 2024-05-20T22:21:03.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:02 smithi145 bash[23893]: audit 2024-05-20T22:21:01.813838+0000 mon.c (mon.2) 369 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:03.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:02 smithi145 bash[23893]: audit 2024-05-20T22:21:01.815304+0000 mon.a (mon.0) 3037 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:03.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:02 smithi145 bash[23893]: cluster 2024-05-20T22:21:02.459120+0000 mgr.y (mgr.14592) 569 : cluster 0 pgmap v886: 364 pgs: 32 unknown, 8 creating+peering, 324 active+clean; 583 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:03.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:02 smithi050 bash[28929]: cluster 2024-05-20T22:21:01.805324+0000 mon.a (mon.0) 3036 : cluster 0 osdmap e541: 8 total, 8 up, 8 in 2024-05-20T22:21:03.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:02 smithi050 bash[28929]: audit 2024-05-20T22:21:01.813838+0000 mon.c (mon.2) 369 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:03.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:02 smithi050 bash[28929]: audit 2024-05-20T22:21:01.815304+0000 mon.a (mon.0) 3037 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:03.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:02 smithi050 bash[28929]: cluster 2024-05-20T22:21:02.459120+0000 mgr.y (mgr.14592) 569 : cluster 0 pgmap v886: 364 pgs: 32 unknown, 8 creating+peering, 324 active+clean; 583 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:03.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:02 smithi050 bash[21866]: cluster 2024-05-20T22:21:01.805324+0000 mon.a (mon.0) 3036 : cluster 0 osdmap e541: 8 total, 8 up, 8 in 2024-05-20T22:21:03.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:02 smithi050 bash[21866]: audit 2024-05-20T22:21:01.813838+0000 mon.c (mon.2) 369 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:03.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:02 smithi050 bash[21866]: audit 2024-05-20T22:21:01.815304+0000 mon.a (mon.0) 3037 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:03.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:02 smithi050 bash[21866]: cluster 2024-05-20T22:21:02.459120+0000 mgr.y (mgr.14592) 569 : cluster 0 pgmap v886: 364 pgs: 32 unknown, 8 creating+peering, 324 active+clean; 583 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:04.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:03 smithi145 bash[23893]: audit 2024-05-20T22:21:02.807827+0000 mon.a (mon.0) 3038 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:21:04.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:03 smithi145 bash[23893]: cluster 2024-05-20T22:21:02.817323+0000 mon.a (mon.0) 3039 : cluster 0 osdmap e542: 8 total, 8 up, 8 in 2024-05-20T22:21:04.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:03 smithi050 bash[28929]: audit 2024-05-20T22:21:02.807827+0000 mon.a (mon.0) 3038 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:21:04.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:03 smithi050 bash[28929]: cluster 2024-05-20T22:21:02.817323+0000 mon.a (mon.0) 3039 : cluster 0 osdmap e542: 8 total, 8 up, 8 in 2024-05-20T22:21:04.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:03 smithi050 bash[21866]: audit 2024-05-20T22:21:02.807827+0000 mon.a (mon.0) 3038 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:21:04.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:03 smithi050 bash[21866]: cluster 2024-05-20T22:21:02.817323+0000 mon.a (mon.0) 3039 : cluster 0 osdmap e542: 8 total, 8 up, 8 in 2024-05-20T22:21:05.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:04 smithi145 bash[23893]: cluster 2024-05-20T22:21:03.827386+0000 mon.a (mon.0) 3040 : cluster 0 osdmap e543: 8 total, 8 up, 8 in 2024-05-20T22:21:05.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:04 smithi145 bash[23893]: audit 2024-05-20T22:21:03.830614+0000 mon.c (mon.2) 370 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:05.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:04 smithi145 bash[23893]: audit 2024-05-20T22:21:03.836008+0000 mon.a (mon.0) 3041 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:05.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:04 smithi145 bash[23893]: cluster 2024-05-20T22:21:04.460135+0000 mgr.y (mgr.14592) 570 : cluster 0 pgmap v889: 396 pgs: 64 unknown, 8 creating+peering, 324 active+clean; 583 KiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:05.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:04 smithi050 bash[21866]: cluster 2024-05-20T22:21:03.827386+0000 mon.a (mon.0) 3040 : cluster 0 osdmap e543: 8 total, 8 up, 8 in 2024-05-20T22:21:05.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:04 smithi050 bash[21866]: audit 2024-05-20T22:21:03.830614+0000 mon.c (mon.2) 370 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:05.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:04 smithi050 bash[21866]: audit 2024-05-20T22:21:03.836008+0000 mon.a (mon.0) 3041 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:05.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:04 smithi050 bash[21866]: cluster 2024-05-20T22:21:04.460135+0000 mgr.y (mgr.14592) 570 : cluster 0 pgmap v889: 396 pgs: 64 unknown, 8 creating+peering, 324 active+clean; 583 KiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:05.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:04 smithi050 bash[28929]: cluster 2024-05-20T22:21:03.827386+0000 mon.a (mon.0) 3040 : cluster 0 osdmap e543: 8 total, 8 up, 8 in 2024-05-20T22:21:05.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:04 smithi050 bash[28929]: audit 2024-05-20T22:21:03.830614+0000 mon.c (mon.2) 370 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:05.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:04 smithi050 bash[28929]: audit 2024-05-20T22:21:03.836008+0000 mon.a (mon.0) 3041 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:05.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:04 smithi050 bash[28929]: cluster 2024-05-20T22:21:04.460135+0000 mgr.y (mgr.14592) 570 : cluster 0 pgmap v889: 396 pgs: 64 unknown, 8 creating+peering, 324 active+clean; 583 KiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:06.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:05 smithi145 bash[23893]: audit 2024-05-20T22:21:04.829991+0000 mon.a (mon.0) 3042 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:21:06.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:05 smithi145 bash[23893]: cluster 2024-05-20T22:21:04.839766+0000 mon.a (mon.0) 3043 : cluster 0 osdmap e544: 8 total, 8 up, 8 in 2024-05-20T22:21:06.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:05 smithi145 bash[23893]: audit 2024-05-20T22:21:04.843233+0000 mon.c (mon.2) 371 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-107", "tierpool": "test-rados-api-smithi050-64110-107-cache"}]: dispatch 2024-05-20T22:21:06.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:05 smithi145 bash[23893]: audit 2024-05-20T22:21:04.843885+0000 mon.a (mon.0) 3044 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-107", "tierpool": "test-rados-api-smithi050-64110-107-cache"}]: dispatch 2024-05-20T22:21:06.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:05 smithi050 bash[21866]: audit 2024-05-20T22:21:04.829991+0000 mon.a (mon.0) 3042 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:21:06.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:05 smithi050 bash[21866]: cluster 2024-05-20T22:21:04.839766+0000 mon.a (mon.0) 3043 : cluster 0 osdmap e544: 8 total, 8 up, 8 in 2024-05-20T22:21:06.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:05 smithi050 bash[21866]: audit 2024-05-20T22:21:04.843233+0000 mon.c (mon.2) 371 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-107", "tierpool": "test-rados-api-smithi050-64110-107-cache"}]: dispatch 2024-05-20T22:21:06.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:05 smithi050 bash[21866]: audit 2024-05-20T22:21:04.843885+0000 mon.a (mon.0) 3044 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-107", "tierpool": "test-rados-api-smithi050-64110-107-cache"}]: dispatch 2024-05-20T22:21:06.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:05 smithi050 bash[28929]: audit 2024-05-20T22:21:04.829991+0000 mon.a (mon.0) 3042 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:21:06.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:05 smithi050 bash[28929]: cluster 2024-05-20T22:21:04.839766+0000 mon.a (mon.0) 3043 : cluster 0 osdmap e544: 8 total, 8 up, 8 in 2024-05-20T22:21:06.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:05 smithi050 bash[28929]: audit 2024-05-20T22:21:04.843233+0000 mon.c (mon.2) 371 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-107", "tierpool": "test-rados-api-smithi050-64110-107-cache"}]: dispatch 2024-05-20T22:21:06.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:05 smithi050 bash[28929]: audit 2024-05-20T22:21:04.843885+0000 mon.a (mon.0) 3044 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-107", "tierpool": "test-rados-api-smithi050-64110-107-cache"}]: dispatch 2024-05-20T22:21:07.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:06 smithi145 bash[23893]: audit 2024-05-20T22:21:05.832824+0000 mon.a (mon.0) 3045 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-107", "tierpool": "test-rados-api-smithi050-64110-107-cache"}]': finished 2024-05-20T22:21:07.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:06 smithi145 bash[23893]: cluster 2024-05-20T22:21:05.840078+0000 mon.a (mon.0) 3046 : cluster 0 osdmap e545: 8 total, 8 up, 8 in 2024-05-20T22:21:07.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:06 smithi145 bash[23893]: audit 2024-05-20T22:21:05.845000+0000 mon.c (mon.2) 372 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-107", "overlaypool": "test-rados-api-smithi050-64110-107-cache"}]: dispatch 2024-05-20T22:21:07.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:06 smithi145 bash[23893]: audit 2024-05-20T22:21:05.860827+0000 mon.a (mon.0) 3047 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-107", "overlaypool": "test-rados-api-smithi050-64110-107-cache"}]: dispatch 2024-05-20T22:21:07.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:06 smithi145 bash[23893]: cluster 2024-05-20T22:21:06.461109+0000 mgr.y (mgr.14592) 571 : cluster 0 pgmap v892: 396 pgs: 396 active+clean; 583 KiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:21:07.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:06 smithi050 bash[21866]: audit 2024-05-20T22:21:05.832824+0000 mon.a (mon.0) 3045 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-107", "tierpool": "test-rados-api-smithi050-64110-107-cache"}]': finished 2024-05-20T22:21:07.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:06 smithi050 bash[21866]: cluster 2024-05-20T22:21:05.840078+0000 mon.a (mon.0) 3046 : cluster 0 osdmap e545: 8 total, 8 up, 8 in 2024-05-20T22:21:07.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:06 smithi050 bash[21866]: audit 2024-05-20T22:21:05.845000+0000 mon.c (mon.2) 372 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-107", "overlaypool": "test-rados-api-smithi050-64110-107-cache"}]: dispatch 2024-05-20T22:21:07.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:06 smithi050 bash[21866]: audit 2024-05-20T22:21:05.860827+0000 mon.a (mon.0) 3047 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-107", "overlaypool": "test-rados-api-smithi050-64110-107-cache"}]: dispatch 2024-05-20T22:21:07.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:06 smithi050 bash[21866]: cluster 2024-05-20T22:21:06.461109+0000 mgr.y (mgr.14592) 571 : cluster 0 pgmap v892: 396 pgs: 396 active+clean; 583 KiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:21:07.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:06 smithi050 bash[28929]: audit 2024-05-20T22:21:05.832824+0000 mon.a (mon.0) 3045 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-107", "tierpool": "test-rados-api-smithi050-64110-107-cache"}]': finished 2024-05-20T22:21:07.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:06 smithi050 bash[28929]: cluster 2024-05-20T22:21:05.840078+0000 mon.a (mon.0) 3046 : cluster 0 osdmap e545: 8 total, 8 up, 8 in 2024-05-20T22:21:07.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:06 smithi050 bash[28929]: audit 2024-05-20T22:21:05.845000+0000 mon.c (mon.2) 372 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-107", "overlaypool": "test-rados-api-smithi050-64110-107-cache"}]: dispatch 2024-05-20T22:21:07.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:06 smithi050 bash[28929]: audit 2024-05-20T22:21:05.860827+0000 mon.a (mon.0) 3047 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-107", "overlaypool": "test-rados-api-smithi050-64110-107-cache"}]: dispatch 2024-05-20T22:21:07.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:06 smithi050 bash[28929]: cluster 2024-05-20T22:21:06.461109+0000 mgr.y (mgr.14592) 571 : cluster 0 pgmap v892: 396 pgs: 396 active+clean; 583 KiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:21:08.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:07 smithi145 bash[23893]: cluster 2024-05-20T22:21:06.846171+0000 mon.a (mon.0) 3048 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:08.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:07 smithi145 bash[23893]: audit 2024-05-20T22:21:06.855494+0000 mon.a (mon.0) 3049 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-107", "overlaypool": "test-rados-api-smithi050-64110-107-cache"}]': finished 2024-05-20T22:21:08.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:07 smithi145 bash[23893]: cluster 2024-05-20T22:21:06.865118+0000 mon.a (mon.0) 3050 : cluster 0 osdmap e546: 8 total, 8 up, 8 in 2024-05-20T22:21:08.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:07 smithi145 bash[23893]: audit 2024-05-20T22:21:06.867654+0000 mon.c (mon.2) 373 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-107-cache", "mode": "writeback"}]: dispatch 2024-05-20T22:21:08.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:07 smithi145 bash[23893]: audit 2024-05-20T22:21:06.869069+0000 mon.a (mon.0) 3051 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-107-cache", "mode": "writeback"}]: dispatch 2024-05-20T22:21:08.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:07 smithi050 bash[21866]: cluster 2024-05-20T22:21:06.846171+0000 mon.a (mon.0) 3048 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:08.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:07 smithi050 bash[21866]: audit 2024-05-20T22:21:06.855494+0000 mon.a (mon.0) 3049 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-107", "overlaypool": "test-rados-api-smithi050-64110-107-cache"}]': finished 2024-05-20T22:21:08.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:07 smithi050 bash[21866]: cluster 2024-05-20T22:21:06.865118+0000 mon.a (mon.0) 3050 : cluster 0 osdmap e546: 8 total, 8 up, 8 in 2024-05-20T22:21:08.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:07 smithi050 bash[21866]: audit 2024-05-20T22:21:06.867654+0000 mon.c (mon.2) 373 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-107-cache", "mode": "writeback"}]: dispatch 2024-05-20T22:21:08.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:07 smithi050 bash[21866]: audit 2024-05-20T22:21:06.869069+0000 mon.a (mon.0) 3051 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-107-cache", "mode": "writeback"}]: dispatch 2024-05-20T22:21:08.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:07 smithi050 bash[28929]: cluster 2024-05-20T22:21:06.846171+0000 mon.a (mon.0) 3048 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:08.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:07 smithi050 bash[28929]: audit 2024-05-20T22:21:06.855494+0000 mon.a (mon.0) 3049 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-107", "overlaypool": "test-rados-api-smithi050-64110-107-cache"}]': finished 2024-05-20T22:21:08.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:07 smithi050 bash[28929]: cluster 2024-05-20T22:21:06.865118+0000 mon.a (mon.0) 3050 : cluster 0 osdmap e546: 8 total, 8 up, 8 in 2024-05-20T22:21:08.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:07 smithi050 bash[28929]: audit 2024-05-20T22:21:06.867654+0000 mon.c (mon.2) 373 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-107-cache", "mode": "writeback"}]: dispatch 2024-05-20T22:21:08.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:07 smithi050 bash[28929]: audit 2024-05-20T22:21:06.869069+0000 mon.a (mon.0) 3051 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-107-cache", "mode": "writeback"}]: dispatch 2024-05-20T22:21:08.640 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:21:08 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:21:09.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:08 smithi145 bash[23893]: cluster 2024-05-20T22:21:07.856413+0000 mon.a (mon.0) 3052 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:21:09.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:08 smithi145 bash[23893]: audit 2024-05-20T22:21:07.866087+0000 mon.a (mon.0) 3053 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-107-cache", "mode": "writeback"}]': finished 2024-05-20T22:21:09.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:08 smithi145 bash[23893]: cluster 2024-05-20T22:21:07.873064+0000 mon.a (mon.0) 3054 : cluster 0 osdmap e547: 8 total, 8 up, 8 in 2024-05-20T22:21:09.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:08 smithi145 bash[23893]: audit 2024-05-20T22:21:07.916394+0000 mon.c (mon.2) 374 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-107"}]: dispatch 2024-05-20T22:21:09.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:08 smithi145 bash[23893]: audit 2024-05-20T22:21:07.917096+0000 mon.a (mon.0) 3055 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-107"}]: dispatch 2024-05-20T22:21:09.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:08 smithi145 bash[23893]: audit 2024-05-20T22:21:08.230980+0000 mgr.y (mgr.14592) 572 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:09.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:08 smithi145 bash[23893]: audit 2024-05-20T22:21:08.316211+0000 mon.a (mon.0) 3056 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:21:09.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:08 smithi145 bash[23893]: audit 2024-05-20T22:21:08.318777+0000 mon.a (mon.0) 3057 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:21:09.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:08 smithi145 bash[23893]: cluster 2024-05-20T22:21:08.462096+0000 mgr.y (mgr.14592) 573 : cluster 0 pgmap v895: 396 pgs: 396 active+clean; 583 KiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:21:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:08 smithi050 bash[21866]: cluster 2024-05-20T22:21:07.856413+0000 mon.a (mon.0) 3052 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:21:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:08 smithi050 bash[21866]: audit 2024-05-20T22:21:07.866087+0000 mon.a (mon.0) 3053 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-107-cache", "mode": "writeback"}]': finished 2024-05-20T22:21:09.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:08 smithi050 bash[21866]: cluster 2024-05-20T22:21:07.873064+0000 mon.a (mon.0) 3054 : cluster 0 osdmap e547: 8 total, 8 up, 8 in 2024-05-20T22:21:09.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:08 smithi050 bash[21866]: audit 2024-05-20T22:21:07.916394+0000 mon.c (mon.2) 374 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-107"}]: dispatch 2024-05-20T22:21:09.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:08 smithi050 bash[21866]: audit 2024-05-20T22:21:07.917096+0000 mon.a (mon.0) 3055 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-107"}]: dispatch 2024-05-20T22:21:09.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:08 smithi050 bash[21866]: audit 2024-05-20T22:21:08.230980+0000 mgr.y (mgr.14592) 572 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:09.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:08 smithi050 bash[21866]: audit 2024-05-20T22:21:08.316211+0000 mon.a (mon.0) 3056 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:21:09.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:08 smithi050 bash[21866]: audit 2024-05-20T22:21:08.318777+0000 mon.a (mon.0) 3057 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:21:09.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:08 smithi050 bash[21866]: cluster 2024-05-20T22:21:08.462096+0000 mgr.y (mgr.14592) 573 : cluster 0 pgmap v895: 396 pgs: 396 active+clean; 583 KiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:21:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:08 smithi050 bash[28929]: cluster 2024-05-20T22:21:07.856413+0000 mon.a (mon.0) 3052 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:21:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:08 smithi050 bash[28929]: audit 2024-05-20T22:21:07.866087+0000 mon.a (mon.0) 3053 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-107-cache", "mode": "writeback"}]': finished 2024-05-20T22:21:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:08 smithi050 bash[28929]: cluster 2024-05-20T22:21:07.873064+0000 mon.a (mon.0) 3054 : cluster 0 osdmap e547: 8 total, 8 up, 8 in 2024-05-20T22:21:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:08 smithi050 bash[28929]: audit 2024-05-20T22:21:07.916394+0000 mon.c (mon.2) 374 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-107"}]: dispatch 2024-05-20T22:21:09.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:08 smithi050 bash[28929]: audit 2024-05-20T22:21:07.917096+0000 mon.a (mon.0) 3055 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-107"}]: dispatch 2024-05-20T22:21:09.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:08 smithi050 bash[28929]: audit 2024-05-20T22:21:08.230980+0000 mgr.y (mgr.14592) 572 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:09.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:08 smithi050 bash[28929]: audit 2024-05-20T22:21:08.316211+0000 mon.a (mon.0) 3056 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:21:09.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:08 smithi050 bash[28929]: audit 2024-05-20T22:21:08.318777+0000 mon.a (mon.0) 3057 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:21:09.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:08 smithi050 bash[28929]: cluster 2024-05-20T22:21:08.462096+0000 mgr.y (mgr.14592) 573 : cluster 0 pgmap v895: 396 pgs: 396 active+clean; 583 KiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:21:09.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:21:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:21:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:21:10.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:09 smithi145 bash[23893]: audit 2024-05-20T22:21:08.881980+0000 mon.a (mon.0) 3058 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-107"}]': finished 2024-05-20T22:21:10.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:09 smithi145 bash[23893]: cluster 2024-05-20T22:21:08.885821+0000 mon.a (mon.0) 3059 : cluster 0 osdmap e548: 8 total, 8 up, 8 in 2024-05-20T22:21:10.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:09 smithi145 bash[23893]: audit 2024-05-20T22:21:08.890992+0000 mon.c (mon.2) 375 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-107", "tierpool": "test-rados-api-smithi050-64110-107-cache"}]: dispatch 2024-05-20T22:21:10.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:09 smithi145 bash[23893]: audit 2024-05-20T22:21:08.891926+0000 mon.a (mon.0) 3060 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-107", "tierpool": "test-rados-api-smithi050-64110-107-cache"}]: dispatch 2024-05-20T22:21:10.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:09 smithi050 bash[21866]: audit 2024-05-20T22:21:08.881980+0000 mon.a (mon.0) 3058 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-107"}]': finished 2024-05-20T22:21:10.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:09 smithi050 bash[21866]: cluster 2024-05-20T22:21:08.885821+0000 mon.a (mon.0) 3059 : cluster 0 osdmap e548: 8 total, 8 up, 8 in 2024-05-20T22:21:10.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:09 smithi050 bash[21866]: audit 2024-05-20T22:21:08.890992+0000 mon.c (mon.2) 375 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-107", "tierpool": "test-rados-api-smithi050-64110-107-cache"}]: dispatch 2024-05-20T22:21:10.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:09 smithi050 bash[21866]: audit 2024-05-20T22:21:08.891926+0000 mon.a (mon.0) 3060 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-107", "tierpool": "test-rados-api-smithi050-64110-107-cache"}]: dispatch 2024-05-20T22:21:10.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:09 smithi050 bash[28929]: audit 2024-05-20T22:21:08.881980+0000 mon.a (mon.0) 3058 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-107"}]': finished 2024-05-20T22:21:10.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:09 smithi050 bash[28929]: cluster 2024-05-20T22:21:08.885821+0000 mon.a (mon.0) 3059 : cluster 0 osdmap e548: 8 total, 8 up, 8 in 2024-05-20T22:21:10.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:09 smithi050 bash[28929]: audit 2024-05-20T22:21:08.890992+0000 mon.c (mon.2) 375 : audit 1 from='client.? v1:172.21.15.50:0/2490015713' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-107", "tierpool": "test-rados-api-smithi050-64110-107-cache"}]: dispatch 2024-05-20T22:21:10.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:09 smithi050 bash[28929]: audit 2024-05-20T22:21:08.891926+0000 mon.a (mon.0) 3060 : audit 1 from='client.26264 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-107", "tierpool": "test-rados-api-smithi050-64110-107-cache"}]: dispatch 2024-05-20T22:21:11.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:10 smithi145 bash[23893]: cluster 2024-05-20T22:21:09.883230+0000 mon.a (mon.0) 3061 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:21:11.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:10 smithi145 bash[23893]: audit 2024-05-20T22:21:09.892696+0000 mon.a (mon.0) 3062 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-107", "tierpool": "test-rados-api-smithi050-64110-107-cache"}]': finished 2024-05-20T22:21:11.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:10 smithi145 bash[23893]: cluster 2024-05-20T22:21:09.899625+0000 mon.a (mon.0) 3063 : cluster 0 osdmap e549: 8 total, 8 up, 8 in 2024-05-20T22:21:11.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:10 smithi145 bash[23893]: cluster 2024-05-20T22:21:10.465597+0000 mgr.y (mgr.14592) 574 : cluster 0 pgmap v898: 396 pgs: 396 active+clean; 583 KiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:21:11.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:10 smithi050 bash[21866]: cluster 2024-05-20T22:21:09.883230+0000 mon.a (mon.0) 3061 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:21:11.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:10 smithi050 bash[21866]: audit 2024-05-20T22:21:09.892696+0000 mon.a (mon.0) 3062 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-107", "tierpool": "test-rados-api-smithi050-64110-107-cache"}]': finished 2024-05-20T22:21:11.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:10 smithi050 bash[21866]: cluster 2024-05-20T22:21:09.899625+0000 mon.a (mon.0) 3063 : cluster 0 osdmap e549: 8 total, 8 up, 8 in 2024-05-20T22:21:11.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:10 smithi050 bash[21866]: cluster 2024-05-20T22:21:10.465597+0000 mgr.y (mgr.14592) 574 : cluster 0 pgmap v898: 396 pgs: 396 active+clean; 583 KiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:21:11.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:10 smithi050 bash[28929]: cluster 2024-05-20T22:21:09.883230+0000 mon.a (mon.0) 3061 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:21:11.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:10 smithi050 bash[28929]: audit 2024-05-20T22:21:09.892696+0000 mon.a (mon.0) 3062 : audit 1 from='client.26264 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-107", "tierpool": "test-rados-api-smithi050-64110-107-cache"}]': finished 2024-05-20T22:21:11.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:10 smithi050 bash[28929]: cluster 2024-05-20T22:21:09.899625+0000 mon.a (mon.0) 3063 : cluster 0 osdmap e549: 8 total, 8 up, 8 in 2024-05-20T22:21:11.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:10 smithi050 bash[28929]: cluster 2024-05-20T22:21:10.465597+0000 mgr.y (mgr.14592) 574 : cluster 0 pgmap v898: 396 pgs: 396 active+clean; 583 KiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:21:12.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:11 smithi050 bash[21866]: cluster 2024-05-20T22:21:10.908491+0000 mon.a (mon.0) 3064 : cluster 0 osdmap e550: 8 total, 8 up, 8 in 2024-05-20T22:21:12.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:11 smithi050 bash[28929]: cluster 2024-05-20T22:21:10.908491+0000 mon.a (mon.0) 3064 : cluster 0 osdmap e550: 8 total, 8 up, 8 in 2024-05-20T22:21:12.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:11 smithi145 bash[23893]: cluster 2024-05-20T22:21:10.908491+0000 mon.a (mon.0) 3064 : cluster 0 osdmap e550: 8 total, 8 up, 8 in 2024-05-20T22:21:13.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:12 smithi050 bash[21866]: cluster 2024-05-20T22:21:11.911151+0000 mon.a (mon.0) 3065 : cluster 0 osdmap e551: 8 total, 8 up, 8 in 2024-05-20T22:21:13.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:12 smithi050 bash[21866]: audit 2024-05-20T22:21:11.945729+0000 mon.a (mon.0) 3066 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-109"}]: dispatch 2024-05-20T22:21:13.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:12 smithi050 bash[21866]: audit 2024-05-20T22:21:11.947774+0000 mon.a (mon.0) 3067 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-109"}]: dispatch 2024-05-20T22:21:13.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:12 smithi050 bash[21866]: audit 2024-05-20T22:21:11.948136+0000 mon.a (mon.0) 3068 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64110-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:21:13.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:12 smithi050 bash[21866]: cluster 2024-05-20T22:21:12.466528+0000 mgr.y (mgr.14592) 575 : cluster 0 pgmap v901: 332 pgs: 332 active+clean; 583 KiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:13.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:12 smithi050 bash[28929]: cluster 2024-05-20T22:21:11.911151+0000 mon.a (mon.0) 3065 : cluster 0 osdmap e551: 8 total, 8 up, 8 in 2024-05-20T22:21:13.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:12 smithi050 bash[28929]: audit 2024-05-20T22:21:11.945729+0000 mon.a (mon.0) 3066 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-109"}]: dispatch 2024-05-20T22:21:13.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:12 smithi050 bash[28929]: audit 2024-05-20T22:21:11.947774+0000 mon.a (mon.0) 3067 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-109"}]: dispatch 2024-05-20T22:21:13.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:12 smithi050 bash[28929]: audit 2024-05-20T22:21:11.948136+0000 mon.a (mon.0) 3068 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64110-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:21:13.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:12 smithi050 bash[28929]: cluster 2024-05-20T22:21:12.466528+0000 mgr.y (mgr.14592) 575 : cluster 0 pgmap v901: 332 pgs: 332 active+clean; 583 KiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:13.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:12 smithi145 bash[23893]: cluster 2024-05-20T22:21:11.911151+0000 mon.a (mon.0) 3065 : cluster 0 osdmap e551: 8 total, 8 up, 8 in 2024-05-20T22:21:13.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:12 smithi145 bash[23893]: audit 2024-05-20T22:21:11.945729+0000 mon.a (mon.0) 3066 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-109"}]: dispatch 2024-05-20T22:21:13.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:12 smithi145 bash[23893]: audit 2024-05-20T22:21:11.947774+0000 mon.a (mon.0) 3067 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-109"}]: dispatch 2024-05-20T22:21:13.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:12 smithi145 bash[23893]: audit 2024-05-20T22:21:11.948136+0000 mon.a (mon.0) 3068 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64110-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:21:13.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:12 smithi145 bash[23893]: cluster 2024-05-20T22:21:12.466528+0000 mgr.y (mgr.14592) 575 : cluster 0 pgmap v901: 332 pgs: 332 active+clean; 583 KiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:14.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:14 smithi050 bash[21866]: audit 2024-05-20T22:21:12.926646+0000 mon.a (mon.0) 3069 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64110-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:21:14.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:14 smithi050 bash[21866]: cluster 2024-05-20T22:21:12.936729+0000 mon.a (mon.0) 3070 : cluster 0 osdmap e552: 8 total, 8 up, 8 in 2024-05-20T22:21:14.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:14 smithi050 bash[21866]: audit 2024-05-20T22:21:12.937963+0000 mon.a (mon.0) 3071 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64110-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64110-109"}]: dispatch 2024-05-20T22:21:14.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:14 smithi050 bash[28929]: audit 2024-05-20T22:21:12.926646+0000 mon.a (mon.0) 3069 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64110-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:21:14.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:14 smithi050 bash[28929]: cluster 2024-05-20T22:21:12.936729+0000 mon.a (mon.0) 3070 : cluster 0 osdmap e552: 8 total, 8 up, 8 in 2024-05-20T22:21:14.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:14 smithi050 bash[28929]: audit 2024-05-20T22:21:12.937963+0000 mon.a (mon.0) 3071 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64110-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64110-109"}]: dispatch 2024-05-20T22:21:14.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:14 smithi145 bash[23893]: audit 2024-05-20T22:21:12.926646+0000 mon.a (mon.0) 3069 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64110-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:21:14.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:14 smithi145 bash[23893]: cluster 2024-05-20T22:21:12.936729+0000 mon.a (mon.0) 3070 : cluster 0 osdmap e552: 8 total, 8 up, 8 in 2024-05-20T22:21:14.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:14 smithi145 bash[23893]: audit 2024-05-20T22:21:12.937963+0000 mon.a (mon.0) 3071 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64110-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64110-109"}]: dispatch 2024-05-20T22:21:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:15 smithi050 bash[21866]: cluster 2024-05-20T22:21:14.394865+0000 mon.a (mon.0) 3072 : cluster 0 osdmap e553: 8 total, 8 up, 8 in 2024-05-20T22:21:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:15 smithi050 bash[21866]: cluster 2024-05-20T22:21:14.467459+0000 mgr.y (mgr.14592) 576 : cluster 0 pgmap v904: 332 pgs: 332 active+clean; 583 KiB data, 590 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:15 smithi050 bash[21866]: audit 2024-05-20T22:21:14.933925+0000 mon.a (mon.0) 3073 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64110-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64110-109"}]': finished 2024-05-20T22:21:15.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:15 smithi050 bash[21866]: cluster 2024-05-20T22:21:14.938948+0000 mon.a (mon.0) 3074 : cluster 0 osdmap e554: 8 total, 8 up, 8 in 2024-05-20T22:21:15.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:15 smithi050 bash[28929]: cluster 2024-05-20T22:21:14.394865+0000 mon.a (mon.0) 3072 : cluster 0 osdmap e553: 8 total, 8 up, 8 in 2024-05-20T22:21:15.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:15 smithi050 bash[28929]: cluster 2024-05-20T22:21:14.467459+0000 mgr.y (mgr.14592) 576 : cluster 0 pgmap v904: 332 pgs: 332 active+clean; 583 KiB data, 590 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:15.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:15 smithi050 bash[28929]: audit 2024-05-20T22:21:14.933925+0000 mon.a (mon.0) 3073 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64110-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64110-109"}]': finished 2024-05-20T22:21:15.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:15 smithi050 bash[28929]: cluster 2024-05-20T22:21:14.938948+0000 mon.a (mon.0) 3074 : cluster 0 osdmap e554: 8 total, 8 up, 8 in 2024-05-20T22:21:15.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:15 smithi145 bash[23893]: cluster 2024-05-20T22:21:14.394865+0000 mon.a (mon.0) 3072 : cluster 0 osdmap e553: 8 total, 8 up, 8 in 2024-05-20T22:21:15.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:15 smithi145 bash[23893]: cluster 2024-05-20T22:21:14.467459+0000 mgr.y (mgr.14592) 576 : cluster 0 pgmap v904: 332 pgs: 332 active+clean; 583 KiB data, 590 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:15.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:15 smithi145 bash[23893]: audit 2024-05-20T22:21:14.933925+0000 mon.a (mon.0) 3073 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64110-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64110-109"}]': finished 2024-05-20T22:21:15.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:15 smithi145 bash[23893]: cluster 2024-05-20T22:21:14.938948+0000 mon.a (mon.0) 3074 : cluster 0 osdmap e554: 8 total, 8 up, 8 in 2024-05-20T22:21:17.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:16 smithi050 bash[21866]: cluster 2024-05-20T22:21:15.945289+0000 mon.a (mon.0) 3075 : cluster 0 osdmap e555: 8 total, 8 up, 8 in 2024-05-20T22:21:17.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:16 smithi050 bash[21866]: audit 2024-05-20T22:21:15.949394+0000 mon.a (mon.0) 3076 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:17.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:16 smithi050 bash[21866]: cluster 2024-05-20T22:21:16.468486+0000 mgr.y (mgr.14592) 577 : cluster 0 pgmap v907: 372 pgs: 32 unknown, 8 creating+peering, 332 active+clean; 583 KiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:16 smithi050 bash[28929]: cluster 2024-05-20T22:21:15.945289+0000 mon.a (mon.0) 3075 : cluster 0 osdmap e555: 8 total, 8 up, 8 in 2024-05-20T22:21:17.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:16 smithi050 bash[28929]: audit 2024-05-20T22:21:15.949394+0000 mon.a (mon.0) 3076 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:17.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:16 smithi050 bash[28929]: cluster 2024-05-20T22:21:16.468486+0000 mgr.y (mgr.14592) 577 : cluster 0 pgmap v907: 372 pgs: 32 unknown, 8 creating+peering, 332 active+clean; 583 KiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:17.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:16 smithi145 bash[23893]: cluster 2024-05-20T22:21:15.945289+0000 mon.a (mon.0) 3075 : cluster 0 osdmap e555: 8 total, 8 up, 8 in 2024-05-20T22:21:17.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:16 smithi145 bash[23893]: audit 2024-05-20T22:21:15.949394+0000 mon.a (mon.0) 3076 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:17.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:16 smithi145 bash[23893]: cluster 2024-05-20T22:21:16.468486+0000 mgr.y (mgr.14592) 577 : cluster 0 pgmap v907: 372 pgs: 32 unknown, 8 creating+peering, 332 active+clean; 583 KiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:18.237 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:17 smithi145 bash[23893]: cluster 2024-05-20T22:21:16.937625+0000 mon.a (mon.0) 3077 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:18.238 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:17 smithi145 bash[23893]: audit 2024-05-20T22:21:16.947362+0000 mon.a (mon.0) 3078 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:21:18.238 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:17 smithi145 bash[23893]: cluster 2024-05-20T22:21:16.956973+0000 mon.a (mon.0) 3079 : cluster 0 osdmap e556: 8 total, 8 up, 8 in 2024-05-20T22:21:18.238 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:17 smithi145 bash[23893]: audit 2024-05-20T22:21:16.963376+0000 mon.a (mon.0) 3080 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-109", "tierpool": "test-rados-api-smithi050-64110-109-cache"}]: dispatch 2024-05-20T22:21:18.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:17 smithi050 bash[21866]: cluster 2024-05-20T22:21:16.937625+0000 mon.a (mon.0) 3077 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:18.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:17 smithi050 bash[21866]: audit 2024-05-20T22:21:16.947362+0000 mon.a (mon.0) 3078 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:21:18.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:17 smithi050 bash[21866]: cluster 2024-05-20T22:21:16.956973+0000 mon.a (mon.0) 3079 : cluster 0 osdmap e556: 8 total, 8 up, 8 in 2024-05-20T22:21:18.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:17 smithi050 bash[21866]: audit 2024-05-20T22:21:16.963376+0000 mon.a (mon.0) 3080 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-109", "tierpool": "test-rados-api-smithi050-64110-109-cache"}]: dispatch 2024-05-20T22:21:18.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:17 smithi050 bash[28929]: cluster 2024-05-20T22:21:16.937625+0000 mon.a (mon.0) 3077 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:18.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:17 smithi050 bash[28929]: audit 2024-05-20T22:21:16.947362+0000 mon.a (mon.0) 3078 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:21:18.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:17 smithi050 bash[28929]: cluster 2024-05-20T22:21:16.956973+0000 mon.a (mon.0) 3079 : cluster 0 osdmap e556: 8 total, 8 up, 8 in 2024-05-20T22:21:18.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:17 smithi050 bash[28929]: audit 2024-05-20T22:21:16.963376+0000 mon.a (mon.0) 3080 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-109", "tierpool": "test-rados-api-smithi050-64110-109-cache"}]: dispatch 2024-05-20T22:21:18.640 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:21:18 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:21:19.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:18 smithi145 bash[23893]: audit 2024-05-20T22:21:17.950337+0000 mon.a (mon.0) 3081 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-109", "tierpool": "test-rados-api-smithi050-64110-109-cache"}]': finished 2024-05-20T22:21:19.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:18 smithi145 bash[23893]: cluster 2024-05-20T22:21:17.958511+0000 mon.a (mon.0) 3082 : cluster 0 osdmap e557: 8 total, 8 up, 8 in 2024-05-20T22:21:19.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:18 smithi145 bash[23893]: audit 2024-05-20T22:21:17.960987+0000 mon.a (mon.0) 3083 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-109", "overlaypool": "test-rados-api-smithi050-64110-109-cache"}]: dispatch 2024-05-20T22:21:19.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:18 smithi145 bash[23893]: audit 2024-05-20T22:21:18.242377+0000 mgr.y (mgr.14592) 578 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:19.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:18 smithi145 bash[23893]: cluster 2024-05-20T22:21:18.469465+0000 mgr.y (mgr.14592) 579 : cluster 0 pgmap v910: 372 pgs: 32 unknown, 8 creating+peering, 332 active+clean; 583 KiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:19.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:18 smithi050 bash[21866]: audit 2024-05-20T22:21:17.950337+0000 mon.a (mon.0) 3081 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-109", "tierpool": "test-rados-api-smithi050-64110-109-cache"}]': finished 2024-05-20T22:21:19.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:18 smithi050 bash[21866]: cluster 2024-05-20T22:21:17.958511+0000 mon.a (mon.0) 3082 : cluster 0 osdmap e557: 8 total, 8 up, 8 in 2024-05-20T22:21:19.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:18 smithi050 bash[21866]: audit 2024-05-20T22:21:17.960987+0000 mon.a (mon.0) 3083 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-109", "overlaypool": "test-rados-api-smithi050-64110-109-cache"}]: dispatch 2024-05-20T22:21:19.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:18 smithi050 bash[21866]: audit 2024-05-20T22:21:18.242377+0000 mgr.y (mgr.14592) 578 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:19.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:18 smithi050 bash[21866]: cluster 2024-05-20T22:21:18.469465+0000 mgr.y (mgr.14592) 579 : cluster 0 pgmap v910: 372 pgs: 32 unknown, 8 creating+peering, 332 active+clean; 583 KiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:19.392 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:18 smithi050 bash[28929]: audit 2024-05-20T22:21:17.950337+0000 mon.a (mon.0) 3081 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-109", "tierpool": "test-rados-api-smithi050-64110-109-cache"}]': finished 2024-05-20T22:21:19.392 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:18 smithi050 bash[28929]: cluster 2024-05-20T22:21:17.958511+0000 mon.a (mon.0) 3082 : cluster 0 osdmap e557: 8 total, 8 up, 8 in 2024-05-20T22:21:19.392 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:18 smithi050 bash[28929]: audit 2024-05-20T22:21:17.960987+0000 mon.a (mon.0) 3083 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-109", "overlaypool": "test-rados-api-smithi050-64110-109-cache"}]: dispatch 2024-05-20T22:21:19.392 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:18 smithi050 bash[28929]: audit 2024-05-20T22:21:18.242377+0000 mgr.y (mgr.14592) 578 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:19.392 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:18 smithi050 bash[28929]: cluster 2024-05-20T22:21:18.469465+0000 mgr.y (mgr.14592) 579 : cluster 0 pgmap v910: 372 pgs: 32 unknown, 8 creating+peering, 332 active+clean; 583 KiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:19.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:21:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:21:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:21:20.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:19 smithi145 bash[23893]: audit 2024-05-20T22:21:18.953012+0000 mon.a (mon.0) 3084 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-109", "overlaypool": "test-rados-api-smithi050-64110-109-cache"}]': finished 2024-05-20T22:21:20.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:19 smithi145 bash[23893]: cluster 2024-05-20T22:21:18.960362+0000 mon.a (mon.0) 3085 : cluster 0 osdmap e558: 8 total, 8 up, 8 in 2024-05-20T22:21:20.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:19 smithi145 bash[23893]: audit 2024-05-20T22:21:18.971003+0000 mon.a (mon.0) 3086 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-109-cache", "mode": "writeback"}]: dispatch 2024-05-20T22:21:20.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:19 smithi145 bash[23893]: cluster 2024-05-20T22:21:19.953463+0000 mon.a (mon.0) 3087 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:21:20.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:19 smithi145 bash[23893]: audit 2024-05-20T22:21:19.955933+0000 mon.a (mon.0) 3088 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-109-cache", "mode": "writeback"}]': finished 2024-05-20T22:21:20.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:19 smithi145 bash[23893]: cluster 2024-05-20T22:21:19.964108+0000 mon.a (mon.0) 3089 : cluster 0 osdmap e559: 8 total, 8 up, 8 in 2024-05-20T22:21:20.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:19 smithi145 bash[23893]: audit 2024-05-20T22:21:19.965781+0000 mon.a (mon.0) 3090 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:21:20.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:19 smithi050 bash[21866]: audit 2024-05-20T22:21:18.953012+0000 mon.a (mon.0) 3084 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-109", "overlaypool": "test-rados-api-smithi050-64110-109-cache"}]': finished 2024-05-20T22:21:20.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:19 smithi050 bash[21866]: cluster 2024-05-20T22:21:18.960362+0000 mon.a (mon.0) 3085 : cluster 0 osdmap e558: 8 total, 8 up, 8 in 2024-05-20T22:21:20.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:19 smithi050 bash[21866]: audit 2024-05-20T22:21:18.971003+0000 mon.a (mon.0) 3086 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-109-cache", "mode": "writeback"}]: dispatch 2024-05-20T22:21:20.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:19 smithi050 bash[21866]: cluster 2024-05-20T22:21:19.953463+0000 mon.a (mon.0) 3087 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:21:20.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:19 smithi050 bash[21866]: audit 2024-05-20T22:21:19.955933+0000 mon.a (mon.0) 3088 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-109-cache", "mode": "writeback"}]': finished 2024-05-20T22:21:20.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:19 smithi050 bash[21866]: cluster 2024-05-20T22:21:19.964108+0000 mon.a (mon.0) 3089 : cluster 0 osdmap e559: 8 total, 8 up, 8 in 2024-05-20T22:21:20.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:19 smithi050 bash[21866]: audit 2024-05-20T22:21:19.965781+0000 mon.a (mon.0) 3090 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:21:20.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:19 smithi050 bash[28929]: audit 2024-05-20T22:21:18.953012+0000 mon.a (mon.0) 3084 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-109", "overlaypool": "test-rados-api-smithi050-64110-109-cache"}]': finished 2024-05-20T22:21:20.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:19 smithi050 bash[28929]: cluster 2024-05-20T22:21:18.960362+0000 mon.a (mon.0) 3085 : cluster 0 osdmap e558: 8 total, 8 up, 8 in 2024-05-20T22:21:20.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:19 smithi050 bash[28929]: audit 2024-05-20T22:21:18.971003+0000 mon.a (mon.0) 3086 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-109-cache", "mode": "writeback"}]: dispatch 2024-05-20T22:21:20.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:19 smithi050 bash[28929]: cluster 2024-05-20T22:21:19.953463+0000 mon.a (mon.0) 3087 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:21:20.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:19 smithi050 bash[28929]: audit 2024-05-20T22:21:19.955933+0000 mon.a (mon.0) 3088 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-109-cache", "mode": "writeback"}]': finished 2024-05-20T22:21:20.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:19 smithi050 bash[28929]: cluster 2024-05-20T22:21:19.964108+0000 mon.a (mon.0) 3089 : cluster 0 osdmap e559: 8 total, 8 up, 8 in 2024-05-20T22:21:20.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:19 smithi050 bash[28929]: audit 2024-05-20T22:21:19.965781+0000 mon.a (mon.0) 3090 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:21:21.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:20 smithi145 bash[23893]: cluster 2024-05-20T22:21:20.472760+0000 mgr.y (mgr.14592) 580 : cluster 0 pgmap v913: 372 pgs: 372 active+clean; 583 KiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:21.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:20 smithi145 bash[23893]: audit 2024-05-20T22:21:20.959280+0000 mon.a (mon.0) 3091 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:21:21.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:20 smithi145 bash[23893]: cluster 2024-05-20T22:21:20.966183+0000 mon.a (mon.0) 3092 : cluster 0 osdmap e560: 8 total, 8 up, 8 in 2024-05-20T22:21:21.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:20 smithi145 bash[23893]: audit 2024-05-20T22:21:20.967428+0000 mon.a (mon.0) 3093 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:21:21.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:20 smithi050 bash[21866]: cluster 2024-05-20T22:21:20.472760+0000 mgr.y (mgr.14592) 580 : cluster 0 pgmap v913: 372 pgs: 372 active+clean; 583 KiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:21.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:20 smithi050 bash[21866]: audit 2024-05-20T22:21:20.959280+0000 mon.a (mon.0) 3091 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:21:21.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:20 smithi050 bash[21866]: cluster 2024-05-20T22:21:20.966183+0000 mon.a (mon.0) 3092 : cluster 0 osdmap e560: 8 total, 8 up, 8 in 2024-05-20T22:21:21.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:20 smithi050 bash[21866]: audit 2024-05-20T22:21:20.967428+0000 mon.a (mon.0) 3093 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:21:21.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:20 smithi050 bash[28929]: cluster 2024-05-20T22:21:20.472760+0000 mgr.y (mgr.14592) 580 : cluster 0 pgmap v913: 372 pgs: 372 active+clean; 583 KiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:21.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:20 smithi050 bash[28929]: audit 2024-05-20T22:21:20.959280+0000 mon.a (mon.0) 3091 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:21:21.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:20 smithi050 bash[28929]: cluster 2024-05-20T22:21:20.966183+0000 mon.a (mon.0) 3092 : cluster 0 osdmap e560: 8 total, 8 up, 8 in 2024-05-20T22:21:21.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:20 smithi050 bash[28929]: audit 2024-05-20T22:21:20.967428+0000 mon.a (mon.0) 3093 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:21:23.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:22 smithi145 bash[23893]: audit 2024-05-20T22:21:21.962147+0000 mon.a (mon.0) 3094 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:21:23.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:22 smithi145 bash[23893]: cluster 2024-05-20T22:21:21.970207+0000 mon.a (mon.0) 3095 : cluster 0 osdmap e561: 8 total, 8 up, 8 in 2024-05-20T22:21:23.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:22 smithi145 bash[23893]: audit 2024-05-20T22:21:21.971748+0000 mon.a (mon.0) 3096 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-05-20T22:21:23.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:22 smithi145 bash[23893]: cluster 2024-05-20T22:21:22.473781+0000 mgr.y (mgr.14592) 581 : cluster 0 pgmap v916: 372 pgs: 372 active+clean; 583 KiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:23.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:22 smithi050 bash[21866]: audit 2024-05-20T22:21:21.962147+0000 mon.a (mon.0) 3094 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:21:23.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:22 smithi050 bash[21866]: cluster 2024-05-20T22:21:21.970207+0000 mon.a (mon.0) 3095 : cluster 0 osdmap e561: 8 total, 8 up, 8 in 2024-05-20T22:21:23.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:22 smithi050 bash[21866]: audit 2024-05-20T22:21:21.971748+0000 mon.a (mon.0) 3096 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-05-20T22:21:23.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:22 smithi050 bash[21866]: cluster 2024-05-20T22:21:22.473781+0000 mgr.y (mgr.14592) 581 : cluster 0 pgmap v916: 372 pgs: 372 active+clean; 583 KiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:23.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:22 smithi050 bash[28929]: audit 2024-05-20T22:21:21.962147+0000 mon.a (mon.0) 3094 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:21:23.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:22 smithi050 bash[28929]: cluster 2024-05-20T22:21:21.970207+0000 mon.a (mon.0) 3095 : cluster 0 osdmap e561: 8 total, 8 up, 8 in 2024-05-20T22:21:23.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:22 smithi050 bash[28929]: audit 2024-05-20T22:21:21.971748+0000 mon.a (mon.0) 3096 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-05-20T22:21:23.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:22 smithi050 bash[28929]: cluster 2024-05-20T22:21:22.473781+0000 mgr.y (mgr.14592) 581 : cluster 0 pgmap v916: 372 pgs: 372 active+clean; 583 KiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:24.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:23 smithi145 bash[23893]: cluster 2024-05-20T22:21:22.963422+0000 mon.a (mon.0) 3097 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:21:24.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:23 smithi145 bash[23893]: audit 2024-05-20T22:21:22.974707+0000 mon.a (mon.0) 3098 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-05-20T22:21:24.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:23 smithi145 bash[23893]: cluster 2024-05-20T22:21:22.985300+0000 mon.a (mon.0) 3099 : cluster 0 osdmap e562: 8 total, 8 up, 8 in 2024-05-20T22:21:24.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:23 smithi145 bash[23893]: audit 2024-05-20T22:21:22.987244+0000 mon.a (mon.0) 3100 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-05-20T22:21:24.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:23 smithi145 bash[23893]: audit 2024-05-20T22:21:23.357692+0000 mon.a (mon.0) 3101 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:21:24.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:23 smithi145 bash[23893]: audit 2024-05-20T22:21:23.360349+0000 mon.a (mon.0) 3102 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:21:24.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:23 smithi050 bash[21866]: cluster 2024-05-20T22:21:22.963422+0000 mon.a (mon.0) 3097 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:21:24.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:23 smithi050 bash[21866]: audit 2024-05-20T22:21:22.974707+0000 mon.a (mon.0) 3098 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-05-20T22:21:24.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:23 smithi050 bash[21866]: cluster 2024-05-20T22:21:22.985300+0000 mon.a (mon.0) 3099 : cluster 0 osdmap e562: 8 total, 8 up, 8 in 2024-05-20T22:21:24.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:23 smithi050 bash[21866]: audit 2024-05-20T22:21:22.987244+0000 mon.a (mon.0) 3100 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-05-20T22:21:24.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:23 smithi050 bash[21866]: audit 2024-05-20T22:21:23.357692+0000 mon.a (mon.0) 3101 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:21:24.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:23 smithi050 bash[21866]: audit 2024-05-20T22:21:23.360349+0000 mon.a (mon.0) 3102 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:21:24.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:23 smithi050 bash[28929]: cluster 2024-05-20T22:21:22.963422+0000 mon.a (mon.0) 3097 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:21:24.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:23 smithi050 bash[28929]: audit 2024-05-20T22:21:22.974707+0000 mon.a (mon.0) 3098 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-05-20T22:21:24.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:23 smithi050 bash[28929]: cluster 2024-05-20T22:21:22.985300+0000 mon.a (mon.0) 3099 : cluster 0 osdmap e562: 8 total, 8 up, 8 in 2024-05-20T22:21:24.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:23 smithi050 bash[28929]: audit 2024-05-20T22:21:22.987244+0000 mon.a (mon.0) 3100 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-05-20T22:21:24.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:23 smithi050 bash[28929]: audit 2024-05-20T22:21:23.357692+0000 mon.a (mon.0) 3101 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:21:24.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:23 smithi050 bash[28929]: audit 2024-05-20T22:21:23.360349+0000 mon.a (mon.0) 3102 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:21:25.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:24 smithi145 bash[23893]: audit 2024-05-20T22:21:23.986354+0000 mon.a (mon.0) 3103 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-05-20T22:21:25.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:24 smithi145 bash[23893]: cluster 2024-05-20T22:21:23.992881+0000 mon.a (mon.0) 3104 : cluster 0 osdmap e563: 8 total, 8 up, 8 in 2024-05-20T22:21:25.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:24 smithi145 bash[23893]: audit 2024-05-20T22:21:24.088920+0000 mon.a (mon.0) 3105 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-109"}]: dispatch 2024-05-20T22:21:25.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:24 smithi145 bash[23893]: cluster 2024-05-20T22:21:24.474916+0000 mgr.y (mgr.14592) 582 : cluster 0 pgmap v919: 372 pgs: 372 active+clean; 583 KiB data, 591 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:25.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:24 smithi050 bash[21866]: audit 2024-05-20T22:21:23.986354+0000 mon.a (mon.0) 3103 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-05-20T22:21:25.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:24 smithi050 bash[21866]: cluster 2024-05-20T22:21:23.992881+0000 mon.a (mon.0) 3104 : cluster 0 osdmap e563: 8 total, 8 up, 8 in 2024-05-20T22:21:25.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:24 smithi050 bash[21866]: audit 2024-05-20T22:21:24.088920+0000 mon.a (mon.0) 3105 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-109"}]: dispatch 2024-05-20T22:21:25.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:24 smithi050 bash[21866]: cluster 2024-05-20T22:21:24.474916+0000 mgr.y (mgr.14592) 582 : cluster 0 pgmap v919: 372 pgs: 372 active+clean; 583 KiB data, 591 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:25.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:25 smithi050 bash[28929]: audit 2024-05-20T22:21:23.986354+0000 mon.a (mon.0) 3103 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-05-20T22:21:25.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:25 smithi050 bash[28929]: cluster 2024-05-20T22:21:23.992881+0000 mon.a (mon.0) 3104 : cluster 0 osdmap e563: 8 total, 8 up, 8 in 2024-05-20T22:21:25.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:25 smithi050 bash[28929]: audit 2024-05-20T22:21:24.088920+0000 mon.a (mon.0) 3105 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-109"}]: dispatch 2024-05-20T22:21:25.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:25 smithi050 bash[28929]: cluster 2024-05-20T22:21:24.474916+0000 mgr.y (mgr.14592) 582 : cluster 0 pgmap v919: 372 pgs: 372 active+clean; 583 KiB data, 591 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:26.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:26 smithi145 bash[23893]: audit 2024-05-20T22:21:24.996794+0000 mon.a (mon.0) 3106 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-109"}]': finished 2024-05-20T22:21:26.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:26 smithi145 bash[23893]: cluster 2024-05-20T22:21:25.007285+0000 mon.a (mon.0) 3107 : cluster 0 osdmap e564: 8 total, 8 up, 8 in 2024-05-20T22:21:26.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:26 smithi145 bash[23893]: audit 2024-05-20T22:21:25.011663+0000 mon.a (mon.0) 3108 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-109", "tierpool": "test-rados-api-smithi050-64110-109-cache"}]: dispatch 2024-05-20T22:21:26.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:26 smithi145 bash[23893]: cluster 2024-05-20T22:21:25.404271+0000 mon.a (mon.0) 3109 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:26.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:26 smithi050 bash[21866]: audit 2024-05-20T22:21:24.996794+0000 mon.a (mon.0) 3106 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-109"}]': finished 2024-05-20T22:21:26.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:26 smithi050 bash[21866]: cluster 2024-05-20T22:21:25.007285+0000 mon.a (mon.0) 3107 : cluster 0 osdmap e564: 8 total, 8 up, 8 in 2024-05-20T22:21:26.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:26 smithi050 bash[21866]: audit 2024-05-20T22:21:25.011663+0000 mon.a (mon.0) 3108 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-109", "tierpool": "test-rados-api-smithi050-64110-109-cache"}]: dispatch 2024-05-20T22:21:26.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:26 smithi050 bash[21866]: cluster 2024-05-20T22:21:25.404271+0000 mon.a (mon.0) 3109 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:26.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:26 smithi050 bash[28929]: audit 2024-05-20T22:21:24.996794+0000 mon.a (mon.0) 3106 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-109"}]': finished 2024-05-20T22:21:26.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:26 smithi050 bash[28929]: cluster 2024-05-20T22:21:25.007285+0000 mon.a (mon.0) 3107 : cluster 0 osdmap e564: 8 total, 8 up, 8 in 2024-05-20T22:21:26.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:26 smithi050 bash[28929]: audit 2024-05-20T22:21:25.011663+0000 mon.a (mon.0) 3108 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-109", "tierpool": "test-rados-api-smithi050-64110-109-cache"}]: dispatch 2024-05-20T22:21:26.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:26 smithi050 bash[28929]: cluster 2024-05-20T22:21:25.404271+0000 mon.a (mon.0) 3109 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:27.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:27 smithi145 bash[23893]: audit 2024-05-20T22:21:25.999533+0000 mon.a (mon.0) 3110 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-109", "tierpool": "test-rados-api-smithi050-64110-109-cache"}]': finished 2024-05-20T22:21:27.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:27 smithi145 bash[23893]: cluster 2024-05-20T22:21:26.006791+0000 mon.a (mon.0) 3111 : cluster 0 osdmap e565: 8 total, 8 up, 8 in 2024-05-20T22:21:27.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:27 smithi145 bash[23893]: cluster 2024-05-20T22:21:26.476016+0000 mgr.y (mgr.14592) 583 : cluster 0 pgmap v922: 372 pgs: 372 active+clean; 583 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:21:27.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:27 smithi145 bash[23893]: cluster 2024-05-20T22:21:27.009957+0000 mon.a (mon.0) 3112 : cluster 0 osdmap e566: 8 total, 8 up, 8 in 2024-05-20T22:21:27.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:27 smithi050 bash[21866]: audit 2024-05-20T22:21:25.999533+0000 mon.a (mon.0) 3110 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-109", "tierpool": "test-rados-api-smithi050-64110-109-cache"}]': finished 2024-05-20T22:21:27.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:27 smithi050 bash[21866]: cluster 2024-05-20T22:21:26.006791+0000 mon.a (mon.0) 3111 : cluster 0 osdmap e565: 8 total, 8 up, 8 in 2024-05-20T22:21:27.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:27 smithi050 bash[21866]: cluster 2024-05-20T22:21:26.476016+0000 mgr.y (mgr.14592) 583 : cluster 0 pgmap v922: 372 pgs: 372 active+clean; 583 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:21:27.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:27 smithi050 bash[21866]: cluster 2024-05-20T22:21:27.009957+0000 mon.a (mon.0) 3112 : cluster 0 osdmap e566: 8 total, 8 up, 8 in 2024-05-20T22:21:27.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:27 smithi050 bash[28929]: audit 2024-05-20T22:21:25.999533+0000 mon.a (mon.0) 3110 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-109", "tierpool": "test-rados-api-smithi050-64110-109-cache"}]': finished 2024-05-20T22:21:27.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:27 smithi050 bash[28929]: cluster 2024-05-20T22:21:26.006791+0000 mon.a (mon.0) 3111 : cluster 0 osdmap e565: 8 total, 8 up, 8 in 2024-05-20T22:21:27.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:27 smithi050 bash[28929]: cluster 2024-05-20T22:21:26.476016+0000 mgr.y (mgr.14592) 583 : cluster 0 pgmap v922: 372 pgs: 372 active+clean; 583 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:21:27.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:27 smithi050 bash[28929]: cluster 2024-05-20T22:21:27.009957+0000 mon.a (mon.0) 3112 : cluster 0 osdmap e566: 8 total, 8 up, 8 in 2024-05-20T22:21:28.639 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:21:28 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:21:29.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:29 smithi145 bash[23893]: cluster 2024-05-20T22:21:28.012836+0000 mon.a (mon.0) 3113 : cluster 0 osdmap e567: 8 total, 8 up, 8 in 2024-05-20T22:21:29.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:29 smithi145 bash[23893]: audit 2024-05-20T22:21:28.019978+0000 mon.a (mon.0) 3114 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-109"}]: dispatch 2024-05-20T22:21:29.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:29 smithi145 bash[23893]: audit 2024-05-20T22:21:28.244338+0000 mgr.y (mgr.14592) 584 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:29.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:29 smithi145 bash[23893]: cluster 2024-05-20T22:21:28.476948+0000 mgr.y (mgr.14592) 585 : cluster 0 pgmap v925: 332 pgs: 332 active+clean; 583 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:29.391 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:29 smithi050 bash[21866]: cluster 2024-05-20T22:21:28.012836+0000 mon.a (mon.0) 3113 : cluster 0 osdmap e567: 8 total, 8 up, 8 in 2024-05-20T22:21:29.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:29 smithi050 bash[21866]: audit 2024-05-20T22:21:28.019978+0000 mon.a (mon.0) 3114 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-109"}]: dispatch 2024-05-20T22:21:29.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:29 smithi050 bash[21866]: audit 2024-05-20T22:21:28.244338+0000 mgr.y (mgr.14592) 584 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:29.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:29 smithi050 bash[21866]: cluster 2024-05-20T22:21:28.476948+0000 mgr.y (mgr.14592) 585 : cluster 0 pgmap v925: 332 pgs: 332 active+clean; 583 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:29.392 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:29 smithi050 bash[28929]: cluster 2024-05-20T22:21:28.012836+0000 mon.a (mon.0) 3113 : cluster 0 osdmap e567: 8 total, 8 up, 8 in 2024-05-20T22:21:29.392 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:29 smithi050 bash[28929]: audit 2024-05-20T22:21:28.019978+0000 mon.a (mon.0) 3114 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-109"}]: dispatch 2024-05-20T22:21:29.392 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:29 smithi050 bash[28929]: audit 2024-05-20T22:21:28.244338+0000 mgr.y (mgr.14592) 584 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:29.392 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:29 smithi050 bash[28929]: cluster 2024-05-20T22:21:28.476948+0000 mgr.y (mgr.14592) 585 : cluster 0 pgmap v925: 332 pgs: 332 active+clean; 583 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:29.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:21:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:21:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:21:30.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:30 smithi145 bash[23893]: audit 2024-05-20T22:21:29.017225+0000 mon.a (mon.0) 3115 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-109"}]': finished 2024-05-20T22:21:30.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:30 smithi145 bash[23893]: cluster 2024-05-20T22:21:29.026532+0000 mon.a (mon.0) 3116 : cluster 0 osdmap e568: 8 total, 8 up, 8 in 2024-05-20T22:21:30.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:30 smithi145 bash[23893]: audit 2024-05-20T22:21:29.036827+0000 mon.a (mon.0) 3117 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-109"}]: dispatch 2024-05-20T22:21:30.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:30 smithi050 bash[28929]: audit 2024-05-20T22:21:29.017225+0000 mon.a (mon.0) 3115 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-109"}]': finished 2024-05-20T22:21:30.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:30 smithi050 bash[28929]: cluster 2024-05-20T22:21:29.026532+0000 mon.a (mon.0) 3116 : cluster 0 osdmap e568: 8 total, 8 up, 8 in 2024-05-20T22:21:30.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:30 smithi050 bash[28929]: audit 2024-05-20T22:21:29.036827+0000 mon.a (mon.0) 3117 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-109"}]: dispatch 2024-05-20T22:21:30.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:30 smithi050 bash[21866]: audit 2024-05-20T22:21:29.017225+0000 mon.a (mon.0) 3115 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-109"}]': finished 2024-05-20T22:21:30.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:30 smithi050 bash[21866]: cluster 2024-05-20T22:21:29.026532+0000 mon.a (mon.0) 3116 : cluster 0 osdmap e568: 8 total, 8 up, 8 in 2024-05-20T22:21:30.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:30 smithi050 bash[21866]: audit 2024-05-20T22:21:29.036827+0000 mon.a (mon.0) 3117 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-109"}]: dispatch 2024-05-20T22:21:31.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:31 smithi145 bash[23893]: audit 2024-05-20T22:21:30.020654+0000 mon.a (mon.0) 3118 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-109"}]': finished 2024-05-20T22:21:31.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:31 smithi145 bash[23893]: cluster 2024-05-20T22:21:30.028051+0000 mon.a (mon.0) 3119 : cluster 0 osdmap e569: 8 total, 8 up, 8 in 2024-05-20T22:21:31.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:31 smithi145 bash[23893]: cluster 2024-05-20T22:21:30.405426+0000 mon.a (mon.0) 3120 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:31.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:31 smithi145 bash[23893]: cluster 2024-05-20T22:21:30.480029+0000 mgr.y (mgr.14592) 586 : cluster 0 pgmap v928: 332 pgs: 332 active+clean; 583 KiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-05-20T22:21:31.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:31 smithi050 bash[21866]: audit 2024-05-20T22:21:30.020654+0000 mon.a (mon.0) 3118 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-109"}]': finished 2024-05-20T22:21:31.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:31 smithi050 bash[21866]: cluster 2024-05-20T22:21:30.028051+0000 mon.a (mon.0) 3119 : cluster 0 osdmap e569: 8 total, 8 up, 8 in 2024-05-20T22:21:31.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:31 smithi050 bash[21866]: cluster 2024-05-20T22:21:30.405426+0000 mon.a (mon.0) 3120 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:31.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:31 smithi050 bash[21866]: cluster 2024-05-20T22:21:30.480029+0000 mgr.y (mgr.14592) 586 : cluster 0 pgmap v928: 332 pgs: 332 active+clean; 583 KiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-05-20T22:21:31.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:31 smithi050 bash[28929]: audit 2024-05-20T22:21:30.020654+0000 mon.a (mon.0) 3118 : audit 1 from='client.? v1:172.21.15.50:0/1229418522' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-109"}]': finished 2024-05-20T22:21:31.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:31 smithi050 bash[28929]: cluster 2024-05-20T22:21:30.028051+0000 mon.a (mon.0) 3119 : cluster 0 osdmap e569: 8 total, 8 up, 8 in 2024-05-20T22:21:31.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:31 smithi050 bash[28929]: cluster 2024-05-20T22:21:30.405426+0000 mon.a (mon.0) 3120 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:31.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:31 smithi050 bash[28929]: cluster 2024-05-20T22:21:30.480029+0000 mgr.y (mgr.14592) 586 : cluster 0 pgmap v928: 332 pgs: 332 active+clean; 583 KiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-05-20T22:21:32.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:32 smithi145 bash[23893]: cluster 2024-05-20T22:21:31.050104+0000 mon.a (mon.0) 3121 : cluster 0 osdmap e570: 8 total, 8 up, 8 in 2024-05-20T22:21:32.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:32 smithi145 bash[23893]: audit 2024-05-20T22:21:31.056900+0000 mon.c (mon.2) 376 : audit 1 from='client.? v1:172.21.15.50:0/1720024892' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:21:32.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:32 smithi145 bash[23893]: audit 2024-05-20T22:21:31.058162+0000 mon.a (mon.0) 3122 : audit 1 from='client.26258 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:21:32.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:32 smithi050 bash[21866]: cluster 2024-05-20T22:21:31.050104+0000 mon.a (mon.0) 3121 : cluster 0 osdmap e570: 8 total, 8 up, 8 in 2024-05-20T22:21:32.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:32 smithi050 bash[21866]: audit 2024-05-20T22:21:31.056900+0000 mon.c (mon.2) 376 : audit 1 from='client.? v1:172.21.15.50:0/1720024892' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:21:32.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:32 smithi050 bash[21866]: audit 2024-05-20T22:21:31.058162+0000 mon.a (mon.0) 3122 : audit 1 from='client.26258 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:21:32.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:32 smithi050 bash[28929]: cluster 2024-05-20T22:21:31.050104+0000 mon.a (mon.0) 3121 : cluster 0 osdmap e570: 8 total, 8 up, 8 in 2024-05-20T22:21:32.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:32 smithi050 bash[28929]: audit 2024-05-20T22:21:31.056900+0000 mon.c (mon.2) 376 : audit 1 from='client.? v1:172.21.15.50:0/1720024892' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:21:32.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:32 smithi050 bash[28929]: audit 2024-05-20T22:21:31.058162+0000 mon.a (mon.0) 3122 : audit 1 from='client.26258 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:21:33.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:33 smithi145 bash[23893]: audit 2024-05-20T22:21:32.045152+0000 mon.a (mon.0) 3123 : audit 1 from='client.26258 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104"}]': finished 2024-05-20T22:21:33.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:33 smithi145 bash[23893]: cluster 2024-05-20T22:21:32.052405+0000 mon.a (mon.0) 3124 : cluster 0 osdmap e571: 8 total, 8 up, 8 in 2024-05-20T22:21:33.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:33 smithi145 bash[23893]: audit 2024-05-20T22:21:32.053881+0000 mon.c (mon.2) 377 : audit 1 from='client.? v1:172.21.15.50:0/1720024892' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:21:33.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:33 smithi145 bash[23893]: audit 2024-05-20T22:21:32.058604+0000 mon.a (mon.0) 3125 : audit 1 from='client.26258 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:21:33.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:33 smithi145 bash[23893]: cluster 2024-05-20T22:21:32.481243+0000 mgr.y (mgr.14592) 587 : cluster 0 pgmap v931: 324 pgs: 324 active+clean; 583 KiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-05-20T22:21:33.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:33 smithi145 bash[23893]: audit 2024-05-20T22:21:33.048760+0000 mon.a (mon.0) 3126 : audit 1 from='client.26258 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi050-64110-104"}]': finished 2024-05-20T22:21:33.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:33 smithi145 bash[23893]: cluster 2024-05-20T22:21:33.055752+0000 mon.a (mon.0) 3127 : cluster 0 osdmap e572: 8 total, 8 up, 8 in 2024-05-20T22:21:33.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:33 smithi050 bash[21866]: audit 2024-05-20T22:21:32.045152+0000 mon.a (mon.0) 3123 : audit 1 from='client.26258 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104"}]': finished 2024-05-20T22:21:33.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:33 smithi050 bash[21866]: cluster 2024-05-20T22:21:32.052405+0000 mon.a (mon.0) 3124 : cluster 0 osdmap e571: 8 total, 8 up, 8 in 2024-05-20T22:21:33.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:33 smithi050 bash[21866]: audit 2024-05-20T22:21:32.053881+0000 mon.c (mon.2) 377 : audit 1 from='client.? v1:172.21.15.50:0/1720024892' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:21:33.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:33 smithi050 bash[21866]: audit 2024-05-20T22:21:32.058604+0000 mon.a (mon.0) 3125 : audit 1 from='client.26258 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:21:33.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:33 smithi050 bash[21866]: cluster 2024-05-20T22:21:32.481243+0000 mgr.y (mgr.14592) 587 : cluster 0 pgmap v931: 324 pgs: 324 active+clean; 583 KiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-05-20T22:21:33.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:33 smithi050 bash[21866]: audit 2024-05-20T22:21:33.048760+0000 mon.a (mon.0) 3126 : audit 1 from='client.26258 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi050-64110-104"}]': finished 2024-05-20T22:21:33.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:33 smithi050 bash[21866]: cluster 2024-05-20T22:21:33.055752+0000 mon.a (mon.0) 3127 : cluster 0 osdmap e572: 8 total, 8 up, 8 in 2024-05-20T22:21:33.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:33 smithi050 bash[28929]: audit 2024-05-20T22:21:32.045152+0000 mon.a (mon.0) 3123 : audit 1 from='client.26258 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi050-64110-104"}]': finished 2024-05-20T22:21:33.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:33 smithi050 bash[28929]: cluster 2024-05-20T22:21:32.052405+0000 mon.a (mon.0) 3124 : cluster 0 osdmap e571: 8 total, 8 up, 8 in 2024-05-20T22:21:33.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:33 smithi050 bash[28929]: audit 2024-05-20T22:21:32.053881+0000 mon.c (mon.2) 377 : audit 1 from='client.? v1:172.21.15.50:0/1720024892' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:21:33.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:33 smithi050 bash[28929]: audit 2024-05-20T22:21:32.058604+0000 mon.a (mon.0) 3125 : audit 1 from='client.26258 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi050-64110-104"}]: dispatch 2024-05-20T22:21:33.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:33 smithi050 bash[28929]: cluster 2024-05-20T22:21:32.481243+0000 mgr.y (mgr.14592) 587 : cluster 0 pgmap v931: 324 pgs: 324 active+clean; 583 KiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-05-20T22:21:33.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:33 smithi050 bash[28929]: audit 2024-05-20T22:21:33.048760+0000 mon.a (mon.0) 3126 : audit 1 from='client.26258 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi050-64110-104"}]': finished 2024-05-20T22:21:33.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:33 smithi050 bash[28929]: cluster 2024-05-20T22:21:33.055752+0000 mon.a (mon.0) 3127 : cluster 0 osdmap e572: 8 total, 8 up, 8 in 2024-05-20T22:21:34.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:34 smithi145 bash[23893]: audit 2024-05-20T22:21:33.087334+0000 mon.c (mon.2) 378 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:34.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:34 smithi145 bash[23893]: audit 2024-05-20T22:21:33.088111+0000 mon.a (mon.0) 3128 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:34.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:34 smithi145 bash[23893]: audit 2024-05-20T22:21:33.089196+0000 mon.c (mon.2) 379 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:34.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:34 smithi145 bash[23893]: audit 2024-05-20T22:21:33.089465+0000 mon.a (mon.0) 3129 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:34.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:34 smithi145 bash[23893]: audit 2024-05-20T22:21:33.089958+0000 mon.c (mon.2) 380 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64110-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:21:34.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:34 smithi145 bash[23893]: audit 2024-05-20T22:21:33.090220+0000 mon.a (mon.0) 3130 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64110-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:21:34.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:34 smithi050 bash[21866]: audit 2024-05-20T22:21:33.087334+0000 mon.c (mon.2) 378 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:34.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:34 smithi050 bash[21866]: audit 2024-05-20T22:21:33.088111+0000 mon.a (mon.0) 3128 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:34.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:34 smithi050 bash[21866]: audit 2024-05-20T22:21:33.089196+0000 mon.c (mon.2) 379 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:34.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:34 smithi050 bash[21866]: audit 2024-05-20T22:21:33.089465+0000 mon.a (mon.0) 3129 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:34.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:34 smithi050 bash[21866]: audit 2024-05-20T22:21:33.089958+0000 mon.c (mon.2) 380 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64110-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:21:34.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:34 smithi050 bash[21866]: audit 2024-05-20T22:21:33.090220+0000 mon.a (mon.0) 3130 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64110-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:21:34.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:34 smithi050 bash[28929]: audit 2024-05-20T22:21:33.087334+0000 mon.c (mon.2) 378 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:34.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:34 smithi050 bash[28929]: audit 2024-05-20T22:21:33.088111+0000 mon.a (mon.0) 3128 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:34.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:34 smithi050 bash[28929]: audit 2024-05-20T22:21:33.089196+0000 mon.c (mon.2) 379 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:34.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:34 smithi050 bash[28929]: audit 2024-05-20T22:21:33.089465+0000 mon.a (mon.0) 3129 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:34.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:34 smithi050 bash[28929]: audit 2024-05-20T22:21:33.089958+0000 mon.c (mon.2) 380 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64110-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:21:34.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:34 smithi050 bash[28929]: audit 2024-05-20T22:21:33.090220+0000 mon.a (mon.0) 3130 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64110-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T22:21:35.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:35 smithi145 bash[23893]: audit 2024-05-20T22:21:34.086998+0000 mon.a (mon.0) 3131 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64110-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:21:35.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:35 smithi145 bash[23893]: cluster 2024-05-20T22:21:34.093694+0000 mon.a (mon.0) 3132 : cluster 0 osdmap e573: 8 total, 8 up, 8 in 2024-05-20T22:21:35.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:35 smithi145 bash[23893]: audit 2024-05-20T22:21:34.095921+0000 mon.c (mon.2) 381 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64110-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:35.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:35 smithi145 bash[23893]: audit 2024-05-20T22:21:34.096770+0000 mon.a (mon.0) 3133 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64110-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:35.391 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:35 smithi145 bash[23893]: cluster 2024-05-20T22:21:34.482169+0000 mgr.y (mgr.14592) 588 : cluster 0 pgmap v934: 324 pgs: 324 active+clean; 583 KiB data, 593 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:35.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:35 smithi050 bash[21866]: audit 2024-05-20T22:21:34.086998+0000 mon.a (mon.0) 3131 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64110-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:21:35.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:35 smithi050 bash[21866]: cluster 2024-05-20T22:21:34.093694+0000 mon.a (mon.0) 3132 : cluster 0 osdmap e573: 8 total, 8 up, 8 in 2024-05-20T22:21:35.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:35 smithi050 bash[21866]: audit 2024-05-20T22:21:34.095921+0000 mon.c (mon.2) 381 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64110-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:35.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:35 smithi050 bash[21866]: audit 2024-05-20T22:21:34.096770+0000 mon.a (mon.0) 3133 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64110-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:35.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:35 smithi050 bash[21866]: cluster 2024-05-20T22:21:34.482169+0000 mgr.y (mgr.14592) 588 : cluster 0 pgmap v934: 324 pgs: 324 active+clean; 583 KiB data, 593 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:35.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:35 smithi050 bash[28929]: audit 2024-05-20T22:21:34.086998+0000 mon.a (mon.0) 3131 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi050-64110-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-05-20T22:21:35.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:35 smithi050 bash[28929]: cluster 2024-05-20T22:21:34.093694+0000 mon.a (mon.0) 3132 : cluster 0 osdmap e573: 8 total, 8 up, 8 in 2024-05-20T22:21:35.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:35 smithi050 bash[28929]: audit 2024-05-20T22:21:34.095921+0000 mon.c (mon.2) 381 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64110-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:35.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:35 smithi050 bash[28929]: audit 2024-05-20T22:21:34.096770+0000 mon.a (mon.0) 3133 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64110-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:35.446 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:35 smithi050 bash[28929]: cluster 2024-05-20T22:21:34.482169+0000 mgr.y (mgr.14592) 588 : cluster 0 pgmap v934: 324 pgs: 324 active+clean; 583 KiB data, 593 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:36.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:36 smithi145 bash[23893]: cluster 2024-05-20T22:21:35.566991+0000 mon.a (mon.0) 3134 : cluster 0 osdmap e574: 8 total, 8 up, 8 in 2024-05-20T22:21:36.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:36 smithi145 bash[23893]: cluster 2024-05-20T22:21:35.567225+0000 mon.a (mon.0) 3135 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:36.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:36 smithi050 bash[21866]: cluster 2024-05-20T22:21:35.566991+0000 mon.a (mon.0) 3134 : cluster 0 osdmap e574: 8 total, 8 up, 8 in 2024-05-20T22:21:36.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:36 smithi050 bash[21866]: cluster 2024-05-20T22:21:35.567225+0000 mon.a (mon.0) 3135 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:36.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:36 smithi050 bash[28929]: cluster 2024-05-20T22:21:35.566991+0000 mon.a (mon.0) 3134 : cluster 0 osdmap e574: 8 total, 8 up, 8 in 2024-05-20T22:21:36.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:36 smithi050 bash[28929]: cluster 2024-05-20T22:21:35.567225+0000 mon.a (mon.0) 3135 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:37.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:37 smithi050 bash[21866]: audit 2024-05-20T22:21:36.099685+0000 mon.a (mon.0) 3136 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64110-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:21:37.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:37 smithi050 bash[21866]: cluster 2024-05-20T22:21:36.108051+0000 mon.a (mon.0) 3137 : cluster 0 osdmap e575: 8 total, 8 up, 8 in 2024-05-20T22:21:37.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:37 smithi050 bash[21866]: cluster 2024-05-20T22:21:36.483079+0000 mgr.y (mgr.14592) 589 : cluster 0 pgmap v937: 332 pgs: 8 unknown, 324 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:37.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:37 smithi050 bash[28929]: audit 2024-05-20T22:21:36.099685+0000 mon.a (mon.0) 3136 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64110-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:21:37.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:37 smithi050 bash[28929]: cluster 2024-05-20T22:21:36.108051+0000 mon.a (mon.0) 3137 : cluster 0 osdmap e575: 8 total, 8 up, 8 in 2024-05-20T22:21:37.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:37 smithi050 bash[28929]: cluster 2024-05-20T22:21:36.483079+0000 mgr.y (mgr.14592) 589 : cluster 0 pgmap v937: 332 pgs: 8 unknown, 324 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:37.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:37 smithi145 bash[23893]: audit 2024-05-20T22:21:36.099685+0000 mon.a (mon.0) 3136 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi050-64110-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:21:37.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:37 smithi145 bash[23893]: cluster 2024-05-20T22:21:36.108051+0000 mon.a (mon.0) 3137 : cluster 0 osdmap e575: 8 total, 8 up, 8 in 2024-05-20T22:21:37.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:37 smithi145 bash[23893]: cluster 2024-05-20T22:21:36.483079+0000 mgr.y (mgr.14592) 589 : cluster 0 pgmap v937: 332 pgs: 8 unknown, 324 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:38.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:38 smithi050 bash[21866]: cluster 2024-05-20T22:21:37.115847+0000 mon.a (mon.0) 3138 : cluster 0 osdmap e576: 8 total, 8 up, 8 in 2024-05-20T22:21:38.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:38 smithi050 bash[21866]: audit 2024-05-20T22:21:37.118622+0000 mon.c (mon.2) 382 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:38.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:38 smithi050 bash[21866]: audit 2024-05-20T22:21:37.124602+0000 mon.a (mon.0) 3139 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:38.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:38 smithi050 bash[21866]: audit 2024-05-20T22:21:38.107727+0000 mon.a (mon.0) 3140 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:21:38.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:38 smithi050 bash[21866]: cluster 2024-05-20T22:21:38.116641+0000 mon.a (mon.0) 3141 : cluster 0 osdmap e577: 8 total, 8 up, 8 in 2024-05-20T22:21:38.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:38 smithi050 bash[28929]: cluster 2024-05-20T22:21:37.115847+0000 mon.a (mon.0) 3138 : cluster 0 osdmap e576: 8 total, 8 up, 8 in 2024-05-20T22:21:38.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:38 smithi050 bash[28929]: audit 2024-05-20T22:21:37.118622+0000 mon.c (mon.2) 382 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:38.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:38 smithi050 bash[28929]: audit 2024-05-20T22:21:37.124602+0000 mon.a (mon.0) 3139 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:38.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:38 smithi050 bash[28929]: audit 2024-05-20T22:21:38.107727+0000 mon.a (mon.0) 3140 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:21:38.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:38 smithi050 bash[28929]: cluster 2024-05-20T22:21:38.116641+0000 mon.a (mon.0) 3141 : cluster 0 osdmap e577: 8 total, 8 up, 8 in 2024-05-20T22:21:38.639 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:21:38 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:21:38.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:38 smithi145 bash[23893]: cluster 2024-05-20T22:21:37.115847+0000 mon.a (mon.0) 3138 : cluster 0 osdmap e576: 8 total, 8 up, 8 in 2024-05-20T22:21:38.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:38 smithi145 bash[23893]: audit 2024-05-20T22:21:37.118622+0000 mon.c (mon.2) 382 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:38.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:38 smithi145 bash[23893]: audit 2024-05-20T22:21:37.124602+0000 mon.a (mon.0) 3139 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:38.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:38 smithi145 bash[23893]: audit 2024-05-20T22:21:38.107727+0000 mon.a (mon.0) 3140 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:21:38.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:38 smithi145 bash[23893]: cluster 2024-05-20T22:21:38.116641+0000 mon.a (mon.0) 3141 : cluster 0 osdmap e577: 8 total, 8 up, 8 in 2024-05-20T22:21:39.443 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:21:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:21:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:21:39.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:39 smithi050 bash[21866]: audit 2024-05-20T22:21:38.172813+0000 mon.c (mon.2) 383 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:21:39.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:39 smithi050 bash[21866]: audit 2024-05-20T22:21:38.173828+0000 mon.a (mon.0) 3142 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:21:39.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:39 smithi050 bash[21866]: audit 2024-05-20T22:21:38.255989+0000 mgr.y (mgr.14592) 590 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:39.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:39 smithi050 bash[21866]: audit 2024-05-20T22:21:38.394404+0000 mon.a (mon.0) 3143 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:21:39.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:39 smithi050 bash[21866]: cluster 2024-05-20T22:21:38.484050+0000 mgr.y (mgr.14592) 591 : cluster 0 pgmap v940: 364 pgs: 40 unknown, 324 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:39.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:39 smithi050 bash[21866]: audit 2024-05-20T22:21:39.110510+0000 mon.a (mon.0) 3144 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-112", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:21:39.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:39 smithi050 bash[21866]: cluster 2024-05-20T22:21:39.117535+0000 mon.a (mon.0) 3145 : cluster 0 osdmap e578: 8 total, 8 up, 8 in 2024-05-20T22:21:39.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:39 smithi050 bash[21866]: audit 2024-05-20T22:21:39.122471+0000 mon.c (mon.2) 384 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-112"}]: dispatch 2024-05-20T22:21:39.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:39 smithi050 bash[21866]: audit 2024-05-20T22:21:39.124390+0000 mon.a (mon.0) 3146 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-112"}]: dispatch 2024-05-20T22:21:39.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:39 smithi050 bash[28929]: audit 2024-05-20T22:21:38.172813+0000 mon.c (mon.2) 383 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:21:39.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:39 smithi050 bash[28929]: audit 2024-05-20T22:21:38.173828+0000 mon.a (mon.0) 3142 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:21:39.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:39 smithi050 bash[28929]: audit 2024-05-20T22:21:38.255989+0000 mgr.y (mgr.14592) 590 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:39.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:39 smithi050 bash[28929]: audit 2024-05-20T22:21:38.394404+0000 mon.a (mon.0) 3143 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:21:39.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:39 smithi050 bash[28929]: cluster 2024-05-20T22:21:38.484050+0000 mgr.y (mgr.14592) 591 : cluster 0 pgmap v940: 364 pgs: 40 unknown, 324 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:39.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:39 smithi050 bash[28929]: audit 2024-05-20T22:21:39.110510+0000 mon.a (mon.0) 3144 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-112", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:21:39.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:39 smithi050 bash[28929]: cluster 2024-05-20T22:21:39.117535+0000 mon.a (mon.0) 3145 : cluster 0 osdmap e578: 8 total, 8 up, 8 in 2024-05-20T22:21:39.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:39 smithi050 bash[28929]: audit 2024-05-20T22:21:39.122471+0000 mon.c (mon.2) 384 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-112"}]: dispatch 2024-05-20T22:21:39.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:39 smithi050 bash[28929]: audit 2024-05-20T22:21:39.124390+0000 mon.a (mon.0) 3146 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-112"}]: dispatch 2024-05-20T22:21:39.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:39 smithi145 bash[23893]: audit 2024-05-20T22:21:38.172813+0000 mon.c (mon.2) 383 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:21:39.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:39 smithi145 bash[23893]: audit 2024-05-20T22:21:38.173828+0000 mon.a (mon.0) 3142 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:21:39.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:39 smithi145 bash[23893]: audit 2024-05-20T22:21:38.255989+0000 mgr.y (mgr.14592) 590 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:39.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:39 smithi145 bash[23893]: audit 2024-05-20T22:21:38.394404+0000 mon.a (mon.0) 3143 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:21:39.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:39 smithi145 bash[23893]: cluster 2024-05-20T22:21:38.484050+0000 mgr.y (mgr.14592) 591 : cluster 0 pgmap v940: 364 pgs: 40 unknown, 324 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:21:39.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:39 smithi145 bash[23893]: audit 2024-05-20T22:21:39.110510+0000 mon.a (mon.0) 3144 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-112", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:21:39.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:39 smithi145 bash[23893]: cluster 2024-05-20T22:21:39.117535+0000 mon.a (mon.0) 3145 : cluster 0 osdmap e578: 8 total, 8 up, 8 in 2024-05-20T22:21:39.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:39 smithi145 bash[23893]: audit 2024-05-20T22:21:39.122471+0000 mon.c (mon.2) 384 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-112"}]: dispatch 2024-05-20T22:21:39.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:39 smithi145 bash[23893]: audit 2024-05-20T22:21:39.124390+0000 mon.a (mon.0) 3146 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-112"}]: dispatch 2024-05-20T22:21:41.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:41 smithi145 bash[23893]: audit 2024-05-20T22:21:40.113263+0000 mon.a (mon.0) 3147 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-112"}]': finished 2024-05-20T22:21:41.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:41 smithi145 bash[23893]: cluster 2024-05-20T22:21:40.120981+0000 mon.a (mon.0) 3148 : cluster 0 osdmap e579: 8 total, 8 up, 8 in 2024-05-20T22:21:41.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:41 smithi145 bash[23893]: audit 2024-05-20T22:21:40.206421+0000 mon.c (mon.2) 385 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:41.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:41 smithi145 bash[23893]: audit 2024-05-20T22:21:40.207145+0000 mon.a (mon.0) 3149 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:41.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:41 smithi145 bash[23893]: cluster 2024-05-20T22:21:40.485047+0000 mgr.y (mgr.14592) 592 : cluster 0 pgmap v943: 364 pgs: 364 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:21:41.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:41 smithi145 bash[23893]: cluster 2024-05-20T22:21:40.568062+0000 mon.a (mon.0) 3150 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:41.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:41 smithi050 bash[21866]: audit 2024-05-20T22:21:40.113263+0000 mon.a (mon.0) 3147 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-112"}]': finished 2024-05-20T22:21:41.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:41 smithi050 bash[21866]: cluster 2024-05-20T22:21:40.120981+0000 mon.a (mon.0) 3148 : cluster 0 osdmap e579: 8 total, 8 up, 8 in 2024-05-20T22:21:41.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:41 smithi050 bash[21866]: audit 2024-05-20T22:21:40.206421+0000 mon.c (mon.2) 385 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:41.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:41 smithi050 bash[21866]: audit 2024-05-20T22:21:40.207145+0000 mon.a (mon.0) 3149 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:41.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:41 smithi050 bash[21866]: cluster 2024-05-20T22:21:40.485047+0000 mgr.y (mgr.14592) 592 : cluster 0 pgmap v943: 364 pgs: 364 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:21:41.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:41 smithi050 bash[21866]: cluster 2024-05-20T22:21:40.568062+0000 mon.a (mon.0) 3150 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:41.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:41 smithi050 bash[28929]: audit 2024-05-20T22:21:40.113263+0000 mon.a (mon.0) 3147 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-112"}]': finished 2024-05-20T22:21:41.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:41 smithi050 bash[28929]: cluster 2024-05-20T22:21:40.120981+0000 mon.a (mon.0) 3148 : cluster 0 osdmap e579: 8 total, 8 up, 8 in 2024-05-20T22:21:41.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:41 smithi050 bash[28929]: audit 2024-05-20T22:21:40.206421+0000 mon.c (mon.2) 385 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:41.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:41 smithi050 bash[28929]: audit 2024-05-20T22:21:40.207145+0000 mon.a (mon.0) 3149 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:41.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:41 smithi050 bash[28929]: cluster 2024-05-20T22:21:40.485047+0000 mgr.y (mgr.14592) 592 : cluster 0 pgmap v943: 364 pgs: 364 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:21:41.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:41 smithi050 bash[28929]: cluster 2024-05-20T22:21:40.568062+0000 mon.a (mon.0) 3150 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:42.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:42 smithi145 bash[23893]: audit 2024-05-20T22:21:41.122381+0000 mon.a (mon.0) 3151 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:21:42.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:42 smithi145 bash[23893]: cluster 2024-05-20T22:21:41.132195+0000 mon.a (mon.0) 3152 : cluster 0 osdmap e580: 8 total, 8 up, 8 in 2024-05-20T22:21:42.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:42 smithi145 bash[23893]: audit 2024-05-20T22:21:41.134042+0000 mon.c (mon.2) 386 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-112"}]: dispatch 2024-05-20T22:21:42.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:42 smithi145 bash[23893]: audit 2024-05-20T22:21:41.135605+0000 mon.a (mon.0) 3153 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-112"}]: dispatch 2024-05-20T22:21:42.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:42 smithi050 bash[21866]: audit 2024-05-20T22:21:41.122381+0000 mon.a (mon.0) 3151 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:21:42.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:42 smithi050 bash[21866]: cluster 2024-05-20T22:21:41.132195+0000 mon.a (mon.0) 3152 : cluster 0 osdmap e580: 8 total, 8 up, 8 in 2024-05-20T22:21:42.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:42 smithi050 bash[21866]: audit 2024-05-20T22:21:41.134042+0000 mon.c (mon.2) 386 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-112"}]: dispatch 2024-05-20T22:21:42.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:42 smithi050 bash[21866]: audit 2024-05-20T22:21:41.135605+0000 mon.a (mon.0) 3153 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-112"}]: dispatch 2024-05-20T22:21:42.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:42 smithi050 bash[28929]: audit 2024-05-20T22:21:41.122381+0000 mon.a (mon.0) 3151 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:21:42.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:42 smithi050 bash[28929]: cluster 2024-05-20T22:21:41.132195+0000 mon.a (mon.0) 3152 : cluster 0 osdmap e580: 8 total, 8 up, 8 in 2024-05-20T22:21:42.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:42 smithi050 bash[28929]: audit 2024-05-20T22:21:41.134042+0000 mon.c (mon.2) 386 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-112"}]: dispatch 2024-05-20T22:21:42.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:42 smithi050 bash[28929]: audit 2024-05-20T22:21:41.135605+0000 mon.a (mon.0) 3153 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-112"}]: dispatch 2024-05-20T22:21:43.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:43 smithi050 bash[21866]: audit 2024-05-20T22:21:42.132599+0000 mon.a (mon.0) 3154 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-112"}]': finished 2024-05-20T22:21:43.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:43 smithi050 bash[21866]: cluster 2024-05-20T22:21:42.139281+0000 mon.a (mon.0) 3155 : cluster 0 osdmap e581: 8 total, 8 up, 8 in 2024-05-20T22:21:43.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:43 smithi050 bash[21866]: cluster 2024-05-20T22:21:42.486177+0000 mgr.y (mgr.14592) 593 : cluster 0 pgmap v946: 364 pgs: 364 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:21:43.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:43 smithi050 bash[28929]: audit 2024-05-20T22:21:42.132599+0000 mon.a (mon.0) 3154 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-112"}]': finished 2024-05-20T22:21:43.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:43 smithi050 bash[28929]: cluster 2024-05-20T22:21:42.139281+0000 mon.a (mon.0) 3155 : cluster 0 osdmap e581: 8 total, 8 up, 8 in 2024-05-20T22:21:43.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:43 smithi050 bash[28929]: cluster 2024-05-20T22:21:42.486177+0000 mgr.y (mgr.14592) 593 : cluster 0 pgmap v946: 364 pgs: 364 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:21:43.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:43 smithi145 bash[23893]: audit 2024-05-20T22:21:42.132599+0000 mon.a (mon.0) 3154 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-112"}]': finished 2024-05-20T22:21:43.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:43 smithi145 bash[23893]: cluster 2024-05-20T22:21:42.139281+0000 mon.a (mon.0) 3155 : cluster 0 osdmap e581: 8 total, 8 up, 8 in 2024-05-20T22:21:43.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:43 smithi145 bash[23893]: cluster 2024-05-20T22:21:42.486177+0000 mgr.y (mgr.14592) 593 : cluster 0 pgmap v946: 364 pgs: 364 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:21:44.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:44 smithi050 bash[21866]: cluster 2024-05-20T22:21:43.153133+0000 mon.a (mon.0) 3156 : cluster 0 osdmap e582: 8 total, 8 up, 8 in 2024-05-20T22:21:44.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:44 smithi050 bash[28929]: cluster 2024-05-20T22:21:43.153133+0000 mon.a (mon.0) 3156 : cluster 0 osdmap e582: 8 total, 8 up, 8 in 2024-05-20T22:21:44.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:44 smithi145 bash[23893]: cluster 2024-05-20T22:21:43.153133+0000 mon.a (mon.0) 3156 : cluster 0 osdmap e582: 8 total, 8 up, 8 in 2024-05-20T22:21:45.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:45 smithi050 bash[21866]: cluster 2024-05-20T22:21:44.165285+0000 mon.a (mon.0) 3157 : cluster 0 osdmap e583: 8 total, 8 up, 8 in 2024-05-20T22:21:45.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:45 smithi050 bash[21866]: audit 2024-05-20T22:21:44.174672+0000 mon.c (mon.2) 387 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:45.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:45 smithi050 bash[21866]: audit 2024-05-20T22:21:44.179420+0000 mon.a (mon.0) 3158 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:45.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:45 smithi050 bash[21866]: cluster 2024-05-20T22:21:44.487189+0000 mgr.y (mgr.14592) 594 : cluster 0 pgmap v949: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:45.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:45 smithi050 bash[28929]: cluster 2024-05-20T22:21:44.165285+0000 mon.a (mon.0) 3157 : cluster 0 osdmap e583: 8 total, 8 up, 8 in 2024-05-20T22:21:45.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:45 smithi050 bash[28929]: audit 2024-05-20T22:21:44.174672+0000 mon.c (mon.2) 387 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:45.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:45 smithi050 bash[28929]: audit 2024-05-20T22:21:44.179420+0000 mon.a (mon.0) 3158 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:45.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:45 smithi050 bash[28929]: cluster 2024-05-20T22:21:44.487189+0000 mgr.y (mgr.14592) 594 : cluster 0 pgmap v949: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:45.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:45 smithi145 bash[23893]: cluster 2024-05-20T22:21:44.165285+0000 mon.a (mon.0) 3157 : cluster 0 osdmap e583: 8 total, 8 up, 8 in 2024-05-20T22:21:45.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:45 smithi145 bash[23893]: audit 2024-05-20T22:21:44.174672+0000 mon.c (mon.2) 387 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:45.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:45 smithi145 bash[23893]: audit 2024-05-20T22:21:44.179420+0000 mon.a (mon.0) 3158 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:45.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:45 smithi145 bash[23893]: cluster 2024-05-20T22:21:44.487189+0000 mgr.y (mgr.14592) 594 : cluster 0 pgmap v949: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:46 smithi050 bash[21866]: audit 2024-05-20T22:21:45.170955+0000 mon.a (mon.0) 3159 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:21:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:46 smithi050 bash[21866]: cluster 2024-05-20T22:21:45.181179+0000 mon.a (mon.0) 3160 : cluster 0 osdmap e584: 8 total, 8 up, 8 in 2024-05-20T22:21:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:46 smithi050 bash[21866]: audit 2024-05-20T22:21:45.227819+0000 mon.c (mon.2) 388 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:21:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:46 smithi050 bash[21866]: audit 2024-05-20T22:21:45.229028+0000 mon.a (mon.0) 3161 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:21:46.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:46 smithi050 bash[21866]: cluster 2024-05-20T22:21:45.569685+0000 mon.a (mon.0) 3162 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:46.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:46 smithi050 bash[28929]: audit 2024-05-20T22:21:45.170955+0000 mon.a (mon.0) 3159 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:21:46.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:46 smithi050 bash[28929]: cluster 2024-05-20T22:21:45.181179+0000 mon.a (mon.0) 3160 : cluster 0 osdmap e584: 8 total, 8 up, 8 in 2024-05-20T22:21:46.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:46 smithi050 bash[28929]: audit 2024-05-20T22:21:45.227819+0000 mon.c (mon.2) 388 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:21:46.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:46 smithi050 bash[28929]: audit 2024-05-20T22:21:45.229028+0000 mon.a (mon.0) 3161 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:21:46.445 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:46 smithi050 bash[28929]: cluster 2024-05-20T22:21:45.569685+0000 mon.a (mon.0) 3162 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:46.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:46 smithi145 bash[23893]: audit 2024-05-20T22:21:45.170955+0000 mon.a (mon.0) 3159 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:21:46.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:46 smithi145 bash[23893]: cluster 2024-05-20T22:21:45.181179+0000 mon.a (mon.0) 3160 : cluster 0 osdmap e584: 8 total, 8 up, 8 in 2024-05-20T22:21:46.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:46 smithi145 bash[23893]: audit 2024-05-20T22:21:45.227819+0000 mon.c (mon.2) 388 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:21:46.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:46 smithi145 bash[23893]: audit 2024-05-20T22:21:45.229028+0000 mon.a (mon.0) 3161 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:21:46.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:46 smithi145 bash[23893]: cluster 2024-05-20T22:21:45.569685+0000 mon.a (mon.0) 3162 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:47.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:47 smithi145 bash[23893]: audit 2024-05-20T22:21:46.173966+0000 mon.a (mon.0) 3163 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-114", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:21:47.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:47 smithi145 bash[23893]: cluster 2024-05-20T22:21:46.181340+0000 mon.a (mon.0) 3164 : cluster 0 osdmap e585: 8 total, 8 up, 8 in 2024-05-20T22:21:47.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:47 smithi145 bash[23893]: audit 2024-05-20T22:21:46.183744+0000 mon.c (mon.2) 389 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-114"}]: dispatch 2024-05-20T22:21:47.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:47 smithi145 bash[23893]: audit 2024-05-20T22:21:46.185679+0000 mon.a (mon.0) 3165 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-114"}]: dispatch 2024-05-20T22:21:47.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:47 smithi145 bash[23893]: cluster 2024-05-20T22:21:46.488357+0000 mgr.y (mgr.14592) 595 : cluster 0 pgmap v952: 364 pgs: 32 creating+peering, 332 active+clean; 583 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-05-20T22:21:47.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:47 smithi145 bash[23893]: audit 2024-05-20T22:21:47.176506+0000 mon.a (mon.0) 3166 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-114"}]': finished 2024-05-20T22:21:47.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:47 smithi145 bash[23893]: cluster 2024-05-20T22:21:47.183167+0000 mon.a (mon.0) 3167 : cluster 0 osdmap e586: 8 total, 8 up, 8 in 2024-05-20T22:21:47.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:47 smithi145 bash[23893]: audit 2024-05-20T22:21:47.185953+0000 mon.c (mon.2) 390 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-114", "mode": "writeback"}]: dispatch 2024-05-20T22:21:47.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:47 smithi050 bash[21866]: audit 2024-05-20T22:21:46.173966+0000 mon.a (mon.0) 3163 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-114", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:21:47.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:47 smithi050 bash[21866]: cluster 2024-05-20T22:21:46.181340+0000 mon.a (mon.0) 3164 : cluster 0 osdmap e585: 8 total, 8 up, 8 in 2024-05-20T22:21:47.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:47 smithi050 bash[21866]: audit 2024-05-20T22:21:46.183744+0000 mon.c (mon.2) 389 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-114"}]: dispatch 2024-05-20T22:21:47.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:47 smithi050 bash[21866]: audit 2024-05-20T22:21:46.185679+0000 mon.a (mon.0) 3165 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-114"}]: dispatch 2024-05-20T22:21:47.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:47 smithi050 bash[21866]: cluster 2024-05-20T22:21:46.488357+0000 mgr.y (mgr.14592) 595 : cluster 0 pgmap v952: 364 pgs: 32 creating+peering, 332 active+clean; 583 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-05-20T22:21:47.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:47 smithi050 bash[21866]: audit 2024-05-20T22:21:47.176506+0000 mon.a (mon.0) 3166 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-114"}]': finished 2024-05-20T22:21:47.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:47 smithi050 bash[21866]: cluster 2024-05-20T22:21:47.183167+0000 mon.a (mon.0) 3167 : cluster 0 osdmap e586: 8 total, 8 up, 8 in 2024-05-20T22:21:47.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:47 smithi050 bash[21866]: audit 2024-05-20T22:21:47.185953+0000 mon.c (mon.2) 390 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-114", "mode": "writeback"}]: dispatch 2024-05-20T22:21:47.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:47 smithi050 bash[28929]: audit 2024-05-20T22:21:46.173966+0000 mon.a (mon.0) 3163 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-114", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:21:47.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:47 smithi050 bash[28929]: cluster 2024-05-20T22:21:46.181340+0000 mon.a (mon.0) 3164 : cluster 0 osdmap e585: 8 total, 8 up, 8 in 2024-05-20T22:21:47.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:47 smithi050 bash[28929]: audit 2024-05-20T22:21:46.183744+0000 mon.c (mon.2) 389 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-114"}]: dispatch 2024-05-20T22:21:47.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:47 smithi050 bash[28929]: audit 2024-05-20T22:21:46.185679+0000 mon.a (mon.0) 3165 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-114"}]: dispatch 2024-05-20T22:21:47.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:47 smithi050 bash[28929]: cluster 2024-05-20T22:21:46.488357+0000 mgr.y (mgr.14592) 595 : cluster 0 pgmap v952: 364 pgs: 32 creating+peering, 332 active+clean; 583 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-05-20T22:21:47.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:47 smithi050 bash[28929]: audit 2024-05-20T22:21:47.176506+0000 mon.a (mon.0) 3166 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-114"}]': finished 2024-05-20T22:21:47.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:47 smithi050 bash[28929]: cluster 2024-05-20T22:21:47.183167+0000 mon.a (mon.0) 3167 : cluster 0 osdmap e586: 8 total, 8 up, 8 in 2024-05-20T22:21:47.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:47 smithi050 bash[28929]: audit 2024-05-20T22:21:47.185953+0000 mon.c (mon.2) 390 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-114", "mode": "writeback"}]: dispatch 2024-05-20T22:21:48.639 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:21:48 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:21:48.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:48 smithi145 bash[23893]: audit 2024-05-20T22:21:47.187484+0000 mon.a (mon.0) 3168 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-114", "mode": "writeback"}]: dispatch 2024-05-20T22:21:48.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:48 smithi145 bash[23893]: cluster 2024-05-20T22:21:48.176928+0000 mon.a (mon.0) 3169 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:21:48.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:48 smithi145 bash[23893]: audit 2024-05-20T22:21:48.179428+0000 mon.a (mon.0) 3170 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-114", "mode": "writeback"}]': finished 2024-05-20T22:21:48.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:48 smithi145 bash[23893]: cluster 2024-05-20T22:21:48.187352+0000 mon.a (mon.0) 3171 : cluster 0 osdmap e587: 8 total, 8 up, 8 in 2024-05-20T22:21:48.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:48 smithi050 bash[21866]: audit 2024-05-20T22:21:47.187484+0000 mon.a (mon.0) 3168 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-114", "mode": "writeback"}]: dispatch 2024-05-20T22:21:48.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:48 smithi050 bash[21866]: cluster 2024-05-20T22:21:48.176928+0000 mon.a (mon.0) 3169 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:21:48.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:48 smithi050 bash[21866]: audit 2024-05-20T22:21:48.179428+0000 mon.a (mon.0) 3170 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-114", "mode": "writeback"}]': finished 2024-05-20T22:21:48.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:48 smithi050 bash[21866]: cluster 2024-05-20T22:21:48.187352+0000 mon.a (mon.0) 3171 : cluster 0 osdmap e587: 8 total, 8 up, 8 in 2024-05-20T22:21:48.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:48 smithi050 bash[28929]: audit 2024-05-20T22:21:47.187484+0000 mon.a (mon.0) 3168 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-114", "mode": "writeback"}]: dispatch 2024-05-20T22:21:48.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:48 smithi050 bash[28929]: cluster 2024-05-20T22:21:48.176928+0000 mon.a (mon.0) 3169 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:21:48.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:48 smithi050 bash[28929]: audit 2024-05-20T22:21:48.179428+0000 mon.a (mon.0) 3170 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-114", "mode": "writeback"}]': finished 2024-05-20T22:21:48.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:48 smithi050 bash[28929]: cluster 2024-05-20T22:21:48.187352+0000 mon.a (mon.0) 3171 : cluster 0 osdmap e587: 8 total, 8 up, 8 in 2024-05-20T22:21:49.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:49 smithi145 bash[23893]: audit 2024-05-20T22:21:48.265620+0000 mgr.y (mgr.14592) 596 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:49.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:49 smithi145 bash[23893]: audit 2024-05-20T22:21:48.312004+0000 mon.c (mon.2) 391 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:49.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:49 smithi145 bash[23893]: audit 2024-05-20T22:21:48.312739+0000 mon.a (mon.0) 3172 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:49.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:49 smithi145 bash[23893]: cluster 2024-05-20T22:21:48.489378+0000 mgr.y (mgr.14592) 597 : cluster 0 pgmap v955: 364 pgs: 32 creating+peering, 332 active+clean; 583 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-05-20T22:21:49.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:21:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:21:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:21:49.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:49 smithi050 bash[21866]: audit 2024-05-20T22:21:48.265620+0000 mgr.y (mgr.14592) 596 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:49.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:49 smithi050 bash[21866]: audit 2024-05-20T22:21:48.312004+0000 mon.c (mon.2) 391 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:49.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:49 smithi050 bash[21866]: audit 2024-05-20T22:21:48.312739+0000 mon.a (mon.0) 3172 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:49.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:49 smithi050 bash[21866]: cluster 2024-05-20T22:21:48.489378+0000 mgr.y (mgr.14592) 597 : cluster 0 pgmap v955: 364 pgs: 32 creating+peering, 332 active+clean; 583 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-05-20T22:21:49.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:49 smithi050 bash[28929]: audit 2024-05-20T22:21:48.265620+0000 mgr.y (mgr.14592) 596 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:49.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:49 smithi050 bash[28929]: audit 2024-05-20T22:21:48.312004+0000 mon.c (mon.2) 391 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:49.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:49 smithi050 bash[28929]: audit 2024-05-20T22:21:48.312739+0000 mon.a (mon.0) 3172 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:21:49.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:49 smithi050 bash[28929]: cluster 2024-05-20T22:21:48.489378+0000 mgr.y (mgr.14592) 597 : cluster 0 pgmap v955: 364 pgs: 32 creating+peering, 332 active+clean; 583 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-05-20T22:21:50.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:50 smithi145 bash[23893]: audit 2024-05-20T22:21:49.219793+0000 mon.a (mon.0) 3173 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:21:50.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:50 smithi145 bash[23893]: cluster 2024-05-20T22:21:49.226840+0000 mon.a (mon.0) 3174 : cluster 0 osdmap e588: 8 total, 8 up, 8 in 2024-05-20T22:21:50.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:50 smithi145 bash[23893]: audit 2024-05-20T22:21:49.233585+0000 mon.c (mon.2) 392 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-114"}]: dispatch 2024-05-20T22:21:50.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:50 smithi145 bash[23893]: audit 2024-05-20T22:21:49.234546+0000 mon.a (mon.0) 3175 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-114"}]: dispatch 2024-05-20T22:21:50.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:50 smithi050 bash[21866]: audit 2024-05-20T22:21:49.219793+0000 mon.a (mon.0) 3173 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:21:50.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:50 smithi050 bash[21866]: cluster 2024-05-20T22:21:49.226840+0000 mon.a (mon.0) 3174 : cluster 0 osdmap e588: 8 total, 8 up, 8 in 2024-05-20T22:21:50.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:50 smithi050 bash[21866]: audit 2024-05-20T22:21:49.233585+0000 mon.c (mon.2) 392 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-114"}]: dispatch 2024-05-20T22:21:50.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:50 smithi050 bash[21866]: audit 2024-05-20T22:21:49.234546+0000 mon.a (mon.0) 3175 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-114"}]: dispatch 2024-05-20T22:21:50.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:50 smithi050 bash[28929]: audit 2024-05-20T22:21:49.219793+0000 mon.a (mon.0) 3173 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:21:50.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:50 smithi050 bash[28929]: cluster 2024-05-20T22:21:49.226840+0000 mon.a (mon.0) 3174 : cluster 0 osdmap e588: 8 total, 8 up, 8 in 2024-05-20T22:21:50.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:50 smithi050 bash[28929]: audit 2024-05-20T22:21:49.233585+0000 mon.c (mon.2) 392 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-114"}]: dispatch 2024-05-20T22:21:50.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:50 smithi050 bash[28929]: audit 2024-05-20T22:21:49.234546+0000 mon.a (mon.0) 3175 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-114"}]: dispatch 2024-05-20T22:21:51.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:51 smithi145 bash[23893]: cluster 2024-05-20T22:21:50.220303+0000 mon.a (mon.0) 3176 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:21:51.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:51 smithi145 bash[23893]: audit 2024-05-20T22:21:50.222630+0000 mon.a (mon.0) 3177 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-114"}]': finished 2024-05-20T22:21:51.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:51 smithi145 bash[23893]: cluster 2024-05-20T22:21:50.230784+0000 mon.a (mon.0) 3178 : cluster 0 osdmap e589: 8 total, 8 up, 8 in 2024-05-20T22:21:51.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:51 smithi145 bash[23893]: cluster 2024-05-20T22:21:50.490371+0000 mgr.y (mgr.14592) 598 : cluster 0 pgmap v958: 364 pgs: 364 active+clean; 583 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:21:51.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:51 smithi145 bash[23893]: cluster 2024-05-20T22:21:50.570939+0000 mon.a (mon.0) 3179 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:51.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:51 smithi050 bash[28929]: cluster 2024-05-20T22:21:50.220303+0000 mon.a (mon.0) 3176 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:21:51.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:51 smithi050 bash[28929]: audit 2024-05-20T22:21:50.222630+0000 mon.a (mon.0) 3177 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-114"}]': finished 2024-05-20T22:21:51.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:51 smithi050 bash[28929]: cluster 2024-05-20T22:21:50.230784+0000 mon.a (mon.0) 3178 : cluster 0 osdmap e589: 8 total, 8 up, 8 in 2024-05-20T22:21:51.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:51 smithi050 bash[28929]: cluster 2024-05-20T22:21:50.490371+0000 mgr.y (mgr.14592) 598 : cluster 0 pgmap v958: 364 pgs: 364 active+clean; 583 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:21:51.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:51 smithi050 bash[28929]: cluster 2024-05-20T22:21:50.570939+0000 mon.a (mon.0) 3179 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:51.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:51 smithi050 bash[21866]: cluster 2024-05-20T22:21:50.220303+0000 mon.a (mon.0) 3176 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:21:51.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:51 smithi050 bash[21866]: audit 2024-05-20T22:21:50.222630+0000 mon.a (mon.0) 3177 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-114"}]': finished 2024-05-20T22:21:51.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:51 smithi050 bash[21866]: cluster 2024-05-20T22:21:50.230784+0000 mon.a (mon.0) 3178 : cluster 0 osdmap e589: 8 total, 8 up, 8 in 2024-05-20T22:21:51.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:51 smithi050 bash[21866]: cluster 2024-05-20T22:21:50.490371+0000 mgr.y (mgr.14592) 598 : cluster 0 pgmap v958: 364 pgs: 364 active+clean; 583 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:21:51.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:51 smithi050 bash[21866]: cluster 2024-05-20T22:21:50.570939+0000 mon.a (mon.0) 3179 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:21:52.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:52 smithi145 bash[23893]: cluster 2024-05-20T22:21:51.257551+0000 mon.a (mon.0) 3180 : cluster 0 osdmap e590: 8 total, 8 up, 8 in 2024-05-20T22:21:52.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:52 smithi050 bash[21866]: cluster 2024-05-20T22:21:51.257551+0000 mon.a (mon.0) 3180 : cluster 0 osdmap e590: 8 total, 8 up, 8 in 2024-05-20T22:21:52.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:52 smithi050 bash[28929]: cluster 2024-05-20T22:21:51.257551+0000 mon.a (mon.0) 3180 : cluster 0 osdmap e590: 8 total, 8 up, 8 in 2024-05-20T22:21:53.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:53 smithi145 bash[23893]: cluster 2024-05-20T22:21:52.268667+0000 mon.a (mon.0) 3181 : cluster 0 osdmap e591: 8 total, 8 up, 8 in 2024-05-20T22:21:53.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:53 smithi145 bash[23893]: audit 2024-05-20T22:21:52.280659+0000 mon.c (mon.2) 393 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:53.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:53 smithi145 bash[23893]: audit 2024-05-20T22:21:52.281812+0000 mon.a (mon.0) 3182 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:53.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:53 smithi145 bash[23893]: cluster 2024-05-20T22:21:52.491515+0000 mgr.y (mgr.14592) 599 : cluster 0 pgmap v961: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:21:53.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:53 smithi050 bash[21866]: cluster 2024-05-20T22:21:52.268667+0000 mon.a (mon.0) 3181 : cluster 0 osdmap e591: 8 total, 8 up, 8 in 2024-05-20T22:21:53.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:53 smithi050 bash[21866]: audit 2024-05-20T22:21:52.280659+0000 mon.c (mon.2) 393 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:53.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:53 smithi050 bash[21866]: audit 2024-05-20T22:21:52.281812+0000 mon.a (mon.0) 3182 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:53.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:53 smithi050 bash[21866]: cluster 2024-05-20T22:21:52.491515+0000 mgr.y (mgr.14592) 599 : cluster 0 pgmap v961: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:21:53.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:53 smithi050 bash[28929]: cluster 2024-05-20T22:21:52.268667+0000 mon.a (mon.0) 3181 : cluster 0 osdmap e591: 8 total, 8 up, 8 in 2024-05-20T22:21:53.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:53 smithi050 bash[28929]: audit 2024-05-20T22:21:52.280659+0000 mon.c (mon.2) 393 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:53.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:53 smithi050 bash[28929]: audit 2024-05-20T22:21:52.281812+0000 mon.a (mon.0) 3182 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:21:53.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:53 smithi050 bash[28929]: cluster 2024-05-20T22:21:52.491515+0000 mgr.y (mgr.14592) 599 : cluster 0 pgmap v961: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:21:54.167 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.168 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.168 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.168 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.168 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.168 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.168 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.168 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.168 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.168 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.168 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.168 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.169 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.169 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.169 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.169 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.169 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.169 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.169 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.169 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.169 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.169 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.169 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.169 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.170 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.170 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.170 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.170 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.170 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.170 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.170 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.170 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.170 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.170 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.170 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.172 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.172 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.172 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.172 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.172 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.172 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.172 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.172 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.172 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.172 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.172 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.172 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.172 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.172 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.173 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.173 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.173 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.173 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.173 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.173 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.173 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.173 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.173 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.173 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.173 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.173 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.173 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:21:54.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:54 smithi145 bash[23893]: audit 2024-05-20T22:21:53.270063+0000 mon.a (mon.0) 3183 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:21:54.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:54 smithi145 bash[23893]: cluster 2024-05-20T22:21:53.279658+0000 mon.a (mon.0) 3184 : cluster 0 osdmap e592: 8 total, 8 up, 8 in 2024-05-20T22:21:54.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:54 smithi145 bash[23893]: audit 2024-05-20T22:21:53.427442+0000 mon.a (mon.0) 3185 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:21:54.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:54 smithi050 bash[21866]: audit 2024-05-20T22:21:53.270063+0000 mon.a (mon.0) 3183 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:21:54.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:54 smithi050 bash[21866]: cluster 2024-05-20T22:21:53.279658+0000 mon.a (mon.0) 3184 : cluster 0 osdmap e592: 8 total, 8 up, 8 in 2024-05-20T22:21:54.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:54 smithi050 bash[21866]: audit 2024-05-20T22:21:53.427442+0000 mon.a (mon.0) 3185 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:21:54.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:54 smithi050 bash[28929]: audit 2024-05-20T22:21:53.270063+0000 mon.a (mon.0) 3183 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:21:54.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:54 smithi050 bash[28929]: cluster 2024-05-20T22:21:53.279658+0000 mon.a (mon.0) 3184 : cluster 0 osdmap e592: 8 total, 8 up, 8 in 2024-05-20T22:21:54.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:54 smithi050 bash[28929]: audit 2024-05-20T22:21:53.427442+0000 mon.a (mon.0) 3185 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:21:55.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:55 smithi145 bash[23893]: cluster 2024-05-20T22:21:54.279789+0000 mon.a (mon.0) 3186 : cluster 0 osdmap e593: 8 total, 8 up, 8 in 2024-05-20T22:21:55.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:55 smithi145 bash[23893]: audit 2024-05-20T22:21:54.334857+0000 mon.c (mon.2) 394 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:21:55.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:55 smithi145 bash[23893]: audit 2024-05-20T22:21:54.335786+0000 mon.a (mon.0) 3187 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:21:55.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:55 smithi145 bash[23893]: cluster 2024-05-20T22:21:54.492859+0000 mgr.y (mgr.14592) 600 : cluster 0 pgmap v964: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:55.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:55 smithi050 bash[21866]: cluster 2024-05-20T22:21:54.279789+0000 mon.a (mon.0) 3186 : cluster 0 osdmap e593: 8 total, 8 up, 8 in 2024-05-20T22:21:55.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:55 smithi050 bash[21866]: audit 2024-05-20T22:21:54.334857+0000 mon.c (mon.2) 394 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:21:55.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:55 smithi050 bash[21866]: audit 2024-05-20T22:21:54.335786+0000 mon.a (mon.0) 3187 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:21:55.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:55 smithi050 bash[21866]: cluster 2024-05-20T22:21:54.492859+0000 mgr.y (mgr.14592) 600 : cluster 0 pgmap v964: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:55.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:55 smithi050 bash[28929]: cluster 2024-05-20T22:21:54.279789+0000 mon.a (mon.0) 3186 : cluster 0 osdmap e593: 8 total, 8 up, 8 in 2024-05-20T22:21:55.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:55 smithi050 bash[28929]: audit 2024-05-20T22:21:54.334857+0000 mon.c (mon.2) 394 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:21:55.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:55 smithi050 bash[28929]: audit 2024-05-20T22:21:54.335786+0000 mon.a (mon.0) 3187 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:21:55.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:55 smithi050 bash[28929]: cluster 2024-05-20T22:21:54.492859+0000 mgr.y (mgr.14592) 600 : cluster 0 pgmap v964: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:21:56.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:56 smithi145 bash[23893]: audit 2024-05-20T22:21:55.294869+0000 mon.a (mon.0) 3188 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-116", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:21:56.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:56 smithi145 bash[23893]: cluster 2024-05-20T22:21:55.305277+0000 mon.a (mon.0) 3189 : cluster 0 osdmap e594: 8 total, 8 up, 8 in 2024-05-20T22:21:56.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:56 smithi145 bash[23893]: audit 2024-05-20T22:21:55.309995+0000 mon.c (mon.2) 395 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-116"}]: dispatch 2024-05-20T22:21:56.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:56 smithi145 bash[23893]: audit 2024-05-20T22:21:55.314939+0000 mon.a (mon.0) 3190 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-116"}]: dispatch 2024-05-20T22:21:56.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:56 smithi050 bash[21866]: audit 2024-05-20T22:21:55.294869+0000 mon.a (mon.0) 3188 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-116", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:21:56.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:56 smithi050 bash[21866]: cluster 2024-05-20T22:21:55.305277+0000 mon.a (mon.0) 3189 : cluster 0 osdmap e594: 8 total, 8 up, 8 in 2024-05-20T22:21:56.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:56 smithi050 bash[21866]: audit 2024-05-20T22:21:55.309995+0000 mon.c (mon.2) 395 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-116"}]: dispatch 2024-05-20T22:21:56.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:56 smithi050 bash[21866]: audit 2024-05-20T22:21:55.314939+0000 mon.a (mon.0) 3190 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-116"}]: dispatch 2024-05-20T22:21:56.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:56 smithi050 bash[28929]: audit 2024-05-20T22:21:55.294869+0000 mon.a (mon.0) 3188 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-116", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:21:56.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:56 smithi050 bash[28929]: cluster 2024-05-20T22:21:55.305277+0000 mon.a (mon.0) 3189 : cluster 0 osdmap e594: 8 total, 8 up, 8 in 2024-05-20T22:21:56.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:56 smithi050 bash[28929]: audit 2024-05-20T22:21:55.309995+0000 mon.c (mon.2) 395 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-116"}]: dispatch 2024-05-20T22:21:56.696 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:56 smithi050 bash[28929]: audit 2024-05-20T22:21:55.314939+0000 mon.a (mon.0) 3190 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-116"}]: dispatch 2024-05-20T22:21:57.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:57 smithi145 bash[23893]: audit 2024-05-20T22:21:56.297925+0000 mon.a (mon.0) 3191 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-116"}]': finished 2024-05-20T22:21:57.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:57 smithi145 bash[23893]: cluster 2024-05-20T22:21:56.305324+0000 mon.a (mon.0) 3192 : cluster 0 osdmap e595: 8 total, 8 up, 8 in 2024-05-20T22:21:57.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:57 smithi145 bash[23893]: audit 2024-05-20T22:21:56.306591+0000 mon.c (mon.2) 396 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-116", "mode": "writeback"}]: dispatch 2024-05-20T22:21:57.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:57 smithi145 bash[23893]: audit 2024-05-20T22:21:56.309620+0000 mon.a (mon.0) 3193 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-116", "mode": "writeback"}]: dispatch 2024-05-20T22:21:57.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:57 smithi145 bash[23893]: cluster 2024-05-20T22:21:56.493859+0000 mgr.y (mgr.14592) 601 : cluster 0 pgmap v967: 364 pgs: 364 active+clean; 583 KiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-05-20T22:21:57.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:57 smithi145 bash[23893]: audit 2024-05-20T22:21:56.828500+0000 mon.a (mon.0) 3194 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:21:57.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:57 smithi145 bash[23893]: cluster 2024-05-20T22:21:57.298318+0000 mon.a (mon.0) 3195 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:21:57.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:57 smithi145 bash[23893]: audit 2024-05-20T22:21:57.300593+0000 mon.a (mon.0) 3196 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-116", "mode": "writeback"}]': finished 2024-05-20T22:21:57.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:57 smithi145 bash[23893]: cluster 2024-05-20T22:21:57.308803+0000 mon.a (mon.0) 3197 : cluster 0 osdmap e596: 8 total, 8 up, 8 in 2024-05-20T22:21:57.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:57 smithi050 bash[21866]: audit 2024-05-20T22:21:56.297925+0000 mon.a (mon.0) 3191 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-116"}]': finished 2024-05-20T22:21:57.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:57 smithi050 bash[21866]: cluster 2024-05-20T22:21:56.305324+0000 mon.a (mon.0) 3192 : cluster 0 osdmap e595: 8 total, 8 up, 8 in 2024-05-20T22:21:57.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:57 smithi050 bash[21866]: audit 2024-05-20T22:21:56.306591+0000 mon.c (mon.2) 396 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-116", "mode": "writeback"}]: dispatch 2024-05-20T22:21:57.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:57 smithi050 bash[21866]: audit 2024-05-20T22:21:56.309620+0000 mon.a (mon.0) 3193 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-116", "mode": "writeback"}]: dispatch 2024-05-20T22:21:57.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:57 smithi050 bash[21866]: cluster 2024-05-20T22:21:56.493859+0000 mgr.y (mgr.14592) 601 : cluster 0 pgmap v967: 364 pgs: 364 active+clean; 583 KiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-05-20T22:21:57.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:57 smithi050 bash[21866]: audit 2024-05-20T22:21:56.828500+0000 mon.a (mon.0) 3194 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:21:57.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:57 smithi050 bash[21866]: cluster 2024-05-20T22:21:57.298318+0000 mon.a (mon.0) 3195 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:21:57.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:57 smithi050 bash[21866]: audit 2024-05-20T22:21:57.300593+0000 mon.a (mon.0) 3196 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-116", "mode": "writeback"}]': finished 2024-05-20T22:21:57.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:57 smithi050 bash[21866]: cluster 2024-05-20T22:21:57.308803+0000 mon.a (mon.0) 3197 : cluster 0 osdmap e596: 8 total, 8 up, 8 in 2024-05-20T22:21:57.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:57 smithi050 bash[28929]: audit 2024-05-20T22:21:56.297925+0000 mon.a (mon.0) 3191 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-116"}]': finished 2024-05-20T22:21:57.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:57 smithi050 bash[28929]: cluster 2024-05-20T22:21:56.305324+0000 mon.a (mon.0) 3192 : cluster 0 osdmap e595: 8 total, 8 up, 8 in 2024-05-20T22:21:57.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:57 smithi050 bash[28929]: audit 2024-05-20T22:21:56.306591+0000 mon.c (mon.2) 396 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-116", "mode": "writeback"}]: dispatch 2024-05-20T22:21:57.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:57 smithi050 bash[28929]: audit 2024-05-20T22:21:56.309620+0000 mon.a (mon.0) 3193 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-116", "mode": "writeback"}]: dispatch 2024-05-20T22:21:57.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:57 smithi050 bash[28929]: cluster 2024-05-20T22:21:56.493859+0000 mgr.y (mgr.14592) 601 : cluster 0 pgmap v967: 364 pgs: 364 active+clean; 583 KiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-05-20T22:21:57.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:57 smithi050 bash[28929]: audit 2024-05-20T22:21:56.828500+0000 mon.a (mon.0) 3194 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:21:57.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:57 smithi050 bash[28929]: cluster 2024-05-20T22:21:57.298318+0000 mon.a (mon.0) 3195 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:21:57.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:57 smithi050 bash[28929]: audit 2024-05-20T22:21:57.300593+0000 mon.a (mon.0) 3196 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-116", "mode": "writeback"}]': finished 2024-05-20T22:21:57.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:57 smithi050 bash[28929]: cluster 2024-05-20T22:21:57.308803+0000 mon.a (mon.0) 3197 : cluster 0 osdmap e596: 8 total, 8 up, 8 in 2024-05-20T22:21:58.639 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:21:58 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:21:58.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:58 smithi145 bash[23893]: audit 2024-05-20T22:21:57.356259+0000 mon.c (mon.2) 397 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "308.7"}]: dispatch 2024-05-20T22:21:58.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:58 smithi145 bash[23893]: audit 2024-05-20T22:21:57.356583+0000 mgr.y (mgr.14592) 602 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "308.7"}]: dispatch 2024-05-20T22:21:58.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:58 smithi145 bash[23893]: cluster 2024-05-20T22:21:57.544504+0000 osd.1 (osd.1) 15 : cluster 0 308.7 scrub starts 2024-05-20T22:21:58.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:58 smithi145 bash[23893]: cluster 2024-05-20T22:21:57.546705+0000 osd.1 (osd.1) 16 : cluster 0 308.7 scrub ok 2024-05-20T22:21:58.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:58 smithi145 bash[23893]: audit 2024-05-20T22:21:57.562800+0000 mon.a (mon.0) 3198 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:21:58.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:58 smithi145 bash[23893]: audit 2024-05-20T22:21:57.564163+0000 mon.a (mon.0) 3199 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:21:58.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:58 smithi145 bash[23893]: audit 2024-05-20T22:21:57.570892+0000 mon.a (mon.0) 3200 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:21:58.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:58 smithi050 bash[21866]: audit 2024-05-20T22:21:57.356259+0000 mon.c (mon.2) 397 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "308.7"}]: dispatch 2024-05-20T22:21:58.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:58 smithi050 bash[21866]: audit 2024-05-20T22:21:57.356583+0000 mgr.y (mgr.14592) 602 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "308.7"}]: dispatch 2024-05-20T22:21:58.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:58 smithi050 bash[21866]: cluster 2024-05-20T22:21:57.544504+0000 osd.1 (osd.1) 15 : cluster 0 308.7 scrub starts 2024-05-20T22:21:58.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:58 smithi050 bash[21866]: cluster 2024-05-20T22:21:57.546705+0000 osd.1 (osd.1) 16 : cluster 0 308.7 scrub ok 2024-05-20T22:21:58.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:58 smithi050 bash[21866]: audit 2024-05-20T22:21:57.562800+0000 mon.a (mon.0) 3198 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:21:58.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:58 smithi050 bash[21866]: audit 2024-05-20T22:21:57.564163+0000 mon.a (mon.0) 3199 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:21:58.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:58 smithi050 bash[21866]: audit 2024-05-20T22:21:57.570892+0000 mon.a (mon.0) 3200 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:21:58.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:58 smithi050 bash[28929]: audit 2024-05-20T22:21:57.356259+0000 mon.c (mon.2) 397 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "308.7"}]: dispatch 2024-05-20T22:21:58.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:58 smithi050 bash[28929]: audit 2024-05-20T22:21:57.356583+0000 mgr.y (mgr.14592) 602 : audit 0 from='mon.? v1:172.21.15.50:0/3816642972' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "308.7"}]: dispatch 2024-05-20T22:21:58.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:58 smithi050 bash[28929]: cluster 2024-05-20T22:21:57.544504+0000 osd.1 (osd.1) 15 : cluster 0 308.7 scrub starts 2024-05-20T22:21:58.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:58 smithi050 bash[28929]: cluster 2024-05-20T22:21:57.546705+0000 osd.1 (osd.1) 16 : cluster 0 308.7 scrub ok 2024-05-20T22:21:58.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:58 smithi050 bash[28929]: audit 2024-05-20T22:21:57.562800+0000 mon.a (mon.0) 3198 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:21:58.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:58 smithi050 bash[28929]: audit 2024-05-20T22:21:57.564163+0000 mon.a (mon.0) 3199 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:21:58.695 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:58 smithi050 bash[28929]: audit 2024-05-20T22:21:57.570892+0000 mon.a (mon.0) 3200 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:21:59.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:59 smithi145 bash[23893]: audit 2024-05-20T22:21:58.276870+0000 mgr.y (mgr.14592) 603 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:59.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:21:59 smithi145 bash[23893]: cluster 2024-05-20T22:21:58.494819+0000 mgr.y (mgr.14592) 604 : cluster 0 pgmap v969: 364 pgs: 364 active+clean; 583 KiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-05-20T22:21:59.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:59 smithi050 bash[21866]: audit 2024-05-20T22:21:58.276870+0000 mgr.y (mgr.14592) 603 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:59.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:21:59 smithi050 bash[21866]: cluster 2024-05-20T22:21:58.494819+0000 mgr.y (mgr.14592) 604 : cluster 0 pgmap v969: 364 pgs: 364 active+clean; 583 KiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-05-20T22:21:59.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:21:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:21:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:21:59.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:59 smithi050 bash[28929]: audit 2024-05-20T22:21:58.276870+0000 mgr.y (mgr.14592) 603 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:21:59.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:21:59 smithi050 bash[28929]: cluster 2024-05-20T22:21:58.494819+0000 mgr.y (mgr.14592) 604 : cluster 0 pgmap v969: 364 pgs: 364 active+clean; 583 KiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-05-20T22:22:01.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:01 smithi145 bash[23893]: cluster 2024-05-20T22:22:00.498077+0000 mgr.y (mgr.14592) 605 : cluster 0 pgmap v970: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-05-20T22:22:01.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:01 smithi050 bash[21866]: cluster 2024-05-20T22:22:00.498077+0000 mgr.y (mgr.14592) 605 : cluster 0 pgmap v970: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-05-20T22:22:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:01 smithi050 bash[28929]: cluster 2024-05-20T22:22:00.498077+0000 mgr.y (mgr.14592) 605 : cluster 0 pgmap v970: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-05-20T22:22:03.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:03 smithi145 bash[23893]: cluster 2024-05-20T22:22:02.499058+0000 mgr.y (mgr.14592) 606 : cluster 0 pgmap v971: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 995 B/s rd, 1 op/s 2024-05-20T22:22:03.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:03 smithi050 bash[21866]: cluster 2024-05-20T22:22:02.499058+0000 mgr.y (mgr.14592) 606 : cluster 0 pgmap v971: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 995 B/s rd, 1 op/s 2024-05-20T22:22:03.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:03 smithi050 bash[28929]: cluster 2024-05-20T22:22:02.499058+0000 mgr.y (mgr.14592) 606 : cluster 0 pgmap v971: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 995 B/s rd, 1 op/s 2024-05-20T22:22:05.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:05 smithi145 bash[23893]: cluster 2024-05-20T22:22:04.500041+0000 mgr.y (mgr.14592) 607 : cluster 0 pgmap v972: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 874 B/s rd, 1 op/s 2024-05-20T22:22:05.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:05 smithi050 bash[21866]: cluster 2024-05-20T22:22:04.500041+0000 mgr.y (mgr.14592) 607 : cluster 0 pgmap v972: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 874 B/s rd, 1 op/s 2024-05-20T22:22:05.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:05 smithi050 bash[28929]: cluster 2024-05-20T22:22:04.500041+0000 mgr.y (mgr.14592) 607 : cluster 0 pgmap v972: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 874 B/s rd, 1 op/s 2024-05-20T22:22:07.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:07 smithi145 bash[23893]: cluster 2024-05-20T22:22:06.503257+0000 mgr.y (mgr.14592) 608 : cluster 0 pgmap v973: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:22:07.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:07 smithi050 bash[21866]: cluster 2024-05-20T22:22:06.503257+0000 mgr.y (mgr.14592) 608 : cluster 0 pgmap v973: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:22:07.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:07 smithi050 bash[28929]: cluster 2024-05-20T22:22:06.503257+0000 mgr.y (mgr.14592) 608 : cluster 0 pgmap v973: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:22:08.639 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:22:08 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:22:09.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:22:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:22:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:22:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:09 smithi050 bash[21866]: audit 2024-05-20T22:22:08.278858+0000 mgr.y (mgr.14592) 609 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:22:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:09 smithi050 bash[21866]: audit 2024-05-20T22:22:08.466236+0000 mon.a (mon.0) 3201 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:22:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:09 smithi050 bash[21866]: audit 2024-05-20T22:22:08.469014+0000 mon.a (mon.0) 3202 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:22:09.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:09 smithi050 bash[21866]: cluster 2024-05-20T22:22:08.504233+0000 mgr.y (mgr.14592) 610 : cluster 0 pgmap v974: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-20T22:22:09.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:09 smithi050 bash[28929]: audit 2024-05-20T22:22:08.278858+0000 mgr.y (mgr.14592) 609 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:22:09.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:09 smithi050 bash[28929]: audit 2024-05-20T22:22:08.466236+0000 mon.a (mon.0) 3201 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:22:09.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:09 smithi050 bash[28929]: audit 2024-05-20T22:22:08.469014+0000 mon.a (mon.0) 3202 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:22:09.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:09 smithi050 bash[28929]: cluster 2024-05-20T22:22:08.504233+0000 mgr.y (mgr.14592) 610 : cluster 0 pgmap v974: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-20T22:22:09.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:09 smithi145 bash[23893]: audit 2024-05-20T22:22:08.278858+0000 mgr.y (mgr.14592) 609 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:22:09.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:09 smithi145 bash[23893]: audit 2024-05-20T22:22:08.466236+0000 mon.a (mon.0) 3201 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:22:09.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:09 smithi145 bash[23893]: audit 2024-05-20T22:22:08.469014+0000 mon.a (mon.0) 3202 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:22:09.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:09 smithi145 bash[23893]: cluster 2024-05-20T22:22:08.504233+0000 mgr.y (mgr.14592) 610 : cluster 0 pgmap v974: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-20T22:22:11.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:11 smithi145 bash[23893]: cluster 2024-05-20T22:22:10.507308+0000 mgr.y (mgr.14592) 611 : cluster 0 pgmap v975: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-20T22:22:11.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:11 smithi050 bash[28929]: cluster 2024-05-20T22:22:10.507308+0000 mgr.y (mgr.14592) 611 : cluster 0 pgmap v975: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-20T22:22:11.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:11 smithi050 bash[21866]: cluster 2024-05-20T22:22:10.507308+0000 mgr.y (mgr.14592) 611 : cluster 0 pgmap v975: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-20T22:22:13.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:13 smithi145 bash[23893]: cluster 2024-05-20T22:22:12.508457+0000 mgr.y (mgr.14592) 612 : cluster 0 pgmap v976: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:22:13.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:13 smithi145 bash[23893]: cluster 2024-05-20T22:22:12.580332+0000 mon.a (mon.0) 3203 : cluster 0 osdmap e597: 8 total, 8 up, 8 in 2024-05-20T22:22:13.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:13 smithi145 bash[23893]: audit 2024-05-20T22:22:12.658354+0000 mon.c (mon.2) 398 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:13.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:13 smithi145 bash[23893]: audit 2024-05-20T22:22:12.659131+0000 mon.a (mon.0) 3204 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:13.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:13 smithi050 bash[21866]: cluster 2024-05-20T22:22:12.508457+0000 mgr.y (mgr.14592) 612 : cluster 0 pgmap v976: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:22:13.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:13 smithi050 bash[21866]: cluster 2024-05-20T22:22:12.580332+0000 mon.a (mon.0) 3203 : cluster 0 osdmap e597: 8 total, 8 up, 8 in 2024-05-20T22:22:13.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:13 smithi050 bash[21866]: audit 2024-05-20T22:22:12.658354+0000 mon.c (mon.2) 398 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:13.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:13 smithi050 bash[21866]: audit 2024-05-20T22:22:12.659131+0000 mon.a (mon.0) 3204 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:13.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:13 smithi050 bash[28929]: cluster 2024-05-20T22:22:12.508457+0000 mgr.y (mgr.14592) 612 : cluster 0 pgmap v976: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:22:13.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:13 smithi050 bash[28929]: cluster 2024-05-20T22:22:12.580332+0000 mon.a (mon.0) 3203 : cluster 0 osdmap e597: 8 total, 8 up, 8 in 2024-05-20T22:22:13.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:13 smithi050 bash[28929]: audit 2024-05-20T22:22:12.658354+0000 mon.c (mon.2) 398 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:13.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:13 smithi050 bash[28929]: audit 2024-05-20T22:22:12.659131+0000 mon.a (mon.0) 3204 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:14.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:14 smithi145 bash[23893]: audit 2024-05-20T22:22:13.583217+0000 mon.a (mon.0) 3205 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:22:14.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:14 smithi145 bash[23893]: cluster 2024-05-20T22:22:13.589824+0000 mon.a (mon.0) 3206 : cluster 0 osdmap e598: 8 total, 8 up, 8 in 2024-05-20T22:22:14.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:14 smithi145 bash[23893]: audit 2024-05-20T22:22:13.592459+0000 mon.c (mon.2) 399 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-116"}]: dispatch 2024-05-20T22:22:14.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:14 smithi145 bash[23893]: audit 2024-05-20T22:22:13.593981+0000 mon.a (mon.0) 3207 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-116"}]: dispatch 2024-05-20T22:22:14.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:14 smithi050 bash[21866]: audit 2024-05-20T22:22:13.583217+0000 mon.a (mon.0) 3205 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:22:14.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:14 smithi050 bash[21866]: cluster 2024-05-20T22:22:13.589824+0000 mon.a (mon.0) 3206 : cluster 0 osdmap e598: 8 total, 8 up, 8 in 2024-05-20T22:22:14.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:14 smithi050 bash[21866]: audit 2024-05-20T22:22:13.592459+0000 mon.c (mon.2) 399 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-116"}]: dispatch 2024-05-20T22:22:14.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:14 smithi050 bash[21866]: audit 2024-05-20T22:22:13.593981+0000 mon.a (mon.0) 3207 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-116"}]: dispatch 2024-05-20T22:22:14.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:14 smithi050 bash[28929]: audit 2024-05-20T22:22:13.583217+0000 mon.a (mon.0) 3205 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:22:14.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:14 smithi050 bash[28929]: cluster 2024-05-20T22:22:13.589824+0000 mon.a (mon.0) 3206 : cluster 0 osdmap e598: 8 total, 8 up, 8 in 2024-05-20T22:22:14.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:14 smithi050 bash[28929]: audit 2024-05-20T22:22:13.592459+0000 mon.c (mon.2) 399 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-116"}]: dispatch 2024-05-20T22:22:14.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:14 smithi050 bash[28929]: audit 2024-05-20T22:22:13.593981+0000 mon.a (mon.0) 3207 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-116"}]: dispatch 2024-05-20T22:22:15.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:15 smithi145 bash[23893]: cluster 2024-05-20T22:22:14.509453+0000 mgr.y (mgr.14592) 613 : cluster 0 pgmap v979: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:22:15.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:15 smithi145 bash[23893]: cluster 2024-05-20T22:22:14.584270+0000 mon.a (mon.0) 3208 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:22:15.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:15 smithi145 bash[23893]: audit 2024-05-20T22:22:14.592401+0000 mon.a (mon.0) 3209 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-116"}]': finished 2024-05-20T22:22:15.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:15 smithi145 bash[23893]: cluster 2024-05-20T22:22:14.604720+0000 mon.a (mon.0) 3210 : cluster 0 osdmap e599: 8 total, 8 up, 8 in 2024-05-20T22:22:15.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:15 smithi145 bash[23893]: audit 2024-05-20T22:22:15.204438+0000 mon.a (mon.0) 3211 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "308.7", "id": [5, 6]}]: dispatch 2024-05-20T22:22:15.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:15 smithi050 bash[21866]: cluster 2024-05-20T22:22:14.509453+0000 mgr.y (mgr.14592) 613 : cluster 0 pgmap v979: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:22:15.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:15 smithi050 bash[21866]: cluster 2024-05-20T22:22:14.584270+0000 mon.a (mon.0) 3208 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:22:15.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:15 smithi050 bash[21866]: audit 2024-05-20T22:22:14.592401+0000 mon.a (mon.0) 3209 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-116"}]': finished 2024-05-20T22:22:15.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:15 smithi050 bash[21866]: cluster 2024-05-20T22:22:14.604720+0000 mon.a (mon.0) 3210 : cluster 0 osdmap e599: 8 total, 8 up, 8 in 2024-05-20T22:22:15.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:15 smithi050 bash[21866]: audit 2024-05-20T22:22:15.204438+0000 mon.a (mon.0) 3211 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "308.7", "id": [5, 6]}]: dispatch 2024-05-20T22:22:15.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:15 smithi050 bash[28929]: cluster 2024-05-20T22:22:14.509453+0000 mgr.y (mgr.14592) 613 : cluster 0 pgmap v979: 364 pgs: 364 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:22:15.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:15 smithi050 bash[28929]: cluster 2024-05-20T22:22:14.584270+0000 mon.a (mon.0) 3208 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:22:15.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:15 smithi050 bash[28929]: audit 2024-05-20T22:22:14.592401+0000 mon.a (mon.0) 3209 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-116"}]': finished 2024-05-20T22:22:15.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:15 smithi050 bash[28929]: cluster 2024-05-20T22:22:14.604720+0000 mon.a (mon.0) 3210 : cluster 0 osdmap e599: 8 total, 8 up, 8 in 2024-05-20T22:22:15.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:15 smithi050 bash[28929]: audit 2024-05-20T22:22:15.204438+0000 mon.a (mon.0) 3211 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "308.7", "id": [5, 6]}]: dispatch 2024-05-20T22:22:16.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:16 smithi145 bash[23893]: audit 2024-05-20T22:22:15.594887+0000 mon.a (mon.0) 3212 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "308.7", "id": [5, 6]}]': finished 2024-05-20T22:22:16.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:16 smithi145 bash[23893]: cluster 2024-05-20T22:22:15.602942+0000 mon.a (mon.0) 3213 : cluster 0 osdmap e600: 8 total, 8 up, 8 in 2024-05-20T22:22:16.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:16 smithi050 bash[21866]: audit 2024-05-20T22:22:15.594887+0000 mon.a (mon.0) 3212 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "308.7", "id": [5, 6]}]': finished 2024-05-20T22:22:16.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:16 smithi050 bash[21866]: cluster 2024-05-20T22:22:15.602942+0000 mon.a (mon.0) 3213 : cluster 0 osdmap e600: 8 total, 8 up, 8 in 2024-05-20T22:22:16.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:16 smithi050 bash[28929]: audit 2024-05-20T22:22:15.594887+0000 mon.a (mon.0) 3212 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "308.7", "id": [5, 6]}]': finished 2024-05-20T22:22:16.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:16 smithi050 bash[28929]: cluster 2024-05-20T22:22:15.602942+0000 mon.a (mon.0) 3213 : cluster 0 osdmap e600: 8 total, 8 up, 8 in 2024-05-20T22:22:17.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:17 smithi145 bash[23893]: cluster 2024-05-20T22:22:16.510422+0000 mgr.y (mgr.14592) 614 : cluster 0 pgmap v982: 332 pgs: 332 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-05-20T22:22:17.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:17 smithi145 bash[23893]: cluster 2024-05-20T22:22:16.630431+0000 mon.a (mon.0) 3214 : cluster 0 osdmap e601: 8 total, 8 up, 8 in 2024-05-20T22:22:17.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:17 smithi145 bash[23893]: audit 2024-05-20T22:22:16.643674+0000 mon.c (mon.2) 400 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:17.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:17 smithi145 bash[23893]: audit 2024-05-20T22:22:16.647951+0000 mon.a (mon.0) 3215 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:17.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:17 smithi050 bash[21866]: cluster 2024-05-20T22:22:16.510422+0000 mgr.y (mgr.14592) 614 : cluster 0 pgmap v982: 332 pgs: 332 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-05-20T22:22:17.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:17 smithi050 bash[21866]: cluster 2024-05-20T22:22:16.630431+0000 mon.a (mon.0) 3214 : cluster 0 osdmap e601: 8 total, 8 up, 8 in 2024-05-20T22:22:17.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:17 smithi050 bash[21866]: audit 2024-05-20T22:22:16.643674+0000 mon.c (mon.2) 400 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:17.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:17 smithi050 bash[21866]: audit 2024-05-20T22:22:16.647951+0000 mon.a (mon.0) 3215 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:17.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:17 smithi050 bash[28929]: cluster 2024-05-20T22:22:16.510422+0000 mgr.y (mgr.14592) 614 : cluster 0 pgmap v982: 332 pgs: 332 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-05-20T22:22:17.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:17 smithi050 bash[28929]: cluster 2024-05-20T22:22:16.630431+0000 mon.a (mon.0) 3214 : cluster 0 osdmap e601: 8 total, 8 up, 8 in 2024-05-20T22:22:17.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:17 smithi050 bash[28929]: audit 2024-05-20T22:22:16.643674+0000 mon.c (mon.2) 400 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:17.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:17 smithi050 bash[28929]: audit 2024-05-20T22:22:16.647951+0000 mon.a (mon.0) 3215 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:18.639 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:22:18 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:22:18.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:18 smithi050 bash[21866]: audit 2024-05-20T22:22:17.626747+0000 mon.a (mon.0) 3216 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:22:18.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:18 smithi050 bash[21866]: cluster 2024-05-20T22:22:17.634971+0000 mon.a (mon.0) 3217 : cluster 0 osdmap e602: 8 total, 8 up, 8 in 2024-05-20T22:22:18.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:18 smithi050 bash[28929]: audit 2024-05-20T22:22:17.626747+0000 mon.a (mon.0) 3216 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:22:18.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:18 smithi050 bash[28929]: cluster 2024-05-20T22:22:17.634971+0000 mon.a (mon.0) 3217 : cluster 0 osdmap e602: 8 total, 8 up, 8 in 2024-05-20T22:22:19.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:18 smithi145 bash[23893]: audit 2024-05-20T22:22:17.626747+0000 mon.a (mon.0) 3216 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:22:19.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:18 smithi145 bash[23893]: cluster 2024-05-20T22:22:17.634971+0000 mon.a (mon.0) 3217 : cluster 0 osdmap e602: 8 total, 8 up, 8 in 2024-05-20T22:22:19.662 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:22:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:22:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:22:19.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:19 smithi050 bash[21866]: audit 2024-05-20T22:22:18.286851+0000 mgr.y (mgr.14592) 615 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:22:19.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:19 smithi050 bash[21866]: cluster 2024-05-20T22:22:18.511438+0000 mgr.y (mgr.14592) 616 : cluster 0 pgmap v985: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-05-20T22:22:19.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:19 smithi050 bash[21866]: cluster 2024-05-20T22:22:18.657469+0000 mon.a (mon.0) 3218 : cluster 0 osdmap e603: 8 total, 8 up, 8 in 2024-05-20T22:22:19.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:19 smithi050 bash[21866]: audit 2024-05-20T22:22:18.673417+0000 mon.c (mon.2) 401 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:19.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:19 smithi050 bash[21866]: audit 2024-05-20T22:22:18.675204+0000 mon.a (mon.0) 3219 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:19.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:19 smithi050 bash[28929]: audit 2024-05-20T22:22:18.286851+0000 mgr.y (mgr.14592) 615 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:22:19.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:19 smithi050 bash[28929]: cluster 2024-05-20T22:22:18.511438+0000 mgr.y (mgr.14592) 616 : cluster 0 pgmap v985: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-05-20T22:22:19.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:19 smithi050 bash[28929]: cluster 2024-05-20T22:22:18.657469+0000 mon.a (mon.0) 3218 : cluster 0 osdmap e603: 8 total, 8 up, 8 in 2024-05-20T22:22:19.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:19 smithi050 bash[28929]: audit 2024-05-20T22:22:18.673417+0000 mon.c (mon.2) 401 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:19.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:19 smithi050 bash[28929]: audit 2024-05-20T22:22:18.675204+0000 mon.a (mon.0) 3219 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:20.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:19 smithi145 bash[23893]: audit 2024-05-20T22:22:18.286851+0000 mgr.y (mgr.14592) 615 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:22:20.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:19 smithi145 bash[23893]: cluster 2024-05-20T22:22:18.511438+0000 mgr.y (mgr.14592) 616 : cluster 0 pgmap v985: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-05-20T22:22:20.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:19 smithi145 bash[23893]: cluster 2024-05-20T22:22:18.657469+0000 mon.a (mon.0) 3218 : cluster 0 osdmap e603: 8 total, 8 up, 8 in 2024-05-20T22:22:20.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:19 smithi145 bash[23893]: audit 2024-05-20T22:22:18.673417+0000 mon.c (mon.2) 401 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:20.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:19 smithi145 bash[23893]: audit 2024-05-20T22:22:18.675204+0000 mon.a (mon.0) 3219 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:20.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:20 smithi050 bash[21866]: audit 2024-05-20T22:22:19.651569+0000 mon.a (mon.0) 3220 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-118", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:22:20.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:20 smithi050 bash[21866]: cluster 2024-05-20T22:22:19.659274+0000 mon.a (mon.0) 3221 : cluster 0 osdmap e604: 8 total, 8 up, 8 in 2024-05-20T22:22:20.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:20 smithi050 bash[21866]: audit 2024-05-20T22:22:19.661702+0000 mon.c (mon.2) 402 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-118"}]: dispatch 2024-05-20T22:22:20.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:20 smithi050 bash[21866]: audit 2024-05-20T22:22:19.676204+0000 mon.a (mon.0) 3222 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-118"}]: dispatch 2024-05-20T22:22:20.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:20 smithi050 bash[21866]: audit 2024-05-20T22:22:20.581042+0000 mon.a (mon.0) 3223 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-118"}]': finished 2024-05-20T22:22:20.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:20 smithi050 bash[21866]: cluster 2024-05-20T22:22:20.588468+0000 mon.a (mon.0) 3224 : cluster 0 osdmap e605: 8 total, 8 up, 8 in 2024-05-20T22:22:20.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:20 smithi050 bash[21866]: audit 2024-05-20T22:22:20.589791+0000 mon.c (mon.2) 403 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-118", "mode": "writeback"}]: dispatch 2024-05-20T22:22:20.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:20 smithi050 bash[21866]: audit 2024-05-20T22:22:20.591689+0000 mon.a (mon.0) 3225 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-118", "mode": "writeback"}]: dispatch 2024-05-20T22:22:20.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:20 smithi050 bash[28929]: audit 2024-05-20T22:22:19.651569+0000 mon.a (mon.0) 3220 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-118", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:22:20.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:20 smithi050 bash[28929]: cluster 2024-05-20T22:22:19.659274+0000 mon.a (mon.0) 3221 : cluster 0 osdmap e604: 8 total, 8 up, 8 in 2024-05-20T22:22:20.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:20 smithi050 bash[28929]: audit 2024-05-20T22:22:19.661702+0000 mon.c (mon.2) 402 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-118"}]: dispatch 2024-05-20T22:22:20.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:20 smithi050 bash[28929]: audit 2024-05-20T22:22:19.676204+0000 mon.a (mon.0) 3222 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-118"}]: dispatch 2024-05-20T22:22:20.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:20 smithi050 bash[28929]: audit 2024-05-20T22:22:20.581042+0000 mon.a (mon.0) 3223 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-118"}]': finished 2024-05-20T22:22:20.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:20 smithi050 bash[28929]: cluster 2024-05-20T22:22:20.588468+0000 mon.a (mon.0) 3224 : cluster 0 osdmap e605: 8 total, 8 up, 8 in 2024-05-20T22:22:20.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:20 smithi050 bash[28929]: audit 2024-05-20T22:22:20.589791+0000 mon.c (mon.2) 403 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-118", "mode": "writeback"}]: dispatch 2024-05-20T22:22:20.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:20 smithi050 bash[28929]: audit 2024-05-20T22:22:20.591689+0000 mon.a (mon.0) 3225 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-118", "mode": "writeback"}]: dispatch 2024-05-20T22:22:21.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:20 smithi145 bash[23893]: audit 2024-05-20T22:22:19.651569+0000 mon.a (mon.0) 3220 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-118", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:22:21.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:20 smithi145 bash[23893]: cluster 2024-05-20T22:22:19.659274+0000 mon.a (mon.0) 3221 : cluster 0 osdmap e604: 8 total, 8 up, 8 in 2024-05-20T22:22:21.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:20 smithi145 bash[23893]: audit 2024-05-20T22:22:19.661702+0000 mon.c (mon.2) 402 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-118"}]: dispatch 2024-05-20T22:22:21.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:20 smithi145 bash[23893]: audit 2024-05-20T22:22:19.676204+0000 mon.a (mon.0) 3222 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-118"}]: dispatch 2024-05-20T22:22:21.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:20 smithi145 bash[23893]: audit 2024-05-20T22:22:20.581042+0000 mon.a (mon.0) 3223 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-118"}]': finished 2024-05-20T22:22:21.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:20 smithi145 bash[23893]: cluster 2024-05-20T22:22:20.588468+0000 mon.a (mon.0) 3224 : cluster 0 osdmap e605: 8 total, 8 up, 8 in 2024-05-20T22:22:21.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:20 smithi145 bash[23893]: audit 2024-05-20T22:22:20.589791+0000 mon.c (mon.2) 403 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-118", "mode": "writeback"}]: dispatch 2024-05-20T22:22:21.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:20 smithi145 bash[23893]: audit 2024-05-20T22:22:20.591689+0000 mon.a (mon.0) 3225 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-118", "mode": "writeback"}]: dispatch 2024-05-20T22:22:21.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:21 smithi050 bash[28929]: cluster 2024-05-20T22:22:20.514668+0000 mgr.y (mgr.14592) 617 : cluster 0 pgmap v988: 364 pgs: 364 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:22:21.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:21 smithi050 bash[28929]: cluster 2024-05-20T22:22:21.581448+0000 mon.a (mon.0) 3226 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:22:21.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:21 smithi050 bash[28929]: audit 2024-05-20T22:22:21.583765+0000 mon.a (mon.0) 3227 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-118", "mode": "writeback"}]': finished 2024-05-20T22:22:21.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:21 smithi050 bash[28929]: cluster 2024-05-20T22:22:21.591899+0000 mon.a (mon.0) 3228 : cluster 0 osdmap e606: 8 total, 8 up, 8 in 2024-05-20T22:22:21.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:21 smithi050 bash[21866]: cluster 2024-05-20T22:22:20.514668+0000 mgr.y (mgr.14592) 617 : cluster 0 pgmap v988: 364 pgs: 364 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:22:21.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:21 smithi050 bash[21866]: cluster 2024-05-20T22:22:21.581448+0000 mon.a (mon.0) 3226 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:22:21.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:21 smithi050 bash[21866]: audit 2024-05-20T22:22:21.583765+0000 mon.a (mon.0) 3227 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-118", "mode": "writeback"}]': finished 2024-05-20T22:22:21.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:21 smithi050 bash[21866]: cluster 2024-05-20T22:22:21.591899+0000 mon.a (mon.0) 3228 : cluster 0 osdmap e606: 8 total, 8 up, 8 in 2024-05-20T22:22:22.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:21 smithi145 bash[23893]: cluster 2024-05-20T22:22:20.514668+0000 mgr.y (mgr.14592) 617 : cluster 0 pgmap v988: 364 pgs: 364 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:22:22.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:21 smithi145 bash[23893]: cluster 2024-05-20T22:22:21.581448+0000 mon.a (mon.0) 3226 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:22:22.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:21 smithi145 bash[23893]: audit 2024-05-20T22:22:21.583765+0000 mon.a (mon.0) 3227 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-118", "mode": "writeback"}]': finished 2024-05-20T22:22:22.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:21 smithi145 bash[23893]: cluster 2024-05-20T22:22:21.591899+0000 mon.a (mon.0) 3228 : cluster 0 osdmap e606: 8 total, 8 up, 8 in 2024-05-20T22:22:23.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:23 smithi145 bash[23893]: cluster 2024-05-20T22:22:22.515664+0000 mgr.y (mgr.14592) 618 : cluster 0 pgmap v991: 364 pgs: 364 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:22:23.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:23 smithi145 bash[23893]: cluster 2024-05-20T22:22:22.593705+0000 mon.a (mon.0) 3229 : cluster 0 osdmap e607: 8 total, 8 up, 8 in 2024-05-20T22:22:23.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:23 smithi145 bash[23893]: audit 2024-05-20T22:22:22.687967+0000 mon.c (mon.2) 404 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:23.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:23 smithi145 bash[23893]: audit 2024-05-20T22:22:22.688546+0000 mon.a (mon.0) 3230 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:23.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:23 smithi145 bash[23893]: audit 2024-05-20T22:22:23.502341+0000 mon.a (mon.0) 3231 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:22:23.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:23 smithi050 bash[28929]: cluster 2024-05-20T22:22:22.515664+0000 mgr.y (mgr.14592) 618 : cluster 0 pgmap v991: 364 pgs: 364 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:22:23.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:23 smithi050 bash[28929]: cluster 2024-05-20T22:22:22.593705+0000 mon.a (mon.0) 3229 : cluster 0 osdmap e607: 8 total, 8 up, 8 in 2024-05-20T22:22:23.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:23 smithi050 bash[28929]: audit 2024-05-20T22:22:22.687967+0000 mon.c (mon.2) 404 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:23.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:23 smithi050 bash[28929]: audit 2024-05-20T22:22:22.688546+0000 mon.a (mon.0) 3230 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:23.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:23 smithi050 bash[28929]: audit 2024-05-20T22:22:23.502341+0000 mon.a (mon.0) 3231 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:22:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:23 smithi050 bash[21866]: cluster 2024-05-20T22:22:22.515664+0000 mgr.y (mgr.14592) 618 : cluster 0 pgmap v991: 364 pgs: 364 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:22:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:23 smithi050 bash[21866]: cluster 2024-05-20T22:22:22.593705+0000 mon.a (mon.0) 3229 : cluster 0 osdmap e607: 8 total, 8 up, 8 in 2024-05-20T22:22:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:23 smithi050 bash[21866]: audit 2024-05-20T22:22:22.687967+0000 mon.c (mon.2) 404 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:23 smithi050 bash[21866]: audit 2024-05-20T22:22:22.688546+0000 mon.a (mon.0) 3230 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:23.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:23 smithi050 bash[21866]: audit 2024-05-20T22:22:23.502341+0000 mon.a (mon.0) 3231 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:22:24.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:24 smithi050 bash[21866]: audit 2024-05-20T22:22:23.682836+0000 mon.a (mon.0) 3232 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:22:24.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:24 smithi050 bash[21866]: cluster 2024-05-20T22:22:23.690666+0000 mon.a (mon.0) 3233 : cluster 0 osdmap e608: 8 total, 8 up, 8 in 2024-05-20T22:22:24.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:24 smithi050 bash[21866]: audit 2024-05-20T22:22:23.693486+0000 mon.c (mon.2) 405 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-118"}]: dispatch 2024-05-20T22:22:24.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:24 smithi050 bash[21866]: audit 2024-05-20T22:22:23.694396+0000 mon.a (mon.0) 3234 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-118"}]: dispatch 2024-05-20T22:22:24.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:24 smithi050 bash[28929]: audit 2024-05-20T22:22:23.682836+0000 mon.a (mon.0) 3232 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:22:24.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:24 smithi050 bash[28929]: cluster 2024-05-20T22:22:23.690666+0000 mon.a (mon.0) 3233 : cluster 0 osdmap e608: 8 total, 8 up, 8 in 2024-05-20T22:22:24.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:24 smithi050 bash[28929]: audit 2024-05-20T22:22:23.693486+0000 mon.c (mon.2) 405 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-118"}]: dispatch 2024-05-20T22:22:24.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:24 smithi050 bash[28929]: audit 2024-05-20T22:22:23.694396+0000 mon.a (mon.0) 3234 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-118"}]: dispatch 2024-05-20T22:22:25.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:24 smithi145 bash[23893]: audit 2024-05-20T22:22:23.682836+0000 mon.a (mon.0) 3232 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:22:25.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:24 smithi145 bash[23893]: cluster 2024-05-20T22:22:23.690666+0000 mon.a (mon.0) 3233 : cluster 0 osdmap e608: 8 total, 8 up, 8 in 2024-05-20T22:22:25.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:24 smithi145 bash[23893]: audit 2024-05-20T22:22:23.693486+0000 mon.c (mon.2) 405 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-118"}]: dispatch 2024-05-20T22:22:25.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:24 smithi145 bash[23893]: audit 2024-05-20T22:22:23.694396+0000 mon.a (mon.0) 3234 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-118"}]: dispatch 2024-05-20T22:22:26.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:25 smithi145 bash[23893]: cluster 2024-05-20T22:22:24.516685+0000 mgr.y (mgr.14592) 619 : cluster 0 pgmap v994: 364 pgs: 364 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:22:26.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:25 smithi145 bash[23893]: cluster 2024-05-20T22:22:24.683799+0000 mon.a (mon.0) 3235 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:22:26.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:25 smithi145 bash[23893]: audit 2024-05-20T22:22:24.691822+0000 mon.a (mon.0) 3236 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-118"}]': finished 2024-05-20T22:22:26.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:25 smithi145 bash[23893]: cluster 2024-05-20T22:22:24.703568+0000 mon.a (mon.0) 3237 : cluster 0 osdmap e609: 8 total, 8 up, 8 in 2024-05-20T22:22:26.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:25 smithi050 bash[21866]: cluster 2024-05-20T22:22:24.516685+0000 mgr.y (mgr.14592) 619 : cluster 0 pgmap v994: 364 pgs: 364 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:22:26.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:25 smithi050 bash[21866]: cluster 2024-05-20T22:22:24.683799+0000 mon.a (mon.0) 3235 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:22:26.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:25 smithi050 bash[21866]: audit 2024-05-20T22:22:24.691822+0000 mon.a (mon.0) 3236 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-118"}]': finished 2024-05-20T22:22:26.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:25 smithi050 bash[21866]: cluster 2024-05-20T22:22:24.703568+0000 mon.a (mon.0) 3237 : cluster 0 osdmap e609: 8 total, 8 up, 8 in 2024-05-20T22:22:26.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:25 smithi050 bash[28929]: cluster 2024-05-20T22:22:24.516685+0000 mgr.y (mgr.14592) 619 : cluster 0 pgmap v994: 364 pgs: 364 active+clean; 583 KiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:22:26.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:25 smithi050 bash[28929]: cluster 2024-05-20T22:22:24.683799+0000 mon.a (mon.0) 3235 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:22:26.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:25 smithi050 bash[28929]: audit 2024-05-20T22:22:24.691822+0000 mon.a (mon.0) 3236 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-118"}]': finished 2024-05-20T22:22:26.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:25 smithi050 bash[28929]: cluster 2024-05-20T22:22:24.703568+0000 mon.a (mon.0) 3237 : cluster 0 osdmap e609: 8 total, 8 up, 8 in 2024-05-20T22:22:27.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:26 smithi145 bash[23893]: cluster 2024-05-20T22:22:25.702505+0000 mon.a (mon.0) 3238 : cluster 0 osdmap e610: 8 total, 8 up, 8 in 2024-05-20T22:22:27.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:26 smithi050 bash[28929]: cluster 2024-05-20T22:22:25.702505+0000 mon.a (mon.0) 3238 : cluster 0 osdmap e610: 8 total, 8 up, 8 in 2024-05-20T22:22:27.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:26 smithi050 bash[21866]: cluster 2024-05-20T22:22:25.702505+0000 mon.a (mon.0) 3238 : cluster 0 osdmap e610: 8 total, 8 up, 8 in 2024-05-20T22:22:28.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:27 smithi145 bash[23893]: cluster 2024-05-20T22:22:26.517658+0000 mgr.y (mgr.14592) 620 : cluster 0 pgmap v997: 332 pgs: 332 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:22:28.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:27 smithi145 bash[23893]: cluster 2024-05-20T22:22:26.735093+0000 mon.a (mon.0) 3239 : cluster 0 osdmap e611: 8 total, 8 up, 8 in 2024-05-20T22:22:28.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:27 smithi145 bash[23893]: audit 2024-05-20T22:22:26.739246+0000 mon.c (mon.2) 406 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:28.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:27 smithi145 bash[23893]: audit 2024-05-20T22:22:26.742940+0000 mon.a (mon.0) 3240 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:28.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:27 smithi050 bash[21866]: cluster 2024-05-20T22:22:26.517658+0000 mgr.y (mgr.14592) 620 : cluster 0 pgmap v997: 332 pgs: 332 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:22:28.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:27 smithi050 bash[21866]: cluster 2024-05-20T22:22:26.735093+0000 mon.a (mon.0) 3239 : cluster 0 osdmap e611: 8 total, 8 up, 8 in 2024-05-20T22:22:28.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:27 smithi050 bash[21866]: audit 2024-05-20T22:22:26.739246+0000 mon.c (mon.2) 406 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:28.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:27 smithi050 bash[21866]: audit 2024-05-20T22:22:26.742940+0000 mon.a (mon.0) 3240 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:28.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:27 smithi050 bash[28929]: cluster 2024-05-20T22:22:26.517658+0000 mgr.y (mgr.14592) 620 : cluster 0 pgmap v997: 332 pgs: 332 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:22:28.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:27 smithi050 bash[28929]: cluster 2024-05-20T22:22:26.735093+0000 mon.a (mon.0) 3239 : cluster 0 osdmap e611: 8 total, 8 up, 8 in 2024-05-20T22:22:28.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:27 smithi050 bash[28929]: audit 2024-05-20T22:22:26.739246+0000 mon.c (mon.2) 406 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:28.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:27 smithi050 bash[28929]: audit 2024-05-20T22:22:26.742940+0000 mon.a (mon.0) 3240 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:28.639 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:22:28 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:22:29.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:28 smithi145 bash[23893]: audit 2024-05-20T22:22:27.730225+0000 mon.a (mon.0) 3241 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:22:29.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:28 smithi145 bash[23893]: cluster 2024-05-20T22:22:27.738464+0000 mon.a (mon.0) 3242 : cluster 0 osdmap e612: 8 total, 8 up, 8 in 2024-05-20T22:22:29.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:28 smithi145 bash[23893]: audit 2024-05-20T22:22:27.793021+0000 mon.c (mon.2) 407 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:29.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:28 smithi145 bash[23893]: audit 2024-05-20T22:22:27.793707+0000 mon.a (mon.0) 3243 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:28 smithi050 bash[21866]: audit 2024-05-20T22:22:27.730225+0000 mon.a (mon.0) 3241 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:22:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:28 smithi050 bash[21866]: cluster 2024-05-20T22:22:27.738464+0000 mon.a (mon.0) 3242 : cluster 0 osdmap e612: 8 total, 8 up, 8 in 2024-05-20T22:22:29.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:28 smithi050 bash[21866]: audit 2024-05-20T22:22:27.793021+0000 mon.c (mon.2) 407 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:29.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:28 smithi050 bash[21866]: audit 2024-05-20T22:22:27.793707+0000 mon.a (mon.0) 3243 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:28 smithi050 bash[28929]: audit 2024-05-20T22:22:27.730225+0000 mon.a (mon.0) 3241 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:22:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:28 smithi050 bash[28929]: cluster 2024-05-20T22:22:27.738464+0000 mon.a (mon.0) 3242 : cluster 0 osdmap e612: 8 total, 8 up, 8 in 2024-05-20T22:22:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:28 smithi050 bash[28929]: audit 2024-05-20T22:22:27.793021+0000 mon.c (mon.2) 407 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:28 smithi050 bash[28929]: audit 2024-05-20T22:22:27.793707+0000 mon.a (mon.0) 3243 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:29.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:22:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:22:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:22:30.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:29 smithi145 bash[23893]: audit 2024-05-20T22:22:28.289280+0000 mgr.y (mgr.14592) 621 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:22:30.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:29 smithi145 bash[23893]: cluster 2024-05-20T22:22:28.518630+0000 mgr.y (mgr.14592) 622 : cluster 0 pgmap v1000: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:22:30.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:29 smithi145 bash[23893]: audit 2024-05-20T22:22:28.757038+0000 mon.a (mon.0) 3244 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-120", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:22:30.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:29 smithi145 bash[23893]: cluster 2024-05-20T22:22:28.767244+0000 mon.a (mon.0) 3245 : cluster 0 osdmap e613: 8 total, 8 up, 8 in 2024-05-20T22:22:30.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:29 smithi145 bash[23893]: audit 2024-05-20T22:22:28.767786+0000 mon.c (mon.2) 408 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-120"}]: dispatch 2024-05-20T22:22:30.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:29 smithi145 bash[23893]: audit 2024-05-20T22:22:28.770184+0000 mon.a (mon.0) 3246 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-120"}]: dispatch 2024-05-20T22:22:30.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:29 smithi050 bash[28929]: audit 2024-05-20T22:22:28.289280+0000 mgr.y (mgr.14592) 621 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:22:30.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:29 smithi050 bash[28929]: cluster 2024-05-20T22:22:28.518630+0000 mgr.y (mgr.14592) 622 : cluster 0 pgmap v1000: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:22:30.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:29 smithi050 bash[28929]: audit 2024-05-20T22:22:28.757038+0000 mon.a (mon.0) 3244 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-120", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:22:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:29 smithi050 bash[28929]: cluster 2024-05-20T22:22:28.767244+0000 mon.a (mon.0) 3245 : cluster 0 osdmap e613: 8 total, 8 up, 8 in 2024-05-20T22:22:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:29 smithi050 bash[28929]: audit 2024-05-20T22:22:28.767786+0000 mon.c (mon.2) 408 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-120"}]: dispatch 2024-05-20T22:22:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:29 smithi050 bash[28929]: audit 2024-05-20T22:22:28.770184+0000 mon.a (mon.0) 3246 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-120"}]: dispatch 2024-05-20T22:22:30.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:29 smithi050 bash[21866]: audit 2024-05-20T22:22:28.289280+0000 mgr.y (mgr.14592) 621 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:22:30.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:29 smithi050 bash[21866]: cluster 2024-05-20T22:22:28.518630+0000 mgr.y (mgr.14592) 622 : cluster 0 pgmap v1000: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:22:30.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:29 smithi050 bash[21866]: audit 2024-05-20T22:22:28.757038+0000 mon.a (mon.0) 3244 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-120", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:22:30.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:29 smithi050 bash[21866]: cluster 2024-05-20T22:22:28.767244+0000 mon.a (mon.0) 3245 : cluster 0 osdmap e613: 8 total, 8 up, 8 in 2024-05-20T22:22:30.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:29 smithi050 bash[21866]: audit 2024-05-20T22:22:28.767786+0000 mon.c (mon.2) 408 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-120"}]: dispatch 2024-05-20T22:22:30.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:29 smithi050 bash[21866]: audit 2024-05-20T22:22:28.770184+0000 mon.a (mon.0) 3246 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-120"}]: dispatch 2024-05-20T22:22:31.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:30 smithi145 bash[23893]: audit 2024-05-20T22:22:29.759669+0000 mon.a (mon.0) 3247 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-120"}]': finished 2024-05-20T22:22:31.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:30 smithi145 bash[23893]: cluster 2024-05-20T22:22:29.767395+0000 mon.a (mon.0) 3248 : cluster 0 osdmap e614: 8 total, 8 up, 8 in 2024-05-20T22:22:31.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:30 smithi145 bash[23893]: audit 2024-05-20T22:22:29.779337+0000 mon.c (mon.2) 409 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-120", "mode": "writeback"}]: dispatch 2024-05-20T22:22:31.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:30 smithi145 bash[23893]: audit 2024-05-20T22:22:29.788210+0000 mon.a (mon.0) 3249 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-120", "mode": "writeback"}]: dispatch 2024-05-20T22:22:31.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:30 smithi145 bash[23893]: cluster 2024-05-20T22:22:30.582530+0000 mon.a (mon.0) 3250 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:22:31.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:30 smithi145 bash[23893]: audit 2024-05-20T22:22:30.584990+0000 mon.a (mon.0) 3251 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-120", "mode": "writeback"}]': finished 2024-05-20T22:22:31.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:30 smithi145 bash[23893]: cluster 2024-05-20T22:22:30.593060+0000 mon.a (mon.0) 3252 : cluster 0 osdmap e615: 8 total, 8 up, 8 in 2024-05-20T22:22:31.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:30 smithi145 bash[23893]: audit 2024-05-20T22:22:30.738965+0000 mon.c (mon.2) 410 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:31.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:30 smithi145 bash[23893]: audit 2024-05-20T22:22:30.739499+0000 mon.a (mon.0) 3253 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:31.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:30 smithi050 bash[21866]: audit 2024-05-20T22:22:29.759669+0000 mon.a (mon.0) 3247 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-120"}]': finished 2024-05-20T22:22:31.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:30 smithi050 bash[21866]: cluster 2024-05-20T22:22:29.767395+0000 mon.a (mon.0) 3248 : cluster 0 osdmap e614: 8 total, 8 up, 8 in 2024-05-20T22:22:31.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:30 smithi050 bash[21866]: audit 2024-05-20T22:22:29.779337+0000 mon.c (mon.2) 409 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-120", "mode": "writeback"}]: dispatch 2024-05-20T22:22:31.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:30 smithi050 bash[21866]: audit 2024-05-20T22:22:29.788210+0000 mon.a (mon.0) 3249 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-120", "mode": "writeback"}]: dispatch 2024-05-20T22:22:31.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:30 smithi050 bash[21866]: cluster 2024-05-20T22:22:30.582530+0000 mon.a (mon.0) 3250 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:22:31.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:30 smithi050 bash[21866]: audit 2024-05-20T22:22:30.584990+0000 mon.a (mon.0) 3251 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-120", "mode": "writeback"}]': finished 2024-05-20T22:22:31.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:30 smithi050 bash[21866]: cluster 2024-05-20T22:22:30.593060+0000 mon.a (mon.0) 3252 : cluster 0 osdmap e615: 8 total, 8 up, 8 in 2024-05-20T22:22:31.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:30 smithi050 bash[21866]: audit 2024-05-20T22:22:30.738965+0000 mon.c (mon.2) 410 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:31.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:30 smithi050 bash[21866]: audit 2024-05-20T22:22:30.739499+0000 mon.a (mon.0) 3253 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:31.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:30 smithi050 bash[28929]: audit 2024-05-20T22:22:29.759669+0000 mon.a (mon.0) 3247 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-120"}]': finished 2024-05-20T22:22:31.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:30 smithi050 bash[28929]: cluster 2024-05-20T22:22:29.767395+0000 mon.a (mon.0) 3248 : cluster 0 osdmap e614: 8 total, 8 up, 8 in 2024-05-20T22:22:31.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:30 smithi050 bash[28929]: audit 2024-05-20T22:22:29.779337+0000 mon.c (mon.2) 409 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-120", "mode": "writeback"}]: dispatch 2024-05-20T22:22:31.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:30 smithi050 bash[28929]: audit 2024-05-20T22:22:29.788210+0000 mon.a (mon.0) 3249 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-120", "mode": "writeback"}]: dispatch 2024-05-20T22:22:31.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:30 smithi050 bash[28929]: cluster 2024-05-20T22:22:30.582530+0000 mon.a (mon.0) 3250 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:22:31.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:30 smithi050 bash[28929]: audit 2024-05-20T22:22:30.584990+0000 mon.a (mon.0) 3251 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-120", "mode": "writeback"}]': finished 2024-05-20T22:22:31.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:30 smithi050 bash[28929]: cluster 2024-05-20T22:22:30.593060+0000 mon.a (mon.0) 3252 : cluster 0 osdmap e615: 8 total, 8 up, 8 in 2024-05-20T22:22:31.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:30 smithi050 bash[28929]: audit 2024-05-20T22:22:30.738965+0000 mon.c (mon.2) 410 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:31.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:30 smithi050 bash[28929]: audit 2024-05-20T22:22:30.739499+0000 mon.a (mon.0) 3253 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:32.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:31 smithi145 bash[23893]: cluster 2024-05-20T22:22:30.521934+0000 mgr.y (mgr.14592) 623 : cluster 0 pgmap v1003: 364 pgs: 364 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:22:32.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:31 smithi145 bash[23893]: audit 2024-05-20T22:22:31.587657+0000 mon.a (mon.0) 3254 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:22:32.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:31 smithi145 bash[23893]: cluster 2024-05-20T22:22:31.595559+0000 mon.a (mon.0) 3255 : cluster 0 osdmap e616: 8 total, 8 up, 8 in 2024-05-20T22:22:32.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:31 smithi145 bash[23893]: audit 2024-05-20T22:22:31.597636+0000 mon.c (mon.2) 411 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-120"}]: dispatch 2024-05-20T22:22:32.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:31 smithi145 bash[23893]: audit 2024-05-20T22:22:31.598848+0000 mon.a (mon.0) 3256 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-120"}]: dispatch 2024-05-20T22:22:32.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:31 smithi050 bash[21866]: cluster 2024-05-20T22:22:30.521934+0000 mgr.y (mgr.14592) 623 : cluster 0 pgmap v1003: 364 pgs: 364 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:22:32.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:31 smithi050 bash[21866]: audit 2024-05-20T22:22:31.587657+0000 mon.a (mon.0) 3254 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:22:32.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:31 smithi050 bash[21866]: cluster 2024-05-20T22:22:31.595559+0000 mon.a (mon.0) 3255 : cluster 0 osdmap e616: 8 total, 8 up, 8 in 2024-05-20T22:22:32.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:31 smithi050 bash[21866]: audit 2024-05-20T22:22:31.597636+0000 mon.c (mon.2) 411 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-120"}]: dispatch 2024-05-20T22:22:32.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:31 smithi050 bash[21866]: audit 2024-05-20T22:22:31.598848+0000 mon.a (mon.0) 3256 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-120"}]: dispatch 2024-05-20T22:22:32.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:31 smithi050 bash[28929]: cluster 2024-05-20T22:22:30.521934+0000 mgr.y (mgr.14592) 623 : cluster 0 pgmap v1003: 364 pgs: 364 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:22:32.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:31 smithi050 bash[28929]: audit 2024-05-20T22:22:31.587657+0000 mon.a (mon.0) 3254 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:22:32.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:31 smithi050 bash[28929]: cluster 2024-05-20T22:22:31.595559+0000 mon.a (mon.0) 3255 : cluster 0 osdmap e616: 8 total, 8 up, 8 in 2024-05-20T22:22:32.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:31 smithi050 bash[28929]: audit 2024-05-20T22:22:31.597636+0000 mon.c (mon.2) 411 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-120"}]: dispatch 2024-05-20T22:22:32.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:31 smithi050 bash[28929]: audit 2024-05-20T22:22:31.598848+0000 mon.a (mon.0) 3256 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-120"}]: dispatch 2024-05-20T22:22:33.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:32 smithi145 bash[23893]: cluster 2024-05-20T22:22:32.588096+0000 mon.a (mon.0) 3257 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:22:33.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:32 smithi145 bash[23893]: audit 2024-05-20T22:22:32.590652+0000 mon.a (mon.0) 3258 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-120"}]': finished 2024-05-20T22:22:33.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:32 smithi145 bash[23893]: cluster 2024-05-20T22:22:32.598139+0000 mon.a (mon.0) 3259 : cluster 0 osdmap e617: 8 total, 8 up, 8 in 2024-05-20T22:22:33.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:32 smithi050 bash[28929]: cluster 2024-05-20T22:22:32.588096+0000 mon.a (mon.0) 3257 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:22:33.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:32 smithi050 bash[28929]: audit 2024-05-20T22:22:32.590652+0000 mon.a (mon.0) 3258 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-120"}]': finished 2024-05-20T22:22:33.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:32 smithi050 bash[28929]: cluster 2024-05-20T22:22:32.598139+0000 mon.a (mon.0) 3259 : cluster 0 osdmap e617: 8 total, 8 up, 8 in 2024-05-20T22:22:33.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:32 smithi050 bash[21866]: cluster 2024-05-20T22:22:32.588096+0000 mon.a (mon.0) 3257 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:22:33.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:32 smithi050 bash[21866]: audit 2024-05-20T22:22:32.590652+0000 mon.a (mon.0) 3258 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-120"}]': finished 2024-05-20T22:22:33.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:32 smithi050 bash[21866]: cluster 2024-05-20T22:22:32.598139+0000 mon.a (mon.0) 3259 : cluster 0 osdmap e617: 8 total, 8 up, 8 in 2024-05-20T22:22:34.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:34 smithi145 bash[23893]: cluster 2024-05-20T22:22:32.522976+0000 mgr.y (mgr.14592) 624 : cluster 0 pgmap v1006: 364 pgs: 364 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:22:34.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:34 smithi145 bash[23893]: cluster 2024-05-20T22:22:33.599957+0000 mon.a (mon.0) 3260 : cluster 0 osdmap e618: 8 total, 8 up, 8 in 2024-05-20T22:22:34.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:34 smithi050 bash[28929]: cluster 2024-05-20T22:22:32.522976+0000 mgr.y (mgr.14592) 624 : cluster 0 pgmap v1006: 364 pgs: 364 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:22:34.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:34 smithi050 bash[28929]: cluster 2024-05-20T22:22:33.599957+0000 mon.a (mon.0) 3260 : cluster 0 osdmap e618: 8 total, 8 up, 8 in 2024-05-20T22:22:34.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:34 smithi050 bash[21866]: cluster 2024-05-20T22:22:32.522976+0000 mgr.y (mgr.14592) 624 : cluster 0 pgmap v1006: 364 pgs: 364 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:22:34.444 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:34 smithi050 bash[21866]: cluster 2024-05-20T22:22:33.599957+0000 mon.a (mon.0) 3260 : cluster 0 osdmap e618: 8 total, 8 up, 8 in 2024-05-20T22:22:35.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:35 smithi145 bash[23893]: cluster 2024-05-20T22:22:34.523971+0000 mgr.y (mgr.14592) 625 : cluster 0 pgmap v1009: 332 pgs: 332 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:22:35.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:35 smithi145 bash[23893]: cluster 2024-05-20T22:22:34.604849+0000 mon.a (mon.0) 3261 : cluster 0 osdmap e619: 8 total, 8 up, 8 in 2024-05-20T22:22:35.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:35 smithi145 bash[23893]: audit 2024-05-20T22:22:34.611302+0000 mon.c (mon.2) 412 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:35.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:35 smithi145 bash[23893]: audit 2024-05-20T22:22:34.613162+0000 mon.a (mon.0) 3262 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:35.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:35 smithi050 bash[21866]: cluster 2024-05-20T22:22:34.523971+0000 mgr.y (mgr.14592) 625 : cluster 0 pgmap v1009: 332 pgs: 332 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:22:35.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:35 smithi050 bash[21866]: cluster 2024-05-20T22:22:34.604849+0000 mon.a (mon.0) 3261 : cluster 0 osdmap e619: 8 total, 8 up, 8 in 2024-05-20T22:22:35.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:35 smithi050 bash[21866]: audit 2024-05-20T22:22:34.611302+0000 mon.c (mon.2) 412 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:35.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:35 smithi050 bash[21866]: audit 2024-05-20T22:22:34.613162+0000 mon.a (mon.0) 3262 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:35.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:35 smithi050 bash[28929]: cluster 2024-05-20T22:22:34.523971+0000 mgr.y (mgr.14592) 625 : cluster 0 pgmap v1009: 332 pgs: 332 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:22:35.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:35 smithi050 bash[28929]: cluster 2024-05-20T22:22:34.604849+0000 mon.a (mon.0) 3261 : cluster 0 osdmap e619: 8 total, 8 up, 8 in 2024-05-20T22:22:35.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:35 smithi050 bash[28929]: audit 2024-05-20T22:22:34.611302+0000 mon.c (mon.2) 412 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:35.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:35 smithi050 bash[28929]: audit 2024-05-20T22:22:34.613162+0000 mon.a (mon.0) 3262 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:36.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:36 smithi145 bash[23893]: audit 2024-05-20T22:22:35.600313+0000 mon.a (mon.0) 3263 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:22:36.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:36 smithi145 bash[23893]: cluster 2024-05-20T22:22:35.608368+0000 mon.a (mon.0) 3264 : cluster 0 osdmap e620: 8 total, 8 up, 8 in 2024-05-20T22:22:36.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:36 smithi145 bash[23893]: audit 2024-05-20T22:22:35.670466+0000 mon.c (mon.2) 413 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:36.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:36 smithi145 bash[23893]: audit 2024-05-20T22:22:35.671740+0000 mon.a (mon.0) 3265 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:36.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:36 smithi050 bash[21866]: audit 2024-05-20T22:22:35.600313+0000 mon.a (mon.0) 3263 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:22:36.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:36 smithi050 bash[21866]: cluster 2024-05-20T22:22:35.608368+0000 mon.a (mon.0) 3264 : cluster 0 osdmap e620: 8 total, 8 up, 8 in 2024-05-20T22:22:36.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:36 smithi050 bash[21866]: audit 2024-05-20T22:22:35.670466+0000 mon.c (mon.2) 413 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:36.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:36 smithi050 bash[21866]: audit 2024-05-20T22:22:35.671740+0000 mon.a (mon.0) 3265 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:36.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:36 smithi050 bash[28929]: audit 2024-05-20T22:22:35.600313+0000 mon.a (mon.0) 3263 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:22:36.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:36 smithi050 bash[28929]: cluster 2024-05-20T22:22:35.608368+0000 mon.a (mon.0) 3264 : cluster 0 osdmap e620: 8 total, 8 up, 8 in 2024-05-20T22:22:36.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:36 smithi050 bash[28929]: audit 2024-05-20T22:22:35.670466+0000 mon.c (mon.2) 413 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:36.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:36 smithi050 bash[28929]: audit 2024-05-20T22:22:35.671740+0000 mon.a (mon.0) 3265 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:37.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:37 smithi050 bash[21866]: cluster 2024-05-20T22:22:36.524911+0000 mgr.y (mgr.14592) 626 : cluster 0 pgmap v1012: 364 pgs: 32 creating+peering, 332 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:22:37.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:37 smithi050 bash[21866]: audit 2024-05-20T22:22:36.627363+0000 mon.a (mon.0) 3266 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-122", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:22:37.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:37 smithi050 bash[21866]: cluster 2024-05-20T22:22:36.636364+0000 mon.a (mon.0) 3267 : cluster 0 osdmap e621: 8 total, 8 up, 8 in 2024-05-20T22:22:37.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:37 smithi050 bash[21866]: audit 2024-05-20T22:22:36.639437+0000 mon.c (mon.2) 414 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-122"}]: dispatch 2024-05-20T22:22:37.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:37 smithi050 bash[21866]: audit 2024-05-20T22:22:36.645662+0000 mon.a (mon.0) 3268 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-122"}]: dispatch 2024-05-20T22:22:37.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:37 smithi050 bash[28929]: cluster 2024-05-20T22:22:36.524911+0000 mgr.y (mgr.14592) 626 : cluster 0 pgmap v1012: 364 pgs: 32 creating+peering, 332 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:22:37.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:37 smithi050 bash[28929]: audit 2024-05-20T22:22:36.627363+0000 mon.a (mon.0) 3266 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-122", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:22:37.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:37 smithi050 bash[28929]: cluster 2024-05-20T22:22:36.636364+0000 mon.a (mon.0) 3267 : cluster 0 osdmap e621: 8 total, 8 up, 8 in 2024-05-20T22:22:37.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:37 smithi050 bash[28929]: audit 2024-05-20T22:22:36.639437+0000 mon.c (mon.2) 414 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-122"}]: dispatch 2024-05-20T22:22:37.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:37 smithi050 bash[28929]: audit 2024-05-20T22:22:36.645662+0000 mon.a (mon.0) 3268 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-122"}]: dispatch 2024-05-20T22:22:38.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:37 smithi145 bash[23893]: cluster 2024-05-20T22:22:36.524911+0000 mgr.y (mgr.14592) 626 : cluster 0 pgmap v1012: 364 pgs: 32 creating+peering, 332 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:22:38.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:37 smithi145 bash[23893]: audit 2024-05-20T22:22:36.627363+0000 mon.a (mon.0) 3266 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-122", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:22:38.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:37 smithi145 bash[23893]: cluster 2024-05-20T22:22:36.636364+0000 mon.a (mon.0) 3267 : cluster 0 osdmap e621: 8 total, 8 up, 8 in 2024-05-20T22:22:38.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:37 smithi145 bash[23893]: audit 2024-05-20T22:22:36.639437+0000 mon.c (mon.2) 414 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-122"}]: dispatch 2024-05-20T22:22:38.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:37 smithi145 bash[23893]: audit 2024-05-20T22:22:36.645662+0000 mon.a (mon.0) 3268 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-122"}]: dispatch 2024-05-20T22:22:38.639 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:22:38 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:22:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:38 smithi050 bash[21866]: audit 2024-05-20T22:22:37.630221+0000 mon.a (mon.0) 3269 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-122"}]': finished 2024-05-20T22:22:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:38 smithi050 bash[21866]: cluster 2024-05-20T22:22:37.637596+0000 mon.a (mon.0) 3270 : cluster 0 osdmap e622: 8 total, 8 up, 8 in 2024-05-20T22:22:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:38 smithi050 bash[21866]: audit 2024-05-20T22:22:37.640299+0000 mon.c (mon.2) 415 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-122", "mode": "writeback"}]: dispatch 2024-05-20T22:22:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:38 smithi050 bash[21866]: audit 2024-05-20T22:22:37.651043+0000 mon.a (mon.0) 3271 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-122", "mode": "writeback"}]: dispatch 2024-05-20T22:22:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:38 smithi050 bash[21866]: audit 2024-05-20T22:22:38.540925+0000 mon.a (mon.0) 3272 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:22:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:38 smithi050 bash[21866]: audit 2024-05-20T22:22:38.543472+0000 mon.a (mon.0) 3273 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:22:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:38 smithi050 bash[21866]: cluster 2024-05-20T22:22:38.630779+0000 mon.a (mon.0) 3274 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:22:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:38 smithi050 bash[21866]: audit 2024-05-20T22:22:38.633193+0000 mon.a (mon.0) 3275 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-122", "mode": "writeback"}]': finished 2024-05-20T22:22:38.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:38 smithi050 bash[21866]: cluster 2024-05-20T22:22:38.641854+0000 mon.a (mon.0) 3276 : cluster 0 osdmap e623: 8 total, 8 up, 8 in 2024-05-20T22:22:38.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:38 smithi050 bash[28929]: audit 2024-05-20T22:22:37.630221+0000 mon.a (mon.0) 3269 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-122"}]': finished 2024-05-20T22:22:38.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:38 smithi050 bash[28929]: cluster 2024-05-20T22:22:37.637596+0000 mon.a (mon.0) 3270 : cluster 0 osdmap e622: 8 total, 8 up, 8 in 2024-05-20T22:22:38.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:38 smithi050 bash[28929]: audit 2024-05-20T22:22:37.640299+0000 mon.c (mon.2) 415 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-122", "mode": "writeback"}]: dispatch 2024-05-20T22:22:38.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:38 smithi050 bash[28929]: audit 2024-05-20T22:22:37.651043+0000 mon.a (mon.0) 3271 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-122", "mode": "writeback"}]: dispatch 2024-05-20T22:22:38.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:38 smithi050 bash[28929]: audit 2024-05-20T22:22:38.540925+0000 mon.a (mon.0) 3272 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:22:38.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:38 smithi050 bash[28929]: audit 2024-05-20T22:22:38.543472+0000 mon.a (mon.0) 3273 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:22:38.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:38 smithi050 bash[28929]: cluster 2024-05-20T22:22:38.630779+0000 mon.a (mon.0) 3274 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:22:38.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:38 smithi050 bash[28929]: audit 2024-05-20T22:22:38.633193+0000 mon.a (mon.0) 3275 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-122", "mode": "writeback"}]': finished 2024-05-20T22:22:38.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:38 smithi050 bash[28929]: cluster 2024-05-20T22:22:38.641854+0000 mon.a (mon.0) 3276 : cluster 0 osdmap e623: 8 total, 8 up, 8 in 2024-05-20T22:22:39.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:38 smithi145 bash[23893]: audit 2024-05-20T22:22:37.630221+0000 mon.a (mon.0) 3269 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-122"}]': finished 2024-05-20T22:22:39.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:38 smithi145 bash[23893]: cluster 2024-05-20T22:22:37.637596+0000 mon.a (mon.0) 3270 : cluster 0 osdmap e622: 8 total, 8 up, 8 in 2024-05-20T22:22:39.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:38 smithi145 bash[23893]: audit 2024-05-20T22:22:37.640299+0000 mon.c (mon.2) 415 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-122", "mode": "writeback"}]: dispatch 2024-05-20T22:22:39.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:38 smithi145 bash[23893]: audit 2024-05-20T22:22:37.651043+0000 mon.a (mon.0) 3271 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-122", "mode": "writeback"}]: dispatch 2024-05-20T22:22:39.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:38 smithi145 bash[23893]: audit 2024-05-20T22:22:38.540925+0000 mon.a (mon.0) 3272 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:22:39.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:38 smithi145 bash[23893]: audit 2024-05-20T22:22:38.543472+0000 mon.a (mon.0) 3273 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:22:39.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:38 smithi145 bash[23893]: cluster 2024-05-20T22:22:38.630779+0000 mon.a (mon.0) 3274 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:22:39.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:38 smithi145 bash[23893]: audit 2024-05-20T22:22:38.633193+0000 mon.a (mon.0) 3275 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-122", "mode": "writeback"}]': finished 2024-05-20T22:22:39.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:38 smithi145 bash[23893]: cluster 2024-05-20T22:22:38.641854+0000 mon.a (mon.0) 3276 : cluster 0 osdmap e623: 8 total, 8 up, 8 in 2024-05-20T22:22:39.660 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:22:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:22:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:22:39.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:39 smithi050 bash[21866]: audit 2024-05-20T22:22:38.300662+0000 mgr.y (mgr.14592) 627 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:22:39.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:39 smithi050 bash[21866]: cluster 2024-05-20T22:22:38.525872+0000 mgr.y (mgr.14592) 628 : cluster 0 pgmap v1015: 364 pgs: 32 creating+peering, 332 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:22:39.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:39 smithi050 bash[21866]: audit 2024-05-20T22:22:38.782935+0000 mon.c (mon.2) 416 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:39.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:39 smithi050 bash[21866]: audit 2024-05-20T22:22:38.783602+0000 mon.a (mon.0) 3277 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:39.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:39 smithi050 bash[28929]: audit 2024-05-20T22:22:38.300662+0000 mgr.y (mgr.14592) 627 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:22:39.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:39 smithi050 bash[28929]: cluster 2024-05-20T22:22:38.525872+0000 mgr.y (mgr.14592) 628 : cluster 0 pgmap v1015: 364 pgs: 32 creating+peering, 332 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:22:39.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:39 smithi050 bash[28929]: audit 2024-05-20T22:22:38.782935+0000 mon.c (mon.2) 416 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:39.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:39 smithi050 bash[28929]: audit 2024-05-20T22:22:38.783602+0000 mon.a (mon.0) 3277 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:40.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:39 smithi145 bash[23893]: audit 2024-05-20T22:22:38.300662+0000 mgr.y (mgr.14592) 627 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:22:40.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:39 smithi145 bash[23893]: cluster 2024-05-20T22:22:38.525872+0000 mgr.y (mgr.14592) 628 : cluster 0 pgmap v1015: 364 pgs: 32 creating+peering, 332 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:22:40.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:39 smithi145 bash[23893]: audit 2024-05-20T22:22:38.782935+0000 mon.c (mon.2) 416 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:40.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:39 smithi145 bash[23893]: audit 2024-05-20T22:22:38.783602+0000 mon.a (mon.0) 3277 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:40.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:40 smithi050 bash[21866]: audit 2024-05-20T22:22:39.674646+0000 mon.a (mon.0) 3278 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:22:40.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:40 smithi050 bash[21866]: cluster 2024-05-20T22:22:39.681411+0000 mon.a (mon.0) 3279 : cluster 0 osdmap e624: 8 total, 8 up, 8 in 2024-05-20T22:22:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:40 smithi050 bash[21866]: audit 2024-05-20T22:22:39.684166+0000 mon.c (mon.2) 417 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-122"}]: dispatch 2024-05-20T22:22:40.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:40 smithi050 bash[21866]: audit 2024-05-20T22:22:39.685199+0000 mon.a (mon.0) 3280 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-122"}]: dispatch 2024-05-20T22:22:40.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:40 smithi050 bash[28929]: audit 2024-05-20T22:22:39.674646+0000 mon.a (mon.0) 3278 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:22:40.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:40 smithi050 bash[28929]: cluster 2024-05-20T22:22:39.681411+0000 mon.a (mon.0) 3279 : cluster 0 osdmap e624: 8 total, 8 up, 8 in 2024-05-20T22:22:40.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:40 smithi050 bash[28929]: audit 2024-05-20T22:22:39.684166+0000 mon.c (mon.2) 417 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-122"}]: dispatch 2024-05-20T22:22:40.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:40 smithi050 bash[28929]: audit 2024-05-20T22:22:39.685199+0000 mon.a (mon.0) 3280 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-122"}]: dispatch 2024-05-20T22:22:41.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:40 smithi145 bash[23893]: audit 2024-05-20T22:22:39.674646+0000 mon.a (mon.0) 3278 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:22:41.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:40 smithi145 bash[23893]: cluster 2024-05-20T22:22:39.681411+0000 mon.a (mon.0) 3279 : cluster 0 osdmap e624: 8 total, 8 up, 8 in 2024-05-20T22:22:41.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:40 smithi145 bash[23893]: audit 2024-05-20T22:22:39.684166+0000 mon.c (mon.2) 417 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-122"}]: dispatch 2024-05-20T22:22:41.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:40 smithi145 bash[23893]: audit 2024-05-20T22:22:39.685199+0000 mon.a (mon.0) 3280 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-122"}]: dispatch 2024-05-20T22:22:42.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:41 smithi145 bash[23893]: cluster 2024-05-20T22:22:40.529275+0000 mgr.y (mgr.14592) 629 : cluster 0 pgmap v1018: 364 pgs: 364 active+clean; 583 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-05-20T22:22:42.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:41 smithi145 bash[23893]: cluster 2024-05-20T22:22:40.675911+0000 mon.a (mon.0) 3281 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:22:42.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:41 smithi145 bash[23893]: audit 2024-05-20T22:22:40.683855+0000 mon.a (mon.0) 3282 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-122"}]': finished 2024-05-20T22:22:42.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:41 smithi145 bash[23893]: cluster 2024-05-20T22:22:40.693555+0000 mon.a (mon.0) 3283 : cluster 0 osdmap e625: 8 total, 8 up, 8 in 2024-05-20T22:22:42.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:41 smithi050 bash[21866]: cluster 2024-05-20T22:22:40.529275+0000 mgr.y (mgr.14592) 629 : cluster 0 pgmap v1018: 364 pgs: 364 active+clean; 583 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-05-20T22:22:42.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:41 smithi050 bash[21866]: cluster 2024-05-20T22:22:40.675911+0000 mon.a (mon.0) 3281 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:22:42.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:41 smithi050 bash[21866]: audit 2024-05-20T22:22:40.683855+0000 mon.a (mon.0) 3282 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-122"}]': finished 2024-05-20T22:22:42.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:41 smithi050 bash[21866]: cluster 2024-05-20T22:22:40.693555+0000 mon.a (mon.0) 3283 : cluster 0 osdmap e625: 8 total, 8 up, 8 in 2024-05-20T22:22:42.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:41 smithi050 bash[28929]: cluster 2024-05-20T22:22:40.529275+0000 mgr.y (mgr.14592) 629 : cluster 0 pgmap v1018: 364 pgs: 364 active+clean; 583 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-05-20T22:22:42.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:41 smithi050 bash[28929]: cluster 2024-05-20T22:22:40.675911+0000 mon.a (mon.0) 3281 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:22:42.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:41 smithi050 bash[28929]: audit 2024-05-20T22:22:40.683855+0000 mon.a (mon.0) 3282 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-122"}]': finished 2024-05-20T22:22:42.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:41 smithi050 bash[28929]: cluster 2024-05-20T22:22:40.693555+0000 mon.a (mon.0) 3283 : cluster 0 osdmap e625: 8 total, 8 up, 8 in 2024-05-20T22:22:43.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:42 smithi145 bash[23893]: cluster 2024-05-20T22:22:41.693775+0000 mon.a (mon.0) 3284 : cluster 0 osdmap e626: 8 total, 8 up, 8 in 2024-05-20T22:22:43.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:42 smithi050 bash[21866]: cluster 2024-05-20T22:22:41.693775+0000 mon.a (mon.0) 3284 : cluster 0 osdmap e626: 8 total, 8 up, 8 in 2024-05-20T22:22:43.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:42 smithi050 bash[28929]: cluster 2024-05-20T22:22:41.693775+0000 mon.a (mon.0) 3284 : cluster 0 osdmap e626: 8 total, 8 up, 8 in 2024-05-20T22:22:44.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:43 smithi145 bash[23893]: cluster 2024-05-20T22:22:42.530330+0000 mgr.y (mgr.14592) 630 : cluster 0 pgmap v1021: 332 pgs: 332 active+clean; 583 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-05-20T22:22:44.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:43 smithi145 bash[23893]: cluster 2024-05-20T22:22:42.723330+0000 mon.a (mon.0) 3285 : cluster 0 osdmap e627: 8 total, 8 up, 8 in 2024-05-20T22:22:44.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:43 smithi145 bash[23893]: audit 2024-05-20T22:22:42.729290+0000 mon.c (mon.2) 418 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:44.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:43 smithi145 bash[23893]: audit 2024-05-20T22:22:42.731057+0000 mon.a (mon.0) 3286 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:44.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:43 smithi050 bash[28929]: cluster 2024-05-20T22:22:42.530330+0000 mgr.y (mgr.14592) 630 : cluster 0 pgmap v1021: 332 pgs: 332 active+clean; 583 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-05-20T22:22:44.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:43 smithi050 bash[28929]: cluster 2024-05-20T22:22:42.723330+0000 mon.a (mon.0) 3285 : cluster 0 osdmap e627: 8 total, 8 up, 8 in 2024-05-20T22:22:44.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:43 smithi050 bash[28929]: audit 2024-05-20T22:22:42.729290+0000 mon.c (mon.2) 418 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:44.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:43 smithi050 bash[28929]: audit 2024-05-20T22:22:42.731057+0000 mon.a (mon.0) 3286 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:44.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:43 smithi050 bash[21866]: cluster 2024-05-20T22:22:42.530330+0000 mgr.y (mgr.14592) 630 : cluster 0 pgmap v1021: 332 pgs: 332 active+clean; 583 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-05-20T22:22:44.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:43 smithi050 bash[21866]: cluster 2024-05-20T22:22:42.723330+0000 mon.a (mon.0) 3285 : cluster 0 osdmap e627: 8 total, 8 up, 8 in 2024-05-20T22:22:44.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:43 smithi050 bash[21866]: audit 2024-05-20T22:22:42.729290+0000 mon.c (mon.2) 418 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:44.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:43 smithi050 bash[21866]: audit 2024-05-20T22:22:42.731057+0000 mon.a (mon.0) 3286 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:45.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:44 smithi145 bash[23893]: audit 2024-05-20T22:22:43.718968+0000 mon.a (mon.0) 3287 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:22:45.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:44 smithi145 bash[23893]: cluster 2024-05-20T22:22:43.726932+0000 mon.a (mon.0) 3288 : cluster 0 osdmap e628: 8 total, 8 up, 8 in 2024-05-20T22:22:45.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:44 smithi050 bash[21866]: audit 2024-05-20T22:22:43.718968+0000 mon.a (mon.0) 3287 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:22:45.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:44 smithi050 bash[21866]: cluster 2024-05-20T22:22:43.726932+0000 mon.a (mon.0) 3288 : cluster 0 osdmap e628: 8 total, 8 up, 8 in 2024-05-20T22:22:45.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:44 smithi050 bash[28929]: audit 2024-05-20T22:22:43.718968+0000 mon.a (mon.0) 3287 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:22:45.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:44 smithi050 bash[28929]: cluster 2024-05-20T22:22:43.726932+0000 mon.a (mon.0) 3288 : cluster 0 osdmap e628: 8 total, 8 up, 8 in 2024-05-20T22:22:46.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:45 smithi145 bash[23893]: cluster 2024-05-20T22:22:44.531307+0000 mgr.y (mgr.14592) 631 : cluster 0 pgmap v1024: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 612 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:22:46.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:45 smithi145 bash[23893]: cluster 2024-05-20T22:22:44.758711+0000 mon.a (mon.0) 3289 : cluster 0 osdmap e629: 8 total, 8 up, 8 in 2024-05-20T22:22:46.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:45 smithi145 bash[23893]: audit 2024-05-20T22:22:44.795456+0000 mon.c (mon.2) 419 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:46.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:45 smithi145 bash[23893]: audit 2024-05-20T22:22:44.796930+0000 mon.a (mon.0) 3290 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:46.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:45 smithi050 bash[21866]: cluster 2024-05-20T22:22:44.531307+0000 mgr.y (mgr.14592) 631 : cluster 0 pgmap v1024: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 612 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:22:46.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:45 smithi050 bash[21866]: cluster 2024-05-20T22:22:44.758711+0000 mon.a (mon.0) 3289 : cluster 0 osdmap e629: 8 total, 8 up, 8 in 2024-05-20T22:22:46.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:45 smithi050 bash[21866]: audit 2024-05-20T22:22:44.795456+0000 mon.c (mon.2) 419 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:46.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:45 smithi050 bash[21866]: audit 2024-05-20T22:22:44.796930+0000 mon.a (mon.0) 3290 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:46.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:45 smithi050 bash[28929]: cluster 2024-05-20T22:22:44.531307+0000 mgr.y (mgr.14592) 631 : cluster 0 pgmap v1024: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 612 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:22:46.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:45 smithi050 bash[28929]: cluster 2024-05-20T22:22:44.758711+0000 mon.a (mon.0) 3289 : cluster 0 osdmap e629: 8 total, 8 up, 8 in 2024-05-20T22:22:46.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:45 smithi050 bash[28929]: audit 2024-05-20T22:22:44.795456+0000 mon.c (mon.2) 419 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:46.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:45 smithi050 bash[28929]: audit 2024-05-20T22:22:44.796930+0000 mon.a (mon.0) 3290 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:47.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:46 smithi145 bash[23893]: audit 2024-05-20T22:22:45.753277+0000 mon.a (mon.0) 3291 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-124", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:22:47.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:46 smithi145 bash[23893]: cluster 2024-05-20T22:22:45.761157+0000 mon.a (mon.0) 3292 : cluster 0 osdmap e630: 8 total, 8 up, 8 in 2024-05-20T22:22:47.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:46 smithi145 bash[23893]: audit 2024-05-20T22:22:45.764773+0000 mon.c (mon.2) 420 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-124"}]: dispatch 2024-05-20T22:22:47.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:46 smithi145 bash[23893]: audit 2024-05-20T22:22:45.776305+0000 mon.a (mon.0) 3293 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-124"}]: dispatch 2024-05-20T22:22:47.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:46 smithi050 bash[21866]: audit 2024-05-20T22:22:45.753277+0000 mon.a (mon.0) 3291 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-124", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:22:47.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:46 smithi050 bash[21866]: cluster 2024-05-20T22:22:45.761157+0000 mon.a (mon.0) 3292 : cluster 0 osdmap e630: 8 total, 8 up, 8 in 2024-05-20T22:22:47.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:46 smithi050 bash[21866]: audit 2024-05-20T22:22:45.764773+0000 mon.c (mon.2) 420 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-124"}]: dispatch 2024-05-20T22:22:47.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:46 smithi050 bash[21866]: audit 2024-05-20T22:22:45.776305+0000 mon.a (mon.0) 3293 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-124"}]: dispatch 2024-05-20T22:22:47.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:46 smithi050 bash[28929]: audit 2024-05-20T22:22:45.753277+0000 mon.a (mon.0) 3291 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-124", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:22:47.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:46 smithi050 bash[28929]: cluster 2024-05-20T22:22:45.761157+0000 mon.a (mon.0) 3292 : cluster 0 osdmap e630: 8 total, 8 up, 8 in 2024-05-20T22:22:47.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:46 smithi050 bash[28929]: audit 2024-05-20T22:22:45.764773+0000 mon.c (mon.2) 420 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-124"}]: dispatch 2024-05-20T22:22:47.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:46 smithi050 bash[28929]: audit 2024-05-20T22:22:45.776305+0000 mon.a (mon.0) 3293 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-124"}]: dispatch 2024-05-20T22:22:48.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:47 smithi145 bash[23893]: cluster 2024-05-20T22:22:46.532461+0000 mgr.y (mgr.14592) 632 : cluster 0 pgmap v1027: 364 pgs: 364 active+clean; 583 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-05-20T22:22:48.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:47 smithi145 bash[23893]: audit 2024-05-20T22:22:46.774209+0000 mon.a (mon.0) 3294 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-124"}]': finished 2024-05-20T22:22:48.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:47 smithi145 bash[23893]: cluster 2024-05-20T22:22:46.784608+0000 mon.a (mon.0) 3295 : cluster 0 osdmap e631: 8 total, 8 up, 8 in 2024-05-20T22:22:48.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:47 smithi145 bash[23893]: audit 2024-05-20T22:22:46.787641+0000 mon.c (mon.2) 421 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-124", "mode": "writeback"}]: dispatch 2024-05-20T22:22:48.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:47 smithi145 bash[23893]: audit 2024-05-20T22:22:46.789560+0000 mon.a (mon.0) 3296 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-124", "mode": "writeback"}]: dispatch 2024-05-20T22:22:48.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:47 smithi050 bash[21866]: cluster 2024-05-20T22:22:46.532461+0000 mgr.y (mgr.14592) 632 : cluster 0 pgmap v1027: 364 pgs: 364 active+clean; 583 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-05-20T22:22:48.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:47 smithi050 bash[21866]: audit 2024-05-20T22:22:46.774209+0000 mon.a (mon.0) 3294 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-124"}]': finished 2024-05-20T22:22:48.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:47 smithi050 bash[21866]: cluster 2024-05-20T22:22:46.784608+0000 mon.a (mon.0) 3295 : cluster 0 osdmap e631: 8 total, 8 up, 8 in 2024-05-20T22:22:48.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:47 smithi050 bash[21866]: audit 2024-05-20T22:22:46.787641+0000 mon.c (mon.2) 421 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-124", "mode": "writeback"}]: dispatch 2024-05-20T22:22:48.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:47 smithi050 bash[21866]: audit 2024-05-20T22:22:46.789560+0000 mon.a (mon.0) 3296 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-124", "mode": "writeback"}]: dispatch 2024-05-20T22:22:48.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:47 smithi050 bash[28929]: cluster 2024-05-20T22:22:46.532461+0000 mgr.y (mgr.14592) 632 : cluster 0 pgmap v1027: 364 pgs: 364 active+clean; 583 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-05-20T22:22:48.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:47 smithi050 bash[28929]: audit 2024-05-20T22:22:46.774209+0000 mon.a (mon.0) 3294 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-124"}]': finished 2024-05-20T22:22:48.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:47 smithi050 bash[28929]: cluster 2024-05-20T22:22:46.784608+0000 mon.a (mon.0) 3295 : cluster 0 osdmap e631: 8 total, 8 up, 8 in 2024-05-20T22:22:48.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:47 smithi050 bash[28929]: audit 2024-05-20T22:22:46.787641+0000 mon.c (mon.2) 421 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-124", "mode": "writeback"}]: dispatch 2024-05-20T22:22:48.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:47 smithi050 bash[28929]: audit 2024-05-20T22:22:46.789560+0000 mon.a (mon.0) 3296 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-124", "mode": "writeback"}]: dispatch 2024-05-20T22:22:48.639 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:22:48 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:22:49.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:48 smithi145 bash[23893]: cluster 2024-05-20T22:22:47.774655+0000 mon.a (mon.0) 3297 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:22:49.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:48 smithi145 bash[23893]: audit 2024-05-20T22:22:47.777041+0000 mon.a (mon.0) 3298 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-124", "mode": "writeback"}]': finished 2024-05-20T22:22:49.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:48 smithi145 bash[23893]: cluster 2024-05-20T22:22:47.785109+0000 mon.a (mon.0) 3299 : cluster 0 osdmap e632: 8 total, 8 up, 8 in 2024-05-20T22:22:49.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:48 smithi050 bash[21866]: cluster 2024-05-20T22:22:47.774655+0000 mon.a (mon.0) 3297 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:22:49.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:48 smithi050 bash[21866]: audit 2024-05-20T22:22:47.777041+0000 mon.a (mon.0) 3298 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-124", "mode": "writeback"}]': finished 2024-05-20T22:22:49.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:48 smithi050 bash[21866]: cluster 2024-05-20T22:22:47.785109+0000 mon.a (mon.0) 3299 : cluster 0 osdmap e632: 8 total, 8 up, 8 in 2024-05-20T22:22:49.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:48 smithi050 bash[28929]: cluster 2024-05-20T22:22:47.774655+0000 mon.a (mon.0) 3297 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:22:49.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:48 smithi050 bash[28929]: audit 2024-05-20T22:22:47.777041+0000 mon.a (mon.0) 3298 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-124", "mode": "writeback"}]': finished 2024-05-20T22:22:49.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:48 smithi050 bash[28929]: cluster 2024-05-20T22:22:47.785109+0000 mon.a (mon.0) 3299 : cluster 0 osdmap e632: 8 total, 8 up, 8 in 2024-05-20T22:22:49.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:22:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:22:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:22:50.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:49 smithi145 bash[23893]: audit 2024-05-20T22:22:48.309871+0000 mgr.y (mgr.14592) 633 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:22:50.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:49 smithi145 bash[23893]: cluster 2024-05-20T22:22:48.533576+0000 mgr.y (mgr.14592) 634 : cluster 0 pgmap v1030: 364 pgs: 364 active+clean; 583 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-05-20T22:22:50.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:49 smithi145 bash[23893]: cluster 2024-05-20T22:22:48.810015+0000 mon.a (mon.0) 3300 : cluster 0 osdmap e633: 8 total, 8 up, 8 in 2024-05-20T22:22:50.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:49 smithi145 bash[23893]: audit 2024-05-20T22:22:48.897560+0000 mon.c (mon.2) 422 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:50.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:49 smithi145 bash[23893]: audit 2024-05-20T22:22:48.898459+0000 mon.a (mon.0) 3301 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:50.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:49 smithi050 bash[21866]: audit 2024-05-20T22:22:48.309871+0000 mgr.y (mgr.14592) 633 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:22:50.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:49 smithi050 bash[21866]: cluster 2024-05-20T22:22:48.533576+0000 mgr.y (mgr.14592) 634 : cluster 0 pgmap v1030: 364 pgs: 364 active+clean; 583 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-05-20T22:22:50.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:49 smithi050 bash[21866]: cluster 2024-05-20T22:22:48.810015+0000 mon.a (mon.0) 3300 : cluster 0 osdmap e633: 8 total, 8 up, 8 in 2024-05-20T22:22:50.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:49 smithi050 bash[21866]: audit 2024-05-20T22:22:48.897560+0000 mon.c (mon.2) 422 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:50.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:49 smithi050 bash[21866]: audit 2024-05-20T22:22:48.898459+0000 mon.a (mon.0) 3301 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:50.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:49 smithi050 bash[28929]: audit 2024-05-20T22:22:48.309871+0000 mgr.y (mgr.14592) 633 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:22:50.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:49 smithi050 bash[28929]: cluster 2024-05-20T22:22:48.533576+0000 mgr.y (mgr.14592) 634 : cluster 0 pgmap v1030: 364 pgs: 364 active+clean; 583 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-05-20T22:22:50.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:49 smithi050 bash[28929]: cluster 2024-05-20T22:22:48.810015+0000 mon.a (mon.0) 3300 : cluster 0 osdmap e633: 8 total, 8 up, 8 in 2024-05-20T22:22:50.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:49 smithi050 bash[28929]: audit 2024-05-20T22:22:48.897560+0000 mon.c (mon.2) 422 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:50.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:49 smithi050 bash[28929]: audit 2024-05-20T22:22:48.898459+0000 mon.a (mon.0) 3301 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:51.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:50 smithi145 bash[23893]: audit 2024-05-20T22:22:49.806178+0000 mon.a (mon.0) 3302 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:22:51.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:50 smithi145 bash[23893]: cluster 2024-05-20T22:22:49.813551+0000 mon.a (mon.0) 3303 : cluster 0 osdmap e634: 8 total, 8 up, 8 in 2024-05-20T22:22:51.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:50 smithi145 bash[23893]: audit 2024-05-20T22:22:49.814984+0000 mon.c (mon.2) 423 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-124"}]: dispatch 2024-05-20T22:22:51.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:50 smithi145 bash[23893]: audit 2024-05-20T22:22:49.815964+0000 mon.a (mon.0) 3304 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-124"}]: dispatch 2024-05-20T22:22:51.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:50 smithi145 bash[23893]: cluster 2024-05-20T22:22:50.806478+0000 mon.a (mon.0) 3305 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:22:51.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:50 smithi145 bash[23893]: audit 2024-05-20T22:22:50.808981+0000 mon.a (mon.0) 3306 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-124"}]': finished 2024-05-20T22:22:51.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:50 smithi145 bash[23893]: cluster 2024-05-20T22:22:50.816923+0000 mon.a (mon.0) 3307 : cluster 0 osdmap e635: 8 total, 8 up, 8 in 2024-05-20T22:22:51.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:50 smithi050 bash[21866]: audit 2024-05-20T22:22:49.806178+0000 mon.a (mon.0) 3302 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:22:51.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:50 smithi050 bash[21866]: cluster 2024-05-20T22:22:49.813551+0000 mon.a (mon.0) 3303 : cluster 0 osdmap e634: 8 total, 8 up, 8 in 2024-05-20T22:22:51.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:50 smithi050 bash[21866]: audit 2024-05-20T22:22:49.814984+0000 mon.c (mon.2) 423 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-124"}]: dispatch 2024-05-20T22:22:51.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:50 smithi050 bash[21866]: audit 2024-05-20T22:22:49.815964+0000 mon.a (mon.0) 3304 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-124"}]: dispatch 2024-05-20T22:22:51.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:50 smithi050 bash[21866]: cluster 2024-05-20T22:22:50.806478+0000 mon.a (mon.0) 3305 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:22:51.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:50 smithi050 bash[21866]: audit 2024-05-20T22:22:50.808981+0000 mon.a (mon.0) 3306 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-124"}]': finished 2024-05-20T22:22:51.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:50 smithi050 bash[21866]: cluster 2024-05-20T22:22:50.816923+0000 mon.a (mon.0) 3307 : cluster 0 osdmap e635: 8 total, 8 up, 8 in 2024-05-20T22:22:51.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:50 smithi050 bash[28929]: audit 2024-05-20T22:22:49.806178+0000 mon.a (mon.0) 3302 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:22:51.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:50 smithi050 bash[28929]: cluster 2024-05-20T22:22:49.813551+0000 mon.a (mon.0) 3303 : cluster 0 osdmap e634: 8 total, 8 up, 8 in 2024-05-20T22:22:51.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:50 smithi050 bash[28929]: audit 2024-05-20T22:22:49.814984+0000 mon.c (mon.2) 423 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-124"}]: dispatch 2024-05-20T22:22:51.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:50 smithi050 bash[28929]: audit 2024-05-20T22:22:49.815964+0000 mon.a (mon.0) 3304 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-124"}]: dispatch 2024-05-20T22:22:51.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:50 smithi050 bash[28929]: cluster 2024-05-20T22:22:50.806478+0000 mon.a (mon.0) 3305 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:22:51.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:50 smithi050 bash[28929]: audit 2024-05-20T22:22:50.808981+0000 mon.a (mon.0) 3306 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-124"}]': finished 2024-05-20T22:22:51.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:50 smithi050 bash[28929]: cluster 2024-05-20T22:22:50.816923+0000 mon.a (mon.0) 3307 : cluster 0 osdmap e635: 8 total, 8 up, 8 in 2024-05-20T22:22:52.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:51 smithi145 bash[23893]: cluster 2024-05-20T22:22:50.536919+0000 mgr.y (mgr.14592) 635 : cluster 0 pgmap v1033: 364 pgs: 364 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 4 op/s 2024-05-20T22:22:52.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:51 smithi050 bash[21866]: cluster 2024-05-20T22:22:50.536919+0000 mgr.y (mgr.14592) 635 : cluster 0 pgmap v1033: 364 pgs: 364 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 4 op/s 2024-05-20T22:22:52.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:51 smithi050 bash[28929]: cluster 2024-05-20T22:22:50.536919+0000 mgr.y (mgr.14592) 635 : cluster 0 pgmap v1033: 364 pgs: 364 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 4 op/s 2024-05-20T22:22:53.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:52 smithi145 bash[23893]: cluster 2024-05-20T22:22:51.843524+0000 mon.a (mon.0) 3308 : cluster 0 osdmap e636: 8 total, 8 up, 8 in 2024-05-20T22:22:53.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:52 smithi145 bash[23893]: cluster 2024-05-20T22:22:52.538032+0000 mgr.y (mgr.14592) 636 : cluster 0 pgmap v1036: 332 pgs: 332 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:22:53.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:52 smithi050 bash[21866]: cluster 2024-05-20T22:22:51.843524+0000 mon.a (mon.0) 3308 : cluster 0 osdmap e636: 8 total, 8 up, 8 in 2024-05-20T22:22:53.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:52 smithi050 bash[21866]: cluster 2024-05-20T22:22:52.538032+0000 mgr.y (mgr.14592) 636 : cluster 0 pgmap v1036: 332 pgs: 332 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:22:53.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:52 smithi050 bash[28929]: cluster 2024-05-20T22:22:51.843524+0000 mon.a (mon.0) 3308 : cluster 0 osdmap e636: 8 total, 8 up, 8 in 2024-05-20T22:22:53.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:52 smithi050 bash[28929]: cluster 2024-05-20T22:22:52.538032+0000 mgr.y (mgr.14592) 636 : cluster 0 pgmap v1036: 332 pgs: 332 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:22:54.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:53 smithi145 bash[23893]: cluster 2024-05-20T22:22:52.869293+0000 mon.a (mon.0) 3309 : cluster 0 osdmap e637: 8 total, 8 up, 8 in 2024-05-20T22:22:54.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:53 smithi145 bash[23893]: audit 2024-05-20T22:22:52.876305+0000 mon.c (mon.2) 424 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:54.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:53 smithi145 bash[23893]: audit 2024-05-20T22:22:52.877447+0000 mon.a (mon.0) 3310 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:54.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:53 smithi145 bash[23893]: audit 2024-05-20T22:22:53.576069+0000 mon.a (mon.0) 3311 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:22:54.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:53 smithi050 bash[21866]: cluster 2024-05-20T22:22:52.869293+0000 mon.a (mon.0) 3309 : cluster 0 osdmap e637: 8 total, 8 up, 8 in 2024-05-20T22:22:54.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:53 smithi050 bash[21866]: audit 2024-05-20T22:22:52.876305+0000 mon.c (mon.2) 424 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:54.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:53 smithi050 bash[21866]: audit 2024-05-20T22:22:52.877447+0000 mon.a (mon.0) 3310 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:54.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:53 smithi050 bash[21866]: audit 2024-05-20T22:22:53.576069+0000 mon.a (mon.0) 3311 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:22:54.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:53 smithi050 bash[28929]: cluster 2024-05-20T22:22:52.869293+0000 mon.a (mon.0) 3309 : cluster 0 osdmap e637: 8 total, 8 up, 8 in 2024-05-20T22:22:54.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:53 smithi050 bash[28929]: audit 2024-05-20T22:22:52.876305+0000 mon.c (mon.2) 424 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:54.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:53 smithi050 bash[28929]: audit 2024-05-20T22:22:52.877447+0000 mon.a (mon.0) 3310 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:22:54.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:53 smithi050 bash[28929]: audit 2024-05-20T22:22:53.576069+0000 mon.a (mon.0) 3311 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:22:55.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:54 smithi145 bash[23893]: audit 2024-05-20T22:22:53.862357+0000 mon.a (mon.0) 3312 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:22:55.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:54 smithi145 bash[23893]: cluster 2024-05-20T22:22:53.871043+0000 mon.a (mon.0) 3313 : cluster 0 osdmap e638: 8 total, 8 up, 8 in 2024-05-20T22:22:55.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:54 smithi145 bash[23893]: audit 2024-05-20T22:22:53.894863+0000 mon.c (mon.2) 425 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:55.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:54 smithi145 bash[23893]: audit 2024-05-20T22:22:53.896274+0000 mon.a (mon.0) 3314 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:55.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:54 smithi145 bash[23893]: cluster 2024-05-20T22:22:54.539061+0000 mgr.y (mgr.14592) 637 : cluster 0 pgmap v1039: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:22:55.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:54 smithi050 bash[21866]: audit 2024-05-20T22:22:53.862357+0000 mon.a (mon.0) 3312 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:22:55.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:54 smithi050 bash[21866]: cluster 2024-05-20T22:22:53.871043+0000 mon.a (mon.0) 3313 : cluster 0 osdmap e638: 8 total, 8 up, 8 in 2024-05-20T22:22:55.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:54 smithi050 bash[21866]: audit 2024-05-20T22:22:53.894863+0000 mon.c (mon.2) 425 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:55.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:54 smithi050 bash[21866]: audit 2024-05-20T22:22:53.896274+0000 mon.a (mon.0) 3314 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:55.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:54 smithi050 bash[21866]: cluster 2024-05-20T22:22:54.539061+0000 mgr.y (mgr.14592) 637 : cluster 0 pgmap v1039: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:22:55.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:54 smithi050 bash[28929]: audit 2024-05-20T22:22:53.862357+0000 mon.a (mon.0) 3312 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:22:55.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:54 smithi050 bash[28929]: cluster 2024-05-20T22:22:53.871043+0000 mon.a (mon.0) 3313 : cluster 0 osdmap e638: 8 total, 8 up, 8 in 2024-05-20T22:22:55.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:54 smithi050 bash[28929]: audit 2024-05-20T22:22:53.894863+0000 mon.c (mon.2) 425 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:55.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:54 smithi050 bash[28929]: audit 2024-05-20T22:22:53.896274+0000 mon.a (mon.0) 3314 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:22:55.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:54 smithi050 bash[28929]: cluster 2024-05-20T22:22:54.539061+0000 mgr.y (mgr.14592) 637 : cluster 0 pgmap v1039: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:22:56.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:55 smithi145 bash[23893]: audit 2024-05-20T22:22:54.886802+0000 mon.a (mon.0) 3315 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-126", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:22:56.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:55 smithi145 bash[23893]: cluster 2024-05-20T22:22:54.896724+0000 mon.a (mon.0) 3316 : cluster 0 osdmap e639: 8 total, 8 up, 8 in 2024-05-20T22:22:56.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:55 smithi145 bash[23893]: audit 2024-05-20T22:22:54.897789+0000 mon.c (mon.2) 426 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-126"}]: dispatch 2024-05-20T22:22:56.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:55 smithi145 bash[23893]: audit 2024-05-20T22:22:54.899020+0000 mon.a (mon.0) 3317 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-126"}]: dispatch 2024-05-20T22:22:56.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:55 smithi145 bash[23893]: audit 2024-05-20T22:22:55.592077+0000 mon.a (mon.0) 3318 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-126"}]': finished 2024-05-20T22:22:56.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:55 smithi145 bash[23893]: cluster 2024-05-20T22:22:55.599386+0000 mon.a (mon.0) 3319 : cluster 0 osdmap e640: 8 total, 8 up, 8 in 2024-05-20T22:22:56.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:55 smithi145 bash[23893]: audit 2024-05-20T22:22:55.606331+0000 mon.c (mon.2) 427 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-126", "mode": "writeback"}]: dispatch 2024-05-20T22:22:56.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:55 smithi145 bash[23893]: audit 2024-05-20T22:22:55.607654+0000 mon.a (mon.0) 3320 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-126", "mode": "writeback"}]: dispatch 2024-05-20T22:22:56.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:55 smithi050 bash[21866]: audit 2024-05-20T22:22:54.886802+0000 mon.a (mon.0) 3315 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-126", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:22:56.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:55 smithi050 bash[21866]: cluster 2024-05-20T22:22:54.896724+0000 mon.a (mon.0) 3316 : cluster 0 osdmap e639: 8 total, 8 up, 8 in 2024-05-20T22:22:56.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:55 smithi050 bash[21866]: audit 2024-05-20T22:22:54.897789+0000 mon.c (mon.2) 426 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-126"}]: dispatch 2024-05-20T22:22:56.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:55 smithi050 bash[21866]: audit 2024-05-20T22:22:54.899020+0000 mon.a (mon.0) 3317 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-126"}]: dispatch 2024-05-20T22:22:56.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:55 smithi050 bash[21866]: audit 2024-05-20T22:22:55.592077+0000 mon.a (mon.0) 3318 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-126"}]': finished 2024-05-20T22:22:56.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:55 smithi050 bash[21866]: cluster 2024-05-20T22:22:55.599386+0000 mon.a (mon.0) 3319 : cluster 0 osdmap e640: 8 total, 8 up, 8 in 2024-05-20T22:22:56.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:55 smithi050 bash[21866]: audit 2024-05-20T22:22:55.606331+0000 mon.c (mon.2) 427 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-126", "mode": "writeback"}]: dispatch 2024-05-20T22:22:56.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:55 smithi050 bash[21866]: audit 2024-05-20T22:22:55.607654+0000 mon.a (mon.0) 3320 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-126", "mode": "writeback"}]: dispatch 2024-05-20T22:22:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:55 smithi050 bash[28929]: audit 2024-05-20T22:22:54.886802+0000 mon.a (mon.0) 3315 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-126", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:22:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:55 smithi050 bash[28929]: cluster 2024-05-20T22:22:54.896724+0000 mon.a (mon.0) 3316 : cluster 0 osdmap e639: 8 total, 8 up, 8 in 2024-05-20T22:22:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:55 smithi050 bash[28929]: audit 2024-05-20T22:22:54.897789+0000 mon.c (mon.2) 426 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-126"}]: dispatch 2024-05-20T22:22:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:55 smithi050 bash[28929]: audit 2024-05-20T22:22:54.899020+0000 mon.a (mon.0) 3317 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-126"}]: dispatch 2024-05-20T22:22:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:55 smithi050 bash[28929]: audit 2024-05-20T22:22:55.592077+0000 mon.a (mon.0) 3318 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-126"}]': finished 2024-05-20T22:22:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:55 smithi050 bash[28929]: cluster 2024-05-20T22:22:55.599386+0000 mon.a (mon.0) 3319 : cluster 0 osdmap e640: 8 total, 8 up, 8 in 2024-05-20T22:22:56.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:55 smithi050 bash[28929]: audit 2024-05-20T22:22:55.606331+0000 mon.c (mon.2) 427 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-126", "mode": "writeback"}]: dispatch 2024-05-20T22:22:56.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:55 smithi050 bash[28929]: audit 2024-05-20T22:22:55.607654+0000 mon.a (mon.0) 3320 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-126", "mode": "writeback"}]: dispatch 2024-05-20T22:22:57.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:56 smithi050 bash[28929]: cluster 2024-05-20T22:22:56.540258+0000 mgr.y (mgr.14592) 638 : cluster 0 pgmap v1042: 364 pgs: 364 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:22:57.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:56 smithi050 bash[28929]: cluster 2024-05-20T22:22:56.592593+0000 mon.a (mon.0) 3321 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:22:57.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:56 smithi050 bash[28929]: audit 2024-05-20T22:22:56.594980+0000 mon.a (mon.0) 3322 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-126", "mode": "writeback"}]': finished 2024-05-20T22:22:57.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:56 smithi050 bash[28929]: cluster 2024-05-20T22:22:56.602601+0000 mon.a (mon.0) 3323 : cluster 0 osdmap e641: 8 total, 8 up, 8 in 2024-05-20T22:22:57.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:56 smithi050 bash[28929]: audit 2024-05-20T22:22:56.764375+0000 mon.c (mon.2) 428 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:57.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:56 smithi050 bash[28929]: audit 2024-05-20T22:22:56.765157+0000 mon.a (mon.0) 3324 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:57.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:56 smithi050 bash[21866]: cluster 2024-05-20T22:22:56.540258+0000 mgr.y (mgr.14592) 638 : cluster 0 pgmap v1042: 364 pgs: 364 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:22:57.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:56 smithi050 bash[21866]: cluster 2024-05-20T22:22:56.592593+0000 mon.a (mon.0) 3321 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:22:57.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:56 smithi050 bash[21866]: audit 2024-05-20T22:22:56.594980+0000 mon.a (mon.0) 3322 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-126", "mode": "writeback"}]': finished 2024-05-20T22:22:57.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:56 smithi050 bash[21866]: cluster 2024-05-20T22:22:56.602601+0000 mon.a (mon.0) 3323 : cluster 0 osdmap e641: 8 total, 8 up, 8 in 2024-05-20T22:22:57.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:56 smithi050 bash[21866]: audit 2024-05-20T22:22:56.764375+0000 mon.c (mon.2) 428 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:57.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:56 smithi050 bash[21866]: audit 2024-05-20T22:22:56.765157+0000 mon.a (mon.0) 3324 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:57.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:56 smithi145 bash[23893]: cluster 2024-05-20T22:22:56.540258+0000 mgr.y (mgr.14592) 638 : cluster 0 pgmap v1042: 364 pgs: 364 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:22:57.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:56 smithi145 bash[23893]: cluster 2024-05-20T22:22:56.592593+0000 mon.a (mon.0) 3321 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:22:57.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:56 smithi145 bash[23893]: audit 2024-05-20T22:22:56.594980+0000 mon.a (mon.0) 3322 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-126", "mode": "writeback"}]': finished 2024-05-20T22:22:57.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:56 smithi145 bash[23893]: cluster 2024-05-20T22:22:56.602601+0000 mon.a (mon.0) 3323 : cluster 0 osdmap e641: 8 total, 8 up, 8 in 2024-05-20T22:22:57.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:56 smithi145 bash[23893]: audit 2024-05-20T22:22:56.764375+0000 mon.c (mon.2) 428 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:57.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:56 smithi145 bash[23893]: audit 2024-05-20T22:22:56.765157+0000 mon.a (mon.0) 3324 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:22:58.608 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:22:58 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:22:58.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:58 smithi145 bash[23893]: audit 2024-05-20T22:22:57.597725+0000 mon.a (mon.0) 3325 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:22:58.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:58 smithi145 bash[23893]: cluster 2024-05-20T22:22:57.604244+0000 mon.a (mon.0) 3326 : cluster 0 osdmap e642: 8 total, 8 up, 8 in 2024-05-20T22:22:58.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:58 smithi145 bash[23893]: audit 2024-05-20T22:22:57.605865+0000 mon.c (mon.2) 429 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-126"}]: dispatch 2024-05-20T22:22:58.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:58 smithi145 bash[23893]: audit 2024-05-20T22:22:57.606847+0000 mon.a (mon.0) 3327 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-126"}]: dispatch 2024-05-20T22:22:58.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:58 smithi145 bash[23893]: audit 2024-05-20T22:22:57.701291+0000 mon.a (mon.0) 3328 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:22:58.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:58 smithi145 bash[23893]: audit 2024-05-20T22:22:58.418475+0000 mon.a (mon.0) 3329 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:22:58.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:58 smithi145 bash[23893]: audit 2024-05-20T22:22:58.419717+0000 mon.a (mon.0) 3330 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:22:58.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:58 smithi145 bash[23893]: audit 2024-05-20T22:22:58.428696+0000 mon.a (mon.0) 3331 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:22:58.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:58 smithi050 bash[21866]: audit 2024-05-20T22:22:57.597725+0000 mon.a (mon.0) 3325 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:22:58.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:58 smithi050 bash[21866]: cluster 2024-05-20T22:22:57.604244+0000 mon.a (mon.0) 3326 : cluster 0 osdmap e642: 8 total, 8 up, 8 in 2024-05-20T22:22:58.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:58 smithi050 bash[21866]: audit 2024-05-20T22:22:57.605865+0000 mon.c (mon.2) 429 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-126"}]: dispatch 2024-05-20T22:22:58.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:58 smithi050 bash[21866]: audit 2024-05-20T22:22:57.606847+0000 mon.a (mon.0) 3327 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-126"}]: dispatch 2024-05-20T22:22:58.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:58 smithi050 bash[21866]: audit 2024-05-20T22:22:57.701291+0000 mon.a (mon.0) 3328 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:22:58.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:58 smithi050 bash[21866]: audit 2024-05-20T22:22:58.418475+0000 mon.a (mon.0) 3329 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:22:58.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:58 smithi050 bash[21866]: audit 2024-05-20T22:22:58.419717+0000 mon.a (mon.0) 3330 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:22:58.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:58 smithi050 bash[21866]: audit 2024-05-20T22:22:58.428696+0000 mon.a (mon.0) 3331 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:22:58.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:58 smithi050 bash[28929]: audit 2024-05-20T22:22:57.597725+0000 mon.a (mon.0) 3325 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:22:58.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:58 smithi050 bash[28929]: cluster 2024-05-20T22:22:57.604244+0000 mon.a (mon.0) 3326 : cluster 0 osdmap e642: 8 total, 8 up, 8 in 2024-05-20T22:22:58.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:58 smithi050 bash[28929]: audit 2024-05-20T22:22:57.605865+0000 mon.c (mon.2) 429 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-126"}]: dispatch 2024-05-20T22:22:58.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:58 smithi050 bash[28929]: audit 2024-05-20T22:22:57.606847+0000 mon.a (mon.0) 3327 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-126"}]: dispatch 2024-05-20T22:22:58.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:58 smithi050 bash[28929]: audit 2024-05-20T22:22:57.701291+0000 mon.a (mon.0) 3328 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:22:58.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:58 smithi050 bash[28929]: audit 2024-05-20T22:22:58.418475+0000 mon.a (mon.0) 3329 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:22:58.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:58 smithi050 bash[28929]: audit 2024-05-20T22:22:58.419717+0000 mon.a (mon.0) 3330 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:22:58.945 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:58 smithi050 bash[28929]: audit 2024-05-20T22:22:58.428696+0000 mon.a (mon.0) 3331 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:22:59.625 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 se api_tier_pp: require_osd_release = squid 2024-05-20T22:22:59.625 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (9082 ms) 2024-05-20T22:22:59.625 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-05-20T22:22:59.625 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: require_osd_release = squid 2024-05-20T22:22:59.625 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (6062 ms) 2024-05-20T22:22:59.625 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-05-20T22:22:59.625 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: require_osd_release = squid 2024-05-20T22:22:59.625 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollback (5022 ms) 2024-05-20T22:22:59.625 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-05-20T22:22:59.626 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: require_osd_release = squid 2024-05-20T22:22:59.626 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (25413 ms) 2024-05-20T22:22:59.626 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-05-20T22:22:59.626 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: require_osd_release = squid 2024-05-20T22:22:59.626 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictRollback (14116 ms) 2024-05-20T22:22:59.626 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-05-20T22:22:59.626 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (12095 ms) 2024-05-20T22:22:59.626 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-05-20T22:22:59.626 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2024-05-20T22:22:59.626 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 00000010 69 73 |is| 2024-05-20T22:22:59.626 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 00000012 2024-05-20T22:22:59.627 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (12092 ms) 2024-05-20T22:22:59.627 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-05-20T22:22:59.627 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: require_osd_release = squid 2024-05-20T22:22:59.627 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (6044 ms) 2024-05-20T22:22:59.627 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (564892 ms total) 2024-05-20T22:22:59.627 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 2024-05-20T22:22:59.627 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2024-05-20T22:22:59.627 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2024-05-20T22:22:59.627 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1037 ms) 2024-05-20T22:22:59.627 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-05-20T22:22:59.627 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (11108 ms) 2024-05-20T22:22:59.627 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2024-05-20T22:22:59.627 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (18119 ms) 2024-05-20T22:22:59.628 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2024-05-20T22:22:59.628 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (3 ms) 2024-05-20T22:22:59.628 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (30267 ms total) 2024-05-20T22:22:59.628 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 2024-05-20T22:22:59.628 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2024-05-20T22:22:59.628 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-05-20T22:22:59.628 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (7041 ms) 2024-05-20T22:22:59.628 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2024-05-20T22:22:59.628 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (8107 ms) 2024-05-20T22:22:59.628 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-05-20T22:22:59.628 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: waiting for scrub... 2024-05-20T22:22:59.628 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: done waiting 2024-05-20T22:22:59.628 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (24342 ms) 2024-05-20T22:22:59.629 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-05-20T22:22:59.629 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (10102 ms) 2024-05-20T22:22:59.629 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-05-20T22:22:59.629 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (7895 ms) 2024-05-20T22:22:59.629 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2024-05-20T22:22:59.629 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (8095 ms) 2024-05-20T22:22:59.629 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-05-20T22:22:59.629 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (10151 ms) 2024-05-20T22:22:59.629 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-05-20T22:22:59.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:22:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:22:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:22:59.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:59 smithi050 bash[21866]: audit 2024-05-20T22:22:58.321099+0000 mgr.y (mgr.14592) 639 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:22:59.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:59 smithi050 bash[21866]: cluster 2024-05-20T22:22:58.541366+0000 mgr.y (mgr.14592) 640 : cluster 0 pgmap v1045: 364 pgs: 364 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:22:59.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:59 smithi050 bash[21866]: cluster 2024-05-20T22:22:58.598074+0000 mon.a (mon.0) 3332 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:22:59.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:59 smithi050 bash[21866]: audit 2024-05-20T22:22:58.600574+0000 mon.a (mon.0) 3333 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-126"}]': finished 2024-05-20T22:22:59.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:22:59 smithi050 bash[21866]: cluster 2024-05-20T22:22:58.608099+0000 mon.a (mon.0) 3334 : cluster 0 osdmap e643: 8 total, 8 up, 8 in 2024-05-20T22:22:59.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:59 smithi050 bash[28929]: audit 2024-05-20T22:22:58.321099+0000 mgr.y (mgr.14592) 639 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:22:59.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:59 smithi050 bash[28929]: cluster 2024-05-20T22:22:58.541366+0000 mgr.y (mgr.14592) 640 : cluster 0 pgmap v1045: 364 pgs: 364 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:22:59.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:59 smithi050 bash[28929]: cluster 2024-05-20T22:22:58.598074+0000 mon.a (mon.0) 3332 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:22:59.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:59 smithi050 bash[28929]: audit 2024-05-20T22:22:58.600574+0000 mon.a (mon.0) 3333 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-126"}]': finished 2024-05-20T22:22:59.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:22:59 smithi050 bash[28929]: cluster 2024-05-20T22:22:58.608099+0000 mon.a (mon.0) 3334 : cluster 0 osdmap e643: 8 total, 8 up, 8 in 2024-05-20T22:22:59.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:59 smithi145 bash[23893]: audit 2024-05-20T22:22:58.321099+0000 mgr.y (mgr.14592) 639 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:22:59.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:59 smithi145 bash[23893]: cluster 2024-05-20T22:22:58.541366+0000 mgr.y (mgr.14592) 640 : cluster 0 pgmap v1045: 364 pgs: 364 active+clean; 583 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:22:59.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:59 smithi145 bash[23893]: cluster 2024-05-20T22:22:58.598074+0000 mon.a (mon.0) 3332 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:22:59.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:59 smithi145 bash[23893]: audit 2024-05-20T22:22:58.600574+0000 mon.a (mon.0) 3333 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-126"}]': finished 2024-05-20T22:22:59.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:22:59 smithi145 bash[23893]: cluster 2024-05-20T22:22:58.608099+0000 mon.a (mon.0) 3334 : cluster 0 osdmap e643: 8 total, 8 up, 8 in 2024-05-20T22:23:00.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:00 smithi145 bash[23893]: cluster 2024-05-20T22:22:59.629613+0000 mon.a (mon.0) 3335 : cluster 0 osdmap e644: 8 total, 8 up, 8 in 2024-05-20T22:23:00.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:00 smithi050 bash[21866]: cluster 2024-05-20T22:22:59.629613+0000 mon.a (mon.0) 3335 : cluster 0 osdmap e644: 8 total, 8 up, 8 in 2024-05-20T22:23:00.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:00 smithi050 bash[28929]: cluster 2024-05-20T22:22:59.629613+0000 mon.a (mon.0) 3335 : cluster 0 osdmap e644: 8 total, 8 up, 8 in 2024-05-20T22:23:01.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:01 smithi050 bash[21866]: cluster 2024-05-20T22:23:00.544450+0000 mgr.y (mgr.14592) 641 : cluster 0 pgmap v1048: 332 pgs: 332 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:23:01.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:01 smithi050 bash[21866]: cluster 2024-05-20T22:23:00.645182+0000 mon.a (mon.0) 3336 : cluster 0 osdmap e645: 8 total, 8 up, 8 in 2024-05-20T22:23:01.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:01 smithi050 bash[21866]: audit 2024-05-20T22:23:00.658661+0000 mon.c (mon.2) 430 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:01.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:01 smithi050 bash[21866]: audit 2024-05-20T22:23:00.669950+0000 mon.a (mon.0) 3337 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:01 smithi050 bash[28929]: cluster 2024-05-20T22:23:00.544450+0000 mgr.y (mgr.14592) 641 : cluster 0 pgmap v1048: 332 pgs: 332 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:23:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:01 smithi050 bash[28929]: cluster 2024-05-20T22:23:00.645182+0000 mon.a (mon.0) 3336 : cluster 0 osdmap e645: 8 total, 8 up, 8 in 2024-05-20T22:23:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:01 smithi050 bash[28929]: audit 2024-05-20T22:23:00.658661+0000 mon.c (mon.2) 430 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:01.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:01 smithi050 bash[28929]: audit 2024-05-20T22:23:00.669950+0000 mon.a (mon.0) 3337 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:02.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:01 smithi145 bash[23893]: cluster 2024-05-20T22:23:00.544450+0000 mgr.y (mgr.14592) 641 : cluster 0 pgmap v1048: 332 pgs: 332 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:23:02.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:01 smithi145 bash[23893]: cluster 2024-05-20T22:23:00.645182+0000 mon.a (mon.0) 3336 : cluster 0 osdmap e645: 8 total, 8 up, 8 in 2024-05-20T22:23:02.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:01 smithi145 bash[23893]: audit 2024-05-20T22:23:00.658661+0000 mon.c (mon.2) 430 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:02.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:01 smithi145 bash[23893]: audit 2024-05-20T22:23:00.669950+0000 mon.a (mon.0) 3337 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:02.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:02 smithi050 bash[21866]: audit 2024-05-20T22:23:01.639247+0000 mon.a (mon.0) 3338 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:23:02.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:02 smithi050 bash[21866]: cluster 2024-05-20T22:23:01.647553+0000 mon.a (mon.0) 3339 : cluster 0 osdmap e646: 8 total, 8 up, 8 in 2024-05-20T22:23:02.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:02 smithi050 bash[21866]: audit 2024-05-20T22:23:01.651602+0000 mon.c (mon.2) 431 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:02.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:02 smithi050 bash[21866]: audit 2024-05-20T22:23:01.654868+0000 mon.a (mon.0) 3340 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:02.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:02 smithi050 bash[21866]: audit 2024-05-20T22:23:02.642592+0000 mon.a (mon.0) 3341 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-128", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:23:02.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:02 smithi050 bash[21866]: cluster 2024-05-20T22:23:02.649296+0000 mon.a (mon.0) 3342 : cluster 0 osdmap e647: 8 total, 8 up, 8 in 2024-05-20T22:23:02.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:02 smithi050 bash[21866]: audit 2024-05-20T22:23:02.652386+0000 mon.c (mon.2) 432 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-128"}]: dispatch 2024-05-20T22:23:02.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:02 smithi050 bash[28929]: audit 2024-05-20T22:23:01.639247+0000 mon.a (mon.0) 3338 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:23:02.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:02 smithi050 bash[28929]: cluster 2024-05-20T22:23:01.647553+0000 mon.a (mon.0) 3339 : cluster 0 osdmap e646: 8 total, 8 up, 8 in 2024-05-20T22:23:02.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:02 smithi050 bash[28929]: audit 2024-05-20T22:23:01.651602+0000 mon.c (mon.2) 431 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:02.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:02 smithi050 bash[28929]: audit 2024-05-20T22:23:01.654868+0000 mon.a (mon.0) 3340 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:02.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:02 smithi050 bash[28929]: audit 2024-05-20T22:23:02.642592+0000 mon.a (mon.0) 3341 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-128", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:23:02.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:02 smithi050 bash[28929]: cluster 2024-05-20T22:23:02.649296+0000 mon.a (mon.0) 3342 : cluster 0 osdmap e647: 8 total, 8 up, 8 in 2024-05-20T22:23:02.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:02 smithi050 bash[28929]: audit 2024-05-20T22:23:02.652386+0000 mon.c (mon.2) 432 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-128"}]: dispatch 2024-05-20T22:23:03.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:02 smithi145 bash[23893]: audit 2024-05-20T22:23:01.639247+0000 mon.a (mon.0) 3338 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:23:03.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:02 smithi145 bash[23893]: cluster 2024-05-20T22:23:01.647553+0000 mon.a (mon.0) 3339 : cluster 0 osdmap e646: 8 total, 8 up, 8 in 2024-05-20T22:23:03.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:02 smithi145 bash[23893]: audit 2024-05-20T22:23:01.651602+0000 mon.c (mon.2) 431 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:03.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:02 smithi145 bash[23893]: audit 2024-05-20T22:23:01.654868+0000 mon.a (mon.0) 3340 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:03.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:02 smithi145 bash[23893]: audit 2024-05-20T22:23:02.642592+0000 mon.a (mon.0) 3341 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-128", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:23:03.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:02 smithi145 bash[23893]: cluster 2024-05-20T22:23:02.649296+0000 mon.a (mon.0) 3342 : cluster 0 osdmap e647: 8 total, 8 up, 8 in 2024-05-20T22:23:03.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:02 smithi145 bash[23893]: audit 2024-05-20T22:23:02.652386+0000 mon.c (mon.2) 432 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-128"}]: dispatch 2024-05-20T22:23:03.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:03 smithi050 bash[28929]: cluster 2024-05-20T22:23:02.545436+0000 mgr.y (mgr.14592) 642 : cluster 0 pgmap v1051: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:23:03.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:03 smithi050 bash[28929]: audit 2024-05-20T22:23:02.656028+0000 mon.a (mon.0) 3343 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-128"}]: dispatch 2024-05-20T22:23:03.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:03 smithi050 bash[28929]: audit 2024-05-20T22:23:03.645455+0000 mon.a (mon.0) 3344 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-128"}]': finished 2024-05-20T22:23:03.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:03 smithi050 bash[28929]: cluster 2024-05-20T22:23:03.652755+0000 mon.a (mon.0) 3345 : cluster 0 osdmap e648: 8 total, 8 up, 8 in 2024-05-20T22:23:03.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:03 smithi050 bash[28929]: audit 2024-05-20T22:23:03.655240+0000 mon.c (mon.2) 433 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-128", "mode": "writeback"}]: dispatch 2024-05-20T22:23:03.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:03 smithi050 bash[28929]: audit 2024-05-20T22:23:03.659157+0000 mon.a (mon.0) 3346 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-128", "mode": "writeback"}]: dispatch 2024-05-20T22:23:03.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:03 smithi050 bash[21866]: cluster 2024-05-20T22:23:02.545436+0000 mgr.y (mgr.14592) 642 : cluster 0 pgmap v1051: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:23:03.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:03 smithi050 bash[21866]: audit 2024-05-20T22:23:02.656028+0000 mon.a (mon.0) 3343 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-128"}]: dispatch 2024-05-20T22:23:03.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:03 smithi050 bash[21866]: audit 2024-05-20T22:23:03.645455+0000 mon.a (mon.0) 3344 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-128"}]': finished 2024-05-20T22:23:03.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:03 smithi050 bash[21866]: cluster 2024-05-20T22:23:03.652755+0000 mon.a (mon.0) 3345 : cluster 0 osdmap e648: 8 total, 8 up, 8 in 2024-05-20T22:23:03.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:03 smithi050 bash[21866]: audit 2024-05-20T22:23:03.655240+0000 mon.c (mon.2) 433 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-128", "mode": "writeback"}]: dispatch 2024-05-20T22:23:03.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:03 smithi050 bash[21866]: audit 2024-05-20T22:23:03.659157+0000 mon.a (mon.0) 3346 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-128", "mode": "writeback"}]: dispatch 2024-05-20T22:23:04.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:03 smithi145 bash[23893]: cluster 2024-05-20T22:23:02.545436+0000 mgr.y (mgr.14592) 642 : cluster 0 pgmap v1051: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:23:04.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:03 smithi145 bash[23893]: audit 2024-05-20T22:23:02.656028+0000 mon.a (mon.0) 3343 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-128"}]: dispatch 2024-05-20T22:23:04.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:03 smithi145 bash[23893]: audit 2024-05-20T22:23:03.645455+0000 mon.a (mon.0) 3344 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-128"}]': finished 2024-05-20T22:23:04.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:03 smithi145 bash[23893]: cluster 2024-05-20T22:23:03.652755+0000 mon.a (mon.0) 3345 : cluster 0 osdmap e648: 8 total, 8 up, 8 in 2024-05-20T22:23:04.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:03 smithi145 bash[23893]: audit 2024-05-20T22:23:03.655240+0000 mon.c (mon.2) 433 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-128", "mode": "writeback"}]: dispatch 2024-05-20T22:23:04.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:03 smithi145 bash[23893]: audit 2024-05-20T22:23:03.659157+0000 mon.a (mon.0) 3346 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-128", "mode": "writeback"}]: dispatch 2024-05-20T22:23:04.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:04 smithi050 bash[21866]: cluster 2024-05-20T22:23:04.645806+0000 mon.a (mon.0) 3347 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:23:04.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:04 smithi050 bash[21866]: audit 2024-05-20T22:23:04.648134+0000 mon.a (mon.0) 3348 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-128", "mode": "writeback"}]': finished 2024-05-20T22:23:04.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:04 smithi050 bash[21866]: cluster 2024-05-20T22:23:04.656319+0000 mon.a (mon.0) 3349 : cluster 0 osdmap e649: 8 total, 8 up, 8 in 2024-05-20T22:23:04.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:04 smithi050 bash[28929]: cluster 2024-05-20T22:23:04.645806+0000 mon.a (mon.0) 3347 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:23:04.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:04 smithi050 bash[28929]: audit 2024-05-20T22:23:04.648134+0000 mon.a (mon.0) 3348 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-128", "mode": "writeback"}]': finished 2024-05-20T22:23:04.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:04 smithi050 bash[28929]: cluster 2024-05-20T22:23:04.656319+0000 mon.a (mon.0) 3349 : cluster 0 osdmap e649: 8 total, 8 up, 8 in 2024-05-20T22:23:05.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:04 smithi145 bash[23893]: cluster 2024-05-20T22:23:04.645806+0000 mon.a (mon.0) 3347 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:23:05.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:04 smithi145 bash[23893]: audit 2024-05-20T22:23:04.648134+0000 mon.a (mon.0) 3348 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-128", "mode": "writeback"}]': finished 2024-05-20T22:23:05.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:04 smithi145 bash[23893]: cluster 2024-05-20T22:23:04.656319+0000 mon.a (mon.0) 3349 : cluster 0 osdmap e649: 8 total, 8 up, 8 in 2024-05-20T22:23:05.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:05 smithi050 bash[21866]: cluster 2024-05-20T22:23:04.546431+0000 mgr.y (mgr.14592) 643 : cluster 0 pgmap v1054: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:23:05.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:05 smithi050 bash[28929]: cluster 2024-05-20T22:23:04.546431+0000 mgr.y (mgr.14592) 643 : cluster 0 pgmap v1054: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:23:06.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:05 smithi145 bash[23893]: cluster 2024-05-20T22:23:04.546431+0000 mgr.y (mgr.14592) 643 : cluster 0 pgmap v1054: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:23:07.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:07 smithi050 bash[21866]: cluster 2024-05-20T22:23:06.549648+0000 mgr.y (mgr.14592) 644 : cluster 0 pgmap v1056: 364 pgs: 364 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 417 B/s wr, 1 op/s 2024-05-20T22:23:07.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:07 smithi050 bash[28929]: cluster 2024-05-20T22:23:06.549648+0000 mgr.y (mgr.14592) 644 : cluster 0 pgmap v1056: 364 pgs: 364 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 417 B/s wr, 1 op/s 2024-05-20T22:23:08.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:07 smithi145 bash[23893]: cluster 2024-05-20T22:23:06.549648+0000 mgr.y (mgr.14592) 644 : cluster 0 pgmap v1056: 364 pgs: 364 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 417 B/s wr, 1 op/s 2024-05-20T22:23:08.639 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:23:08 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:23:09.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:23:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:23:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:23:09.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:09 smithi050 bash[21866]: audit 2024-05-20T22:23:08.332357+0000 mgr.y (mgr.14592) 645 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:23:09.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:09 smithi050 bash[21866]: cluster 2024-05-20T22:23:08.550629+0000 mgr.y (mgr.14592) 646 : cluster 0 pgmap v1057: 364 pgs: 364 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 341 B/s wr, 1 op/s 2024-05-20T22:23:09.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:09 smithi050 bash[21866]: audit 2024-05-20T22:23:08.614456+0000 mon.a (mon.0) 3350 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:23:09.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:09 smithi050 bash[21866]: audit 2024-05-20T22:23:08.617097+0000 mon.a (mon.0) 3351 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:23:09.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:09 smithi050 bash[28929]: audit 2024-05-20T22:23:08.332357+0000 mgr.y (mgr.14592) 645 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:23:09.693 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:09 smithi050 bash[28929]: cluster 2024-05-20T22:23:08.550629+0000 mgr.y (mgr.14592) 646 : cluster 0 pgmap v1057: 364 pgs: 364 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 341 B/s wr, 1 op/s 2024-05-20T22:23:09.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:09 smithi050 bash[28929]: audit 2024-05-20T22:23:08.614456+0000 mon.a (mon.0) 3350 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:23:09.694 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:09 smithi050 bash[28929]: audit 2024-05-20T22:23:08.617097+0000 mon.a (mon.0) 3351 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:23:09.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:09 smithi145 bash[23893]: audit 2024-05-20T22:23:08.332357+0000 mgr.y (mgr.14592) 645 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:23:09.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:09 smithi145 bash[23893]: cluster 2024-05-20T22:23:08.550629+0000 mgr.y (mgr.14592) 646 : cluster 0 pgmap v1057: 364 pgs: 364 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 341 B/s wr, 1 op/s 2024-05-20T22:23:09.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:09 smithi145 bash[23893]: audit 2024-05-20T22:23:08.614456+0000 mon.a (mon.0) 3350 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:23:09.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:09 smithi145 bash[23893]: audit 2024-05-20T22:23:08.617097+0000 mon.a (mon.0) 3351 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:23:10.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:10 smithi145 bash[23893]: audit 2024-05-20T22:23:09.831527+0000 mon.c (mon.2) 434 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:10.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:10 smithi145 bash[23893]: audit 2024-05-20T22:23:09.832304+0000 mon.a (mon.0) 3352 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:10.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:10 smithi050 bash[21866]: audit 2024-05-20T22:23:09.831527+0000 mon.c (mon.2) 434 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:10.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:10 smithi050 bash[21866]: audit 2024-05-20T22:23:09.832304+0000 mon.a (mon.0) 3352 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:10.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:10 smithi050 bash[28929]: audit 2024-05-20T22:23:09.831527+0000 mon.c (mon.2) 434 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:10.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:10 smithi050 bash[28929]: audit 2024-05-20T22:23:09.832304+0000 mon.a (mon.0) 3352 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:11.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:11 smithi145 bash[23893]: cluster 2024-05-20T22:23:10.553885+0000 mgr.y (mgr.14592) 647 : cluster 0 pgmap v1058: 364 pgs: 364 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 259 B/s wr, 1 op/s 2024-05-20T22:23:11.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:11 smithi145 bash[23893]: audit 2024-05-20T22:23:10.623135+0000 mon.a (mon.0) 3353 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:23:11.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:11 smithi145 bash[23893]: cluster 2024-05-20T22:23:10.630839+0000 mon.a (mon.0) 3354 : cluster 0 osdmap e650: 8 total, 8 up, 8 in 2024-05-20T22:23:11.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:11 smithi145 bash[23893]: audit 2024-05-20T22:23:10.631378+0000 mon.c (mon.2) 435 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-128"}]: dispatch 2024-05-20T22:23:11.890 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:11 smithi145 bash[23893]: audit 2024-05-20T22:23:10.633365+0000 mon.a (mon.0) 3355 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-128"}]: dispatch 2024-05-20T22:23:11.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:11 smithi050 bash[21866]: cluster 2024-05-20T22:23:10.553885+0000 mgr.y (mgr.14592) 647 : cluster 0 pgmap v1058: 364 pgs: 364 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 259 B/s wr, 1 op/s 2024-05-20T22:23:11.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:11 smithi050 bash[21866]: audit 2024-05-20T22:23:10.623135+0000 mon.a (mon.0) 3353 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:23:11.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:11 smithi050 bash[21866]: cluster 2024-05-20T22:23:10.630839+0000 mon.a (mon.0) 3354 : cluster 0 osdmap e650: 8 total, 8 up, 8 in 2024-05-20T22:23:11.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:11 smithi050 bash[21866]: audit 2024-05-20T22:23:10.631378+0000 mon.c (mon.2) 435 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-128"}]: dispatch 2024-05-20T22:23:11.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:11 smithi050 bash[21866]: audit 2024-05-20T22:23:10.633365+0000 mon.a (mon.0) 3355 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-128"}]: dispatch 2024-05-20T22:23:11.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:11 smithi050 bash[28929]: cluster 2024-05-20T22:23:10.553885+0000 mgr.y (mgr.14592) 647 : cluster 0 pgmap v1058: 364 pgs: 364 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 259 B/s wr, 1 op/s 2024-05-20T22:23:11.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:11 smithi050 bash[28929]: audit 2024-05-20T22:23:10.623135+0000 mon.a (mon.0) 3353 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:23:11.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:11 smithi050 bash[28929]: cluster 2024-05-20T22:23:10.630839+0000 mon.a (mon.0) 3354 : cluster 0 osdmap e650: 8 total, 8 up, 8 in 2024-05-20T22:23:11.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:11 smithi050 bash[28929]: audit 2024-05-20T22:23:10.631378+0000 mon.c (mon.2) 435 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-128"}]: dispatch 2024-05-20T22:23:11.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:11 smithi050 bash[28929]: audit 2024-05-20T22:23:10.633365+0000 mon.a (mon.0) 3355 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-128"}]: dispatch 2024-05-20T22:23:12.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:12 smithi050 bash[21866]: cluster 2024-05-20T22:23:11.623665+0000 mon.a (mon.0) 3356 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:23:12.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:12 smithi050 bash[21866]: audit 2024-05-20T22:23:11.626092+0000 mon.a (mon.0) 3357 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-128"}]': finished 2024-05-20T22:23:12.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:12 smithi050 bash[21866]: cluster 2024-05-20T22:23:11.634057+0000 mon.a (mon.0) 3358 : cluster 0 osdmap e651: 8 total, 8 up, 8 in 2024-05-20T22:23:12.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:12 smithi050 bash[28929]: cluster 2024-05-20T22:23:11.623665+0000 mon.a (mon.0) 3356 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:23:12.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:12 smithi050 bash[28929]: audit 2024-05-20T22:23:11.626092+0000 mon.a (mon.0) 3357 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-128"}]': finished 2024-05-20T22:23:12.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:12 smithi050 bash[28929]: cluster 2024-05-20T22:23:11.634057+0000 mon.a (mon.0) 3358 : cluster 0 osdmap e651: 8 total, 8 up, 8 in 2024-05-20T22:23:13.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:12 smithi145 bash[23893]: cluster 2024-05-20T22:23:11.623665+0000 mon.a (mon.0) 3356 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:23:13.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:12 smithi145 bash[23893]: audit 2024-05-20T22:23:11.626092+0000 mon.a (mon.0) 3357 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-128"}]': finished 2024-05-20T22:23:13.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:12 smithi145 bash[23893]: cluster 2024-05-20T22:23:11.634057+0000 mon.a (mon.0) 3358 : cluster 0 osdmap e651: 8 total, 8 up, 8 in 2024-05-20T22:23:13.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:13 smithi050 bash[21866]: cluster 2024-05-20T22:23:12.554985+0000 mgr.y (mgr.14592) 648 : cluster 0 pgmap v1061: 364 pgs: 364 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 259 B/s wr, 1 op/s 2024-05-20T22:23:13.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:13 smithi050 bash[21866]: cluster 2024-05-20T22:23:12.641235+0000 mon.a (mon.0) 3359 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:23:13.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:13 smithi050 bash[21866]: cluster 2024-05-20T22:23:12.659768+0000 mon.a (mon.0) 3360 : cluster 0 osdmap e652: 8 total, 8 up, 8 in 2024-05-20T22:23:13.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:13 smithi050 bash[28929]: cluster 2024-05-20T22:23:12.554985+0000 mgr.y (mgr.14592) 648 : cluster 0 pgmap v1061: 364 pgs: 364 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 259 B/s wr, 1 op/s 2024-05-20T22:23:13.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:13 smithi050 bash[28929]: cluster 2024-05-20T22:23:12.641235+0000 mon.a (mon.0) 3359 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:23:13.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:13 smithi050 bash[28929]: cluster 2024-05-20T22:23:12.659768+0000 mon.a (mon.0) 3360 : cluster 0 osdmap e652: 8 total, 8 up, 8 in 2024-05-20T22:23:14.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:13 smithi145 bash[23893]: cluster 2024-05-20T22:23:12.554985+0000 mgr.y (mgr.14592) 648 : cluster 0 pgmap v1061: 364 pgs: 364 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 259 B/s wr, 1 op/s 2024-05-20T22:23:14.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:13 smithi145 bash[23893]: cluster 2024-05-20T22:23:12.641235+0000 mon.a (mon.0) 3359 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:23:14.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:13 smithi145 bash[23893]: cluster 2024-05-20T22:23:12.659768+0000 mon.a (mon.0) 3360 : cluster 0 osdmap e652: 8 total, 8 up, 8 in 2024-05-20T22:23:14.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:14 smithi050 bash[21866]: cluster 2024-05-20T22:23:13.670342+0000 mon.a (mon.0) 3361 : cluster 0 osdmap e653: 8 total, 8 up, 8 in 2024-05-20T22:23:14.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:14 smithi050 bash[21866]: audit 2024-05-20T22:23:13.675004+0000 mon.c (mon.2) 436 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:14.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:14 smithi050 bash[21866]: audit 2024-05-20T22:23:13.677475+0000 mon.a (mon.0) 3362 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:14.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:14 smithi050 bash[28929]: cluster 2024-05-20T22:23:13.670342+0000 mon.a (mon.0) 3361 : cluster 0 osdmap e653: 8 total, 8 up, 8 in 2024-05-20T22:23:14.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:14 smithi050 bash[28929]: audit 2024-05-20T22:23:13.675004+0000 mon.c (mon.2) 436 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:14.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:14 smithi050 bash[28929]: audit 2024-05-20T22:23:13.677475+0000 mon.a (mon.0) 3362 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:15.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:14 smithi145 bash[23893]: cluster 2024-05-20T22:23:13.670342+0000 mon.a (mon.0) 3361 : cluster 0 osdmap e653: 8 total, 8 up, 8 in 2024-05-20T22:23:15.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:14 smithi145 bash[23893]: audit 2024-05-20T22:23:13.675004+0000 mon.c (mon.2) 436 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:15.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:14 smithi145 bash[23893]: audit 2024-05-20T22:23:13.677475+0000 mon.a (mon.0) 3362 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:15.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:15 smithi050 bash[21866]: cluster 2024-05-20T22:23:14.556072+0000 mgr.y (mgr.14592) 649 : cluster 0 pgmap v1064: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:23:15.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:15 smithi050 bash[21866]: audit 2024-05-20T22:23:14.674149+0000 mon.a (mon.0) 3363 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:23:15.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:15 smithi050 bash[21866]: cluster 2024-05-20T22:23:14.684775+0000 mon.a (mon.0) 3364 : cluster 0 osdmap e654: 8 total, 8 up, 8 in 2024-05-20T22:23:15.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:15 smithi050 bash[21866]: audit 2024-05-20T22:23:14.688657+0000 mon.c (mon.2) 437 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:15.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:15 smithi050 bash[21866]: audit 2024-05-20T22:23:14.690448+0000 mon.a (mon.0) 3365 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:15.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:15 smithi050 bash[28929]: cluster 2024-05-20T22:23:14.556072+0000 mgr.y (mgr.14592) 649 : cluster 0 pgmap v1064: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:23:15.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:15 smithi050 bash[28929]: audit 2024-05-20T22:23:14.674149+0000 mon.a (mon.0) 3363 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:23:15.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:15 smithi050 bash[28929]: cluster 2024-05-20T22:23:14.684775+0000 mon.a (mon.0) 3364 : cluster 0 osdmap e654: 8 total, 8 up, 8 in 2024-05-20T22:23:15.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:15 smithi050 bash[28929]: audit 2024-05-20T22:23:14.688657+0000 mon.c (mon.2) 437 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:15.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:15 smithi050 bash[28929]: audit 2024-05-20T22:23:14.690448+0000 mon.a (mon.0) 3365 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:16.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:15 smithi145 bash[23893]: cluster 2024-05-20T22:23:14.556072+0000 mgr.y (mgr.14592) 649 : cluster 0 pgmap v1064: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:23:16.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:15 smithi145 bash[23893]: audit 2024-05-20T22:23:14.674149+0000 mon.a (mon.0) 3363 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:23:16.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:15 smithi145 bash[23893]: cluster 2024-05-20T22:23:14.684775+0000 mon.a (mon.0) 3364 : cluster 0 osdmap e654: 8 total, 8 up, 8 in 2024-05-20T22:23:16.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:15 smithi145 bash[23893]: audit 2024-05-20T22:23:14.688657+0000 mon.c (mon.2) 437 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:16.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:15 smithi145 bash[23893]: audit 2024-05-20T22:23:14.690448+0000 mon.a (mon.0) 3365 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:17.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:16 smithi145 bash[23893]: audit 2024-05-20T22:23:15.682919+0000 mon.a (mon.0) 3366 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-130", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:23:17.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:16 smithi145 bash[23893]: cluster 2024-05-20T22:23:15.688278+0000 mon.a (mon.0) 3367 : cluster 0 osdmap e655: 8 total, 8 up, 8 in 2024-05-20T22:23:17.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:16 smithi145 bash[23893]: audit 2024-05-20T22:23:15.690985+0000 mon.c (mon.2) 438 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-130"}]: dispatch 2024-05-20T22:23:17.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:16 smithi145 bash[23893]: audit 2024-05-20T22:23:15.698039+0000 mon.a (mon.0) 3368 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-130"}]: dispatch 2024-05-20T22:23:17.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:16 smithi050 bash[21866]: audit 2024-05-20T22:23:15.682919+0000 mon.a (mon.0) 3366 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-130", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:23:17.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:16 smithi050 bash[21866]: cluster 2024-05-20T22:23:15.688278+0000 mon.a (mon.0) 3367 : cluster 0 osdmap e655: 8 total, 8 up, 8 in 2024-05-20T22:23:17.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:16 smithi050 bash[21866]: audit 2024-05-20T22:23:15.690985+0000 mon.c (mon.2) 438 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-130"}]: dispatch 2024-05-20T22:23:17.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:16 smithi050 bash[21866]: audit 2024-05-20T22:23:15.698039+0000 mon.a (mon.0) 3368 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-130"}]: dispatch 2024-05-20T22:23:17.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:16 smithi050 bash[28929]: audit 2024-05-20T22:23:15.682919+0000 mon.a (mon.0) 3366 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-130", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:23:17.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:16 smithi050 bash[28929]: cluster 2024-05-20T22:23:15.688278+0000 mon.a (mon.0) 3367 : cluster 0 osdmap e655: 8 total, 8 up, 8 in 2024-05-20T22:23:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:16 smithi050 bash[28929]: audit 2024-05-20T22:23:15.690985+0000 mon.c (mon.2) 438 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-130"}]: dispatch 2024-05-20T22:23:17.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:16 smithi050 bash[28929]: audit 2024-05-20T22:23:15.698039+0000 mon.a (mon.0) 3368 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-130"}]: dispatch 2024-05-20T22:23:18.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:17 smithi145 bash[23893]: cluster 2024-05-20T22:23:16.557083+0000 mgr.y (mgr.14592) 650 : cluster 0 pgmap v1067: 364 pgs: 364 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:23:18.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:17 smithi145 bash[23893]: audit 2024-05-20T22:23:16.685740+0000 mon.a (mon.0) 3369 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-130"}]': finished 2024-05-20T22:23:18.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:17 smithi145 bash[23893]: cluster 2024-05-20T22:23:16.693764+0000 mon.a (mon.0) 3370 : cluster 0 osdmap e656: 8 total, 8 up, 8 in 2024-05-20T22:23:18.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:17 smithi145 bash[23893]: audit 2024-05-20T22:23:16.695317+0000 mon.c (mon.2) 439 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-130", "mode": "writeback"}]: dispatch 2024-05-20T22:23:18.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:17 smithi145 bash[23893]: audit 2024-05-20T22:23:16.697651+0000 mon.a (mon.0) 3371 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-130", "mode": "writeback"}]: dispatch 2024-05-20T22:23:18.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:17 smithi145 bash[23893]: cluster 2024-05-20T22:23:17.686377+0000 mon.a (mon.0) 3372 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:23:18.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:17 smithi145 bash[23893]: audit 2024-05-20T22:23:17.689760+0000 mon.a (mon.0) 3373 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-130", "mode": "writeback"}]': finished 2024-05-20T22:23:18.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:17 smithi145 bash[23893]: cluster 2024-05-20T22:23:17.697058+0000 mon.a (mon.0) 3374 : cluster 0 osdmap e657: 8 total, 8 up, 8 in 2024-05-20T22:23:18.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:17 smithi050 bash[21866]: cluster 2024-05-20T22:23:16.557083+0000 mgr.y (mgr.14592) 650 : cluster 0 pgmap v1067: 364 pgs: 364 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:23:18.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:17 smithi050 bash[21866]: audit 2024-05-20T22:23:16.685740+0000 mon.a (mon.0) 3369 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-130"}]': finished 2024-05-20T22:23:18.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:17 smithi050 bash[21866]: cluster 2024-05-20T22:23:16.693764+0000 mon.a (mon.0) 3370 : cluster 0 osdmap e656: 8 total, 8 up, 8 in 2024-05-20T22:23:18.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:17 smithi050 bash[21866]: audit 2024-05-20T22:23:16.695317+0000 mon.c (mon.2) 439 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-130", "mode": "writeback"}]: dispatch 2024-05-20T22:23:18.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:17 smithi050 bash[21866]: audit 2024-05-20T22:23:16.697651+0000 mon.a (mon.0) 3371 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-130", "mode": "writeback"}]: dispatch 2024-05-20T22:23:18.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:17 smithi050 bash[21866]: cluster 2024-05-20T22:23:17.686377+0000 mon.a (mon.0) 3372 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:23:18.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:17 smithi050 bash[21866]: audit 2024-05-20T22:23:17.689760+0000 mon.a (mon.0) 3373 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-130", "mode": "writeback"}]': finished 2024-05-20T22:23:18.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:17 smithi050 bash[21866]: cluster 2024-05-20T22:23:17.697058+0000 mon.a (mon.0) 3374 : cluster 0 osdmap e657: 8 total, 8 up, 8 in 2024-05-20T22:23:18.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:17 smithi050 bash[28929]: cluster 2024-05-20T22:23:16.557083+0000 mgr.y (mgr.14592) 650 : cluster 0 pgmap v1067: 364 pgs: 364 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:23:18.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:17 smithi050 bash[28929]: audit 2024-05-20T22:23:16.685740+0000 mon.a (mon.0) 3369 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-130"}]': finished 2024-05-20T22:23:18.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:17 smithi050 bash[28929]: cluster 2024-05-20T22:23:16.693764+0000 mon.a (mon.0) 3370 : cluster 0 osdmap e656: 8 total, 8 up, 8 in 2024-05-20T22:23:18.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:17 smithi050 bash[28929]: audit 2024-05-20T22:23:16.695317+0000 mon.c (mon.2) 439 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-130", "mode": "writeback"}]: dispatch 2024-05-20T22:23:18.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:17 smithi050 bash[28929]: audit 2024-05-20T22:23:16.697651+0000 mon.a (mon.0) 3371 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-130", "mode": "writeback"}]: dispatch 2024-05-20T22:23:18.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:17 smithi050 bash[28929]: cluster 2024-05-20T22:23:17.686377+0000 mon.a (mon.0) 3372 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:23:18.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:17 smithi050 bash[28929]: audit 2024-05-20T22:23:17.689760+0000 mon.a (mon.0) 3373 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-130", "mode": "writeback"}]': finished 2024-05-20T22:23:18.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:17 smithi050 bash[28929]: cluster 2024-05-20T22:23:17.697058+0000 mon.a (mon.0) 3374 : cluster 0 osdmap e657: 8 total, 8 up, 8 in 2024-05-20T22:23:18.639 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:23:18 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:23:19.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:18 smithi145 bash[23893]: audit 2024-05-20T22:23:17.934025+0000 mon.c (mon.2) 440 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:19.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:18 smithi145 bash[23893]: audit 2024-05-20T22:23:17.934691+0000 mon.a (mon.0) 3375 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:19.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:18 smithi050 bash[21866]: audit 2024-05-20T22:23:17.934025+0000 mon.c (mon.2) 440 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:19.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:18 smithi050 bash[21866]: audit 2024-05-20T22:23:17.934691+0000 mon.a (mon.0) 3375 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:19.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:18 smithi050 bash[28929]: audit 2024-05-20T22:23:17.934025+0000 mon.c (mon.2) 440 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:19.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:18 smithi050 bash[28929]: audit 2024-05-20T22:23:17.934691+0000 mon.a (mon.0) 3375 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:19.692 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:23:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:23:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:23:20.147 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:19 smithi145 bash[23893]: audit 2024-05-20T22:23:18.343786+0000 mgr.y (mgr.14592) 651 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:23:20.148 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:19 smithi145 bash[23893]: cluster 2024-05-20T22:23:18.558051+0000 mgr.y (mgr.14592) 652 : cluster 0 pgmap v1070: 364 pgs: 364 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:20.148 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:19 smithi145 bash[23893]: audit 2024-05-20T22:23:18.713772+0000 mon.a (mon.0) 3376 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:23:20.148 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:19 smithi145 bash[23893]: cluster 2024-05-20T22:23:18.721024+0000 mon.a (mon.0) 3377 : cluster 0 osdmap e658: 8 total, 8 up, 8 in 2024-05-20T22:23:20.148 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:19 smithi145 bash[23893]: audit 2024-05-20T22:23:18.724741+0000 mon.c (mon.2) 441 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-130"}]: dispatch 2024-05-20T22:23:20.148 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:19 smithi145 bash[23893]: audit 2024-05-20T22:23:18.726507+0000 mon.a (mon.0) 3378 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-130"}]: dispatch 2024-05-20T22:23:20.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:19 smithi050 bash[21866]: audit 2024-05-20T22:23:18.343786+0000 mgr.y (mgr.14592) 651 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:23:20.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:19 smithi050 bash[21866]: cluster 2024-05-20T22:23:18.558051+0000 mgr.y (mgr.14592) 652 : cluster 0 pgmap v1070: 364 pgs: 364 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:20.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:19 smithi050 bash[21866]: audit 2024-05-20T22:23:18.713772+0000 mon.a (mon.0) 3376 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:23:20.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:19 smithi050 bash[21866]: cluster 2024-05-20T22:23:18.721024+0000 mon.a (mon.0) 3377 : cluster 0 osdmap e658: 8 total, 8 up, 8 in 2024-05-20T22:23:20.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:19 smithi050 bash[21866]: audit 2024-05-20T22:23:18.724741+0000 mon.c (mon.2) 441 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-130"}]: dispatch 2024-05-20T22:23:20.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:19 smithi050 bash[21866]: audit 2024-05-20T22:23:18.726507+0000 mon.a (mon.0) 3378 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-130"}]: dispatch 2024-05-20T22:23:20.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:19 smithi050 bash[28929]: audit 2024-05-20T22:23:18.343786+0000 mgr.y (mgr.14592) 651 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:23:20.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:19 smithi050 bash[28929]: cluster 2024-05-20T22:23:18.558051+0000 mgr.y (mgr.14592) 652 : cluster 0 pgmap v1070: 364 pgs: 364 active+clean; 583 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:20.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:19 smithi050 bash[28929]: audit 2024-05-20T22:23:18.713772+0000 mon.a (mon.0) 3376 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:23:20.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:19 smithi050 bash[28929]: cluster 2024-05-20T22:23:18.721024+0000 mon.a (mon.0) 3377 : cluster 0 osdmap e658: 8 total, 8 up, 8 in 2024-05-20T22:23:20.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:19 smithi050 bash[28929]: audit 2024-05-20T22:23:18.724741+0000 mon.c (mon.2) 441 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-130"}]: dispatch 2024-05-20T22:23:20.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:19 smithi050 bash[28929]: audit 2024-05-20T22:23:18.726507+0000 mon.a (mon.0) 3378 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-130"}]: dispatch 2024-05-20T22:23:21.139 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:23:20 smithi145 bash[51536]: logger=sqlstore.transactions t=2024-05-20T22:23:20.948175268Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-05-20T22:23:21.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:20 smithi145 bash[23893]: cluster 2024-05-20T22:23:19.714493+0000 mon.a (mon.0) 3379 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:23:21.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:20 smithi145 bash[23893]: audit 2024-05-20T22:23:19.717510+0000 mon.a (mon.0) 3380 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-130"}]': finished 2024-05-20T22:23:21.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:20 smithi145 bash[23893]: cluster 2024-05-20T22:23:19.731816+0000 mon.a (mon.0) 3381 : cluster 0 osdmap e659: 8 total, 8 up, 8 in 2024-05-20T22:23:21.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:20 smithi145 bash[23893]: cluster 2024-05-20T22:23:20.601426+0000 mon.a (mon.0) 3382 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:23:21.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:20 smithi050 bash[21866]: cluster 2024-05-20T22:23:19.714493+0000 mon.a (mon.0) 3379 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:23:21.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:20 smithi050 bash[21866]: audit 2024-05-20T22:23:19.717510+0000 mon.a (mon.0) 3380 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-130"}]': finished 2024-05-20T22:23:21.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:20 smithi050 bash[21866]: cluster 2024-05-20T22:23:19.731816+0000 mon.a (mon.0) 3381 : cluster 0 osdmap e659: 8 total, 8 up, 8 in 2024-05-20T22:23:21.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:20 smithi050 bash[21866]: cluster 2024-05-20T22:23:20.601426+0000 mon.a (mon.0) 3382 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:23:21.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:20 smithi050 bash[28929]: cluster 2024-05-20T22:23:19.714493+0000 mon.a (mon.0) 3379 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:23:21.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:20 smithi050 bash[28929]: audit 2024-05-20T22:23:19.717510+0000 mon.a (mon.0) 3380 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-130"}]': finished 2024-05-20T22:23:21.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:20 smithi050 bash[28929]: cluster 2024-05-20T22:23:19.731816+0000 mon.a (mon.0) 3381 : cluster 0 osdmap e659: 8 total, 8 up, 8 in 2024-05-20T22:23:21.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:20 smithi050 bash[28929]: cluster 2024-05-20T22:23:20.601426+0000 mon.a (mon.0) 3382 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:23:22.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:21 smithi145 bash[23893]: cluster 2024-05-20T22:23:20.561446+0000 mgr.y (mgr.14592) 653 : cluster 0 pgmap v1073: 364 pgs: 364 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-05-20T22:23:22.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:21 smithi145 bash[23893]: cluster 2024-05-20T22:23:20.759191+0000 mon.a (mon.0) 3383 : cluster 0 osdmap e660: 8 total, 8 up, 8 in 2024-05-20T22:23:22.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:21 smithi050 bash[21866]: cluster 2024-05-20T22:23:20.561446+0000 mgr.y (mgr.14592) 653 : cluster 0 pgmap v1073: 364 pgs: 364 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-05-20T22:23:22.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:21 smithi050 bash[21866]: cluster 2024-05-20T22:23:20.759191+0000 mon.a (mon.0) 3383 : cluster 0 osdmap e660: 8 total, 8 up, 8 in 2024-05-20T22:23:22.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:21 smithi050 bash[28929]: cluster 2024-05-20T22:23:20.561446+0000 mgr.y (mgr.14592) 653 : cluster 0 pgmap v1073: 364 pgs: 364 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-05-20T22:23:22.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:21 smithi050 bash[28929]: cluster 2024-05-20T22:23:20.759191+0000 mon.a (mon.0) 3383 : cluster 0 osdmap e660: 8 total, 8 up, 8 in 2024-05-20T22:23:23.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:22 smithi145 bash[23893]: cluster 2024-05-20T22:23:21.771737+0000 mon.a (mon.0) 3384 : cluster 0 osdmap e661: 8 total, 8 up, 8 in 2024-05-20T22:23:23.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:22 smithi145 bash[23893]: audit 2024-05-20T22:23:21.781224+0000 mon.c (mon.2) 442 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:23.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:22 smithi145 bash[23893]: audit 2024-05-20T22:23:21.783371+0000 mon.a (mon.0) 3385 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:23.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:22 smithi050 bash[28929]: cluster 2024-05-20T22:23:21.771737+0000 mon.a (mon.0) 3384 : cluster 0 osdmap e661: 8 total, 8 up, 8 in 2024-05-20T22:23:23.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:22 smithi050 bash[28929]: audit 2024-05-20T22:23:21.781224+0000 mon.c (mon.2) 442 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:23.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:22 smithi050 bash[28929]: audit 2024-05-20T22:23:21.783371+0000 mon.a (mon.0) 3385 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:23.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:22 smithi050 bash[21866]: cluster 2024-05-20T22:23:21.771737+0000 mon.a (mon.0) 3384 : cluster 0 osdmap e661: 8 total, 8 up, 8 in 2024-05-20T22:23:23.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:22 smithi050 bash[21866]: audit 2024-05-20T22:23:21.781224+0000 mon.c (mon.2) 442 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:23.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:22 smithi050 bash[21866]: audit 2024-05-20T22:23:21.783371+0000 mon.a (mon.0) 3385 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:24.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:23 smithi145 bash[23893]: cluster 2024-05-20T22:23:22.562597+0000 mgr.y (mgr.14592) 654 : cluster 0 pgmap v1076: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:23:24.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:23 smithi145 bash[23893]: audit 2024-05-20T22:23:22.774328+0000 mon.a (mon.0) 3386 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:23:24.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:23 smithi145 bash[23893]: cluster 2024-05-20T22:23:22.786066+0000 mon.a (mon.0) 3387 : cluster 0 osdmap e662: 8 total, 8 up, 8 in 2024-05-20T22:23:24.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:23 smithi145 bash[23893]: audit 2024-05-20T22:23:22.800916+0000 mon.c (mon.2) 443 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:24.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:23 smithi145 bash[23893]: audit 2024-05-20T22:23:22.802013+0000 mon.a (mon.0) 3388 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:24.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:23 smithi145 bash[23893]: audit 2024-05-20T22:23:23.655239+0000 mon.a (mon.0) 3389 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:23:24.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:23 smithi145 bash[23893]: audit 2024-05-20T22:23:23.657872+0000 mon.a (mon.0) 3390 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:23:24.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:23 smithi050 bash[28929]: cluster 2024-05-20T22:23:22.562597+0000 mgr.y (mgr.14592) 654 : cluster 0 pgmap v1076: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:23:24.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:23 smithi050 bash[28929]: audit 2024-05-20T22:23:22.774328+0000 mon.a (mon.0) 3386 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:23:24.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:23 smithi050 bash[28929]: cluster 2024-05-20T22:23:22.786066+0000 mon.a (mon.0) 3387 : cluster 0 osdmap e662: 8 total, 8 up, 8 in 2024-05-20T22:23:24.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:23 smithi050 bash[28929]: audit 2024-05-20T22:23:22.800916+0000 mon.c (mon.2) 443 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:24.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:23 smithi050 bash[28929]: audit 2024-05-20T22:23:22.802013+0000 mon.a (mon.0) 3388 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:24.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:23 smithi050 bash[28929]: audit 2024-05-20T22:23:23.655239+0000 mon.a (mon.0) 3389 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:23:24.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:23 smithi050 bash[28929]: audit 2024-05-20T22:23:23.657872+0000 mon.a (mon.0) 3390 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:23:24.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:23 smithi050 bash[21866]: cluster 2024-05-20T22:23:22.562597+0000 mgr.y (mgr.14592) 654 : cluster 0 pgmap v1076: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:23:24.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:23 smithi050 bash[21866]: audit 2024-05-20T22:23:22.774328+0000 mon.a (mon.0) 3386 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:23:24.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:23 smithi050 bash[21866]: cluster 2024-05-20T22:23:22.786066+0000 mon.a (mon.0) 3387 : cluster 0 osdmap e662: 8 total, 8 up, 8 in 2024-05-20T22:23:24.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:23 smithi050 bash[21866]: audit 2024-05-20T22:23:22.800916+0000 mon.c (mon.2) 443 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:24.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:23 smithi050 bash[21866]: audit 2024-05-20T22:23:22.802013+0000 mon.a (mon.0) 3388 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:24.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:23 smithi050 bash[21866]: audit 2024-05-20T22:23:23.655239+0000 mon.a (mon.0) 3389 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:23:24.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:23 smithi050 bash[21866]: audit 2024-05-20T22:23:23.657872+0000 mon.a (mon.0) 3390 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:23:25.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:24 smithi145 bash[23893]: audit 2024-05-20T22:23:23.777028+0000 mon.a (mon.0) 3391 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-132", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:23:25.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:24 smithi145 bash[23893]: cluster 2024-05-20T22:23:23.785107+0000 mon.a (mon.0) 3392 : cluster 0 osdmap e663: 8 total, 8 up, 8 in 2024-05-20T22:23:25.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:24 smithi145 bash[23893]: audit 2024-05-20T22:23:23.787767+0000 mon.c (mon.2) 444 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-132"}]: dispatch 2024-05-20T22:23:25.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:24 smithi145 bash[23893]: audit 2024-05-20T22:23:23.789876+0000 mon.a (mon.0) 3393 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-132"}]: dispatch 2024-05-20T22:23:25.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:24 smithi145 bash[23893]: audit 2024-05-20T22:23:24.780590+0000 mon.a (mon.0) 3394 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-132"}]': finished 2024-05-20T22:23:25.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:24 smithi050 bash[21866]: audit 2024-05-20T22:23:23.777028+0000 mon.a (mon.0) 3391 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-132", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:23:25.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:24 smithi050 bash[21866]: cluster 2024-05-20T22:23:23.785107+0000 mon.a (mon.0) 3392 : cluster 0 osdmap e663: 8 total, 8 up, 8 in 2024-05-20T22:23:25.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:24 smithi050 bash[21866]: audit 2024-05-20T22:23:23.787767+0000 mon.c (mon.2) 444 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-132"}]: dispatch 2024-05-20T22:23:25.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:24 smithi050 bash[21866]: audit 2024-05-20T22:23:23.789876+0000 mon.a (mon.0) 3393 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-132"}]: dispatch 2024-05-20T22:23:25.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:24 smithi050 bash[21866]: audit 2024-05-20T22:23:24.780590+0000 mon.a (mon.0) 3394 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-132"}]': finished 2024-05-20T22:23:25.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:24 smithi050 bash[28929]: audit 2024-05-20T22:23:23.777028+0000 mon.a (mon.0) 3391 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-132", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:23:25.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:24 smithi050 bash[28929]: cluster 2024-05-20T22:23:23.785107+0000 mon.a (mon.0) 3392 : cluster 0 osdmap e663: 8 total, 8 up, 8 in 2024-05-20T22:23:25.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:24 smithi050 bash[28929]: audit 2024-05-20T22:23:23.787767+0000 mon.c (mon.2) 444 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-132"}]: dispatch 2024-05-20T22:23:25.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:24 smithi050 bash[28929]: audit 2024-05-20T22:23:23.789876+0000 mon.a (mon.0) 3393 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-132"}]: dispatch 2024-05-20T22:23:25.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:24 smithi050 bash[28929]: audit 2024-05-20T22:23:24.780590+0000 mon.a (mon.0) 3394 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-132"}]': finished 2024-05-20T22:23:26.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:25 smithi145 bash[23893]: cluster 2024-05-20T22:23:24.563611+0000 mgr.y (mgr.14592) 655 : cluster 0 pgmap v1079: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:23:26.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:25 smithi145 bash[23893]: audit 2024-05-20T22:23:24.789392+0000 mon.c (mon.2) 445 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-132", "mode": "writeback"}]: dispatch 2024-05-20T22:23:26.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:25 smithi145 bash[23893]: cluster 2024-05-20T22:23:24.795272+0000 mon.a (mon.0) 3395 : cluster 0 osdmap e664: 8 total, 8 up, 8 in 2024-05-20T22:23:26.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:25 smithi145 bash[23893]: audit 2024-05-20T22:23:24.797325+0000 mon.a (mon.0) 3396 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-132", "mode": "writeback"}]: dispatch 2024-05-20T22:23:26.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:25 smithi145 bash[23893]: cluster 2024-05-20T22:23:25.781006+0000 mon.a (mon.0) 3397 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:23:26.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:25 smithi145 bash[23893]: audit 2024-05-20T22:23:25.783391+0000 mon.a (mon.0) 3398 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-132", "mode": "writeback"}]': finished 2024-05-20T22:23:26.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:25 smithi145 bash[23893]: cluster 2024-05-20T22:23:25.791630+0000 mon.a (mon.0) 3399 : cluster 0 osdmap e665: 8 total, 8 up, 8 in 2024-05-20T22:23:26.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:25 smithi050 bash[21866]: cluster 2024-05-20T22:23:24.563611+0000 mgr.y (mgr.14592) 655 : cluster 0 pgmap v1079: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:23:26.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:25 smithi050 bash[21866]: audit 2024-05-20T22:23:24.789392+0000 mon.c (mon.2) 445 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-132", "mode": "writeback"}]: dispatch 2024-05-20T22:23:26.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:25 smithi050 bash[21866]: cluster 2024-05-20T22:23:24.795272+0000 mon.a (mon.0) 3395 : cluster 0 osdmap e664: 8 total, 8 up, 8 in 2024-05-20T22:23:26.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:25 smithi050 bash[21866]: audit 2024-05-20T22:23:24.797325+0000 mon.a (mon.0) 3396 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-132", "mode": "writeback"}]: dispatch 2024-05-20T22:23:26.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:25 smithi050 bash[21866]: cluster 2024-05-20T22:23:25.781006+0000 mon.a (mon.0) 3397 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:23:26.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:25 smithi050 bash[21866]: audit 2024-05-20T22:23:25.783391+0000 mon.a (mon.0) 3398 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-132", "mode": "writeback"}]': finished 2024-05-20T22:23:26.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:25 smithi050 bash[21866]: cluster 2024-05-20T22:23:25.791630+0000 mon.a (mon.0) 3399 : cluster 0 osdmap e665: 8 total, 8 up, 8 in 2024-05-20T22:23:26.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:25 smithi050 bash[28929]: cluster 2024-05-20T22:23:24.563611+0000 mgr.y (mgr.14592) 655 : cluster 0 pgmap v1079: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:23:26.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:25 smithi050 bash[28929]: audit 2024-05-20T22:23:24.789392+0000 mon.c (mon.2) 445 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-132", "mode": "writeback"}]: dispatch 2024-05-20T22:23:26.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:25 smithi050 bash[28929]: cluster 2024-05-20T22:23:24.795272+0000 mon.a (mon.0) 3395 : cluster 0 osdmap e664: 8 total, 8 up, 8 in 2024-05-20T22:23:26.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:25 smithi050 bash[28929]: audit 2024-05-20T22:23:24.797325+0000 mon.a (mon.0) 3396 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-132", "mode": "writeback"}]: dispatch 2024-05-20T22:23:26.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:25 smithi050 bash[28929]: cluster 2024-05-20T22:23:25.781006+0000 mon.a (mon.0) 3397 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:23:26.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:25 smithi050 bash[28929]: audit 2024-05-20T22:23:25.783391+0000 mon.a (mon.0) 3398 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-132", "mode": "writeback"}]': finished 2024-05-20T22:23:26.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:25 smithi050 bash[28929]: cluster 2024-05-20T22:23:25.791630+0000 mon.a (mon.0) 3399 : cluster 0 osdmap e665: 8 total, 8 up, 8 in 2024-05-20T22:23:28.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:27 smithi145 bash[23893]: cluster 2024-05-20T22:23:26.564563+0000 mgr.y (mgr.14592) 656 : cluster 0 pgmap v1082: 364 pgs: 364 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:28.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:27 smithi145 bash[23893]: cluster 2024-05-20T22:23:26.820725+0000 mon.a (mon.0) 3400 : cluster 0 osdmap e666: 8 total, 8 up, 8 in 2024-05-20T22:23:28.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:27 smithi050 bash[21866]: cluster 2024-05-20T22:23:26.564563+0000 mgr.y (mgr.14592) 656 : cluster 0 pgmap v1082: 364 pgs: 364 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:28.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:27 smithi050 bash[21866]: cluster 2024-05-20T22:23:26.820725+0000 mon.a (mon.0) 3400 : cluster 0 osdmap e666: 8 total, 8 up, 8 in 2024-05-20T22:23:28.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:27 smithi050 bash[28929]: cluster 2024-05-20T22:23:26.564563+0000 mgr.y (mgr.14592) 656 : cluster 0 pgmap v1082: 364 pgs: 364 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:28.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:27 smithi050 bash[28929]: cluster 2024-05-20T22:23:26.820725+0000 mon.a (mon.0) 3400 : cluster 0 osdmap e666: 8 total, 8 up, 8 in 2024-05-20T22:23:28.639 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:23:28 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:23:29.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:28 smithi145 bash[23893]: cluster 2024-05-20T22:23:27.835091+0000 mon.a (mon.0) 3401 : cluster 0 osdmap e667: 8 total, 8 up, 8 in 2024-05-20T22:23:29.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:28 smithi145 bash[23893]: audit 2024-05-20T22:23:27.944310+0000 mon.c (mon.2) 446 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:29.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:28 smithi145 bash[23893]: audit 2024-05-20T22:23:27.944978+0000 mon.a (mon.0) 3402 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:29.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:28 smithi145 bash[23893]: audit 2024-05-20T22:23:28.355275+0000 mgr.y (mgr.14592) 657 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:23:29.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:28 smithi145 bash[23893]: cluster 2024-05-20T22:23:28.565516+0000 mgr.y (mgr.14592) 658 : cluster 0 pgmap v1085: 364 pgs: 364 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:28 smithi050 bash[21866]: cluster 2024-05-20T22:23:27.835091+0000 mon.a (mon.0) 3401 : cluster 0 osdmap e667: 8 total, 8 up, 8 in 2024-05-20T22:23:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:28 smithi050 bash[21866]: audit 2024-05-20T22:23:27.944310+0000 mon.c (mon.2) 446 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:28 smithi050 bash[21866]: audit 2024-05-20T22:23:27.944978+0000 mon.a (mon.0) 3402 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:28 smithi050 bash[21866]: audit 2024-05-20T22:23:28.355275+0000 mgr.y (mgr.14592) 657 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:23:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:28 smithi050 bash[21866]: cluster 2024-05-20T22:23:28.565516+0000 mgr.y (mgr.14592) 658 : cluster 0 pgmap v1085: 364 pgs: 364 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:29.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:28 smithi050 bash[28929]: cluster 2024-05-20T22:23:27.835091+0000 mon.a (mon.0) 3401 : cluster 0 osdmap e667: 8 total, 8 up, 8 in 2024-05-20T22:23:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:28 smithi050 bash[28929]: audit 2024-05-20T22:23:27.944310+0000 mon.c (mon.2) 446 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:28 smithi050 bash[28929]: audit 2024-05-20T22:23:27.944978+0000 mon.a (mon.0) 3402 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:28 smithi050 bash[28929]: audit 2024-05-20T22:23:28.355275+0000 mgr.y (mgr.14592) 657 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:23:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:28 smithi050 bash[28929]: cluster 2024-05-20T22:23:28.565516+0000 mgr.y (mgr.14592) 658 : cluster 0 pgmap v1085: 364 pgs: 364 active+clean; 583 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:29.692 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:23:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:23:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:23:30.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:29 smithi145 bash[23893]: audit 2024-05-20T22:23:28.838743+0000 mon.a (mon.0) 3403 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:23:30.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:29 smithi145 bash[23893]: cluster 2024-05-20T22:23:28.847544+0000 mon.a (mon.0) 3404 : cluster 0 osdmap e668: 8 total, 8 up, 8 in 2024-05-20T22:23:30.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:29 smithi145 bash[23893]: audit 2024-05-20T22:23:28.871032+0000 mon.c (mon.2) 447 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-132"}]: dispatch 2024-05-20T22:23:30.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:29 smithi145 bash[23893]: audit 2024-05-20T22:23:28.871733+0000 mon.a (mon.0) 3405 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-132"}]: dispatch 2024-05-20T22:23:30.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:29 smithi050 bash[28929]: audit 2024-05-20T22:23:28.838743+0000 mon.a (mon.0) 3403 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:23:30.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:29 smithi050 bash[28929]: cluster 2024-05-20T22:23:28.847544+0000 mon.a (mon.0) 3404 : cluster 0 osdmap e668: 8 total, 8 up, 8 in 2024-05-20T22:23:30.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:29 smithi050 bash[28929]: audit 2024-05-20T22:23:28.871032+0000 mon.c (mon.2) 447 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-132"}]: dispatch 2024-05-20T22:23:30.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:29 smithi050 bash[28929]: audit 2024-05-20T22:23:28.871733+0000 mon.a (mon.0) 3405 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-132"}]: dispatch 2024-05-20T22:23:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:29 smithi050 bash[21866]: audit 2024-05-20T22:23:28.838743+0000 mon.a (mon.0) 3403 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:23:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:29 smithi050 bash[21866]: cluster 2024-05-20T22:23:28.847544+0000 mon.a (mon.0) 3404 : cluster 0 osdmap e668: 8 total, 8 up, 8 in 2024-05-20T22:23:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:29 smithi050 bash[21866]: audit 2024-05-20T22:23:28.871032+0000 mon.c (mon.2) 447 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-132"}]: dispatch 2024-05-20T22:23:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:29 smithi050 bash[21866]: audit 2024-05-20T22:23:28.871733+0000 mon.a (mon.0) 3405 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-132"}]: dispatch 2024-05-20T22:23:31.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:30 smithi145 bash[23893]: audit 2024-05-20T22:23:29.841525+0000 mon.a (mon.0) 3406 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-132"}]': finished 2024-05-20T22:23:31.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:30 smithi145 bash[23893]: cluster 2024-05-20T22:23:29.848999+0000 mon.a (mon.0) 3407 : cluster 0 osdmap e669: 8 total, 8 up, 8 in 2024-05-20T22:23:31.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:30 smithi145 bash[23893]: cluster 2024-05-20T22:23:30.568818+0000 mgr.y (mgr.14592) 659 : cluster 0 pgmap v1088: 364 pgs: 364 active+clean; 583 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-05-20T22:23:31.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:30 smithi050 bash[21866]: audit 2024-05-20T22:23:29.841525+0000 mon.a (mon.0) 3406 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-132"}]': finished 2024-05-20T22:23:31.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:30 smithi050 bash[21866]: cluster 2024-05-20T22:23:29.848999+0000 mon.a (mon.0) 3407 : cluster 0 osdmap e669: 8 total, 8 up, 8 in 2024-05-20T22:23:31.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:30 smithi050 bash[21866]: cluster 2024-05-20T22:23:30.568818+0000 mgr.y (mgr.14592) 659 : cluster 0 pgmap v1088: 364 pgs: 364 active+clean; 583 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-05-20T22:23:31.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:30 smithi050 bash[28929]: audit 2024-05-20T22:23:29.841525+0000 mon.a (mon.0) 3406 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-132"}]': finished 2024-05-20T22:23:31.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:30 smithi050 bash[28929]: cluster 2024-05-20T22:23:29.848999+0000 mon.a (mon.0) 3407 : cluster 0 osdmap e669: 8 total, 8 up, 8 in 2024-05-20T22:23:31.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:30 smithi050 bash[28929]: cluster 2024-05-20T22:23:30.568818+0000 mgr.y (mgr.14592) 659 : cluster 0 pgmap v1088: 364 pgs: 364 active+clean; 583 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-05-20T22:23:32.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:31 smithi145 bash[23893]: cluster 2024-05-20T22:23:30.873720+0000 mon.a (mon.0) 3408 : cluster 0 osdmap e670: 8 total, 8 up, 8 in 2024-05-20T22:23:32.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:31 smithi145 bash[23893]: audit 2024-05-20T22:23:30.949335+0000 mon.c (mon.2) 448 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:32.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:31 smithi145 bash[23893]: audit 2024-05-20T22:23:30.949995+0000 mon.a (mon.0) 3409 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:32.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:31 smithi050 bash[28929]: cluster 2024-05-20T22:23:30.873720+0000 mon.a (mon.0) 3408 : cluster 0 osdmap e670: 8 total, 8 up, 8 in 2024-05-20T22:23:32.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:31 smithi050 bash[28929]: audit 2024-05-20T22:23:30.949335+0000 mon.c (mon.2) 448 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:32.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:31 smithi050 bash[28929]: audit 2024-05-20T22:23:30.949995+0000 mon.a (mon.0) 3409 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:32.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:31 smithi050 bash[21866]: cluster 2024-05-20T22:23:30.873720+0000 mon.a (mon.0) 3408 : cluster 0 osdmap e670: 8 total, 8 up, 8 in 2024-05-20T22:23:32.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:31 smithi050 bash[21866]: audit 2024-05-20T22:23:30.949335+0000 mon.c (mon.2) 448 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:32.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:31 smithi050 bash[21866]: audit 2024-05-20T22:23:30.949995+0000 mon.a (mon.0) 3409 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:33.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:32 smithi050 bash[21866]: audit 2024-05-20T22:23:31.866242+0000 mon.a (mon.0) 3410 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:23:33.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:32 smithi050 bash[21866]: cluster 2024-05-20T22:23:31.874269+0000 mon.a (mon.0) 3411 : cluster 0 osdmap e671: 8 total, 8 up, 8 in 2024-05-20T22:23:33.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:32 smithi050 bash[21866]: audit 2024-05-20T22:23:31.875848+0000 mon.c (mon.2) 449 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-132"}]: dispatch 2024-05-20T22:23:33.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:32 smithi050 bash[21866]: audit 2024-05-20T22:23:31.878619+0000 mon.a (mon.0) 3412 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-132"}]: dispatch 2024-05-20T22:23:33.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:32 smithi050 bash[21866]: cluster 2024-05-20T22:23:32.569845+0000 mgr.y (mgr.14592) 660 : cluster 0 pgmap v1091: 364 pgs: 364 active+clean; 583 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-05-20T22:23:33.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:32 smithi050 bash[21866]: cluster 2024-05-20T22:23:32.866587+0000 mon.a (mon.0) 3413 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:23:33.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:32 smithi050 bash[21866]: audit 2024-05-20T22:23:32.869317+0000 mon.a (mon.0) 3414 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-132"}]': finished 2024-05-20T22:23:33.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:32 smithi050 bash[21866]: cluster 2024-05-20T22:23:32.877345+0000 mon.a (mon.0) 3415 : cluster 0 osdmap e672: 8 total, 8 up, 8 in 2024-05-20T22:23:33.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:32 smithi050 bash[28929]: audit 2024-05-20T22:23:31.866242+0000 mon.a (mon.0) 3410 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:23:33.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:32 smithi050 bash[28929]: cluster 2024-05-20T22:23:31.874269+0000 mon.a (mon.0) 3411 : cluster 0 osdmap e671: 8 total, 8 up, 8 in 2024-05-20T22:23:33.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:32 smithi050 bash[28929]: audit 2024-05-20T22:23:31.875848+0000 mon.c (mon.2) 449 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-132"}]: dispatch 2024-05-20T22:23:33.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:32 smithi050 bash[28929]: audit 2024-05-20T22:23:31.878619+0000 mon.a (mon.0) 3412 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-132"}]: dispatch 2024-05-20T22:23:33.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:32 smithi050 bash[28929]: cluster 2024-05-20T22:23:32.569845+0000 mgr.y (mgr.14592) 660 : cluster 0 pgmap v1091: 364 pgs: 364 active+clean; 583 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-05-20T22:23:33.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:32 smithi050 bash[28929]: cluster 2024-05-20T22:23:32.866587+0000 mon.a (mon.0) 3413 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:23:33.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:32 smithi050 bash[28929]: audit 2024-05-20T22:23:32.869317+0000 mon.a (mon.0) 3414 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-132"}]': finished 2024-05-20T22:23:33.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:32 smithi050 bash[28929]: cluster 2024-05-20T22:23:32.877345+0000 mon.a (mon.0) 3415 : cluster 0 osdmap e672: 8 total, 8 up, 8 in 2024-05-20T22:23:33.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:32 smithi145 bash[23893]: audit 2024-05-20T22:23:31.866242+0000 mon.a (mon.0) 3410 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:23:33.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:32 smithi145 bash[23893]: cluster 2024-05-20T22:23:31.874269+0000 mon.a (mon.0) 3411 : cluster 0 osdmap e671: 8 total, 8 up, 8 in 2024-05-20T22:23:33.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:32 smithi145 bash[23893]: audit 2024-05-20T22:23:31.875848+0000 mon.c (mon.2) 449 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-132"}]: dispatch 2024-05-20T22:23:33.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:32 smithi145 bash[23893]: audit 2024-05-20T22:23:31.878619+0000 mon.a (mon.0) 3412 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-132"}]: dispatch 2024-05-20T22:23:33.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:32 smithi145 bash[23893]: cluster 2024-05-20T22:23:32.569845+0000 mgr.y (mgr.14592) 660 : cluster 0 pgmap v1091: 364 pgs: 364 active+clean; 583 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-05-20T22:23:33.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:32 smithi145 bash[23893]: cluster 2024-05-20T22:23:32.866587+0000 mon.a (mon.0) 3413 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:23:33.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:32 smithi145 bash[23893]: audit 2024-05-20T22:23:32.869317+0000 mon.a (mon.0) 3414 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-132"}]': finished 2024-05-20T22:23:33.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:32 smithi145 bash[23893]: cluster 2024-05-20T22:23:32.877345+0000 mon.a (mon.0) 3415 : cluster 0 osdmap e672: 8 total, 8 up, 8 in 2024-05-20T22:23:34.179 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK c 2024-05-20T22:23:34.179 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.187 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.187 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.187 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.187 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.187 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.187 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:34.187 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:23:35.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:34 smithi050 bash[21866]: cluster 2024-05-20T22:23:33.907716+0000 mon.a (mon.0) 3416 : cluster 0 osdmap e673: 8 total, 8 up, 8 in 2024-05-20T22:23:35.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:34 smithi050 bash[21866]: cluster 2024-05-20T22:23:34.570819+0000 mgr.y (mgr.14592) 661 : cluster 0 pgmap v1094: 332 pgs: 332 active+clean; 583 KiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:23:35.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:34 smithi050 bash[28929]: cluster 2024-05-20T22:23:33.907716+0000 mon.a (mon.0) 3416 : cluster 0 osdmap e673: 8 total, 8 up, 8 in 2024-05-20T22:23:35.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:34 smithi050 bash[28929]: cluster 2024-05-20T22:23:34.570819+0000 mgr.y (mgr.14592) 661 : cluster 0 pgmap v1094: 332 pgs: 332 active+clean; 583 KiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:23:35.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:34 smithi145 bash[23893]: cluster 2024-05-20T22:23:33.907716+0000 mon.a (mon.0) 3416 : cluster 0 osdmap e673: 8 total, 8 up, 8 in 2024-05-20T22:23:35.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:34 smithi145 bash[23893]: cluster 2024-05-20T22:23:34.570819+0000 mgr.y (mgr.14592) 661 : cluster 0 pgmap v1094: 332 pgs: 332 active+clean; 583 KiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:23:36.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:35 smithi050 bash[28929]: cluster 2024-05-20T22:23:34.920452+0000 mon.a (mon.0) 3417 : cluster 0 osdmap e674: 8 total, 8 up, 8 in 2024-05-20T22:23:36.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:35 smithi050 bash[28929]: audit 2024-05-20T22:23:34.929128+0000 mon.c (mon.2) 450 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:36.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:35 smithi050 bash[28929]: audit 2024-05-20T22:23:34.933495+0000 mon.a (mon.0) 3418 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:36.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:35 smithi050 bash[21866]: cluster 2024-05-20T22:23:34.920452+0000 mon.a (mon.0) 3417 : cluster 0 osdmap e674: 8 total, 8 up, 8 in 2024-05-20T22:23:36.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:35 smithi050 bash[21866]: audit 2024-05-20T22:23:34.929128+0000 mon.c (mon.2) 450 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:36.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:35 smithi050 bash[21866]: audit 2024-05-20T22:23:34.933495+0000 mon.a (mon.0) 3418 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:36.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:35 smithi145 bash[23893]: cluster 2024-05-20T22:23:34.920452+0000 mon.a (mon.0) 3417 : cluster 0 osdmap e674: 8 total, 8 up, 8 in 2024-05-20T22:23:36.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:35 smithi145 bash[23893]: audit 2024-05-20T22:23:34.929128+0000 mon.c (mon.2) 450 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:36.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:35 smithi145 bash[23893]: audit 2024-05-20T22:23:34.933495+0000 mon.a (mon.0) 3418 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:37.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:36 smithi050 bash[21866]: audit 2024-05-20T22:23:35.914629+0000 mon.a (mon.0) 3419 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:23:37.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:36 smithi050 bash[21866]: cluster 2024-05-20T22:23:35.922938+0000 mon.a (mon.0) 3420 : cluster 0 osdmap e675: 8 total, 8 up, 8 in 2024-05-20T22:23:37.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:36 smithi050 bash[21866]: audit 2024-05-20T22:23:35.930635+0000 mon.c (mon.2) 451 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:37.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:36 smithi050 bash[21866]: audit 2024-05-20T22:23:35.932452+0000 mon.a (mon.0) 3421 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:37.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:36 smithi050 bash[21866]: cluster 2024-05-20T22:23:36.571794+0000 mgr.y (mgr.14592) 662 : cluster 0 pgmap v1097: 364 pgs: 32 creating+peering, 332 active+clean; 583 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-20T22:23:37.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:36 smithi050 bash[21866]: audit 2024-05-20T22:23:36.917258+0000 mon.a (mon.0) 3422 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-134", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:23:37.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:36 smithi050 bash[21866]: cluster 2024-05-20T22:23:36.924793+0000 mon.a (mon.0) 3423 : cluster 0 osdmap e676: 8 total, 8 up, 8 in 2024-05-20T22:23:37.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:36 smithi050 bash[21866]: audit 2024-05-20T22:23:36.926225+0000 mon.c (mon.2) 452 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-134"}]: dispatch 2024-05-20T22:23:37.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:36 smithi050 bash[21866]: audit 2024-05-20T22:23:36.927109+0000 mon.a (mon.0) 3424 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-134"}]: dispatch 2024-05-20T22:23:37.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:36 smithi050 bash[28929]: audit 2024-05-20T22:23:35.914629+0000 mon.a (mon.0) 3419 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:23:37.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:36 smithi050 bash[28929]: cluster 2024-05-20T22:23:35.922938+0000 mon.a (mon.0) 3420 : cluster 0 osdmap e675: 8 total, 8 up, 8 in 2024-05-20T22:23:37.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:36 smithi050 bash[28929]: audit 2024-05-20T22:23:35.930635+0000 mon.c (mon.2) 451 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:37.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:36 smithi050 bash[28929]: audit 2024-05-20T22:23:35.932452+0000 mon.a (mon.0) 3421 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:37.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:36 smithi050 bash[28929]: cluster 2024-05-20T22:23:36.571794+0000 mgr.y (mgr.14592) 662 : cluster 0 pgmap v1097: 364 pgs: 32 creating+peering, 332 active+clean; 583 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-20T22:23:37.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:36 smithi050 bash[28929]: audit 2024-05-20T22:23:36.917258+0000 mon.a (mon.0) 3422 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-134", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:23:37.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:36 smithi050 bash[28929]: cluster 2024-05-20T22:23:36.924793+0000 mon.a (mon.0) 3423 : cluster 0 osdmap e676: 8 total, 8 up, 8 in 2024-05-20T22:23:37.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:36 smithi050 bash[28929]: audit 2024-05-20T22:23:36.926225+0000 mon.c (mon.2) 452 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-134"}]: dispatch 2024-05-20T22:23:37.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:36 smithi050 bash[28929]: audit 2024-05-20T22:23:36.927109+0000 mon.a (mon.0) 3424 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-134"}]: dispatch 2024-05-20T22:23:37.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:36 smithi145 bash[23893]: audit 2024-05-20T22:23:35.914629+0000 mon.a (mon.0) 3419 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:23:37.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:36 smithi145 bash[23893]: cluster 2024-05-20T22:23:35.922938+0000 mon.a (mon.0) 3420 : cluster 0 osdmap e675: 8 total, 8 up, 8 in 2024-05-20T22:23:37.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:36 smithi145 bash[23893]: audit 2024-05-20T22:23:35.930635+0000 mon.c (mon.2) 451 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:37.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:36 smithi145 bash[23893]: audit 2024-05-20T22:23:35.932452+0000 mon.a (mon.0) 3421 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:37.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:36 smithi145 bash[23893]: cluster 2024-05-20T22:23:36.571794+0000 mgr.y (mgr.14592) 662 : cluster 0 pgmap v1097: 364 pgs: 32 creating+peering, 332 active+clean; 583 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-20T22:23:37.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:36 smithi145 bash[23893]: audit 2024-05-20T22:23:36.917258+0000 mon.a (mon.0) 3422 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-134", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:23:37.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:36 smithi145 bash[23893]: cluster 2024-05-20T22:23:36.924793+0000 mon.a (mon.0) 3423 : cluster 0 osdmap e676: 8 total, 8 up, 8 in 2024-05-20T22:23:37.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:36 smithi145 bash[23893]: audit 2024-05-20T22:23:36.926225+0000 mon.c (mon.2) 452 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-134"}]: dispatch 2024-05-20T22:23:37.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:36 smithi145 bash[23893]: audit 2024-05-20T22:23:36.927109+0000 mon.a (mon.0) 3424 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-134"}]: dispatch 2024-05-20T22:23:38.639 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:23:38 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:23:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:38 smithi050 bash[21866]: audit 2024-05-20T22:23:37.920017+0000 mon.a (mon.0) 3425 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-134"}]': finished 2024-05-20T22:23:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:38 smithi050 bash[21866]: cluster 2024-05-20T22:23:37.926937+0000 mon.a (mon.0) 3426 : cluster 0 osdmap e677: 8 total, 8 up, 8 in 2024-05-20T22:23:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:38 smithi050 bash[21866]: audit 2024-05-20T22:23:37.931638+0000 mon.c (mon.2) 453 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-134", "mode": "writeback"}]: dispatch 2024-05-20T22:23:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:38 smithi050 bash[21866]: audit 2024-05-20T22:23:37.932783+0000 mon.a (mon.0) 3427 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-134", "mode": "writeback"}]: dispatch 2024-05-20T22:23:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:38 smithi050 bash[21866]: audit 2024-05-20T22:23:38.366364+0000 mgr.y (mgr.14592) 663 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:23:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:38 smithi050 bash[21866]: cluster 2024-05-20T22:23:38.572721+0000 mgr.y (mgr.14592) 664 : cluster 0 pgmap v1100: 364 pgs: 32 creating+peering, 332 active+clean; 583 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:39.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:38 smithi050 bash[21866]: audit 2024-05-20T22:23:38.692225+0000 mon.a (mon.0) 3428 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:23:39.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:38 smithi050 bash[28929]: audit 2024-05-20T22:23:37.920017+0000 mon.a (mon.0) 3425 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-134"}]': finished 2024-05-20T22:23:39.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:38 smithi050 bash[28929]: cluster 2024-05-20T22:23:37.926937+0000 mon.a (mon.0) 3426 : cluster 0 osdmap e677: 8 total, 8 up, 8 in 2024-05-20T22:23:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:38 smithi050 bash[28929]: audit 2024-05-20T22:23:37.931638+0000 mon.c (mon.2) 453 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-134", "mode": "writeback"}]: dispatch 2024-05-20T22:23:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:38 smithi050 bash[28929]: audit 2024-05-20T22:23:37.932783+0000 mon.a (mon.0) 3427 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-134", "mode": "writeback"}]: dispatch 2024-05-20T22:23:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:38 smithi050 bash[28929]: audit 2024-05-20T22:23:38.366364+0000 mgr.y (mgr.14592) 663 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:23:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:38 smithi050 bash[28929]: cluster 2024-05-20T22:23:38.572721+0000 mgr.y (mgr.14592) 664 : cluster 0 pgmap v1100: 364 pgs: 32 creating+peering, 332 active+clean; 583 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:39.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:38 smithi050 bash[28929]: audit 2024-05-20T22:23:38.692225+0000 mon.a (mon.0) 3428 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:23:39.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:38 smithi145 bash[23893]: audit 2024-05-20T22:23:37.920017+0000 mon.a (mon.0) 3425 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-134"}]': finished 2024-05-20T22:23:39.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:38 smithi145 bash[23893]: cluster 2024-05-20T22:23:37.926937+0000 mon.a (mon.0) 3426 : cluster 0 osdmap e677: 8 total, 8 up, 8 in 2024-05-20T22:23:39.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:38 smithi145 bash[23893]: audit 2024-05-20T22:23:37.931638+0000 mon.c (mon.2) 453 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-134", "mode": "writeback"}]: dispatch 2024-05-20T22:23:39.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:38 smithi145 bash[23893]: audit 2024-05-20T22:23:37.932783+0000 mon.a (mon.0) 3427 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-134", "mode": "writeback"}]: dispatch 2024-05-20T22:23:39.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:38 smithi145 bash[23893]: audit 2024-05-20T22:23:38.366364+0000 mgr.y (mgr.14592) 663 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:23:39.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:38 smithi145 bash[23893]: cluster 2024-05-20T22:23:38.572721+0000 mgr.y (mgr.14592) 664 : cluster 0 pgmap v1100: 364 pgs: 32 creating+peering, 332 active+clean; 583 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:39.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:38 smithi145 bash[23893]: audit 2024-05-20T22:23:38.692225+0000 mon.a (mon.0) 3428 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:23:39.692 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:23:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:23:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:23:40.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:39 smithi050 bash[28929]: cluster 2024-05-20T22:23:38.921085+0000 mon.a (mon.0) 3429 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:23:40.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:39 smithi050 bash[28929]: audit 2024-05-20T22:23:38.928757+0000 mon.a (mon.0) 3430 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-134", "mode": "writeback"}]': finished 2024-05-20T22:23:40.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:39 smithi050 bash[28929]: cluster 2024-05-20T22:23:38.938926+0000 mon.a (mon.0) 3431 : cluster 0 osdmap e678: 8 total, 8 up, 8 in 2024-05-20T22:23:40.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:39 smithi050 bash[28929]: audit 2024-05-20T22:23:39.052806+0000 mon.c (mon.2) 454 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:40.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:39 smithi050 bash[28929]: audit 2024-05-20T22:23:39.053484+0000 mon.a (mon.0) 3432 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:40.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:39 smithi050 bash[21866]: cluster 2024-05-20T22:23:38.921085+0000 mon.a (mon.0) 3429 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:23:40.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:39 smithi050 bash[21866]: audit 2024-05-20T22:23:38.928757+0000 mon.a (mon.0) 3430 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-134", "mode": "writeback"}]': finished 2024-05-20T22:23:40.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:39 smithi050 bash[21866]: cluster 2024-05-20T22:23:38.938926+0000 mon.a (mon.0) 3431 : cluster 0 osdmap e678: 8 total, 8 up, 8 in 2024-05-20T22:23:40.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:39 smithi050 bash[21866]: audit 2024-05-20T22:23:39.052806+0000 mon.c (mon.2) 454 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:40.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:39 smithi050 bash[21866]: audit 2024-05-20T22:23:39.053484+0000 mon.a (mon.0) 3432 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:40.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:39 smithi145 bash[23893]: cluster 2024-05-20T22:23:38.921085+0000 mon.a (mon.0) 3429 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:23:40.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:39 smithi145 bash[23893]: audit 2024-05-20T22:23:38.928757+0000 mon.a (mon.0) 3430 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-134", "mode": "writeback"}]': finished 2024-05-20T22:23:40.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:39 smithi145 bash[23893]: cluster 2024-05-20T22:23:38.938926+0000 mon.a (mon.0) 3431 : cluster 0 osdmap e678: 8 total, 8 up, 8 in 2024-05-20T22:23:40.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:39 smithi145 bash[23893]: audit 2024-05-20T22:23:39.052806+0000 mon.c (mon.2) 454 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:40.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:39 smithi145 bash[23893]: audit 2024-05-20T22:23:39.053484+0000 mon.a (mon.0) 3432 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:41.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:40 smithi145 bash[23893]: audit 2024-05-20T22:23:39.931324+0000 mon.a (mon.0) 3433 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:23:41.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:40 smithi145 bash[23893]: cluster 2024-05-20T22:23:39.938080+0000 mon.a (mon.0) 3434 : cluster 0 osdmap e679: 8 total, 8 up, 8 in 2024-05-20T22:23:41.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:40 smithi145 bash[23893]: audit 2024-05-20T22:23:39.941495+0000 mon.c (mon.2) 455 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-134"}]: dispatch 2024-05-20T22:23:41.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:40 smithi145 bash[23893]: audit 2024-05-20T22:23:39.956666+0000 mon.a (mon.0) 3435 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-134"}]: dispatch 2024-05-20T22:23:41.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:40 smithi145 bash[23893]: cluster 2024-05-20T22:23:40.576063+0000 mgr.y (mgr.14592) 665 : cluster 0 pgmap v1103: 364 pgs: 364 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-05-20T22:23:41.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:40 smithi145 bash[23893]: cluster 2024-05-20T22:23:40.607132+0000 mon.a (mon.0) 3436 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:23:41.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:40 smithi145 bash[23893]: audit 2024-05-20T22:23:40.609427+0000 mon.a (mon.0) 3437 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-134"}]': finished 2024-05-20T22:23:41.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:40 smithi145 bash[23893]: cluster 2024-05-20T22:23:40.617918+0000 mon.a (mon.0) 3438 : cluster 0 osdmap e680: 8 total, 8 up, 8 in 2024-05-20T22:23:41.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:40 smithi050 bash[21866]: audit 2024-05-20T22:23:39.931324+0000 mon.a (mon.0) 3433 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:23:41.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:40 smithi050 bash[21866]: cluster 2024-05-20T22:23:39.938080+0000 mon.a (mon.0) 3434 : cluster 0 osdmap e679: 8 total, 8 up, 8 in 2024-05-20T22:23:41.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:40 smithi050 bash[21866]: audit 2024-05-20T22:23:39.941495+0000 mon.c (mon.2) 455 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-134"}]: dispatch 2024-05-20T22:23:41.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:40 smithi050 bash[21866]: audit 2024-05-20T22:23:39.956666+0000 mon.a (mon.0) 3435 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-134"}]: dispatch 2024-05-20T22:23:41.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:40 smithi050 bash[21866]: cluster 2024-05-20T22:23:40.576063+0000 mgr.y (mgr.14592) 665 : cluster 0 pgmap v1103: 364 pgs: 364 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-05-20T22:23:41.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:40 smithi050 bash[21866]: cluster 2024-05-20T22:23:40.607132+0000 mon.a (mon.0) 3436 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:23:41.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:40 smithi050 bash[21866]: audit 2024-05-20T22:23:40.609427+0000 mon.a (mon.0) 3437 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-134"}]': finished 2024-05-20T22:23:41.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:40 smithi050 bash[21866]: cluster 2024-05-20T22:23:40.617918+0000 mon.a (mon.0) 3438 : cluster 0 osdmap e680: 8 total, 8 up, 8 in 2024-05-20T22:23:41.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:40 smithi050 bash[28929]: audit 2024-05-20T22:23:39.931324+0000 mon.a (mon.0) 3433 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:23:41.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:40 smithi050 bash[28929]: cluster 2024-05-20T22:23:39.938080+0000 mon.a (mon.0) 3434 : cluster 0 osdmap e679: 8 total, 8 up, 8 in 2024-05-20T22:23:41.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:40 smithi050 bash[28929]: audit 2024-05-20T22:23:39.941495+0000 mon.c (mon.2) 455 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-134"}]: dispatch 2024-05-20T22:23:41.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:40 smithi050 bash[28929]: audit 2024-05-20T22:23:39.956666+0000 mon.a (mon.0) 3435 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-134"}]: dispatch 2024-05-20T22:23:41.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:40 smithi050 bash[28929]: cluster 2024-05-20T22:23:40.576063+0000 mgr.y (mgr.14592) 665 : cluster 0 pgmap v1103: 364 pgs: 364 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-05-20T22:23:41.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:40 smithi050 bash[28929]: cluster 2024-05-20T22:23:40.607132+0000 mon.a (mon.0) 3436 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:23:41.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:40 smithi050 bash[28929]: audit 2024-05-20T22:23:40.609427+0000 mon.a (mon.0) 3437 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-134"}]': finished 2024-05-20T22:23:41.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:40 smithi050 bash[28929]: cluster 2024-05-20T22:23:40.617918+0000 mon.a (mon.0) 3438 : cluster 0 osdmap e680: 8 total, 8 up, 8 in 2024-05-20T22:23:42.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:42 smithi145 bash[23893]: cluster 2024-05-20T22:23:41.619615+0000 mon.a (mon.0) 3439 : cluster 0 osdmap e681: 8 total, 8 up, 8 in 2024-05-20T22:23:42.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:42 smithi050 bash[21866]: cluster 2024-05-20T22:23:41.619615+0000 mon.a (mon.0) 3439 : cluster 0 osdmap e681: 8 total, 8 up, 8 in 2024-05-20T22:23:42.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:42 smithi050 bash[28929]: cluster 2024-05-20T22:23:41.619615+0000 mon.a (mon.0) 3439 : cluster 0 osdmap e681: 8 total, 8 up, 8 in 2024-05-20T22:23:43.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:43 smithi145 bash[23893]: cluster 2024-05-20T22:23:42.577123+0000 mgr.y (mgr.14592) 666 : cluster 0 pgmap v1106: 332 pgs: 332 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:23:43.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:43 smithi145 bash[23893]: cluster 2024-05-20T22:23:42.632688+0000 mon.a (mon.0) 3440 : cluster 0 osdmap e682: 8 total, 8 up, 8 in 2024-05-20T22:23:43.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:43 smithi145 bash[23893]: audit 2024-05-20T22:23:42.636245+0000 mon.c (mon.2) 456 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:43.889 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:43 smithi145 bash[23893]: audit 2024-05-20T22:23:42.640926+0000 mon.a (mon.0) 3441 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:43.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:43 smithi050 bash[21866]: cluster 2024-05-20T22:23:42.577123+0000 mgr.y (mgr.14592) 666 : cluster 0 pgmap v1106: 332 pgs: 332 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:23:43.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:43 smithi050 bash[21866]: cluster 2024-05-20T22:23:42.632688+0000 mon.a (mon.0) 3440 : cluster 0 osdmap e682: 8 total, 8 up, 8 in 2024-05-20T22:23:43.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:43 smithi050 bash[21866]: audit 2024-05-20T22:23:42.636245+0000 mon.c (mon.2) 456 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:43.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:43 smithi050 bash[21866]: audit 2024-05-20T22:23:42.640926+0000 mon.a (mon.0) 3441 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:43.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:43 smithi050 bash[28929]: cluster 2024-05-20T22:23:42.577123+0000 mgr.y (mgr.14592) 666 : cluster 0 pgmap v1106: 332 pgs: 332 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:23:43.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:43 smithi050 bash[28929]: cluster 2024-05-20T22:23:42.632688+0000 mon.a (mon.0) 3440 : cluster 0 osdmap e682: 8 total, 8 up, 8 in 2024-05-20T22:23:43.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:43 smithi050 bash[28929]: audit 2024-05-20T22:23:42.636245+0000 mon.c (mon.2) 456 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:43.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:43 smithi050 bash[28929]: audit 2024-05-20T22:23:42.640926+0000 mon.a (mon.0) 3441 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:44.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:44 smithi050 bash[21866]: audit 2024-05-20T22:23:43.626512+0000 mon.a (mon.0) 3442 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:23:44.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:44 smithi050 bash[21866]: cluster 2024-05-20T22:23:43.635061+0000 mon.a (mon.0) 3443 : cluster 0 osdmap e683: 8 total, 8 up, 8 in 2024-05-20T22:23:44.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:44 smithi050 bash[21866]: audit 2024-05-20T22:23:43.640545+0000 mon.c (mon.2) 457 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:44.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:44 smithi050 bash[21866]: audit 2024-05-20T22:23:43.656185+0000 mon.a (mon.0) 3444 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:44.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:44 smithi050 bash[28929]: audit 2024-05-20T22:23:43.626512+0000 mon.a (mon.0) 3442 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:23:44.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:44 smithi050 bash[28929]: cluster 2024-05-20T22:23:43.635061+0000 mon.a (mon.0) 3443 : cluster 0 osdmap e683: 8 total, 8 up, 8 in 2024-05-20T22:23:44.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:44 smithi050 bash[28929]: audit 2024-05-20T22:23:43.640545+0000 mon.c (mon.2) 457 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:44.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:44 smithi050 bash[28929]: audit 2024-05-20T22:23:43.656185+0000 mon.a (mon.0) 3444 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:45.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:44 smithi145 bash[23893]: audit 2024-05-20T22:23:43.626512+0000 mon.a (mon.0) 3442 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:23:45.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:44 smithi145 bash[23893]: cluster 2024-05-20T22:23:43.635061+0000 mon.a (mon.0) 3443 : cluster 0 osdmap e683: 8 total, 8 up, 8 in 2024-05-20T22:23:45.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:44 smithi145 bash[23893]: audit 2024-05-20T22:23:43.640545+0000 mon.c (mon.2) 457 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:45.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:44 smithi145 bash[23893]: audit 2024-05-20T22:23:43.656185+0000 mon.a (mon.0) 3444 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:45.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:45 smithi050 bash[21866]: cluster 2024-05-20T22:23:44.578129+0000 mgr.y (mgr.14592) 667 : cluster 0 pgmap v1109: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:23:45.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:45 smithi050 bash[21866]: audit 2024-05-20T22:23:44.649046+0000 mon.a (mon.0) 3445 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-136", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:23:45.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:45 smithi050 bash[21866]: cluster 2024-05-20T22:23:44.659531+0000 mon.a (mon.0) 3446 : cluster 0 osdmap e684: 8 total, 8 up, 8 in 2024-05-20T22:23:45.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:45 smithi050 bash[21866]: audit 2024-05-20T22:23:44.660001+0000 mon.c (mon.2) 458 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-136"}]: dispatch 2024-05-20T22:23:45.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:45 smithi050 bash[21866]: audit 2024-05-20T22:23:44.662391+0000 mon.a (mon.0) 3447 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-136"}]: dispatch 2024-05-20T22:23:45.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:45 smithi050 bash[28929]: cluster 2024-05-20T22:23:44.578129+0000 mgr.y (mgr.14592) 667 : cluster 0 pgmap v1109: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:23:45.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:45 smithi050 bash[28929]: audit 2024-05-20T22:23:44.649046+0000 mon.a (mon.0) 3445 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-136", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:23:45.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:45 smithi050 bash[28929]: cluster 2024-05-20T22:23:44.659531+0000 mon.a (mon.0) 3446 : cluster 0 osdmap e684: 8 total, 8 up, 8 in 2024-05-20T22:23:45.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:45 smithi050 bash[28929]: audit 2024-05-20T22:23:44.660001+0000 mon.c (mon.2) 458 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-136"}]: dispatch 2024-05-20T22:23:45.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:45 smithi050 bash[28929]: audit 2024-05-20T22:23:44.662391+0000 mon.a (mon.0) 3447 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-136"}]: dispatch 2024-05-20T22:23:46.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:45 smithi145 bash[23893]: cluster 2024-05-20T22:23:44.578129+0000 mgr.y (mgr.14592) 667 : cluster 0 pgmap v1109: 364 pgs: 32 unknown, 332 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:23:46.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:45 smithi145 bash[23893]: audit 2024-05-20T22:23:44.649046+0000 mon.a (mon.0) 3445 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-136", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:23:46.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:45 smithi145 bash[23893]: cluster 2024-05-20T22:23:44.659531+0000 mon.a (mon.0) 3446 : cluster 0 osdmap e684: 8 total, 8 up, 8 in 2024-05-20T22:23:46.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:45 smithi145 bash[23893]: audit 2024-05-20T22:23:44.660001+0000 mon.c (mon.2) 458 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-136"}]: dispatch 2024-05-20T22:23:46.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:45 smithi145 bash[23893]: audit 2024-05-20T22:23:44.662391+0000 mon.a (mon.0) 3447 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-136"}]: dispatch 2024-05-20T22:23:46.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:46 smithi050 bash[21866]: audit 2024-05-20T22:23:45.651803+0000 mon.a (mon.0) 3448 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-136"}]': finished 2024-05-20T22:23:46.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:46 smithi050 bash[21866]: cluster 2024-05-20T22:23:45.660214+0000 mon.a (mon.0) 3449 : cluster 0 osdmap e685: 8 total, 8 up, 8 in 2024-05-20T22:23:46.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:46 smithi050 bash[21866]: audit 2024-05-20T22:23:45.660929+0000 mon.c (mon.2) 459 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-136", "mode": "writeback"}]: dispatch 2024-05-20T22:23:46.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:46 smithi050 bash[21866]: audit 2024-05-20T22:23:45.664610+0000 mon.a (mon.0) 3450 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-136", "mode": "writeback"}]: dispatch 2024-05-20T22:23:46.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:46 smithi050 bash[21866]: cluster 2024-05-20T22:23:46.652242+0000 mon.a (mon.0) 3451 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:23:46.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:46 smithi050 bash[21866]: audit 2024-05-20T22:23:46.654401+0000 mon.a (mon.0) 3452 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-136", "mode": "writeback"}]': finished 2024-05-20T22:23:46.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:46 smithi050 bash[21866]: cluster 2024-05-20T22:23:46.662190+0000 mon.a (mon.0) 3453 : cluster 0 osdmap e686: 8 total, 8 up, 8 in 2024-05-20T22:23:46.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:46 smithi050 bash[28929]: audit 2024-05-20T22:23:45.651803+0000 mon.a (mon.0) 3448 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-136"}]': finished 2024-05-20T22:23:46.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:46 smithi050 bash[28929]: cluster 2024-05-20T22:23:45.660214+0000 mon.a (mon.0) 3449 : cluster 0 osdmap e685: 8 total, 8 up, 8 in 2024-05-20T22:23:46.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:46 smithi050 bash[28929]: audit 2024-05-20T22:23:45.660929+0000 mon.c (mon.2) 459 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-136", "mode": "writeback"}]: dispatch 2024-05-20T22:23:46.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:46 smithi050 bash[28929]: audit 2024-05-20T22:23:45.664610+0000 mon.a (mon.0) 3450 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-136", "mode": "writeback"}]: dispatch 2024-05-20T22:23:46.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:46 smithi050 bash[28929]: cluster 2024-05-20T22:23:46.652242+0000 mon.a (mon.0) 3451 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:23:46.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:46 smithi050 bash[28929]: audit 2024-05-20T22:23:46.654401+0000 mon.a (mon.0) 3452 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-136", "mode": "writeback"}]': finished 2024-05-20T22:23:46.944 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:46 smithi050 bash[28929]: cluster 2024-05-20T22:23:46.662190+0000 mon.a (mon.0) 3453 : cluster 0 osdmap e686: 8 total, 8 up, 8 in 2024-05-20T22:23:47.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:46 smithi145 bash[23893]: audit 2024-05-20T22:23:45.651803+0000 mon.a (mon.0) 3448 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-136"}]': finished 2024-05-20T22:23:47.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:46 smithi145 bash[23893]: cluster 2024-05-20T22:23:45.660214+0000 mon.a (mon.0) 3449 : cluster 0 osdmap e685: 8 total, 8 up, 8 in 2024-05-20T22:23:47.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:46 smithi145 bash[23893]: audit 2024-05-20T22:23:45.660929+0000 mon.c (mon.2) 459 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-136", "mode": "writeback"}]: dispatch 2024-05-20T22:23:47.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:46 smithi145 bash[23893]: audit 2024-05-20T22:23:45.664610+0000 mon.a (mon.0) 3450 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-136", "mode": "writeback"}]: dispatch 2024-05-20T22:23:47.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:46 smithi145 bash[23893]: cluster 2024-05-20T22:23:46.652242+0000 mon.a (mon.0) 3451 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:23:47.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:46 smithi145 bash[23893]: audit 2024-05-20T22:23:46.654401+0000 mon.a (mon.0) 3452 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-136", "mode": "writeback"}]': finished 2024-05-20T22:23:47.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:46 smithi145 bash[23893]: cluster 2024-05-20T22:23:46.662190+0000 mon.a (mon.0) 3453 : cluster 0 osdmap e686: 8 total, 8 up, 8 in 2024-05-20T22:23:47.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:47 smithi050 bash[21866]: cluster 2024-05-20T22:23:46.579094+0000 mgr.y (mgr.14592) 668 : cluster 0 pgmap v1112: 364 pgs: 364 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:47.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:47 smithi050 bash[21866]: audit 2024-05-20T22:23:46.775494+0000 mon.c (mon.2) 460 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:47.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:47 smithi050 bash[21866]: audit 2024-05-20T22:23:46.776257+0000 mon.a (mon.0) 3454 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:47.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:47 smithi050 bash[28929]: cluster 2024-05-20T22:23:46.579094+0000 mgr.y (mgr.14592) 668 : cluster 0 pgmap v1112: 364 pgs: 364 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:47.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:47 smithi050 bash[28929]: audit 2024-05-20T22:23:46.775494+0000 mon.c (mon.2) 460 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:47.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:47 smithi050 bash[28929]: audit 2024-05-20T22:23:46.776257+0000 mon.a (mon.0) 3454 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:48.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:47 smithi145 bash[23893]: cluster 2024-05-20T22:23:46.579094+0000 mgr.y (mgr.14592) 668 : cluster 0 pgmap v1112: 364 pgs: 364 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:48.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:47 smithi145 bash[23893]: audit 2024-05-20T22:23:46.775494+0000 mon.c (mon.2) 460 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:48.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:47 smithi145 bash[23893]: audit 2024-05-20T22:23:46.776257+0000 mon.a (mon.0) 3454 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:48.639 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:23:48 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:23:49.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:48 smithi145 bash[23893]: audit 2024-05-20T22:23:47.691946+0000 mon.a (mon.0) 3455 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:23:49.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:48 smithi145 bash[23893]: cluster 2024-05-20T22:23:47.698937+0000 mon.a (mon.0) 3456 : cluster 0 osdmap e687: 8 total, 8 up, 8 in 2024-05-20T22:23:49.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:48 smithi145 bash[23893]: audit 2024-05-20T22:23:47.700987+0000 mon.c (mon.2) 461 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-136"}]: dispatch 2024-05-20T22:23:49.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:48 smithi145 bash[23893]: audit 2024-05-20T22:23:47.703817+0000 mon.a (mon.0) 3457 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-136"}]: dispatch 2024-05-20T22:23:49.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:48 smithi050 bash[21866]: audit 2024-05-20T22:23:47.691946+0000 mon.a (mon.0) 3455 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:23:49.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:48 smithi050 bash[21866]: cluster 2024-05-20T22:23:47.698937+0000 mon.a (mon.0) 3456 : cluster 0 osdmap e687: 8 total, 8 up, 8 in 2024-05-20T22:23:49.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:48 smithi050 bash[21866]: audit 2024-05-20T22:23:47.700987+0000 mon.c (mon.2) 461 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-136"}]: dispatch 2024-05-20T22:23:49.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:48 smithi050 bash[21866]: audit 2024-05-20T22:23:47.703817+0000 mon.a (mon.0) 3457 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-136"}]: dispatch 2024-05-20T22:23:49.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:48 smithi050 bash[28929]: audit 2024-05-20T22:23:47.691946+0000 mon.a (mon.0) 3455 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:23:49.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:48 smithi050 bash[28929]: cluster 2024-05-20T22:23:47.698937+0000 mon.a (mon.0) 3456 : cluster 0 osdmap e687: 8 total, 8 up, 8 in 2024-05-20T22:23:49.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:48 smithi050 bash[28929]: audit 2024-05-20T22:23:47.700987+0000 mon.c (mon.2) 461 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-136"}]: dispatch 2024-05-20T22:23:49.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:48 smithi050 bash[28929]: audit 2024-05-20T22:23:47.703817+0000 mon.a (mon.0) 3457 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-136"}]: dispatch 2024-05-20T22:23:49.692 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:23:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:23:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:23:50.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:49 smithi145 bash[23893]: audit 2024-05-20T22:23:48.377818+0000 mgr.y (mgr.14592) 669 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:23:50.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:49 smithi145 bash[23893]: cluster 2024-05-20T22:23:48.580076+0000 mgr.y (mgr.14592) 670 : cluster 0 pgmap v1115: 364 pgs: 364 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:50.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:49 smithi145 bash[23893]: cluster 2024-05-20T22:23:48.693014+0000 mon.a (mon.0) 3458 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:23:50.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:49 smithi145 bash[23893]: audit 2024-05-20T22:23:48.700600+0000 mon.a (mon.0) 3459 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-136"}]': finished 2024-05-20T22:23:50.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:49 smithi145 bash[23893]: cluster 2024-05-20T22:23:48.710801+0000 mon.a (mon.0) 3460 : cluster 0 osdmap e688: 8 total, 8 up, 8 in 2024-05-20T22:23:50.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:49 smithi050 bash[21866]: audit 2024-05-20T22:23:48.377818+0000 mgr.y (mgr.14592) 669 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:23:50.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:49 smithi050 bash[21866]: cluster 2024-05-20T22:23:48.580076+0000 mgr.y (mgr.14592) 670 : cluster 0 pgmap v1115: 364 pgs: 364 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:50.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:49 smithi050 bash[21866]: cluster 2024-05-20T22:23:48.693014+0000 mon.a (mon.0) 3458 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:23:50.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:49 smithi050 bash[21866]: audit 2024-05-20T22:23:48.700600+0000 mon.a (mon.0) 3459 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-136"}]': finished 2024-05-20T22:23:50.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:49 smithi050 bash[21866]: cluster 2024-05-20T22:23:48.710801+0000 mon.a (mon.0) 3460 : cluster 0 osdmap e688: 8 total, 8 up, 8 in 2024-05-20T22:23:50.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:49 smithi050 bash[28929]: audit 2024-05-20T22:23:48.377818+0000 mgr.y (mgr.14592) 669 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:23:50.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:49 smithi050 bash[28929]: cluster 2024-05-20T22:23:48.580076+0000 mgr.y (mgr.14592) 670 : cluster 0 pgmap v1115: 364 pgs: 364 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:50.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:49 smithi050 bash[28929]: cluster 2024-05-20T22:23:48.693014+0000 mon.a (mon.0) 3458 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:23:50.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:49 smithi050 bash[28929]: audit 2024-05-20T22:23:48.700600+0000 mon.a (mon.0) 3459 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-136"}]': finished 2024-05-20T22:23:50.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:49 smithi050 bash[28929]: cluster 2024-05-20T22:23:48.710801+0000 mon.a (mon.0) 3460 : cluster 0 osdmap e688: 8 total, 8 up, 8 in 2024-05-20T22:23:51.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:50 smithi145 bash[23893]: cluster 2024-05-20T22:23:49.710759+0000 mon.a (mon.0) 3461 : cluster 0 osdmap e689: 8 total, 8 up, 8 in 2024-05-20T22:23:51.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:50 smithi050 bash[28929]: cluster 2024-05-20T22:23:49.710759+0000 mon.a (mon.0) 3461 : cluster 0 osdmap e689: 8 total, 8 up, 8 in 2024-05-20T22:23:51.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:50 smithi050 bash[21866]: cluster 2024-05-20T22:23:49.710759+0000 mon.a (mon.0) 3461 : cluster 0 osdmap e689: 8 total, 8 up, 8 in 2024-05-20T22:23:52.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:51 smithi145 bash[23893]: cluster 2024-05-20T22:23:50.583397+0000 mgr.y (mgr.14592) 671 : cluster 0 pgmap v1118: 332 pgs: 332 active+clean; 4.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-05-20T22:23:52.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:51 smithi145 bash[23893]: cluster 2024-05-20T22:23:50.735547+0000 mon.a (mon.0) 3462 : cluster 0 osdmap e690: 8 total, 8 up, 8 in 2024-05-20T22:23:52.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:51 smithi145 bash[23893]: audit 2024-05-20T22:23:50.742428+0000 mon.c (mon.2) 462 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:52.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:51 smithi145 bash[23893]: audit 2024-05-20T22:23:50.748584+0000 mon.a (mon.0) 3463 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:52.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:51 smithi050 bash[21866]: cluster 2024-05-20T22:23:50.583397+0000 mgr.y (mgr.14592) 671 : cluster 0 pgmap v1118: 332 pgs: 332 active+clean; 4.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-05-20T22:23:52.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:51 smithi050 bash[21866]: cluster 2024-05-20T22:23:50.735547+0000 mon.a (mon.0) 3462 : cluster 0 osdmap e690: 8 total, 8 up, 8 in 2024-05-20T22:23:52.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:51 smithi050 bash[21866]: audit 2024-05-20T22:23:50.742428+0000 mon.c (mon.2) 462 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:52.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:51 smithi050 bash[21866]: audit 2024-05-20T22:23:50.748584+0000 mon.a (mon.0) 3463 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:52.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:51 smithi050 bash[28929]: cluster 2024-05-20T22:23:50.583397+0000 mgr.y (mgr.14592) 671 : cluster 0 pgmap v1118: 332 pgs: 332 active+clean; 4.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-05-20T22:23:52.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:51 smithi050 bash[28929]: cluster 2024-05-20T22:23:50.735547+0000 mon.a (mon.0) 3462 : cluster 0 osdmap e690: 8 total, 8 up, 8 in 2024-05-20T22:23:52.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:51 smithi050 bash[28929]: audit 2024-05-20T22:23:50.742428+0000 mon.c (mon.2) 462 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:52.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:51 smithi050 bash[28929]: audit 2024-05-20T22:23:50.748584+0000 mon.a (mon.0) 3463 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:23:53.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:52 smithi145 bash[23893]: audit 2024-05-20T22:23:51.739191+0000 mon.a (mon.0) 3464 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:23:53.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:52 smithi145 bash[23893]: cluster 2024-05-20T22:23:51.746631+0000 mon.a (mon.0) 3465 : cluster 0 osdmap e691: 8 total, 8 up, 8 in 2024-05-20T22:23:53.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:52 smithi145 bash[23893]: audit 2024-05-20T22:23:51.751509+0000 mon.c (mon.2) 463 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:53.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:52 smithi145 bash[23893]: audit 2024-05-20T22:23:51.753699+0000 mon.a (mon.0) 3466 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:53.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:52 smithi050 bash[28929]: audit 2024-05-20T22:23:51.739191+0000 mon.a (mon.0) 3464 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:23:53.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:52 smithi050 bash[28929]: cluster 2024-05-20T22:23:51.746631+0000 mon.a (mon.0) 3465 : cluster 0 osdmap e691: 8 total, 8 up, 8 in 2024-05-20T22:23:53.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:52 smithi050 bash[28929]: audit 2024-05-20T22:23:51.751509+0000 mon.c (mon.2) 463 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:53.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:52 smithi050 bash[28929]: audit 2024-05-20T22:23:51.753699+0000 mon.a (mon.0) 3466 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:53.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:52 smithi050 bash[21866]: audit 2024-05-20T22:23:51.739191+0000 mon.a (mon.0) 3464 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:23:53.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:52 smithi050 bash[21866]: cluster 2024-05-20T22:23:51.746631+0000 mon.a (mon.0) 3465 : cluster 0 osdmap e691: 8 total, 8 up, 8 in 2024-05-20T22:23:53.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:52 smithi050 bash[21866]: audit 2024-05-20T22:23:51.751509+0000 mon.c (mon.2) 463 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:53.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:52 smithi050 bash[21866]: audit 2024-05-20T22:23:51.753699+0000 mon.a (mon.0) 3466 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:23:54.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:53 smithi145 bash[23893]: cluster 2024-05-20T22:23:52.584570+0000 mgr.y (mgr.14592) 672 : cluster 0 pgmap v1121: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-05-20T22:23:54.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:53 smithi145 bash[23893]: audit 2024-05-20T22:23:52.748470+0000 mon.a (mon.0) 3467 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-138", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:23:54.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:53 smithi145 bash[23893]: cluster 2024-05-20T22:23:52.759370+0000 mon.a (mon.0) 3468 : cluster 0 osdmap e692: 8 total, 8 up, 8 in 2024-05-20T22:23:54.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:53 smithi145 bash[23893]: audit 2024-05-20T22:23:52.759635+0000 mon.c (mon.2) 464 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:23:54.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:53 smithi145 bash[23893]: audit 2024-05-20T22:23:52.762164+0000 mon.a (mon.0) 3469 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:23:54.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:53 smithi145 bash[23893]: audit 2024-05-20T22:23:53.728259+0000 mon.a (mon.0) 3470 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:23:54.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:53 smithi050 bash[21866]: cluster 2024-05-20T22:23:52.584570+0000 mgr.y (mgr.14592) 672 : cluster 0 pgmap v1121: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-05-20T22:23:54.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:53 smithi050 bash[21866]: audit 2024-05-20T22:23:52.748470+0000 mon.a (mon.0) 3467 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-138", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:23:54.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:53 smithi050 bash[21866]: cluster 2024-05-20T22:23:52.759370+0000 mon.a (mon.0) 3468 : cluster 0 osdmap e692: 8 total, 8 up, 8 in 2024-05-20T22:23:54.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:53 smithi050 bash[21866]: audit 2024-05-20T22:23:52.759635+0000 mon.c (mon.2) 464 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:23:54.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:53 smithi050 bash[21866]: audit 2024-05-20T22:23:52.762164+0000 mon.a (mon.0) 3469 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:23:54.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:53 smithi050 bash[21866]: audit 2024-05-20T22:23:53.728259+0000 mon.a (mon.0) 3470 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:23:54.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:53 smithi050 bash[28929]: cluster 2024-05-20T22:23:52.584570+0000 mgr.y (mgr.14592) 672 : cluster 0 pgmap v1121: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-05-20T22:23:54.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:53 smithi050 bash[28929]: audit 2024-05-20T22:23:52.748470+0000 mon.a (mon.0) 3467 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-138", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:23:54.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:53 smithi050 bash[28929]: cluster 2024-05-20T22:23:52.759370+0000 mon.a (mon.0) 3468 : cluster 0 osdmap e692: 8 total, 8 up, 8 in 2024-05-20T22:23:54.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:53 smithi050 bash[28929]: audit 2024-05-20T22:23:52.759635+0000 mon.c (mon.2) 464 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:23:54.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:53 smithi050 bash[28929]: audit 2024-05-20T22:23:52.762164+0000 mon.a (mon.0) 3469 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:23:54.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:53 smithi050 bash[28929]: audit 2024-05-20T22:23:53.728259+0000 mon.a (mon.0) 3470 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:23:55.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:54 smithi145 bash[23893]: audit 2024-05-20T22:23:53.751150+0000 mon.a (mon.0) 3471 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:23:55.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:54 smithi145 bash[23893]: cluster 2024-05-20T22:23:53.758690+0000 mon.a (mon.0) 3472 : cluster 0 osdmap e693: 8 total, 8 up, 8 in 2024-05-20T22:23:55.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:54 smithi145 bash[23893]: audit 2024-05-20T22:23:53.762806+0000 mon.c (mon.2) 465 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:23:55.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:54 smithi145 bash[23893]: audit 2024-05-20T22:23:53.776773+0000 mon.a (mon.0) 3473 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:23:55.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:54 smithi050 bash[21866]: audit 2024-05-20T22:23:53.751150+0000 mon.a (mon.0) 3471 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:23:55.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:54 smithi050 bash[21866]: cluster 2024-05-20T22:23:53.758690+0000 mon.a (mon.0) 3472 : cluster 0 osdmap e693: 8 total, 8 up, 8 in 2024-05-20T22:23:55.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:54 smithi050 bash[21866]: audit 2024-05-20T22:23:53.762806+0000 mon.c (mon.2) 465 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:23:55.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:54 smithi050 bash[21866]: audit 2024-05-20T22:23:53.776773+0000 mon.a (mon.0) 3473 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:23:55.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:54 smithi050 bash[28929]: audit 2024-05-20T22:23:53.751150+0000 mon.a (mon.0) 3471 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:23:55.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:54 smithi050 bash[28929]: cluster 2024-05-20T22:23:53.758690+0000 mon.a (mon.0) 3472 : cluster 0 osdmap e693: 8 total, 8 up, 8 in 2024-05-20T22:23:55.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:54 smithi050 bash[28929]: audit 2024-05-20T22:23:53.762806+0000 mon.c (mon.2) 465 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:23:55.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:54 smithi050 bash[28929]: audit 2024-05-20T22:23:53.776773+0000 mon.a (mon.0) 3473 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:23:56.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:55 smithi145 bash[23893]: cluster 2024-05-20T22:23:54.585560+0000 mgr.y (mgr.14592) 673 : cluster 0 pgmap v1124: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:23:56.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:55 smithi145 bash[23893]: audit 2024-05-20T22:23:54.773461+0000 mon.a (mon.0) 3474 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:23:56.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:55 smithi145 bash[23893]: cluster 2024-05-20T22:23:54.783310+0000 mon.a (mon.0) 3475 : cluster 0 osdmap e694: 8 total, 8 up, 8 in 2024-05-20T22:23:56.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:55 smithi145 bash[23893]: audit 2024-05-20T22:23:54.785206+0000 mon.c (mon.2) 466 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-05-20T22:23:56.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:55 smithi145 bash[23893]: audit 2024-05-20T22:23:54.788604+0000 mon.a (mon.0) 3476 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-05-20T22:23:56.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:55 smithi050 bash[21866]: cluster 2024-05-20T22:23:54.585560+0000 mgr.y (mgr.14592) 673 : cluster 0 pgmap v1124: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:23:56.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:55 smithi050 bash[21866]: audit 2024-05-20T22:23:54.773461+0000 mon.a (mon.0) 3474 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:23:56.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:55 smithi050 bash[21866]: cluster 2024-05-20T22:23:54.783310+0000 mon.a (mon.0) 3475 : cluster 0 osdmap e694: 8 total, 8 up, 8 in 2024-05-20T22:23:56.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:55 smithi050 bash[21866]: audit 2024-05-20T22:23:54.785206+0000 mon.c (mon.2) 466 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-05-20T22:23:56.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:55 smithi050 bash[21866]: audit 2024-05-20T22:23:54.788604+0000 mon.a (mon.0) 3476 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-05-20T22:23:56.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:55 smithi050 bash[28929]: cluster 2024-05-20T22:23:54.585560+0000 mgr.y (mgr.14592) 673 : cluster 0 pgmap v1124: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:23:56.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:55 smithi050 bash[28929]: audit 2024-05-20T22:23:54.773461+0000 mon.a (mon.0) 3474 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:23:56.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:55 smithi050 bash[28929]: cluster 2024-05-20T22:23:54.783310+0000 mon.a (mon.0) 3475 : cluster 0 osdmap e694: 8 total, 8 up, 8 in 2024-05-20T22:23:56.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:55 smithi050 bash[28929]: audit 2024-05-20T22:23:54.785206+0000 mon.c (mon.2) 466 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-05-20T22:23:56.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:55 smithi050 bash[28929]: audit 2024-05-20T22:23:54.788604+0000 mon.a (mon.0) 3476 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-05-20T22:23:57.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:56 smithi145 bash[23893]: audit 2024-05-20T22:23:55.776653+0000 mon.a (mon.0) 3477 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-05-20T22:23:57.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:56 smithi145 bash[23893]: cluster 2024-05-20T22:23:55.784139+0000 mon.a (mon.0) 3478 : cluster 0 osdmap e695: 8 total, 8 up, 8 in 2024-05-20T22:23:57.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:56 smithi050 bash[21866]: audit 2024-05-20T22:23:55.776653+0000 mon.a (mon.0) 3477 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-05-20T22:23:57.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:56 smithi050 bash[21866]: cluster 2024-05-20T22:23:55.784139+0000 mon.a (mon.0) 3478 : cluster 0 osdmap e695: 8 total, 8 up, 8 in 2024-05-20T22:23:57.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:56 smithi050 bash[28929]: audit 2024-05-20T22:23:55.776653+0000 mon.a (mon.0) 3477 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-05-20T22:23:57.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:56 smithi050 bash[28929]: cluster 2024-05-20T22:23:55.784139+0000 mon.a (mon.0) 3478 : cluster 0 osdmap e695: 8 total, 8 up, 8 in 2024-05-20T22:23:58.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:57 smithi145 bash[23893]: cluster 2024-05-20T22:23:56.586637+0000 mgr.y (mgr.14592) 674 : cluster 0 pgmap v1127: 364 pgs: 364 active+clean; 4.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:58.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:57 smithi145 bash[23893]: audit 2024-05-20T22:23:56.831548+0000 mon.c (mon.2) 467 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:58.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:57 smithi145 bash[23893]: audit 2024-05-20T22:23:56.832269+0000 mon.a (mon.0) 3479 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:58.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:57 smithi145 bash[23893]: audit 2024-05-20T22:23:56.833331+0000 mon.c (mon.2) 468 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-138"}]: dispatch 2024-05-20T22:23:58.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:57 smithi145 bash[23893]: audit 2024-05-20T22:23:56.834025+0000 mon.a (mon.0) 3480 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-138"}]: dispatch 2024-05-20T22:23:58.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:57 smithi050 bash[21866]: cluster 2024-05-20T22:23:56.586637+0000 mgr.y (mgr.14592) 674 : cluster 0 pgmap v1127: 364 pgs: 364 active+clean; 4.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:58.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:57 smithi050 bash[21866]: audit 2024-05-20T22:23:56.831548+0000 mon.c (mon.2) 467 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:58.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:57 smithi050 bash[21866]: audit 2024-05-20T22:23:56.832269+0000 mon.a (mon.0) 3479 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:58.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:57 smithi050 bash[21866]: audit 2024-05-20T22:23:56.833331+0000 mon.c (mon.2) 468 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-138"}]: dispatch 2024-05-20T22:23:58.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:57 smithi050 bash[21866]: audit 2024-05-20T22:23:56.834025+0000 mon.a (mon.0) 3480 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-138"}]: dispatch 2024-05-20T22:23:58.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:57 smithi050 bash[28929]: cluster 2024-05-20T22:23:56.586637+0000 mgr.y (mgr.14592) 674 : cluster 0 pgmap v1127: 364 pgs: 364 active+clean; 4.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:23:58.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:57 smithi050 bash[28929]: audit 2024-05-20T22:23:56.831548+0000 mon.c (mon.2) 467 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:58.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:57 smithi050 bash[28929]: audit 2024-05-20T22:23:56.832269+0000 mon.a (mon.0) 3479 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:23:58.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:57 smithi050 bash[28929]: audit 2024-05-20T22:23:56.833331+0000 mon.c (mon.2) 468 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-138"}]: dispatch 2024-05-20T22:23:58.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:57 smithi050 bash[28929]: audit 2024-05-20T22:23:56.834025+0000 mon.a (mon.0) 3480 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-138"}]: dispatch 2024-05-20T22:23:58.639 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:23:58 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:23:59.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:58 smithi145 bash[23893]: audit 2024-05-20T22:23:57.800250+0000 mon.a (mon.0) 3481 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-138"}]': finished 2024-05-20T22:23:59.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:58 smithi145 bash[23893]: cluster 2024-05-20T22:23:57.807747+0000 mon.a (mon.0) 3482 : cluster 0 osdmap e696: 8 total, 8 up, 8 in 2024-05-20T22:23:59.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:58 smithi145 bash[23893]: audit 2024-05-20T22:23:58.563721+0000 mon.a (mon.0) 3483 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:23:59.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:58 smithi050 bash[21866]: audit 2024-05-20T22:23:57.800250+0000 mon.a (mon.0) 3481 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-138"}]': finished 2024-05-20T22:23:59.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:58 smithi050 bash[21866]: cluster 2024-05-20T22:23:57.807747+0000 mon.a (mon.0) 3482 : cluster 0 osdmap e696: 8 total, 8 up, 8 in 2024-05-20T22:23:59.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:58 smithi050 bash[21866]: audit 2024-05-20T22:23:58.563721+0000 mon.a (mon.0) 3483 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:23:59.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:58 smithi050 bash[28929]: audit 2024-05-20T22:23:57.800250+0000 mon.a (mon.0) 3481 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-138"}]': finished 2024-05-20T22:23:59.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:58 smithi050 bash[28929]: cluster 2024-05-20T22:23:57.807747+0000 mon.a (mon.0) 3482 : cluster 0 osdmap e696: 8 total, 8 up, 8 in 2024-05-20T22:23:59.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:58 smithi050 bash[28929]: audit 2024-05-20T22:23:58.563721+0000 mon.a (mon.0) 3483 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:23:59.693 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:23:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:23:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:24:00.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:59 smithi145 bash[23893]: audit 2024-05-20T22:23:58.389389+0000 mgr.y (mgr.14592) 675 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:24:00.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:59 smithi145 bash[23893]: cluster 2024-05-20T22:23:58.587636+0000 mgr.y (mgr.14592) 676 : cluster 0 pgmap v1129: 364 pgs: 364 active+clean; 4.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-20T22:24:00.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:59 smithi145 bash[23893]: cluster 2024-05-20T22:23:58.813328+0000 mon.a (mon.0) 3484 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:24:00.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:59 smithi145 bash[23893]: cluster 2024-05-20T22:23:58.830102+0000 mon.a (mon.0) 3485 : cluster 0 osdmap e697: 8 total, 8 up, 8 in 2024-05-20T22:24:00.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:59 smithi145 bash[23893]: audit 2024-05-20T22:23:59.295093+0000 mon.a (mon.0) 3486 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:24:00.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:59 smithi145 bash[23893]: audit 2024-05-20T22:23:59.296437+0000 mon.a (mon.0) 3487 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:24:00.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:23:59 smithi145 bash[23893]: audit 2024-05-20T22:23:59.303807+0000 mon.a (mon.0) 3488 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:24:00.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:59 smithi050 bash[21866]: audit 2024-05-20T22:23:58.389389+0000 mgr.y (mgr.14592) 675 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:24:00.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:59 smithi050 bash[21866]: cluster 2024-05-20T22:23:58.587636+0000 mgr.y (mgr.14592) 676 : cluster 0 pgmap v1129: 364 pgs: 364 active+clean; 4.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-20T22:24:00.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:59 smithi050 bash[21866]: cluster 2024-05-20T22:23:58.813328+0000 mon.a (mon.0) 3484 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:24:00.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:59 smithi050 bash[21866]: cluster 2024-05-20T22:23:58.830102+0000 mon.a (mon.0) 3485 : cluster 0 osdmap e697: 8 total, 8 up, 8 in 2024-05-20T22:24:00.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:59 smithi050 bash[21866]: audit 2024-05-20T22:23:59.295093+0000 mon.a (mon.0) 3486 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:24:00.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:59 smithi050 bash[21866]: audit 2024-05-20T22:23:59.296437+0000 mon.a (mon.0) 3487 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:24:00.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:23:59 smithi050 bash[21866]: audit 2024-05-20T22:23:59.303807+0000 mon.a (mon.0) 3488 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:24:00.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:59 smithi050 bash[28929]: audit 2024-05-20T22:23:58.389389+0000 mgr.y (mgr.14592) 675 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:24:00.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:59 smithi050 bash[28929]: cluster 2024-05-20T22:23:58.587636+0000 mgr.y (mgr.14592) 676 : cluster 0 pgmap v1129: 364 pgs: 364 active+clean; 4.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-20T22:24:00.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:59 smithi050 bash[28929]: cluster 2024-05-20T22:23:58.813328+0000 mon.a (mon.0) 3484 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:24:00.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:59 smithi050 bash[28929]: cluster 2024-05-20T22:23:58.830102+0000 mon.a (mon.0) 3485 : cluster 0 osdmap e697: 8 total, 8 up, 8 in 2024-05-20T22:24:00.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:59 smithi050 bash[28929]: audit 2024-05-20T22:23:59.295093+0000 mon.a (mon.0) 3486 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:24:00.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:59 smithi050 bash[28929]: audit 2024-05-20T22:23:59.296437+0000 mon.a (mon.0) 3487 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:24:00.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:23:59 smithi050 bash[28929]: audit 2024-05-20T22:23:59.303807+0000 mon.a (mon.0) 3488 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:24:01.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:00 smithi145 bash[23893]: cluster 2024-05-20T22:23:59.836472+0000 mon.a (mon.0) 3489 : cluster 0 osdmap e698: 8 total, 8 up, 8 in 2024-05-20T22:24:01.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:00 smithi145 bash[23893]: audit 2024-05-20T22:23:59.849819+0000 mon.c (mon.2) 469 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:01.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:00 smithi145 bash[23893]: audit 2024-05-20T22:23:59.850968+0000 mon.a (mon.0) 3490 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:01.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:00 smithi145 bash[23893]: cluster 2024-05-20T22:24:00.590809+0000 mgr.y (mgr.14592) 677 : cluster 0 pgmap v1132: 364 pgs: 32 creating+peering, 332 active+clean; 4.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-20T22:24:01.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:00 smithi050 bash[21866]: cluster 2024-05-20T22:23:59.836472+0000 mon.a (mon.0) 3489 : cluster 0 osdmap e698: 8 total, 8 up, 8 in 2024-05-20T22:24:01.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:00 smithi050 bash[21866]: audit 2024-05-20T22:23:59.849819+0000 mon.c (mon.2) 469 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:01.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:00 smithi050 bash[21866]: audit 2024-05-20T22:23:59.850968+0000 mon.a (mon.0) 3490 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:01.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:00 smithi050 bash[21866]: cluster 2024-05-20T22:24:00.590809+0000 mgr.y (mgr.14592) 677 : cluster 0 pgmap v1132: 364 pgs: 32 creating+peering, 332 active+clean; 4.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-20T22:24:01.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:00 smithi050 bash[28929]: cluster 2024-05-20T22:23:59.836472+0000 mon.a (mon.0) 3489 : cluster 0 osdmap e698: 8 total, 8 up, 8 in 2024-05-20T22:24:01.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:00 smithi050 bash[28929]: audit 2024-05-20T22:23:59.849819+0000 mon.c (mon.2) 469 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:01.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:00 smithi050 bash[28929]: audit 2024-05-20T22:23:59.850968+0000 mon.a (mon.0) 3490 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:01.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:00 smithi050 bash[28929]: cluster 2024-05-20T22:24:00.590809+0000 mgr.y (mgr.14592) 677 : cluster 0 pgmap v1132: 364 pgs: 32 creating+peering, 332 active+clean; 4.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-20T22:24:02.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:01 smithi145 bash[23893]: audit 2024-05-20T22:24:00.837798+0000 mon.a (mon.0) 3491 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:24:02.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:01 smithi145 bash[23893]: cluster 2024-05-20T22:24:00.847752+0000 mon.a (mon.0) 3492 : cluster 0 osdmap e699: 8 total, 8 up, 8 in 2024-05-20T22:24:02.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:01 smithi145 bash[23893]: audit 2024-05-20T22:24:00.851739+0000 mon.c (mon.2) 470 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:02.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:01 smithi145 bash[23893]: audit 2024-05-20T22:24:00.860066+0000 mon.a (mon.0) 3493 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:02.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:01 smithi050 bash[21866]: audit 2024-05-20T22:24:00.837798+0000 mon.a (mon.0) 3491 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:24:02.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:01 smithi050 bash[21866]: cluster 2024-05-20T22:24:00.847752+0000 mon.a (mon.0) 3492 : cluster 0 osdmap e699: 8 total, 8 up, 8 in 2024-05-20T22:24:02.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:01 smithi050 bash[21866]: audit 2024-05-20T22:24:00.851739+0000 mon.c (mon.2) 470 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:02.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:01 smithi050 bash[21866]: audit 2024-05-20T22:24:00.860066+0000 mon.a (mon.0) 3493 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:02.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:01 smithi050 bash[28929]: audit 2024-05-20T22:24:00.837798+0000 mon.a (mon.0) 3491 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:24:02.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:01 smithi050 bash[28929]: cluster 2024-05-20T22:24:00.847752+0000 mon.a (mon.0) 3492 : cluster 0 osdmap e699: 8 total, 8 up, 8 in 2024-05-20T22:24:02.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:01 smithi050 bash[28929]: audit 2024-05-20T22:24:00.851739+0000 mon.c (mon.2) 470 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:02.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:01 smithi050 bash[28929]: audit 2024-05-20T22:24:00.860066+0000 mon.a (mon.0) 3493 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:03.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:02 smithi145 bash[23893]: audit 2024-05-20T22:24:01.840803+0000 mon.a (mon.0) 3494 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-140", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:24:03.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:02 smithi145 bash[23893]: cluster 2024-05-20T22:24:01.848569+0000 mon.a (mon.0) 3495 : cluster 0 osdmap e700: 8 total, 8 up, 8 in 2024-05-20T22:24:03.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:02 smithi145 bash[23893]: audit 2024-05-20T22:24:01.854789+0000 mon.c (mon.2) 471 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_count","val": "3"}]: dispatch 2024-05-20T22:24:03.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:02 smithi145 bash[23893]: audit 2024-05-20T22:24:01.865251+0000 mon.a (mon.0) 3496 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_count","val": "3"}]: dispatch 2024-05-20T22:24:03.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:02 smithi145 bash[23893]: cluster 2024-05-20T22:24:02.591913+0000 mgr.y (mgr.14592) 678 : cluster 0 pgmap v1135: 364 pgs: 32 creating+peering, 332 active+clean; 4.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:24:03.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:02 smithi050 bash[21866]: audit 2024-05-20T22:24:01.840803+0000 mon.a (mon.0) 3494 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-140", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:24:03.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:02 smithi050 bash[21866]: cluster 2024-05-20T22:24:01.848569+0000 mon.a (mon.0) 3495 : cluster 0 osdmap e700: 8 total, 8 up, 8 in 2024-05-20T22:24:03.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:02 smithi050 bash[21866]: audit 2024-05-20T22:24:01.854789+0000 mon.c (mon.2) 471 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_count","val": "3"}]: dispatch 2024-05-20T22:24:03.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:02 smithi050 bash[21866]: audit 2024-05-20T22:24:01.865251+0000 mon.a (mon.0) 3496 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_count","val": "3"}]: dispatch 2024-05-20T22:24:03.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:02 smithi050 bash[21866]: cluster 2024-05-20T22:24:02.591913+0000 mgr.y (mgr.14592) 678 : cluster 0 pgmap v1135: 364 pgs: 32 creating+peering, 332 active+clean; 4.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:24:03.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:02 smithi050 bash[28929]: audit 2024-05-20T22:24:01.840803+0000 mon.a (mon.0) 3494 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-140", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:24:03.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:02 smithi050 bash[28929]: cluster 2024-05-20T22:24:01.848569+0000 mon.a (mon.0) 3495 : cluster 0 osdmap e700: 8 total, 8 up, 8 in 2024-05-20T22:24:03.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:02 smithi050 bash[28929]: audit 2024-05-20T22:24:01.854789+0000 mon.c (mon.2) 471 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_count","val": "3"}]: dispatch 2024-05-20T22:24:03.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:02 smithi050 bash[28929]: audit 2024-05-20T22:24:01.865251+0000 mon.a (mon.0) 3496 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_count","val": "3"}]: dispatch 2024-05-20T22:24:03.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:02 smithi050 bash[28929]: cluster 2024-05-20T22:24:02.591913+0000 mgr.y (mgr.14592) 678 : cluster 0 pgmap v1135: 364 pgs: 32 creating+peering, 332 active+clean; 4.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:24:04.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:03 smithi145 bash[23893]: audit 2024-05-20T22:24:02.864559+0000 mon.a (mon.0) 3497 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_count","val": "3"}]': finished 2024-05-20T22:24:04.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:03 smithi145 bash[23893]: cluster 2024-05-20T22:24:02.873762+0000 mon.a (mon.0) 3498 : cluster 0 osdmap e701: 8 total, 8 up, 8 in 2024-05-20T22:24:04.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:03 smithi145 bash[23893]: audit 2024-05-20T22:24:02.877465+0000 mon.c (mon.2) 472 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_period","val": "3"}]: dispatch 2024-05-20T22:24:04.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:03 smithi145 bash[23893]: audit 2024-05-20T22:24:02.878452+0000 mon.a (mon.0) 3499 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_period","val": "3"}]: dispatch 2024-05-20T22:24:04.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:03 smithi050 bash[21866]: audit 2024-05-20T22:24:02.864559+0000 mon.a (mon.0) 3497 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_count","val": "3"}]': finished 2024-05-20T22:24:04.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:03 smithi050 bash[21866]: cluster 2024-05-20T22:24:02.873762+0000 mon.a (mon.0) 3498 : cluster 0 osdmap e701: 8 total, 8 up, 8 in 2024-05-20T22:24:04.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:03 smithi050 bash[21866]: audit 2024-05-20T22:24:02.877465+0000 mon.c (mon.2) 472 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_period","val": "3"}]: dispatch 2024-05-20T22:24:04.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:03 smithi050 bash[21866]: audit 2024-05-20T22:24:02.878452+0000 mon.a (mon.0) 3499 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_period","val": "3"}]: dispatch 2024-05-20T22:24:04.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:03 smithi050 bash[28929]: audit 2024-05-20T22:24:02.864559+0000 mon.a (mon.0) 3497 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_count","val": "3"}]': finished 2024-05-20T22:24:04.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:03 smithi050 bash[28929]: cluster 2024-05-20T22:24:02.873762+0000 mon.a (mon.0) 3498 : cluster 0 osdmap e701: 8 total, 8 up, 8 in 2024-05-20T22:24:04.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:03 smithi050 bash[28929]: audit 2024-05-20T22:24:02.877465+0000 mon.c (mon.2) 472 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_period","val": "3"}]: dispatch 2024-05-20T22:24:04.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:03 smithi050 bash[28929]: audit 2024-05-20T22:24:02.878452+0000 mon.a (mon.0) 3499 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_period","val": "3"}]: dispatch 2024-05-20T22:24:05.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:04 smithi145 bash[23893]: audit 2024-05-20T22:24:03.875076+0000 mon.a (mon.0) 3500 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_period","val": "3"}]': finished 2024-05-20T22:24:05.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:04 smithi145 bash[23893]: cluster 2024-05-20T22:24:03.882481+0000 mon.a (mon.0) 3501 : cluster 0 osdmap e702: 8 total, 8 up, 8 in 2024-05-20T22:24:05.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:04 smithi145 bash[23893]: audit 2024-05-20T22:24:03.883602+0000 mon.c (mon.2) 473 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:24:05.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:04 smithi145 bash[23893]: audit 2024-05-20T22:24:03.885818+0000 mon.a (mon.0) 3502 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:24:05.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:04 smithi145 bash[23893]: cluster 2024-05-20T22:24:04.592907+0000 mgr.y (mgr.14592) 679 : cluster 0 pgmap v1138: 364 pgs: 32 creating+peering, 332 active+clean; 4.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:24:05.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:04 smithi050 bash[21866]: audit 2024-05-20T22:24:03.875076+0000 mon.a (mon.0) 3500 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_period","val": "3"}]': finished 2024-05-20T22:24:05.241 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:04 smithi050 bash[21866]: cluster 2024-05-20T22:24:03.882481+0000 mon.a (mon.0) 3501 : cluster 0 osdmap e702: 8 total, 8 up, 8 in 2024-05-20T22:24:05.241 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:04 smithi050 bash[21866]: audit 2024-05-20T22:24:03.883602+0000 mon.c (mon.2) 473 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:24:05.241 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:04 smithi050 bash[21866]: audit 2024-05-20T22:24:03.885818+0000 mon.a (mon.0) 3502 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:24:05.241 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:04 smithi050 bash[21866]: cluster 2024-05-20T22:24:04.592907+0000 mgr.y (mgr.14592) 679 : cluster 0 pgmap v1138: 364 pgs: 32 creating+peering, 332 active+clean; 4.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:24:05.241 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:04 smithi050 bash[28929]: audit 2024-05-20T22:24:03.875076+0000 mon.a (mon.0) 3500 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_period","val": "3"}]': finished 2024-05-20T22:24:05.241 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:04 smithi050 bash[28929]: cluster 2024-05-20T22:24:03.882481+0000 mon.a (mon.0) 3501 : cluster 0 osdmap e702: 8 total, 8 up, 8 in 2024-05-20T22:24:05.242 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:04 smithi050 bash[28929]: audit 2024-05-20T22:24:03.883602+0000 mon.c (mon.2) 473 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:24:05.242 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:04 smithi050 bash[28929]: audit 2024-05-20T22:24:03.885818+0000 mon.a (mon.0) 3502 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:24:05.242 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:04 smithi050 bash[28929]: cluster 2024-05-20T22:24:04.592907+0000 mgr.y (mgr.14592) 679 : cluster 0 pgmap v1138: 364 pgs: 32 creating+peering, 332 active+clean; 4.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:24:06.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:05 smithi050 bash[21866]: audit 2024-05-20T22:24:04.883654+0000 mon.a (mon.0) 3503 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:24:06.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:05 smithi050 bash[21866]: cluster 2024-05-20T22:24:04.893411+0000 mon.a (mon.0) 3504 : cluster 0 osdmap e703: 8 total, 8 up, 8 in 2024-05-20T22:24:06.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:05 smithi050 bash[21866]: audit 2024-05-20T22:24:04.894508+0000 mon.c (mon.2) 474 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-05-20T22:24:06.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:05 smithi050 bash[21866]: audit 2024-05-20T22:24:04.895413+0000 mon.a (mon.0) 3505 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-05-20T22:24:06.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:05 smithi050 bash[21866]: cluster 2024-05-20T22:24:05.613938+0000 mon.a (mon.0) 3506 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:24:06.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:05 smithi050 bash[28929]: audit 2024-05-20T22:24:04.883654+0000 mon.a (mon.0) 3503 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:24:06.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:05 smithi050 bash[28929]: cluster 2024-05-20T22:24:04.893411+0000 mon.a (mon.0) 3504 : cluster 0 osdmap e703: 8 total, 8 up, 8 in 2024-05-20T22:24:06.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:05 smithi050 bash[28929]: audit 2024-05-20T22:24:04.894508+0000 mon.c (mon.2) 474 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-05-20T22:24:06.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:05 smithi050 bash[28929]: audit 2024-05-20T22:24:04.895413+0000 mon.a (mon.0) 3505 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-05-20T22:24:06.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:05 smithi050 bash[28929]: cluster 2024-05-20T22:24:05.613938+0000 mon.a (mon.0) 3506 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:24:06.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:05 smithi145 bash[23893]: audit 2024-05-20T22:24:04.883654+0000 mon.a (mon.0) 3503 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:24:06.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:05 smithi145 bash[23893]: cluster 2024-05-20T22:24:04.893411+0000 mon.a (mon.0) 3504 : cluster 0 osdmap e703: 8 total, 8 up, 8 in 2024-05-20T22:24:06.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:05 smithi145 bash[23893]: audit 2024-05-20T22:24:04.894508+0000 mon.c (mon.2) 474 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-05-20T22:24:06.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:05 smithi145 bash[23893]: audit 2024-05-20T22:24:04.895413+0000 mon.a (mon.0) 3505 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-05-20T22:24:06.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:05 smithi145 bash[23893]: cluster 2024-05-20T22:24:05.613938+0000 mon.a (mon.0) 3506 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:24:07.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:06 smithi050 bash[21866]: audit 2024-05-20T22:24:05.886544+0000 mon.a (mon.0) 3507 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-05-20T22:24:07.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:06 smithi050 bash[21866]: cluster 2024-05-20T22:24:05.895085+0000 mon.a (mon.0) 3508 : cluster 0 osdmap e704: 8 total, 8 up, 8 in 2024-05-20T22:24:07.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:06 smithi050 bash[21866]: cluster 2024-05-20T22:24:06.593853+0000 mgr.y (mgr.14592) 680 : cluster 0 pgmap v1141: 364 pgs: 364 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:24:07.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:06 smithi050 bash[28929]: audit 2024-05-20T22:24:05.886544+0000 mon.a (mon.0) 3507 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-05-20T22:24:07.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:06 smithi050 bash[28929]: cluster 2024-05-20T22:24:05.895085+0000 mon.a (mon.0) 3508 : cluster 0 osdmap e704: 8 total, 8 up, 8 in 2024-05-20T22:24:07.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:06 smithi050 bash[28929]: cluster 2024-05-20T22:24:06.593853+0000 mgr.y (mgr.14592) 680 : cluster 0 pgmap v1141: 364 pgs: 364 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:24:07.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:06 smithi145 bash[23893]: audit 2024-05-20T22:24:05.886544+0000 mon.a (mon.0) 3507 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-05-20T22:24:07.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:06 smithi145 bash[23893]: cluster 2024-05-20T22:24:05.895085+0000 mon.a (mon.0) 3508 : cluster 0 osdmap e704: 8 total, 8 up, 8 in 2024-05-20T22:24:07.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:06 smithi145 bash[23893]: cluster 2024-05-20T22:24:06.593853+0000 mgr.y (mgr.14592) 680 : cluster 0 pgmap v1141: 364 pgs: 364 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:24:08.889 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:24:08 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:24:09.645 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:24:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:24:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:24:09.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:09 smithi050 bash[21866]: audit 2024-05-20T22:24:08.398733+0000 mgr.y (mgr.14592) 681 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:24:09.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:09 smithi050 bash[21866]: cluster 2024-05-20T22:24:08.594918+0000 mgr.y (mgr.14592) 682 : cluster 0 pgmap v1142: 364 pgs: 364 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 893 B/s rd, 0 op/s 2024-05-20T22:24:09.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:09 smithi050 bash[21866]: audit 2024-05-20T22:24:08.766754+0000 mon.a (mon.0) 3509 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:24:09.942 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:09 smithi050 bash[28929]: audit 2024-05-20T22:24:08.398733+0000 mgr.y (mgr.14592) 681 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:24:09.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:09 smithi050 bash[28929]: cluster 2024-05-20T22:24:08.594918+0000 mgr.y (mgr.14592) 682 : cluster 0 pgmap v1142: 364 pgs: 364 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 893 B/s rd, 0 op/s 2024-05-20T22:24:09.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:09 smithi050 bash[28929]: audit 2024-05-20T22:24:08.766754+0000 mon.a (mon.0) 3509 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:24:10.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:09 smithi145 bash[23893]: audit 2024-05-20T22:24:08.398733+0000 mgr.y (mgr.14592) 681 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:24:10.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:09 smithi145 bash[23893]: cluster 2024-05-20T22:24:08.594918+0000 mgr.y (mgr.14592) 682 : cluster 0 pgmap v1142: 364 pgs: 364 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 893 B/s rd, 0 op/s 2024-05-20T22:24:10.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:09 smithi145 bash[23893]: audit 2024-05-20T22:24:08.766754+0000 mon.a (mon.0) 3509 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:24:11.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:11 smithi050 bash[21866]: cluster 2024-05-20T22:24:10.598205+0000 mgr.y (mgr.14592) 683 : cluster 0 pgmap v1143: 364 pgs: 364 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 6.1 KiB/s wr, 2 op/s 2024-05-20T22:24:11.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:11 smithi050 bash[28929]: cluster 2024-05-20T22:24:10.598205+0000 mgr.y (mgr.14592) 683 : cluster 0 pgmap v1143: 364 pgs: 364 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 6.1 KiB/s wr, 2 op/s 2024-05-20T22:24:12.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:11 smithi145 bash[23893]: cluster 2024-05-20T22:24:10.598205+0000 mgr.y (mgr.14592) 683 : cluster 0 pgmap v1143: 364 pgs: 364 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 6.1 KiB/s wr, 2 op/s 2024-05-20T22:24:13.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:13 smithi050 bash[21866]: cluster 2024-05-20T22:24:12.599211+0000 mgr.y (mgr.14592) 684 : cluster 0 pgmap v1144: 364 pgs: 364 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.1 KiB/s wr, 1 op/s 2024-05-20T22:24:13.942 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:13 smithi050 bash[28929]: cluster 2024-05-20T22:24:12.599211+0000 mgr.y (mgr.14592) 684 : cluster 0 pgmap v1144: 364 pgs: 364 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.1 KiB/s wr, 1 op/s 2024-05-20T22:24:14.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:13 smithi145 bash[23893]: cluster 2024-05-20T22:24:12.599211+0000 mgr.y (mgr.14592) 684 : cluster 0 pgmap v1144: 364 pgs: 364 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.1 KiB/s wr, 1 op/s 2024-05-20T22:24:15.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:15 smithi050 bash[21866]: cluster 2024-05-20T22:24:14.600196+0000 mgr.y (mgr.14592) 685 : cluster 0 pgmap v1145: 364 pgs: 364 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 4.2 KiB/s wr, 1 op/s 2024-05-20T22:24:15.942 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:15 smithi050 bash[28929]: cluster 2024-05-20T22:24:14.600196+0000 mgr.y (mgr.14592) 685 : cluster 0 pgmap v1145: 364 pgs: 364 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 4.2 KiB/s wr, 1 op/s 2024-05-20T22:24:16.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:15 smithi145 bash[23893]: cluster 2024-05-20T22:24:14.600196+0000 mgr.y (mgr.14592) 685 : cluster 0 pgmap v1145: 364 pgs: 364 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 4.2 KiB/s wr, 1 op/s 2024-05-20T22:24:17.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:17 smithi050 bash[21866]: cluster 2024-05-20T22:24:16.603425+0000 mgr.y (mgr.14592) 686 : cluster 0 pgmap v1146: 364 pgs: 364 active+clean; 4.5 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 955 B/s rd, 7.7 KiB/s wr, 2 op/s 2024-05-20T22:24:17.942 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:17 smithi050 bash[28929]: cluster 2024-05-20T22:24:16.603425+0000 mgr.y (mgr.14592) 686 : cluster 0 pgmap v1146: 364 pgs: 364 active+clean; 4.5 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 955 B/s rd, 7.7 KiB/s wr, 2 op/s 2024-05-20T22:24:18.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:17 smithi145 bash[23893]: cluster 2024-05-20T22:24:16.603425+0000 mgr.y (mgr.14592) 686 : cluster 0 pgmap v1146: 364 pgs: 364 active+clean; 4.5 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 955 B/s rd, 7.7 KiB/s wr, 2 op/s 2024-05-20T22:24:18.673 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:24:18 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:24:18.942 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:18 smithi050 bash[28929]: audit 2024-05-20T22:24:18.001727+0000 mon.c (mon.2) 475 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:18.942 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:18 smithi050 bash[28929]: audit 2024-05-20T22:24:18.002379+0000 mon.a (mon.0) 3510 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:18.942 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:18 smithi050 bash[28929]: audit 2024-05-20T22:24:18.003525+0000 mon.c (mon.2) 476 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-140"}]: dispatch 2024-05-20T22:24:18.946 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:18 smithi050 bash[28929]: audit 2024-05-20T22:24:18.004126+0000 mon.a (mon.0) 3511 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-140"}]: dispatch 2024-05-20T22:24:18.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:18 smithi050 bash[21866]: audit 2024-05-20T22:24:18.001727+0000 mon.c (mon.2) 475 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:18.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:18 smithi050 bash[21866]: audit 2024-05-20T22:24:18.002379+0000 mon.a (mon.0) 3510 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:18.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:18 smithi050 bash[21866]: audit 2024-05-20T22:24:18.003525+0000 mon.c (mon.2) 476 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-140"}]: dispatch 2024-05-20T22:24:18.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:18 smithi050 bash[21866]: audit 2024-05-20T22:24:18.004126+0000 mon.a (mon.0) 3511 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-140"}]: dispatch 2024-05-20T22:24:19.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:18 smithi145 bash[23893]: audit 2024-05-20T22:24:18.001727+0000 mon.c (mon.2) 475 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:19.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:18 smithi145 bash[23893]: audit 2024-05-20T22:24:18.002379+0000 mon.a (mon.0) 3510 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:19.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:18 smithi145 bash[23893]: audit 2024-05-20T22:24:18.003525+0000 mon.c (mon.2) 476 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-140"}]: dispatch 2024-05-20T22:24:19.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:18 smithi145 bash[23893]: audit 2024-05-20T22:24:18.004126+0000 mon.a (mon.0) 3511 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-140"}]: dispatch 2024-05-20T22:24:19.692 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:24:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:24:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:24:20.442 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:20 smithi050 bash[21866]: audit 2024-05-20T22:24:18.410229+0000 mgr.y (mgr.14592) 687 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:24:20.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:20 smithi050 bash[21866]: cluster 2024-05-20T22:24:18.604426+0000 mgr.y (mgr.14592) 688 : cluster 0 pgmap v1147: 364 pgs: 364 active+clean; 4.5 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 6.9 KiB/s wr, 1 op/s 2024-05-20T22:24:20.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:20 smithi050 bash[21866]: audit 2024-05-20T22:24:18.677844+0000 mon.a (mon.0) 3512 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-140"}]': finished 2024-05-20T22:24:20.443 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:20 smithi050 bash[21866]: cluster 2024-05-20T22:24:18.686889+0000 mon.a (mon.0) 3513 : cluster 0 osdmap e705: 8 total, 8 up, 8 in 2024-05-20T22:24:20.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:20 smithi050 bash[28929]: audit 2024-05-20T22:24:18.410229+0000 mgr.y (mgr.14592) 687 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:24:20.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:20 smithi050 bash[28929]: cluster 2024-05-20T22:24:18.604426+0000 mgr.y (mgr.14592) 688 : cluster 0 pgmap v1147: 364 pgs: 364 active+clean; 4.5 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 6.9 KiB/s wr, 1 op/s 2024-05-20T22:24:20.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:20 smithi050 bash[28929]: audit 2024-05-20T22:24:18.677844+0000 mon.a (mon.0) 3512 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-140"}]': finished 2024-05-20T22:24:20.444 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:20 smithi050 bash[28929]: cluster 2024-05-20T22:24:18.686889+0000 mon.a (mon.0) 3513 : cluster 0 osdmap e705: 8 total, 8 up, 8 in 2024-05-20T22:24:20.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:20 smithi145 bash[23893]: audit 2024-05-20T22:24:18.410229+0000 mgr.y (mgr.14592) 687 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:24:20.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:20 smithi145 bash[23893]: cluster 2024-05-20T22:24:18.604426+0000 mgr.y (mgr.14592) 688 : cluster 0 pgmap v1147: 364 pgs: 364 active+clean; 4.5 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 6.9 KiB/s wr, 1 op/s 2024-05-20T22:24:20.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:20 smithi145 bash[23893]: audit 2024-05-20T22:24:18.677844+0000 mon.a (mon.0) 3512 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-140"}]': finished 2024-05-20T22:24:20.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:20 smithi145 bash[23893]: cluster 2024-05-20T22:24:18.686889+0000 mon.a (mon.0) 3513 : cluster 0 osdmap e705: 8 total, 8 up, 8 in 2024-05-20T22:24:21.442 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:21 smithi050 bash[21866]: cluster 2024-05-20T22:24:19.690501+0000 mon.a (mon.0) 3514 : cluster 0 osdmap e706: 8 total, 8 up, 8 in 2024-05-20T22:24:21.442 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:21 smithi050 bash[21866]: cluster 2024-05-20T22:24:20.607766+0000 mgr.y (mgr.14592) 689 : cluster 0 pgmap v1150: 332 pgs: 332 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:24:21.442 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:21 smithi050 bash[21866]: cluster 2024-05-20T22:24:20.691105+0000 mon.a (mon.0) 3515 : cluster 0 osdmap e707: 8 total, 8 up, 8 in 2024-05-20T22:24:21.442 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:21 smithi050 bash[21866]: audit 2024-05-20T22:24:20.694245+0000 mon.c (mon.2) 477 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:21.442 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:21 smithi050 bash[21866]: audit 2024-05-20T22:24:20.695992+0000 mon.a (mon.0) 3516 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:21.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:21 smithi050 bash[28929]: cluster 2024-05-20T22:24:19.690501+0000 mon.a (mon.0) 3514 : cluster 0 osdmap e706: 8 total, 8 up, 8 in 2024-05-20T22:24:21.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:21 smithi050 bash[28929]: cluster 2024-05-20T22:24:20.607766+0000 mgr.y (mgr.14592) 689 : cluster 0 pgmap v1150: 332 pgs: 332 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:24:21.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:21 smithi050 bash[28929]: cluster 2024-05-20T22:24:20.691105+0000 mon.a (mon.0) 3515 : cluster 0 osdmap e707: 8 total, 8 up, 8 in 2024-05-20T22:24:21.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:21 smithi050 bash[28929]: audit 2024-05-20T22:24:20.694245+0000 mon.c (mon.2) 477 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:21.443 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:21 smithi050 bash[28929]: audit 2024-05-20T22:24:20.695992+0000 mon.a (mon.0) 3516 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:21.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:21 smithi145 bash[23893]: cluster 2024-05-20T22:24:19.690501+0000 mon.a (mon.0) 3514 : cluster 0 osdmap e706: 8 total, 8 up, 8 in 2024-05-20T22:24:21.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:21 smithi145 bash[23893]: cluster 2024-05-20T22:24:20.607766+0000 mgr.y (mgr.14592) 689 : cluster 0 pgmap v1150: 332 pgs: 332 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:24:21.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:21 smithi145 bash[23893]: cluster 2024-05-20T22:24:20.691105+0000 mon.a (mon.0) 3515 : cluster 0 osdmap e707: 8 total, 8 up, 8 in 2024-05-20T22:24:21.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:21 smithi145 bash[23893]: audit 2024-05-20T22:24:20.694245+0000 mon.c (mon.2) 477 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:21.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:21 smithi145 bash[23893]: audit 2024-05-20T22:24:20.695992+0000 mon.a (mon.0) 3516 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:22.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:22 smithi050 bash[21866]: audit 2024-05-20T22:24:21.687018+0000 mon.a (mon.0) 3517 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:24:22.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:22 smithi050 bash[21866]: cluster 2024-05-20T22:24:21.695506+0000 mon.a (mon.0) 3518 : cluster 0 osdmap e708: 8 total, 8 up, 8 in 2024-05-20T22:24:22.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:22 smithi050 bash[21866]: audit 2024-05-20T22:24:21.800409+0000 mon.c (mon.2) 478 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:22.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:22 smithi050 bash[21866]: audit 2024-05-20T22:24:21.801015+0000 mon.a (mon.0) 3519 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:22.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:22 smithi050 bash[28929]: audit 2024-05-20T22:24:21.687018+0000 mon.a (mon.0) 3517 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:24:22.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:22 smithi050 bash[28929]: cluster 2024-05-20T22:24:21.695506+0000 mon.a (mon.0) 3518 : cluster 0 osdmap e708: 8 total, 8 up, 8 in 2024-05-20T22:24:22.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:22 smithi050 bash[28929]: audit 2024-05-20T22:24:21.800409+0000 mon.c (mon.2) 478 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:22.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:22 smithi050 bash[28929]: audit 2024-05-20T22:24:21.801015+0000 mon.a (mon.0) 3519 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:23.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:22 smithi145 bash[23893]: audit 2024-05-20T22:24:21.687018+0000 mon.a (mon.0) 3517 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:24:23.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:22 smithi145 bash[23893]: cluster 2024-05-20T22:24:21.695506+0000 mon.a (mon.0) 3518 : cluster 0 osdmap e708: 8 total, 8 up, 8 in 2024-05-20T22:24:23.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:22 smithi145 bash[23893]: audit 2024-05-20T22:24:21.800409+0000 mon.c (mon.2) 478 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:23.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:22 smithi145 bash[23893]: audit 2024-05-20T22:24:21.801015+0000 mon.a (mon.0) 3519 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:24.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:23 smithi145 bash[23893]: cluster 2024-05-20T22:24:22.608831+0000 mgr.y (mgr.14592) 690 : cluster 0 pgmap v1153: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:24:24.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:23 smithi145 bash[23893]: audit 2024-05-20T22:24:22.696558+0000 mon.a (mon.0) 3520 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:24:24.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:23 smithi145 bash[23893]: cluster 2024-05-20T22:24:22.705333+0000 mon.a (mon.0) 3521 : cluster 0 osdmap e709: 8 total, 8 up, 8 in 2024-05-20T22:24:24.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:23 smithi145 bash[23893]: audit 2024-05-20T22:24:22.709100+0000 mon.c (mon.2) 479 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-142"}]: dispatch 2024-05-20T22:24:24.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:23 smithi145 bash[23893]: audit 2024-05-20T22:24:22.710043+0000 mon.a (mon.0) 3522 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-142"}]: dispatch 2024-05-20T22:24:24.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:23 smithi050 bash[21866]: cluster 2024-05-20T22:24:22.608831+0000 mgr.y (mgr.14592) 690 : cluster 0 pgmap v1153: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:24:24.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:23 smithi050 bash[21866]: audit 2024-05-20T22:24:22.696558+0000 mon.a (mon.0) 3520 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:24:24.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:23 smithi050 bash[21866]: cluster 2024-05-20T22:24:22.705333+0000 mon.a (mon.0) 3521 : cluster 0 osdmap e709: 8 total, 8 up, 8 in 2024-05-20T22:24:24.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:23 smithi050 bash[21866]: audit 2024-05-20T22:24:22.709100+0000 mon.c (mon.2) 479 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-142"}]: dispatch 2024-05-20T22:24:24.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:23 smithi050 bash[21866]: audit 2024-05-20T22:24:22.710043+0000 mon.a (mon.0) 3522 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-142"}]: dispatch 2024-05-20T22:24:24.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:23 smithi050 bash[28929]: cluster 2024-05-20T22:24:22.608831+0000 mgr.y (mgr.14592) 690 : cluster 0 pgmap v1153: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:24:24.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:23 smithi050 bash[28929]: audit 2024-05-20T22:24:22.696558+0000 mon.a (mon.0) 3520 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:24:24.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:23 smithi050 bash[28929]: cluster 2024-05-20T22:24:22.705333+0000 mon.a (mon.0) 3521 : cluster 0 osdmap e709: 8 total, 8 up, 8 in 2024-05-20T22:24:24.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:23 smithi050 bash[28929]: audit 2024-05-20T22:24:22.709100+0000 mon.c (mon.2) 479 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-142"}]: dispatch 2024-05-20T22:24:24.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:23 smithi050 bash[28929]: audit 2024-05-20T22:24:22.710043+0000 mon.a (mon.0) 3522 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-142"}]: dispatch 2024-05-20T22:24:25.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:24 smithi145 bash[23893]: audit 2024-05-20T22:24:23.699262+0000 mon.a (mon.0) 3523 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-142"}]': finished 2024-05-20T22:24:25.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:24 smithi145 bash[23893]: cluster 2024-05-20T22:24:23.706642+0000 mon.a (mon.0) 3524 : cluster 0 osdmap e710: 8 total, 8 up, 8 in 2024-05-20T22:24:25.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:24 smithi145 bash[23893]: audit 2024-05-20T22:24:23.708823+0000 mon.c (mon.2) 480 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-142", "mode": "writeback"}]: dispatch 2024-05-20T22:24:25.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:24 smithi145 bash[23893]: audit 2024-05-20T22:24:23.709703+0000 mon.a (mon.0) 3525 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-142", "mode": "writeback"}]: dispatch 2024-05-20T22:24:25.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:24 smithi145 bash[23893]: audit 2024-05-20T22:24:23.815961+0000 mon.a (mon.0) 3526 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:24:25.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:24 smithi145 bash[23893]: cluster 2024-05-20T22:24:24.699626+0000 mon.a (mon.0) 3527 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:24:25.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:24 smithi145 bash[23893]: audit 2024-05-20T22:24:24.701872+0000 mon.a (mon.0) 3528 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-142", "mode": "writeback"}]': finished 2024-05-20T22:24:25.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:24 smithi145 bash[23893]: cluster 2024-05-20T22:24:24.709835+0000 mon.a (mon.0) 3529 : cluster 0 osdmap e711: 8 total, 8 up, 8 in 2024-05-20T22:24:25.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:24 smithi145 bash[23893]: audit 2024-05-20T22:24:24.711525+0000 mon.c (mon.2) 481 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:24:25.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:24 smithi050 bash[28929]: audit 2024-05-20T22:24:23.699262+0000 mon.a (mon.0) 3523 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-142"}]': finished 2024-05-20T22:24:25.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:24 smithi050 bash[28929]: cluster 2024-05-20T22:24:23.706642+0000 mon.a (mon.0) 3524 : cluster 0 osdmap e710: 8 total, 8 up, 8 in 2024-05-20T22:24:25.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:24 smithi050 bash[28929]: audit 2024-05-20T22:24:23.708823+0000 mon.c (mon.2) 480 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-142", "mode": "writeback"}]: dispatch 2024-05-20T22:24:25.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:24 smithi050 bash[28929]: audit 2024-05-20T22:24:23.709703+0000 mon.a (mon.0) 3525 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-142", "mode": "writeback"}]: dispatch 2024-05-20T22:24:25.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:24 smithi050 bash[28929]: audit 2024-05-20T22:24:23.815961+0000 mon.a (mon.0) 3526 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:24:25.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:24 smithi050 bash[28929]: cluster 2024-05-20T22:24:24.699626+0000 mon.a (mon.0) 3527 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:24:25.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:24 smithi050 bash[28929]: audit 2024-05-20T22:24:24.701872+0000 mon.a (mon.0) 3528 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-142", "mode": "writeback"}]': finished 2024-05-20T22:24:25.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:24 smithi050 bash[28929]: cluster 2024-05-20T22:24:24.709835+0000 mon.a (mon.0) 3529 : cluster 0 osdmap e711: 8 total, 8 up, 8 in 2024-05-20T22:24:25.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:24 smithi050 bash[28929]: audit 2024-05-20T22:24:24.711525+0000 mon.c (mon.2) 481 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:24:25.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:24 smithi050 bash[21866]: audit 2024-05-20T22:24:23.699262+0000 mon.a (mon.0) 3523 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-142"}]': finished 2024-05-20T22:24:25.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:24 smithi050 bash[21866]: cluster 2024-05-20T22:24:23.706642+0000 mon.a (mon.0) 3524 : cluster 0 osdmap e710: 8 total, 8 up, 8 in 2024-05-20T22:24:25.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:24 smithi050 bash[21866]: audit 2024-05-20T22:24:23.708823+0000 mon.c (mon.2) 480 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-142", "mode": "writeback"}]: dispatch 2024-05-20T22:24:25.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:24 smithi050 bash[21866]: audit 2024-05-20T22:24:23.709703+0000 mon.a (mon.0) 3525 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-142", "mode": "writeback"}]: dispatch 2024-05-20T22:24:25.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:24 smithi050 bash[21866]: audit 2024-05-20T22:24:23.815961+0000 mon.a (mon.0) 3526 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:24:25.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:24 smithi050 bash[21866]: cluster 2024-05-20T22:24:24.699626+0000 mon.a (mon.0) 3527 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:24:25.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:24 smithi050 bash[21866]: audit 2024-05-20T22:24:24.701872+0000 mon.a (mon.0) 3528 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-142", "mode": "writeback"}]': finished 2024-05-20T22:24:25.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:24 smithi050 bash[21866]: cluster 2024-05-20T22:24:24.709835+0000 mon.a (mon.0) 3529 : cluster 0 osdmap e711: 8 total, 8 up, 8 in 2024-05-20T22:24:25.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:24 smithi050 bash[21866]: audit 2024-05-20T22:24:24.711525+0000 mon.c (mon.2) 481 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:24:26.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:25 smithi145 bash[23893]: cluster 2024-05-20T22:24:24.609815+0000 mgr.y (mgr.14592) 691 : cluster 0 pgmap v1156: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:24:26.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:25 smithi145 bash[23893]: audit 2024-05-20T22:24:24.712895+0000 mon.a (mon.0) 3530 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:24:26.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:25 smithi145 bash[23893]: audit 2024-05-20T22:24:25.704633+0000 mon.a (mon.0) 3531 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:24:26.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:25 smithi145 bash[23893]: cluster 2024-05-20T22:24:25.712001+0000 mon.a (mon.0) 3532 : cluster 0 osdmap e712: 8 total, 8 up, 8 in 2024-05-20T22:24:26.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:25 smithi145 bash[23893]: audit 2024-05-20T22:24:25.713440+0000 mon.c (mon.2) 482 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:24:26.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:25 smithi145 bash[23893]: audit 2024-05-20T22:24:25.720437+0000 mon.a (mon.0) 3533 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:24:26.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:25 smithi050 bash[21866]: cluster 2024-05-20T22:24:24.609815+0000 mgr.y (mgr.14592) 691 : cluster 0 pgmap v1156: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:24:26.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:25 smithi050 bash[21866]: audit 2024-05-20T22:24:24.712895+0000 mon.a (mon.0) 3530 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:24:26.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:25 smithi050 bash[21866]: audit 2024-05-20T22:24:25.704633+0000 mon.a (mon.0) 3531 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:24:26.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:25 smithi050 bash[21866]: cluster 2024-05-20T22:24:25.712001+0000 mon.a (mon.0) 3532 : cluster 0 osdmap e712: 8 total, 8 up, 8 in 2024-05-20T22:24:26.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:25 smithi050 bash[21866]: audit 2024-05-20T22:24:25.713440+0000 mon.c (mon.2) 482 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:24:26.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:25 smithi050 bash[21866]: audit 2024-05-20T22:24:25.720437+0000 mon.a (mon.0) 3533 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:24:26.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:25 smithi050 bash[28929]: cluster 2024-05-20T22:24:24.609815+0000 mgr.y (mgr.14592) 691 : cluster 0 pgmap v1156: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 688 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:24:26.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:25 smithi050 bash[28929]: audit 2024-05-20T22:24:24.712895+0000 mon.a (mon.0) 3530 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:24:26.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:25 smithi050 bash[28929]: audit 2024-05-20T22:24:25.704633+0000 mon.a (mon.0) 3531 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:24:26.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:25 smithi050 bash[28929]: cluster 2024-05-20T22:24:25.712001+0000 mon.a (mon.0) 3532 : cluster 0 osdmap e712: 8 total, 8 up, 8 in 2024-05-20T22:24:26.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:25 smithi050 bash[28929]: audit 2024-05-20T22:24:25.713440+0000 mon.c (mon.2) 482 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:24:26.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:25 smithi050 bash[28929]: audit 2024-05-20T22:24:25.720437+0000 mon.a (mon.0) 3533 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:24:28.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:27 smithi145 bash[23893]: cluster 2024-05-20T22:24:26.610797+0000 mgr.y (mgr.14592) 692 : cluster 0 pgmap v1159: 364 pgs: 364 active+clean; 4.4 MiB data, 693 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-05-20T22:24:28.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:27 smithi145 bash[23893]: audit 2024-05-20T22:24:26.707882+0000 mon.a (mon.0) 3534 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:24:28.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:27 smithi145 bash[23893]: cluster 2024-05-20T22:24:26.715746+0000 mon.a (mon.0) 3535 : cluster 0 osdmap e713: 8 total, 8 up, 8 in 2024-05-20T22:24:28.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:27 smithi145 bash[23893]: audit 2024-05-20T22:24:26.717292+0000 mon.c (mon.2) 483 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:24:28.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:27 smithi145 bash[23893]: audit 2024-05-20T22:24:26.726118+0000 mon.a (mon.0) 3536 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:24:28.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:27 smithi050 bash[21866]: cluster 2024-05-20T22:24:26.610797+0000 mgr.y (mgr.14592) 692 : cluster 0 pgmap v1159: 364 pgs: 364 active+clean; 4.4 MiB data, 693 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-05-20T22:24:28.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:27 smithi050 bash[21866]: audit 2024-05-20T22:24:26.707882+0000 mon.a (mon.0) 3534 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:24:28.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:27 smithi050 bash[21866]: cluster 2024-05-20T22:24:26.715746+0000 mon.a (mon.0) 3535 : cluster 0 osdmap e713: 8 total, 8 up, 8 in 2024-05-20T22:24:28.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:27 smithi050 bash[21866]: audit 2024-05-20T22:24:26.717292+0000 mon.c (mon.2) 483 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:24:28.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:27 smithi050 bash[21866]: audit 2024-05-20T22:24:26.726118+0000 mon.a (mon.0) 3536 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:24:28.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:27 smithi050 bash[28929]: cluster 2024-05-20T22:24:26.610797+0000 mgr.y (mgr.14592) 692 : cluster 0 pgmap v1159: 364 pgs: 364 active+clean; 4.4 MiB data, 693 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-05-20T22:24:28.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:27 smithi050 bash[28929]: audit 2024-05-20T22:24:26.707882+0000 mon.a (mon.0) 3534 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:24:28.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:27 smithi050 bash[28929]: cluster 2024-05-20T22:24:26.715746+0000 mon.a (mon.0) 3535 : cluster 0 osdmap e713: 8 total, 8 up, 8 in 2024-05-20T22:24:28.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:27 smithi050 bash[28929]: audit 2024-05-20T22:24:26.717292+0000 mon.c (mon.2) 483 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:24:28.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:27 smithi050 bash[28929]: audit 2024-05-20T22:24:26.726118+0000 mon.a (mon.0) 3536 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:24:28.733 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:24:28 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:24:29.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:28 smithi145 bash[23893]: cluster 2024-05-20T22:24:27.708314+0000 mon.a (mon.0) 3537 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:24:29.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:28 smithi145 bash[23893]: audit 2024-05-20T22:24:27.710591+0000 mon.a (mon.0) 3538 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:24:29.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:28 smithi145 bash[23893]: cluster 2024-05-20T22:24:27.719140+0000 mon.a (mon.0) 3539 : cluster 0 osdmap e714: 8 total, 8 up, 8 in 2024-05-20T22:24:29.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:28 smithi145 bash[23893]: audit 2024-05-20T22:24:27.721443+0000 mon.c (mon.2) 484 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-05-20T22:24:29.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:28 smithi145 bash[23893]: audit 2024-05-20T22:24:27.726654+0000 mon.a (mon.0) 3540 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-05-20T22:24:29.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:28 smithi145 bash[23893]: audit 2024-05-20T22:24:28.713300+0000 mon.a (mon.0) 3541 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-05-20T22:24:29.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:28 smithi145 bash[23893]: cluster 2024-05-20T22:24:28.722969+0000 mon.a (mon.0) 3542 : cluster 0 osdmap e715: 8 total, 8 up, 8 in 2024-05-20T22:24:29.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:28 smithi145 bash[23893]: audit 2024-05-20T22:24:28.726062+0000 mon.c (mon.2) 485 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-05-20T22:24:29.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:28 smithi050 bash[21866]: cluster 2024-05-20T22:24:27.708314+0000 mon.a (mon.0) 3537 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:24:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:28 smithi050 bash[21866]: audit 2024-05-20T22:24:27.710591+0000 mon.a (mon.0) 3538 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:24:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:28 smithi050 bash[21866]: cluster 2024-05-20T22:24:27.719140+0000 mon.a (mon.0) 3539 : cluster 0 osdmap e714: 8 total, 8 up, 8 in 2024-05-20T22:24:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:28 smithi050 bash[21866]: audit 2024-05-20T22:24:27.721443+0000 mon.c (mon.2) 484 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-05-20T22:24:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:28 smithi050 bash[21866]: audit 2024-05-20T22:24:27.726654+0000 mon.a (mon.0) 3540 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-05-20T22:24:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:28 smithi050 bash[21866]: audit 2024-05-20T22:24:28.713300+0000 mon.a (mon.0) 3541 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-05-20T22:24:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:28 smithi050 bash[21866]: cluster 2024-05-20T22:24:28.722969+0000 mon.a (mon.0) 3542 : cluster 0 osdmap e715: 8 total, 8 up, 8 in 2024-05-20T22:24:29.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:28 smithi050 bash[21866]: audit 2024-05-20T22:24:28.726062+0000 mon.c (mon.2) 485 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-05-20T22:24:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:28 smithi050 bash[28929]: cluster 2024-05-20T22:24:27.708314+0000 mon.a (mon.0) 3537 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:24:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:28 smithi050 bash[28929]: audit 2024-05-20T22:24:27.710591+0000 mon.a (mon.0) 3538 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:24:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:28 smithi050 bash[28929]: cluster 2024-05-20T22:24:27.719140+0000 mon.a (mon.0) 3539 : cluster 0 osdmap e714: 8 total, 8 up, 8 in 2024-05-20T22:24:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:28 smithi050 bash[28929]: audit 2024-05-20T22:24:27.721443+0000 mon.c (mon.2) 484 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-05-20T22:24:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:28 smithi050 bash[28929]: audit 2024-05-20T22:24:27.726654+0000 mon.a (mon.0) 3540 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-05-20T22:24:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:28 smithi050 bash[28929]: audit 2024-05-20T22:24:28.713300+0000 mon.a (mon.0) 3541 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-05-20T22:24:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:28 smithi050 bash[28929]: cluster 2024-05-20T22:24:28.722969+0000 mon.a (mon.0) 3542 : cluster 0 osdmap e715: 8 total, 8 up, 8 in 2024-05-20T22:24:29.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:28 smithi050 bash[28929]: audit 2024-05-20T22:24:28.726062+0000 mon.c (mon.2) 485 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-05-20T22:24:29.692 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:24:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:24:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:24:30.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:29 smithi145 bash[23893]: audit 2024-05-20T22:24:28.421669+0000 mgr.y (mgr.14592) 693 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:24:30.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:29 smithi145 bash[23893]: cluster 2024-05-20T22:24:28.611762+0000 mgr.y (mgr.14592) 694 : cluster 0 pgmap v1162: 364 pgs: 364 active+clean; 4.4 MiB data, 693 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-05-20T22:24:30.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:29 smithi145 bash[23893]: audit 2024-05-20T22:24:28.727925+0000 mon.a (mon.0) 3543 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-05-20T22:24:30.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:29 smithi145 bash[23893]: audit 2024-05-20T22:24:29.716030+0000 mon.a (mon.0) 3544 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-05-20T22:24:30.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:29 smithi145 bash[23893]: cluster 2024-05-20T22:24:29.723457+0000 mon.a (mon.0) 3545 : cluster 0 osdmap e716: 8 total, 8 up, 8 in 2024-05-20T22:24:30.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:29 smithi145 bash[23893]: audit 2024-05-20T22:24:29.725683+0000 mon.c (mon.2) 486 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-05-20T22:24:30.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:29 smithi145 bash[23893]: audit 2024-05-20T22:24:29.728388+0000 mon.a (mon.0) 3546 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-05-20T22:24:30.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:29 smithi050 bash[21866]: audit 2024-05-20T22:24:28.421669+0000 mgr.y (mgr.14592) 693 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:24:30.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:29 smithi050 bash[21866]: cluster 2024-05-20T22:24:28.611762+0000 mgr.y (mgr.14592) 694 : cluster 0 pgmap v1162: 364 pgs: 364 active+clean; 4.4 MiB data, 693 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-05-20T22:24:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:29 smithi050 bash[21866]: audit 2024-05-20T22:24:28.727925+0000 mon.a (mon.0) 3543 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-05-20T22:24:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:29 smithi050 bash[21866]: audit 2024-05-20T22:24:29.716030+0000 mon.a (mon.0) 3544 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-05-20T22:24:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:29 smithi050 bash[21866]: cluster 2024-05-20T22:24:29.723457+0000 mon.a (mon.0) 3545 : cluster 0 osdmap e716: 8 total, 8 up, 8 in 2024-05-20T22:24:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:29 smithi050 bash[21866]: audit 2024-05-20T22:24:29.725683+0000 mon.c (mon.2) 486 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-05-20T22:24:30.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:29 smithi050 bash[21866]: audit 2024-05-20T22:24:29.728388+0000 mon.a (mon.0) 3546 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-05-20T22:24:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:29 smithi050 bash[28929]: audit 2024-05-20T22:24:28.421669+0000 mgr.y (mgr.14592) 693 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:24:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:29 smithi050 bash[28929]: cluster 2024-05-20T22:24:28.611762+0000 mgr.y (mgr.14592) 694 : cluster 0 pgmap v1162: 364 pgs: 364 active+clean; 4.4 MiB data, 693 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-05-20T22:24:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:29 smithi050 bash[28929]: audit 2024-05-20T22:24:28.727925+0000 mon.a (mon.0) 3543 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-05-20T22:24:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:29 smithi050 bash[28929]: audit 2024-05-20T22:24:29.716030+0000 mon.a (mon.0) 3544 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-05-20T22:24:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:29 smithi050 bash[28929]: cluster 2024-05-20T22:24:29.723457+0000 mon.a (mon.0) 3545 : cluster 0 osdmap e716: 8 total, 8 up, 8 in 2024-05-20T22:24:30.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:29 smithi050 bash[28929]: audit 2024-05-20T22:24:29.725683+0000 mon.c (mon.2) 486 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-05-20T22:24:30.195 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:29 smithi050 bash[28929]: audit 2024-05-20T22:24:29.728388+0000 mon.a (mon.0) 3546 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-05-20T22:24:32.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:31 smithi145 bash[23893]: cluster 2024-05-20T22:24:30.615045+0000 mgr.y (mgr.14592) 695 : cluster 0 pgmap v1165: 364 pgs: 364 active+clean; 4.4 MiB data, 694 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:24:32.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:31 smithi145 bash[23893]: audit 2024-05-20T22:24:30.718838+0000 mon.a (mon.0) 3547 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-05-20T22:24:32.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:31 smithi145 bash[23893]: cluster 2024-05-20T22:24:30.725810+0000 mon.a (mon.0) 3548 : cluster 0 osdmap e717: 8 total, 8 up, 8 in 2024-05-20T22:24:32.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:31 smithi145 bash[23893]: audit 2024-05-20T22:24:30.834567+0000 mon.c (mon.2) 487 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:32.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:31 smithi145 bash[23893]: audit 2024-05-20T22:24:30.835168+0000 mon.a (mon.0) 3549 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:32.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:31 smithi050 bash[21866]: cluster 2024-05-20T22:24:30.615045+0000 mgr.y (mgr.14592) 695 : cluster 0 pgmap v1165: 364 pgs: 364 active+clean; 4.4 MiB data, 694 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:24:32.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:31 smithi050 bash[21866]: audit 2024-05-20T22:24:30.718838+0000 mon.a (mon.0) 3547 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-05-20T22:24:32.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:31 smithi050 bash[21866]: cluster 2024-05-20T22:24:30.725810+0000 mon.a (mon.0) 3548 : cluster 0 osdmap e717: 8 total, 8 up, 8 in 2024-05-20T22:24:32.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:31 smithi050 bash[21866]: audit 2024-05-20T22:24:30.834567+0000 mon.c (mon.2) 487 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:32.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:31 smithi050 bash[21866]: audit 2024-05-20T22:24:30.835168+0000 mon.a (mon.0) 3549 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:32.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:31 smithi050 bash[28929]: cluster 2024-05-20T22:24:30.615045+0000 mgr.y (mgr.14592) 695 : cluster 0 pgmap v1165: 364 pgs: 364 active+clean; 4.4 MiB data, 694 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:24:32.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:31 smithi050 bash[28929]: audit 2024-05-20T22:24:30.718838+0000 mon.a (mon.0) 3547 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-05-20T22:24:32.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:31 smithi050 bash[28929]: cluster 2024-05-20T22:24:30.725810+0000 mon.a (mon.0) 3548 : cluster 0 osdmap e717: 8 total, 8 up, 8 in 2024-05-20T22:24:32.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:31 smithi050 bash[28929]: audit 2024-05-20T22:24:30.834567+0000 mon.c (mon.2) 487 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:32.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:31 smithi050 bash[28929]: audit 2024-05-20T22:24:30.835168+0000 mon.a (mon.0) 3549 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:33.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:32 smithi145 bash[23893]: audit 2024-05-20T22:24:31.745838+0000 mon.a (mon.0) 3550 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:24:33.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:32 smithi145 bash[23893]: cluster 2024-05-20T22:24:31.753349+0000 mon.a (mon.0) 3551 : cluster 0 osdmap e718: 8 total, 8 up, 8 in 2024-05-20T22:24:33.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:32 smithi145 bash[23893]: audit 2024-05-20T22:24:31.754623+0000 mon.c (mon.2) 488 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142"}]: dispatch 2024-05-20T22:24:33.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:32 smithi145 bash[23893]: audit 2024-05-20T22:24:31.758000+0000 mon.a (mon.0) 3552 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142"}]: dispatch 2024-05-20T22:24:33.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:32 smithi050 bash[21866]: audit 2024-05-20T22:24:31.745838+0000 mon.a (mon.0) 3550 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:24:33.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:32 smithi050 bash[21866]: cluster 2024-05-20T22:24:31.753349+0000 mon.a (mon.0) 3551 : cluster 0 osdmap e718: 8 total, 8 up, 8 in 2024-05-20T22:24:33.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:32 smithi050 bash[21866]: audit 2024-05-20T22:24:31.754623+0000 mon.c (mon.2) 488 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142"}]: dispatch 2024-05-20T22:24:33.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:32 smithi050 bash[21866]: audit 2024-05-20T22:24:31.758000+0000 mon.a (mon.0) 3552 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142"}]: dispatch 2024-05-20T22:24:33.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:32 smithi050 bash[28929]: audit 2024-05-20T22:24:31.745838+0000 mon.a (mon.0) 3550 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:24:33.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:32 smithi050 bash[28929]: cluster 2024-05-20T22:24:31.753349+0000 mon.a (mon.0) 3551 : cluster 0 osdmap e718: 8 total, 8 up, 8 in 2024-05-20T22:24:33.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:32 smithi050 bash[28929]: audit 2024-05-20T22:24:31.754623+0000 mon.c (mon.2) 488 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142"}]: dispatch 2024-05-20T22:24:33.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:32 smithi050 bash[28929]: audit 2024-05-20T22:24:31.758000+0000 mon.a (mon.0) 3552 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142"}]: dispatch 2024-05-20T22:24:34.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:33 smithi145 bash[23893]: cluster 2024-05-20T22:24:32.616123+0000 mgr.y (mgr.14592) 696 : cluster 0 pgmap v1168: 364 pgs: 364 active+clean; 4.4 MiB data, 694 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:24:34.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:33 smithi145 bash[23893]: audit 2024-05-20T22:24:32.754841+0000 mon.a (mon.0) 3553 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142"}]': finished 2024-05-20T22:24:34.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:33 smithi145 bash[23893]: cluster 2024-05-20T22:24:32.764740+0000 mon.a (mon.0) 3554 : cluster 0 osdmap e719: 8 total, 8 up, 8 in 2024-05-20T22:24:34.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:33 smithi145 bash[23893]: audit 2024-05-20T22:24:32.841218+0000 mon.c (mon.2) 489 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:34.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:33 smithi145 bash[23893]: audit 2024-05-20T22:24:32.841967+0000 mon.a (mon.0) 3555 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:34.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:33 smithi145 bash[23893]: audit 2024-05-20T22:24:32.843004+0000 mon.c (mon.2) 490 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142"}]: dispatch 2024-05-20T22:24:34.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:33 smithi145 bash[23893]: audit 2024-05-20T22:24:32.843680+0000 mon.a (mon.0) 3556 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142"}]: dispatch 2024-05-20T22:24:34.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:33 smithi050 bash[21866]: cluster 2024-05-20T22:24:32.616123+0000 mgr.y (mgr.14592) 696 : cluster 0 pgmap v1168: 364 pgs: 364 active+clean; 4.4 MiB data, 694 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:24:34.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:33 smithi050 bash[21866]: audit 2024-05-20T22:24:32.754841+0000 mon.a (mon.0) 3553 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142"}]': finished 2024-05-20T22:24:34.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:33 smithi050 bash[21866]: cluster 2024-05-20T22:24:32.764740+0000 mon.a (mon.0) 3554 : cluster 0 osdmap e719: 8 total, 8 up, 8 in 2024-05-20T22:24:34.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:33 smithi050 bash[21866]: audit 2024-05-20T22:24:32.841218+0000 mon.c (mon.2) 489 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:34.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:33 smithi050 bash[21866]: audit 2024-05-20T22:24:32.841967+0000 mon.a (mon.0) 3555 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:34.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:33 smithi050 bash[21866]: audit 2024-05-20T22:24:32.843004+0000 mon.c (mon.2) 490 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142"}]: dispatch 2024-05-20T22:24:34.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:33 smithi050 bash[21866]: audit 2024-05-20T22:24:32.843680+0000 mon.a (mon.0) 3556 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142"}]: dispatch 2024-05-20T22:24:34.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:33 smithi050 bash[28929]: cluster 2024-05-20T22:24:32.616123+0000 mgr.y (mgr.14592) 696 : cluster 0 pgmap v1168: 364 pgs: 364 active+clean; 4.4 MiB data, 694 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:24:34.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:33 smithi050 bash[28929]: audit 2024-05-20T22:24:32.754841+0000 mon.a (mon.0) 3553 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142"}]': finished 2024-05-20T22:24:34.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:33 smithi050 bash[28929]: cluster 2024-05-20T22:24:32.764740+0000 mon.a (mon.0) 3554 : cluster 0 osdmap e719: 8 total, 8 up, 8 in 2024-05-20T22:24:34.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:33 smithi050 bash[28929]: audit 2024-05-20T22:24:32.841218+0000 mon.c (mon.2) 489 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:34.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:33 smithi050 bash[28929]: audit 2024-05-20T22:24:32.841967+0000 mon.a (mon.0) 3555 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:34.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:33 smithi050 bash[28929]: audit 2024-05-20T22:24:32.843004+0000 mon.c (mon.2) 490 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142"}]: dispatch 2024-05-20T22:24:34.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:33 smithi050 bash[28929]: audit 2024-05-20T22:24:32.843680+0000 mon.a (mon.0) 3556 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-142"}]: dispatch 2024-05-20T22:24:35.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:34 smithi145 bash[23893]: cluster 2024-05-20T22:24:33.765418+0000 mon.a (mon.0) 3557 : cluster 0 osdmap e720: 8 total, 8 up, 8 in 2024-05-20T22:24:35.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:34 smithi050 bash[21866]: cluster 2024-05-20T22:24:33.765418+0000 mon.a (mon.0) 3557 : cluster 0 osdmap e720: 8 total, 8 up, 8 in 2024-05-20T22:24:35.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:34 smithi050 bash[28929]: cluster 2024-05-20T22:24:33.765418+0000 mon.a (mon.0) 3557 : cluster 0 osdmap e720: 8 total, 8 up, 8 in 2024-05-20T22:24:36.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:35 smithi145 bash[23893]: cluster 2024-05-20T22:24:34.617028+0000 mgr.y (mgr.14592) 697 : cluster 0 pgmap v1171: 332 pgs: 332 active+clean; 4.4 MiB data, 694 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:24:36.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:35 smithi145 bash[23893]: cluster 2024-05-20T22:24:34.789242+0000 mon.a (mon.0) 3558 : cluster 0 osdmap e721: 8 total, 8 up, 8 in 2024-05-20T22:24:36.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:35 smithi145 bash[23893]: audit 2024-05-20T22:24:34.804526+0000 mon.c (mon.2) 491 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:36.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:35 smithi145 bash[23893]: audit 2024-05-20T22:24:34.806130+0000 mon.a (mon.0) 3559 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:36.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:35 smithi050 bash[21866]: cluster 2024-05-20T22:24:34.617028+0000 mgr.y (mgr.14592) 697 : cluster 0 pgmap v1171: 332 pgs: 332 active+clean; 4.4 MiB data, 694 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:24:36.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:35 smithi050 bash[21866]: cluster 2024-05-20T22:24:34.789242+0000 mon.a (mon.0) 3558 : cluster 0 osdmap e721: 8 total, 8 up, 8 in 2024-05-20T22:24:36.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:35 smithi050 bash[21866]: audit 2024-05-20T22:24:34.804526+0000 mon.c (mon.2) 491 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:36.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:35 smithi050 bash[21866]: audit 2024-05-20T22:24:34.806130+0000 mon.a (mon.0) 3559 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:36.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:35 smithi050 bash[28929]: cluster 2024-05-20T22:24:34.617028+0000 mgr.y (mgr.14592) 697 : cluster 0 pgmap v1171: 332 pgs: 332 active+clean; 4.4 MiB data, 694 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:24:36.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:35 smithi050 bash[28929]: cluster 2024-05-20T22:24:34.789242+0000 mon.a (mon.0) 3558 : cluster 0 osdmap e721: 8 total, 8 up, 8 in 2024-05-20T22:24:36.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:35 smithi050 bash[28929]: audit 2024-05-20T22:24:34.804526+0000 mon.c (mon.2) 491 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:36.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:35 smithi050 bash[28929]: audit 2024-05-20T22:24:34.806130+0000 mon.a (mon.0) 3559 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:37.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:36 smithi145 bash[23893]: audit 2024-05-20T22:24:35.783292+0000 mon.a (mon.0) 3560 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:24:37.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:36 smithi145 bash[23893]: cluster 2024-05-20T22:24:35.791366+0000 mon.a (mon.0) 3561 : cluster 0 osdmap e722: 8 total, 8 up, 8 in 2024-05-20T22:24:37.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:36 smithi145 bash[23893]: audit 2024-05-20T22:24:35.854089+0000 mon.c (mon.2) 492 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:37.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:36 smithi145 bash[23893]: audit 2024-05-20T22:24:35.855071+0000 mon.a (mon.0) 3562 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:37.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:36 smithi050 bash[21866]: audit 2024-05-20T22:24:35.783292+0000 mon.a (mon.0) 3560 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:24:37.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:36 smithi050 bash[21866]: cluster 2024-05-20T22:24:35.791366+0000 mon.a (mon.0) 3561 : cluster 0 osdmap e722: 8 total, 8 up, 8 in 2024-05-20T22:24:37.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:36 smithi050 bash[21866]: audit 2024-05-20T22:24:35.854089+0000 mon.c (mon.2) 492 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:37.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:36 smithi050 bash[21866]: audit 2024-05-20T22:24:35.855071+0000 mon.a (mon.0) 3562 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:37.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:36 smithi050 bash[28929]: audit 2024-05-20T22:24:35.783292+0000 mon.a (mon.0) 3560 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:24:37.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:36 smithi050 bash[28929]: cluster 2024-05-20T22:24:35.791366+0000 mon.a (mon.0) 3561 : cluster 0 osdmap e722: 8 total, 8 up, 8 in 2024-05-20T22:24:37.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:36 smithi050 bash[28929]: audit 2024-05-20T22:24:35.854089+0000 mon.c (mon.2) 492 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:37.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:36 smithi050 bash[28929]: audit 2024-05-20T22:24:35.855071+0000 mon.a (mon.0) 3562 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:38.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:37 smithi145 bash[23893]: cluster 2024-05-20T22:24:36.617965+0000 mgr.y (mgr.14592) 698 : cluster 0 pgmap v1174: 364 pgs: 32 creating+peering, 332 active+clean; 4.4 MiB data, 678 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-20T22:24:38.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:37 smithi145 bash[23893]: audit 2024-05-20T22:24:36.810478+0000 mon.a (mon.0) 3563 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:24:38.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:37 smithi145 bash[23893]: cluster 2024-05-20T22:24:36.820131+0000 mon.a (mon.0) 3564 : cluster 0 osdmap e723: 8 total, 8 up, 8 in 2024-05-20T22:24:38.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:37 smithi145 bash[23893]: audit 2024-05-20T22:24:36.820894+0000 mon.c (mon.2) 493 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-144"}]: dispatch 2024-05-20T22:24:38.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:37 smithi145 bash[23893]: audit 2024-05-20T22:24:36.822044+0000 mon.a (mon.0) 3565 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-144"}]: dispatch 2024-05-20T22:24:38.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:37 smithi050 bash[21866]: cluster 2024-05-20T22:24:36.617965+0000 mgr.y (mgr.14592) 698 : cluster 0 pgmap v1174: 364 pgs: 32 creating+peering, 332 active+clean; 4.4 MiB data, 678 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-20T22:24:38.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:37 smithi050 bash[21866]: audit 2024-05-20T22:24:36.810478+0000 mon.a (mon.0) 3563 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:24:38.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:37 smithi050 bash[21866]: cluster 2024-05-20T22:24:36.820131+0000 mon.a (mon.0) 3564 : cluster 0 osdmap e723: 8 total, 8 up, 8 in 2024-05-20T22:24:38.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:37 smithi050 bash[21866]: audit 2024-05-20T22:24:36.820894+0000 mon.c (mon.2) 493 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-144"}]: dispatch 2024-05-20T22:24:38.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:37 smithi050 bash[21866]: audit 2024-05-20T22:24:36.822044+0000 mon.a (mon.0) 3565 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-144"}]: dispatch 2024-05-20T22:24:38.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:37 smithi050 bash[28929]: cluster 2024-05-20T22:24:36.617965+0000 mgr.y (mgr.14592) 698 : cluster 0 pgmap v1174: 364 pgs: 32 creating+peering, 332 active+clean; 4.4 MiB data, 678 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-20T22:24:38.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:37 smithi050 bash[28929]: audit 2024-05-20T22:24:36.810478+0000 mon.a (mon.0) 3563 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:24:38.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:37 smithi050 bash[28929]: cluster 2024-05-20T22:24:36.820131+0000 mon.a (mon.0) 3564 : cluster 0 osdmap e723: 8 total, 8 up, 8 in 2024-05-20T22:24:38.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:37 smithi050 bash[28929]: audit 2024-05-20T22:24:36.820894+0000 mon.c (mon.2) 493 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-144"}]: dispatch 2024-05-20T22:24:38.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:37 smithi050 bash[28929]: audit 2024-05-20T22:24:36.822044+0000 mon.a (mon.0) 3565 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-144"}]: dispatch 2024-05-20T22:24:38.837 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:24:38 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:24:39.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:38 smithi145 bash[23893]: audit 2024-05-20T22:24:37.813125+0000 mon.a (mon.0) 3566 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-144"}]': finished 2024-05-20T22:24:39.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:38 smithi145 bash[23893]: cluster 2024-05-20T22:24:37.822619+0000 mon.a (mon.0) 3567 : cluster 0 osdmap e724: 8 total, 8 up, 8 in 2024-05-20T22:24:39.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:38 smithi145 bash[23893]: audit 2024-05-20T22:24:37.823275+0000 mon.c (mon.2) 494 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-144", "mode": "readproxy"}]: dispatch 2024-05-20T22:24:39.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:38 smithi145 bash[23893]: audit 2024-05-20T22:24:37.825734+0000 mon.a (mon.0) 3568 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-144", "mode": "readproxy"}]: dispatch 2024-05-20T22:24:39.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:38 smithi145 bash[23893]: cluster 2024-05-20T22:24:38.813536+0000 mon.a (mon.0) 3569 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:24:39.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:38 smithi145 bash[23893]: audit 2024-05-20T22:24:38.816002+0000 mon.a (mon.0) 3570 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-144", "mode": "readproxy"}]': finished 2024-05-20T22:24:39.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:38 smithi050 bash[21866]: audit 2024-05-20T22:24:37.813125+0000 mon.a (mon.0) 3566 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-144"}]': finished 2024-05-20T22:24:39.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:38 smithi050 bash[21866]: cluster 2024-05-20T22:24:37.822619+0000 mon.a (mon.0) 3567 : cluster 0 osdmap e724: 8 total, 8 up, 8 in 2024-05-20T22:24:39.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:38 smithi050 bash[21866]: audit 2024-05-20T22:24:37.823275+0000 mon.c (mon.2) 494 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-144", "mode": "readproxy"}]: dispatch 2024-05-20T22:24:39.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:38 smithi050 bash[21866]: audit 2024-05-20T22:24:37.825734+0000 mon.a (mon.0) 3568 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-144", "mode": "readproxy"}]: dispatch 2024-05-20T22:24:39.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:38 smithi050 bash[21866]: cluster 2024-05-20T22:24:38.813536+0000 mon.a (mon.0) 3569 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:24:39.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:38 smithi050 bash[21866]: audit 2024-05-20T22:24:38.816002+0000 mon.a (mon.0) 3570 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-144", "mode": "readproxy"}]': finished 2024-05-20T22:24:39.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:38 smithi050 bash[28929]: audit 2024-05-20T22:24:37.813125+0000 mon.a (mon.0) 3566 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-144"}]': finished 2024-05-20T22:24:39.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:38 smithi050 bash[28929]: cluster 2024-05-20T22:24:37.822619+0000 mon.a (mon.0) 3567 : cluster 0 osdmap e724: 8 total, 8 up, 8 in 2024-05-20T22:24:39.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:38 smithi050 bash[28929]: audit 2024-05-20T22:24:37.823275+0000 mon.c (mon.2) 494 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-144", "mode": "readproxy"}]: dispatch 2024-05-20T22:24:39.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:38 smithi050 bash[28929]: audit 2024-05-20T22:24:37.825734+0000 mon.a (mon.0) 3568 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-144", "mode": "readproxy"}]: dispatch 2024-05-20T22:24:39.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:38 smithi050 bash[28929]: cluster 2024-05-20T22:24:38.813536+0000 mon.a (mon.0) 3569 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:24:39.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:38 smithi050 bash[28929]: audit 2024-05-20T22:24:38.816002+0000 mon.a (mon.0) 3570 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-144", "mode": "readproxy"}]': finished 2024-05-20T22:24:39.692 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:24:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:24:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:24:40.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:39 smithi145 bash[23893]: audit 2024-05-20T22:24:38.433197+0000 mgr.y (mgr.14592) 699 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:24:40.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:39 smithi145 bash[23893]: cluster 2024-05-20T22:24:38.618921+0000 mgr.y (mgr.14592) 700 : cluster 0 pgmap v1177: 364 pgs: 32 creating+peering, 332 active+clean; 4.4 MiB data, 678 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-20T22:24:40.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:39 smithi145 bash[23893]: cluster 2024-05-20T22:24:38.823895+0000 mon.a (mon.0) 3571 : cluster 0 osdmap e725: 8 total, 8 up, 8 in 2024-05-20T22:24:40.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:39 smithi145 bash[23893]: audit 2024-05-20T22:24:38.858187+0000 mon.a (mon.0) 3572 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:24:40.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:39 smithi145 bash[23893]: audit 2024-05-20T22:24:38.860854+0000 mon.a (mon.0) 3573 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:24:40.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:39 smithi050 bash[21866]: audit 2024-05-20T22:24:38.433197+0000 mgr.y (mgr.14592) 699 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:24:40.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:39 smithi050 bash[21866]: cluster 2024-05-20T22:24:38.618921+0000 mgr.y (mgr.14592) 700 : cluster 0 pgmap v1177: 364 pgs: 32 creating+peering, 332 active+clean; 4.4 MiB data, 678 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-20T22:24:40.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:39 smithi050 bash[21866]: cluster 2024-05-20T22:24:38.823895+0000 mon.a (mon.0) 3571 : cluster 0 osdmap e725: 8 total, 8 up, 8 in 2024-05-20T22:24:40.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:39 smithi050 bash[21866]: audit 2024-05-20T22:24:38.858187+0000 mon.a (mon.0) 3572 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:24:40.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:39 smithi050 bash[21866]: audit 2024-05-20T22:24:38.860854+0000 mon.a (mon.0) 3573 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:24:40.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:39 smithi050 bash[28929]: audit 2024-05-20T22:24:38.433197+0000 mgr.y (mgr.14592) 699 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:24:40.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:39 smithi050 bash[28929]: cluster 2024-05-20T22:24:38.618921+0000 mgr.y (mgr.14592) 700 : cluster 0 pgmap v1177: 364 pgs: 32 creating+peering, 332 active+clean; 4.4 MiB data, 678 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-20T22:24:40.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:39 smithi050 bash[28929]: cluster 2024-05-20T22:24:38.823895+0000 mon.a (mon.0) 3571 : cluster 0 osdmap e725: 8 total, 8 up, 8 in 2024-05-20T22:24:40.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:39 smithi050 bash[28929]: audit 2024-05-20T22:24:38.858187+0000 mon.a (mon.0) 3572 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:24:40.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:39 smithi050 bash[28929]: audit 2024-05-20T22:24:38.860854+0000 mon.a (mon.0) 3573 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:24:41.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:40 smithi145 bash[23893]: cluster 2024-05-20T22:24:40.622259+0000 mgr.y (mgr.14592) 701 : cluster 0 pgmap v1179: 364 pgs: 364 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 211 B/s wr, 1 op/s 2024-05-20T22:24:41.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:40 smithi050 bash[21866]: cluster 2024-05-20T22:24:40.622259+0000 mgr.y (mgr.14592) 701 : cluster 0 pgmap v1179: 364 pgs: 364 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 211 B/s wr, 1 op/s 2024-05-20T22:24:41.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:40 smithi050 bash[28929]: cluster 2024-05-20T22:24:40.622259+0000 mgr.y (mgr.14592) 701 : cluster 0 pgmap v1179: 364 pgs: 364 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 211 B/s wr, 1 op/s 2024-05-20T22:24:43.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:43 smithi050 bash[21866]: cluster 2024-05-20T22:24:42.623248+0000 mgr.y (mgr.14592) 702 : cluster 0 pgmap v1180: 364 pgs: 364 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-05-20T22:24:43.942 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:43 smithi050 bash[28929]: cluster 2024-05-20T22:24:42.623248+0000 mgr.y (mgr.14592) 702 : cluster 0 pgmap v1180: 364 pgs: 364 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-05-20T22:24:44.141 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:43 smithi145 bash[23893]: cluster 2024-05-20T22:24:42.623248+0000 mgr.y (mgr.14592) 702 : cluster 0 pgmap v1180: 364 pgs: 364 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-05-20T22:24:45.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:45 smithi050 bash[21866]: cluster 2024-05-20T22:24:44.624233+0000 mgr.y (mgr.14592) 703 : cluster 0 pgmap v1181: 364 pgs: 364 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 786 B/s rd, 131 B/s wr, 0 op/s 2024-05-20T22:24:45.942 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:45 smithi050 bash[28929]: cluster 2024-05-20T22:24:44.624233+0000 mgr.y (mgr.14592) 703 : cluster 0 pgmap v1181: 364 pgs: 364 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 786 B/s rd, 131 B/s wr, 0 op/s 2024-05-20T22:24:46.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:45 smithi145 bash[23893]: cluster 2024-05-20T22:24:44.624233+0000 mgr.y (mgr.14592) 703 : cluster 0 pgmap v1181: 364 pgs: 364 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 786 B/s rd, 131 B/s wr, 0 op/s 2024-05-20T22:24:47.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:47 smithi050 bash[21866]: cluster 2024-05-20T22:24:46.627464+0000 mgr.y (mgr.14592) 704 : cluster 0 pgmap v1182: 364 pgs: 364 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 116 B/s wr, 1 op/s 2024-05-20T22:24:47.942 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:47 smithi050 bash[28929]: cluster 2024-05-20T22:24:46.627464+0000 mgr.y (mgr.14592) 704 : cluster 0 pgmap v1182: 364 pgs: 364 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 116 B/s wr, 1 op/s 2024-05-20T22:24:48.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:47 smithi145 bash[23893]: cluster 2024-05-20T22:24:46.627464+0000 mgr.y (mgr.14592) 704 : cluster 0 pgmap v1182: 364 pgs: 364 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 116 B/s wr, 1 op/s 2024-05-20T22:24:48.889 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:24:48 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:24:49.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:24:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:24:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:24:50.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:49 smithi145 bash[23893]: audit 2024-05-20T22:24:48.443134+0000 mgr.y (mgr.14592) 705 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:24:50.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:49 smithi145 bash[23893]: cluster 2024-05-20T22:24:48.628474+0000 mgr.y (mgr.14592) 706 : cluster 0 pgmap v1183: 364 pgs: 364 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 102 B/s wr, 1 op/s 2024-05-20T22:24:50.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:49 smithi145 bash[23893]: audit 2024-05-20T22:24:49.164490+0000 mon.c (mon.2) 495 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:50.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:49 smithi145 bash[23893]: audit 2024-05-20T22:24:49.165129+0000 mon.a (mon.0) 3574 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:50.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:49 smithi050 bash[21866]: audit 2024-05-20T22:24:48.443134+0000 mgr.y (mgr.14592) 705 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:24:50.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:49 smithi050 bash[21866]: cluster 2024-05-20T22:24:48.628474+0000 mgr.y (mgr.14592) 706 : cluster 0 pgmap v1183: 364 pgs: 364 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 102 B/s wr, 1 op/s 2024-05-20T22:24:50.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:49 smithi050 bash[21866]: audit 2024-05-20T22:24:49.164490+0000 mon.c (mon.2) 495 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:50.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:49 smithi050 bash[21866]: audit 2024-05-20T22:24:49.165129+0000 mon.a (mon.0) 3574 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:50.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:49 smithi050 bash[28929]: audit 2024-05-20T22:24:48.443134+0000 mgr.y (mgr.14592) 705 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:24:50.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:49 smithi050 bash[28929]: cluster 2024-05-20T22:24:48.628474+0000 mgr.y (mgr.14592) 706 : cluster 0 pgmap v1183: 364 pgs: 364 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 102 B/s wr, 1 op/s 2024-05-20T22:24:50.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:49 smithi050 bash[28929]: audit 2024-05-20T22:24:49.164490+0000 mon.c (mon.2) 495 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:50.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:49 smithi050 bash[28929]: audit 2024-05-20T22:24:49.165129+0000 mon.a (mon.0) 3574 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:51.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:50 smithi145 bash[23893]: audit 2024-05-20T22:24:49.693772+0000 mon.a (mon.0) 3575 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:24:51.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:50 smithi145 bash[23893]: cluster 2024-05-20T22:24:49.701127+0000 mon.a (mon.0) 3576 : cluster 0 osdmap e726: 8 total, 8 up, 8 in 2024-05-20T22:24:51.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:50 smithi145 bash[23893]: audit 2024-05-20T22:24:49.705648+0000 mon.c (mon.2) 496 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144"}]: dispatch 2024-05-20T22:24:51.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:50 smithi145 bash[23893]: audit 2024-05-20T22:24:49.716782+0000 mon.a (mon.0) 3577 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144"}]: dispatch 2024-05-20T22:24:51.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:50 smithi050 bash[21866]: audit 2024-05-20T22:24:49.693772+0000 mon.a (mon.0) 3575 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:24:51.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:50 smithi050 bash[21866]: cluster 2024-05-20T22:24:49.701127+0000 mon.a (mon.0) 3576 : cluster 0 osdmap e726: 8 total, 8 up, 8 in 2024-05-20T22:24:51.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:50 smithi050 bash[21866]: audit 2024-05-20T22:24:49.705648+0000 mon.c (mon.2) 496 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144"}]: dispatch 2024-05-20T22:24:51.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:50 smithi050 bash[21866]: audit 2024-05-20T22:24:49.716782+0000 mon.a (mon.0) 3577 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144"}]: dispatch 2024-05-20T22:24:51.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:50 smithi050 bash[28929]: audit 2024-05-20T22:24:49.693772+0000 mon.a (mon.0) 3575 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:24:51.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:50 smithi050 bash[28929]: cluster 2024-05-20T22:24:49.701127+0000 mon.a (mon.0) 3576 : cluster 0 osdmap e726: 8 total, 8 up, 8 in 2024-05-20T22:24:51.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:50 smithi050 bash[28929]: audit 2024-05-20T22:24:49.705648+0000 mon.c (mon.2) 496 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144"}]: dispatch 2024-05-20T22:24:51.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:50 smithi050 bash[28929]: audit 2024-05-20T22:24:49.716782+0000 mon.a (mon.0) 3577 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144"}]: dispatch 2024-05-20T22:24:52.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:51 smithi145 bash[23893]: cluster 2024-05-20T22:24:50.631697+0000 mgr.y (mgr.14592) 707 : cluster 0 pgmap v1185: 364 pgs: 364 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:24:52.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:51 smithi145 bash[23893]: cluster 2024-05-20T22:24:50.707239+0000 mon.a (mon.0) 3578 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:24:52.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:51 smithi145 bash[23893]: audit 2024-05-20T22:24:50.715237+0000 mon.a (mon.0) 3579 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144"}]': finished 2024-05-20T22:24:52.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:51 smithi145 bash[23893]: cluster 2024-05-20T22:24:50.724959+0000 mon.a (mon.0) 3580 : cluster 0 osdmap e727: 8 total, 8 up, 8 in 2024-05-20T22:24:52.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:51 smithi145 bash[23893]: audit 2024-05-20T22:24:50.824264+0000 mon.c (mon.2) 497 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:52.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:51 smithi145 bash[23893]: audit 2024-05-20T22:24:50.824912+0000 mon.a (mon.0) 3581 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:52.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:51 smithi145 bash[23893]: audit 2024-05-20T22:24:50.826066+0000 mon.c (mon.2) 498 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144"}]: dispatch 2024-05-20T22:24:52.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:51 smithi145 bash[23893]: audit 2024-05-20T22:24:50.826670+0000 mon.a (mon.0) 3582 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144"}]: dispatch 2024-05-20T22:24:52.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:51 smithi050 bash[21866]: cluster 2024-05-20T22:24:50.631697+0000 mgr.y (mgr.14592) 707 : cluster 0 pgmap v1185: 364 pgs: 364 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:24:52.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:51 smithi050 bash[21866]: cluster 2024-05-20T22:24:50.707239+0000 mon.a (mon.0) 3578 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:24:52.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:51 smithi050 bash[21866]: audit 2024-05-20T22:24:50.715237+0000 mon.a (mon.0) 3579 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144"}]': finished 2024-05-20T22:24:52.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:51 smithi050 bash[21866]: cluster 2024-05-20T22:24:50.724959+0000 mon.a (mon.0) 3580 : cluster 0 osdmap e727: 8 total, 8 up, 8 in 2024-05-20T22:24:52.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:51 smithi050 bash[21866]: audit 2024-05-20T22:24:50.824264+0000 mon.c (mon.2) 497 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:52.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:51 smithi050 bash[21866]: audit 2024-05-20T22:24:50.824912+0000 mon.a (mon.0) 3581 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:52.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:51 smithi050 bash[21866]: audit 2024-05-20T22:24:50.826066+0000 mon.c (mon.2) 498 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144"}]: dispatch 2024-05-20T22:24:52.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:51 smithi050 bash[21866]: audit 2024-05-20T22:24:50.826670+0000 mon.a (mon.0) 3582 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144"}]: dispatch 2024-05-20T22:24:52.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:51 smithi050 bash[28929]: cluster 2024-05-20T22:24:50.631697+0000 mgr.y (mgr.14592) 707 : cluster 0 pgmap v1185: 364 pgs: 364 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:24:52.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:51 smithi050 bash[28929]: cluster 2024-05-20T22:24:50.707239+0000 mon.a (mon.0) 3578 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:24:52.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:51 smithi050 bash[28929]: audit 2024-05-20T22:24:50.715237+0000 mon.a (mon.0) 3579 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144"}]': finished 2024-05-20T22:24:52.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:51 smithi050 bash[28929]: cluster 2024-05-20T22:24:50.724959+0000 mon.a (mon.0) 3580 : cluster 0 osdmap e727: 8 total, 8 up, 8 in 2024-05-20T22:24:52.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:51 smithi050 bash[28929]: audit 2024-05-20T22:24:50.824264+0000 mon.c (mon.2) 497 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:52.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:51 smithi050 bash[28929]: audit 2024-05-20T22:24:50.824912+0000 mon.a (mon.0) 3581 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:24:52.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:51 smithi050 bash[28929]: audit 2024-05-20T22:24:50.826066+0000 mon.c (mon.2) 498 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144"}]: dispatch 2024-05-20T22:24:52.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:51 smithi050 bash[28929]: audit 2024-05-20T22:24:50.826670+0000 mon.a (mon.0) 3582 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-144"}]: dispatch 2024-05-20T22:24:53.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:52 smithi145 bash[23893]: cluster 2024-05-20T22:24:51.725595+0000 mon.a (mon.0) 3583 : cluster 0 osdmap e728: 8 total, 8 up, 8 in 2024-05-20T22:24:53.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:52 smithi050 bash[21866]: cluster 2024-05-20T22:24:51.725595+0000 mon.a (mon.0) 3583 : cluster 0 osdmap e728: 8 total, 8 up, 8 in 2024-05-20T22:24:53.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:52 smithi050 bash[28929]: cluster 2024-05-20T22:24:51.725595+0000 mon.a (mon.0) 3583 : cluster 0 osdmap e728: 8 total, 8 up, 8 in 2024-05-20T22:24:54.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:53 smithi145 bash[23893]: cluster 2024-05-20T22:24:52.632809+0000 mgr.y (mgr.14592) 708 : cluster 0 pgmap v1188: 332 pgs: 332 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:24:54.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:53 smithi145 bash[23893]: cluster 2024-05-20T22:24:52.757075+0000 mon.a (mon.0) 3584 : cluster 0 osdmap e729: 8 total, 8 up, 8 in 2024-05-20T22:24:54.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:53 smithi145 bash[23893]: audit 2024-05-20T22:24:52.760652+0000 mon.c (mon.2) 499 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:54.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:53 smithi145 bash[23893]: audit 2024-05-20T22:24:52.768406+0000 mon.a (mon.0) 3585 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:54.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:53 smithi050 bash[21866]: cluster 2024-05-20T22:24:52.632809+0000 mgr.y (mgr.14592) 708 : cluster 0 pgmap v1188: 332 pgs: 332 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:24:54.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:53 smithi050 bash[21866]: cluster 2024-05-20T22:24:52.757075+0000 mon.a (mon.0) 3584 : cluster 0 osdmap e729: 8 total, 8 up, 8 in 2024-05-20T22:24:54.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:53 smithi050 bash[21866]: audit 2024-05-20T22:24:52.760652+0000 mon.c (mon.2) 499 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:54.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:53 smithi050 bash[21866]: audit 2024-05-20T22:24:52.768406+0000 mon.a (mon.0) 3585 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:54.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:53 smithi050 bash[28929]: cluster 2024-05-20T22:24:52.632809+0000 mgr.y (mgr.14592) 708 : cluster 0 pgmap v1188: 332 pgs: 332 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:24:54.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:53 smithi050 bash[28929]: cluster 2024-05-20T22:24:52.757075+0000 mon.a (mon.0) 3584 : cluster 0 osdmap e729: 8 total, 8 up, 8 in 2024-05-20T22:24:54.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:53 smithi050 bash[28929]: audit 2024-05-20T22:24:52.760652+0000 mon.c (mon.2) 499 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:54.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:53 smithi050 bash[28929]: audit 2024-05-20T22:24:52.768406+0000 mon.a (mon.0) 3585 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:24:55.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:54 smithi145 bash[23893]: audit 2024-05-20T22:24:53.758642+0000 mon.a (mon.0) 3586 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:24:55.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:54 smithi145 bash[23893]: cluster 2024-05-20T22:24:53.766272+0000 mon.a (mon.0) 3587 : cluster 0 osdmap e730: 8 total, 8 up, 8 in 2024-05-20T22:24:55.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:54 smithi145 bash[23893]: audit 2024-05-20T22:24:53.833114+0000 mon.c (mon.2) 500 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:55.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:54 smithi145 bash[23893]: audit 2024-05-20T22:24:53.833709+0000 mon.a (mon.0) 3588 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:55.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:54 smithi145 bash[23893]: audit 2024-05-20T22:24:53.907021+0000 mon.a (mon.0) 3589 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:24:55.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:54 smithi145 bash[23893]: audit 2024-05-20T22:24:53.909588+0000 mon.a (mon.0) 3590 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:24:55.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:54 smithi050 bash[21866]: audit 2024-05-20T22:24:53.758642+0000 mon.a (mon.0) 3586 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:24:55.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:54 smithi050 bash[21866]: cluster 2024-05-20T22:24:53.766272+0000 mon.a (mon.0) 3587 : cluster 0 osdmap e730: 8 total, 8 up, 8 in 2024-05-20T22:24:55.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:54 smithi050 bash[21866]: audit 2024-05-20T22:24:53.833114+0000 mon.c (mon.2) 500 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:55.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:54 smithi050 bash[21866]: audit 2024-05-20T22:24:53.833709+0000 mon.a (mon.0) 3588 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:55.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:54 smithi050 bash[21866]: audit 2024-05-20T22:24:53.907021+0000 mon.a (mon.0) 3589 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:24:55.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:54 smithi050 bash[21866]: audit 2024-05-20T22:24:53.909588+0000 mon.a (mon.0) 3590 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:24:55.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:54 smithi050 bash[28929]: audit 2024-05-20T22:24:53.758642+0000 mon.a (mon.0) 3586 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:24:55.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:54 smithi050 bash[28929]: cluster 2024-05-20T22:24:53.766272+0000 mon.a (mon.0) 3587 : cluster 0 osdmap e730: 8 total, 8 up, 8 in 2024-05-20T22:24:55.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:54 smithi050 bash[28929]: audit 2024-05-20T22:24:53.833114+0000 mon.c (mon.2) 500 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:55.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:54 smithi050 bash[28929]: audit 2024-05-20T22:24:53.833709+0000 mon.a (mon.0) 3588 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:24:55.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:54 smithi050 bash[28929]: audit 2024-05-20T22:24:53.907021+0000 mon.a (mon.0) 3589 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:24:55.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:54 smithi050 bash[28929]: audit 2024-05-20T22:24:53.909588+0000 mon.a (mon.0) 3590 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:24:56.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:55 smithi145 bash[23893]: cluster 2024-05-20T22:24:54.633831+0000 mgr.y (mgr.14592) 709 : cluster 0 pgmap v1191: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:24:56.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:55 smithi145 bash[23893]: audit 2024-05-20T22:24:54.770222+0000 mon.a (mon.0) 3591 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:24:56.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:55 smithi145 bash[23893]: cluster 2024-05-20T22:24:54.777226+0000 mon.a (mon.0) 3592 : cluster 0 osdmap e731: 8 total, 8 up, 8 in 2024-05-20T22:24:56.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:55 smithi145 bash[23893]: audit 2024-05-20T22:24:54.779249+0000 mon.c (mon.2) 501 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-146"}]: dispatch 2024-05-20T22:24:56.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:55 smithi145 bash[23893]: audit 2024-05-20T22:24:54.781401+0000 mon.a (mon.0) 3593 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-146"}]: dispatch 2024-05-20T22:24:56.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:55 smithi050 bash[21866]: cluster 2024-05-20T22:24:54.633831+0000 mgr.y (mgr.14592) 709 : cluster 0 pgmap v1191: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:24:56.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:55 smithi050 bash[21866]: audit 2024-05-20T22:24:54.770222+0000 mon.a (mon.0) 3591 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:24:56.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:55 smithi050 bash[21866]: cluster 2024-05-20T22:24:54.777226+0000 mon.a (mon.0) 3592 : cluster 0 osdmap e731: 8 total, 8 up, 8 in 2024-05-20T22:24:56.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:55 smithi050 bash[21866]: audit 2024-05-20T22:24:54.779249+0000 mon.c (mon.2) 501 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-146"}]: dispatch 2024-05-20T22:24:56.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:55 smithi050 bash[21866]: audit 2024-05-20T22:24:54.781401+0000 mon.a (mon.0) 3593 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-146"}]: dispatch 2024-05-20T22:24:56.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:55 smithi050 bash[28929]: cluster 2024-05-20T22:24:54.633831+0000 mgr.y (mgr.14592) 709 : cluster 0 pgmap v1191: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:24:56.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:55 smithi050 bash[28929]: audit 2024-05-20T22:24:54.770222+0000 mon.a (mon.0) 3591 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:24:56.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:55 smithi050 bash[28929]: cluster 2024-05-20T22:24:54.777226+0000 mon.a (mon.0) 3592 : cluster 0 osdmap e731: 8 total, 8 up, 8 in 2024-05-20T22:24:56.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:55 smithi050 bash[28929]: audit 2024-05-20T22:24:54.779249+0000 mon.c (mon.2) 501 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-146"}]: dispatch 2024-05-20T22:24:56.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:55 smithi050 bash[28929]: audit 2024-05-20T22:24:54.781401+0000 mon.a (mon.0) 3593 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-146"}]: dispatch 2024-05-20T22:24:57.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:56 smithi145 bash[23893]: audit 2024-05-20T22:24:55.772947+0000 mon.a (mon.0) 3594 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-146"}]': finished 2024-05-20T22:24:57.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:56 smithi145 bash[23893]: cluster 2024-05-20T22:24:55.780526+0000 mon.a (mon.0) 3595 : cluster 0 osdmap e732: 8 total, 8 up, 8 in 2024-05-20T22:24:57.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:56 smithi145 bash[23893]: audit 2024-05-20T22:24:55.784815+0000 mon.c (mon.2) 502 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-146", "mode": "writeback"}]: dispatch 2024-05-20T22:24:57.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:56 smithi145 bash[23893]: audit 2024-05-20T22:24:55.796659+0000 mon.a (mon.0) 3596 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-146", "mode": "writeback"}]: dispatch 2024-05-20T22:24:57.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:56 smithi050 bash[21866]: audit 2024-05-20T22:24:55.772947+0000 mon.a (mon.0) 3594 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-146"}]': finished 2024-05-20T22:24:57.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:56 smithi050 bash[21866]: cluster 2024-05-20T22:24:55.780526+0000 mon.a (mon.0) 3595 : cluster 0 osdmap e732: 8 total, 8 up, 8 in 2024-05-20T22:24:57.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:56 smithi050 bash[21866]: audit 2024-05-20T22:24:55.784815+0000 mon.c (mon.2) 502 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-146", "mode": "writeback"}]: dispatch 2024-05-20T22:24:57.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:56 smithi050 bash[21866]: audit 2024-05-20T22:24:55.796659+0000 mon.a (mon.0) 3596 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-146", "mode": "writeback"}]: dispatch 2024-05-20T22:24:57.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:56 smithi050 bash[28929]: audit 2024-05-20T22:24:55.772947+0000 mon.a (mon.0) 3594 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi050-64110-111", "overlaypool": "test-rados-api-smithi050-64110-146"}]': finished 2024-05-20T22:24:57.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:56 smithi050 bash[28929]: cluster 2024-05-20T22:24:55.780526+0000 mon.a (mon.0) 3595 : cluster 0 osdmap e732: 8 total, 8 up, 8 in 2024-05-20T22:24:57.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:56 smithi050 bash[28929]: audit 2024-05-20T22:24:55.784815+0000 mon.c (mon.2) 502 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-146", "mode": "writeback"}]: dispatch 2024-05-20T22:24:57.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:56 smithi050 bash[28929]: audit 2024-05-20T22:24:55.796659+0000 mon.a (mon.0) 3596 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-146", "mode": "writeback"}]: dispatch 2024-05-20T22:24:58.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:57 smithi145 bash[23893]: cluster 2024-05-20T22:24:56.634843+0000 mgr.y (mgr.14592) 710 : cluster 0 pgmap v1194: 364 pgs: 364 active+clean; 4.4 MiB data, 701 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-05-20T22:24:58.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:57 smithi145 bash[23893]: cluster 2024-05-20T22:24:56.785774+0000 mon.a (mon.0) 3597 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:24:58.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:57 smithi145 bash[23893]: audit 2024-05-20T22:24:56.788268+0000 mon.a (mon.0) 3598 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-146", "mode": "writeback"}]': finished 2024-05-20T22:24:58.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:57 smithi145 bash[23893]: cluster 2024-05-20T22:24:56.796819+0000 mon.a (mon.0) 3599 : cluster 0 osdmap e733: 8 total, 8 up, 8 in 2024-05-20T22:24:58.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:57 smithi145 bash[23893]: audit 2024-05-20T22:24:56.890504+0000 mon.c (mon.2) 503 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:24:58.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:57 smithi145 bash[23893]: audit 2024-05-20T22:24:56.891116+0000 mon.a (mon.0) 3600 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:24:58.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:57 smithi050 bash[21866]: cluster 2024-05-20T22:24:56.634843+0000 mgr.y (mgr.14592) 710 : cluster 0 pgmap v1194: 364 pgs: 364 active+clean; 4.4 MiB data, 701 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-05-20T22:24:58.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:57 smithi050 bash[21866]: cluster 2024-05-20T22:24:56.785774+0000 mon.a (mon.0) 3597 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:24:58.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:57 smithi050 bash[21866]: audit 2024-05-20T22:24:56.788268+0000 mon.a (mon.0) 3598 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-146", "mode": "writeback"}]': finished 2024-05-20T22:24:58.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:57 smithi050 bash[21866]: cluster 2024-05-20T22:24:56.796819+0000 mon.a (mon.0) 3599 : cluster 0 osdmap e733: 8 total, 8 up, 8 in 2024-05-20T22:24:58.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:57 smithi050 bash[21866]: audit 2024-05-20T22:24:56.890504+0000 mon.c (mon.2) 503 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:24:58.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:57 smithi050 bash[21866]: audit 2024-05-20T22:24:56.891116+0000 mon.a (mon.0) 3600 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:24:58.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:57 smithi050 bash[28929]: cluster 2024-05-20T22:24:56.634843+0000 mgr.y (mgr.14592) 710 : cluster 0 pgmap v1194: 364 pgs: 364 active+clean; 4.4 MiB data, 701 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-05-20T22:24:58.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:57 smithi050 bash[28929]: cluster 2024-05-20T22:24:56.785774+0000 mon.a (mon.0) 3597 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-05-20T22:24:58.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:57 smithi050 bash[28929]: audit 2024-05-20T22:24:56.788268+0000 mon.a (mon.0) 3598 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi050-64110-146", "mode": "writeback"}]': finished 2024-05-20T22:24:58.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:57 smithi050 bash[28929]: cluster 2024-05-20T22:24:56.796819+0000 mon.a (mon.0) 3599 : cluster 0 osdmap e733: 8 total, 8 up, 8 in 2024-05-20T22:24:58.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:57 smithi050 bash[28929]: audit 2024-05-20T22:24:56.890504+0000 mon.c (mon.2) 503 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:24:58.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:57 smithi050 bash[28929]: audit 2024-05-20T22:24:56.891116+0000 mon.a (mon.0) 3600 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_count","val": "2"}]: dispatch 2024-05-20T22:24:58.821 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:24:58 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:24:59.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:58 smithi145 bash[23893]: audit 2024-05-20T22:24:57.805188+0000 mon.a (mon.0) 3601 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:24:59.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:58 smithi145 bash[23893]: cluster 2024-05-20T22:24:57.811761+0000 mon.a (mon.0) 3602 : cluster 0 osdmap e734: 8 total, 8 up, 8 in 2024-05-20T22:24:59.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:58 smithi145 bash[23893]: audit 2024-05-20T22:24:57.815703+0000 mon.c (mon.2) 504 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:24:59.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:58 smithi145 bash[23893]: audit 2024-05-20T22:24:57.829525+0000 mon.a (mon.0) 3603 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:24:59.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:58 smithi050 bash[21866]: audit 2024-05-20T22:24:57.805188+0000 mon.a (mon.0) 3601 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:24:59.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:58 smithi050 bash[21866]: cluster 2024-05-20T22:24:57.811761+0000 mon.a (mon.0) 3602 : cluster 0 osdmap e734: 8 total, 8 up, 8 in 2024-05-20T22:24:59.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:58 smithi050 bash[21866]: audit 2024-05-20T22:24:57.815703+0000 mon.c (mon.2) 504 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:24:59.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:58 smithi050 bash[21866]: audit 2024-05-20T22:24:57.829525+0000 mon.a (mon.0) 3603 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:24:59.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:58 smithi050 bash[28929]: audit 2024-05-20T22:24:57.805188+0000 mon.a (mon.0) 3601 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_count","val": "2"}]': finished 2024-05-20T22:24:59.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:58 smithi050 bash[28929]: cluster 2024-05-20T22:24:57.811761+0000 mon.a (mon.0) 3602 : cluster 0 osdmap e734: 8 total, 8 up, 8 in 2024-05-20T22:24:59.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:58 smithi050 bash[28929]: audit 2024-05-20T22:24:57.815703+0000 mon.c (mon.2) 504 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:24:59.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:58 smithi050 bash[28929]: audit 2024-05-20T22:24:57.829525+0000 mon.a (mon.0) 3603 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_period","val": "600"}]: dispatch 2024-05-20T22:24:59.694 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:24:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:24:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:25:00.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:59 smithi145 bash[23893]: audit 2024-05-20T22:24:58.456532+0000 mgr.y (mgr.14592) 711 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:25:00.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:59 smithi145 bash[23893]: cluster 2024-05-20T22:24:58.636023+0000 mgr.y (mgr.14592) 712 : cluster 0 pgmap v1197: 364 pgs: 364 active+clean; 4.4 MiB data, 701 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-05-20T22:25:00.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:59 smithi145 bash[23893]: audit 2024-05-20T22:24:58.827075+0000 mon.a (mon.0) 3604 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:25:00.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:59 smithi145 bash[23893]: cluster 2024-05-20T22:24:58.836626+0000 mon.a (mon.0) 3605 : cluster 0 osdmap e735: 8 total, 8 up, 8 in 2024-05-20T22:25:00.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:59 smithi145 bash[23893]: audit 2024-05-20T22:24:58.837453+0000 mon.c (mon.2) 505 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:25:00.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:59 smithi145 bash[23893]: audit 2024-05-20T22:24:58.838486+0000 mon.a (mon.0) 3606 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:25:00.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:24:59 smithi145 bash[23893]: audit 2024-05-20T22:24:59.393170+0000 mon.a (mon.0) 3607 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:25:00.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:59 smithi050 bash[28929]: audit 2024-05-20T22:24:58.456532+0000 mgr.y (mgr.14592) 711 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:25:00.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:59 smithi050 bash[28929]: cluster 2024-05-20T22:24:58.636023+0000 mgr.y (mgr.14592) 712 : cluster 0 pgmap v1197: 364 pgs: 364 active+clean; 4.4 MiB data, 701 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-05-20T22:25:00.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:59 smithi050 bash[28929]: audit 2024-05-20T22:24:58.827075+0000 mon.a (mon.0) 3604 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:25:00.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:59 smithi050 bash[28929]: cluster 2024-05-20T22:24:58.836626+0000 mon.a (mon.0) 3605 : cluster 0 osdmap e735: 8 total, 8 up, 8 in 2024-05-20T22:25:00.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:59 smithi050 bash[28929]: audit 2024-05-20T22:24:58.837453+0000 mon.c (mon.2) 505 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:25:00.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:59 smithi050 bash[28929]: audit 2024-05-20T22:24:58.838486+0000 mon.a (mon.0) 3606 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:25:00.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:24:59 smithi050 bash[28929]: audit 2024-05-20T22:24:59.393170+0000 mon.a (mon.0) 3607 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:25:00.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:59 smithi050 bash[21866]: audit 2024-05-20T22:24:58.456532+0000 mgr.y (mgr.14592) 711 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:25:00.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:59 smithi050 bash[21866]: cluster 2024-05-20T22:24:58.636023+0000 mgr.y (mgr.14592) 712 : cluster 0 pgmap v1197: 364 pgs: 364 active+clean; 4.4 MiB data, 701 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-05-20T22:25:00.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:59 smithi050 bash[21866]: audit 2024-05-20T22:24:58.827075+0000 mon.a (mon.0) 3604 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_period","val": "600"}]': finished 2024-05-20T22:25:00.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:59 smithi050 bash[21866]: cluster 2024-05-20T22:24:58.836626+0000 mon.a (mon.0) 3605 : cluster 0 osdmap e735: 8 total, 8 up, 8 in 2024-05-20T22:25:00.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:59 smithi050 bash[21866]: audit 2024-05-20T22:24:58.837453+0000 mon.c (mon.2) 505 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:25:00.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:59 smithi050 bash[21866]: audit 2024-05-20T22:24:58.838486+0000 mon.a (mon.0) 3606 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-05-20T22:25:00.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:24:59 smithi050 bash[21866]: audit 2024-05-20T22:24:59.393170+0000 mon.a (mon.0) 3607 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:25:01.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:00 smithi145 bash[23893]: cluster 2024-05-20T22:24:59.827532+0000 mon.a (mon.0) 3608 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:25:01.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:00 smithi145 bash[23893]: audit 2024-05-20T22:24:59.829778+0000 mon.a (mon.0) 3609 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:25:01.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:00 smithi145 bash[23893]: cluster 2024-05-20T22:24:59.839097+0000 mon.a (mon.0) 3610 : cluster 0 osdmap e736: 8 total, 8 up, 8 in 2024-05-20T22:25:01.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:00 smithi145 bash[23893]: audit 2024-05-20T22:24:59.839692+0000 mon.c (mon.2) 506 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-05-20T22:25:01.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:00 smithi145 bash[23893]: audit 2024-05-20T22:24:59.841611+0000 mon.a (mon.0) 3611 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-05-20T22:25:01.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:00 smithi145 bash[23893]: audit 2024-05-20T22:25:00.133479+0000 mon.a (mon.0) 3612 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:25:01.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:00 smithi145 bash[23893]: audit 2024-05-20T22:25:00.134475+0000 mon.a (mon.0) 3613 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:25:01.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:00 smithi145 bash[23893]: audit 2024-05-20T22:25:00.143054+0000 mon.a (mon.0) 3614 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:25:01.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:00 smithi145 bash[23893]: cluster 2024-05-20T22:25:00.639246+0000 mgr.y (mgr.14592) 713 : cluster 0 pgmap v1200: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-20T22:25:01.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:00 smithi145 bash[23893]: audit 2024-05-20T22:25:00.832507+0000 mon.a (mon.0) 3615 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-05-20T22:25:01.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:00 smithi145 bash[23893]: cluster 2024-05-20T22:25:00.839571+0000 mon.a (mon.0) 3616 : cluster 0 osdmap e737: 8 total, 8 up, 8 in 2024-05-20T22:25:01.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:00 smithi145 bash[23893]: audit 2024-05-20T22:25:00.843286+0000 mon.a (mon.0) 3617 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "target_max_objects","val": "1"}]: dispatch 2024-05-20T22:25:01.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:00 smithi050 bash[21866]: cluster 2024-05-20T22:24:59.827532+0000 mon.a (mon.0) 3608 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:25:01.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:00 smithi050 bash[21866]: audit 2024-05-20T22:24:59.829778+0000 mon.a (mon.0) 3609 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:25:01.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:00 smithi050 bash[21866]: cluster 2024-05-20T22:24:59.839097+0000 mon.a (mon.0) 3610 : cluster 0 osdmap e736: 8 total, 8 up, 8 in 2024-05-20T22:25:01.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:00 smithi050 bash[21866]: audit 2024-05-20T22:24:59.839692+0000 mon.c (mon.2) 506 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-05-20T22:25:01.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:00 smithi050 bash[21866]: audit 2024-05-20T22:24:59.841611+0000 mon.a (mon.0) 3611 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-05-20T22:25:01.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:00 smithi050 bash[21866]: audit 2024-05-20T22:25:00.133479+0000 mon.a (mon.0) 3612 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:25:01.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:00 smithi050 bash[21866]: audit 2024-05-20T22:25:00.134475+0000 mon.a (mon.0) 3613 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:25:01.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:00 smithi050 bash[21866]: audit 2024-05-20T22:25:00.143054+0000 mon.a (mon.0) 3614 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:25:01.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:00 smithi050 bash[21866]: cluster 2024-05-20T22:25:00.639246+0000 mgr.y (mgr.14592) 713 : cluster 0 pgmap v1200: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-20T22:25:01.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:00 smithi050 bash[21866]: audit 2024-05-20T22:25:00.832507+0000 mon.a (mon.0) 3615 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-05-20T22:25:01.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:00 smithi050 bash[21866]: cluster 2024-05-20T22:25:00.839571+0000 mon.a (mon.0) 3616 : cluster 0 osdmap e737: 8 total, 8 up, 8 in 2024-05-20T22:25:01.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:00 smithi050 bash[21866]: audit 2024-05-20T22:25:00.843286+0000 mon.a (mon.0) 3617 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "target_max_objects","val": "1"}]: dispatch 2024-05-20T22:25:01.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:00 smithi050 bash[28929]: cluster 2024-05-20T22:24:59.827532+0000 mon.a (mon.0) 3608 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-05-20T22:25:01.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:00 smithi050 bash[28929]: audit 2024-05-20T22:24:59.829778+0000 mon.a (mon.0) 3609 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "hit_set_type","val": "bloom"}]': finished 2024-05-20T22:25:01.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:00 smithi050 bash[28929]: cluster 2024-05-20T22:24:59.839097+0000 mon.a (mon.0) 3610 : cluster 0 osdmap e736: 8 total, 8 up, 8 in 2024-05-20T22:25:01.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:00 smithi050 bash[28929]: audit 2024-05-20T22:24:59.839692+0000 mon.c (mon.2) 506 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-05-20T22:25:01.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:00 smithi050 bash[28929]: audit 2024-05-20T22:24:59.841611+0000 mon.a (mon.0) 3611 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-05-20T22:25:01.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:00 smithi050 bash[28929]: audit 2024-05-20T22:25:00.133479+0000 mon.a (mon.0) 3612 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:25:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:00 smithi050 bash[28929]: audit 2024-05-20T22:25:00.134475+0000 mon.a (mon.0) 3613 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:25:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:00 smithi050 bash[28929]: audit 2024-05-20T22:25:00.143054+0000 mon.a (mon.0) 3614 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:25:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:00 smithi050 bash[28929]: cluster 2024-05-20T22:25:00.639246+0000 mgr.y (mgr.14592) 713 : cluster 0 pgmap v1200: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-20T22:25:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:00 smithi050 bash[28929]: audit 2024-05-20T22:25:00.832507+0000 mon.a (mon.0) 3615 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-05-20T22:25:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:00 smithi050 bash[28929]: cluster 2024-05-20T22:25:00.839571+0000 mon.a (mon.0) 3616 : cluster 0 osdmap e737: 8 total, 8 up, 8 in 2024-05-20T22:25:01.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:00 smithi050 bash[28929]: audit 2024-05-20T22:25:00.843286+0000 mon.a (mon.0) 3617 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "target_max_objects","val": "1"}]: dispatch 2024-05-20T22:25:02.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:01 smithi145 bash[23893]: audit 2024-05-20T22:25:00.841308+0000 mon.c (mon.2) 507 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "target_max_objects","val": "1"}]: dispatch 2024-05-20T22:25:02.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:01 smithi145 bash[23893]: audit 2024-05-20T22:25:01.835059+0000 mon.a (mon.0) 3618 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "target_max_objects","val": "1"}]': finished 2024-05-20T22:25:02.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:01 smithi145 bash[23893]: cluster 2024-05-20T22:25:01.841677+0000 mon.a (mon.0) 3619 : cluster 0 osdmap e738: 8 total, 8 up, 8 in 2024-05-20T22:25:02.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:01 smithi050 bash[21866]: audit 2024-05-20T22:25:00.841308+0000 mon.c (mon.2) 507 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "target_max_objects","val": "1"}]: dispatch 2024-05-20T22:25:02.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:01 smithi050 bash[21866]: audit 2024-05-20T22:25:01.835059+0000 mon.a (mon.0) 3618 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "target_max_objects","val": "1"}]': finished 2024-05-20T22:25:02.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:01 smithi050 bash[21866]: cluster 2024-05-20T22:25:01.841677+0000 mon.a (mon.0) 3619 : cluster 0 osdmap e738: 8 total, 8 up, 8 in 2024-05-20T22:25:02.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:01 smithi050 bash[28929]: audit 2024-05-20T22:25:00.841308+0000 mon.c (mon.2) 507 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "target_max_objects","val": "1"}]: dispatch 2024-05-20T22:25:02.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:01 smithi050 bash[28929]: audit 2024-05-20T22:25:01.835059+0000 mon.a (mon.0) 3618 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-146","var": "target_max_objects","val": "1"}]': finished 2024-05-20T22:25:02.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:01 smithi050 bash[28929]: cluster 2024-05-20T22:25:01.841677+0000 mon.a (mon.0) 3619 : cluster 0 osdmap e738: 8 total, 8 up, 8 in 2024-05-20T22:25:03.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:02 smithi145 bash[23893]: cluster 2024-05-20T22:25:02.640376+0000 mgr.y (mgr.14592) 714 : cluster 0 pgmap v1203: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-20T22:25:03.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:02 smithi050 bash[21866]: cluster 2024-05-20T22:25:02.640376+0000 mgr.y (mgr.14592) 714 : cluster 0 pgmap v1203: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-20T22:25:03.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:02 smithi050 bash[28929]: cluster 2024-05-20T22:25:02.640376+0000 mgr.y (mgr.14592) 714 : cluster 0 pgmap v1203: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-20T22:25:04.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:03 smithi145 bash[23893]: cluster 2024-05-20T22:25:02.850755+0000 mon.a (mon.0) 3620 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-05-20T22:25:04.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:03 smithi050 bash[21866]: cluster 2024-05-20T22:25:02.850755+0000 mon.a (mon.0) 3620 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-05-20T22:25:04.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:03 smithi050 bash[28929]: cluster 2024-05-20T22:25:02.850755+0000 mon.a (mon.0) 3620 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-05-20T22:25:05.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:04 smithi145 bash[23893]: cluster 2024-05-20T22:25:04.641382+0000 mgr.y (mgr.14592) 715 : cluster 0 pgmap v1204: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-20T22:25:05.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:04 smithi050 bash[21866]: cluster 2024-05-20T22:25:04.641382+0000 mgr.y (mgr.14592) 715 : cluster 0 pgmap v1204: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-20T22:25:05.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:04 smithi050 bash[28929]: cluster 2024-05-20T22:25:04.641382+0000 mgr.y (mgr.14592) 715 : cluster 0 pgmap v1204: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-20T22:25:08.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:07 smithi145 bash[23893]: cluster 2024-05-20T22:25:06.644932+0000 mgr.y (mgr.14592) 716 : cluster 0 pgmap v1205: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-20T22:25:08.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:07 smithi050 bash[21866]: cluster 2024-05-20T22:25:06.644932+0000 mgr.y (mgr.14592) 716 : cluster 0 pgmap v1205: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-20T22:25:08.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:07 smithi050 bash[28929]: cluster 2024-05-20T22:25:06.644932+0000 mgr.y (mgr.14592) 716 : cluster 0 pgmap v1205: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-20T22:25:08.889 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:25:08 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:25:09.691 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:25:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:25:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:25:10.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:09 smithi145 bash[23893]: audit 2024-05-20T22:25:08.467855+0000 mgr.y (mgr.14592) 717 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:25:10.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:09 smithi145 bash[23893]: cluster 2024-05-20T22:25:08.645947+0000 mgr.y (mgr.14592) 718 : cluster 0 pgmap v1206: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-05-20T22:25:10.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:09 smithi145 bash[23893]: audit 2024-05-20T22:25:08.949396+0000 mon.a (mon.0) 3621 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:25:10.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:09 smithi145 bash[23893]: audit 2024-05-20T22:25:08.952390+0000 mon.a (mon.0) 3622 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:25:10.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:09 smithi050 bash[21866]: audit 2024-05-20T22:25:08.467855+0000 mgr.y (mgr.14592) 717 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:25:10.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:09 smithi050 bash[21866]: cluster 2024-05-20T22:25:08.645947+0000 mgr.y (mgr.14592) 718 : cluster 0 pgmap v1206: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-05-20T22:25:10.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:09 smithi050 bash[21866]: audit 2024-05-20T22:25:08.949396+0000 mon.a (mon.0) 3621 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:25:10.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:09 smithi050 bash[21866]: audit 2024-05-20T22:25:08.952390+0000 mon.a (mon.0) 3622 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:25:10.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:09 smithi050 bash[28929]: audit 2024-05-20T22:25:08.467855+0000 mgr.y (mgr.14592) 717 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:25:10.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:09 smithi050 bash[28929]: cluster 2024-05-20T22:25:08.645947+0000 mgr.y (mgr.14592) 718 : cluster 0 pgmap v1206: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-05-20T22:25:10.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:09 smithi050 bash[28929]: audit 2024-05-20T22:25:08.949396+0000 mon.a (mon.0) 3621 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:25:10.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:09 smithi050 bash[28929]: audit 2024-05-20T22:25:08.952390+0000 mon.a (mon.0) 3622 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:25:12.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:11 smithi145 bash[23893]: cluster 2024-05-20T22:25:10.649226+0000 mgr.y (mgr.14592) 719 : cluster 0 pgmap v1207: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:25:12.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:11 smithi050 bash[28929]: cluster 2024-05-20T22:25:10.649226+0000 mgr.y (mgr.14592) 719 : cluster 0 pgmap v1207: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:25:12.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:11 smithi050 bash[21866]: cluster 2024-05-20T22:25:10.649226+0000 mgr.y (mgr.14592) 719 : cluster 0 pgmap v1207: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:25:13.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:12 smithi145 bash[23893]: audit 2024-05-20T22:25:11.874783+0000 mon.c (mon.2) 508 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:13.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:12 smithi145 bash[23893]: audit 2024-05-20T22:25:11.875463+0000 mon.a (mon.0) 3623 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:13.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:12 smithi050 bash[21866]: audit 2024-05-20T22:25:11.874783+0000 mon.c (mon.2) 508 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:13.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:12 smithi050 bash[21866]: audit 2024-05-20T22:25:11.875463+0000 mon.a (mon.0) 3623 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:13.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:12 smithi050 bash[28929]: audit 2024-05-20T22:25:11.874783+0000 mon.c (mon.2) 508 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:13.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:12 smithi050 bash[28929]: audit 2024-05-20T22:25:11.875463+0000 mon.a (mon.0) 3623 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:14.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:13 smithi145 bash[23893]: cluster 2024-05-20T22:25:12.650359+0000 mgr.y (mgr.14592) 720 : cluster 0 pgmap v1208: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:25:14.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:13 smithi145 bash[23893]: audit 2024-05-20T22:25:12.720550+0000 mon.a (mon.0) 3624 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:25:14.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:13 smithi145 bash[23893]: cluster 2024-05-20T22:25:12.727740+0000 mon.a (mon.0) 3625 : cluster 0 osdmap e739: 8 total, 8 up, 8 in 2024-05-20T22:25:14.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:13 smithi145 bash[23893]: audit 2024-05-20T22:25:12.731183+0000 mon.c (mon.2) 509 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146"}]: dispatch 2024-05-20T22:25:14.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:13 smithi145 bash[23893]: audit 2024-05-20T22:25:12.732014+0000 mon.a (mon.0) 3626 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146"}]: dispatch 2024-05-20T22:25:14.191 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.191 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:25:14.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:13 smithi050 bash[21866]: cluster 2024-05-20T22:25:12.650359+0000 mgr.y (mgr.14592) 720 : cluster 0 pgmap v1208: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:25:14.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:13 smithi050 bash[21866]: audit 2024-05-20T22:25:12.720550+0000 mon.a (mon.0) 3624 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:25:14.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:13 smithi050 bash[21866]: cluster 2024-05-20T22:25:12.727740+0000 mon.a (mon.0) 3625 : cluster 0 osdmap e739: 8 total, 8 up, 8 in 2024-05-20T22:25:14.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:13 smithi050 bash[21866]: audit 2024-05-20T22:25:12.731183+0000 mon.c (mon.2) 509 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146"}]: dispatch 2024-05-20T22:25:14.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:13 smithi050 bash[21866]: audit 2024-05-20T22:25:12.732014+0000 mon.a (mon.0) 3626 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146"}]: dispatch 2024-05-20T22:25:14.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:13 smithi050 bash[28929]: cluster 2024-05-20T22:25:12.650359+0000 mgr.y (mgr.14592) 720 : cluster 0 pgmap v1208: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 B/s wr, 1 op/s 2024-05-20T22:25:14.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:13 smithi050 bash[28929]: audit 2024-05-20T22:25:12.720550+0000 mon.a (mon.0) 3624 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:25:14.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:13 smithi050 bash[28929]: cluster 2024-05-20T22:25:12.727740+0000 mon.a (mon.0) 3625 : cluster 0 osdmap e739: 8 total, 8 up, 8 in 2024-05-20T22:25:14.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:13 smithi050 bash[28929]: audit 2024-05-20T22:25:12.731183+0000 mon.c (mon.2) 509 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146"}]: dispatch 2024-05-20T22:25:14.200 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:13 smithi050 bash[28929]: audit 2024-05-20T22:25:12.732014+0000 mon.a (mon.0) 3626 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146"}]: dispatch 2024-05-20T22:25:15.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:14 smithi145 bash[23893]: audit 2024-05-20T22:25:13.732219+0000 mon.a (mon.0) 3627 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146"}]': finished 2024-05-20T22:25:15.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:14 smithi145 bash[23893]: cluster 2024-05-20T22:25:13.739788+0000 mon.a (mon.0) 3628 : cluster 0 osdmap e740: 8 total, 8 up, 8 in 2024-05-20T22:25:15.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:14 smithi145 bash[23893]: audit 2024-05-20T22:25:13.819430+0000 mon.c (mon.2) 510 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:15.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:14 smithi145 bash[23893]: audit 2024-05-20T22:25:13.820318+0000 mon.a (mon.0) 3629 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:15.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:14 smithi145 bash[23893]: audit 2024-05-20T22:25:13.821514+0000 mon.c (mon.2) 511 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146"}]: dispatch 2024-05-20T22:25:15.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:14 smithi145 bash[23893]: audit 2024-05-20T22:25:13.822307+0000 mon.a (mon.0) 3630 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146"}]: dispatch 2024-05-20T22:25:15.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:14 smithi050 bash[21866]: audit 2024-05-20T22:25:13.732219+0000 mon.a (mon.0) 3627 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146"}]': finished 2024-05-20T22:25:15.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:14 smithi050 bash[21866]: cluster 2024-05-20T22:25:13.739788+0000 mon.a (mon.0) 3628 : cluster 0 osdmap e740: 8 total, 8 up, 8 in 2024-05-20T22:25:15.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:14 smithi050 bash[21866]: audit 2024-05-20T22:25:13.819430+0000 mon.c (mon.2) 510 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:15.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:14 smithi050 bash[21866]: audit 2024-05-20T22:25:13.820318+0000 mon.a (mon.0) 3629 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:15.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:14 smithi050 bash[21866]: audit 2024-05-20T22:25:13.821514+0000 mon.c (mon.2) 511 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146"}]: dispatch 2024-05-20T22:25:15.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:14 smithi050 bash[21866]: audit 2024-05-20T22:25:13.822307+0000 mon.a (mon.0) 3630 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146"}]: dispatch 2024-05-20T22:25:15.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:14 smithi050 bash[28929]: audit 2024-05-20T22:25:13.732219+0000 mon.a (mon.0) 3627 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146"}]': finished 2024-05-20T22:25:15.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:14 smithi050 bash[28929]: cluster 2024-05-20T22:25:13.739788+0000 mon.a (mon.0) 3628 : cluster 0 osdmap e740: 8 total, 8 up, 8 in 2024-05-20T22:25:15.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:14 smithi050 bash[28929]: audit 2024-05-20T22:25:13.819430+0000 mon.c (mon.2) 510 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:15.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:14 smithi050 bash[28929]: audit 2024-05-20T22:25:13.820318+0000 mon.a (mon.0) 3629 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:15.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:14 smithi050 bash[28929]: audit 2024-05-20T22:25:13.821514+0000 mon.c (mon.2) 511 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146"}]: dispatch 2024-05-20T22:25:15.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:14 smithi050 bash[28929]: audit 2024-05-20T22:25:13.822307+0000 mon.a (mon.0) 3630 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-146"}]: dispatch 2024-05-20T22:25:16.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:15 smithi145 bash[23893]: cluster 2024-05-20T22:25:14.651441+0000 mgr.y (mgr.14592) 721 : cluster 0 pgmap v1211: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:25:16.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:15 smithi145 bash[23893]: cluster 2024-05-20T22:25:14.732173+0000 mon.a (mon.0) 3631 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:25:16.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:15 smithi145 bash[23893]: cluster 2024-05-20T22:25:14.732218+0000 mon.a (mon.0) 3632 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-05-20T22:25:16.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:15 smithi145 bash[23893]: cluster 2024-05-20T22:25:14.751425+0000 mon.a (mon.0) 3633 : cluster 0 osdmap e741: 8 total, 8 up, 8 in 2024-05-20T22:25:16.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:15 smithi050 bash[21866]: cluster 2024-05-20T22:25:14.651441+0000 mgr.y (mgr.14592) 721 : cluster 0 pgmap v1211: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:25:16.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:15 smithi050 bash[21866]: cluster 2024-05-20T22:25:14.732173+0000 mon.a (mon.0) 3631 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:25:16.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:15 smithi050 bash[21866]: cluster 2024-05-20T22:25:14.732218+0000 mon.a (mon.0) 3632 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-05-20T22:25:16.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:15 smithi050 bash[21866]: cluster 2024-05-20T22:25:14.751425+0000 mon.a (mon.0) 3633 : cluster 0 osdmap e741: 8 total, 8 up, 8 in 2024-05-20T22:25:16.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:15 smithi050 bash[28929]: cluster 2024-05-20T22:25:14.651441+0000 mgr.y (mgr.14592) 721 : cluster 0 pgmap v1211: 364 pgs: 364 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:25:16.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:15 smithi050 bash[28929]: cluster 2024-05-20T22:25:14.732173+0000 mon.a (mon.0) 3631 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:25:16.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:15 smithi050 bash[28929]: cluster 2024-05-20T22:25:14.732218+0000 mon.a (mon.0) 3632 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-05-20T22:25:16.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:15 smithi050 bash[28929]: cluster 2024-05-20T22:25:14.751425+0000 mon.a (mon.0) 3633 : cluster 0 osdmap e741: 8 total, 8 up, 8 in 2024-05-20T22:25:17.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:16 smithi145 bash[23893]: cluster 2024-05-20T22:25:15.760143+0000 mon.a (mon.0) 3634 : cluster 0 osdmap e742: 8 total, 8 up, 8 in 2024-05-20T22:25:17.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:16 smithi145 bash[23893]: audit 2024-05-20T22:25:15.780999+0000 mon.c (mon.2) 512 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:17.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:16 smithi145 bash[23893]: audit 2024-05-20T22:25:15.781851+0000 mon.a (mon.0) 3635 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:17.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:16 smithi050 bash[21866]: cluster 2024-05-20T22:25:15.760143+0000 mon.a (mon.0) 3634 : cluster 0 osdmap e742: 8 total, 8 up, 8 in 2024-05-20T22:25:17.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:16 smithi050 bash[21866]: audit 2024-05-20T22:25:15.780999+0000 mon.c (mon.2) 512 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:17.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:16 smithi050 bash[21866]: audit 2024-05-20T22:25:15.781851+0000 mon.a (mon.0) 3635 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:17.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:16 smithi050 bash[28929]: cluster 2024-05-20T22:25:15.760143+0000 mon.a (mon.0) 3634 : cluster 0 osdmap e742: 8 total, 8 up, 8 in 2024-05-20T22:25:17.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:16 smithi050 bash[28929]: audit 2024-05-20T22:25:15.780999+0000 mon.c (mon.2) 512 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:17.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:16 smithi050 bash[28929]: audit 2024-05-20T22:25:15.781851+0000 mon.a (mon.0) 3635 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:18.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:17 smithi145 bash[23893]: cluster 2024-05-20T22:25:16.652484+0000 mgr.y (mgr.14592) 722 : cluster 0 pgmap v1214: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-20T22:25:18.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:17 smithi145 bash[23893]: audit 2024-05-20T22:25:16.762115+0000 mon.a (mon.0) 3636 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:25:18.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:17 smithi145 bash[23893]: cluster 2024-05-20T22:25:16.771331+0000 mon.a (mon.0) 3637 : cluster 0 osdmap e743: 8 total, 8 up, 8 in 2024-05-20T22:25:18.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:17 smithi145 bash[23893]: audit 2024-05-20T22:25:16.826094+0000 mon.c (mon.2) 513 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:25:18.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:17 smithi145 bash[23893]: audit 2024-05-20T22:25:16.826483+0000 mon.a (mon.0) 3638 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:25:18.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:17 smithi050 bash[21866]: cluster 2024-05-20T22:25:16.652484+0000 mgr.y (mgr.14592) 722 : cluster 0 pgmap v1214: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-20T22:25:18.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:17 smithi050 bash[21866]: audit 2024-05-20T22:25:16.762115+0000 mon.a (mon.0) 3636 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:25:18.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:17 smithi050 bash[21866]: cluster 2024-05-20T22:25:16.771331+0000 mon.a (mon.0) 3637 : cluster 0 osdmap e743: 8 total, 8 up, 8 in 2024-05-20T22:25:18.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:17 smithi050 bash[21866]: audit 2024-05-20T22:25:16.826094+0000 mon.c (mon.2) 513 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:25:18.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:17 smithi050 bash[21866]: audit 2024-05-20T22:25:16.826483+0000 mon.a (mon.0) 3638 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:25:18.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:17 smithi050 bash[28929]: cluster 2024-05-20T22:25:16.652484+0000 mgr.y (mgr.14592) 722 : cluster 0 pgmap v1214: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-20T22:25:18.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:17 smithi050 bash[28929]: audit 2024-05-20T22:25:16.762115+0000 mon.a (mon.0) 3636 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:25:18.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:17 smithi050 bash[28929]: cluster 2024-05-20T22:25:16.771331+0000 mon.a (mon.0) 3637 : cluster 0 osdmap e743: 8 total, 8 up, 8 in 2024-05-20T22:25:18.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:17 smithi050 bash[28929]: audit 2024-05-20T22:25:16.826094+0000 mon.c (mon.2) 513 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:25:18.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:17 smithi050 bash[28929]: audit 2024-05-20T22:25:16.826483+0000 mon.a (mon.0) 3638 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-05-20T22:25:18.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:25:18 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:25:19.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:18 smithi145 bash[23893]: audit 2024-05-20T22:25:17.765350+0000 mon.a (mon.0) 3639 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:25:19.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:18 smithi145 bash[23893]: cluster 2024-05-20T22:25:17.772159+0000 mon.a (mon.0) 3640 : cluster 0 osdmap e744: 8 total, 8 up, 8 in 2024-05-20T22:25:19.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:18 smithi145 bash[23893]: audit 2024-05-20T22:25:17.817232+0000 mon.c (mon.2) 514 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148"}]: dispatch 2024-05-20T22:25:19.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:18 smithi145 bash[23893]: audit 2024-05-20T22:25:17.817973+0000 mon.a (mon.0) 3641 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148"}]: dispatch 2024-05-20T22:25:19.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:18 smithi050 bash[21866]: audit 2024-05-20T22:25:17.765350+0000 mon.a (mon.0) 3639 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:25:19.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:18 smithi050 bash[21866]: cluster 2024-05-20T22:25:17.772159+0000 mon.a (mon.0) 3640 : cluster 0 osdmap e744: 8 total, 8 up, 8 in 2024-05-20T22:25:19.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:18 smithi050 bash[21866]: audit 2024-05-20T22:25:17.817232+0000 mon.c (mon.2) 514 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148"}]: dispatch 2024-05-20T22:25:19.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:18 smithi050 bash[21866]: audit 2024-05-20T22:25:17.817973+0000 mon.a (mon.0) 3641 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148"}]: dispatch 2024-05-20T22:25:19.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:18 smithi050 bash[28929]: audit 2024-05-20T22:25:17.765350+0000 mon.a (mon.0) 3639 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148", "force_nonempty": "--force-nonempty" }]': finished 2024-05-20T22:25:19.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:18 smithi050 bash[28929]: cluster 2024-05-20T22:25:17.772159+0000 mon.a (mon.0) 3640 : cluster 0 osdmap e744: 8 total, 8 up, 8 in 2024-05-20T22:25:19.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:18 smithi050 bash[28929]: audit 2024-05-20T22:25:17.817232+0000 mon.c (mon.2) 514 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148"}]: dispatch 2024-05-20T22:25:19.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:18 smithi050 bash[28929]: audit 2024-05-20T22:25:17.817973+0000 mon.a (mon.0) 3641 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148"}]: dispatch 2024-05-20T22:25:19.691 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:25:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:25:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:25:20.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:19 smithi145 bash[23893]: audit 2024-05-20T22:25:18.479358+0000 mgr.y (mgr.14592) 723 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:25:20.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:19 smithi145 bash[23893]: cluster 2024-05-20T22:25:18.653469+0000 mgr.y (mgr.14592) 724 : cluster 0 pgmap v1217: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-20T22:25:20.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:19 smithi145 bash[23893]: audit 2024-05-20T22:25:18.790291+0000 mon.a (mon.0) 3642 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148"}]': finished 2024-05-20T22:25:20.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:19 smithi145 bash[23893]: cluster 2024-05-20T22:25:18.798551+0000 mon.a (mon.0) 3643 : cluster 0 osdmap e745: 8 total, 8 up, 8 in 2024-05-20T22:25:20.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:19 smithi145 bash[23893]: audit 2024-05-20T22:25:18.874166+0000 mon.c (mon.2) 515 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:20.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:19 smithi145 bash[23893]: audit 2024-05-20T22:25:18.874830+0000 mon.a (mon.0) 3644 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:20.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:19 smithi145 bash[23893]: audit 2024-05-20T22:25:18.875984+0000 mon.c (mon.2) 516 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148"}]: dispatch 2024-05-20T22:25:20.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:19 smithi145 bash[23893]: audit 2024-05-20T22:25:18.876591+0000 mon.a (mon.0) 3645 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148"}]: dispatch 2024-05-20T22:25:20.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:19 smithi050 bash[21866]: audit 2024-05-20T22:25:18.479358+0000 mgr.y (mgr.14592) 723 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:25:20.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:19 smithi050 bash[21866]: cluster 2024-05-20T22:25:18.653469+0000 mgr.y (mgr.14592) 724 : cluster 0 pgmap v1217: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-20T22:25:20.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:19 smithi050 bash[21866]: audit 2024-05-20T22:25:18.790291+0000 mon.a (mon.0) 3642 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148"}]': finished 2024-05-20T22:25:20.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:19 smithi050 bash[21866]: cluster 2024-05-20T22:25:18.798551+0000 mon.a (mon.0) 3643 : cluster 0 osdmap e745: 8 total, 8 up, 8 in 2024-05-20T22:25:20.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:19 smithi050 bash[21866]: audit 2024-05-20T22:25:18.874166+0000 mon.c (mon.2) 515 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:20.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:19 smithi050 bash[21866]: audit 2024-05-20T22:25:18.874830+0000 mon.a (mon.0) 3644 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:20.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:19 smithi050 bash[21866]: audit 2024-05-20T22:25:18.875984+0000 mon.c (mon.2) 516 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148"}]: dispatch 2024-05-20T22:25:20.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:19 smithi050 bash[21866]: audit 2024-05-20T22:25:18.876591+0000 mon.a (mon.0) 3645 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148"}]: dispatch 2024-05-20T22:25:20.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:19 smithi050 bash[28929]: audit 2024-05-20T22:25:18.479358+0000 mgr.y (mgr.14592) 723 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:25:20.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:19 smithi050 bash[28929]: cluster 2024-05-20T22:25:18.653469+0000 mgr.y (mgr.14592) 724 : cluster 0 pgmap v1217: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 702 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-20T22:25:20.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:19 smithi050 bash[28929]: audit 2024-05-20T22:25:18.790291+0000 mon.a (mon.0) 3642 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148"}]': finished 2024-05-20T22:25:20.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:19 smithi050 bash[28929]: cluster 2024-05-20T22:25:18.798551+0000 mon.a (mon.0) 3643 : cluster 0 osdmap e745: 8 total, 8 up, 8 in 2024-05-20T22:25:20.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:19 smithi050 bash[28929]: audit 2024-05-20T22:25:18.874166+0000 mon.c (mon.2) 515 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:20.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:19 smithi050 bash[28929]: audit 2024-05-20T22:25:18.874830+0000 mon.a (mon.0) 3644 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:20.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:19 smithi050 bash[28929]: audit 2024-05-20T22:25:18.875984+0000 mon.c (mon.2) 516 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148"}]: dispatch 2024-05-20T22:25:20.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:19 smithi050 bash[28929]: audit 2024-05-20T22:25:18.876591+0000 mon.a (mon.0) 3645 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-148"}]: dispatch 2024-05-20T22:25:21.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:20 smithi145 bash[23893]: cluster 2024-05-20T22:25:19.799713+0000 mon.a (mon.0) 3646 : cluster 0 osdmap e746: 8 total, 8 up, 8 in 2024-05-20T22:25:21.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:20 smithi145 bash[23893]: cluster 2024-05-20T22:25:20.639189+0000 mon.a (mon.0) 3647 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:25:21.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:20 smithi050 bash[21866]: cluster 2024-05-20T22:25:19.799713+0000 mon.a (mon.0) 3646 : cluster 0 osdmap e746: 8 total, 8 up, 8 in 2024-05-20T22:25:21.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:20 smithi050 bash[21866]: cluster 2024-05-20T22:25:20.639189+0000 mon.a (mon.0) 3647 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:25:21.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:20 smithi050 bash[28929]: cluster 2024-05-20T22:25:19.799713+0000 mon.a (mon.0) 3646 : cluster 0 osdmap e746: 8 total, 8 up, 8 in 2024-05-20T22:25:21.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:20 smithi050 bash[28929]: cluster 2024-05-20T22:25:20.639189+0000 mon.a (mon.0) 3647 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:25:22.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:21 smithi145 bash[23893]: cluster 2024-05-20T22:25:20.656558+0000 mgr.y (mgr.14592) 725 : cluster 0 pgmap v1220: 332 pgs: 332 active+clean; 4.4 MiB data, 707 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:25:22.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:21 smithi145 bash[23893]: cluster 2024-05-20T22:25:20.826367+0000 mon.a (mon.0) 3648 : cluster 0 osdmap e747: 8 total, 8 up, 8 in 2024-05-20T22:25:22.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:21 smithi145 bash[23893]: audit 2024-05-20T22:25:20.829939+0000 mon.c (mon.2) 517 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:22.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:21 smithi145 bash[23893]: audit 2024-05-20T22:25:20.831667+0000 mon.a (mon.0) 3649 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:22.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:21 smithi050 bash[28929]: cluster 2024-05-20T22:25:20.656558+0000 mgr.y (mgr.14592) 725 : cluster 0 pgmap v1220: 332 pgs: 332 active+clean; 4.4 MiB data, 707 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:25:22.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:21 smithi050 bash[28929]: cluster 2024-05-20T22:25:20.826367+0000 mon.a (mon.0) 3648 : cluster 0 osdmap e747: 8 total, 8 up, 8 in 2024-05-20T22:25:22.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:21 smithi050 bash[28929]: audit 2024-05-20T22:25:20.829939+0000 mon.c (mon.2) 517 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:22.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:21 smithi050 bash[28929]: audit 2024-05-20T22:25:20.831667+0000 mon.a (mon.0) 3649 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:22.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:21 smithi050 bash[21866]: cluster 2024-05-20T22:25:20.656558+0000 mgr.y (mgr.14592) 725 : cluster 0 pgmap v1220: 332 pgs: 332 active+clean; 4.4 MiB data, 707 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:25:22.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:21 smithi050 bash[21866]: cluster 2024-05-20T22:25:20.826367+0000 mon.a (mon.0) 3648 : cluster 0 osdmap e747: 8 total, 8 up, 8 in 2024-05-20T22:25:22.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:21 smithi050 bash[21866]: audit 2024-05-20T22:25:20.829939+0000 mon.c (mon.2) 517 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:22.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:21 smithi050 bash[21866]: audit 2024-05-20T22:25:20.831667+0000 mon.a (mon.0) 3649 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:23.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:22 smithi145 bash[23893]: audit 2024-05-20T22:25:21.827778+0000 mon.a (mon.0) 3650 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:25:23.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:22 smithi145 bash[23893]: cluster 2024-05-20T22:25:21.835511+0000 mon.a (mon.0) 3651 : cluster 0 osdmap e748: 8 total, 8 up, 8 in 2024-05-20T22:25:23.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:22 smithi145 bash[23893]: audit 2024-05-20T22:25:21.966646+0000 mon.c (mon.2) 518 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:23.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:22 smithi145 bash[23893]: audit 2024-05-20T22:25:21.967300+0000 mon.a (mon.0) 3652 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:23.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:22 smithi145 bash[23893]: audit 2024-05-20T22:25:21.968391+0000 mon.c (mon.2) 519 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-150"}]: dispatch 2024-05-20T22:25:23.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:22 smithi145 bash[23893]: audit 2024-05-20T22:25:21.968974+0000 mon.a (mon.0) 3653 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-150"}]: dispatch 2024-05-20T22:25:23.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:22 smithi050 bash[21866]: audit 2024-05-20T22:25:21.827778+0000 mon.a (mon.0) 3650 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:25:23.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:22 smithi050 bash[21866]: cluster 2024-05-20T22:25:21.835511+0000 mon.a (mon.0) 3651 : cluster 0 osdmap e748: 8 total, 8 up, 8 in 2024-05-20T22:25:23.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:22 smithi050 bash[21866]: audit 2024-05-20T22:25:21.966646+0000 mon.c (mon.2) 518 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:23.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:22 smithi050 bash[21866]: audit 2024-05-20T22:25:21.967300+0000 mon.a (mon.0) 3652 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:23.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:22 smithi050 bash[21866]: audit 2024-05-20T22:25:21.968391+0000 mon.c (mon.2) 519 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-150"}]: dispatch 2024-05-20T22:25:23.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:22 smithi050 bash[21866]: audit 2024-05-20T22:25:21.968974+0000 mon.a (mon.0) 3653 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-150"}]: dispatch 2024-05-20T22:25:23.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:22 smithi050 bash[28929]: audit 2024-05-20T22:25:21.827778+0000 mon.a (mon.0) 3650 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:25:23.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:22 smithi050 bash[28929]: cluster 2024-05-20T22:25:21.835511+0000 mon.a (mon.0) 3651 : cluster 0 osdmap e748: 8 total, 8 up, 8 in 2024-05-20T22:25:23.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:22 smithi050 bash[28929]: audit 2024-05-20T22:25:21.966646+0000 mon.c (mon.2) 518 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:23.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:22 smithi050 bash[28929]: audit 2024-05-20T22:25:21.967300+0000 mon.a (mon.0) 3652 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:23.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:22 smithi050 bash[28929]: audit 2024-05-20T22:25:21.968391+0000 mon.c (mon.2) 519 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-150"}]: dispatch 2024-05-20T22:25:23.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:22 smithi050 bash[28929]: audit 2024-05-20T22:25:21.968974+0000 mon.a (mon.0) 3653 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-150"}]: dispatch 2024-05-20T22:25:24.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:23 smithi145 bash[23893]: cluster 2024-05-20T22:25:22.657517+0000 mgr.y (mgr.14592) 726 : cluster 0 pgmap v1223: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 707 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:25:24.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:23 smithi145 bash[23893]: cluster 2024-05-20T22:25:22.845922+0000 mon.a (mon.0) 3654 : cluster 0 osdmap e749: 8 total, 8 up, 8 in 2024-05-20T22:25:24.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:23 smithi050 bash[21866]: cluster 2024-05-20T22:25:22.657517+0000 mgr.y (mgr.14592) 726 : cluster 0 pgmap v1223: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 707 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:25:24.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:23 smithi050 bash[21866]: cluster 2024-05-20T22:25:22.845922+0000 mon.a (mon.0) 3654 : cluster 0 osdmap e749: 8 total, 8 up, 8 in 2024-05-20T22:25:24.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:23 smithi050 bash[28929]: cluster 2024-05-20T22:25:22.657517+0000 mgr.y (mgr.14592) 726 : cluster 0 pgmap v1223: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 707 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:25:24.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:23 smithi050 bash[28929]: cluster 2024-05-20T22:25:22.845922+0000 mon.a (mon.0) 3654 : cluster 0 osdmap e749: 8 total, 8 up, 8 in 2024-05-20T22:25:25.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:24 smithi145 bash[23893]: cluster 2024-05-20T22:25:23.849607+0000 mon.a (mon.0) 3655 : cluster 0 osdmap e750: 8 total, 8 up, 8 in 2024-05-20T22:25:25.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:24 smithi145 bash[23893]: audit 2024-05-20T22:25:23.871312+0000 mon.c (mon.2) 520 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:25.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:24 smithi145 bash[23893]: audit 2024-05-20T22:25:23.875133+0000 mon.a (mon.0) 3656 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:25.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:24 smithi145 bash[23893]: audit 2024-05-20T22:25:23.991835+0000 mon.a (mon.0) 3657 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:25:25.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:24 smithi145 bash[23893]: audit 2024-05-20T22:25:23.994366+0000 mon.a (mon.0) 3658 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:25:25.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:24 smithi145 bash[23893]: cluster 2024-05-20T22:25:24.658477+0000 mgr.y (mgr.14592) 727 : cluster 0 pgmap v1226: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 707 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:25:25.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:24 smithi145 bash[23893]: audit 2024-05-20T22:25:24.844321+0000 mon.a (mon.0) 3659 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:25:25.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:24 smithi145 bash[23893]: cluster 2024-05-20T22:25:24.852673+0000 mon.a (mon.0) 3660 : cluster 0 osdmap e751: 8 total, 8 up, 8 in 2024-05-20T22:25:25.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:24 smithi050 bash[21866]: cluster 2024-05-20T22:25:23.849607+0000 mon.a (mon.0) 3655 : cluster 0 osdmap e750: 8 total, 8 up, 8 in 2024-05-20T22:25:25.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:24 smithi050 bash[21866]: audit 2024-05-20T22:25:23.871312+0000 mon.c (mon.2) 520 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:25.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:24 smithi050 bash[21866]: audit 2024-05-20T22:25:23.875133+0000 mon.a (mon.0) 3656 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:25.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:24 smithi050 bash[21866]: audit 2024-05-20T22:25:23.991835+0000 mon.a (mon.0) 3657 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:25:25.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:24 smithi050 bash[21866]: audit 2024-05-20T22:25:23.994366+0000 mon.a (mon.0) 3658 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:25:25.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:24 smithi050 bash[21866]: cluster 2024-05-20T22:25:24.658477+0000 mgr.y (mgr.14592) 727 : cluster 0 pgmap v1226: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 707 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:25:25.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:24 smithi050 bash[21866]: audit 2024-05-20T22:25:24.844321+0000 mon.a (mon.0) 3659 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:25:25.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:24 smithi050 bash[21866]: cluster 2024-05-20T22:25:24.852673+0000 mon.a (mon.0) 3660 : cluster 0 osdmap e751: 8 total, 8 up, 8 in 2024-05-20T22:25:25.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:24 smithi050 bash[28929]: cluster 2024-05-20T22:25:23.849607+0000 mon.a (mon.0) 3655 : cluster 0 osdmap e750: 8 total, 8 up, 8 in 2024-05-20T22:25:25.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:24 smithi050 bash[28929]: audit 2024-05-20T22:25:23.871312+0000 mon.c (mon.2) 520 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:25.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:24 smithi050 bash[28929]: audit 2024-05-20T22:25:23.875133+0000 mon.a (mon.0) 3656 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:25.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:24 smithi050 bash[28929]: audit 2024-05-20T22:25:23.991835+0000 mon.a (mon.0) 3657 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:25:25.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:24 smithi050 bash[28929]: audit 2024-05-20T22:25:23.994366+0000 mon.a (mon.0) 3658 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:25:25.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:24 smithi050 bash[28929]: cluster 2024-05-20T22:25:24.658477+0000 mgr.y (mgr.14592) 727 : cluster 0 pgmap v1226: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 707 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:25:25.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:24 smithi050 bash[28929]: audit 2024-05-20T22:25:24.844321+0000 mon.a (mon.0) 3659 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:25:25.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:24 smithi050 bash[28929]: cluster 2024-05-20T22:25:24.852673+0000 mon.a (mon.0) 3660 : cluster 0 osdmap e751: 8 total, 8 up, 8 in 2024-05-20T22:25:26.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:26 smithi145 bash[23893]: audit 2024-05-20T22:25:24.957978+0000 mon.c (mon.2) 521 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:26.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:26 smithi145 bash[23893]: audit 2024-05-20T22:25:24.958327+0000 mon.a (mon.0) 3661 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:26.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:26 smithi145 bash[23893]: audit 2024-05-20T22:25:24.958894+0000 mon.c (mon.2) 522 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-152"}]: dispatch 2024-05-20T22:25:26.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:26 smithi145 bash[23893]: audit 2024-05-20T22:25:24.959182+0000 mon.a (mon.0) 3662 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-152"}]: dispatch 2024-05-20T22:25:26.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:26 smithi145 bash[23893]: cluster 2024-05-20T22:25:25.642223+0000 mon.a (mon.0) 3663 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:25:26.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:26 smithi145 bash[23893]: cluster 2024-05-20T22:25:25.854495+0000 mon.a (mon.0) 3664 : cluster 0 osdmap e752: 8 total, 8 up, 8 in 2024-05-20T22:25:26.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:26 smithi050 bash[21866]: audit 2024-05-20T22:25:24.957978+0000 mon.c (mon.2) 521 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:26.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:26 smithi050 bash[21866]: audit 2024-05-20T22:25:24.958327+0000 mon.a (mon.0) 3661 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:26.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:26 smithi050 bash[21866]: audit 2024-05-20T22:25:24.958894+0000 mon.c (mon.2) 522 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-152"}]: dispatch 2024-05-20T22:25:26.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:26 smithi050 bash[21866]: audit 2024-05-20T22:25:24.959182+0000 mon.a (mon.0) 3662 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-152"}]: dispatch 2024-05-20T22:25:26.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:26 smithi050 bash[21866]: cluster 2024-05-20T22:25:25.642223+0000 mon.a (mon.0) 3663 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:25:26.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:26 smithi050 bash[21866]: cluster 2024-05-20T22:25:25.854495+0000 mon.a (mon.0) 3664 : cluster 0 osdmap e752: 8 total, 8 up, 8 in 2024-05-20T22:25:26.692 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:26 smithi050 bash[28929]: audit 2024-05-20T22:25:24.957978+0000 mon.c (mon.2) 521 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:26.692 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:26 smithi050 bash[28929]: audit 2024-05-20T22:25:24.958327+0000 mon.a (mon.0) 3661 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:26.692 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:26 smithi050 bash[28929]: audit 2024-05-20T22:25:24.958894+0000 mon.c (mon.2) 522 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-152"}]: dispatch 2024-05-20T22:25:26.692 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:26 smithi050 bash[28929]: audit 2024-05-20T22:25:24.959182+0000 mon.a (mon.0) 3662 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-152"}]: dispatch 2024-05-20T22:25:26.692 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:26 smithi050 bash[28929]: cluster 2024-05-20T22:25:25.642223+0000 mon.a (mon.0) 3663 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:25:26.692 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:26 smithi050 bash[28929]: cluster 2024-05-20T22:25:25.854495+0000 mon.a (mon.0) 3664 : cluster 0 osdmap e752: 8 total, 8 up, 8 in 2024-05-20T22:25:27.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:27 smithi145 bash[23893]: cluster 2024-05-20T22:25:26.659432+0000 mgr.y (mgr.14592) 728 : cluster 0 pgmap v1229: 332 pgs: 332 active+clean; 4.4 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-05-20T22:25:27.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:27 smithi145 bash[23893]: cluster 2024-05-20T22:25:26.858910+0000 mon.a (mon.0) 3665 : cluster 0 osdmap e753: 8 total, 8 up, 8 in 2024-05-20T22:25:27.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:27 smithi145 bash[23893]: audit 2024-05-20T22:25:26.866613+0000 mon.c (mon.2) 523 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:27.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:27 smithi145 bash[23893]: audit 2024-05-20T22:25:26.877726+0000 mon.a (mon.0) 3666 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:27.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:27 smithi050 bash[28929]: cluster 2024-05-20T22:25:26.659432+0000 mgr.y (mgr.14592) 728 : cluster 0 pgmap v1229: 332 pgs: 332 active+clean; 4.4 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-05-20T22:25:27.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:27 smithi050 bash[28929]: cluster 2024-05-20T22:25:26.858910+0000 mon.a (mon.0) 3665 : cluster 0 osdmap e753: 8 total, 8 up, 8 in 2024-05-20T22:25:27.692 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:27 smithi050 bash[28929]: audit 2024-05-20T22:25:26.866613+0000 mon.c (mon.2) 523 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:27.692 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:27 smithi050 bash[28929]: audit 2024-05-20T22:25:26.877726+0000 mon.a (mon.0) 3666 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:27.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:27 smithi050 bash[21866]: cluster 2024-05-20T22:25:26.659432+0000 mgr.y (mgr.14592) 728 : cluster 0 pgmap v1229: 332 pgs: 332 active+clean; 4.4 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-05-20T22:25:27.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:27 smithi050 bash[21866]: cluster 2024-05-20T22:25:26.858910+0000 mon.a (mon.0) 3665 : cluster 0 osdmap e753: 8 total, 8 up, 8 in 2024-05-20T22:25:27.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:27 smithi050 bash[21866]: audit 2024-05-20T22:25:26.866613+0000 mon.c (mon.2) 523 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:27.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:27 smithi050 bash[21866]: audit 2024-05-20T22:25:26.877726+0000 mon.a (mon.0) 3666 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:25:28.859 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:25:28 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:25:29.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:28 smithi145 bash[23893]: audit 2024-05-20T22:25:27.854218+0000 mon.a (mon.0) 3667 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:25:29.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:28 smithi145 bash[23893]: cluster 2024-05-20T22:25:27.861806+0000 mon.a (mon.0) 3668 : cluster 0 osdmap e754: 8 total, 8 up, 8 in 2024-05-20T22:25:29.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:28 smithi145 bash[23893]: audit 2024-05-20T22:25:27.866678+0000 mon.c (mon.2) 524 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-111","var": "dedup_tier","val": "test-rados-api-smithi050-64110-154"}]: dispatch 2024-05-20T22:25:29.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:28 smithi145 bash[23893]: audit 2024-05-20T22:25:27.867679+0000 mon.a (mon.0) 3669 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-111","var": "dedup_tier","val": "test-rados-api-smithi050-64110-154"}]: dispatch 2024-05-20T22:25:29.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:28 smithi145 bash[23893]: audit 2024-05-20T22:25:27.949073+0000 mon.c (mon.2) 525 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:29.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:28 smithi145 bash[23893]: audit 2024-05-20T22:25:27.949656+0000 mon.a (mon.0) 3670 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:29.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:28 smithi145 bash[23893]: audit 2024-05-20T22:25:27.950627+0000 mon.c (mon.2) 526 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-154"}]: dispatch 2024-05-20T22:25:29.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:28 smithi145 bash[23893]: audit 2024-05-20T22:25:27.951119+0000 mon.a (mon.0) 3671 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-154"}]: dispatch 2024-05-20T22:25:29.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:28 smithi145 bash[23893]: audit 2024-05-20T22:25:28.483458+0000 mgr.y (mgr.14592) 729 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:25:29.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:28 smithi145 bash[23893]: cluster 2024-05-20T22:25:28.660564+0000 mgr.y (mgr.14592) 730 : cluster 0 pgmap v1232: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-05-20T22:25:29.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:28 smithi050 bash[21866]: audit 2024-05-20T22:25:27.854218+0000 mon.a (mon.0) 3667 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:25:29.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:28 smithi050 bash[21866]: cluster 2024-05-20T22:25:27.861806+0000 mon.a (mon.0) 3668 : cluster 0 osdmap e754: 8 total, 8 up, 8 in 2024-05-20T22:25:29.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:28 smithi050 bash[21866]: audit 2024-05-20T22:25:27.866678+0000 mon.c (mon.2) 524 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-111","var": "dedup_tier","val": "test-rados-api-smithi050-64110-154"}]: dispatch 2024-05-20T22:25:29.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:28 smithi050 bash[21866]: audit 2024-05-20T22:25:27.867679+0000 mon.a (mon.0) 3669 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-111","var": "dedup_tier","val": "test-rados-api-smithi050-64110-154"}]: dispatch 2024-05-20T22:25:29.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:28 smithi050 bash[21866]: audit 2024-05-20T22:25:27.949073+0000 mon.c (mon.2) 525 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:29.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:28 smithi050 bash[21866]: audit 2024-05-20T22:25:27.949656+0000 mon.a (mon.0) 3670 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:29.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:28 smithi050 bash[21866]: audit 2024-05-20T22:25:27.950627+0000 mon.c (mon.2) 526 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-154"}]: dispatch 2024-05-20T22:25:29.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:28 smithi050 bash[21866]: audit 2024-05-20T22:25:27.951119+0000 mon.a (mon.0) 3671 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-154"}]: dispatch 2024-05-20T22:25:29.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:28 smithi050 bash[21866]: audit 2024-05-20T22:25:28.483458+0000 mgr.y (mgr.14592) 729 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:25:29.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:28 smithi050 bash[21866]: cluster 2024-05-20T22:25:28.660564+0000 mgr.y (mgr.14592) 730 : cluster 0 pgmap v1232: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-05-20T22:25:29.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:28 smithi050 bash[28929]: audit 2024-05-20T22:25:27.854218+0000 mon.a (mon.0) 3667 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi050-64110-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:25:29.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:28 smithi050 bash[28929]: cluster 2024-05-20T22:25:27.861806+0000 mon.a (mon.0) 3668 : cluster 0 osdmap e754: 8 total, 8 up, 8 in 2024-05-20T22:25:29.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:28 smithi050 bash[28929]: audit 2024-05-20T22:25:27.866678+0000 mon.c (mon.2) 524 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-111","var": "dedup_tier","val": "test-rados-api-smithi050-64110-154"}]: dispatch 2024-05-20T22:25:29.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:28 smithi050 bash[28929]: audit 2024-05-20T22:25:27.867679+0000 mon.a (mon.0) 3669 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi050-64110-111","var": "dedup_tier","val": "test-rados-api-smithi050-64110-154"}]: dispatch 2024-05-20T22:25:29.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:28 smithi050 bash[28929]: audit 2024-05-20T22:25:27.949073+0000 mon.c (mon.2) 525 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:29.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:28 smithi050 bash[28929]: audit 2024-05-20T22:25:27.949656+0000 mon.a (mon.0) 3670 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:29.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:28 smithi050 bash[28929]: audit 2024-05-20T22:25:27.950627+0000 mon.c (mon.2) 526 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-154"}]: dispatch 2024-05-20T22:25:29.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:28 smithi050 bash[28929]: audit 2024-05-20T22:25:27.951119+0000 mon.a (mon.0) 3671 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi050-64110-111", "tierpool": "test-rados-api-smithi050-64110-154"}]: dispatch 2024-05-20T22:25:29.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:28 smithi050 bash[28929]: audit 2024-05-20T22:25:28.483458+0000 mgr.y (mgr.14592) 729 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:25:29.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:28 smithi050 bash[28929]: cluster 2024-05-20T22:25:28.660564+0000 mgr.y (mgr.14592) 730 : cluster 0 pgmap v1232: 364 pgs: 32 unknown, 332 active+clean; 4.4 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-05-20T22:25:29.691 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:25:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:25:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:25:30.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:29 smithi145 bash[23893]: cluster 2024-05-20T22:25:28.874545+0000 mon.a (mon.0) 3672 : cluster 0 osdmap e755: 8 total, 8 up, 8 in 2024-05-20T22:25:30.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:29 smithi050 bash[21866]: cluster 2024-05-20T22:25:28.874545+0000 mon.a (mon.0) 3672 : cluster 0 osdmap e755: 8 total, 8 up, 8 in 2024-05-20T22:25:30.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:29 smithi050 bash[28929]: cluster 2024-05-20T22:25:28.874545+0000 mon.a (mon.0) 3672 : cluster 0 osdmap e755: 8 total, 8 up, 8 in 2024-05-20T22:25:31.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:30 smithi145 bash[23893]: cluster 2024-05-20T22:25:29.872768+0000 mon.a (mon.0) 3673 : cluster 0 osdmap e756: 8 total, 8 up, 8 in 2024-05-20T22:25:31.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:30 smithi145 bash[23893]: audit 2024-05-20T22:25:29.876035+0000 mon.c (mon.2) 527 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:31.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:30 smithi145 bash[23893]: audit 2024-05-20T22:25:29.877475+0000 mon.a (mon.0) 3674 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:31.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:30 smithi145 bash[23893]: cluster 2024-05-20T22:25:30.643596+0000 mon.a (mon.0) 3675 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:25:31.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:30 smithi145 bash[23893]: cluster 2024-05-20T22:25:30.663482+0000 mgr.y (mgr.14592) 731 : cluster 0 pgmap v1235: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:25:31.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:30 smithi145 bash[23893]: audit 2024-05-20T22:25:30.868961+0000 mon.a (mon.0) 3676 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:25:31.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:30 smithi145 bash[23893]: cluster 2024-05-20T22:25:30.877469+0000 mon.a (mon.0) 3677 : cluster 0 osdmap e757: 8 total, 8 up, 8 in 2024-05-20T22:25:31.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:30 smithi050 bash[21866]: cluster 2024-05-20T22:25:29.872768+0000 mon.a (mon.0) 3673 : cluster 0 osdmap e756: 8 total, 8 up, 8 in 2024-05-20T22:25:31.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:30 smithi050 bash[21866]: audit 2024-05-20T22:25:29.876035+0000 mon.c (mon.2) 527 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:31.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:30 smithi050 bash[21866]: audit 2024-05-20T22:25:29.877475+0000 mon.a (mon.0) 3674 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:31.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:30 smithi050 bash[21866]: cluster 2024-05-20T22:25:30.643596+0000 mon.a (mon.0) 3675 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:25:31.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:30 smithi050 bash[21866]: cluster 2024-05-20T22:25:30.663482+0000 mgr.y (mgr.14592) 731 : cluster 0 pgmap v1235: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:25:31.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:30 smithi050 bash[21866]: audit 2024-05-20T22:25:30.868961+0000 mon.a (mon.0) 3676 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:25:31.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:30 smithi050 bash[21866]: cluster 2024-05-20T22:25:30.877469+0000 mon.a (mon.0) 3677 : cluster 0 osdmap e757: 8 total, 8 up, 8 in 2024-05-20T22:25:31.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:30 smithi050 bash[28929]: cluster 2024-05-20T22:25:29.872768+0000 mon.a (mon.0) 3673 : cluster 0 osdmap e756: 8 total, 8 up, 8 in 2024-05-20T22:25:31.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:30 smithi050 bash[28929]: audit 2024-05-20T22:25:29.876035+0000 mon.c (mon.2) 527 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:31.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:30 smithi050 bash[28929]: audit 2024-05-20T22:25:29.877475+0000 mon.a (mon.0) 3674 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:31.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:30 smithi050 bash[28929]: cluster 2024-05-20T22:25:30.643596+0000 mon.a (mon.0) 3675 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:25:31.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:30 smithi050 bash[28929]: cluster 2024-05-20T22:25:30.663482+0000 mgr.y (mgr.14592) 731 : cluster 0 pgmap v1235: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:25:31.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:30 smithi050 bash[28929]: audit 2024-05-20T22:25:30.868961+0000 mon.a (mon.0) 3676 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:25:31.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:30 smithi050 bash[28929]: cluster 2024-05-20T22:25:30.877469+0000 mon.a (mon.0) 3677 : cluster 0 osdmap e757: 8 total, 8 up, 8 in 2024-05-20T22:25:31.915 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: wait] LibRadosTwoPoolsECPP.TryFlush (7783 ms) 2024-05-20T22:25:31.915 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-05-20T22:25:31.915 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (13030 ms) 2024-05-20T22:25:31.915 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2024-05-20T22:25:31.916 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (8099 ms) 2024-05-20T22:25:31.916 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-05-20T22:25:31.916 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (13148 ms) 2024-05-20T22:25:31.916 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-05-20T22:25:31.916 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (7714 ms) 2024-05-20T22:25:31.916 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-05-20T22:25:31.916 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (8089 ms) 2024-05-20T22:25:31.916 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-05-20T22:25:31.916 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: hmm, no HitSet yet 2024-05-20T22:25:31.916 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: ok, hit_set contains 319:602f83fe:::foo:head 2024-05-20T22:25:31.916 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (9119 ms) 2024-05-20T22:25:31.916 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-05-20T22:25:31.916 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243846,0 2024-05-20T22:25:31.917 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: first is 1716243846 2024-05-20T22:25:31.917 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243846,0 2024-05-20T22:25:31.917 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243846,0 2024-05-20T22:25:31.917 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243846,1716243848,1716243849,0 2024-05-20T22:25:31.917 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243846,1716243848,1716243849,0 2024-05-20T22:25:31.917 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243846,1716243848,1716243849,0 2024-05-20T22:25:31.917 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243846,1716243848,1716243849,1716243851,1716243852,0 2024-05-20T22:25:31.917 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243846,1716243848,1716243849,1716243851,1716243852,0 2024-05-20T22:25:31.917 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243846,1716243848,1716243849,1716243851,1716243852,0 2024-05-20T22:25:31.917 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243846,1716243848,1716243849,1716243851,1716243852,1716243854,1716243855,0 2024-05-20T22:25:31.917 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243846,1716243848,1716243849,1716243851,1716243852,1716243854,1716243855,0 2024-05-20T22:25:31.917 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243846,1716243848,1716243849,1716243851,1716243852,1716243854,1716243855,0 2024-05-20T22:25:31.917 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: got ls 1716243849,1716243851,1716243852,1716243854,1716243855,1716243857,1716243858,0 2024-05-20T22:25:31.917 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: first now 1716243849, trimmed 2024-05-20T22:25:31.918 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetTrim (20860 ms) 2024-05-20T22:25:31.918 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-05-20T22:25:31.918 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: foo0 2024-05-20T22:25:31.918 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-05-20T22:25:31.918 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (14075 ms) 2024-05-20T22:25:31.918 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-05-20T22:25:31.918 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ProxyRead (17960 ms) 2024-05-20T22:25:31.918 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-05-20T22:25:31.918 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.CachePin (23027 ms) 2024-05-20T22:25:31.918 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-05-20T22:25:31.918 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetRedirectRead (5052 ms) 2024-05-20T22:25:31.918 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-05-20T22:25:31.918 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetChunkRead (3046 ms) 2024-05-20T22:25:31.919 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-05-20T22:25:31.919 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ManifestPromoteRead (3006 ms) 2024-05-20T22:25:31.919 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-05-20T22:25:31.919 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TrySetDedupTier (3018 ms) 2024-05-20T22:25:31.919 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (232761 ms total) 2024-05-20T22:25:31.919 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 2024-05-20T22:25:31.919 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] Global test environment tear-down 2024-05-20T22:25:31.919 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (885094 ms total) 2024-05-20T22:25:31.919 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ PASSED ] 77 tests. 2024-05-20T22:25:31.920 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:25:31.920 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=63963 2024-05-20T22:25:31.920 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 63963 2024-05-20T22:25:31.920 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:25:31.920 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64141 2024-05-20T22:25:31.920 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64141 2024-05-20T22:25:31.920 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:25:31.921 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64501 2024-05-20T22:25:31.921 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64501 2024-05-20T22:25:31.921 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:25:31.921 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64321 2024-05-20T22:25:31.921 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64321 2024-05-20T22:25:31.921 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:25:31.921 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64198 2024-05-20T22:25:31.921 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64198 2024-05-20T22:25:31.921 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:25:31.921 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64030 2024-05-20T22:25:31.921 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64030 2024-05-20T22:25:32.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:31 smithi145 bash[23893]: audit 2024-05-20T22:25:30.883508+0000 mon.c (mon.2) 528 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:32.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:31 smithi145 bash[23893]: audit 2024-05-20T22:25:30.896199+0000 mon.a (mon.0) 3678 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:32.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:31 smithi050 bash[21866]: audit 2024-05-20T22:25:30.883508+0000 mon.c (mon.2) 528 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:32.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:31 smithi050 bash[21866]: audit 2024-05-20T22:25:30.896199+0000 mon.a (mon.0) 3678 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:32.254 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:31 smithi050 bash[28929]: audit 2024-05-20T22:25:30.883508+0000 mon.c (mon.2) 528 : audit 1 from='client.? v1:172.21.15.50:0/743225021' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:32.254 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:31 smithi050 bash[28929]: audit 2024-05-20T22:25:30.896199+0000 mon.a (mon.0) 3678 : audit 1 from='client.26276 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-111"}]: dispatch 2024-05-20T22:25:33.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:32 smithi050 bash[28929]: audit 2024-05-20T22:25:31.898474+0000 mon.a (mon.0) 3679 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:25:33.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:32 smithi050 bash[28929]: cluster 2024-05-20T22:25:31.905772+0000 mon.a (mon.0) 3680 : cluster 0 osdmap e758: 8 total, 8 up, 8 in 2024-05-20T22:25:33.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:32 smithi050 bash[28929]: cluster 2024-05-20T22:25:32.664414+0000 mgr.y (mgr.14592) 732 : cluster 0 pgmap v1238: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:25:33.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:32 smithi050 bash[21866]: audit 2024-05-20T22:25:31.898474+0000 mon.a (mon.0) 3679 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:25:33.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:32 smithi050 bash[21866]: cluster 2024-05-20T22:25:31.905772+0000 mon.a (mon.0) 3680 : cluster 0 osdmap e758: 8 total, 8 up, 8 in 2024-05-20T22:25:33.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:32 smithi050 bash[21866]: cluster 2024-05-20T22:25:32.664414+0000 mgr.y (mgr.14592) 732 : cluster 0 pgmap v1238: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:25:33.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:32 smithi145 bash[23893]: audit 2024-05-20T22:25:31.898474+0000 mon.a (mon.0) 3679 : audit 1 from='client.26276 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi050-64110-111"}]': finished 2024-05-20T22:25:33.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:32 smithi145 bash[23893]: cluster 2024-05-20T22:25:31.905772+0000 mon.a (mon.0) 3680 : cluster 0 osdmap e758: 8 total, 8 up, 8 in 2024-05-20T22:25:33.389 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:32 smithi145 bash[23893]: cluster 2024-05-20T22:25:32.664414+0000 mgr.y (mgr.14592) 732 : cluster 0 pgmap v1238: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:25:36.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:35 smithi145 bash[23893]: cluster 2024-05-20T22:25:34.665345+0000 mgr.y (mgr.14592) 733 : cluster 0 pgmap v1239: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:25:36.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:35 smithi145 bash[23893]: cluster 2024-05-20T22:25:35.659996+0000 mon.a (mon.0) 3681 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:25:36.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:35 smithi050 bash[21866]: cluster 2024-05-20T22:25:34.665345+0000 mgr.y (mgr.14592) 733 : cluster 0 pgmap v1239: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:25:36.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:35 smithi050 bash[21866]: cluster 2024-05-20T22:25:35.659996+0000 mon.a (mon.0) 3681 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:25:36.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:35 smithi050 bash[28929]: cluster 2024-05-20T22:25:34.665345+0000 mgr.y (mgr.14592) 733 : cluster 0 pgmap v1239: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail 2024-05-20T22:25:36.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:35 smithi050 bash[28929]: cluster 2024-05-20T22:25:35.659996+0000 mon.a (mon.0) 3681 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:25:38.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:37 smithi145 bash[23893]: cluster 2024-05-20T22:25:36.668325+0000 mgr.y (mgr.14592) 734 : cluster 0 pgmap v1240: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-05-20T22:25:38.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:37 smithi050 bash[21866]: cluster 2024-05-20T22:25:36.668325+0000 mgr.y (mgr.14592) 734 : cluster 0 pgmap v1240: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-05-20T22:25:38.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:37 smithi050 bash[28929]: cluster 2024-05-20T22:25:36.668325+0000 mgr.y (mgr.14592) 734 : cluster 0 pgmap v1240: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-05-20T22:25:38.889 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:25:38 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:25:39.691 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:25:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:25:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:25:40.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:39 smithi145 bash[23893]: audit 2024-05-20T22:25:38.494888+0000 mgr.y (mgr.14592) 735 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:25:40.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:39 smithi145 bash[23893]: cluster 2024-05-20T22:25:38.669242+0000 mgr.y (mgr.14592) 736 : cluster 0 pgmap v1241: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:25:40.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:39 smithi145 bash[23893]: audit 2024-05-20T22:25:39.027488+0000 mon.a (mon.0) 3682 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:25:40.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:39 smithi050 bash[21866]: audit 2024-05-20T22:25:38.494888+0000 mgr.y (mgr.14592) 735 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:25:40.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:39 smithi050 bash[21866]: cluster 2024-05-20T22:25:38.669242+0000 mgr.y (mgr.14592) 736 : cluster 0 pgmap v1241: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:25:40.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:39 smithi050 bash[21866]: audit 2024-05-20T22:25:39.027488+0000 mon.a (mon.0) 3682 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:25:40.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:39 smithi050 bash[28929]: audit 2024-05-20T22:25:38.494888+0000 mgr.y (mgr.14592) 735 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:25:40.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:39 smithi050 bash[28929]: cluster 2024-05-20T22:25:38.669242+0000 mgr.y (mgr.14592) 736 : cluster 0 pgmap v1241: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:25:40.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:39 smithi050 bash[28929]: audit 2024-05-20T22:25:39.027488+0000 mon.a (mon.0) 3682 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:25:42.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:41 smithi145 bash[23893]: cluster 2024-05-20T22:25:40.672174+0000 mgr.y (mgr.14592) 737 : cluster 0 pgmap v1242: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-20T22:25:42.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:41 smithi050 bash[21866]: cluster 2024-05-20T22:25:40.672174+0000 mgr.y (mgr.14592) 737 : cluster 0 pgmap v1242: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-20T22:25:42.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:41 smithi050 bash[28929]: cluster 2024-05-20T22:25:40.672174+0000 mgr.y (mgr.14592) 737 : cluster 0 pgmap v1242: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-20T22:25:44.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:43 smithi145 bash[23893]: cluster 2024-05-20T22:25:42.673091+0000 mgr.y (mgr.14592) 738 : cluster 0 pgmap v1243: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 950 B/s rd, 0 op/s 2024-05-20T22:25:44.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:43 smithi050 bash[21866]: cluster 2024-05-20T22:25:42.673091+0000 mgr.y (mgr.14592) 738 : cluster 0 pgmap v1243: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 950 B/s rd, 0 op/s 2024-05-20T22:25:44.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:43 smithi050 bash[28929]: cluster 2024-05-20T22:25:42.673091+0000 mgr.y (mgr.14592) 738 : cluster 0 pgmap v1243: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 950 B/s rd, 0 op/s 2024-05-20T22:25:46.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:45 smithi145 bash[23893]: cluster 2024-05-20T22:25:44.674001+0000 mgr.y (mgr.14592) 739 : cluster 0 pgmap v1244: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:25:46.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:45 smithi050 bash[21866]: cluster 2024-05-20T22:25:44.674001+0000 mgr.y (mgr.14592) 739 : cluster 0 pgmap v1244: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:25:46.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:45 smithi050 bash[28929]: cluster 2024-05-20T22:25:44.674001+0000 mgr.y (mgr.14592) 739 : cluster 0 pgmap v1244: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:25:48.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:47 smithi145 bash[23893]: cluster 2024-05-20T22:25:46.677036+0000 mgr.y (mgr.14592) 740 : cluster 0 pgmap v1245: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:25:48.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:47 smithi050 bash[28929]: cluster 2024-05-20T22:25:46.677036+0000 mgr.y (mgr.14592) 740 : cluster 0 pgmap v1245: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:25:48.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:47 smithi050 bash[21866]: cluster 2024-05-20T22:25:46.677036+0000 mgr.y (mgr.14592) 740 : cluster 0 pgmap v1245: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:25:48.889 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:25:48 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:25:49.691 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:25:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:25:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:25:50.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:49 smithi145 bash[23893]: audit 2024-05-20T22:25:48.506394+0000 mgr.y (mgr.14592) 741 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:25:50.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:49 smithi145 bash[23893]: cluster 2024-05-20T22:25:48.678000+0000 mgr.y (mgr.14592) 742 : cluster 0 pgmap v1246: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:25:50.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:49 smithi050 bash[21866]: audit 2024-05-20T22:25:48.506394+0000 mgr.y (mgr.14592) 741 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:25:50.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:49 smithi050 bash[21866]: cluster 2024-05-20T22:25:48.678000+0000 mgr.y (mgr.14592) 742 : cluster 0 pgmap v1246: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:25:50.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:49 smithi050 bash[28929]: audit 2024-05-20T22:25:48.506394+0000 mgr.y (mgr.14592) 741 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:25:50.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:49 smithi050 bash[28929]: cluster 2024-05-20T22:25:48.678000+0000 mgr.y (mgr.14592) 742 : cluster 0 pgmap v1246: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:25:52.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:51 smithi145 bash[23893]: cluster 2024-05-20T22:25:50.680888+0000 mgr.y (mgr.14592) 743 : cluster 0 pgmap v1247: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:25:52.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:51 smithi050 bash[21866]: cluster 2024-05-20T22:25:50.680888+0000 mgr.y (mgr.14592) 743 : cluster 0 pgmap v1247: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:25:52.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:51 smithi050 bash[28929]: cluster 2024-05-20T22:25:50.680888+0000 mgr.y (mgr.14592) 743 : cluster 0 pgmap v1247: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:25:54.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:53 smithi145 bash[23893]: cluster 2024-05-20T22:25:52.681786+0000 mgr.y (mgr.14592) 744 : cluster 0 pgmap v1248: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:25:54.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:53 smithi050 bash[21866]: cluster 2024-05-20T22:25:52.681786+0000 mgr.y (mgr.14592) 744 : cluster 0 pgmap v1248: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:25:54.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:53 smithi050 bash[28929]: cluster 2024-05-20T22:25:52.681786+0000 mgr.y (mgr.14592) 744 : cluster 0 pgmap v1248: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:25:55.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:54 smithi145 bash[23893]: audit 2024-05-20T22:25:54.060497+0000 mon.a (mon.0) 3683 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:25:55.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:54 smithi050 bash[21866]: audit 2024-05-20T22:25:54.060497+0000 mon.a (mon.0) 3683 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:25:55.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:54 smithi050 bash[28929]: audit 2024-05-20T22:25:54.060497+0000 mon.a (mon.0) 3683 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:25:56.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:55 smithi145 bash[23893]: cluster 2024-05-20T22:25:54.682672+0000 mgr.y (mgr.14592) 745 : cluster 0 pgmap v1249: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:25:56.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:55 smithi050 bash[21866]: cluster 2024-05-20T22:25:54.682672+0000 mgr.y (mgr.14592) 745 : cluster 0 pgmap v1249: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:25:56.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:55 smithi050 bash[28929]: cluster 2024-05-20T22:25:54.682672+0000 mgr.y (mgr.14592) 745 : cluster 0 pgmap v1249: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:25:58.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:57 smithi145 bash[23893]: cluster 2024-05-20T22:25:56.685648+0000 mgr.y (mgr.14592) 746 : cluster 0 pgmap v1250: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:25:58.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:57 smithi050 bash[21866]: cluster 2024-05-20T22:25:56.685648+0000 mgr.y (mgr.14592) 746 : cluster 0 pgmap v1250: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:25:58.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:57 smithi050 bash[28929]: cluster 2024-05-20T22:25:56.685648+0000 mgr.y (mgr.14592) 746 : cluster 0 pgmap v1250: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:25:58.889 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:25:58 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:25:59.691 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:25:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:25:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:26:00.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:59 smithi145 bash[23893]: audit 2024-05-20T22:25:58.517784+0000 mgr.y (mgr.14592) 747 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:26:00.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:25:59 smithi145 bash[23893]: cluster 2024-05-20T22:25:58.686599+0000 mgr.y (mgr.14592) 748 : cluster 0 pgmap v1251: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:00.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:59 smithi050 bash[21866]: audit 2024-05-20T22:25:58.517784+0000 mgr.y (mgr.14592) 747 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:26:00.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:25:59 smithi050 bash[21866]: cluster 2024-05-20T22:25:58.686599+0000 mgr.y (mgr.14592) 748 : cluster 0 pgmap v1251: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:00.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:59 smithi050 bash[28929]: audit 2024-05-20T22:25:58.517784+0000 mgr.y (mgr.14592) 747 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:26:00.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:25:59 smithi050 bash[28929]: cluster 2024-05-20T22:25:58.686599+0000 mgr.y (mgr.14592) 748 : cluster 0 pgmap v1251: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:01.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:00 smithi145 bash[23893]: audit 2024-05-20T22:26:00.272107+0000 mon.a (mon.0) 3684 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:26:01.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:00 smithi050 bash[21866]: audit 2024-05-20T22:26:00.272107+0000 mon.a (mon.0) 3684 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:26:01.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:00 smithi050 bash[28929]: audit 2024-05-20T22:26:00.272107+0000 mon.a (mon.0) 3684 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:26:02.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:01 smithi145 bash[23893]: cluster 2024-05-20T22:26:00.689439+0000 mgr.y (mgr.14592) 749 : cluster 0 pgmap v1252: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:02.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:01 smithi145 bash[23893]: audit 2024-05-20T22:26:00.955369+0000 mon.a (mon.0) 3685 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:26:02.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:01 smithi145 bash[23893]: audit 2024-05-20T22:26:00.956719+0000 mon.a (mon.0) 3686 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:26:02.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:01 smithi145 bash[23893]: audit 2024-05-20T22:26:00.965723+0000 mon.a (mon.0) 3687 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:26:02.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:01 smithi050 bash[21866]: cluster 2024-05-20T22:26:00.689439+0000 mgr.y (mgr.14592) 749 : cluster 0 pgmap v1252: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:02.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:01 smithi050 bash[21866]: audit 2024-05-20T22:26:00.955369+0000 mon.a (mon.0) 3685 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:26:02.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:01 smithi050 bash[21866]: audit 2024-05-20T22:26:00.956719+0000 mon.a (mon.0) 3686 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:26:02.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:01 smithi050 bash[21866]: audit 2024-05-20T22:26:00.965723+0000 mon.a (mon.0) 3687 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:26:02.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:01 smithi050 bash[28929]: cluster 2024-05-20T22:26:00.689439+0000 mgr.y (mgr.14592) 749 : cluster 0 pgmap v1252: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:02.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:01 smithi050 bash[28929]: audit 2024-05-20T22:26:00.955369+0000 mon.a (mon.0) 3685 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:26:02.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:01 smithi050 bash[28929]: audit 2024-05-20T22:26:00.956719+0000 mon.a (mon.0) 3686 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:26:02.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:01 smithi050 bash[28929]: audit 2024-05-20T22:26:00.965723+0000 mon.a (mon.0) 3687 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:26:04.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:03 smithi145 bash[23893]: cluster 2024-05-20T22:26:02.690309+0000 mgr.y (mgr.14592) 750 : cluster 0 pgmap v1253: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:04.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:03 smithi050 bash[21866]: cluster 2024-05-20T22:26:02.690309+0000 mgr.y (mgr.14592) 750 : cluster 0 pgmap v1253: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:04.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:03 smithi050 bash[28929]: cluster 2024-05-20T22:26:02.690309+0000 mgr.y (mgr.14592) 750 : cluster 0 pgmap v1253: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:06.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:05 smithi145 bash[23893]: cluster 2024-05-20T22:26:04.691241+0000 mgr.y (mgr.14592) 751 : cluster 0 pgmap v1254: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:06.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:05 smithi050 bash[21866]: cluster 2024-05-20T22:26:04.691241+0000 mgr.y (mgr.14592) 751 : cluster 0 pgmap v1254: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:06.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:05 smithi050 bash[28929]: cluster 2024-05-20T22:26:04.691241+0000 mgr.y (mgr.14592) 751 : cluster 0 pgmap v1254: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:08.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:07 smithi145 bash[23893]: cluster 2024-05-20T22:26:06.694160+0000 mgr.y (mgr.14592) 752 : cluster 0 pgmap v1255: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:08.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:07 smithi050 bash[21866]: cluster 2024-05-20T22:26:06.694160+0000 mgr.y (mgr.14592) 752 : cluster 0 pgmap v1255: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:08.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:07 smithi050 bash[28929]: cluster 2024-05-20T22:26:06.694160+0000 mgr.y (mgr.14592) 752 : cluster 0 pgmap v1255: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:08.889 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:26:08 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:26:09.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:26:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:26:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:26:10.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:09 smithi145 bash[23893]: audit 2024-05-20T22:26:08.519968+0000 mgr.y (mgr.14592) 753 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:26:10.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:09 smithi145 bash[23893]: cluster 2024-05-20T22:26:08.695054+0000 mgr.y (mgr.14592) 754 : cluster 0 pgmap v1256: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:10.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:09 smithi145 bash[23893]: audit 2024-05-20T22:26:09.093052+0000 mon.a (mon.0) 3688 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:26:10.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:09 smithi050 bash[21866]: audit 2024-05-20T22:26:08.519968+0000 mgr.y (mgr.14592) 753 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:26:10.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:09 smithi050 bash[21866]: cluster 2024-05-20T22:26:08.695054+0000 mgr.y (mgr.14592) 754 : cluster 0 pgmap v1256: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:10.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:09 smithi050 bash[21866]: audit 2024-05-20T22:26:09.093052+0000 mon.a (mon.0) 3688 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:26:10.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:09 smithi050 bash[28929]: audit 2024-05-20T22:26:08.519968+0000 mgr.y (mgr.14592) 753 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:26:10.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:09 smithi050 bash[28929]: cluster 2024-05-20T22:26:08.695054+0000 mgr.y (mgr.14592) 754 : cluster 0 pgmap v1256: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:10.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:09 smithi050 bash[28929]: audit 2024-05-20T22:26:09.093052+0000 mon.a (mon.0) 3688 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:26:12.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:11 smithi145 bash[23893]: cluster 2024-05-20T22:26:10.698330+0000 mgr.y (mgr.14592) 755 : cluster 0 pgmap v1257: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:12.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:11 smithi050 bash[21866]: cluster 2024-05-20T22:26:10.698330+0000 mgr.y (mgr.14592) 755 : cluster 0 pgmap v1257: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:12.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:11 smithi050 bash[28929]: cluster 2024-05-20T22:26:10.698330+0000 mgr.y (mgr.14592) 755 : cluster 0 pgmap v1257: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:14.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:13 smithi145 bash[23893]: cluster 2024-05-20T22:26:12.699291+0000 mgr.y (mgr.14592) 756 : cluster 0 pgmap v1258: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:14.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:13 smithi050 bash[21866]: cluster 2024-05-20T22:26:12.699291+0000 mgr.y (mgr.14592) 756 : cluster 0 pgmap v1258: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:14.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:13 smithi050 bash[28929]: cluster 2024-05-20T22:26:12.699291+0000 mgr.y (mgr.14592) 756 : cluster 0 pgmap v1258: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:16.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:15 smithi145 bash[23893]: cluster 2024-05-20T22:26:14.700240+0000 mgr.y (mgr.14592) 757 : cluster 0 pgmap v1259: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:16.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:15 smithi050 bash[21866]: cluster 2024-05-20T22:26:14.700240+0000 mgr.y (mgr.14592) 757 : cluster 0 pgmap v1259: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:16.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:15 smithi050 bash[28929]: cluster 2024-05-20T22:26:14.700240+0000 mgr.y (mgr.14592) 757 : cluster 0 pgmap v1259: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:18.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:17 smithi145 bash[23893]: cluster 2024-05-20T22:26:16.703282+0000 mgr.y (mgr.14592) 758 : cluster 0 pgmap v1260: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:18.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:17 smithi050 bash[28929]: cluster 2024-05-20T22:26:16.703282+0000 mgr.y (mgr.14592) 758 : cluster 0 pgmap v1260: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:18.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:17 smithi050 bash[21866]: cluster 2024-05-20T22:26:16.703282+0000 mgr.y (mgr.14592) 758 : cluster 0 pgmap v1260: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:18.889 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:26:18 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:26:19.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:26:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:26:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:26:20.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:19 smithi145 bash[23893]: audit 2024-05-20T22:26:18.531367+0000 mgr.y (mgr.14592) 759 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:26:20.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:19 smithi145 bash[23893]: cluster 2024-05-20T22:26:18.704599+0000 mgr.y (mgr.14592) 760 : cluster 0 pgmap v1261: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:20.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:19 smithi050 bash[21866]: audit 2024-05-20T22:26:18.531367+0000 mgr.y (mgr.14592) 759 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:26:20.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:19 smithi050 bash[21866]: cluster 2024-05-20T22:26:18.704599+0000 mgr.y (mgr.14592) 760 : cluster 0 pgmap v1261: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:20.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:19 smithi050 bash[28929]: audit 2024-05-20T22:26:18.531367+0000 mgr.y (mgr.14592) 759 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:26:20.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:19 smithi050 bash[28929]: cluster 2024-05-20T22:26:18.704599+0000 mgr.y (mgr.14592) 760 : cluster 0 pgmap v1261: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:22.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:21 smithi145 bash[23893]: cluster 2024-05-20T22:26:20.707542+0000 mgr.y (mgr.14592) 761 : cluster 0 pgmap v1262: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:22.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:21 smithi050 bash[21866]: cluster 2024-05-20T22:26:20.707542+0000 mgr.y (mgr.14592) 761 : cluster 0 pgmap v1262: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:22.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:21 smithi050 bash[28929]: cluster 2024-05-20T22:26:20.707542+0000 mgr.y (mgr.14592) 761 : cluster 0 pgmap v1262: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:24.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:23 smithi145 bash[23893]: cluster 2024-05-20T22:26:22.708494+0000 mgr.y (mgr.14592) 762 : cluster 0 pgmap v1263: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:24.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:23 smithi050 bash[21866]: cluster 2024-05-20T22:26:22.708494+0000 mgr.y (mgr.14592) 762 : cluster 0 pgmap v1263: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:24.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:23 smithi050 bash[28929]: cluster 2024-05-20T22:26:22.708494+0000 mgr.y (mgr.14592) 762 : cluster 0 pgmap v1263: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:25.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:24 smithi145 bash[23893]: audit 2024-05-20T22:26:24.128763+0000 mon.a (mon.0) 3689 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:26:25.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:24 smithi050 bash[21866]: audit 2024-05-20T22:26:24.128763+0000 mon.a (mon.0) 3689 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:26:25.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:24 smithi050 bash[28929]: audit 2024-05-20T22:26:24.128763+0000 mon.a (mon.0) 3689 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:26:26.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:25 smithi145 bash[23893]: cluster 2024-05-20T22:26:24.709437+0000 mgr.y (mgr.14592) 763 : cluster 0 pgmap v1264: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:26.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:25 smithi050 bash[21866]: cluster 2024-05-20T22:26:24.709437+0000 mgr.y (mgr.14592) 763 : cluster 0 pgmap v1264: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:26.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:25 smithi050 bash[28929]: cluster 2024-05-20T22:26:24.709437+0000 mgr.y (mgr.14592) 763 : cluster 0 pgmap v1264: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:28.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:27 smithi145 bash[23893]: cluster 2024-05-20T22:26:26.712568+0000 mgr.y (mgr.14592) 764 : cluster 0 pgmap v1265: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:28.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:27 smithi050 bash[21866]: cluster 2024-05-20T22:26:26.712568+0000 mgr.y (mgr.14592) 764 : cluster 0 pgmap v1265: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:28.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:27 smithi050 bash[28929]: cluster 2024-05-20T22:26:26.712568+0000 mgr.y (mgr.14592) 764 : cluster 0 pgmap v1265: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:28.889 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:26:28 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:26:29.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:26:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:26:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:26:30.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:29 smithi145 bash[23893]: audit 2024-05-20T22:26:28.534138+0000 mgr.y (mgr.14592) 765 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:26:30.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:29 smithi145 bash[23893]: cluster 2024-05-20T22:26:28.713485+0000 mgr.y (mgr.14592) 766 : cluster 0 pgmap v1266: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:30.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:29 smithi050 bash[21866]: audit 2024-05-20T22:26:28.534138+0000 mgr.y (mgr.14592) 765 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:26:30.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:29 smithi050 bash[21866]: cluster 2024-05-20T22:26:28.713485+0000 mgr.y (mgr.14592) 766 : cluster 0 pgmap v1266: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:30.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:29 smithi050 bash[28929]: audit 2024-05-20T22:26:28.534138+0000 mgr.y (mgr.14592) 765 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:26:30.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:29 smithi050 bash[28929]: cluster 2024-05-20T22:26:28.713485+0000 mgr.y (mgr.14592) 766 : cluster 0 pgmap v1266: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:31.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:30 smithi145 bash[23893]: cluster 2024-05-20T22:26:30.716840+0000 mgr.y (mgr.14592) 767 : cluster 0 pgmap v1267: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:31.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:30 smithi050 bash[21866]: cluster 2024-05-20T22:26:30.716840+0000 mgr.y (mgr.14592) 767 : cluster 0 pgmap v1267: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:31.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:30 smithi050 bash[28929]: cluster 2024-05-20T22:26:30.716840+0000 mgr.y (mgr.14592) 767 : cluster 0 pgmap v1267: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:34.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:33 smithi145 bash[23893]: cluster 2024-05-20T22:26:32.717801+0000 mgr.y (mgr.14592) 768 : cluster 0 pgmap v1268: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:34.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:33 smithi050 bash[21866]: cluster 2024-05-20T22:26:32.717801+0000 mgr.y (mgr.14592) 768 : cluster 0 pgmap v1268: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:34.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:33 smithi050 bash[28929]: cluster 2024-05-20T22:26:32.717801+0000 mgr.y (mgr.14592) 768 : cluster 0 pgmap v1268: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:36.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:35 smithi145 bash[23893]: cluster 2024-05-20T22:26:34.718693+0000 mgr.y (mgr.14592) 769 : cluster 0 pgmap v1269: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:36.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:35 smithi050 bash[21866]: cluster 2024-05-20T22:26:34.718693+0000 mgr.y (mgr.14592) 769 : cluster 0 pgmap v1269: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:36.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:35 smithi050 bash[28929]: cluster 2024-05-20T22:26:34.718693+0000 mgr.y (mgr.14592) 769 : cluster 0 pgmap v1269: 324 pgs: 324 active+clean; 583 KiB data, 704 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:38.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:37 smithi145 bash[23893]: cluster 2024-05-20T22:26:36.721648+0000 mgr.y (mgr.14592) 770 : cluster 0 pgmap v1270: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:26:38.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:37 smithi050 bash[21866]: cluster 2024-05-20T22:26:36.721648+0000 mgr.y (mgr.14592) 770 : cluster 0 pgmap v1270: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:26:38.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:37 smithi050 bash[28929]: cluster 2024-05-20T22:26:36.721648+0000 mgr.y (mgr.14592) 770 : cluster 0 pgmap v1270: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:26:38.889 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:26:38 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:26:39.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:26:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:26:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:26:40.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:39 smithi145 bash[23893]: audit 2024-05-20T22:26:38.544085+0000 mgr.y (mgr.14592) 771 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:26:40.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:39 smithi145 bash[23893]: cluster 2024-05-20T22:26:38.722571+0000 mgr.y (mgr.14592) 772 : cluster 0 pgmap v1271: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:26:40.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:39 smithi145 bash[23893]: audit 2024-05-20T22:26:39.160955+0000 mon.a (mon.0) 3690 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:26:40.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:39 smithi050 bash[21866]: audit 2024-05-20T22:26:38.544085+0000 mgr.y (mgr.14592) 771 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:26:40.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:39 smithi050 bash[21866]: cluster 2024-05-20T22:26:38.722571+0000 mgr.y (mgr.14592) 772 : cluster 0 pgmap v1271: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:26:40.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:39 smithi050 bash[21866]: audit 2024-05-20T22:26:39.160955+0000 mon.a (mon.0) 3690 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:26:40.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:39 smithi050 bash[28929]: audit 2024-05-20T22:26:38.544085+0000 mgr.y (mgr.14592) 771 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:26:40.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:39 smithi050 bash[28929]: cluster 2024-05-20T22:26:38.722571+0000 mgr.y (mgr.14592) 772 : cluster 0 pgmap v1271: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:26:40.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:39 smithi050 bash[28929]: audit 2024-05-20T22:26:39.160955+0000 mon.a (mon.0) 3690 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:26:42.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:41 smithi145 bash[23893]: cluster 2024-05-20T22:26:40.725656+0000 mgr.y (mgr.14592) 773 : cluster 0 pgmap v1272: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:26:42.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:41 smithi050 bash[21866]: cluster 2024-05-20T22:26:40.725656+0000 mgr.y (mgr.14592) 773 : cluster 0 pgmap v1272: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:26:42.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:41 smithi050 bash[28929]: cluster 2024-05-20T22:26:40.725656+0000 mgr.y (mgr.14592) 773 : cluster 0 pgmap v1272: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:26:44.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:43 smithi145 bash[23893]: cluster 2024-05-20T22:26:42.726754+0000 mgr.y (mgr.14592) 774 : cluster 0 pgmap v1273: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:26:44.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:43 smithi050 bash[21866]: cluster 2024-05-20T22:26:42.726754+0000 mgr.y (mgr.14592) 774 : cluster 0 pgmap v1273: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:26:44.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:43 smithi050 bash[28929]: cluster 2024-05-20T22:26:42.726754+0000 mgr.y (mgr.14592) 774 : cluster 0 pgmap v1273: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:26:46.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:45 smithi145 bash[23893]: cluster 2024-05-20T22:26:44.727714+0000 mgr.y (mgr.14592) 775 : cluster 0 pgmap v1274: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:26:46.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:45 smithi050 bash[21866]: cluster 2024-05-20T22:26:44.727714+0000 mgr.y (mgr.14592) 775 : cluster 0 pgmap v1274: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:26:46.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:45 smithi050 bash[28929]: cluster 2024-05-20T22:26:44.727714+0000 mgr.y (mgr.14592) 775 : cluster 0 pgmap v1274: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:26:48.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:47 smithi145 bash[23893]: cluster 2024-05-20T22:26:46.730714+0000 mgr.y (mgr.14592) 776 : cluster 0 pgmap v1275: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:26:48.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:47 smithi050 bash[21866]: cluster 2024-05-20T22:26:46.730714+0000 mgr.y (mgr.14592) 776 : cluster 0 pgmap v1275: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:26:48.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:47 smithi050 bash[28929]: cluster 2024-05-20T22:26:46.730714+0000 mgr.y (mgr.14592) 776 : cluster 0 pgmap v1275: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:26:48.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:26:48 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:26:49.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:26:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:26:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:26:50.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:49 smithi145 bash[23893]: audit 2024-05-20T22:26:48.555514+0000 mgr.y (mgr.14592) 777 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:26:50.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:49 smithi145 bash[23893]: cluster 2024-05-20T22:26:48.731798+0000 mgr.y (mgr.14592) 778 : cluster 0 pgmap v1276: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:50.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:49 smithi050 bash[21866]: audit 2024-05-20T22:26:48.555514+0000 mgr.y (mgr.14592) 777 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:26:50.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:49 smithi050 bash[21866]: cluster 2024-05-20T22:26:48.731798+0000 mgr.y (mgr.14592) 778 : cluster 0 pgmap v1276: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:50.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:49 smithi050 bash[28929]: audit 2024-05-20T22:26:48.555514+0000 mgr.y (mgr.14592) 777 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:26:50.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:49 smithi050 bash[28929]: cluster 2024-05-20T22:26:48.731798+0000 mgr.y (mgr.14592) 778 : cluster 0 pgmap v1276: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:52.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:51 smithi145 bash[23893]: cluster 2024-05-20T22:26:50.734863+0000 mgr.y (mgr.14592) 779 : cluster 0 pgmap v1277: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:52.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:51 smithi050 bash[21866]: cluster 2024-05-20T22:26:50.734863+0000 mgr.y (mgr.14592) 779 : cluster 0 pgmap v1277: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:52.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:51 smithi050 bash[28929]: cluster 2024-05-20T22:26:50.734863+0000 mgr.y (mgr.14592) 779 : cluster 0 pgmap v1277: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:54.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:53 smithi145 bash[23893]: cluster 2024-05-20T22:26:52.735968+0000 mgr.y (mgr.14592) 780 : cluster 0 pgmap v1278: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:54.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:53 smithi050 bash[21866]: cluster 2024-05-20T22:26:52.735968+0000 mgr.y (mgr.14592) 780 : cluster 0 pgmap v1278: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:54.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:53 smithi050 bash[28929]: cluster 2024-05-20T22:26:52.735968+0000 mgr.y (mgr.14592) 780 : cluster 0 pgmap v1278: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:54.202 INFO:tasks.workunit.client.0.smithi050.stdout:ing 1 sec 2024-05-20T22:26:54.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.211 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:54.211 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:26:55.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:54 smithi145 bash[23893]: audit 2024-05-20T22:26:54.193778+0000 mon.a (mon.0) 3691 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:26:55.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:54 smithi050 bash[21866]: audit 2024-05-20T22:26:54.193778+0000 mon.a (mon.0) 3691 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:26:55.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:54 smithi050 bash[28929]: audit 2024-05-20T22:26:54.193778+0000 mon.a (mon.0) 3691 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:26:56.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:55 smithi145 bash[23893]: cluster 2024-05-20T22:26:54.736898+0000 mgr.y (mgr.14592) 781 : cluster 0 pgmap v1279: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:56.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:55 smithi050 bash[21866]: cluster 2024-05-20T22:26:54.736898+0000 mgr.y (mgr.14592) 781 : cluster 0 pgmap v1279: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:56.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:55 smithi050 bash[28929]: cluster 2024-05-20T22:26:54.736898+0000 mgr.y (mgr.14592) 781 : cluster 0 pgmap v1279: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:26:58.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:57 smithi145 bash[23893]: cluster 2024-05-20T22:26:56.739814+0000 mgr.y (mgr.14592) 782 : cluster 0 pgmap v1280: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:58.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:57 smithi050 bash[21866]: cluster 2024-05-20T22:26:56.739814+0000 mgr.y (mgr.14592) 782 : cluster 0 pgmap v1280: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:58.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:57 smithi050 bash[28929]: cluster 2024-05-20T22:26:56.739814+0000 mgr.y (mgr.14592) 782 : cluster 0 pgmap v1280: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:26:58.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:26:58 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:26:59.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:26:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:26:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:27:00.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:59 smithi145 bash[23893]: audit 2024-05-20T22:26:58.566940+0000 mgr.y (mgr.14592) 783 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:27:00.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:26:59 smithi145 bash[23893]: cluster 2024-05-20T22:26:58.740723+0000 mgr.y (mgr.14592) 784 : cluster 0 pgmap v1281: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:00.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:59 smithi050 bash[28929]: audit 2024-05-20T22:26:58.566940+0000 mgr.y (mgr.14592) 783 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:27:00.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:26:59 smithi050 bash[28929]: cluster 2024-05-20T22:26:58.740723+0000 mgr.y (mgr.14592) 784 : cluster 0 pgmap v1281: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:00.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:59 smithi050 bash[21866]: audit 2024-05-20T22:26:58.566940+0000 mgr.y (mgr.14592) 783 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:27:00.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:26:59 smithi050 bash[21866]: cluster 2024-05-20T22:26:58.740723+0000 mgr.y (mgr.14592) 784 : cluster 0 pgmap v1281: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:02.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:01 smithi145 bash[23893]: cluster 2024-05-20T22:27:00.743713+0000 mgr.y (mgr.14592) 785 : cluster 0 pgmap v1282: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:02.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:01 smithi145 bash[23893]: audit 2024-05-20T22:27:01.096072+0000 mon.a (mon.0) 3692 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:27:02.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:01 smithi145 bash[23893]: audit 2024-05-20T22:27:01.834293+0000 mon.a (mon.0) 3693 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:27:02.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:01 smithi145 bash[23893]: audit 2024-05-20T22:27:01.835544+0000 mon.a (mon.0) 3694 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:27:02.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:01 smithi145 bash[23893]: audit 2024-05-20T22:27:01.841618+0000 mon.a (mon.0) 3695 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:27:02.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:01 smithi050 bash[21866]: cluster 2024-05-20T22:27:00.743713+0000 mgr.y (mgr.14592) 785 : cluster 0 pgmap v1282: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:02.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:01 smithi050 bash[21866]: audit 2024-05-20T22:27:01.096072+0000 mon.a (mon.0) 3692 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:27:02.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:01 smithi050 bash[21866]: audit 2024-05-20T22:27:01.834293+0000 mon.a (mon.0) 3693 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:27:02.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:01 smithi050 bash[21866]: audit 2024-05-20T22:27:01.835544+0000 mon.a (mon.0) 3694 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:27:02.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:01 smithi050 bash[21866]: audit 2024-05-20T22:27:01.841618+0000 mon.a (mon.0) 3695 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:27:02.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:01 smithi050 bash[28929]: cluster 2024-05-20T22:27:00.743713+0000 mgr.y (mgr.14592) 785 : cluster 0 pgmap v1282: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:02.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:01 smithi050 bash[28929]: audit 2024-05-20T22:27:01.096072+0000 mon.a (mon.0) 3692 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:27:02.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:01 smithi050 bash[28929]: audit 2024-05-20T22:27:01.834293+0000 mon.a (mon.0) 3693 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:27:02.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:01 smithi050 bash[28929]: audit 2024-05-20T22:27:01.835544+0000 mon.a (mon.0) 3694 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:27:02.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:01 smithi050 bash[28929]: audit 2024-05-20T22:27:01.841618+0000 mon.a (mon.0) 3695 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:27:04.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:03 smithi145 bash[23893]: cluster 2024-05-20T22:27:02.744624+0000 mgr.y (mgr.14592) 786 : cluster 0 pgmap v1283: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:04.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:03 smithi050 bash[21866]: cluster 2024-05-20T22:27:02.744624+0000 mgr.y (mgr.14592) 786 : cluster 0 pgmap v1283: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:04.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:03 smithi050 bash[28929]: cluster 2024-05-20T22:27:02.744624+0000 mgr.y (mgr.14592) 786 : cluster 0 pgmap v1283: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:06.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:05 smithi145 bash[23893]: cluster 2024-05-20T22:27:04.745528+0000 mgr.y (mgr.14592) 787 : cluster 0 pgmap v1284: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:06.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:05 smithi050 bash[21866]: cluster 2024-05-20T22:27:04.745528+0000 mgr.y (mgr.14592) 787 : cluster 0 pgmap v1284: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:06.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:05 smithi050 bash[28929]: cluster 2024-05-20T22:27:04.745528+0000 mgr.y (mgr.14592) 787 : cluster 0 pgmap v1284: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:08.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:07 smithi145 bash[23893]: cluster 2024-05-20T22:27:06.748466+0000 mgr.y (mgr.14592) 788 : cluster 0 pgmap v1285: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:08.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:07 smithi050 bash[21866]: cluster 2024-05-20T22:27:06.748466+0000 mgr.y (mgr.14592) 788 : cluster 0 pgmap v1285: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:08.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:07 smithi050 bash[28929]: cluster 2024-05-20T22:27:06.748466+0000 mgr.y (mgr.14592) 788 : cluster 0 pgmap v1285: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:08.889 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:27:08 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:27:09.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:08 smithi050 bash[21866]: audit 2024-05-20T22:27:08.578367+0000 mgr.y (mgr.14592) 789 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:27:09.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:08 smithi050 bash[21866]: cluster 2024-05-20T22:27:08.749374+0000 mgr.y (mgr.14592) 790 : cluster 0 pgmap v1286: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:09.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:08 smithi050 bash[28929]: audit 2024-05-20T22:27:08.578367+0000 mgr.y (mgr.14592) 789 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:27:09.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:08 smithi050 bash[28929]: cluster 2024-05-20T22:27:08.749374+0000 mgr.y (mgr.14592) 790 : cluster 0 pgmap v1286: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:09.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:08 smithi145 bash[23893]: audit 2024-05-20T22:27:08.578367+0000 mgr.y (mgr.14592) 789 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:27:09.390 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:08 smithi145 bash[23893]: cluster 2024-05-20T22:27:08.749374+0000 mgr.y (mgr.14592) 790 : cluster 0 pgmap v1286: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:09.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:27:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:27:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:27:10.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:09 smithi050 bash[21866]: audit 2024-05-20T22:27:09.225973+0000 mon.a (mon.0) 3696 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:27:10.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:09 smithi050 bash[28929]: audit 2024-05-20T22:27:09.225973+0000 mon.a (mon.0) 3696 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:27:10.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:09 smithi145 bash[23893]: audit 2024-05-20T22:27:09.225973+0000 mon.a (mon.0) 3696 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:27:11.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:10 smithi050 bash[21866]: cluster 2024-05-20T22:27:10.752314+0000 mgr.y (mgr.14592) 791 : cluster 0 pgmap v1287: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:11.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:10 smithi050 bash[28929]: cluster 2024-05-20T22:27:10.752314+0000 mgr.y (mgr.14592) 791 : cluster 0 pgmap v1287: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:11.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:10 smithi145 bash[23893]: cluster 2024-05-20T22:27:10.752314+0000 mgr.y (mgr.14592) 791 : cluster 0 pgmap v1287: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:14.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:13 smithi145 bash[23893]: cluster 2024-05-20T22:27:12.753245+0000 mgr.y (mgr.14592) 792 : cluster 0 pgmap v1288: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:14.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:13 smithi050 bash[21866]: cluster 2024-05-20T22:27:12.753245+0000 mgr.y (mgr.14592) 792 : cluster 0 pgmap v1288: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:14.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:13 smithi050 bash[28929]: cluster 2024-05-20T22:27:12.753245+0000 mgr.y (mgr.14592) 792 : cluster 0 pgmap v1288: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:16.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:15 smithi145 bash[23893]: cluster 2024-05-20T22:27:14.754166+0000 mgr.y (mgr.14592) 793 : cluster 0 pgmap v1289: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:16.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:15 smithi050 bash[21866]: cluster 2024-05-20T22:27:14.754166+0000 mgr.y (mgr.14592) 793 : cluster 0 pgmap v1289: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:16.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:15 smithi050 bash[28929]: cluster 2024-05-20T22:27:14.754166+0000 mgr.y (mgr.14592) 793 : cluster 0 pgmap v1289: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:18.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:17 smithi145 bash[23893]: cluster 2024-05-20T22:27:16.757255+0000 mgr.y (mgr.14592) 794 : cluster 0 pgmap v1290: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:18.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:17 smithi050 bash[21866]: cluster 2024-05-20T22:27:16.757255+0000 mgr.y (mgr.14592) 794 : cluster 0 pgmap v1290: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:18.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:17 smithi050 bash[28929]: cluster 2024-05-20T22:27:16.757255+0000 mgr.y (mgr.14592) 794 : cluster 0 pgmap v1290: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:18.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:27:18 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:27:19.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:27:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:27:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:27:20.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:19 smithi145 bash[23893]: audit 2024-05-20T22:27:18.582925+0000 mgr.y (mgr.14592) 795 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:27:20.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:19 smithi145 bash[23893]: cluster 2024-05-20T22:27:18.758106+0000 mgr.y (mgr.14592) 796 : cluster 0 pgmap v1291: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:20.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:19 smithi050 bash[21866]: audit 2024-05-20T22:27:18.582925+0000 mgr.y (mgr.14592) 795 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:27:20.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:19 smithi050 bash[21866]: cluster 2024-05-20T22:27:18.758106+0000 mgr.y (mgr.14592) 796 : cluster 0 pgmap v1291: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:20.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:19 smithi050 bash[28929]: audit 2024-05-20T22:27:18.582925+0000 mgr.y (mgr.14592) 795 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:27:20.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:19 smithi050 bash[28929]: cluster 2024-05-20T22:27:18.758106+0000 mgr.y (mgr.14592) 796 : cluster 0 pgmap v1291: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:22.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:21 smithi145 bash[23893]: cluster 2024-05-20T22:27:20.760971+0000 mgr.y (mgr.14592) 797 : cluster 0 pgmap v1292: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:22.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:21 smithi050 bash[21866]: cluster 2024-05-20T22:27:20.760971+0000 mgr.y (mgr.14592) 797 : cluster 0 pgmap v1292: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:22.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:21 smithi050 bash[28929]: cluster 2024-05-20T22:27:20.760971+0000 mgr.y (mgr.14592) 797 : cluster 0 pgmap v1292: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:24.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:23 smithi145 bash[23893]: cluster 2024-05-20T22:27:22.761893+0000 mgr.y (mgr.14592) 798 : cluster 0 pgmap v1293: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:24.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:23 smithi050 bash[21866]: cluster 2024-05-20T22:27:22.761893+0000 mgr.y (mgr.14592) 798 : cluster 0 pgmap v1293: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:24.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:23 smithi050 bash[28929]: cluster 2024-05-20T22:27:22.761893+0000 mgr.y (mgr.14592) 798 : cluster 0 pgmap v1293: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:25.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:24 smithi145 bash[23893]: audit 2024-05-20T22:27:24.258412+0000 mon.a (mon.0) 3697 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:27:25.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:24 smithi050 bash[21866]: audit 2024-05-20T22:27:24.258412+0000 mon.a (mon.0) 3697 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:27:25.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:24 smithi050 bash[28929]: audit 2024-05-20T22:27:24.258412+0000 mon.a (mon.0) 3697 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:27:26.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:25 smithi145 bash[23893]: cluster 2024-05-20T22:27:24.762842+0000 mgr.y (mgr.14592) 799 : cluster 0 pgmap v1294: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:26.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:25 smithi050 bash[21866]: cluster 2024-05-20T22:27:24.762842+0000 mgr.y (mgr.14592) 799 : cluster 0 pgmap v1294: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:26.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:25 smithi050 bash[28929]: cluster 2024-05-20T22:27:24.762842+0000 mgr.y (mgr.14592) 799 : cluster 0 pgmap v1294: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:28.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:27 smithi145 bash[23893]: cluster 2024-05-20T22:27:26.765757+0000 mgr.y (mgr.14592) 800 : cluster 0 pgmap v1295: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:28.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:27 smithi050 bash[21866]: cluster 2024-05-20T22:27:26.765757+0000 mgr.y (mgr.14592) 800 : cluster 0 pgmap v1295: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:28.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:27 smithi050 bash[28929]: cluster 2024-05-20T22:27:26.765757+0000 mgr.y (mgr.14592) 800 : cluster 0 pgmap v1295: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:28.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:27:28 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:27:29.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:27:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:27:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:27:30.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:29 smithi145 bash[23893]: audit 2024-05-20T22:27:28.584613+0000 mgr.y (mgr.14592) 801 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:27:30.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:29 smithi145 bash[23893]: cluster 2024-05-20T22:27:28.766652+0000 mgr.y (mgr.14592) 802 : cluster 0 pgmap v1296: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:30.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:29 smithi050 bash[28929]: audit 2024-05-20T22:27:28.584613+0000 mgr.y (mgr.14592) 801 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:27:30.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:29 smithi050 bash[28929]: cluster 2024-05-20T22:27:28.766652+0000 mgr.y (mgr.14592) 802 : cluster 0 pgmap v1296: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:30.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:29 smithi050 bash[21866]: audit 2024-05-20T22:27:28.584613+0000 mgr.y (mgr.14592) 801 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:27:30.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:29 smithi050 bash[21866]: cluster 2024-05-20T22:27:28.766652+0000 mgr.y (mgr.14592) 802 : cluster 0 pgmap v1296: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:32.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:31 smithi145 bash[23893]: cluster 2024-05-20T22:27:30.769606+0000 mgr.y (mgr.14592) 803 : cluster 0 pgmap v1297: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:32.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:31 smithi050 bash[28929]: cluster 2024-05-20T22:27:30.769606+0000 mgr.y (mgr.14592) 803 : cluster 0 pgmap v1297: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:32.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:31 smithi050 bash[21866]: cluster 2024-05-20T22:27:30.769606+0000 mgr.y (mgr.14592) 803 : cluster 0 pgmap v1297: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:34.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:33 smithi145 bash[23893]: cluster 2024-05-20T22:27:32.770504+0000 mgr.y (mgr.14592) 804 : cluster 0 pgmap v1298: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:34.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:33 smithi050 bash[28929]: cluster 2024-05-20T22:27:32.770504+0000 mgr.y (mgr.14592) 804 : cluster 0 pgmap v1298: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:34.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:33 smithi050 bash[21866]: cluster 2024-05-20T22:27:32.770504+0000 mgr.y (mgr.14592) 804 : cluster 0 pgmap v1298: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:35.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:34 smithi050 bash[21866]: cluster 2024-05-20T22:27:34.771410+0000 mgr.y (mgr.14592) 805 : cluster 0 pgmap v1299: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:35.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:34 smithi050 bash[28929]: cluster 2024-05-20T22:27:34.771410+0000 mgr.y (mgr.14592) 805 : cluster 0 pgmap v1299: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:35.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:34 smithi145 bash[23893]: cluster 2024-05-20T22:27:34.771410+0000 mgr.y (mgr.14592) 805 : cluster 0 pgmap v1299: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:38.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:37 smithi145 bash[23893]: cluster 2024-05-20T22:27:36.774340+0000 mgr.y (mgr.14592) 806 : cluster 0 pgmap v1300: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:38.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:37 smithi050 bash[21866]: cluster 2024-05-20T22:27:36.774340+0000 mgr.y (mgr.14592) 806 : cluster 0 pgmap v1300: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:38.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:37 smithi050 bash[28929]: cluster 2024-05-20T22:27:36.774340+0000 mgr.y (mgr.14592) 806 : cluster 0 pgmap v1300: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:38.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:27:38 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:27:39.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:27:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:27:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:27:40.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:39 smithi145 bash[23893]: audit 2024-05-20T22:27:38.595411+0000 mgr.y (mgr.14592) 807 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:27:40.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:39 smithi145 bash[23893]: cluster 2024-05-20T22:27:38.775267+0000 mgr.y (mgr.14592) 808 : cluster 0 pgmap v1301: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:40.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:39 smithi145 bash[23893]: audit 2024-05-20T22:27:39.290743+0000 mon.a (mon.0) 3698 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:27:40.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:39 smithi050 bash[21866]: audit 2024-05-20T22:27:38.595411+0000 mgr.y (mgr.14592) 807 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:27:40.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:39 smithi050 bash[21866]: cluster 2024-05-20T22:27:38.775267+0000 mgr.y (mgr.14592) 808 : cluster 0 pgmap v1301: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:40.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:39 smithi050 bash[21866]: audit 2024-05-20T22:27:39.290743+0000 mon.a (mon.0) 3698 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:27:40.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:39 smithi050 bash[28929]: audit 2024-05-20T22:27:38.595411+0000 mgr.y (mgr.14592) 807 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:27:40.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:39 smithi050 bash[28929]: cluster 2024-05-20T22:27:38.775267+0000 mgr.y (mgr.14592) 808 : cluster 0 pgmap v1301: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:40.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:39 smithi050 bash[28929]: audit 2024-05-20T22:27:39.290743+0000 mon.a (mon.0) 3698 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:27:42.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:41 smithi145 bash[23893]: cluster 2024-05-20T22:27:40.778209+0000 mgr.y (mgr.14592) 809 : cluster 0 pgmap v1302: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:42.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:41 smithi050 bash[21866]: cluster 2024-05-20T22:27:40.778209+0000 mgr.y (mgr.14592) 809 : cluster 0 pgmap v1302: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:42.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:41 smithi050 bash[28929]: cluster 2024-05-20T22:27:40.778209+0000 mgr.y (mgr.14592) 809 : cluster 0 pgmap v1302: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:44.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:43 smithi145 bash[23893]: cluster 2024-05-20T22:27:42.779104+0000 mgr.y (mgr.14592) 810 : cluster 0 pgmap v1303: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:44.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:43 smithi050 bash[21866]: cluster 2024-05-20T22:27:42.779104+0000 mgr.y (mgr.14592) 810 : cluster 0 pgmap v1303: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:44.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:43 smithi050 bash[28929]: cluster 2024-05-20T22:27:42.779104+0000 mgr.y (mgr.14592) 810 : cluster 0 pgmap v1303: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:46.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:45 smithi145 bash[23893]: cluster 2024-05-20T22:27:44.780033+0000 mgr.y (mgr.14592) 811 : cluster 0 pgmap v1304: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:46.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:45 smithi050 bash[21866]: cluster 2024-05-20T22:27:44.780033+0000 mgr.y (mgr.14592) 811 : cluster 0 pgmap v1304: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:46.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:45 smithi050 bash[28929]: cluster 2024-05-20T22:27:44.780033+0000 mgr.y (mgr.14592) 811 : cluster 0 pgmap v1304: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:48.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:47 smithi145 bash[23893]: cluster 2024-05-20T22:27:46.782849+0000 mgr.y (mgr.14592) 812 : cluster 0 pgmap v1305: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:48.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:47 smithi050 bash[21866]: cluster 2024-05-20T22:27:46.782849+0000 mgr.y (mgr.14592) 812 : cluster 0 pgmap v1305: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:48.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:47 smithi050 bash[28929]: cluster 2024-05-20T22:27:46.782849+0000 mgr.y (mgr.14592) 812 : cluster 0 pgmap v1305: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:48.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:27:48 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:27:49.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:27:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:27:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:27:50.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:49 smithi145 bash[23893]: audit 2024-05-20T22:27:48.598549+0000 mgr.y (mgr.14592) 813 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:27:50.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:49 smithi145 bash[23893]: cluster 2024-05-20T22:27:48.783767+0000 mgr.y (mgr.14592) 814 : cluster 0 pgmap v1306: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:50.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:49 smithi050 bash[21866]: audit 2024-05-20T22:27:48.598549+0000 mgr.y (mgr.14592) 813 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:27:50.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:49 smithi050 bash[21866]: cluster 2024-05-20T22:27:48.783767+0000 mgr.y (mgr.14592) 814 : cluster 0 pgmap v1306: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:50.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:49 smithi050 bash[28929]: audit 2024-05-20T22:27:48.598549+0000 mgr.y (mgr.14592) 813 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:27:50.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:49 smithi050 bash[28929]: cluster 2024-05-20T22:27:48.783767+0000 mgr.y (mgr.14592) 814 : cluster 0 pgmap v1306: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:52.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:51 smithi145 bash[23893]: cluster 2024-05-20T22:27:50.786689+0000 mgr.y (mgr.14592) 815 : cluster 0 pgmap v1307: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:52.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:51 smithi050 bash[28929]: cluster 2024-05-20T22:27:50.786689+0000 mgr.y (mgr.14592) 815 : cluster 0 pgmap v1307: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:52.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:51 smithi050 bash[21866]: cluster 2024-05-20T22:27:50.786689+0000 mgr.y (mgr.14592) 815 : cluster 0 pgmap v1307: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:54.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:53 smithi145 bash[23893]: cluster 2024-05-20T22:27:52.787563+0000 mgr.y (mgr.14592) 816 : cluster 0 pgmap v1308: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:54.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:53 smithi050 bash[21866]: cluster 2024-05-20T22:27:52.787563+0000 mgr.y (mgr.14592) 816 : cluster 0 pgmap v1308: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:54.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:53 smithi050 bash[28929]: cluster 2024-05-20T22:27:52.787563+0000 mgr.y (mgr.14592) 816 : cluster 0 pgmap v1308: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:55.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:54 smithi145 bash[23893]: audit 2024-05-20T22:27:54.322466+0000 mon.a (mon.0) 3699 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:27:55.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:54 smithi050 bash[21866]: audit 2024-05-20T22:27:54.322466+0000 mon.a (mon.0) 3699 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:27:55.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:54 smithi050 bash[28929]: audit 2024-05-20T22:27:54.322466+0000 mon.a (mon.0) 3699 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:27:56.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:55 smithi145 bash[23893]: cluster 2024-05-20T22:27:54.788631+0000 mgr.y (mgr.14592) 817 : cluster 0 pgmap v1309: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:56.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:55 smithi050 bash[21866]: cluster 2024-05-20T22:27:54.788631+0000 mgr.y (mgr.14592) 817 : cluster 0 pgmap v1309: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:56.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:55 smithi050 bash[28929]: cluster 2024-05-20T22:27:54.788631+0000 mgr.y (mgr.14592) 817 : cluster 0 pgmap v1309: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:27:57.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:56 smithi145 bash[23893]: cluster 2024-05-20T22:27:56.791596+0000 mgr.y (mgr.14592) 818 : cluster 0 pgmap v1310: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:57.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:56 smithi050 bash[21866]: cluster 2024-05-20T22:27:56.791596+0000 mgr.y (mgr.14592) 818 : cluster 0 pgmap v1310: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:57.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:56 smithi050 bash[28929]: cluster 2024-05-20T22:27:56.791596+0000 mgr.y (mgr.14592) 818 : cluster 0 pgmap v1310: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:27:58.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:27:58 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:27:59.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:27:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:27:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:28:00.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:59 smithi145 bash[23893]: audit 2024-05-20T22:27:58.609923+0000 mgr.y (mgr.14592) 819 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:00.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:27:59 smithi145 bash[23893]: cluster 2024-05-20T22:27:58.792486+0000 mgr.y (mgr.14592) 820 : cluster 0 pgmap v1311: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:00.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:59 smithi050 bash[21866]: audit 2024-05-20T22:27:58.609923+0000 mgr.y (mgr.14592) 819 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:00.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:27:59 smithi050 bash[21866]: cluster 2024-05-20T22:27:58.792486+0000 mgr.y (mgr.14592) 820 : cluster 0 pgmap v1311: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:00.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:59 smithi050 bash[28929]: audit 2024-05-20T22:27:58.609923+0000 mgr.y (mgr.14592) 819 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:00.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:27:59 smithi050 bash[28929]: cluster 2024-05-20T22:27:58.792486+0000 mgr.y (mgr.14592) 820 : cluster 0 pgmap v1311: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:02.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:01 smithi145 bash[23893]: cluster 2024-05-20T22:28:00.795376+0000 mgr.y (mgr.14592) 821 : cluster 0 pgmap v1312: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:02.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:01 smithi050 bash[21866]: cluster 2024-05-20T22:28:00.795376+0000 mgr.y (mgr.14592) 821 : cluster 0 pgmap v1312: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:02.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:01 smithi050 bash[28929]: cluster 2024-05-20T22:28:00.795376+0000 mgr.y (mgr.14592) 821 : cluster 0 pgmap v1312: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:03.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:02 smithi145 bash[23893]: audit 2024-05-20T22:28:01.936687+0000 mon.a (mon.0) 3700 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:28:03.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:02 smithi145 bash[23893]: audit 2024-05-20T22:28:02.473214+0000 mon.a (mon.0) 3701 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:28:03.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:02 smithi145 bash[23893]: audit 2024-05-20T22:28:02.478165+0000 mon.a (mon.0) 3702 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:28:03.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:02 smithi050 bash[21866]: audit 2024-05-20T22:28:01.936687+0000 mon.a (mon.0) 3700 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:28:03.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:02 smithi050 bash[21866]: audit 2024-05-20T22:28:02.473214+0000 mon.a (mon.0) 3701 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:28:03.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:02 smithi050 bash[21866]: audit 2024-05-20T22:28:02.478165+0000 mon.a (mon.0) 3702 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:28:03.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:02 smithi050 bash[28929]: audit 2024-05-20T22:28:01.936687+0000 mon.a (mon.0) 3700 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:28:03.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:02 smithi050 bash[28929]: audit 2024-05-20T22:28:02.473214+0000 mon.a (mon.0) 3701 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:28:03.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:02 smithi050 bash[28929]: audit 2024-05-20T22:28:02.478165+0000 mon.a (mon.0) 3702 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:28:04.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:03 smithi145 bash[23893]: cluster 2024-05-20T22:28:02.796295+0000 mgr.y (mgr.14592) 822 : cluster 0 pgmap v1313: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:04.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:03 smithi145 bash[23893]: audit 2024-05-20T22:28:03.049420+0000 mon.a (mon.0) 3703 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:28:04.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:03 smithi145 bash[23893]: audit 2024-05-20T22:28:03.050337+0000 mon.a (mon.0) 3704 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:28:04.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:03 smithi145 bash[23893]: audit 2024-05-20T22:28:03.055685+0000 mon.a (mon.0) 3705 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:28:04.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:03 smithi050 bash[21866]: cluster 2024-05-20T22:28:02.796295+0000 mgr.y (mgr.14592) 822 : cluster 0 pgmap v1313: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:04.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:03 smithi050 bash[21866]: audit 2024-05-20T22:28:03.049420+0000 mon.a (mon.0) 3703 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:28:04.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:03 smithi050 bash[21866]: audit 2024-05-20T22:28:03.050337+0000 mon.a (mon.0) 3704 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:28:04.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:03 smithi050 bash[21866]: audit 2024-05-20T22:28:03.055685+0000 mon.a (mon.0) 3705 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:28:04.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:03 smithi050 bash[28929]: cluster 2024-05-20T22:28:02.796295+0000 mgr.y (mgr.14592) 822 : cluster 0 pgmap v1313: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:04.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:03 smithi050 bash[28929]: audit 2024-05-20T22:28:03.049420+0000 mon.a (mon.0) 3703 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:28:04.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:03 smithi050 bash[28929]: audit 2024-05-20T22:28:03.050337+0000 mon.a (mon.0) 3704 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:28:04.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:03 smithi050 bash[28929]: audit 2024-05-20T22:28:03.055685+0000 mon.a (mon.0) 3705 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:28:06.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:05 smithi145 bash[23893]: cluster 2024-05-20T22:28:04.797185+0000 mgr.y (mgr.14592) 823 : cluster 0 pgmap v1314: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:06.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:05 smithi050 bash[21866]: cluster 2024-05-20T22:28:04.797185+0000 mgr.y (mgr.14592) 823 : cluster 0 pgmap v1314: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:06.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:05 smithi050 bash[28929]: cluster 2024-05-20T22:28:04.797185+0000 mgr.y (mgr.14592) 823 : cluster 0 pgmap v1314: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:08.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:07 smithi145 bash[23893]: cluster 2024-05-20T22:28:06.800149+0000 mgr.y (mgr.14592) 824 : cluster 0 pgmap v1315: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:08.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:07 smithi050 bash[21866]: cluster 2024-05-20T22:28:06.800149+0000 mgr.y (mgr.14592) 824 : cluster 0 pgmap v1315: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:08.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:07 smithi050 bash[28929]: cluster 2024-05-20T22:28:06.800149+0000 mgr.y (mgr.14592) 824 : cluster 0 pgmap v1315: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:08.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:28:08 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:28:09.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:28:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:28:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:28:10.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:09 smithi145 bash[23893]: audit 2024-05-20T22:28:08.621405+0000 mgr.y (mgr.14592) 825 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:10.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:09 smithi145 bash[23893]: cluster 2024-05-20T22:28:08.801048+0000 mgr.y (mgr.14592) 826 : cluster 0 pgmap v1316: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:10.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:09 smithi145 bash[23893]: audit 2024-05-20T22:28:09.354433+0000 mon.a (mon.0) 3706 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:28:10.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:09 smithi050 bash[21866]: audit 2024-05-20T22:28:08.621405+0000 mgr.y (mgr.14592) 825 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:10.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:09 smithi050 bash[21866]: cluster 2024-05-20T22:28:08.801048+0000 mgr.y (mgr.14592) 826 : cluster 0 pgmap v1316: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:10.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:09 smithi050 bash[21866]: audit 2024-05-20T22:28:09.354433+0000 mon.a (mon.0) 3706 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:28:10.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:09 smithi050 bash[28929]: audit 2024-05-20T22:28:08.621405+0000 mgr.y (mgr.14592) 825 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:10.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:09 smithi050 bash[28929]: cluster 2024-05-20T22:28:08.801048+0000 mgr.y (mgr.14592) 826 : cluster 0 pgmap v1316: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:10.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:09 smithi050 bash[28929]: audit 2024-05-20T22:28:09.354433+0000 mon.a (mon.0) 3706 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:28:12.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:11 smithi145 bash[23893]: cluster 2024-05-20T22:28:10.803986+0000 mgr.y (mgr.14592) 827 : cluster 0 pgmap v1317: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:12.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:11 smithi050 bash[21866]: cluster 2024-05-20T22:28:10.803986+0000 mgr.y (mgr.14592) 827 : cluster 0 pgmap v1317: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:12.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:11 smithi050 bash[28929]: cluster 2024-05-20T22:28:10.803986+0000 mgr.y (mgr.14592) 827 : cluster 0 pgmap v1317: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:14.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:13 smithi145 bash[23893]: cluster 2024-05-20T22:28:12.804891+0000 mgr.y (mgr.14592) 828 : cluster 0 pgmap v1318: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:14.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:13 smithi050 bash[21866]: cluster 2024-05-20T22:28:12.804891+0000 mgr.y (mgr.14592) 828 : cluster 0 pgmap v1318: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:14.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:13 smithi050 bash[28929]: cluster 2024-05-20T22:28:12.804891+0000 mgr.y (mgr.14592) 828 : cluster 0 pgmap v1318: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:15.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:14 smithi145 bash[23893]: cluster 2024-05-20T22:28:14.805768+0000 mgr.y (mgr.14592) 829 : cluster 0 pgmap v1319: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:15.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:14 smithi050 bash[21866]: cluster 2024-05-20T22:28:14.805768+0000 mgr.y (mgr.14592) 829 : cluster 0 pgmap v1319: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:15.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:14 smithi050 bash[28929]: cluster 2024-05-20T22:28:14.805768+0000 mgr.y (mgr.14592) 829 : cluster 0 pgmap v1319: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:18.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:17 smithi145 bash[23893]: cluster 2024-05-20T22:28:16.808620+0000 mgr.y (mgr.14592) 830 : cluster 0 pgmap v1320: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:18.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:17 smithi050 bash[21866]: cluster 2024-05-20T22:28:16.808620+0000 mgr.y (mgr.14592) 830 : cluster 0 pgmap v1320: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:18.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:17 smithi050 bash[28929]: cluster 2024-05-20T22:28:16.808620+0000 mgr.y (mgr.14592) 830 : cluster 0 pgmap v1320: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:18.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:28:18 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:28:19.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:28:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:28:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:28:20.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:19 smithi145 bash[23893]: audit 2024-05-20T22:28:18.623679+0000 mgr.y (mgr.14592) 831 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:20.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:19 smithi145 bash[23893]: cluster 2024-05-20T22:28:18.809515+0000 mgr.y (mgr.14592) 832 : cluster 0 pgmap v1321: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:20.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:19 smithi050 bash[21866]: audit 2024-05-20T22:28:18.623679+0000 mgr.y (mgr.14592) 831 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:20.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:19 smithi050 bash[21866]: cluster 2024-05-20T22:28:18.809515+0000 mgr.y (mgr.14592) 832 : cluster 0 pgmap v1321: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:20.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:19 smithi050 bash[28929]: audit 2024-05-20T22:28:18.623679+0000 mgr.y (mgr.14592) 831 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:20.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:19 smithi050 bash[28929]: cluster 2024-05-20T22:28:18.809515+0000 mgr.y (mgr.14592) 832 : cluster 0 pgmap v1321: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:22.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:21 smithi145 bash[23893]: cluster 2024-05-20T22:28:20.812559+0000 mgr.y (mgr.14592) 833 : cluster 0 pgmap v1322: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:22.139 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:28:21 smithi145 bash[51536]: logger=cleanup t=2024-05-20T22:28:21.991407063Z level=info msg="Completed cleanup jobs" duration=2.393927ms 2024-05-20T22:28:22.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:21 smithi050 bash[21866]: cluster 2024-05-20T22:28:20.812559+0000 mgr.y (mgr.14592) 833 : cluster 0 pgmap v1322: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:22.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:21 smithi050 bash[28929]: cluster 2024-05-20T22:28:20.812559+0000 mgr.y (mgr.14592) 833 : cluster 0 pgmap v1322: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:24.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:23 smithi145 bash[23893]: cluster 2024-05-20T22:28:22.813529+0000 mgr.y (mgr.14592) 834 : cluster 0 pgmap v1323: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:24.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:23 smithi050 bash[21866]: cluster 2024-05-20T22:28:22.813529+0000 mgr.y (mgr.14592) 834 : cluster 0 pgmap v1323: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:24.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:23 smithi050 bash[28929]: cluster 2024-05-20T22:28:22.813529+0000 mgr.y (mgr.14592) 834 : cluster 0 pgmap v1323: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:25.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:24 smithi145 bash[23893]: audit 2024-05-20T22:28:24.386727+0000 mon.a (mon.0) 3707 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:28:25.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:24 smithi145 bash[23893]: cluster 2024-05-20T22:28:24.814458+0000 mgr.y (mgr.14592) 835 : cluster 0 pgmap v1324: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:25.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:24 smithi050 bash[21866]: audit 2024-05-20T22:28:24.386727+0000 mon.a (mon.0) 3707 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:28:25.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:24 smithi050 bash[21866]: cluster 2024-05-20T22:28:24.814458+0000 mgr.y (mgr.14592) 835 : cluster 0 pgmap v1324: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:25.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:24 smithi050 bash[28929]: audit 2024-05-20T22:28:24.386727+0000 mon.a (mon.0) 3707 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:28:25.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:24 smithi050 bash[28929]: cluster 2024-05-20T22:28:24.814458+0000 mgr.y (mgr.14592) 835 : cluster 0 pgmap v1324: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:28.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:27 smithi145 bash[23893]: cluster 2024-05-20T22:28:26.817410+0000 mgr.y (mgr.14592) 836 : cluster 0 pgmap v1325: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:28.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:27 smithi050 bash[21866]: cluster 2024-05-20T22:28:26.817410+0000 mgr.y (mgr.14592) 836 : cluster 0 pgmap v1325: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:28.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:27 smithi050 bash[28929]: cluster 2024-05-20T22:28:26.817410+0000 mgr.y (mgr.14592) 836 : cluster 0 pgmap v1325: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:28.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:28:28 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:28:29.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:28:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:28:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:28:30.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:29 smithi145 bash[23893]: audit 2024-05-20T22:28:28.634998+0000 mgr.y (mgr.14592) 837 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:30.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:29 smithi145 bash[23893]: cluster 2024-05-20T22:28:28.818312+0000 mgr.y (mgr.14592) 838 : cluster 0 pgmap v1326: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:30.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:29 smithi050 bash[21866]: audit 2024-05-20T22:28:28.634998+0000 mgr.y (mgr.14592) 837 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:30.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:29 smithi050 bash[21866]: cluster 2024-05-20T22:28:28.818312+0000 mgr.y (mgr.14592) 838 : cluster 0 pgmap v1326: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:30.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:29 smithi050 bash[28929]: audit 2024-05-20T22:28:28.634998+0000 mgr.y (mgr.14592) 837 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:30.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:29 smithi050 bash[28929]: cluster 2024-05-20T22:28:28.818312+0000 mgr.y (mgr.14592) 838 : cluster 0 pgmap v1326: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:31.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:30 smithi050 bash[28929]: cluster 2024-05-20T22:28:30.821257+0000 mgr.y (mgr.14592) 839 : cluster 0 pgmap v1327: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:31.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:30 smithi050 bash[21866]: cluster 2024-05-20T22:28:30.821257+0000 mgr.y (mgr.14592) 839 : cluster 0 pgmap v1327: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:31.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:30 smithi145 bash[23893]: cluster 2024-05-20T22:28:30.821257+0000 mgr.y (mgr.14592) 839 : cluster 0 pgmap v1327: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:34.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:33 smithi145 bash[23893]: cluster 2024-05-20T22:28:32.822172+0000 mgr.y (mgr.14592) 840 : cluster 0 pgmap v1328: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:34.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:33 smithi050 bash[21866]: cluster 2024-05-20T22:28:32.822172+0000 mgr.y (mgr.14592) 840 : cluster 0 pgmap v1328: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:34.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:33 smithi050 bash[28929]: cluster 2024-05-20T22:28:32.822172+0000 mgr.y (mgr.14592) 840 : cluster 0 pgmap v1328: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:34.215 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.215 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.215 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.215 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.215 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.215 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.215 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.215 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.215 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.216 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.216 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.216 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.216 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.216 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.216 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.216 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.216 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.216 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.216 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.216 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.216 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.216 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:34.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:28:35.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:34 smithi050 bash[21866]: cluster 2024-05-20T22:28:34.823099+0000 mgr.y (mgr.14592) 841 : cluster 0 pgmap v1329: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:35.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:34 smithi050 bash[28929]: cluster 2024-05-20T22:28:34.823099+0000 mgr.y (mgr.14592) 841 : cluster 0 pgmap v1329: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:35.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:34 smithi145 bash[23893]: cluster 2024-05-20T22:28:34.823099+0000 mgr.y (mgr.14592) 841 : cluster 0 pgmap v1329: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:38.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:37 smithi145 bash[23893]: cluster 2024-05-20T22:28:36.826065+0000 mgr.y (mgr.14592) 842 : cluster 0 pgmap v1330: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:38.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:37 smithi050 bash[21866]: cluster 2024-05-20T22:28:36.826065+0000 mgr.y (mgr.14592) 842 : cluster 0 pgmap v1330: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:38.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:37 smithi050 bash[28929]: cluster 2024-05-20T22:28:36.826065+0000 mgr.y (mgr.14592) 842 : cluster 0 pgmap v1330: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:38.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:28:38 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:28:38.888 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:38 smithi145 bash[23893]: audit 2024-05-20T22:28:38.646319+0000 mgr.y (mgr.14592) 843 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:38.888 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:38 smithi145 bash[23893]: cluster 2024-05-20T22:28:38.826985+0000 mgr.y (mgr.14592) 844 : cluster 0 pgmap v1331: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:39.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:38 smithi050 bash[21866]: audit 2024-05-20T22:28:38.646319+0000 mgr.y (mgr.14592) 843 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:39.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:38 smithi050 bash[21866]: cluster 2024-05-20T22:28:38.826985+0000 mgr.y (mgr.14592) 844 : cluster 0 pgmap v1331: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:39.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:38 smithi050 bash[28929]: audit 2024-05-20T22:28:38.646319+0000 mgr.y (mgr.14592) 843 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:39.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:38 smithi050 bash[28929]: cluster 2024-05-20T22:28:38.826985+0000 mgr.y (mgr.14592) 844 : cluster 0 pgmap v1331: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:39.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:28:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:28:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:28:40.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:39 smithi145 bash[23893]: audit 2024-05-20T22:28:39.420142+0000 mon.a (mon.0) 3708 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:28:40.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:39 smithi050 bash[28929]: audit 2024-05-20T22:28:39.420142+0000 mon.a (mon.0) 3708 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:28:40.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:39 smithi050 bash[21866]: audit 2024-05-20T22:28:39.420142+0000 mon.a (mon.0) 3708 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:28:41.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:40 smithi050 bash[21866]: cluster 2024-05-20T22:28:40.829941+0000 mgr.y (mgr.14592) 845 : cluster 0 pgmap v1332: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:41.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:40 smithi050 bash[28929]: cluster 2024-05-20T22:28:40.829941+0000 mgr.y (mgr.14592) 845 : cluster 0 pgmap v1332: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:41.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:40 smithi145 bash[23893]: cluster 2024-05-20T22:28:40.829941+0000 mgr.y (mgr.14592) 845 : cluster 0 pgmap v1332: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:43.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:42 smithi050 bash[28929]: cluster 2024-05-20T22:28:42.831103+0000 mgr.y (mgr.14592) 846 : cluster 0 pgmap v1333: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:43.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:42 smithi050 bash[21866]: cluster 2024-05-20T22:28:42.831103+0000 mgr.y (mgr.14592) 846 : cluster 0 pgmap v1333: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:43.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:42 smithi145 bash[23893]: cluster 2024-05-20T22:28:42.831103+0000 mgr.y (mgr.14592) 846 : cluster 0 pgmap v1333: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:45.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:44 smithi050 bash[21866]: cluster 2024-05-20T22:28:44.832109+0000 mgr.y (mgr.14592) 847 : cluster 0 pgmap v1334: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:45.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:44 smithi050 bash[28929]: cluster 2024-05-20T22:28:44.832109+0000 mgr.y (mgr.14592) 847 : cluster 0 pgmap v1334: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:45.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:44 smithi145 bash[23893]: cluster 2024-05-20T22:28:44.832109+0000 mgr.y (mgr.14592) 847 : cluster 0 pgmap v1334: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:47.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:46 smithi050 bash[21866]: cluster 2024-05-20T22:28:46.835024+0000 mgr.y (mgr.14592) 848 : cluster 0 pgmap v1335: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:47.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:46 smithi050 bash[28929]: cluster 2024-05-20T22:28:46.835024+0000 mgr.y (mgr.14592) 848 : cluster 0 pgmap v1335: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:47.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:46 smithi145 bash[23893]: cluster 2024-05-20T22:28:46.835024+0000 mgr.y (mgr.14592) 848 : cluster 0 pgmap v1335: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:48.926 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:28:48 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:28:49.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:48 smithi050 bash[21866]: audit 2024-05-20T22:28:48.654567+0000 mgr.y (mgr.14592) 849 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:49.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:48 smithi050 bash[21866]: cluster 2024-05-20T22:28:48.835989+0000 mgr.y (mgr.14592) 850 : cluster 0 pgmap v1336: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:49.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:48 smithi050 bash[28929]: audit 2024-05-20T22:28:48.654567+0000 mgr.y (mgr.14592) 849 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:49.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:48 smithi050 bash[28929]: cluster 2024-05-20T22:28:48.835989+0000 mgr.y (mgr.14592) 850 : cluster 0 pgmap v1336: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:49.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:48 smithi145 bash[23893]: audit 2024-05-20T22:28:48.654567+0000 mgr.y (mgr.14592) 849 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:49.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:48 smithi145 bash[23893]: cluster 2024-05-20T22:28:48.835989+0000 mgr.y (mgr.14592) 850 : cluster 0 pgmap v1336: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:49.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:28:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:28:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:28:51.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:50 smithi050 bash[21866]: cluster 2024-05-20T22:28:50.838825+0000 mgr.y (mgr.14592) 851 : cluster 0 pgmap v1337: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:51.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:50 smithi050 bash[28929]: cluster 2024-05-20T22:28:50.838825+0000 mgr.y (mgr.14592) 851 : cluster 0 pgmap v1337: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:51.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:50 smithi145 bash[23893]: cluster 2024-05-20T22:28:50.838825+0000 mgr.y (mgr.14592) 851 : cluster 0 pgmap v1337: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:53.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:52 smithi050 bash[21866]: cluster 2024-05-20T22:28:52.839739+0000 mgr.y (mgr.14592) 852 : cluster 0 pgmap v1338: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:53.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:52 smithi050 bash[28929]: cluster 2024-05-20T22:28:52.839739+0000 mgr.y (mgr.14592) 852 : cluster 0 pgmap v1338: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:53.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:52 smithi145 bash[23893]: cluster 2024-05-20T22:28:52.839739+0000 mgr.y (mgr.14592) 852 : cluster 0 pgmap v1338: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:54.888 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:54 smithi145 bash[23893]: audit 2024-05-20T22:28:54.452657+0000 mon.a (mon.0) 3709 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:28:54.939 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:54 smithi050 bash[21866]: audit 2024-05-20T22:28:54.452657+0000 mon.a (mon.0) 3709 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:28:54.939 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:54 smithi050 bash[28929]: audit 2024-05-20T22:28:54.452657+0000 mon.a (mon.0) 3709 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:28:55.888 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:55 smithi145 bash[23893]: cluster 2024-05-20T22:28:54.840676+0000 mgr.y (mgr.14592) 853 : cluster 0 pgmap v1339: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:55.939 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:55 smithi050 bash[21866]: cluster 2024-05-20T22:28:54.840676+0000 mgr.y (mgr.14592) 853 : cluster 0 pgmap v1339: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:55.939 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:55 smithi050 bash[28929]: cluster 2024-05-20T22:28:54.840676+0000 mgr.y (mgr.14592) 853 : cluster 0 pgmap v1339: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:57.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:56 smithi050 bash[21866]: cluster 2024-05-20T22:28:56.843584+0000 mgr.y (mgr.14592) 854 : cluster 0 pgmap v1340: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:57.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:56 smithi050 bash[28929]: cluster 2024-05-20T22:28:56.843584+0000 mgr.y (mgr.14592) 854 : cluster 0 pgmap v1340: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:57.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:56 smithi145 bash[23893]: cluster 2024-05-20T22:28:56.843584+0000 mgr.y (mgr.14592) 854 : cluster 0 pgmap v1340: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:28:58.929 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:28:58 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:28:59.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:58 smithi050 bash[21866]: audit 2024-05-20T22:28:58.664220+0000 mgr.y (mgr.14592) 855 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:59.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:28:58 smithi050 bash[21866]: cluster 2024-05-20T22:28:58.844509+0000 mgr.y (mgr.14592) 856 : cluster 0 pgmap v1341: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:59.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:58 smithi050 bash[28929]: audit 2024-05-20T22:28:58.664220+0000 mgr.y (mgr.14592) 855 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:59.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:28:58 smithi050 bash[28929]: cluster 2024-05-20T22:28:58.844509+0000 mgr.y (mgr.14592) 856 : cluster 0 pgmap v1341: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:59.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:58 smithi145 bash[23893]: audit 2024-05-20T22:28:58.664220+0000 mgr.y (mgr.14592) 855 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:28:59.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:28:58 smithi145 bash[23893]: cluster 2024-05-20T22:28:58.844509+0000 mgr.y (mgr.14592) 856 : cluster 0 pgmap v1341: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:28:59.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:28:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:28:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:29:01.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:00 smithi050 bash[21866]: cluster 2024-05-20T22:29:00.847415+0000 mgr.y (mgr.14592) 857 : cluster 0 pgmap v1342: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:01.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:00 smithi050 bash[28929]: cluster 2024-05-20T22:29:00.847415+0000 mgr.y (mgr.14592) 857 : cluster 0 pgmap v1342: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:01.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:00 smithi145 bash[23893]: cluster 2024-05-20T22:29:00.847415+0000 mgr.y (mgr.14592) 857 : cluster 0 pgmap v1342: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:03.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:02 smithi050 bash[21866]: cluster 2024-05-20T22:29:02.848410+0000 mgr.y (mgr.14592) 858 : cluster 0 pgmap v1343: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:03.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:02 smithi050 bash[28929]: cluster 2024-05-20T22:29:02.848410+0000 mgr.y (mgr.14592) 858 : cluster 0 pgmap v1343: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:03.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:02 smithi145 bash[23893]: cluster 2024-05-20T22:29:02.848410+0000 mgr.y (mgr.14592) 858 : cluster 0 pgmap v1343: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:04.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:03 smithi050 bash[28929]: audit 2024-05-20T22:29:03.177530+0000 mon.a (mon.0) 3710 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:29:04.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:03 smithi050 bash[28929]: audit 2024-05-20T22:29:03.717300+0000 mon.a (mon.0) 3711 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:04.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:03 smithi050 bash[28929]: audit 2024-05-20T22:29:03.724241+0000 mon.a (mon.0) 3712 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:04.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:03 smithi050 bash[21866]: audit 2024-05-20T22:29:03.177530+0000 mon.a (mon.0) 3710 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:29:04.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:03 smithi050 bash[21866]: audit 2024-05-20T22:29:03.717300+0000 mon.a (mon.0) 3711 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:04.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:03 smithi050 bash[21866]: audit 2024-05-20T22:29:03.724241+0000 mon.a (mon.0) 3712 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:04.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:03 smithi145 bash[23893]: audit 2024-05-20T22:29:03.177530+0000 mon.a (mon.0) 3710 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:29:04.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:03 smithi145 bash[23893]: audit 2024-05-20T22:29:03.717300+0000 mon.a (mon.0) 3711 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:04.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:03 smithi145 bash[23893]: audit 2024-05-20T22:29:03.724241+0000 mon.a (mon.0) 3712 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:05.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:04 smithi145 bash[23893]: cluster 2024-05-20T22:29:04.849293+0000 mgr.y (mgr.14592) 859 : cluster 0 pgmap v1344: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:05.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:04 smithi050 bash[21866]: cluster 2024-05-20T22:29:04.849293+0000 mgr.y (mgr.14592) 859 : cluster 0 pgmap v1344: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:05.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:04 smithi050 bash[28929]: cluster 2024-05-20T22:29:04.849293+0000 mgr.y (mgr.14592) 859 : cluster 0 pgmap v1344: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:07.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:06 smithi050 bash[21866]: cluster 2024-05-20T22:29:06.852268+0000 mgr.y (mgr.14592) 860 : cluster 0 pgmap v1345: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:07.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:06 smithi050 bash[28929]: cluster 2024-05-20T22:29:06.852268+0000 mgr.y (mgr.14592) 860 : cluster 0 pgmap v1345: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:07.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:06 smithi145 bash[23893]: cluster 2024-05-20T22:29:06.852268+0000 mgr.y (mgr.14592) 860 : cluster 0 pgmap v1345: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:09.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:29:08 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:29:09.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:29:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:29:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:29:10.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:09 smithi145 bash[23893]: audit 2024-05-20T22:29:08.675043+0000 mgr.y (mgr.14592) 861 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:29:10.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:09 smithi145 bash[23893]: audit 2024-05-20T22:29:08.845133+0000 mon.a (mon.0) 3713 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:10.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:09 smithi145 bash[23893]: audit 2024-05-20T22:29:08.849425+0000 mon.a (mon.0) 3714 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:10.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:09 smithi145 bash[23893]: cluster 2024-05-20T22:29:08.852767+0000 mgr.y (mgr.14592) 862 : cluster 0 pgmap v1346: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:10.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:09 smithi145 bash[23893]: audit 2024-05-20T22:29:09.485374+0000 mon.a (mon.0) 3715 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:29:10.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:09 smithi145 bash[23893]: audit 2024-05-20T22:29:09.700913+0000 mon.a (mon.0) 3716 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:10.140 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:09 smithi145 bash[23893]: audit 2024-05-20T22:29:09.710670+0000 mon.a (mon.0) 3717 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:10.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:09 smithi050 bash[21866]: audit 2024-05-20T22:29:08.675043+0000 mgr.y (mgr.14592) 861 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:29:10.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:09 smithi050 bash[21866]: audit 2024-05-20T22:29:08.845133+0000 mon.a (mon.0) 3713 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:10.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:09 smithi050 bash[21866]: audit 2024-05-20T22:29:08.849425+0000 mon.a (mon.0) 3714 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:10.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:09 smithi050 bash[21866]: cluster 2024-05-20T22:29:08.852767+0000 mgr.y (mgr.14592) 862 : cluster 0 pgmap v1346: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:10.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:09 smithi050 bash[21866]: audit 2024-05-20T22:29:09.485374+0000 mon.a (mon.0) 3715 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:29:10.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:09 smithi050 bash[21866]: audit 2024-05-20T22:29:09.700913+0000 mon.a (mon.0) 3716 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:10.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:09 smithi050 bash[21866]: audit 2024-05-20T22:29:09.710670+0000 mon.a (mon.0) 3717 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:10.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:09 smithi050 bash[28929]: audit 2024-05-20T22:29:08.675043+0000 mgr.y (mgr.14592) 861 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:29:10.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:09 smithi050 bash[28929]: audit 2024-05-20T22:29:08.845133+0000 mon.a (mon.0) 3713 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:10.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:09 smithi050 bash[28929]: audit 2024-05-20T22:29:08.849425+0000 mon.a (mon.0) 3714 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:10.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:09 smithi050 bash[28929]: cluster 2024-05-20T22:29:08.852767+0000 mgr.y (mgr.14592) 862 : cluster 0 pgmap v1346: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:10.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:09 smithi050 bash[28929]: audit 2024-05-20T22:29:09.485374+0000 mon.a (mon.0) 3715 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:29:10.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:09 smithi050 bash[28929]: audit 2024-05-20T22:29:09.700913+0000 mon.a (mon.0) 3716 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:10.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:09 smithi050 bash[28929]: audit 2024-05-20T22:29:09.710670+0000 mon.a (mon.0) 3717 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:11.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:10 smithi145 bash[23893]: audit 2024-05-20T22:29:10.321508+0000 mon.a (mon.0) 3718 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:29:11.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:10 smithi145 bash[23893]: audit 2024-05-20T22:29:10.323206+0000 mon.a (mon.0) 3719 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:29:11.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:10 smithi145 bash[23893]: audit 2024-05-20T22:29:10.333140+0000 mon.a (mon.0) 3720 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:11.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:10 smithi050 bash[21866]: audit 2024-05-20T22:29:10.321508+0000 mon.a (mon.0) 3718 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:29:11.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:10 smithi050 bash[21866]: audit 2024-05-20T22:29:10.323206+0000 mon.a (mon.0) 3719 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:29:11.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:10 smithi050 bash[21866]: audit 2024-05-20T22:29:10.333140+0000 mon.a (mon.0) 3720 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:11.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:10 smithi050 bash[28929]: audit 2024-05-20T22:29:10.321508+0000 mon.a (mon.0) 3718 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:29:11.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:10 smithi050 bash[28929]: audit 2024-05-20T22:29:10.323206+0000 mon.a (mon.0) 3719 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:29:11.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:10 smithi050 bash[28929]: audit 2024-05-20T22:29:10.333140+0000 mon.a (mon.0) 3720 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:29:12.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:11 smithi145 bash[23893]: cluster 2024-05-20T22:29:10.855824+0000 mgr.y (mgr.14592) 863 : cluster 0 pgmap v1347: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:12.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:11 smithi050 bash[28929]: cluster 2024-05-20T22:29:10.855824+0000 mgr.y (mgr.14592) 863 : cluster 0 pgmap v1347: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:12.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:11 smithi050 bash[21866]: cluster 2024-05-20T22:29:10.855824+0000 mgr.y (mgr.14592) 863 : cluster 0 pgmap v1347: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:14.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:13 smithi145 bash[23893]: cluster 2024-05-20T22:29:12.856929+0000 mgr.y (mgr.14592) 864 : cluster 0 pgmap v1348: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:14.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:13 smithi050 bash[21866]: cluster 2024-05-20T22:29:12.856929+0000 mgr.y (mgr.14592) 864 : cluster 0 pgmap v1348: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:14.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:13 smithi050 bash[28929]: cluster 2024-05-20T22:29:12.856929+0000 mgr.y (mgr.14592) 864 : cluster 0 pgmap v1348: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:16.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:15 smithi145 bash[23893]: cluster 2024-05-20T22:29:14.857878+0000 mgr.y (mgr.14592) 865 : cluster 0 pgmap v1349: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:16.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:15 smithi050 bash[21866]: cluster 2024-05-20T22:29:14.857878+0000 mgr.y (mgr.14592) 865 : cluster 0 pgmap v1349: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:16.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:15 smithi050 bash[28929]: cluster 2024-05-20T22:29:14.857878+0000 mgr.y (mgr.14592) 865 : cluster 0 pgmap v1349: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:18.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:17 smithi145 bash[23893]: cluster 2024-05-20T22:29:16.860825+0000 mgr.y (mgr.14592) 866 : cluster 0 pgmap v1350: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:18.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:17 smithi050 bash[21866]: cluster 2024-05-20T22:29:16.860825+0000 mgr.y (mgr.14592) 866 : cluster 0 pgmap v1350: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:18.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:17 smithi050 bash[28929]: cluster 2024-05-20T22:29:16.860825+0000 mgr.y (mgr.14592) 866 : cluster 0 pgmap v1350: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:19.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:29:18 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:29:19.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:29:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:29:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:29:20.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:19 smithi145 bash[23893]: audit 2024-05-20T22:29:18.678150+0000 mgr.y (mgr.14592) 867 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:29:20.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:19 smithi145 bash[23893]: cluster 2024-05-20T22:29:18.861745+0000 mgr.y (mgr.14592) 868 : cluster 0 pgmap v1351: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:20.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:19 smithi050 bash[21866]: audit 2024-05-20T22:29:18.678150+0000 mgr.y (mgr.14592) 867 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:29:20.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:19 smithi050 bash[21866]: cluster 2024-05-20T22:29:18.861745+0000 mgr.y (mgr.14592) 868 : cluster 0 pgmap v1351: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:20.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:19 smithi050 bash[28929]: audit 2024-05-20T22:29:18.678150+0000 mgr.y (mgr.14592) 867 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:29:20.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:19 smithi050 bash[28929]: cluster 2024-05-20T22:29:18.861745+0000 mgr.y (mgr.14592) 868 : cluster 0 pgmap v1351: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:22.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:21 smithi145 bash[23893]: cluster 2024-05-20T22:29:20.864816+0000 mgr.y (mgr.14592) 869 : cluster 0 pgmap v1352: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:22.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:21 smithi050 bash[21866]: cluster 2024-05-20T22:29:20.864816+0000 mgr.y (mgr.14592) 869 : cluster 0 pgmap v1352: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:22.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:21 smithi050 bash[28929]: cluster 2024-05-20T22:29:20.864816+0000 mgr.y (mgr.14592) 869 : cluster 0 pgmap v1352: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:23.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:22 smithi050 bash[21866]: cluster 2024-05-20T22:29:22.865769+0000 mgr.y (mgr.14592) 870 : cluster 0 pgmap v1353: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:23.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:22 smithi050 bash[28929]: cluster 2024-05-20T22:29:22.865769+0000 mgr.y (mgr.14592) 870 : cluster 0 pgmap v1353: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:23.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:22 smithi145 bash[23893]: cluster 2024-05-20T22:29:22.865769+0000 mgr.y (mgr.14592) 870 : cluster 0 pgmap v1353: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:24.887 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:24 smithi145 bash[23893]: audit 2024-05-20T22:29:24.519042+0000 mon.a (mon.0) 3721 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:29:24.939 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:24 smithi050 bash[21866]: audit 2024-05-20T22:29:24.519042+0000 mon.a (mon.0) 3721 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:29:24.939 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:24 smithi050 bash[28929]: audit 2024-05-20T22:29:24.519042+0000 mon.a (mon.0) 3721 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:29:25.887 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:25 smithi145 bash[23893]: cluster 2024-05-20T22:29:24.866669+0000 mgr.y (mgr.14592) 871 : cluster 0 pgmap v1354: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:25.939 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:25 smithi050 bash[21866]: cluster 2024-05-20T22:29:24.866669+0000 mgr.y (mgr.14592) 871 : cluster 0 pgmap v1354: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:25.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:25 smithi050 bash[28929]: cluster 2024-05-20T22:29:24.866669+0000 mgr.y (mgr.14592) 871 : cluster 0 pgmap v1354: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:27.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:26 smithi050 bash[21866]: cluster 2024-05-20T22:29:26.869607+0000 mgr.y (mgr.14592) 872 : cluster 0 pgmap v1355: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:27.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:26 smithi050 bash[28929]: cluster 2024-05-20T22:29:26.869607+0000 mgr.y (mgr.14592) 872 : cluster 0 pgmap v1355: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:27.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:26 smithi145 bash[23893]: cluster 2024-05-20T22:29:26.869607+0000 mgr.y (mgr.14592) 872 : cluster 0 pgmap v1355: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:28.933 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:29:28 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:29:29.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:28 smithi050 bash[21866]: audit 2024-05-20T22:29:28.688126+0000 mgr.y (mgr.14592) 873 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:29:29.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:28 smithi050 bash[21866]: cluster 2024-05-20T22:29:28.870520+0000 mgr.y (mgr.14592) 874 : cluster 0 pgmap v1356: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:29.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:28 smithi050 bash[28929]: audit 2024-05-20T22:29:28.688126+0000 mgr.y (mgr.14592) 873 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:29:29.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:28 smithi050 bash[28929]: cluster 2024-05-20T22:29:28.870520+0000 mgr.y (mgr.14592) 874 : cluster 0 pgmap v1356: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:29.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:28 smithi145 bash[23893]: audit 2024-05-20T22:29:28.688126+0000 mgr.y (mgr.14592) 873 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:29:29.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:28 smithi145 bash[23893]: cluster 2024-05-20T22:29:28.870520+0000 mgr.y (mgr.14592) 874 : cluster 0 pgmap v1356: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:29.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:29:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:29:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:29:31.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:30 smithi050 bash[21866]: cluster 2024-05-20T22:29:30.873475+0000 mgr.y (mgr.14592) 875 : cluster 0 pgmap v1357: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:31.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:30 smithi050 bash[28929]: cluster 2024-05-20T22:29:30.873475+0000 mgr.y (mgr.14592) 875 : cluster 0 pgmap v1357: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:31.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:30 smithi145 bash[23893]: cluster 2024-05-20T22:29:30.873475+0000 mgr.y (mgr.14592) 875 : cluster 0 pgmap v1357: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:33.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:32 smithi050 bash[21866]: cluster 2024-05-20T22:29:32.874406+0000 mgr.y (mgr.14592) 876 : cluster 0 pgmap v1358: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:33.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:32 smithi050 bash[28929]: cluster 2024-05-20T22:29:32.874406+0000 mgr.y (mgr.14592) 876 : cluster 0 pgmap v1358: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:33.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:32 smithi145 bash[23893]: cluster 2024-05-20T22:29:32.874406+0000 mgr.y (mgr.14592) 876 : cluster 0 pgmap v1358: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:35.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:34 smithi050 bash[21866]: cluster 2024-05-20T22:29:34.875330+0000 mgr.y (mgr.14592) 877 : cluster 0 pgmap v1359: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:35.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:34 smithi050 bash[28929]: cluster 2024-05-20T22:29:34.875330+0000 mgr.y (mgr.14592) 877 : cluster 0 pgmap v1359: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:35.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:34 smithi145 bash[23893]: cluster 2024-05-20T22:29:34.875330+0000 mgr.y (mgr.14592) 877 : cluster 0 pgmap v1359: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:37.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:36 smithi050 bash[21866]: cluster 2024-05-20T22:29:36.878370+0000 mgr.y (mgr.14592) 878 : cluster 0 pgmap v1360: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:37.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:36 smithi050 bash[28929]: cluster 2024-05-20T22:29:36.878370+0000 mgr.y (mgr.14592) 878 : cluster 0 pgmap v1360: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:37.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:36 smithi145 bash[23893]: cluster 2024-05-20T22:29:36.878370+0000 mgr.y (mgr.14592) 878 : cluster 0 pgmap v1360: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:39.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:29:38 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:29:39.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:38 smithi145 bash[23893]: audit 2024-05-20T22:29:38.695966+0000 mgr.y (mgr.14592) 879 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:29:39.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:38 smithi145 bash[23893]: cluster 2024-05-20T22:29:38.879348+0000 mgr.y (mgr.14592) 880 : cluster 0 pgmap v1361: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:39.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:38 smithi050 bash[21866]: audit 2024-05-20T22:29:38.695966+0000 mgr.y (mgr.14592) 879 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:29:39.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:38 smithi050 bash[21866]: cluster 2024-05-20T22:29:38.879348+0000 mgr.y (mgr.14592) 880 : cluster 0 pgmap v1361: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:39.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:38 smithi050 bash[28929]: audit 2024-05-20T22:29:38.695966+0000 mgr.y (mgr.14592) 879 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:29:39.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:38 smithi050 bash[28929]: cluster 2024-05-20T22:29:38.879348+0000 mgr.y (mgr.14592) 880 : cluster 0 pgmap v1361: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:39.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:29:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:29:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:29:40.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:39 smithi050 bash[21866]: audit 2024-05-20T22:29:39.551076+0000 mon.a (mon.0) 3722 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:29:40.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:39 smithi050 bash[28929]: audit 2024-05-20T22:29:39.551076+0000 mon.a (mon.0) 3722 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:29:40.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:39 smithi145 bash[23893]: audit 2024-05-20T22:29:39.551076+0000 mon.a (mon.0) 3722 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:29:41.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:40 smithi050 bash[21866]: cluster 2024-05-20T22:29:40.882348+0000 mgr.y (mgr.14592) 881 : cluster 0 pgmap v1362: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:41.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:40 smithi050 bash[28929]: cluster 2024-05-20T22:29:40.882348+0000 mgr.y (mgr.14592) 881 : cluster 0 pgmap v1362: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:41.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:40 smithi145 bash[23893]: cluster 2024-05-20T22:29:40.882348+0000 mgr.y (mgr.14592) 881 : cluster 0 pgmap v1362: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:43.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:42 smithi050 bash[28929]: cluster 2024-05-20T22:29:42.883272+0000 mgr.y (mgr.14592) 882 : cluster 0 pgmap v1363: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:43.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:42 smithi050 bash[21866]: cluster 2024-05-20T22:29:42.883272+0000 mgr.y (mgr.14592) 882 : cluster 0 pgmap v1363: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:43.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:42 smithi145 bash[23893]: cluster 2024-05-20T22:29:42.883272+0000 mgr.y (mgr.14592) 882 : cluster 0 pgmap v1363: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:45.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:44 smithi050 bash[21866]: cluster 2024-05-20T22:29:44.884233+0000 mgr.y (mgr.14592) 883 : cluster 0 pgmap v1364: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:45.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:44 smithi050 bash[28929]: cluster 2024-05-20T22:29:44.884233+0000 mgr.y (mgr.14592) 883 : cluster 0 pgmap v1364: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:45.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:44 smithi145 bash[23893]: cluster 2024-05-20T22:29:44.884233+0000 mgr.y (mgr.14592) 883 : cluster 0 pgmap v1364: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:47.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:46 smithi050 bash[21866]: cluster 2024-05-20T22:29:46.887174+0000 mgr.y (mgr.14592) 884 : cluster 0 pgmap v1365: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:47.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:46 smithi050 bash[28929]: cluster 2024-05-20T22:29:46.887174+0000 mgr.y (mgr.14592) 884 : cluster 0 pgmap v1365: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:47.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:46 smithi145 bash[23893]: cluster 2024-05-20T22:29:46.887174+0000 mgr.y (mgr.14592) 884 : cluster 0 pgmap v1365: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:49.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:48 smithi145 bash[23893]: audit 2024-05-20T22:29:48.707261+0000 mgr.y (mgr.14592) 885 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:29:49.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:48 smithi145 bash[23893]: cluster 2024-05-20T22:29:48.888125+0000 mgr.y (mgr.14592) 886 : cluster 0 pgmap v1366: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:49.138 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:29:48 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:29:49.389 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:48 smithi050 bash[21866]: audit 2024-05-20T22:29:48.707261+0000 mgr.y (mgr.14592) 885 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:29:49.389 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:48 smithi050 bash[21866]: cluster 2024-05-20T22:29:48.888125+0000 mgr.y (mgr.14592) 886 : cluster 0 pgmap v1366: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:49.389 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:48 smithi050 bash[28929]: audit 2024-05-20T22:29:48.707261+0000 mgr.y (mgr.14592) 885 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:29:49.390 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:48 smithi050 bash[28929]: cluster 2024-05-20T22:29:48.888125+0000 mgr.y (mgr.14592) 886 : cluster 0 pgmap v1366: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:49.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:29:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:29:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:29:51.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:50 smithi145 bash[23893]: cluster 2024-05-20T22:29:50.891056+0000 mgr.y (mgr.14592) 887 : cluster 0 pgmap v1367: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:51.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:50 smithi050 bash[21866]: cluster 2024-05-20T22:29:50.891056+0000 mgr.y (mgr.14592) 887 : cluster 0 pgmap v1367: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:51.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:50 smithi050 bash[28929]: cluster 2024-05-20T22:29:50.891056+0000 mgr.y (mgr.14592) 887 : cluster 0 pgmap v1367: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:53.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:52 smithi145 bash[23893]: cluster 2024-05-20T22:29:52.892053+0000 mgr.y (mgr.14592) 888 : cluster 0 pgmap v1368: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:53.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:52 smithi050 bash[21866]: cluster 2024-05-20T22:29:52.892053+0000 mgr.y (mgr.14592) 888 : cluster 0 pgmap v1368: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:53.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:52 smithi050 bash[28929]: cluster 2024-05-20T22:29:52.892053+0000 mgr.y (mgr.14592) 888 : cluster 0 pgmap v1368: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:54.887 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:54 smithi145 bash[23893]: audit 2024-05-20T22:29:54.584105+0000 mon.a (mon.0) 3723 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:29:54.939 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:54 smithi050 bash[21866]: audit 2024-05-20T22:29:54.584105+0000 mon.a (mon.0) 3723 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:29:54.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:54 smithi050 bash[28929]: audit 2024-05-20T22:29:54.584105+0000 mon.a (mon.0) 3723 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:29:55.887 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:55 smithi145 bash[23893]: cluster 2024-05-20T22:29:54.892896+0000 mgr.y (mgr.14592) 889 : cluster 0 pgmap v1369: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:55.939 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:55 smithi050 bash[21866]: cluster 2024-05-20T22:29:54.892896+0000 mgr.y (mgr.14592) 889 : cluster 0 pgmap v1369: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:55.939 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:55 smithi050 bash[28929]: cluster 2024-05-20T22:29:54.892896+0000 mgr.y (mgr.14592) 889 : cluster 0 pgmap v1369: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:29:58.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:57 smithi145 bash[23893]: cluster 2024-05-20T22:29:56.895820+0000 mgr.y (mgr.14592) 890 : cluster 0 pgmap v1370: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:58.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:57 smithi050 bash[21866]: cluster 2024-05-20T22:29:56.895820+0000 mgr.y (mgr.14592) 890 : cluster 0 pgmap v1370: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:58.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:57 smithi050 bash[28929]: cluster 2024-05-20T22:29:56.895820+0000 mgr.y (mgr.14592) 890 : cluster 0 pgmap v1370: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:29:59.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:58 smithi145 bash[23893]: audit 2024-05-20T22:29:58.718489+0000 mgr.y (mgr.14592) 891 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:29:59.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:29:58 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:29:59.389 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:58 smithi050 bash[21866]: audit 2024-05-20T22:29:58.718489+0000 mgr.y (mgr.14592) 891 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:29:59.390 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:58 smithi050 bash[28929]: audit 2024-05-20T22:29:58.718489+0000 mgr.y (mgr.14592) 891 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:29:59.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:29:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:29:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:30:00.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:29:59 smithi145 bash[23893]: cluster 2024-05-20T22:29:58.896845+0000 mgr.y (mgr.14592) 892 : cluster 0 pgmap v1371: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:00.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:29:59 smithi050 bash[21866]: cluster 2024-05-20T22:29:58.896845+0000 mgr.y (mgr.14592) 892 : cluster 0 pgmap v1371: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:00.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:29:59 smithi050 bash[28929]: cluster 2024-05-20T22:29:58.896845+0000 mgr.y (mgr.14592) 892 : cluster 0 pgmap v1371: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:01.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:00 smithi145 bash[23893]: cluster 2024-05-20T22:30:00.000117+0000 mon.a (mon.0) 3724 : cluster 3 overall HEALTH_WARN 6 pool(s) do not have an application enabled 2024-05-20T22:30:01.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:00 smithi050 bash[21866]: cluster 2024-05-20T22:30:00.000117+0000 mon.a (mon.0) 3724 : cluster 3 overall HEALTH_WARN 6 pool(s) do not have an application enabled 2024-05-20T22:30:01.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:00 smithi050 bash[28929]: cluster 2024-05-20T22:30:00.000117+0000 mon.a (mon.0) 3724 : cluster 3 overall HEALTH_WARN 6 pool(s) do not have an application enabled 2024-05-20T22:30:02.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:01 smithi145 bash[23893]: cluster 2024-05-20T22:30:00.899821+0000 mgr.y (mgr.14592) 893 : cluster 0 pgmap v1372: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:02.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:01 smithi050 bash[21866]: cluster 2024-05-20T22:30:00.899821+0000 mgr.y (mgr.14592) 893 : cluster 0 pgmap v1372: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:02.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:01 smithi050 bash[28929]: cluster 2024-05-20T22:30:00.899821+0000 mgr.y (mgr.14592) 893 : cluster 0 pgmap v1372: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:04.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:03 smithi145 bash[23893]: cluster 2024-05-20T22:30:02.900796+0000 mgr.y (mgr.14592) 894 : cluster 0 pgmap v1373: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:04.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:03 smithi050 bash[21866]: cluster 2024-05-20T22:30:02.900796+0000 mgr.y (mgr.14592) 894 : cluster 0 pgmap v1373: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:04.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:03 smithi050 bash[28929]: cluster 2024-05-20T22:30:02.900796+0000 mgr.y (mgr.14592) 894 : cluster 0 pgmap v1373: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:06.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:05 smithi145 bash[23893]: cluster 2024-05-20T22:30:04.901700+0000 mgr.y (mgr.14592) 895 : cluster 0 pgmap v1374: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:06.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:05 smithi050 bash[21866]: cluster 2024-05-20T22:30:04.901700+0000 mgr.y (mgr.14592) 895 : cluster 0 pgmap v1374: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:06.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:05 smithi050 bash[28929]: cluster 2024-05-20T22:30:04.901700+0000 mgr.y (mgr.14592) 895 : cluster 0 pgmap v1374: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:08.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:07 smithi145 bash[23893]: cluster 2024-05-20T22:30:06.904634+0000 mgr.y (mgr.14592) 896 : cluster 0 pgmap v1375: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:08.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:07 smithi050 bash[21866]: cluster 2024-05-20T22:30:06.904634+0000 mgr.y (mgr.14592) 896 : cluster 0 pgmap v1375: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:08.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:07 smithi050 bash[28929]: cluster 2024-05-20T22:30:06.904634+0000 mgr.y (mgr.14592) 896 : cluster 0 pgmap v1375: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:08.987 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:30:08 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:30:09.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:08 smithi145 bash[23893]: audit 2024-05-20T22:30:08.729721+0000 mgr.y (mgr.14592) 897 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:30:09.388 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:08 smithi050 bash[21866]: audit 2024-05-20T22:30:08.729721+0000 mgr.y (mgr.14592) 897 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:30:09.389 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:08 smithi050 bash[28929]: audit 2024-05-20T22:30:08.729721+0000 mgr.y (mgr.14592) 897 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:30:09.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:30:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:30:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:30:10.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:09 smithi145 bash[23893]: cluster 2024-05-20T22:30:08.905527+0000 mgr.y (mgr.14592) 898 : cluster 0 pgmap v1376: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:10.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:09 smithi145 bash[23893]: audit 2024-05-20T22:30:09.616736+0000 mon.a (mon.0) 3725 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:30:10.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:09 smithi050 bash[21866]: cluster 2024-05-20T22:30:08.905527+0000 mgr.y (mgr.14592) 898 : cluster 0 pgmap v1376: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:10.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:09 smithi050 bash[21866]: audit 2024-05-20T22:30:09.616736+0000 mon.a (mon.0) 3725 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:30:10.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:09 smithi050 bash[28929]: cluster 2024-05-20T22:30:08.905527+0000 mgr.y (mgr.14592) 898 : cluster 0 pgmap v1376: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:10.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:09 smithi050 bash[28929]: audit 2024-05-20T22:30:09.616736+0000 mon.a (mon.0) 3725 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:30:11.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:11 smithi145 bash[23893]: audit 2024-05-20T22:30:10.468487+0000 mon.a (mon.0) 3726 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:30:11.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:11 smithi050 bash[21866]: audit 2024-05-20T22:30:10.468487+0000 mon.a (mon.0) 3726 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:30:11.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:11 smithi050 bash[28929]: audit 2024-05-20T22:30:10.468487+0000 mon.a (mon.0) 3726 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:30:12.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:12 smithi145 bash[23893]: cluster 2024-05-20T22:30:10.908297+0000 mgr.y (mgr.14592) 899 : cluster 0 pgmap v1377: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:12.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:12 smithi145 bash[23893]: audit 2024-05-20T22:30:11.206566+0000 mon.a (mon.0) 3727 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:30:12.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:12 smithi145 bash[23893]: audit 2024-05-20T22:30:11.207794+0000 mon.a (mon.0) 3728 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:30:12.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:12 smithi145 bash[23893]: audit 2024-05-20T22:30:11.215825+0000 mon.a (mon.0) 3729 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:30:12.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:12 smithi050 bash[21866]: cluster 2024-05-20T22:30:10.908297+0000 mgr.y (mgr.14592) 899 : cluster 0 pgmap v1377: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:12.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:12 smithi050 bash[21866]: audit 2024-05-20T22:30:11.206566+0000 mon.a (mon.0) 3727 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:30:12.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:12 smithi050 bash[21866]: audit 2024-05-20T22:30:11.207794+0000 mon.a (mon.0) 3728 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:30:12.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:12 smithi050 bash[21866]: audit 2024-05-20T22:30:11.215825+0000 mon.a (mon.0) 3729 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:30:12.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:12 smithi050 bash[28929]: cluster 2024-05-20T22:30:10.908297+0000 mgr.y (mgr.14592) 899 : cluster 0 pgmap v1377: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:12.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:12 smithi050 bash[28929]: audit 2024-05-20T22:30:11.206566+0000 mon.a (mon.0) 3727 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:30:12.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:12 smithi050 bash[28929]: audit 2024-05-20T22:30:11.207794+0000 mon.a (mon.0) 3728 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:30:12.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:12 smithi050 bash[28929]: audit 2024-05-20T22:30:11.215825+0000 mon.a (mon.0) 3729 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:30:14.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.230 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.230 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.230 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.230 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.230 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.230 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.230 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.230 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.230 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.230 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.230 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.230 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.231 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.231 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.231 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.231 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.231 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.231 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.231 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.231 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.231 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.231 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.231 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.231 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.231 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.232 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.232 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.232 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.232 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.232 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.232 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.232 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.232 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.232 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.232 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.232 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.232 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.232 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:30:14.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:14 smithi145 bash[23893]: cluster 2024-05-20T22:30:12.909209+0000 mgr.y (mgr.14592) 900 : cluster 0 pgmap v1378: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:14.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:14 smithi050 bash[21866]: cluster 2024-05-20T22:30:12.909209+0000 mgr.y (mgr.14592) 900 : cluster 0 pgmap v1378: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:14.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:14 smithi050 bash[28929]: cluster 2024-05-20T22:30:12.909209+0000 mgr.y (mgr.14592) 900 : cluster 0 pgmap v1378: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:16.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:16 smithi145 bash[23893]: cluster 2024-05-20T22:30:14.910134+0000 mgr.y (mgr.14592) 901 : cluster 0 pgmap v1379: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:16.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:16 smithi050 bash[21866]: cluster 2024-05-20T22:30:14.910134+0000 mgr.y (mgr.14592) 901 : cluster 0 pgmap v1379: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:16.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:16 smithi050 bash[28929]: cluster 2024-05-20T22:30:14.910134+0000 mgr.y (mgr.14592) 901 : cluster 0 pgmap v1379: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:18.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:18 smithi145 bash[23893]: cluster 2024-05-20T22:30:16.913097+0000 mgr.y (mgr.14592) 902 : cluster 0 pgmap v1380: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:18.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:18 smithi050 bash[21866]: cluster 2024-05-20T22:30:16.913097+0000 mgr.y (mgr.14592) 902 : cluster 0 pgmap v1380: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:18.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:18 smithi050 bash[28929]: cluster 2024-05-20T22:30:16.913097+0000 mgr.y (mgr.14592) 902 : cluster 0 pgmap v1380: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:19.018 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:30:18 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:30:19.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:19 smithi145 bash[23893]: audit 2024-05-20T22:30:18.739592+0000 mgr.y (mgr.14592) 903 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:30:19.389 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:19 smithi050 bash[21866]: audit 2024-05-20T22:30:18.739592+0000 mgr.y (mgr.14592) 903 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:30:19.389 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:19 smithi050 bash[28929]: audit 2024-05-20T22:30:18.739592+0000 mgr.y (mgr.14592) 903 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:30:19.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:30:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:30:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:30:20.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:20 smithi145 bash[23893]: cluster 2024-05-20T22:30:18.914003+0000 mgr.y (mgr.14592) 904 : cluster 0 pgmap v1381: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:20.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:20 smithi050 bash[21866]: cluster 2024-05-20T22:30:18.914003+0000 mgr.y (mgr.14592) 904 : cluster 0 pgmap v1381: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:20.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:20 smithi050 bash[28929]: cluster 2024-05-20T22:30:18.914003+0000 mgr.y (mgr.14592) 904 : cluster 0 pgmap v1381: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:22.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:22 smithi145 bash[23893]: cluster 2024-05-20T22:30:20.916911+0000 mgr.y (mgr.14592) 905 : cluster 0 pgmap v1382: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:22.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:22 smithi050 bash[21866]: cluster 2024-05-20T22:30:20.916911+0000 mgr.y (mgr.14592) 905 : cluster 0 pgmap v1382: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:22.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:22 smithi050 bash[28929]: cluster 2024-05-20T22:30:20.916911+0000 mgr.y (mgr.14592) 905 : cluster 0 pgmap v1382: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:24.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:24 smithi145 bash[23893]: cluster 2024-05-20T22:30:22.917822+0000 mgr.y (mgr.14592) 906 : cluster 0 pgmap v1383: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:24.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:24 smithi050 bash[21866]: cluster 2024-05-20T22:30:22.917822+0000 mgr.y (mgr.14592) 906 : cluster 0 pgmap v1383: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:24.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:24 smithi050 bash[28929]: cluster 2024-05-20T22:30:22.917822+0000 mgr.y (mgr.14592) 906 : cluster 0 pgmap v1383: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:25.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:25 smithi145 bash[23893]: audit 2024-05-20T22:30:24.649239+0000 mon.a (mon.0) 3730 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:30:25.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:25 smithi050 bash[21866]: audit 2024-05-20T22:30:24.649239+0000 mon.a (mon.0) 3730 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:30:25.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:25 smithi050 bash[28929]: audit 2024-05-20T22:30:24.649239+0000 mon.a (mon.0) 3730 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:30:26.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:26 smithi145 bash[23893]: cluster 2024-05-20T22:30:24.918698+0000 mgr.y (mgr.14592) 907 : cluster 0 pgmap v1384: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:26.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:26 smithi050 bash[21866]: cluster 2024-05-20T22:30:24.918698+0000 mgr.y (mgr.14592) 907 : cluster 0 pgmap v1384: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:26.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:26 smithi050 bash[28929]: cluster 2024-05-20T22:30:24.918698+0000 mgr.y (mgr.14592) 907 : cluster 0 pgmap v1384: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:28.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:28 smithi145 bash[23893]: cluster 2024-05-20T22:30:26.921646+0000 mgr.y (mgr.14592) 908 : cluster 0 pgmap v1385: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:28.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:28 smithi050 bash[21866]: cluster 2024-05-20T22:30:26.921646+0000 mgr.y (mgr.14592) 908 : cluster 0 pgmap v1385: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:28.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:28 smithi050 bash[28929]: cluster 2024-05-20T22:30:26.921646+0000 mgr.y (mgr.14592) 908 : cluster 0 pgmap v1385: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:29.053 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:30:28 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:30:29.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:29 smithi145 bash[23893]: audit 2024-05-20T22:30:28.743717+0000 mgr.y (mgr.14592) 909 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:30:29.389 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:29 smithi050 bash[21866]: audit 2024-05-20T22:30:28.743717+0000 mgr.y (mgr.14592) 909 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:30:29.389 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:29 smithi050 bash[28929]: audit 2024-05-20T22:30:28.743717+0000 mgr.y (mgr.14592) 909 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:30:29.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:30:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:30:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:30:30.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:30 smithi145 bash[23893]: cluster 2024-05-20T22:30:28.922547+0000 mgr.y (mgr.14592) 910 : cluster 0 pgmap v1386: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:30.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:30 smithi050 bash[21866]: cluster 2024-05-20T22:30:28.922547+0000 mgr.y (mgr.14592) 910 : cluster 0 pgmap v1386: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:30.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:30 smithi050 bash[28929]: cluster 2024-05-20T22:30:28.922547+0000 mgr.y (mgr.14592) 910 : cluster 0 pgmap v1386: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:32.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:32 smithi145 bash[23893]: cluster 2024-05-20T22:30:30.925752+0000 mgr.y (mgr.14592) 911 : cluster 0 pgmap v1387: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:32.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:32 smithi050 bash[21866]: cluster 2024-05-20T22:30:30.925752+0000 mgr.y (mgr.14592) 911 : cluster 0 pgmap v1387: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:32.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:32 smithi050 bash[28929]: cluster 2024-05-20T22:30:30.925752+0000 mgr.y (mgr.14592) 911 : cluster 0 pgmap v1387: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:34.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:34 smithi145 bash[23893]: cluster 2024-05-20T22:30:32.926704+0000 mgr.y (mgr.14592) 912 : cluster 0 pgmap v1388: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:34.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:34 smithi050 bash[21866]: cluster 2024-05-20T22:30:32.926704+0000 mgr.y (mgr.14592) 912 : cluster 0 pgmap v1388: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:34.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:34 smithi050 bash[28929]: cluster 2024-05-20T22:30:32.926704+0000 mgr.y (mgr.14592) 912 : cluster 0 pgmap v1388: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:36.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:36 smithi145 bash[23893]: cluster 2024-05-20T22:30:34.927598+0000 mgr.y (mgr.14592) 913 : cluster 0 pgmap v1389: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:36.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:36 smithi050 bash[28929]: cluster 2024-05-20T22:30:34.927598+0000 mgr.y (mgr.14592) 913 : cluster 0 pgmap v1389: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:36.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:36 smithi050 bash[21866]: cluster 2024-05-20T22:30:34.927598+0000 mgr.y (mgr.14592) 913 : cluster 0 pgmap v1389: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:38.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:38 smithi145 bash[23893]: cluster 2024-05-20T22:30:36.930523+0000 mgr.y (mgr.14592) 914 : cluster 0 pgmap v1390: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:38.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:38 smithi050 bash[21866]: cluster 2024-05-20T22:30:36.930523+0000 mgr.y (mgr.14592) 914 : cluster 0 pgmap v1390: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:38.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:38 smithi050 bash[28929]: cluster 2024-05-20T22:30:36.930523+0000 mgr.y (mgr.14592) 914 : cluster 0 pgmap v1390: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:39.082 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:30:38 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:30:39.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:39 smithi145 bash[23893]: audit 2024-05-20T22:30:38.755125+0000 mgr.y (mgr.14592) 915 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:30:39.389 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:39 smithi050 bash[21866]: audit 2024-05-20T22:30:38.755125+0000 mgr.y (mgr.14592) 915 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:30:39.389 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:39 smithi050 bash[28929]: audit 2024-05-20T22:30:38.755125+0000 mgr.y (mgr.14592) 915 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:30:39.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:30:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:30:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:30:40.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:40 smithi145 bash[23893]: cluster 2024-05-20T22:30:38.931424+0000 mgr.y (mgr.14592) 916 : cluster 0 pgmap v1391: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:40.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:40 smithi145 bash[23893]: audit 2024-05-20T22:30:39.680936+0000 mon.a (mon.0) 3731 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:30:40.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:40 smithi050 bash[28929]: cluster 2024-05-20T22:30:38.931424+0000 mgr.y (mgr.14592) 916 : cluster 0 pgmap v1391: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:40.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:40 smithi050 bash[28929]: audit 2024-05-20T22:30:39.680936+0000 mon.a (mon.0) 3731 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:30:40.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:40 smithi050 bash[21866]: cluster 2024-05-20T22:30:38.931424+0000 mgr.y (mgr.14592) 916 : cluster 0 pgmap v1391: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:40.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:40 smithi050 bash[21866]: audit 2024-05-20T22:30:39.680936+0000 mon.a (mon.0) 3731 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:30:42.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:42 smithi145 bash[23893]: cluster 2024-05-20T22:30:40.934361+0000 mgr.y (mgr.14592) 917 : cluster 0 pgmap v1392: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:42.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:42 smithi050 bash[21866]: cluster 2024-05-20T22:30:40.934361+0000 mgr.y (mgr.14592) 917 : cluster 0 pgmap v1392: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:42.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:42 smithi050 bash[28929]: cluster 2024-05-20T22:30:40.934361+0000 mgr.y (mgr.14592) 917 : cluster 0 pgmap v1392: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:44.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:44 smithi145 bash[23893]: cluster 2024-05-20T22:30:42.935286+0000 mgr.y (mgr.14592) 918 : cluster 0 pgmap v1393: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:44.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:44 smithi050 bash[21866]: cluster 2024-05-20T22:30:42.935286+0000 mgr.y (mgr.14592) 918 : cluster 0 pgmap v1393: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:44.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:44 smithi050 bash[28929]: cluster 2024-05-20T22:30:42.935286+0000 mgr.y (mgr.14592) 918 : cluster 0 pgmap v1393: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:46.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:46 smithi145 bash[23893]: cluster 2024-05-20T22:30:44.936237+0000 mgr.y (mgr.14592) 919 : cluster 0 pgmap v1394: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:46.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:46 smithi050 bash[21866]: cluster 2024-05-20T22:30:44.936237+0000 mgr.y (mgr.14592) 919 : cluster 0 pgmap v1394: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:46.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:46 smithi050 bash[28929]: cluster 2024-05-20T22:30:44.936237+0000 mgr.y (mgr.14592) 919 : cluster 0 pgmap v1394: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:48.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:48 smithi145 bash[23893]: cluster 2024-05-20T22:30:46.939153+0000 mgr.y (mgr.14592) 920 : cluster 0 pgmap v1395: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:48.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:48 smithi050 bash[21866]: cluster 2024-05-20T22:30:46.939153+0000 mgr.y (mgr.14592) 920 : cluster 0 pgmap v1395: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:48.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:48 smithi050 bash[28929]: cluster 2024-05-20T22:30:46.939153+0000 mgr.y (mgr.14592) 920 : cluster 0 pgmap v1395: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:49.111 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:30:48 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:30:49.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:49 smithi145 bash[23893]: audit 2024-05-20T22:30:48.766476+0000 mgr.y (mgr.14592) 921 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:30:49.389 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:49 smithi050 bash[21866]: audit 2024-05-20T22:30:48.766476+0000 mgr.y (mgr.14592) 921 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:30:49.389 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:49 smithi050 bash[28929]: audit 2024-05-20T22:30:48.766476+0000 mgr.y (mgr.14592) 921 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:30:49.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:30:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:30:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:30:50.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:50 smithi145 bash[23893]: cluster 2024-05-20T22:30:48.940098+0000 mgr.y (mgr.14592) 922 : cluster 0 pgmap v1396: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:50.442 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:50 smithi050 bash[21866]: cluster 2024-05-20T22:30:48.940098+0000 mgr.y (mgr.14592) 922 : cluster 0 pgmap v1396: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:50.442 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:50 smithi050 bash[28929]: cluster 2024-05-20T22:30:48.940098+0000 mgr.y (mgr.14592) 922 : cluster 0 pgmap v1396: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:52.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:52 smithi145 bash[23893]: cluster 2024-05-20T22:30:50.942963+0000 mgr.y (mgr.14592) 923 : cluster 0 pgmap v1397: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:52.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:52 smithi050 bash[21866]: cluster 2024-05-20T22:30:50.942963+0000 mgr.y (mgr.14592) 923 : cluster 0 pgmap v1397: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:52.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:52 smithi050 bash[28929]: cluster 2024-05-20T22:30:50.942963+0000 mgr.y (mgr.14592) 923 : cluster 0 pgmap v1397: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:54.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:54 smithi145 bash[23893]: cluster 2024-05-20T22:30:52.943907+0000 mgr.y (mgr.14592) 924 : cluster 0 pgmap v1398: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:54.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:54 smithi050 bash[21866]: cluster 2024-05-20T22:30:52.943907+0000 mgr.y (mgr.14592) 924 : cluster 0 pgmap v1398: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:54.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:54 smithi050 bash[28929]: cluster 2024-05-20T22:30:52.943907+0000 mgr.y (mgr.14592) 924 : cluster 0 pgmap v1398: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:55.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:55 smithi145 bash[23893]: audit 2024-05-20T22:30:54.712897+0000 mon.a (mon.0) 3732 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:30:55.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:55 smithi050 bash[21866]: audit 2024-05-20T22:30:54.712897+0000 mon.a (mon.0) 3732 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:30:55.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:55 smithi050 bash[28929]: audit 2024-05-20T22:30:54.712897+0000 mon.a (mon.0) 3732 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:30:56.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:56 smithi145 bash[23893]: cluster 2024-05-20T22:30:54.944777+0000 mgr.y (mgr.14592) 925 : cluster 0 pgmap v1399: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:56.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:56 smithi050 bash[21866]: cluster 2024-05-20T22:30:54.944777+0000 mgr.y (mgr.14592) 925 : cluster 0 pgmap v1399: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:56.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:56 smithi050 bash[28929]: cluster 2024-05-20T22:30:54.944777+0000 mgr.y (mgr.14592) 925 : cluster 0 pgmap v1399: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:30:58.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:58 smithi145 bash[23893]: cluster 2024-05-20T22:30:56.947664+0000 mgr.y (mgr.14592) 926 : cluster 0 pgmap v1400: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:58.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:58 smithi050 bash[21866]: cluster 2024-05-20T22:30:56.947664+0000 mgr.y (mgr.14592) 926 : cluster 0 pgmap v1400: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:58.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:58 smithi050 bash[28929]: cluster 2024-05-20T22:30:56.947664+0000 mgr.y (mgr.14592) 926 : cluster 0 pgmap v1400: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:30:59.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:30:58 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:30:59.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:30:59 smithi050 bash[21866]: audit 2024-05-20T22:30:58.771808+0000 mgr.y (mgr.14592) 927 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:30:59.439 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:30:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:30:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:30:59.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:30:59 smithi050 bash[28929]: audit 2024-05-20T22:30:58.771808+0000 mgr.y (mgr.14592) 927 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:30:59.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:30:59 smithi145 bash[23893]: audit 2024-05-20T22:30:58.771808+0000 mgr.y (mgr.14592) 927 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:31:00.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:00 smithi050 bash[21866]: cluster 2024-05-20T22:30:58.948538+0000 mgr.y (mgr.14592) 928 : cluster 0 pgmap v1401: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:00.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:00 smithi050 bash[28929]: cluster 2024-05-20T22:30:58.948538+0000 mgr.y (mgr.14592) 928 : cluster 0 pgmap v1401: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:00.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:00 smithi145 bash[23893]: cluster 2024-05-20T22:30:58.948538+0000 mgr.y (mgr.14592) 928 : cluster 0 pgmap v1401: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:02.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:02 smithi050 bash[21866]: cluster 2024-05-20T22:31:00.951463+0000 mgr.y (mgr.14592) 929 : cluster 0 pgmap v1402: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:02.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:02 smithi050 bash[28929]: cluster 2024-05-20T22:31:00.951463+0000 mgr.y (mgr.14592) 929 : cluster 0 pgmap v1402: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:02.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:02 smithi145 bash[23893]: cluster 2024-05-20T22:31:00.951463+0000 mgr.y (mgr.14592) 929 : cluster 0 pgmap v1402: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:04.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:04 smithi050 bash[21866]: cluster 2024-05-20T22:31:02.952560+0000 mgr.y (mgr.14592) 930 : cluster 0 pgmap v1403: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:04.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:04 smithi050 bash[28929]: cluster 2024-05-20T22:31:02.952560+0000 mgr.y (mgr.14592) 930 : cluster 0 pgmap v1403: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:04.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:04 smithi145 bash[23893]: cluster 2024-05-20T22:31:02.952560+0000 mgr.y (mgr.14592) 930 : cluster 0 pgmap v1403: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:06.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:06 smithi050 bash[21866]: cluster 2024-05-20T22:31:04.953501+0000 mgr.y (mgr.14592) 931 : cluster 0 pgmap v1404: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:06.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:06 smithi050 bash[28929]: cluster 2024-05-20T22:31:04.953501+0000 mgr.y (mgr.14592) 931 : cluster 0 pgmap v1404: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:06.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:06 smithi145 bash[23893]: cluster 2024-05-20T22:31:04.953501+0000 mgr.y (mgr.14592) 931 : cluster 0 pgmap v1404: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:08.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:08 smithi050 bash[21866]: cluster 2024-05-20T22:31:06.956547+0000 mgr.y (mgr.14592) 932 : cluster 0 pgmap v1405: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:08.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:08 smithi050 bash[28929]: cluster 2024-05-20T22:31:06.956547+0000 mgr.y (mgr.14592) 932 : cluster 0 pgmap v1405: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:08.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:08 smithi145 bash[23893]: cluster 2024-05-20T22:31:06.956547+0000 mgr.y (mgr.14592) 932 : cluster 0 pgmap v1405: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:09.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:31:08 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:31:09.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:09 smithi050 bash[21866]: audit 2024-05-20T22:31:08.783220+0000 mgr.y (mgr.14592) 933 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:31:09.440 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:31:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:31:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:31:09.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:09 smithi050 bash[28929]: audit 2024-05-20T22:31:08.783220+0000 mgr.y (mgr.14592) 933 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:31:09.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:09 smithi145 bash[23893]: audit 2024-05-20T22:31:08.783220+0000 mgr.y (mgr.14592) 933 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:31:10.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:10 smithi050 bash[21866]: cluster 2024-05-20T22:31:08.957471+0000 mgr.y (mgr.14592) 934 : cluster 0 pgmap v1406: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:10.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:10 smithi050 bash[21866]: audit 2024-05-20T22:31:09.745110+0000 mon.a (mon.0) 3733 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:31:10.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:10 smithi050 bash[28929]: cluster 2024-05-20T22:31:08.957471+0000 mgr.y (mgr.14592) 934 : cluster 0 pgmap v1406: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:10.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:10 smithi050 bash[28929]: audit 2024-05-20T22:31:09.745110+0000 mon.a (mon.0) 3733 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:31:10.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:10 smithi145 bash[23893]: cluster 2024-05-20T22:31:08.957471+0000 mgr.y (mgr.14592) 934 : cluster 0 pgmap v1406: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:10.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:10 smithi145 bash[23893]: audit 2024-05-20T22:31:09.745110+0000 mon.a (mon.0) 3733 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:31:12.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:12 smithi050 bash[21866]: cluster 2024-05-20T22:31:10.960552+0000 mgr.y (mgr.14592) 935 : cluster 0 pgmap v1407: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:12.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:12 smithi050 bash[21866]: audit 2024-05-20T22:31:11.344713+0000 mon.a (mon.0) 3734 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:31:12.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:12 smithi050 bash[21866]: audit 2024-05-20T22:31:12.060823+0000 mon.a (mon.0) 3735 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:31:12.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:12 smithi050 bash[21866]: audit 2024-05-20T22:31:12.062440+0000 mon.a (mon.0) 3736 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:31:12.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:12 smithi050 bash[21866]: audit 2024-05-20T22:31:12.072751+0000 mon.a (mon.0) 3737 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:31:12.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:12 smithi050 bash[28929]: cluster 2024-05-20T22:31:10.960552+0000 mgr.y (mgr.14592) 935 : cluster 0 pgmap v1407: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:12.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:12 smithi050 bash[28929]: audit 2024-05-20T22:31:11.344713+0000 mon.a (mon.0) 3734 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:31:12.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:12 smithi050 bash[28929]: audit 2024-05-20T22:31:12.060823+0000 mon.a (mon.0) 3735 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:31:12.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:12 smithi050 bash[28929]: audit 2024-05-20T22:31:12.062440+0000 mon.a (mon.0) 3736 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:31:12.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:12 smithi050 bash[28929]: audit 2024-05-20T22:31:12.072751+0000 mon.a (mon.0) 3737 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:31:12.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:12 smithi145 bash[23893]: cluster 2024-05-20T22:31:10.960552+0000 mgr.y (mgr.14592) 935 : cluster 0 pgmap v1407: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:12.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:12 smithi145 bash[23893]: audit 2024-05-20T22:31:11.344713+0000 mon.a (mon.0) 3734 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:31:12.638 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:12 smithi145 bash[23893]: audit 2024-05-20T22:31:12.060823+0000 mon.a (mon.0) 3735 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:31:12.638 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:12 smithi145 bash[23893]: audit 2024-05-20T22:31:12.062440+0000 mon.a (mon.0) 3736 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:31:12.638 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:12 smithi145 bash[23893]: audit 2024-05-20T22:31:12.072751+0000 mon.a (mon.0) 3737 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:31:14.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:14 smithi050 bash[21866]: cluster 2024-05-20T22:31:12.961501+0000 mgr.y (mgr.14592) 936 : cluster 0 pgmap v1408: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:14.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:14 smithi050 bash[28929]: cluster 2024-05-20T22:31:12.961501+0000 mgr.y (mgr.14592) 936 : cluster 0 pgmap v1408: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:14.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:14 smithi145 bash[23893]: cluster 2024-05-20T22:31:12.961501+0000 mgr.y (mgr.14592) 936 : cluster 0 pgmap v1408: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:16.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:16 smithi050 bash[21866]: cluster 2024-05-20T22:31:14.962418+0000 mgr.y (mgr.14592) 937 : cluster 0 pgmap v1409: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:16.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:16 smithi050 bash[28929]: cluster 2024-05-20T22:31:14.962418+0000 mgr.y (mgr.14592) 937 : cluster 0 pgmap v1409: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:16.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:16 smithi145 bash[23893]: cluster 2024-05-20T22:31:14.962418+0000 mgr.y (mgr.14592) 937 : cluster 0 pgmap v1409: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:18.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:18 smithi145 bash[23893]: cluster 2024-05-20T22:31:16.965384+0000 mgr.y (mgr.14592) 938 : cluster 0 pgmap v1410: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:18.689 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:18 smithi050 bash[21866]: cluster 2024-05-20T22:31:16.965384+0000 mgr.y (mgr.14592) 938 : cluster 0 pgmap v1410: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:18.689 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:18 smithi050 bash[28929]: cluster 2024-05-20T22:31:16.965384+0000 mgr.y (mgr.14592) 938 : cluster 0 pgmap v1410: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:19.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:31:18 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:31:19.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:19 smithi145 bash[23893]: audit 2024-05-20T22:31:18.794635+0000 mgr.y (mgr.14592) 939 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:31:19.689 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:19 smithi050 bash[21866]: audit 2024-05-20T22:31:18.794635+0000 mgr.y (mgr.14592) 939 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:31:19.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:31:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:31:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:31:19.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:19 smithi050 bash[28929]: audit 2024-05-20T22:31:18.794635+0000 mgr.y (mgr.14592) 939 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:31:20.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:20 smithi145 bash[23893]: cluster 2024-05-20T22:31:18.966438+0000 mgr.y (mgr.14592) 940 : cluster 0 pgmap v1411: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:20.765 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:20 smithi050 bash[21866]: cluster 2024-05-20T22:31:18.966438+0000 mgr.y (mgr.14592) 940 : cluster 0 pgmap v1411: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:20.765 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:20 smithi050 bash[28929]: cluster 2024-05-20T22:31:18.966438+0000 mgr.y (mgr.14592) 940 : cluster 0 pgmap v1411: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:22.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:22 smithi145 bash[23893]: cluster 2024-05-20T22:31:20.969439+0000 mgr.y (mgr.14592) 941 : cluster 0 pgmap v1412: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:22.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:22 smithi050 bash[21866]: cluster 2024-05-20T22:31:20.969439+0000 mgr.y (mgr.14592) 941 : cluster 0 pgmap v1412: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:22.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:22 smithi050 bash[28929]: cluster 2024-05-20T22:31:20.969439+0000 mgr.y (mgr.14592) 941 : cluster 0 pgmap v1412: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:24.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:24 smithi145 bash[23893]: cluster 2024-05-20T22:31:22.970394+0000 mgr.y (mgr.14592) 942 : cluster 0 pgmap v1413: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:24.689 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:24 smithi050 bash[21866]: cluster 2024-05-20T22:31:22.970394+0000 mgr.y (mgr.14592) 942 : cluster 0 pgmap v1413: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:24.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:24 smithi050 bash[28929]: cluster 2024-05-20T22:31:22.970394+0000 mgr.y (mgr.14592) 942 : cluster 0 pgmap v1413: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:25.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:25 smithi145 bash[23893]: audit 2024-05-20T22:31:24.778266+0000 mon.a (mon.0) 3738 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:31:25.689 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:25 smithi050 bash[21866]: audit 2024-05-20T22:31:24.778266+0000 mon.a (mon.0) 3738 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:31:25.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:25 smithi050 bash[28929]: audit 2024-05-20T22:31:24.778266+0000 mon.a (mon.0) 3738 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:31:26.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:26 smithi145 bash[23893]: cluster 2024-05-20T22:31:24.971312+0000 mgr.y (mgr.14592) 943 : cluster 0 pgmap v1414: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:26.689 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:26 smithi050 bash[21866]: cluster 2024-05-20T22:31:24.971312+0000 mgr.y (mgr.14592) 943 : cluster 0 pgmap v1414: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:26.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:26 smithi050 bash[28929]: cluster 2024-05-20T22:31:24.971312+0000 mgr.y (mgr.14592) 943 : cluster 0 pgmap v1414: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:28.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:28 smithi145 bash[23893]: cluster 2024-05-20T22:31:26.974414+0000 mgr.y (mgr.14592) 944 : cluster 0 pgmap v1415: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:28.689 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:28 smithi050 bash[21866]: cluster 2024-05-20T22:31:26.974414+0000 mgr.y (mgr.14592) 944 : cluster 0 pgmap v1415: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:28.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:28 smithi050 bash[28929]: cluster 2024-05-20T22:31:26.974414+0000 mgr.y (mgr.14592) 944 : cluster 0 pgmap v1415: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:29.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:31:28 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:31:29.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:29 smithi145 bash[23893]: audit 2024-05-20T22:31:28.806005+0000 mgr.y (mgr.14592) 945 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:31:29.689 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:29 smithi050 bash[21866]: audit 2024-05-20T22:31:28.806005+0000 mgr.y (mgr.14592) 945 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:31:29.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:31:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:31:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:31:29.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:29 smithi050 bash[28929]: audit 2024-05-20T22:31:28.806005+0000 mgr.y (mgr.14592) 945 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:31:30.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:30 smithi145 bash[23893]: cluster 2024-05-20T22:31:28.975304+0000 mgr.y (mgr.14592) 946 : cluster 0 pgmap v1416: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:30.689 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:30 smithi050 bash[21866]: cluster 2024-05-20T22:31:28.975304+0000 mgr.y (mgr.14592) 946 : cluster 0 pgmap v1416: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:30.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:30 smithi050 bash[28929]: cluster 2024-05-20T22:31:28.975304+0000 mgr.y (mgr.14592) 946 : cluster 0 pgmap v1416: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:32.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:32 smithi145 bash[23893]: cluster 2024-05-20T22:31:30.978175+0000 mgr.y (mgr.14592) 947 : cluster 0 pgmap v1417: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:32.689 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:32 smithi050 bash[21866]: cluster 2024-05-20T22:31:30.978175+0000 mgr.y (mgr.14592) 947 : cluster 0 pgmap v1417: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:32.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:32 smithi050 bash[28929]: cluster 2024-05-20T22:31:30.978175+0000 mgr.y (mgr.14592) 947 : cluster 0 pgmap v1417: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:34.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:34 smithi145 bash[23893]: cluster 2024-05-20T22:31:32.979114+0000 mgr.y (mgr.14592) 948 : cluster 0 pgmap v1418: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:34.689 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:34 smithi050 bash[21866]: cluster 2024-05-20T22:31:32.979114+0000 mgr.y (mgr.14592) 948 : cluster 0 pgmap v1418: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:34.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:34 smithi050 bash[28929]: cluster 2024-05-20T22:31:32.979114+0000 mgr.y (mgr.14592) 948 : cluster 0 pgmap v1418: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:37.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:36 smithi145 bash[23893]: cluster 2024-05-20T22:31:34.980152+0000 mgr.y (mgr.14592) 949 : cluster 0 pgmap v1419: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:37.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:36 smithi050 bash[21866]: cluster 2024-05-20T22:31:34.980152+0000 mgr.y (mgr.14592) 949 : cluster 0 pgmap v1419: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:37.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:36 smithi050 bash[28929]: cluster 2024-05-20T22:31:34.980152+0000 mgr.y (mgr.14592) 949 : cluster 0 pgmap v1419: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:39.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:38 smithi145 bash[23893]: cluster 2024-05-20T22:31:36.983213+0000 mgr.y (mgr.14592) 950 : cluster 0 pgmap v1420: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:39.138 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:31:38 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:31:39.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:38 smithi050 bash[21866]: cluster 2024-05-20T22:31:36.983213+0000 mgr.y (mgr.14592) 950 : cluster 0 pgmap v1420: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:39.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:38 smithi050 bash[28929]: cluster 2024-05-20T22:31:36.983213+0000 mgr.y (mgr.14592) 950 : cluster 0 pgmap v1420: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:39.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:31:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:31:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:31:40.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:39 smithi145 bash[23893]: audit 2024-05-20T22:31:38.814214+0000 mgr.y (mgr.14592) 951 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:31:40.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:39 smithi050 bash[21866]: audit 2024-05-20T22:31:38.814214+0000 mgr.y (mgr.14592) 951 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:31:40.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:39 smithi050 bash[28929]: audit 2024-05-20T22:31:38.814214+0000 mgr.y (mgr.14592) 951 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:31:41.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:40 smithi145 bash[23893]: cluster 2024-05-20T22:31:38.984299+0000 mgr.y (mgr.14592) 952 : cluster 0 pgmap v1421: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:41.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:40 smithi145 bash[23893]: audit 2024-05-20T22:31:39.811426+0000 mon.a (mon.0) 3739 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:31:41.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:40 smithi050 bash[21866]: cluster 2024-05-20T22:31:38.984299+0000 mgr.y (mgr.14592) 952 : cluster 0 pgmap v1421: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:41.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:40 smithi050 bash[21866]: audit 2024-05-20T22:31:39.811426+0000 mon.a (mon.0) 3739 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:31:41.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:40 smithi050 bash[28929]: cluster 2024-05-20T22:31:38.984299+0000 mgr.y (mgr.14592) 952 : cluster 0 pgmap v1421: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:41.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:40 smithi050 bash[28929]: audit 2024-05-20T22:31:39.811426+0000 mon.a (mon.0) 3739 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:31:43.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:42 smithi145 bash[23893]: cluster 2024-05-20T22:31:40.987342+0000 mgr.y (mgr.14592) 953 : cluster 0 pgmap v1422: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:43.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:42 smithi050 bash[21866]: cluster 2024-05-20T22:31:40.987342+0000 mgr.y (mgr.14592) 953 : cluster 0 pgmap v1422: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:43.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:42 smithi050 bash[28929]: cluster 2024-05-20T22:31:40.987342+0000 mgr.y (mgr.14592) 953 : cluster 0 pgmap v1422: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:45.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:44 smithi145 bash[23893]: cluster 2024-05-20T22:31:42.988695+0000 mgr.y (mgr.14592) 954 : cluster 0 pgmap v1423: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:45.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:44 smithi050 bash[21866]: cluster 2024-05-20T22:31:42.988695+0000 mgr.y (mgr.14592) 954 : cluster 0 pgmap v1423: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:45.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:44 smithi050 bash[28929]: cluster 2024-05-20T22:31:42.988695+0000 mgr.y (mgr.14592) 954 : cluster 0 pgmap v1423: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:47.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:46 smithi145 bash[23893]: cluster 2024-05-20T22:31:44.989722+0000 mgr.y (mgr.14592) 955 : cluster 0 pgmap v1424: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:47.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:46 smithi050 bash[21866]: cluster 2024-05-20T22:31:44.989722+0000 mgr.y (mgr.14592) 955 : cluster 0 pgmap v1424: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:47.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:46 smithi050 bash[28929]: cluster 2024-05-20T22:31:44.989722+0000 mgr.y (mgr.14592) 955 : cluster 0 pgmap v1424: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:49.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:31:48 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:31:49.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:48 smithi145 bash[23893]: cluster 2024-05-20T22:31:46.992736+0000 mgr.y (mgr.14592) 956 : cluster 0 pgmap v1425: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:49.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:48 smithi050 bash[21866]: cluster 2024-05-20T22:31:46.992736+0000 mgr.y (mgr.14592) 956 : cluster 0 pgmap v1425: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:49.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:48 smithi050 bash[28929]: cluster 2024-05-20T22:31:46.992736+0000 mgr.y (mgr.14592) 956 : cluster 0 pgmap v1425: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:49.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:31:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:31:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:31:50.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:49 smithi145 bash[23893]: audit 2024-05-20T22:31:48.823665+0000 mgr.y (mgr.14592) 957 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:31:50.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:49 smithi050 bash[21866]: audit 2024-05-20T22:31:48.823665+0000 mgr.y (mgr.14592) 957 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:31:50.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:49 smithi050 bash[28929]: audit 2024-05-20T22:31:48.823665+0000 mgr.y (mgr.14592) 957 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:31:51.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:50 smithi145 bash[23893]: cluster 2024-05-20T22:31:48.993642+0000 mgr.y (mgr.14592) 958 : cluster 0 pgmap v1426: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:51.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:50 smithi050 bash[28929]: cluster 2024-05-20T22:31:48.993642+0000 mgr.y (mgr.14592) 958 : cluster 0 pgmap v1426: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:51.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:50 smithi050 bash[21866]: cluster 2024-05-20T22:31:48.993642+0000 mgr.y (mgr.14592) 958 : cluster 0 pgmap v1426: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:53.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:52 smithi145 bash[23893]: cluster 2024-05-20T22:31:50.996569+0000 mgr.y (mgr.14592) 959 : cluster 0 pgmap v1427: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:53.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:52 smithi050 bash[21866]: cluster 2024-05-20T22:31:50.996569+0000 mgr.y (mgr.14592) 959 : cluster 0 pgmap v1427: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:53.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:52 smithi050 bash[28929]: cluster 2024-05-20T22:31:50.996569+0000 mgr.y (mgr.14592) 959 : cluster 0 pgmap v1427: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:54.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.249 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.249 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.249 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.249 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.249 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.249 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.249 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.249 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.249 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.249 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.249 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.249 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.249 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.249 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.249 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:54.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:31:55.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:54 smithi145 bash[23893]: cluster 2024-05-20T22:31:52.997456+0000 mgr.y (mgr.14592) 960 : cluster 0 pgmap v1428: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:55.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:54 smithi050 bash[21866]: cluster 2024-05-20T22:31:52.997456+0000 mgr.y (mgr.14592) 960 : cluster 0 pgmap v1428: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:55.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:54 smithi050 bash[28929]: cluster 2024-05-20T22:31:52.997456+0000 mgr.y (mgr.14592) 960 : cluster 0 pgmap v1428: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:56.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:55 smithi145 bash[23893]: audit 2024-05-20T22:31:54.844311+0000 mon.a (mon.0) 3740 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:31:56.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:55 smithi050 bash[21866]: audit 2024-05-20T22:31:54.844311+0000 mon.a (mon.0) 3740 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:31:56.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:55 smithi050 bash[28929]: audit 2024-05-20T22:31:54.844311+0000 mon.a (mon.0) 3740 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:31:57.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:56 smithi145 bash[23893]: cluster 2024-05-20T22:31:54.998516+0000 mgr.y (mgr.14592) 961 : cluster 0 pgmap v1429: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:57.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:56 smithi050 bash[21866]: cluster 2024-05-20T22:31:54.998516+0000 mgr.y (mgr.14592) 961 : cluster 0 pgmap v1429: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:57.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:56 smithi050 bash[28929]: cluster 2024-05-20T22:31:54.998516+0000 mgr.y (mgr.14592) 961 : cluster 0 pgmap v1429: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:31:59.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:58 smithi145 bash[23893]: cluster 2024-05-20T22:31:57.001512+0000 mgr.y (mgr.14592) 962 : cluster 0 pgmap v1430: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:59.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:31:58 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:31:59.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:58 smithi050 bash[21866]: cluster 2024-05-20T22:31:57.001512+0000 mgr.y (mgr.14592) 962 : cluster 0 pgmap v1430: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:59.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:58 smithi050 bash[28929]: cluster 2024-05-20T22:31:57.001512+0000 mgr.y (mgr.14592) 962 : cluster 0 pgmap v1430: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:31:59.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:31:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:31:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:32:00.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:31:59 smithi145 bash[23893]: audit 2024-05-20T22:31:58.834779+0000 mgr.y (mgr.14592) 963 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:32:00.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:31:59 smithi050 bash[21866]: audit 2024-05-20T22:31:58.834779+0000 mgr.y (mgr.14592) 963 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:32:00.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:31:59 smithi050 bash[28929]: audit 2024-05-20T22:31:58.834779+0000 mgr.y (mgr.14592) 963 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:32:01.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:00 smithi145 bash[23893]: cluster 2024-05-20T22:31:59.002439+0000 mgr.y (mgr.14592) 964 : cluster 0 pgmap v1431: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:01.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:00 smithi050 bash[28929]: cluster 2024-05-20T22:31:59.002439+0000 mgr.y (mgr.14592) 964 : cluster 0 pgmap v1431: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:01.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:00 smithi050 bash[21866]: cluster 2024-05-20T22:31:59.002439+0000 mgr.y (mgr.14592) 964 : cluster 0 pgmap v1431: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:03.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:02 smithi145 bash[23893]: cluster 2024-05-20T22:32:01.005392+0000 mgr.y (mgr.14592) 965 : cluster 0 pgmap v1432: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:03.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:02 smithi050 bash[21866]: cluster 2024-05-20T22:32:01.005392+0000 mgr.y (mgr.14592) 965 : cluster 0 pgmap v1432: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:03.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:02 smithi050 bash[28929]: cluster 2024-05-20T22:32:01.005392+0000 mgr.y (mgr.14592) 965 : cluster 0 pgmap v1432: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:05.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:04 smithi145 bash[23893]: cluster 2024-05-20T22:32:03.006311+0000 mgr.y (mgr.14592) 966 : cluster 0 pgmap v1433: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:05.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:04 smithi050 bash[28929]: cluster 2024-05-20T22:32:03.006311+0000 mgr.y (mgr.14592) 966 : cluster 0 pgmap v1433: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:05.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:04 smithi050 bash[21866]: cluster 2024-05-20T22:32:03.006311+0000 mgr.y (mgr.14592) 966 : cluster 0 pgmap v1433: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:07.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:06 smithi145 bash[23893]: cluster 2024-05-20T22:32:05.007204+0000 mgr.y (mgr.14592) 967 : cluster 0 pgmap v1434: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:07.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:06 smithi050 bash[21866]: cluster 2024-05-20T22:32:05.007204+0000 mgr.y (mgr.14592) 967 : cluster 0 pgmap v1434: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:07.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:06 smithi050 bash[28929]: cluster 2024-05-20T22:32:05.007204+0000 mgr.y (mgr.14592) 967 : cluster 0 pgmap v1434: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:09.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:08 smithi145 bash[23893]: cluster 2024-05-20T22:32:07.010148+0000 mgr.y (mgr.14592) 968 : cluster 0 pgmap v1435: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:09.138 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:32:08 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:32:09.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:08 smithi050 bash[28929]: cluster 2024-05-20T22:32:07.010148+0000 mgr.y (mgr.14592) 968 : cluster 0 pgmap v1435: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:09.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:08 smithi050 bash[21866]: cluster 2024-05-20T22:32:07.010148+0000 mgr.y (mgr.14592) 968 : cluster 0 pgmap v1435: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:09.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:32:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:32:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:32:10.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:09 smithi145 bash[23893]: audit 2024-05-20T22:32:08.845891+0000 mgr.y (mgr.14592) 969 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:32:10.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:09 smithi050 bash[21866]: audit 2024-05-20T22:32:08.845891+0000 mgr.y (mgr.14592) 969 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:32:10.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:09 smithi050 bash[28929]: audit 2024-05-20T22:32:08.845891+0000 mgr.y (mgr.14592) 969 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:32:11.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:10 smithi145 bash[23893]: cluster 2024-05-20T22:32:09.011057+0000 mgr.y (mgr.14592) 970 : cluster 0 pgmap v1436: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:11.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:10 smithi145 bash[23893]: audit 2024-05-20T22:32:09.876255+0000 mon.a (mon.0) 3741 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:32:11.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:10 smithi050 bash[21866]: cluster 2024-05-20T22:32:09.011057+0000 mgr.y (mgr.14592) 970 : cluster 0 pgmap v1436: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:11.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:10 smithi050 bash[21866]: audit 2024-05-20T22:32:09.876255+0000 mon.a (mon.0) 3741 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:32:11.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:10 smithi050 bash[28929]: cluster 2024-05-20T22:32:09.011057+0000 mgr.y (mgr.14592) 970 : cluster 0 pgmap v1436: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:11.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:10 smithi050 bash[28929]: audit 2024-05-20T22:32:09.876255+0000 mon.a (mon.0) 3741 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:32:13.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:12 smithi145 bash[23893]: cluster 2024-05-20T22:32:11.014107+0000 mgr.y (mgr.14592) 971 : cluster 0 pgmap v1437: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:13.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:12 smithi145 bash[23893]: audit 2024-05-20T22:32:12.206941+0000 mon.a (mon.0) 3742 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:32:13.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:12 smithi050 bash[21866]: cluster 2024-05-20T22:32:11.014107+0000 mgr.y (mgr.14592) 971 : cluster 0 pgmap v1437: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:13.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:12 smithi050 bash[21866]: audit 2024-05-20T22:32:12.206941+0000 mon.a (mon.0) 3742 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:32:13.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:12 smithi050 bash[28929]: cluster 2024-05-20T22:32:11.014107+0000 mgr.y (mgr.14592) 971 : cluster 0 pgmap v1437: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:13.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:12 smithi050 bash[28929]: audit 2024-05-20T22:32:12.206941+0000 mon.a (mon.0) 3742 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:32:14.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:13 smithi145 bash[23893]: audit 2024-05-20T22:32:12.911291+0000 mon.a (mon.0) 3743 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:32:14.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:13 smithi145 bash[23893]: audit 2024-05-20T22:32:12.912846+0000 mon.a (mon.0) 3744 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:32:14.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:13 smithi145 bash[23893]: audit 2024-05-20T22:32:12.922666+0000 mon.a (mon.0) 3745 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:32:14.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:13 smithi050 bash[21866]: audit 2024-05-20T22:32:12.911291+0000 mon.a (mon.0) 3743 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:32:14.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:13 smithi050 bash[21866]: audit 2024-05-20T22:32:12.912846+0000 mon.a (mon.0) 3744 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:32:14.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:13 smithi050 bash[21866]: audit 2024-05-20T22:32:12.922666+0000 mon.a (mon.0) 3745 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:32:14.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:13 smithi050 bash[28929]: audit 2024-05-20T22:32:12.911291+0000 mon.a (mon.0) 3743 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:32:14.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:13 smithi050 bash[28929]: audit 2024-05-20T22:32:12.912846+0000 mon.a (mon.0) 3744 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:32:14.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:13 smithi050 bash[28929]: audit 2024-05-20T22:32:12.922666+0000 mon.a (mon.0) 3745 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:32:15.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:14 smithi050 bash[21866]: cluster 2024-05-20T22:32:13.014973+0000 mgr.y (mgr.14592) 972 : cluster 0 pgmap v1438: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:15.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:14 smithi050 bash[28929]: cluster 2024-05-20T22:32:13.014973+0000 mgr.y (mgr.14592) 972 : cluster 0 pgmap v1438: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:15.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:14 smithi145 bash[23893]: cluster 2024-05-20T22:32:13.014973+0000 mgr.y (mgr.14592) 972 : cluster 0 pgmap v1438: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:17.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:16 smithi145 bash[23893]: cluster 2024-05-20T22:32:15.016049+0000 mgr.y (mgr.14592) 973 : cluster 0 pgmap v1439: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:17.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:16 smithi050 bash[21866]: cluster 2024-05-20T22:32:15.016049+0000 mgr.y (mgr.14592) 973 : cluster 0 pgmap v1439: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:17.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:16 smithi050 bash[28929]: cluster 2024-05-20T22:32:15.016049+0000 mgr.y (mgr.14592) 973 : cluster 0 pgmap v1439: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:19.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:18 smithi145 bash[23893]: cluster 2024-05-20T22:32:17.019026+0000 mgr.y (mgr.14592) 974 : cluster 0 pgmap v1440: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:19.138 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:32:18 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:32:19.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:18 smithi050 bash[21866]: cluster 2024-05-20T22:32:17.019026+0000 mgr.y (mgr.14592) 974 : cluster 0 pgmap v1440: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:19.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:18 smithi050 bash[28929]: cluster 2024-05-20T22:32:17.019026+0000 mgr.y (mgr.14592) 974 : cluster 0 pgmap v1440: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:19.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:32:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:32:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:32:20.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:19 smithi145 bash[23893]: audit 2024-05-20T22:32:18.857161+0000 mgr.y (mgr.14592) 975 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:32:20.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:19 smithi050 bash[21866]: audit 2024-05-20T22:32:18.857161+0000 mgr.y (mgr.14592) 975 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:32:20.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:19 smithi050 bash[28929]: audit 2024-05-20T22:32:18.857161+0000 mgr.y (mgr.14592) 975 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:32:21.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:20 smithi145 bash[23893]: cluster 2024-05-20T22:32:19.019954+0000 mgr.y (mgr.14592) 976 : cluster 0 pgmap v1441: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:21.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:20 smithi050 bash[21866]: cluster 2024-05-20T22:32:19.019954+0000 mgr.y (mgr.14592) 976 : cluster 0 pgmap v1441: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:21.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:20 smithi050 bash[28929]: cluster 2024-05-20T22:32:19.019954+0000 mgr.y (mgr.14592) 976 : cluster 0 pgmap v1441: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:23.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:22 smithi145 bash[23893]: cluster 2024-05-20T22:32:21.022843+0000 mgr.y (mgr.14592) 977 : cluster 0 pgmap v1442: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:23.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:22 smithi050 bash[21866]: cluster 2024-05-20T22:32:21.022843+0000 mgr.y (mgr.14592) 977 : cluster 0 pgmap v1442: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:23.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:22 smithi050 bash[28929]: cluster 2024-05-20T22:32:21.022843+0000 mgr.y (mgr.14592) 977 : cluster 0 pgmap v1442: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:25.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:24 smithi145 bash[23893]: cluster 2024-05-20T22:32:23.023717+0000 mgr.y (mgr.14592) 978 : cluster 0 pgmap v1443: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:25.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:24 smithi050 bash[21866]: cluster 2024-05-20T22:32:23.023717+0000 mgr.y (mgr.14592) 978 : cluster 0 pgmap v1443: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:25.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:24 smithi050 bash[28929]: cluster 2024-05-20T22:32:23.023717+0000 mgr.y (mgr.14592) 978 : cluster 0 pgmap v1443: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:26.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:25 smithi145 bash[23893]: audit 2024-05-20T22:32:24.909129+0000 mon.a (mon.0) 3746 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:32:26.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:25 smithi050 bash[21866]: audit 2024-05-20T22:32:24.909129+0000 mon.a (mon.0) 3746 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:32:26.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:25 smithi050 bash[28929]: audit 2024-05-20T22:32:24.909129+0000 mon.a (mon.0) 3746 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:32:27.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:26 smithi145 bash[23893]: cluster 2024-05-20T22:32:25.024620+0000 mgr.y (mgr.14592) 979 : cluster 0 pgmap v1444: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:27.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:26 smithi050 bash[21866]: cluster 2024-05-20T22:32:25.024620+0000 mgr.y (mgr.14592) 979 : cluster 0 pgmap v1444: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:27.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:26 smithi050 bash[28929]: cluster 2024-05-20T22:32:25.024620+0000 mgr.y (mgr.14592) 979 : cluster 0 pgmap v1444: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:29.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:28 smithi145 bash[23893]: cluster 2024-05-20T22:32:27.027894+0000 mgr.y (mgr.14592) 980 : cluster 0 pgmap v1445: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:29.138 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:32:28 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:32:29.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:28 smithi050 bash[21866]: cluster 2024-05-20T22:32:27.027894+0000 mgr.y (mgr.14592) 980 : cluster 0 pgmap v1445: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:29.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:28 smithi050 bash[28929]: cluster 2024-05-20T22:32:27.027894+0000 mgr.y (mgr.14592) 980 : cluster 0 pgmap v1445: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:29.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:32:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:32:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:32:30.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:29 smithi145 bash[23893]: audit 2024-05-20T22:32:28.864658+0000 mgr.y (mgr.14592) 981 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:32:30.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:29 smithi050 bash[21866]: audit 2024-05-20T22:32:28.864658+0000 mgr.y (mgr.14592) 981 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:32:30.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:29 smithi050 bash[28929]: audit 2024-05-20T22:32:28.864658+0000 mgr.y (mgr.14592) 981 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:32:31.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:30 smithi145 bash[23893]: cluster 2024-05-20T22:32:29.028801+0000 mgr.y (mgr.14592) 982 : cluster 0 pgmap v1446: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:31.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:30 smithi050 bash[21866]: cluster 2024-05-20T22:32:29.028801+0000 mgr.y (mgr.14592) 982 : cluster 0 pgmap v1446: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:31.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:30 smithi050 bash[28929]: cluster 2024-05-20T22:32:29.028801+0000 mgr.y (mgr.14592) 982 : cluster 0 pgmap v1446: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:33.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:32 smithi145 bash[23893]: cluster 2024-05-20T22:32:31.031726+0000 mgr.y (mgr.14592) 983 : cluster 0 pgmap v1447: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:33.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:32 smithi050 bash[21866]: cluster 2024-05-20T22:32:31.031726+0000 mgr.y (mgr.14592) 983 : cluster 0 pgmap v1447: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:33.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:32 smithi050 bash[28929]: cluster 2024-05-20T22:32:31.031726+0000 mgr.y (mgr.14592) 983 : cluster 0 pgmap v1447: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:35.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:34 smithi145 bash[23893]: cluster 2024-05-20T22:32:33.032658+0000 mgr.y (mgr.14592) 984 : cluster 0 pgmap v1448: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:35.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:34 smithi050 bash[21866]: cluster 2024-05-20T22:32:33.032658+0000 mgr.y (mgr.14592) 984 : cluster 0 pgmap v1448: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:35.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:34 smithi050 bash[28929]: cluster 2024-05-20T22:32:33.032658+0000 mgr.y (mgr.14592) 984 : cluster 0 pgmap v1448: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:37.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:36 smithi145 bash[23893]: cluster 2024-05-20T22:32:35.033569+0000 mgr.y (mgr.14592) 985 : cluster 0 pgmap v1449: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:37.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:36 smithi050 bash[21866]: cluster 2024-05-20T22:32:35.033569+0000 mgr.y (mgr.14592) 985 : cluster 0 pgmap v1449: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:37.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:36 smithi050 bash[28929]: cluster 2024-05-20T22:32:35.033569+0000 mgr.y (mgr.14592) 985 : cluster 0 pgmap v1449: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:39.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:38 smithi145 bash[23893]: cluster 2024-05-20T22:32:37.036565+0000 mgr.y (mgr.14592) 986 : cluster 0 pgmap v1450: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:39.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:32:38 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:32:39.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:38 smithi050 bash[21866]: cluster 2024-05-20T22:32:37.036565+0000 mgr.y (mgr.14592) 986 : cluster 0 pgmap v1450: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:39.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:38 smithi050 bash[28929]: cluster 2024-05-20T22:32:37.036565+0000 mgr.y (mgr.14592) 986 : cluster 0 pgmap v1450: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:39.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:32:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:32:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:32:40.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:39 smithi145 bash[23893]: audit 2024-05-20T22:32:38.875330+0000 mgr.y (mgr.14592) 987 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:32:40.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:39 smithi050 bash[21866]: audit 2024-05-20T22:32:38.875330+0000 mgr.y (mgr.14592) 987 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:32:40.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:39 smithi050 bash[28929]: audit 2024-05-20T22:32:38.875330+0000 mgr.y (mgr.14592) 987 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:32:41.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:40 smithi145 bash[23893]: cluster 2024-05-20T22:32:39.037523+0000 mgr.y (mgr.14592) 988 : cluster 0 pgmap v1451: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:41.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:40 smithi145 bash[23893]: audit 2024-05-20T22:32:39.958482+0000 mon.a (mon.0) 3747 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:32:41.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:40 smithi050 bash[21866]: cluster 2024-05-20T22:32:39.037523+0000 mgr.y (mgr.14592) 988 : cluster 0 pgmap v1451: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:41.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:40 smithi050 bash[21866]: audit 2024-05-20T22:32:39.958482+0000 mon.a (mon.0) 3747 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:32:41.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:40 smithi050 bash[28929]: cluster 2024-05-20T22:32:39.037523+0000 mgr.y (mgr.14592) 988 : cluster 0 pgmap v1451: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:41.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:40 smithi050 bash[28929]: audit 2024-05-20T22:32:39.958482+0000 mon.a (mon.0) 3747 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:32:43.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:42 smithi145 bash[23893]: cluster 2024-05-20T22:32:41.040530+0000 mgr.y (mgr.14592) 989 : cluster 0 pgmap v1452: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:43.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:42 smithi050 bash[21866]: cluster 2024-05-20T22:32:41.040530+0000 mgr.y (mgr.14592) 989 : cluster 0 pgmap v1452: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:43.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:42 smithi050 bash[28929]: cluster 2024-05-20T22:32:41.040530+0000 mgr.y (mgr.14592) 989 : cluster 0 pgmap v1452: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:45.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:44 smithi145 bash[23893]: cluster 2024-05-20T22:32:43.041454+0000 mgr.y (mgr.14592) 990 : cluster 0 pgmap v1453: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:45.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:44 smithi050 bash[21866]: cluster 2024-05-20T22:32:43.041454+0000 mgr.y (mgr.14592) 990 : cluster 0 pgmap v1453: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:45.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:44 smithi050 bash[28929]: cluster 2024-05-20T22:32:43.041454+0000 mgr.y (mgr.14592) 990 : cluster 0 pgmap v1453: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:47.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:46 smithi145 bash[23893]: cluster 2024-05-20T22:32:45.042365+0000 mgr.y (mgr.14592) 991 : cluster 0 pgmap v1454: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:47.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:46 smithi050 bash[21866]: cluster 2024-05-20T22:32:45.042365+0000 mgr.y (mgr.14592) 991 : cluster 0 pgmap v1454: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:47.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:46 smithi050 bash[28929]: cluster 2024-05-20T22:32:45.042365+0000 mgr.y (mgr.14592) 991 : cluster 0 pgmap v1454: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:32:49.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:48 smithi145 bash[23893]: cluster 2024-05-20T22:32:47.045419+0000 mgr.y (mgr.14592) 992 : cluster 0 pgmap v1455: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:49.138 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:32:48 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:32:49.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:48 smithi050 bash[21866]: cluster 2024-05-20T22:32:47.045419+0000 mgr.y (mgr.14592) 992 : cluster 0 pgmap v1455: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:49.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:48 smithi050 bash[28929]: cluster 2024-05-20T22:32:47.045419+0000 mgr.y (mgr.14592) 992 : cluster 0 pgmap v1455: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:49.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:32:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:32:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:32:50.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:49 smithi145 bash[23893]: audit 2024-05-20T22:32:48.886664+0000 mgr.y (mgr.14592) 993 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:32:50.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:49 smithi050 bash[21866]: audit 2024-05-20T22:32:48.886664+0000 mgr.y (mgr.14592) 993 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:32:50.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:49 smithi050 bash[28929]: audit 2024-05-20T22:32:48.886664+0000 mgr.y (mgr.14592) 993 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:32:51.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:50 smithi145 bash[23893]: cluster 2024-05-20T22:32:49.046488+0000 mgr.y (mgr.14592) 994 : cluster 0 pgmap v1456: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:32:51.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:50 smithi050 bash[21866]: cluster 2024-05-20T22:32:49.046488+0000 mgr.y (mgr.14592) 994 : cluster 0 pgmap v1456: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:32:51.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:50 smithi050 bash[28929]: cluster 2024-05-20T22:32:49.046488+0000 mgr.y (mgr.14592) 994 : cluster 0 pgmap v1456: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:32:53.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:52 smithi145 bash[23893]: cluster 2024-05-20T22:32:51.049829+0000 mgr.y (mgr.14592) 995 : cluster 0 pgmap v1457: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:53.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:52 smithi050 bash[21866]: cluster 2024-05-20T22:32:51.049829+0000 mgr.y (mgr.14592) 995 : cluster 0 pgmap v1457: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:53.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:52 smithi050 bash[28929]: cluster 2024-05-20T22:32:51.049829+0000 mgr.y (mgr.14592) 995 : cluster 0 pgmap v1457: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:55.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:54 smithi145 bash[23893]: cluster 2024-05-20T22:32:53.050738+0000 mgr.y (mgr.14592) 996 : cluster 0 pgmap v1458: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:32:55.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:54 smithi050 bash[28929]: cluster 2024-05-20T22:32:53.050738+0000 mgr.y (mgr.14592) 996 : cluster 0 pgmap v1458: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:32:55.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:54 smithi050 bash[21866]: cluster 2024-05-20T22:32:53.050738+0000 mgr.y (mgr.14592) 996 : cluster 0 pgmap v1458: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:32:56.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:55 smithi050 bash[21866]: audit 2024-05-20T22:32:54.991654+0000 mon.a (mon.0) 3748 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:32:56.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:55 smithi050 bash[28929]: audit 2024-05-20T22:32:54.991654+0000 mon.a (mon.0) 3748 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:32:56.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:55 smithi145 bash[23893]: audit 2024-05-20T22:32:54.991654+0000 mon.a (mon.0) 3748 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:32:57.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:56 smithi050 bash[21866]: cluster 2024-05-20T22:32:55.051632+0000 mgr.y (mgr.14592) 997 : cluster 0 pgmap v1459: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:32:57.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:56 smithi050 bash[28929]: cluster 2024-05-20T22:32:55.051632+0000 mgr.y (mgr.14592) 997 : cluster 0 pgmap v1459: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:32:57.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:56 smithi145 bash[23893]: cluster 2024-05-20T22:32:55.051632+0000 mgr.y (mgr.14592) 997 : cluster 0 pgmap v1459: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:32:59.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:58 smithi050 bash[21866]: cluster 2024-05-20T22:32:57.054735+0000 mgr.y (mgr.14592) 998 : cluster 0 pgmap v1460: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:59.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:58 smithi050 bash[28929]: cluster 2024-05-20T22:32:57.054735+0000 mgr.y (mgr.14592) 998 : cluster 0 pgmap v1460: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:59.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:58 smithi145 bash[23893]: cluster 2024-05-20T22:32:57.054735+0000 mgr.y (mgr.14592) 998 : cluster 0 pgmap v1460: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:32:59.388 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:32:58 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:32:59.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:32:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:32:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:33:00.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:32:59 smithi050 bash[21866]: audit 2024-05-20T22:32:58.898042+0000 mgr.y (mgr.14592) 999 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:33:00.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:32:59 smithi050 bash[28929]: audit 2024-05-20T22:32:58.898042+0000 mgr.y (mgr.14592) 999 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:33:00.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:32:59 smithi145 bash[23893]: audit 2024-05-20T22:32:58.898042+0000 mgr.y (mgr.14592) 999 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:33:01.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:00 smithi050 bash[21866]: cluster 2024-05-20T22:32:59.055891+0000 mgr.y (mgr.14592) 1000 : cluster 0 pgmap v1461: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:01.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:00 smithi050 bash[28929]: cluster 2024-05-20T22:32:59.055891+0000 mgr.y (mgr.14592) 1000 : cluster 0 pgmap v1461: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:01.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:00 smithi145 bash[23893]: cluster 2024-05-20T22:32:59.055891+0000 mgr.y (mgr.14592) 1000 : cluster 0 pgmap v1461: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:03.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:02 smithi050 bash[21866]: cluster 2024-05-20T22:33:01.058925+0000 mgr.y (mgr.14592) 1001 : cluster 0 pgmap v1462: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:03.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:02 smithi050 bash[28929]: cluster 2024-05-20T22:33:01.058925+0000 mgr.y (mgr.14592) 1001 : cluster 0 pgmap v1462: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:03.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:02 smithi145 bash[23893]: cluster 2024-05-20T22:33:01.058925+0000 mgr.y (mgr.14592) 1001 : cluster 0 pgmap v1462: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:05.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:04 smithi050 bash[21866]: cluster 2024-05-20T22:33:03.060050+0000 mgr.y (mgr.14592) 1002 : cluster 0 pgmap v1463: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:05.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:04 smithi050 bash[28929]: cluster 2024-05-20T22:33:03.060050+0000 mgr.y (mgr.14592) 1002 : cluster 0 pgmap v1463: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:05.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:04 smithi145 bash[23893]: cluster 2024-05-20T22:33:03.060050+0000 mgr.y (mgr.14592) 1002 : cluster 0 pgmap v1463: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:06.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:05 smithi145 bash[23893]: cluster 2024-05-20T22:33:05.060992+0000 mgr.y (mgr.14592) 1003 : cluster 0 pgmap v1464: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:06.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:05 smithi050 bash[21866]: cluster 2024-05-20T22:33:05.060992+0000 mgr.y (mgr.14592) 1003 : cluster 0 pgmap v1464: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:06.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:05 smithi050 bash[28929]: cluster 2024-05-20T22:33:05.060992+0000 mgr.y (mgr.14592) 1003 : cluster 0 pgmap v1464: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:08.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:08 smithi145 bash[23893]: cluster 2024-05-20T22:33:07.063957+0000 mgr.y (mgr.14592) 1004 : cluster 0 pgmap v1465: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:08.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:08 smithi050 bash[21866]: cluster 2024-05-20T22:33:07.063957+0000 mgr.y (mgr.14592) 1004 : cluster 0 pgmap v1465: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:08.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:08 smithi050 bash[28929]: cluster 2024-05-20T22:33:07.063957+0000 mgr.y (mgr.14592) 1004 : cluster 0 pgmap v1465: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:09.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:09 smithi145 bash[23893]: audit 2024-05-20T22:33:08.909496+0000 mgr.y (mgr.14592) 1005 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:33:09.387 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:33:08 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:33:09.388 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:09 smithi050 bash[21866]: audit 2024-05-20T22:33:08.909496+0000 mgr.y (mgr.14592) 1005 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:33:09.389 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:09 smithi050 bash[28929]: audit 2024-05-20T22:33:08.909496+0000 mgr.y (mgr.14592) 1005 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:33:09.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:33:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:33:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:33:10.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:10 smithi145 bash[23893]: cluster 2024-05-20T22:33:09.064810+0000 mgr.y (mgr.14592) 1006 : cluster 0 pgmap v1466: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:10.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:10 smithi145 bash[23893]: audit 2024-05-20T22:33:10.024158+0000 mon.a (mon.0) 3749 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:33:10.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:10 smithi050 bash[28929]: cluster 2024-05-20T22:33:09.064810+0000 mgr.y (mgr.14592) 1006 : cluster 0 pgmap v1466: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:10.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:10 smithi050 bash[28929]: audit 2024-05-20T22:33:10.024158+0000 mon.a (mon.0) 3749 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:33:10.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:10 smithi050 bash[21866]: cluster 2024-05-20T22:33:09.064810+0000 mgr.y (mgr.14592) 1006 : cluster 0 pgmap v1466: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:10.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:10 smithi050 bash[21866]: audit 2024-05-20T22:33:10.024158+0000 mon.a (mon.0) 3749 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:33:12.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:12 smithi145 bash[23893]: cluster 2024-05-20T22:33:11.068366+0000 mgr.y (mgr.14592) 1007 : cluster 0 pgmap v1467: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:12.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:12 smithi050 bash[21866]: cluster 2024-05-20T22:33:11.068366+0000 mgr.y (mgr.14592) 1007 : cluster 0 pgmap v1467: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:12.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:12 smithi050 bash[28929]: cluster 2024-05-20T22:33:11.068366+0000 mgr.y (mgr.14592) 1007 : cluster 0 pgmap v1467: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:13.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:13 smithi145 bash[23893]: audit 2024-05-20T22:33:13.057037+0000 mon.a (mon.0) 3750 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:33:13.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:13 smithi050 bash[28929]: audit 2024-05-20T22:33:13.057037+0000 mon.a (mon.0) 3750 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:33:13.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:13 smithi050 bash[21866]: audit 2024-05-20T22:33:13.057037+0000 mon.a (mon.0) 3750 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:33:14.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:14 smithi050 bash[21866]: cluster 2024-05-20T22:33:13.069252+0000 mgr.y (mgr.14592) 1008 : cluster 0 pgmap v1468: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:14.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:14 smithi050 bash[28929]: cluster 2024-05-20T22:33:13.069252+0000 mgr.y (mgr.14592) 1008 : cluster 0 pgmap v1468: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:14.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:14 smithi145 bash[23893]: cluster 2024-05-20T22:33:13.069252+0000 mgr.y (mgr.14592) 1008 : cluster 0 pgmap v1468: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:16.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:16 smithi050 bash[21866]: cluster 2024-05-20T22:33:15.070160+0000 mgr.y (mgr.14592) 1009 : cluster 0 pgmap v1469: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:16.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:16 smithi050 bash[28929]: cluster 2024-05-20T22:33:15.070160+0000 mgr.y (mgr.14592) 1009 : cluster 0 pgmap v1469: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:16.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:16 smithi145 bash[23893]: cluster 2024-05-20T22:33:15.070160+0000 mgr.y (mgr.14592) 1009 : cluster 0 pgmap v1469: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:18.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:18 smithi050 bash[21866]: cluster 2024-05-20T22:33:17.073135+0000 mgr.y (mgr.14592) 1010 : cluster 0 pgmap v1470: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:18.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:18 smithi050 bash[28929]: cluster 2024-05-20T22:33:17.073135+0000 mgr.y (mgr.14592) 1010 : cluster 0 pgmap v1470: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:18.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:18 smithi145 bash[23893]: cluster 2024-05-20T22:33:17.073135+0000 mgr.y (mgr.14592) 1010 : cluster 0 pgmap v1470: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:19.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:19 smithi145 bash[23893]: audit 2024-05-20T22:33:18.920901+0000 mgr.y (mgr.14592) 1011 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:33:19.387 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:33:18 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:33:19.440 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:33:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:33:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:33:19.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:19 smithi050 bash[28929]: audit 2024-05-20T22:33:18.920901+0000 mgr.y (mgr.14592) 1011 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:33:19.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:19 smithi050 bash[21866]: audit 2024-05-20T22:33:18.920901+0000 mgr.y (mgr.14592) 1011 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:33:20.435 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:20 smithi050 bash[21866]: cluster 2024-05-20T22:33:19.074071+0000 mgr.y (mgr.14592) 1012 : cluster 0 pgmap v1471: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:20.436 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:20 smithi050 bash[28929]: cluster 2024-05-20T22:33:19.074071+0000 mgr.y (mgr.14592) 1012 : cluster 0 pgmap v1471: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:20.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:20 smithi145 bash[23893]: cluster 2024-05-20T22:33:19.074071+0000 mgr.y (mgr.14592) 1012 : cluster 0 pgmap v1471: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:22.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:22 smithi050 bash[28929]: cluster 2024-05-20T22:33:21.076170+0000 mgr.y (mgr.14592) 1013 : cluster 0 pgmap v1472: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:22.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:22 smithi050 bash[21866]: cluster 2024-05-20T22:33:21.076170+0000 mgr.y (mgr.14592) 1013 : cluster 0 pgmap v1472: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:22.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:22 smithi145 bash[23893]: cluster 2024-05-20T22:33:21.076170+0000 mgr.y (mgr.14592) 1013 : cluster 0 pgmap v1472: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:25.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:24 smithi145 bash[23893]: cluster 2024-05-20T22:33:23.076789+0000 mgr.y (mgr.14592) 1014 : cluster 0 pgmap v1473: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:25.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:24 smithi145 bash[23893]: audit 2024-05-20T22:33:23.894481+0000 mon.a (mon.0) 3751 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:33:25.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:24 smithi145 bash[23893]: audit 2024-05-20T22:33:23.905118+0000 mon.a (mon.0) 3752 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:33:25.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:24 smithi145 bash[23893]: audit 2024-05-20T22:33:23.907159+0000 mon.a (mon.0) 3753 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:33:25.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:24 smithi145 bash[23893]: audit 2024-05-20T22:33:23.908746+0000 mon.a (mon.0) 3754 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:33:25.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:24 smithi145 bash[23893]: audit 2024-05-20T22:33:23.918256+0000 mon.a (mon.0) 3755 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:33:25.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:24 smithi050 bash[21866]: cluster 2024-05-20T22:33:23.076789+0000 mgr.y (mgr.14592) 1014 : cluster 0 pgmap v1473: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:25.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:24 smithi050 bash[21866]: audit 2024-05-20T22:33:23.894481+0000 mon.a (mon.0) 3751 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:33:25.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:24 smithi050 bash[21866]: audit 2024-05-20T22:33:23.905118+0000 mon.a (mon.0) 3752 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:33:25.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:24 smithi050 bash[21866]: audit 2024-05-20T22:33:23.907159+0000 mon.a (mon.0) 3753 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:33:25.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:24 smithi050 bash[21866]: audit 2024-05-20T22:33:23.908746+0000 mon.a (mon.0) 3754 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:33:25.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:24 smithi050 bash[21866]: audit 2024-05-20T22:33:23.918256+0000 mon.a (mon.0) 3755 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:33:25.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:24 smithi050 bash[28929]: cluster 2024-05-20T22:33:23.076789+0000 mgr.y (mgr.14592) 1014 : cluster 0 pgmap v1473: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:25.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:24 smithi050 bash[28929]: audit 2024-05-20T22:33:23.894481+0000 mon.a (mon.0) 3751 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:33:25.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:24 smithi050 bash[28929]: audit 2024-05-20T22:33:23.905118+0000 mon.a (mon.0) 3752 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:33:25.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:24 smithi050 bash[28929]: audit 2024-05-20T22:33:23.907159+0000 mon.a (mon.0) 3753 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:33:25.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:24 smithi050 bash[28929]: audit 2024-05-20T22:33:23.908746+0000 mon.a (mon.0) 3754 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:33:25.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:24 smithi050 bash[28929]: audit 2024-05-20T22:33:23.918256+0000 mon.a (mon.0) 3755 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:33:26.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:25 smithi050 bash[21866]: audit 2024-05-20T22:33:25.056582+0000 mon.a (mon.0) 3756 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:33:26.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:25 smithi050 bash[28929]: audit 2024-05-20T22:33:25.056582+0000 mon.a (mon.0) 3756 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:33:26.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:25 smithi145 bash[23893]: audit 2024-05-20T22:33:25.056582+0000 mon.a (mon.0) 3756 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:33:27.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:26 smithi050 bash[21866]: cluster 2024-05-20T22:33:25.077896+0000 mgr.y (mgr.14592) 1015 : cluster 0 pgmap v1474: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:27.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:26 smithi050 bash[28929]: cluster 2024-05-20T22:33:25.077896+0000 mgr.y (mgr.14592) 1015 : cluster 0 pgmap v1474: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:27.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:26 smithi145 bash[23893]: cluster 2024-05-20T22:33:25.077896+0000 mgr.y (mgr.14592) 1015 : cluster 0 pgmap v1474: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:29.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:28 smithi050 bash[21866]: cluster 2024-05-20T22:33:27.080835+0000 mgr.y (mgr.14592) 1016 : cluster 0 pgmap v1475: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:29.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:28 smithi050 bash[28929]: cluster 2024-05-20T22:33:27.080835+0000 mgr.y (mgr.14592) 1016 : cluster 0 pgmap v1475: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:29.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:28 smithi145 bash[23893]: cluster 2024-05-20T22:33:27.080835+0000 mgr.y (mgr.14592) 1016 : cluster 0 pgmap v1475: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:29.388 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:33:28 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:33:29.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:33:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:33:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:33:30.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:29 smithi050 bash[21866]: audit 2024-05-20T22:33:28.932248+0000 mgr.y (mgr.14592) 1017 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:33:30.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:29 smithi050 bash[28929]: audit 2024-05-20T22:33:28.932248+0000 mgr.y (mgr.14592) 1017 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:33:30.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:29 smithi145 bash[23893]: audit 2024-05-20T22:33:28.932248+0000 mgr.y (mgr.14592) 1017 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:33:31.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:30 smithi050 bash[21866]: cluster 2024-05-20T22:33:29.081742+0000 mgr.y (mgr.14592) 1018 : cluster 0 pgmap v1476: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:31.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:30 smithi050 bash[28929]: cluster 2024-05-20T22:33:29.081742+0000 mgr.y (mgr.14592) 1018 : cluster 0 pgmap v1476: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:31.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:30 smithi145 bash[23893]: cluster 2024-05-20T22:33:29.081742+0000 mgr.y (mgr.14592) 1018 : cluster 0 pgmap v1476: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:33.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:32 smithi050 bash[21866]: cluster 2024-05-20T22:33:31.084693+0000 mgr.y (mgr.14592) 1019 : cluster 0 pgmap v1477: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:33.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:32 smithi050 bash[28929]: cluster 2024-05-20T22:33:31.084693+0000 mgr.y (mgr.14592) 1019 : cluster 0 pgmap v1477: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:33.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:32 smithi145 bash[23893]: cluster 2024-05-20T22:33:31.084693+0000 mgr.y (mgr.14592) 1019 : cluster 0 pgmap v1477: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:34.256 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.256 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.256 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.256 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.256 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.256 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.256 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.257 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.257 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.257 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.257 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.257 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.257 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.257 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.257 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.257 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.257 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.257 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.257 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.258 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.258 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.258 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.258 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.258 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.258 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.258 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.258 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.258 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.258 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.258 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.258 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.259 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.259 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.259 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.259 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.259 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.259 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.259 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.259 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.259 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.259 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.259 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.259 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.260 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.260 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.260 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.260 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.260 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.260 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.260 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.260 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.260 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.260 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.260 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.260 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.260 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.260 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.260 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.260 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.261 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.261 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.261 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.261 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.261 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.261 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.261 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.261 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.261 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.261 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.261 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.261 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.261 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.262 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.262 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.262 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.262 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.262 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.262 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.262 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.262 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.262 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.262 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.262 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.263 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.263 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.263 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.263 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.263 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.263 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.263 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.263 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.263 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.263 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.263 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.263 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.263 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.264 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.264 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.264 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:34.264 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:33:35.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:34 smithi050 bash[21866]: cluster 2024-05-20T22:33:33.085629+0000 mgr.y (mgr.14592) 1020 : cluster 0 pgmap v1478: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:35.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:34 smithi050 bash[28929]: cluster 2024-05-20T22:33:33.085629+0000 mgr.y (mgr.14592) 1020 : cluster 0 pgmap v1478: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:35.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:34 smithi145 bash[23893]: cluster 2024-05-20T22:33:33.085629+0000 mgr.y (mgr.14592) 1020 : cluster 0 pgmap v1478: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:37.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:36 smithi050 bash[21866]: cluster 2024-05-20T22:33:35.086644+0000 mgr.y (mgr.14592) 1021 : cluster 0 pgmap v1479: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:37.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:36 smithi050 bash[28929]: cluster 2024-05-20T22:33:35.086644+0000 mgr.y (mgr.14592) 1021 : cluster 0 pgmap v1479: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:37.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:36 smithi145 bash[23893]: cluster 2024-05-20T22:33:35.086644+0000 mgr.y (mgr.14592) 1021 : cluster 0 pgmap v1479: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:39.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:38 smithi050 bash[28929]: cluster 2024-05-20T22:33:37.089645+0000 mgr.y (mgr.14592) 1022 : cluster 0 pgmap v1480: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:39.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:38 smithi050 bash[21866]: cluster 2024-05-20T22:33:37.089645+0000 mgr.y (mgr.14592) 1022 : cluster 0 pgmap v1480: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:39.387 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:33:38 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:33:39.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:38 smithi145 bash[23893]: cluster 2024-05-20T22:33:37.089645+0000 mgr.y (mgr.14592) 1022 : cluster 0 pgmap v1480: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:39.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:33:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:33:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:33:40.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:39 smithi050 bash[21866]: audit 2024-05-20T22:33:38.935029+0000 mgr.y (mgr.14592) 1023 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:33:40.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:39 smithi050 bash[28929]: audit 2024-05-20T22:33:38.935029+0000 mgr.y (mgr.14592) 1023 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:33:40.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:39 smithi145 bash[23893]: audit 2024-05-20T22:33:38.935029+0000 mgr.y (mgr.14592) 1023 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:33:41.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:40 smithi050 bash[21866]: cluster 2024-05-20T22:33:39.090560+0000 mgr.y (mgr.14592) 1024 : cluster 0 pgmap v1481: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:41.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:40 smithi050 bash[21866]: audit 2024-05-20T22:33:40.088985+0000 mon.a (mon.0) 3757 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:33:41.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:40 smithi050 bash[28929]: cluster 2024-05-20T22:33:39.090560+0000 mgr.y (mgr.14592) 1024 : cluster 0 pgmap v1481: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:41.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:40 smithi050 bash[28929]: audit 2024-05-20T22:33:40.088985+0000 mon.a (mon.0) 3757 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:33:41.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:40 smithi145 bash[23893]: cluster 2024-05-20T22:33:39.090560+0000 mgr.y (mgr.14592) 1024 : cluster 0 pgmap v1481: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:41.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:40 smithi145 bash[23893]: audit 2024-05-20T22:33:40.088985+0000 mon.a (mon.0) 3757 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:33:42.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:41 smithi145 bash[23893]: cluster 2024-05-20T22:33:41.093552+0000 mgr.y (mgr.14592) 1025 : cluster 0 pgmap v1482: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:42.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:41 smithi050 bash[21866]: cluster 2024-05-20T22:33:41.093552+0000 mgr.y (mgr.14592) 1025 : cluster 0 pgmap v1482: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:42.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:41 smithi050 bash[28929]: cluster 2024-05-20T22:33:41.093552+0000 mgr.y (mgr.14592) 1025 : cluster 0 pgmap v1482: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:44.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:44 smithi050 bash[21866]: cluster 2024-05-20T22:33:43.094509+0000 mgr.y (mgr.14592) 1026 : cluster 0 pgmap v1483: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:44.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:44 smithi050 bash[28929]: cluster 2024-05-20T22:33:43.094509+0000 mgr.y (mgr.14592) 1026 : cluster 0 pgmap v1483: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:44.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:44 smithi145 bash[23893]: cluster 2024-05-20T22:33:43.094509+0000 mgr.y (mgr.14592) 1026 : cluster 0 pgmap v1483: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:46.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:46 smithi050 bash[21866]: cluster 2024-05-20T22:33:45.095436+0000 mgr.y (mgr.14592) 1027 : cluster 0 pgmap v1484: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:46.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:46 smithi050 bash[28929]: cluster 2024-05-20T22:33:45.095436+0000 mgr.y (mgr.14592) 1027 : cluster 0 pgmap v1484: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:46.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:46 smithi145 bash[23893]: cluster 2024-05-20T22:33:45.095436+0000 mgr.y (mgr.14592) 1027 : cluster 0 pgmap v1484: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:48.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:48 smithi050 bash[21866]: cluster 2024-05-20T22:33:47.098469+0000 mgr.y (mgr.14592) 1028 : cluster 0 pgmap v1485: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:48.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:48 smithi050 bash[28929]: cluster 2024-05-20T22:33:47.098469+0000 mgr.y (mgr.14592) 1028 : cluster 0 pgmap v1485: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:48.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:48 smithi145 bash[23893]: cluster 2024-05-20T22:33:47.098469+0000 mgr.y (mgr.14592) 1028 : cluster 0 pgmap v1485: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:49.387 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:33:48 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:33:49.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:33:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:33:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:33:50.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:50 smithi050 bash[21866]: audit 2024-05-20T22:33:48.945624+0000 mgr.y (mgr.14592) 1029 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:33:50.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:50 smithi050 bash[21866]: cluster 2024-05-20T22:33:49.099570+0000 mgr.y (mgr.14592) 1030 : cluster 0 pgmap v1486: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:50.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:50 smithi050 bash[28929]: audit 2024-05-20T22:33:48.945624+0000 mgr.y (mgr.14592) 1029 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:33:50.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:50 smithi050 bash[28929]: cluster 2024-05-20T22:33:49.099570+0000 mgr.y (mgr.14592) 1030 : cluster 0 pgmap v1486: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:50.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:50 smithi145 bash[23893]: audit 2024-05-20T22:33:48.945624+0000 mgr.y (mgr.14592) 1029 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:33:50.638 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:50 smithi145 bash[23893]: cluster 2024-05-20T22:33:49.099570+0000 mgr.y (mgr.14592) 1030 : cluster 0 pgmap v1486: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:52.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:52 smithi050 bash[21866]: cluster 2024-05-20T22:33:51.102507+0000 mgr.y (mgr.14592) 1031 : cluster 0 pgmap v1487: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:52.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:52 smithi050 bash[28929]: cluster 2024-05-20T22:33:51.102507+0000 mgr.y (mgr.14592) 1031 : cluster 0 pgmap v1487: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:52.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:52 smithi145 bash[23893]: cluster 2024-05-20T22:33:51.102507+0000 mgr.y (mgr.14592) 1031 : cluster 0 pgmap v1487: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:54.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:54 smithi050 bash[21866]: cluster 2024-05-20T22:33:53.103459+0000 mgr.y (mgr.14592) 1032 : cluster 0 pgmap v1488: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:54.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:54 smithi050 bash[28929]: cluster 2024-05-20T22:33:53.103459+0000 mgr.y (mgr.14592) 1032 : cluster 0 pgmap v1488: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:54.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:54 smithi145 bash[23893]: cluster 2024-05-20T22:33:53.103459+0000 mgr.y (mgr.14592) 1032 : cluster 0 pgmap v1488: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:55.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:55 smithi050 bash[21866]: audit 2024-05-20T22:33:55.123560+0000 mon.a (mon.0) 3758 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:33:55.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:55 smithi050 bash[28929]: audit 2024-05-20T22:33:55.123560+0000 mon.a (mon.0) 3758 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:33:55.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:55 smithi145 bash[23893]: audit 2024-05-20T22:33:55.123560+0000 mon.a (mon.0) 3758 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:33:56.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:56 smithi050 bash[21866]: cluster 2024-05-20T22:33:55.104387+0000 mgr.y (mgr.14592) 1033 : cluster 0 pgmap v1489: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:56.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:56 smithi050 bash[28929]: cluster 2024-05-20T22:33:55.104387+0000 mgr.y (mgr.14592) 1033 : cluster 0 pgmap v1489: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:56.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:56 smithi145 bash[23893]: cluster 2024-05-20T22:33:55.104387+0000 mgr.y (mgr.14592) 1033 : cluster 0 pgmap v1489: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:33:58.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:33:58 smithi050 bash[21866]: cluster 2024-05-20T22:33:57.107327+0000 mgr.y (mgr.14592) 1034 : cluster 0 pgmap v1490: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:58.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:33:58 smithi050 bash[28929]: cluster 2024-05-20T22:33:57.107327+0000 mgr.y (mgr.14592) 1034 : cluster 0 pgmap v1490: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:58.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:33:58 smithi145 bash[23893]: cluster 2024-05-20T22:33:57.107327+0000 mgr.y (mgr.14592) 1034 : cluster 0 pgmap v1490: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:33:59.387 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:33:58 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:33:59.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:33:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:33:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:34:00.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:00 smithi050 bash[28929]: audit 2024-05-20T22:33:58.957025+0000 mgr.y (mgr.14592) 1035 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:34:00.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:00 smithi050 bash[28929]: cluster 2024-05-20T22:33:59.108216+0000 mgr.y (mgr.14592) 1036 : cluster 0 pgmap v1491: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:00.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:00 smithi050 bash[21866]: audit 2024-05-20T22:33:58.957025+0000 mgr.y (mgr.14592) 1035 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:34:00.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:00 smithi050 bash[21866]: cluster 2024-05-20T22:33:59.108216+0000 mgr.y (mgr.14592) 1036 : cluster 0 pgmap v1491: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:00.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:00 smithi145 bash[23893]: audit 2024-05-20T22:33:58.957025+0000 mgr.y (mgr.14592) 1035 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:34:00.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:00 smithi145 bash[23893]: cluster 2024-05-20T22:33:59.108216+0000 mgr.y (mgr.14592) 1036 : cluster 0 pgmap v1491: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:02.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:02 smithi050 bash[21866]: cluster 2024-05-20T22:34:01.112442+0000 mgr.y (mgr.14592) 1037 : cluster 0 pgmap v1492: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:02.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:02 smithi050 bash[28929]: cluster 2024-05-20T22:34:01.112442+0000 mgr.y (mgr.14592) 1037 : cluster 0 pgmap v1492: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:02.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:02 smithi145 bash[23893]: cluster 2024-05-20T22:34:01.112442+0000 mgr.y (mgr.14592) 1037 : cluster 0 pgmap v1492: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:04.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:04 smithi145 bash[23893]: cluster 2024-05-20T22:34:03.113540+0000 mgr.y (mgr.14592) 1038 : cluster 0 pgmap v1493: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:04.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:04 smithi050 bash[21866]: cluster 2024-05-20T22:34:03.113540+0000 mgr.y (mgr.14592) 1038 : cluster 0 pgmap v1493: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:04.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:04 smithi050 bash[28929]: cluster 2024-05-20T22:34:03.113540+0000 mgr.y (mgr.14592) 1038 : cluster 0 pgmap v1493: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:06.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:06 smithi145 bash[23893]: cluster 2024-05-20T22:34:05.114500+0000 mgr.y (mgr.14592) 1039 : cluster 0 pgmap v1494: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:06.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:06 smithi050 bash[28929]: cluster 2024-05-20T22:34:05.114500+0000 mgr.y (mgr.14592) 1039 : cluster 0 pgmap v1494: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:06.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:06 smithi050 bash[21866]: cluster 2024-05-20T22:34:05.114500+0000 mgr.y (mgr.14592) 1039 : cluster 0 pgmap v1494: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:08.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:08 smithi145 bash[23893]: cluster 2024-05-20T22:34:07.117483+0000 mgr.y (mgr.14592) 1040 : cluster 0 pgmap v1495: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:08.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:08 smithi050 bash[21866]: cluster 2024-05-20T22:34:07.117483+0000 mgr.y (mgr.14592) 1040 : cluster 0 pgmap v1495: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:08.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:08 smithi050 bash[28929]: cluster 2024-05-20T22:34:07.117483+0000 mgr.y (mgr.14592) 1040 : cluster 0 pgmap v1495: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:09.387 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:34:08 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:34:09.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:34:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:34:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:34:10.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:10 smithi145 bash[23893]: audit 2024-05-20T22:34:08.966968+0000 mgr.y (mgr.14592) 1041 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:34:10.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:10 smithi145 bash[23893]: cluster 2024-05-20T22:34:09.118364+0000 mgr.y (mgr.14592) 1042 : cluster 0 pgmap v1496: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:10.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:10 smithi145 bash[23893]: audit 2024-05-20T22:34:10.155974+0000 mon.a (mon.0) 3759 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:34:10.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:10 smithi050 bash[21866]: audit 2024-05-20T22:34:08.966968+0000 mgr.y (mgr.14592) 1041 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:34:10.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:10 smithi050 bash[21866]: cluster 2024-05-20T22:34:09.118364+0000 mgr.y (mgr.14592) 1042 : cluster 0 pgmap v1496: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:10.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:10 smithi050 bash[21866]: audit 2024-05-20T22:34:10.155974+0000 mon.a (mon.0) 3759 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:34:10.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:10 smithi050 bash[28929]: audit 2024-05-20T22:34:08.966968+0000 mgr.y (mgr.14592) 1041 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:34:10.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:10 smithi050 bash[28929]: cluster 2024-05-20T22:34:09.118364+0000 mgr.y (mgr.14592) 1042 : cluster 0 pgmap v1496: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:10.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:10 smithi050 bash[28929]: audit 2024-05-20T22:34:10.155974+0000 mon.a (mon.0) 3759 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:34:12.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:12 smithi145 bash[23893]: cluster 2024-05-20T22:34:11.121329+0000 mgr.y (mgr.14592) 1043 : cluster 0 pgmap v1497: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:12.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:12 smithi050 bash[28929]: cluster 2024-05-20T22:34:11.121329+0000 mgr.y (mgr.14592) 1043 : cluster 0 pgmap v1497: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:12.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:12 smithi050 bash[21866]: cluster 2024-05-20T22:34:11.121329+0000 mgr.y (mgr.14592) 1043 : cluster 0 pgmap v1497: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:14.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:14 smithi145 bash[23893]: cluster 2024-05-20T22:34:13.122387+0000 mgr.y (mgr.14592) 1044 : cluster 0 pgmap v1498: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:14.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:14 smithi050 bash[28929]: cluster 2024-05-20T22:34:13.122387+0000 mgr.y (mgr.14592) 1044 : cluster 0 pgmap v1498: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:14.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:14 smithi050 bash[21866]: cluster 2024-05-20T22:34:13.122387+0000 mgr.y (mgr.14592) 1044 : cluster 0 pgmap v1498: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:16.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:16 smithi145 bash[23893]: cluster 2024-05-20T22:34:15.123323+0000 mgr.y (mgr.14592) 1045 : cluster 0 pgmap v1499: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:16.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:16 smithi050 bash[21866]: cluster 2024-05-20T22:34:15.123323+0000 mgr.y (mgr.14592) 1045 : cluster 0 pgmap v1499: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:16.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:16 smithi050 bash[28929]: cluster 2024-05-20T22:34:15.123323+0000 mgr.y (mgr.14592) 1045 : cluster 0 pgmap v1499: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:18.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:18 smithi145 bash[23893]: cluster 2024-05-20T22:34:17.126320+0000 mgr.y (mgr.14592) 1046 : cluster 0 pgmap v1500: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:18.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:18 smithi050 bash[21866]: cluster 2024-05-20T22:34:17.126320+0000 mgr.y (mgr.14592) 1046 : cluster 0 pgmap v1500: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:18.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:18 smithi050 bash[28929]: cluster 2024-05-20T22:34:17.126320+0000 mgr.y (mgr.14592) 1046 : cluster 0 pgmap v1500: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:19.387 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:34:18 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:34:19.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:34:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:34:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:34:20.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:20 smithi145 bash[23893]: audit 2024-05-20T22:34:18.978360+0000 mgr.y (mgr.14592) 1047 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:34:20.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:20 smithi145 bash[23893]: cluster 2024-05-20T22:34:19.127232+0000 mgr.y (mgr.14592) 1048 : cluster 0 pgmap v1501: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:20.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:20 smithi050 bash[21866]: audit 2024-05-20T22:34:18.978360+0000 mgr.y (mgr.14592) 1047 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:34:20.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:20 smithi050 bash[21866]: cluster 2024-05-20T22:34:19.127232+0000 mgr.y (mgr.14592) 1048 : cluster 0 pgmap v1501: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:20.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:20 smithi050 bash[28929]: audit 2024-05-20T22:34:18.978360+0000 mgr.y (mgr.14592) 1047 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:34:20.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:20 smithi050 bash[28929]: cluster 2024-05-20T22:34:19.127232+0000 mgr.y (mgr.14592) 1048 : cluster 0 pgmap v1501: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:22.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:22 smithi145 bash[23893]: cluster 2024-05-20T22:34:21.130198+0000 mgr.y (mgr.14592) 1049 : cluster 0 pgmap v1502: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:22.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:22 smithi050 bash[21866]: cluster 2024-05-20T22:34:21.130198+0000 mgr.y (mgr.14592) 1049 : cluster 0 pgmap v1502: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:22.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:22 smithi050 bash[28929]: cluster 2024-05-20T22:34:21.130198+0000 mgr.y (mgr.14592) 1049 : cluster 0 pgmap v1502: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:24.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:24 smithi145 bash[23893]: cluster 2024-05-20T22:34:23.131100+0000 mgr.y (mgr.14592) 1050 : cluster 0 pgmap v1503: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:24.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:24 smithi145 bash[23893]: audit 2024-05-20T22:34:24.044015+0000 mon.a (mon.0) 3760 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:34:24.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:24 smithi050 bash[28929]: cluster 2024-05-20T22:34:23.131100+0000 mgr.y (mgr.14592) 1050 : cluster 0 pgmap v1503: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:24.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:24 smithi050 bash[28929]: audit 2024-05-20T22:34:24.044015+0000 mon.a (mon.0) 3760 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:34:24.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:24 smithi050 bash[21866]: cluster 2024-05-20T22:34:23.131100+0000 mgr.y (mgr.14592) 1050 : cluster 0 pgmap v1503: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:24.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:24 smithi050 bash[21866]: audit 2024-05-20T22:34:24.044015+0000 mon.a (mon.0) 3760 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:34:25.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:25 smithi145 bash[23893]: audit 2024-05-20T22:34:24.792192+0000 mon.a (mon.0) 3761 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:34:25.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:25 smithi145 bash[23893]: audit 2024-05-20T22:34:24.793537+0000 mon.a (mon.0) 3762 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:34:25.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:25 smithi145 bash[23893]: audit 2024-05-20T22:34:24.802431+0000 mon.a (mon.0) 3763 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:34:25.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:25 smithi145 bash[23893]: audit 2024-05-20T22:34:25.188889+0000 mon.a (mon.0) 3764 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:34:25.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:25 smithi050 bash[28929]: audit 2024-05-20T22:34:24.792192+0000 mon.a (mon.0) 3761 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:34:25.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:25 smithi050 bash[28929]: audit 2024-05-20T22:34:24.793537+0000 mon.a (mon.0) 3762 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:34:25.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:25 smithi050 bash[28929]: audit 2024-05-20T22:34:24.802431+0000 mon.a (mon.0) 3763 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:34:25.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:25 smithi050 bash[28929]: audit 2024-05-20T22:34:25.188889+0000 mon.a (mon.0) 3764 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:34:25.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:25 smithi050 bash[21866]: audit 2024-05-20T22:34:24.792192+0000 mon.a (mon.0) 3761 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:34:25.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:25 smithi050 bash[21866]: audit 2024-05-20T22:34:24.793537+0000 mon.a (mon.0) 3762 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:34:25.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:25 smithi050 bash[21866]: audit 2024-05-20T22:34:24.802431+0000 mon.a (mon.0) 3763 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:34:25.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:25 smithi050 bash[21866]: audit 2024-05-20T22:34:25.188889+0000 mon.a (mon.0) 3764 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:34:27.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:26 smithi145 bash[23893]: cluster 2024-05-20T22:34:25.132063+0000 mgr.y (mgr.14592) 1051 : cluster 0 pgmap v1504: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:27.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:26 smithi050 bash[21866]: cluster 2024-05-20T22:34:25.132063+0000 mgr.y (mgr.14592) 1051 : cluster 0 pgmap v1504: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:27.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:26 smithi050 bash[28929]: cluster 2024-05-20T22:34:25.132063+0000 mgr.y (mgr.14592) 1051 : cluster 0 pgmap v1504: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:29.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:28 smithi145 bash[23893]: cluster 2024-05-20T22:34:27.134998+0000 mgr.y (mgr.14592) 1052 : cluster 0 pgmap v1505: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:29.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:34:28 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:34:29.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:28 smithi050 bash[21866]: cluster 2024-05-20T22:34:27.134998+0000 mgr.y (mgr.14592) 1052 : cluster 0 pgmap v1505: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:29.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:28 smithi050 bash[28929]: cluster 2024-05-20T22:34:27.134998+0000 mgr.y (mgr.14592) 1052 : cluster 0 pgmap v1505: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:29.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:34:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:34:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:34:31.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:30 smithi145 bash[23893]: audit 2024-05-20T22:34:28.980709+0000 mgr.y (mgr.14592) 1053 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:34:31.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:30 smithi145 bash[23893]: cluster 2024-05-20T22:34:29.135913+0000 mgr.y (mgr.14592) 1054 : cluster 0 pgmap v1506: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:31.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:30 smithi050 bash[21866]: audit 2024-05-20T22:34:28.980709+0000 mgr.y (mgr.14592) 1053 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:34:31.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:30 smithi050 bash[21866]: cluster 2024-05-20T22:34:29.135913+0000 mgr.y (mgr.14592) 1054 : cluster 0 pgmap v1506: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:31.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:30 smithi050 bash[28929]: audit 2024-05-20T22:34:28.980709+0000 mgr.y (mgr.14592) 1053 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:34:31.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:30 smithi050 bash[28929]: cluster 2024-05-20T22:34:29.135913+0000 mgr.y (mgr.14592) 1054 : cluster 0 pgmap v1506: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:33.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:32 smithi145 bash[23893]: cluster 2024-05-20T22:34:31.138811+0000 mgr.y (mgr.14592) 1055 : cluster 0 pgmap v1507: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:33.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:32 smithi050 bash[21866]: cluster 2024-05-20T22:34:31.138811+0000 mgr.y (mgr.14592) 1055 : cluster 0 pgmap v1507: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:33.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:32 smithi050 bash[28929]: cluster 2024-05-20T22:34:31.138811+0000 mgr.y (mgr.14592) 1055 : cluster 0 pgmap v1507: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:35.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:34 smithi145 bash[23893]: cluster 2024-05-20T22:34:33.140480+0000 mgr.y (mgr.14592) 1056 : cluster 0 pgmap v1508: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:35.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:34 smithi050 bash[28929]: cluster 2024-05-20T22:34:33.140480+0000 mgr.y (mgr.14592) 1056 : cluster 0 pgmap v1508: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:35.238 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:34 smithi050 bash[21866]: cluster 2024-05-20T22:34:33.140480+0000 mgr.y (mgr.14592) 1056 : cluster 0 pgmap v1508: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:37.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:36 smithi145 bash[23893]: cluster 2024-05-20T22:34:35.141371+0000 mgr.y (mgr.14592) 1057 : cluster 0 pgmap v1509: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:37.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:36 smithi050 bash[21866]: cluster 2024-05-20T22:34:35.141371+0000 mgr.y (mgr.14592) 1057 : cluster 0 pgmap v1509: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:37.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:36 smithi050 bash[28929]: cluster 2024-05-20T22:34:35.141371+0000 mgr.y (mgr.14592) 1057 : cluster 0 pgmap v1509: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:39.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:38 smithi145 bash[23893]: cluster 2024-05-20T22:34:37.144353+0000 mgr.y (mgr.14592) 1058 : cluster 0 pgmap v1510: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:39.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:34:38 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:34:39.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:38 smithi050 bash[21866]: cluster 2024-05-20T22:34:37.144353+0000 mgr.y (mgr.14592) 1058 : cluster 0 pgmap v1510: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:39.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:38 smithi050 bash[28929]: cluster 2024-05-20T22:34:37.144353+0000 mgr.y (mgr.14592) 1058 : cluster 0 pgmap v1510: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:39.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:34:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:34:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:34:41.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:40 smithi145 bash[23893]: audit 2024-05-20T22:34:38.987615+0000 mgr.y (mgr.14592) 1059 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:34:41.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:40 smithi145 bash[23893]: cluster 2024-05-20T22:34:39.145472+0000 mgr.y (mgr.14592) 1060 : cluster 0 pgmap v1511: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:41.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:40 smithi145 bash[23893]: audit 2024-05-20T22:34:40.224456+0000 mon.a (mon.0) 3765 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:34:41.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:40 smithi050 bash[21866]: audit 2024-05-20T22:34:38.987615+0000 mgr.y (mgr.14592) 1059 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:34:41.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:40 smithi050 bash[21866]: cluster 2024-05-20T22:34:39.145472+0000 mgr.y (mgr.14592) 1060 : cluster 0 pgmap v1511: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:41.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:40 smithi050 bash[21866]: audit 2024-05-20T22:34:40.224456+0000 mon.a (mon.0) 3765 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:34:41.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:40 smithi050 bash[28929]: audit 2024-05-20T22:34:38.987615+0000 mgr.y (mgr.14592) 1059 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:34:41.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:40 smithi050 bash[28929]: cluster 2024-05-20T22:34:39.145472+0000 mgr.y (mgr.14592) 1060 : cluster 0 pgmap v1511: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:41.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:40 smithi050 bash[28929]: audit 2024-05-20T22:34:40.224456+0000 mon.a (mon.0) 3765 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:34:43.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:42 smithi145 bash[23893]: cluster 2024-05-20T22:34:41.148516+0000 mgr.y (mgr.14592) 1061 : cluster 0 pgmap v1512: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:43.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:42 smithi050 bash[21866]: cluster 2024-05-20T22:34:41.148516+0000 mgr.y (mgr.14592) 1061 : cluster 0 pgmap v1512: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:43.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:42 smithi050 bash[28929]: cluster 2024-05-20T22:34:41.148516+0000 mgr.y (mgr.14592) 1061 : cluster 0 pgmap v1512: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:45.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:44 smithi145 bash[23893]: cluster 2024-05-20T22:34:43.149569+0000 mgr.y (mgr.14592) 1062 : cluster 0 pgmap v1513: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:45.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:44 smithi050 bash[21866]: cluster 2024-05-20T22:34:43.149569+0000 mgr.y (mgr.14592) 1062 : cluster 0 pgmap v1513: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:45.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:44 smithi050 bash[28929]: cluster 2024-05-20T22:34:43.149569+0000 mgr.y (mgr.14592) 1062 : cluster 0 pgmap v1513: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:47.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:46 smithi145 bash[23893]: cluster 2024-05-20T22:34:45.150640+0000 mgr.y (mgr.14592) 1063 : cluster 0 pgmap v1514: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:47.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:46 smithi050 bash[21866]: cluster 2024-05-20T22:34:45.150640+0000 mgr.y (mgr.14592) 1063 : cluster 0 pgmap v1514: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:47.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:46 smithi050 bash[28929]: cluster 2024-05-20T22:34:45.150640+0000 mgr.y (mgr.14592) 1063 : cluster 0 pgmap v1514: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:49.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:48 smithi145 bash[23893]: cluster 2024-05-20T22:34:47.153724+0000 mgr.y (mgr.14592) 1064 : cluster 0 pgmap v1515: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:49.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:34:48 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:34:49.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:48 smithi050 bash[21866]: cluster 2024-05-20T22:34:47.153724+0000 mgr.y (mgr.14592) 1064 : cluster 0 pgmap v1515: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:49.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:48 smithi050 bash[28929]: cluster 2024-05-20T22:34:47.153724+0000 mgr.y (mgr.14592) 1064 : cluster 0 pgmap v1515: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:49.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:34:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:34:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:34:51.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:50 smithi145 bash[23893]: audit 2024-05-20T22:34:48.991956+0000 mgr.y (mgr.14592) 1065 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:34:51.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:50 smithi145 bash[23893]: cluster 2024-05-20T22:34:49.154854+0000 mgr.y (mgr.14592) 1066 : cluster 0 pgmap v1516: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:51.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:50 smithi050 bash[21866]: audit 2024-05-20T22:34:48.991956+0000 mgr.y (mgr.14592) 1065 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:34:51.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:50 smithi050 bash[21866]: cluster 2024-05-20T22:34:49.154854+0000 mgr.y (mgr.14592) 1066 : cluster 0 pgmap v1516: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:51.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:50 smithi050 bash[28929]: audit 2024-05-20T22:34:48.991956+0000 mgr.y (mgr.14592) 1065 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:34:51.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:50 smithi050 bash[28929]: cluster 2024-05-20T22:34:49.154854+0000 mgr.y (mgr.14592) 1066 : cluster 0 pgmap v1516: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:53.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:52 smithi145 bash[23893]: cluster 2024-05-20T22:34:51.157847+0000 mgr.y (mgr.14592) 1067 : cluster 0 pgmap v1517: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:53.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:52 smithi050 bash[21866]: cluster 2024-05-20T22:34:51.157847+0000 mgr.y (mgr.14592) 1067 : cluster 0 pgmap v1517: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:53.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:52 smithi050 bash[28929]: cluster 2024-05-20T22:34:51.157847+0000 mgr.y (mgr.14592) 1067 : cluster 0 pgmap v1517: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:55.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:54 smithi145 bash[23893]: cluster 2024-05-20T22:34:53.158781+0000 mgr.y (mgr.14592) 1068 : cluster 0 pgmap v1518: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:55.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:54 smithi050 bash[21866]: cluster 2024-05-20T22:34:53.158781+0000 mgr.y (mgr.14592) 1068 : cluster 0 pgmap v1518: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:55.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:54 smithi050 bash[28929]: cluster 2024-05-20T22:34:53.158781+0000 mgr.y (mgr.14592) 1068 : cluster 0 pgmap v1518: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:56.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:55 smithi145 bash[23893]: audit 2024-05-20T22:34:55.257245+0000 mon.a (mon.0) 3766 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:34:56.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:55 smithi050 bash[28929]: audit 2024-05-20T22:34:55.257245+0000 mon.a (mon.0) 3766 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:34:56.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:55 smithi050 bash[21866]: audit 2024-05-20T22:34:55.257245+0000 mon.a (mon.0) 3766 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:34:57.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:56 smithi145 bash[23893]: cluster 2024-05-20T22:34:55.159799+0000 mgr.y (mgr.14592) 1069 : cluster 0 pgmap v1519: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:57.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:56 smithi050 bash[21866]: cluster 2024-05-20T22:34:55.159799+0000 mgr.y (mgr.14592) 1069 : cluster 0 pgmap v1519: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:57.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:56 smithi050 bash[28929]: cluster 2024-05-20T22:34:55.159799+0000 mgr.y (mgr.14592) 1069 : cluster 0 pgmap v1519: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:34:59.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:34:58 smithi145 bash[23893]: cluster 2024-05-20T22:34:57.162717+0000 mgr.y (mgr.14592) 1070 : cluster 0 pgmap v1520: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:59.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:34:59 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:34:59.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:34:58 smithi050 bash[21866]: cluster 2024-05-20T22:34:57.162717+0000 mgr.y (mgr.14592) 1070 : cluster 0 pgmap v1520: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:59.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:34:58 smithi050 bash[28929]: cluster 2024-05-20T22:34:57.162717+0000 mgr.y (mgr.14592) 1070 : cluster 0 pgmap v1520: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:34:59.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:34:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:34:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:35:01.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:00 smithi145 bash[23893]: audit 2024-05-20T22:34:59.003374+0000 mgr.y (mgr.14592) 1071 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:35:01.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:00 smithi145 bash[23893]: cluster 2024-05-20T22:34:59.163661+0000 mgr.y (mgr.14592) 1072 : cluster 0 pgmap v1521: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:01.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:00 smithi050 bash[21866]: audit 2024-05-20T22:34:59.003374+0000 mgr.y (mgr.14592) 1071 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:35:01.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:00 smithi050 bash[21866]: cluster 2024-05-20T22:34:59.163661+0000 mgr.y (mgr.14592) 1072 : cluster 0 pgmap v1521: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:01.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:00 smithi050 bash[28929]: audit 2024-05-20T22:34:59.003374+0000 mgr.y (mgr.14592) 1071 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:35:01.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:00 smithi050 bash[28929]: cluster 2024-05-20T22:34:59.163661+0000 mgr.y (mgr.14592) 1072 : cluster 0 pgmap v1521: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:03.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:02 smithi145 bash[23893]: cluster 2024-05-20T22:35:01.166623+0000 mgr.y (mgr.14592) 1073 : cluster 0 pgmap v1522: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:03.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:02 smithi050 bash[21866]: cluster 2024-05-20T22:35:01.166623+0000 mgr.y (mgr.14592) 1073 : cluster 0 pgmap v1522: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:03.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:02 smithi050 bash[28929]: cluster 2024-05-20T22:35:01.166623+0000 mgr.y (mgr.14592) 1073 : cluster 0 pgmap v1522: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:05.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:04 smithi145 bash[23893]: cluster 2024-05-20T22:35:03.167542+0000 mgr.y (mgr.14592) 1074 : cluster 0 pgmap v1523: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:05.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:04 smithi050 bash[21866]: cluster 2024-05-20T22:35:03.167542+0000 mgr.y (mgr.14592) 1074 : cluster 0 pgmap v1523: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:05.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:04 smithi050 bash[28929]: cluster 2024-05-20T22:35:03.167542+0000 mgr.y (mgr.14592) 1074 : cluster 0 pgmap v1523: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:07.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:06 smithi050 bash[21866]: cluster 2024-05-20T22:35:05.168469+0000 mgr.y (mgr.14592) 1075 : cluster 0 pgmap v1524: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:07.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:06 smithi050 bash[28929]: cluster 2024-05-20T22:35:05.168469+0000 mgr.y (mgr.14592) 1075 : cluster 0 pgmap v1524: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:07.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:06 smithi145 bash[23893]: cluster 2024-05-20T22:35:05.168469+0000 mgr.y (mgr.14592) 1075 : cluster 0 pgmap v1524: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:09.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:08 smithi050 bash[21866]: cluster 2024-05-20T22:35:07.171438+0000 mgr.y (mgr.14592) 1076 : cluster 0 pgmap v1525: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:09.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:08 smithi050 bash[28929]: cluster 2024-05-20T22:35:07.171438+0000 mgr.y (mgr.14592) 1076 : cluster 0 pgmap v1525: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:09.387 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:35:09 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:35:09.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:08 smithi145 bash[23893]: cluster 2024-05-20T22:35:07.171438+0000 mgr.y (mgr.14592) 1076 : cluster 0 pgmap v1525: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:09.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:35:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:35:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:35:11.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:10 smithi050 bash[28929]: audit 2024-05-20T22:35:09.014773+0000 mgr.y (mgr.14592) 1077 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:35:11.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:10 smithi050 bash[28929]: cluster 2024-05-20T22:35:09.172365+0000 mgr.y (mgr.14592) 1078 : cluster 0 pgmap v1526: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:11.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:10 smithi050 bash[28929]: audit 2024-05-20T22:35:10.289655+0000 mon.a (mon.0) 3767 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:35:11.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:10 smithi050 bash[21866]: audit 2024-05-20T22:35:09.014773+0000 mgr.y (mgr.14592) 1077 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:35:11.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:10 smithi050 bash[21866]: cluster 2024-05-20T22:35:09.172365+0000 mgr.y (mgr.14592) 1078 : cluster 0 pgmap v1526: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:11.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:10 smithi050 bash[21866]: audit 2024-05-20T22:35:10.289655+0000 mon.a (mon.0) 3767 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:35:11.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:10 smithi145 bash[23893]: audit 2024-05-20T22:35:09.014773+0000 mgr.y (mgr.14592) 1077 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:35:11.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:10 smithi145 bash[23893]: cluster 2024-05-20T22:35:09.172365+0000 mgr.y (mgr.14592) 1078 : cluster 0 pgmap v1526: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:11.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:10 smithi145 bash[23893]: audit 2024-05-20T22:35:10.289655+0000 mon.a (mon.0) 3767 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:35:13.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:12 smithi050 bash[21866]: cluster 2024-05-20T22:35:11.175370+0000 mgr.y (mgr.14592) 1079 : cluster 0 pgmap v1527: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:13.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:12 smithi050 bash[28929]: cluster 2024-05-20T22:35:11.175370+0000 mgr.y (mgr.14592) 1079 : cluster 0 pgmap v1527: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:13.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:12 smithi145 bash[23893]: cluster 2024-05-20T22:35:11.175370+0000 mgr.y (mgr.14592) 1079 : cluster 0 pgmap v1527: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:14.269 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.269 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.269 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.270 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.270 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.270 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.270 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.270 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.270 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.270 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.270 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.270 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.270 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.270 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.270 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.271 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.271 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.271 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.271 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.271 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.271 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.271 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.271 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.271 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.271 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.271 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.271 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.271 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.272 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.272 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.272 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.272 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.272 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.272 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.272 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.272 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.272 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.272 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.272 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.272 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:14.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:35:15.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:14 smithi050 bash[21866]: cluster 2024-05-20T22:35:13.176315+0000 mgr.y (mgr.14592) 1080 : cluster 0 pgmap v1528: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:15.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:14 smithi050 bash[28929]: cluster 2024-05-20T22:35:13.176315+0000 mgr.y (mgr.14592) 1080 : cluster 0 pgmap v1528: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:15.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:14 smithi145 bash[23893]: cluster 2024-05-20T22:35:13.176315+0000 mgr.y (mgr.14592) 1080 : cluster 0 pgmap v1528: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:17.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:16 smithi050 bash[21866]: cluster 2024-05-20T22:35:15.177188+0000 mgr.y (mgr.14592) 1081 : cluster 0 pgmap v1529: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:17.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:16 smithi050 bash[28929]: cluster 2024-05-20T22:35:15.177188+0000 mgr.y (mgr.14592) 1081 : cluster 0 pgmap v1529: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:17.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:16 smithi145 bash[23893]: cluster 2024-05-20T22:35:15.177188+0000 mgr.y (mgr.14592) 1081 : cluster 0 pgmap v1529: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:19.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:18 smithi050 bash[21866]: cluster 2024-05-20T22:35:17.180179+0000 mgr.y (mgr.14592) 1082 : cluster 0 pgmap v1530: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:19.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:18 smithi050 bash[28929]: cluster 2024-05-20T22:35:17.180179+0000 mgr.y (mgr.14592) 1082 : cluster 0 pgmap v1530: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:19.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:18 smithi145 bash[23893]: cluster 2024-05-20T22:35:17.180179+0000 mgr.y (mgr.14592) 1082 : cluster 0 pgmap v1530: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:19.387 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:35:19 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:35:19.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:35:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:35:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:35:21.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:20 smithi050 bash[21866]: audit 2024-05-20T22:35:19.026263+0000 mgr.y (mgr.14592) 1083 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:35:21.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:20 smithi050 bash[21866]: cluster 2024-05-20T22:35:19.181217+0000 mgr.y (mgr.14592) 1084 : cluster 0 pgmap v1531: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:21.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:20 smithi050 bash[28929]: audit 2024-05-20T22:35:19.026263+0000 mgr.y (mgr.14592) 1083 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:35:21.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:20 smithi050 bash[28929]: cluster 2024-05-20T22:35:19.181217+0000 mgr.y (mgr.14592) 1084 : cluster 0 pgmap v1531: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:21.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:20 smithi145 bash[23893]: audit 2024-05-20T22:35:19.026263+0000 mgr.y (mgr.14592) 1083 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:35:21.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:20 smithi145 bash[23893]: cluster 2024-05-20T22:35:19.181217+0000 mgr.y (mgr.14592) 1084 : cluster 0 pgmap v1531: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:23.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:22 smithi050 bash[21866]: cluster 2024-05-20T22:35:21.184236+0000 mgr.y (mgr.14592) 1085 : cluster 0 pgmap v1532: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:23.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:22 smithi050 bash[28929]: cluster 2024-05-20T22:35:21.184236+0000 mgr.y (mgr.14592) 1085 : cluster 0 pgmap v1532: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:23.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:22 smithi145 bash[23893]: cluster 2024-05-20T22:35:21.184236+0000 mgr.y (mgr.14592) 1085 : cluster 0 pgmap v1532: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:25.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:24 smithi050 bash[21866]: cluster 2024-05-20T22:35:23.185128+0000 mgr.y (mgr.14592) 1086 : cluster 0 pgmap v1533: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:25.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:24 smithi050 bash[28929]: cluster 2024-05-20T22:35:23.185128+0000 mgr.y (mgr.14592) 1086 : cluster 0 pgmap v1533: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:25.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:24 smithi145 bash[23893]: cluster 2024-05-20T22:35:23.185128+0000 mgr.y (mgr.14592) 1086 : cluster 0 pgmap v1533: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:26.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:25 smithi050 bash[21866]: audit 2024-05-20T22:35:24.933366+0000 mon.a (mon.0) 3768 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:35:26.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:25 smithi050 bash[21866]: audit 2024-05-20T22:35:25.321811+0000 mon.a (mon.0) 3769 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:35:26.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:25 smithi050 bash[21866]: audit 2024-05-20T22:35:25.637680+0000 mon.a (mon.0) 3770 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:35:26.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:25 smithi050 bash[21866]: audit 2024-05-20T22:35:25.638615+0000 mon.a (mon.0) 3771 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:35:26.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:25 smithi050 bash[21866]: audit 2024-05-20T22:35:25.645071+0000 mon.a (mon.0) 3772 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:35:26.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:25 smithi050 bash[28929]: audit 2024-05-20T22:35:24.933366+0000 mon.a (mon.0) 3768 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:35:26.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:25 smithi050 bash[28929]: audit 2024-05-20T22:35:25.321811+0000 mon.a (mon.0) 3769 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:35:26.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:25 smithi050 bash[28929]: audit 2024-05-20T22:35:25.637680+0000 mon.a (mon.0) 3770 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:35:26.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:25 smithi050 bash[28929]: audit 2024-05-20T22:35:25.638615+0000 mon.a (mon.0) 3771 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:35:26.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:25 smithi050 bash[28929]: audit 2024-05-20T22:35:25.645071+0000 mon.a (mon.0) 3772 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:35:26.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:25 smithi145 bash[23893]: audit 2024-05-20T22:35:24.933366+0000 mon.a (mon.0) 3768 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:35:26.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:25 smithi145 bash[23893]: audit 2024-05-20T22:35:25.321811+0000 mon.a (mon.0) 3769 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:35:26.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:25 smithi145 bash[23893]: audit 2024-05-20T22:35:25.637680+0000 mon.a (mon.0) 3770 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:35:26.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:25 smithi145 bash[23893]: audit 2024-05-20T22:35:25.638615+0000 mon.a (mon.0) 3771 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:35:26.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:25 smithi145 bash[23893]: audit 2024-05-20T22:35:25.645071+0000 mon.a (mon.0) 3772 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:35:27.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:26 smithi050 bash[21866]: cluster 2024-05-20T22:35:25.185993+0000 mgr.y (mgr.14592) 1087 : cluster 0 pgmap v1534: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:27.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:26 smithi050 bash[28929]: cluster 2024-05-20T22:35:25.185993+0000 mgr.y (mgr.14592) 1087 : cluster 0 pgmap v1534: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:27.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:26 smithi145 bash[23893]: cluster 2024-05-20T22:35:25.185993+0000 mgr.y (mgr.14592) 1087 : cluster 0 pgmap v1534: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:29.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:28 smithi145 bash[23893]: cluster 2024-05-20T22:35:27.188871+0000 mgr.y (mgr.14592) 1088 : cluster 0 pgmap v1535: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:29.387 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:35:29 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:35:29.389 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:28 smithi050 bash[21866]: cluster 2024-05-20T22:35:27.188871+0000 mgr.y (mgr.14592) 1088 : cluster 0 pgmap v1535: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:29.389 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:28 smithi050 bash[28929]: cluster 2024-05-20T22:35:27.188871+0000 mgr.y (mgr.14592) 1088 : cluster 0 pgmap v1535: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:29.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:35:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:35:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:35:31.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:30 smithi145 bash[23893]: audit 2024-05-20T22:35:29.037677+0000 mgr.y (mgr.14592) 1089 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:35:31.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:30 smithi145 bash[23893]: cluster 2024-05-20T22:35:29.189771+0000 mgr.y (mgr.14592) 1090 : cluster 0 pgmap v1536: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:31.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:30 smithi050 bash[21866]: audit 2024-05-20T22:35:29.037677+0000 mgr.y (mgr.14592) 1089 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:35:31.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:30 smithi050 bash[21866]: cluster 2024-05-20T22:35:29.189771+0000 mgr.y (mgr.14592) 1090 : cluster 0 pgmap v1536: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:31.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:30 smithi050 bash[28929]: audit 2024-05-20T22:35:29.037677+0000 mgr.y (mgr.14592) 1089 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:35:31.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:30 smithi050 bash[28929]: cluster 2024-05-20T22:35:29.189771+0000 mgr.y (mgr.14592) 1090 : cluster 0 pgmap v1536: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:33.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:32 smithi145 bash[23893]: cluster 2024-05-20T22:35:31.192735+0000 mgr.y (mgr.14592) 1091 : cluster 0 pgmap v1537: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:33.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:32 smithi050 bash[21866]: cluster 2024-05-20T22:35:31.192735+0000 mgr.y (mgr.14592) 1091 : cluster 0 pgmap v1537: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:33.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:32 smithi050 bash[28929]: cluster 2024-05-20T22:35:31.192735+0000 mgr.y (mgr.14592) 1091 : cluster 0 pgmap v1537: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:35.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:34 smithi145 bash[23893]: cluster 2024-05-20T22:35:33.193642+0000 mgr.y (mgr.14592) 1092 : cluster 0 pgmap v1538: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:35.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:34 smithi050 bash[21866]: cluster 2024-05-20T22:35:33.193642+0000 mgr.y (mgr.14592) 1092 : cluster 0 pgmap v1538: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:35.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:34 smithi050 bash[28929]: cluster 2024-05-20T22:35:33.193642+0000 mgr.y (mgr.14592) 1092 : cluster 0 pgmap v1538: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:36.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:35 smithi145 bash[23893]: cluster 2024-05-20T22:35:35.194578+0000 mgr.y (mgr.14592) 1093 : cluster 0 pgmap v1539: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:36.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:35 smithi050 bash[21866]: cluster 2024-05-20T22:35:35.194578+0000 mgr.y (mgr.14592) 1093 : cluster 0 pgmap v1539: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:36.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:35 smithi050 bash[28929]: cluster 2024-05-20T22:35:35.194578+0000 mgr.y (mgr.14592) 1093 : cluster 0 pgmap v1539: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:38.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:38 smithi145 bash[23893]: cluster 2024-05-20T22:35:37.197552+0000 mgr.y (mgr.14592) 1094 : cluster 0 pgmap v1540: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:38.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:38 smithi050 bash[21866]: cluster 2024-05-20T22:35:37.197552+0000 mgr.y (mgr.14592) 1094 : cluster 0 pgmap v1540: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:38.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:38 smithi050 bash[28929]: cluster 2024-05-20T22:35:37.197552+0000 mgr.y (mgr.14592) 1094 : cluster 0 pgmap v1540: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:39.387 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:35:39 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:35:39.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:35:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:35:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:35:40.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:40 smithi145 bash[23893]: audit 2024-05-20T22:35:39.043055+0000 mgr.y (mgr.14592) 1095 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:35:40.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:40 smithi145 bash[23893]: cluster 2024-05-20T22:35:39.198449+0000 mgr.y (mgr.14592) 1096 : cluster 0 pgmap v1541: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:40.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:40 smithi050 bash[21866]: audit 2024-05-20T22:35:39.043055+0000 mgr.y (mgr.14592) 1095 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:35:40.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:40 smithi050 bash[21866]: cluster 2024-05-20T22:35:39.198449+0000 mgr.y (mgr.14592) 1096 : cluster 0 pgmap v1541: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:40.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:40 smithi050 bash[28929]: audit 2024-05-20T22:35:39.043055+0000 mgr.y (mgr.14592) 1095 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:35:40.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:40 smithi050 bash[28929]: cluster 2024-05-20T22:35:39.198449+0000 mgr.y (mgr.14592) 1096 : cluster 0 pgmap v1541: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:41.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:41 smithi145 bash[23893]: audit 2024-05-20T22:35:40.353097+0000 mon.a (mon.0) 3773 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:35:41.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:41 smithi050 bash[21866]: audit 2024-05-20T22:35:40.353097+0000 mon.a (mon.0) 3773 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:35:41.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:41 smithi050 bash[28929]: audit 2024-05-20T22:35:40.353097+0000 mon.a (mon.0) 3773 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:35:42.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:42 smithi145 bash[23893]: cluster 2024-05-20T22:35:41.201550+0000 mgr.y (mgr.14592) 1097 : cluster 0 pgmap v1542: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:42.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:42 smithi050 bash[21866]: cluster 2024-05-20T22:35:41.201550+0000 mgr.y (mgr.14592) 1097 : cluster 0 pgmap v1542: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:42.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:42 smithi050 bash[28929]: cluster 2024-05-20T22:35:41.201550+0000 mgr.y (mgr.14592) 1097 : cluster 0 pgmap v1542: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:44.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:44 smithi145 bash[23893]: cluster 2024-05-20T22:35:43.202741+0000 mgr.y (mgr.14592) 1098 : cluster 0 pgmap v1543: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:44.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:44 smithi050 bash[21866]: cluster 2024-05-20T22:35:43.202741+0000 mgr.y (mgr.14592) 1098 : cluster 0 pgmap v1543: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:44.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:44 smithi050 bash[28929]: cluster 2024-05-20T22:35:43.202741+0000 mgr.y (mgr.14592) 1098 : cluster 0 pgmap v1543: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:46.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:46 smithi145 bash[23893]: cluster 2024-05-20T22:35:45.203953+0000 mgr.y (mgr.14592) 1099 : cluster 0 pgmap v1544: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:46.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:46 smithi050 bash[28929]: cluster 2024-05-20T22:35:45.203953+0000 mgr.y (mgr.14592) 1099 : cluster 0 pgmap v1544: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:46.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:46 smithi050 bash[21866]: cluster 2024-05-20T22:35:45.203953+0000 mgr.y (mgr.14592) 1099 : cluster 0 pgmap v1544: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:48.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:48 smithi145 bash[23893]: cluster 2024-05-20T22:35:47.206724+0000 mgr.y (mgr.14592) 1100 : cluster 0 pgmap v1545: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:48.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:48 smithi050 bash[21866]: cluster 2024-05-20T22:35:47.206724+0000 mgr.y (mgr.14592) 1100 : cluster 0 pgmap v1545: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:48.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:48 smithi050 bash[28929]: cluster 2024-05-20T22:35:47.206724+0000 mgr.y (mgr.14592) 1100 : cluster 0 pgmap v1545: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:49.387 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:35:49 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:35:49.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:35:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:35:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:35:50.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:50 smithi145 bash[23893]: audit 2024-05-20T22:35:49.054421+0000 mgr.y (mgr.14592) 1101 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:35:50.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:50 smithi145 bash[23893]: cluster 2024-05-20T22:35:49.207660+0000 mgr.y (mgr.14592) 1102 : cluster 0 pgmap v1546: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:50.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:50 smithi050 bash[21866]: audit 2024-05-20T22:35:49.054421+0000 mgr.y (mgr.14592) 1101 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:35:50.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:50 smithi050 bash[21866]: cluster 2024-05-20T22:35:49.207660+0000 mgr.y (mgr.14592) 1102 : cluster 0 pgmap v1546: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:50.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:50 smithi050 bash[28929]: audit 2024-05-20T22:35:49.054421+0000 mgr.y (mgr.14592) 1101 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:35:50.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:50 smithi050 bash[28929]: cluster 2024-05-20T22:35:49.207660+0000 mgr.y (mgr.14592) 1102 : cluster 0 pgmap v1546: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:52.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:52 smithi145 bash[23893]: cluster 2024-05-20T22:35:51.210614+0000 mgr.y (mgr.14592) 1103 : cluster 0 pgmap v1547: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:52.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:52 smithi050 bash[21866]: cluster 2024-05-20T22:35:51.210614+0000 mgr.y (mgr.14592) 1103 : cluster 0 pgmap v1547: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:52.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:52 smithi050 bash[28929]: cluster 2024-05-20T22:35:51.210614+0000 mgr.y (mgr.14592) 1103 : cluster 0 pgmap v1547: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:54.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:54 smithi145 bash[23893]: cluster 2024-05-20T22:35:53.211622+0000 mgr.y (mgr.14592) 1104 : cluster 0 pgmap v1548: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:54.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:54 smithi050 bash[21866]: cluster 2024-05-20T22:35:53.211622+0000 mgr.y (mgr.14592) 1104 : cluster 0 pgmap v1548: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:54.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:54 smithi050 bash[28929]: cluster 2024-05-20T22:35:53.211622+0000 mgr.y (mgr.14592) 1104 : cluster 0 pgmap v1548: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:56.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:56 smithi145 bash[23893]: cluster 2024-05-20T22:35:55.212924+0000 mgr.y (mgr.14592) 1105 : cluster 0 pgmap v1549: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:56.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:56 smithi145 bash[23893]: audit 2024-05-20T22:35:55.386063+0000 mon.a (mon.0) 3774 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:35:56.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:56 smithi050 bash[21866]: cluster 2024-05-20T22:35:55.212924+0000 mgr.y (mgr.14592) 1105 : cluster 0 pgmap v1549: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:56.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:56 smithi050 bash[21866]: audit 2024-05-20T22:35:55.386063+0000 mon.a (mon.0) 3774 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:35:56.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:56 smithi050 bash[28929]: cluster 2024-05-20T22:35:55.212924+0000 mgr.y (mgr.14592) 1105 : cluster 0 pgmap v1549: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:35:56.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:56 smithi050 bash[28929]: audit 2024-05-20T22:35:55.386063+0000 mon.a (mon.0) 3774 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:35:58.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:35:58 smithi145 bash[23893]: cluster 2024-05-20T22:35:57.215849+0000 mgr.y (mgr.14592) 1106 : cluster 0 pgmap v1550: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:58.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:35:58 smithi050 bash[21866]: cluster 2024-05-20T22:35:57.215849+0000 mgr.y (mgr.14592) 1106 : cluster 0 pgmap v1550: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:58.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:35:58 smithi050 bash[28929]: cluster 2024-05-20T22:35:57.215849+0000 mgr.y (mgr.14592) 1106 : cluster 0 pgmap v1550: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:35:59.387 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:35:59 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:35:59.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:35:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:35:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:36:00.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:00 smithi145 bash[23893]: audit 2024-05-20T22:35:59.065719+0000 mgr.y (mgr.14592) 1107 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:36:00.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:00 smithi145 bash[23893]: cluster 2024-05-20T22:35:59.216805+0000 mgr.y (mgr.14592) 1108 : cluster 0 pgmap v1551: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:00.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:00 smithi050 bash[21866]: audit 2024-05-20T22:35:59.065719+0000 mgr.y (mgr.14592) 1107 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:36:00.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:00 smithi050 bash[21866]: cluster 2024-05-20T22:35:59.216805+0000 mgr.y (mgr.14592) 1108 : cluster 0 pgmap v1551: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:00.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:00 smithi050 bash[28929]: audit 2024-05-20T22:35:59.065719+0000 mgr.y (mgr.14592) 1107 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:36:00.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:00 smithi050 bash[28929]: cluster 2024-05-20T22:35:59.216805+0000 mgr.y (mgr.14592) 1108 : cluster 0 pgmap v1551: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:02.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:02 smithi145 bash[23893]: cluster 2024-05-20T22:36:01.219918+0000 mgr.y (mgr.14592) 1109 : cluster 0 pgmap v1552: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:02.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:02 smithi050 bash[21866]: cluster 2024-05-20T22:36:01.219918+0000 mgr.y (mgr.14592) 1109 : cluster 0 pgmap v1552: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:02.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:02 smithi050 bash[28929]: cluster 2024-05-20T22:36:01.219918+0000 mgr.y (mgr.14592) 1109 : cluster 0 pgmap v1552: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:04.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:04 smithi145 bash[23893]: cluster 2024-05-20T22:36:03.220940+0000 mgr.y (mgr.14592) 1110 : cluster 0 pgmap v1553: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:04.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:04 smithi050 bash[21866]: cluster 2024-05-20T22:36:03.220940+0000 mgr.y (mgr.14592) 1110 : cluster 0 pgmap v1553: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:04.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:04 smithi050 bash[28929]: cluster 2024-05-20T22:36:03.220940+0000 mgr.y (mgr.14592) 1110 : cluster 0 pgmap v1553: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:06.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:06 smithi145 bash[23893]: cluster 2024-05-20T22:36:05.222599+0000 mgr.y (mgr.14592) 1111 : cluster 0 pgmap v1554: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:06.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:06 smithi050 bash[21866]: cluster 2024-05-20T22:36:05.222599+0000 mgr.y (mgr.14592) 1111 : cluster 0 pgmap v1554: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:06.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:06 smithi050 bash[28929]: cluster 2024-05-20T22:36:05.222599+0000 mgr.y (mgr.14592) 1111 : cluster 0 pgmap v1554: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:08.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:08 smithi145 bash[23893]: cluster 2024-05-20T22:36:07.224987+0000 mgr.y (mgr.14592) 1112 : cluster 0 pgmap v1555: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:08.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:08 smithi050 bash[21866]: cluster 2024-05-20T22:36:07.224987+0000 mgr.y (mgr.14592) 1112 : cluster 0 pgmap v1555: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:08.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:08 smithi050 bash[28929]: cluster 2024-05-20T22:36:07.224987+0000 mgr.y (mgr.14592) 1112 : cluster 0 pgmap v1555: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:09.387 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:36:09 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:36:09.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:36:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:36:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:36:10.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:10 smithi145 bash[23893]: audit 2024-05-20T22:36:09.077125+0000 mgr.y (mgr.14592) 1113 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:36:10.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:10 smithi145 bash[23893]: cluster 2024-05-20T22:36:09.226107+0000 mgr.y (mgr.14592) 1114 : cluster 0 pgmap v1556: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:10.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:10 smithi050 bash[21866]: audit 2024-05-20T22:36:09.077125+0000 mgr.y (mgr.14592) 1113 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:36:10.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:10 smithi050 bash[21866]: cluster 2024-05-20T22:36:09.226107+0000 mgr.y (mgr.14592) 1114 : cluster 0 pgmap v1556: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:10.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:10 smithi050 bash[28929]: audit 2024-05-20T22:36:09.077125+0000 mgr.y (mgr.14592) 1113 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:36:10.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:10 smithi050 bash[28929]: cluster 2024-05-20T22:36:09.226107+0000 mgr.y (mgr.14592) 1114 : cluster 0 pgmap v1556: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:11.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:11 smithi145 bash[23893]: audit 2024-05-20T22:36:10.418298+0000 mon.a (mon.0) 3775 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:36:11.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:11 smithi050 bash[28929]: audit 2024-05-20T22:36:10.418298+0000 mon.a (mon.0) 3775 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:36:11.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:11 smithi050 bash[21866]: audit 2024-05-20T22:36:10.418298+0000 mon.a (mon.0) 3775 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:36:12.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:12 smithi145 bash[23893]: cluster 2024-05-20T22:36:11.229093+0000 mgr.y (mgr.14592) 1115 : cluster 0 pgmap v1557: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:12.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:12 smithi050 bash[21866]: cluster 2024-05-20T22:36:11.229093+0000 mgr.y (mgr.14592) 1115 : cluster 0 pgmap v1557: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:12.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:12 smithi050 bash[28929]: cluster 2024-05-20T22:36:11.229093+0000 mgr.y (mgr.14592) 1115 : cluster 0 pgmap v1557: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:14.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:14 smithi145 bash[23893]: cluster 2024-05-20T22:36:13.230003+0000 mgr.y (mgr.14592) 1116 : cluster 0 pgmap v1558: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:14.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:14 smithi050 bash[21866]: cluster 2024-05-20T22:36:13.230003+0000 mgr.y (mgr.14592) 1116 : cluster 0 pgmap v1558: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:14.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:14 smithi050 bash[28929]: cluster 2024-05-20T22:36:13.230003+0000 mgr.y (mgr.14592) 1116 : cluster 0 pgmap v1558: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:16.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:16 smithi145 bash[23893]: cluster 2024-05-20T22:36:15.232203+0000 mgr.y (mgr.14592) 1117 : cluster 0 pgmap v1559: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:16.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:16 smithi050 bash[21866]: cluster 2024-05-20T22:36:15.232203+0000 mgr.y (mgr.14592) 1117 : cluster 0 pgmap v1559: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:16.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:16 smithi050 bash[28929]: cluster 2024-05-20T22:36:15.232203+0000 mgr.y (mgr.14592) 1117 : cluster 0 pgmap v1559: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:18.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:18 smithi145 bash[23893]: cluster 2024-05-20T22:36:17.234185+0000 mgr.y (mgr.14592) 1118 : cluster 0 pgmap v1560: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:18.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:18 smithi050 bash[28929]: cluster 2024-05-20T22:36:17.234185+0000 mgr.y (mgr.14592) 1118 : cluster 0 pgmap v1560: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:18.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:18 smithi050 bash[21866]: cluster 2024-05-20T22:36:17.234185+0000 mgr.y (mgr.14592) 1118 : cluster 0 pgmap v1560: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:19.387 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:36:19 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:36:19.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:36:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:36:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:36:20.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:20 smithi145 bash[23893]: audit 2024-05-20T22:36:19.088479+0000 mgr.y (mgr.14592) 1119 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:36:20.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:20 smithi145 bash[23893]: cluster 2024-05-20T22:36:19.235070+0000 mgr.y (mgr.14592) 1120 : cluster 0 pgmap v1561: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:20.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:20 smithi050 bash[21866]: audit 2024-05-20T22:36:19.088479+0000 mgr.y (mgr.14592) 1119 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:36:20.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:20 smithi050 bash[21866]: cluster 2024-05-20T22:36:19.235070+0000 mgr.y (mgr.14592) 1120 : cluster 0 pgmap v1561: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:20.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:20 smithi050 bash[28929]: audit 2024-05-20T22:36:19.088479+0000 mgr.y (mgr.14592) 1119 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:36:20.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:20 smithi050 bash[28929]: cluster 2024-05-20T22:36:19.235070+0000 mgr.y (mgr.14592) 1120 : cluster 0 pgmap v1561: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:22.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:22 smithi145 bash[23893]: cluster 2024-05-20T22:36:21.237972+0000 mgr.y (mgr.14592) 1121 : cluster 0 pgmap v1562: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:22.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:22 smithi050 bash[21866]: cluster 2024-05-20T22:36:21.237972+0000 mgr.y (mgr.14592) 1121 : cluster 0 pgmap v1562: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:22.742 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:22 smithi050 bash[28929]: cluster 2024-05-20T22:36:21.237972+0000 mgr.y (mgr.14592) 1121 : cluster 0 pgmap v1562: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:24.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:24 smithi145 bash[23893]: cluster 2024-05-20T22:36:23.238859+0000 mgr.y (mgr.14592) 1122 : cluster 0 pgmap v1563: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:24.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:24 smithi050 bash[21866]: cluster 2024-05-20T22:36:23.238859+0000 mgr.y (mgr.14592) 1122 : cluster 0 pgmap v1563: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:24.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:24 smithi050 bash[28929]: cluster 2024-05-20T22:36:23.238859+0000 mgr.y (mgr.14592) 1122 : cluster 0 pgmap v1563: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:26.636 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:26 smithi145 bash[23893]: cluster 2024-05-20T22:36:25.241528+0000 mgr.y (mgr.14592) 1123 : cluster 0 pgmap v1564: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:26.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:26 smithi145 bash[23893]: audit 2024-05-20T22:36:25.451776+0000 mon.a (mon.0) 3776 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:36:26.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:26 smithi145 bash[23893]: audit 2024-05-20T22:36:25.725190+0000 mon.a (mon.0) 3777 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:36:26.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:26 smithi050 bash[21866]: cluster 2024-05-20T22:36:25.241528+0000 mgr.y (mgr.14592) 1123 : cluster 0 pgmap v1564: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:26.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:26 smithi050 bash[21866]: audit 2024-05-20T22:36:25.451776+0000 mon.a (mon.0) 3776 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:36:26.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:26 smithi050 bash[21866]: audit 2024-05-20T22:36:25.725190+0000 mon.a (mon.0) 3777 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:36:26.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:26 smithi050 bash[28929]: cluster 2024-05-20T22:36:25.241528+0000 mgr.y (mgr.14592) 1123 : cluster 0 pgmap v1564: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:26.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:26 smithi050 bash[28929]: audit 2024-05-20T22:36:25.451776+0000 mon.a (mon.0) 3776 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:36:26.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:26 smithi050 bash[28929]: audit 2024-05-20T22:36:25.725190+0000 mon.a (mon.0) 3777 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:36:28.636 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:28 smithi145 bash[23893]: cluster 2024-05-20T22:36:27.242828+0000 mgr.y (mgr.14592) 1124 : cluster 0 pgmap v1565: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:28.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:28 smithi050 bash[21866]: cluster 2024-05-20T22:36:27.242828+0000 mgr.y (mgr.14592) 1124 : cluster 0 pgmap v1565: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:28.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:28 smithi050 bash[28929]: cluster 2024-05-20T22:36:27.242828+0000 mgr.y (mgr.14592) 1124 : cluster 0 pgmap v1565: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:29.386 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:36:29 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:36:29.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:36:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:36:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:36:30.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:30 smithi145 bash[23893]: audit 2024-05-20T22:36:29.098919+0000 mgr.y (mgr.14592) 1125 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:36:30.637 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:30 smithi145 bash[23893]: cluster 2024-05-20T22:36:29.243701+0000 mgr.y (mgr.14592) 1126 : cluster 0 pgmap v1566: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:30.689 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:30 smithi050 bash[21866]: audit 2024-05-20T22:36:29.098919+0000 mgr.y (mgr.14592) 1125 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:36:30.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:30 smithi050 bash[21866]: cluster 2024-05-20T22:36:29.243701+0000 mgr.y (mgr.14592) 1126 : cluster 0 pgmap v1566: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:30.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:30 smithi050 bash[28929]: audit 2024-05-20T22:36:29.098919+0000 mgr.y (mgr.14592) 1125 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:36:30.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:30 smithi050 bash[28929]: cluster 2024-05-20T22:36:29.243701+0000 mgr.y (mgr.14592) 1126 : cluster 0 pgmap v1566: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:32.636 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:32 smithi145 bash[23893]: cluster 2024-05-20T22:36:31.246673+0000 mgr.y (mgr.14592) 1127 : cluster 0 pgmap v1567: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:32.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:32 smithi050 bash[21866]: cluster 2024-05-20T22:36:31.246673+0000 mgr.y (mgr.14592) 1127 : cluster 0 pgmap v1567: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:32.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:32 smithi050 bash[28929]: cluster 2024-05-20T22:36:31.246673+0000 mgr.y (mgr.14592) 1127 : cluster 0 pgmap v1567: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:34.636 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:34 smithi145 bash[23893]: cluster 2024-05-20T22:36:33.247647+0000 mgr.y (mgr.14592) 1128 : cluster 0 pgmap v1568: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:34.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:34 smithi050 bash[21866]: cluster 2024-05-20T22:36:33.247647+0000 mgr.y (mgr.14592) 1128 : cluster 0 pgmap v1568: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:34.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:34 smithi050 bash[28929]: cluster 2024-05-20T22:36:33.247647+0000 mgr.y (mgr.14592) 1128 : cluster 0 pgmap v1568: 324 pgs: 324 active+clean; 583 KiB data, 706 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:36.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:36 smithi050 bash[21866]: cluster 2024-05-20T22:36:35.250429+0000 mgr.y (mgr.14592) 1129 : cluster 0 pgmap v1569: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:36:36.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:36 smithi050 bash[21866]: audit 2024-05-20T22:36:35.659774+0000 mon.a (mon.0) 3778 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:36:36.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:36 smithi050 bash[21866]: audit 2024-05-20T22:36:35.669969+0000 mon.a (mon.0) 3779 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:36:36.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:36 smithi050 bash[21866]: audit 2024-05-20T22:36:35.672152+0000 mon.a (mon.0) 3780 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:36:36.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:36 smithi050 bash[21866]: audit 2024-05-20T22:36:35.673906+0000 mon.a (mon.0) 3781 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:36:36.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:36 smithi050 bash[21866]: audit 2024-05-20T22:36:35.684037+0000 mon.a (mon.0) 3782 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:36:36.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:36 smithi050 bash[28929]: cluster 2024-05-20T22:36:35.250429+0000 mgr.y (mgr.14592) 1129 : cluster 0 pgmap v1569: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:36:36.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:36 smithi050 bash[28929]: audit 2024-05-20T22:36:35.659774+0000 mon.a (mon.0) 3778 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:36:36.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:36 smithi050 bash[28929]: audit 2024-05-20T22:36:35.669969+0000 mon.a (mon.0) 3779 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:36:36.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:36 smithi050 bash[28929]: audit 2024-05-20T22:36:35.672152+0000 mon.a (mon.0) 3780 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:36:36.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:36 smithi050 bash[28929]: audit 2024-05-20T22:36:35.673906+0000 mon.a (mon.0) 3781 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:36:36.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:36 smithi050 bash[28929]: audit 2024-05-20T22:36:35.684037+0000 mon.a (mon.0) 3782 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:36:37.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:36 smithi145 bash[23893]: cluster 2024-05-20T22:36:35.250429+0000 mgr.y (mgr.14592) 1129 : cluster 0 pgmap v1569: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:36:37.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:36 smithi145 bash[23893]: audit 2024-05-20T22:36:35.659774+0000 mon.a (mon.0) 3778 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:36:37.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:36 smithi145 bash[23893]: audit 2024-05-20T22:36:35.669969+0000 mon.a (mon.0) 3779 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:36:37.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:36 smithi145 bash[23893]: audit 2024-05-20T22:36:35.672152+0000 mon.a (mon.0) 3780 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:36:37.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:36 smithi145 bash[23893]: audit 2024-05-20T22:36:35.673906+0000 mon.a (mon.0) 3781 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:36:37.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:36 smithi145 bash[23893]: audit 2024-05-20T22:36:35.684037+0000 mon.a (mon.0) 3782 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:36:38.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:38 smithi050 bash[21866]: cluster 2024-05-20T22:36:37.251360+0000 mgr.y (mgr.14592) 1130 : cluster 0 pgmap v1570: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:36:38.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:38 smithi050 bash[28929]: cluster 2024-05-20T22:36:37.251360+0000 mgr.y (mgr.14592) 1130 : cluster 0 pgmap v1570: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:36:39.098 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:38 smithi145 bash[23893]: cluster 2024-05-20T22:36:37.251360+0000 mgr.y (mgr.14592) 1130 : cluster 0 pgmap v1570: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:36:39.386 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:36:39 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:36:39.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:36:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:36:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:36:40.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:40 smithi050 bash[21866]: audit 2024-05-20T22:36:39.106748+0000 mgr.y (mgr.14592) 1131 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:36:40.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:40 smithi050 bash[21866]: cluster 2024-05-20T22:36:39.252314+0000 mgr.y (mgr.14592) 1132 : cluster 0 pgmap v1571: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:36:40.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:40 smithi050 bash[21866]: audit 2024-05-20T22:36:40.483415+0000 mon.a (mon.0) 3783 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:36:40.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:40 smithi050 bash[28929]: audit 2024-05-20T22:36:39.106748+0000 mgr.y (mgr.14592) 1131 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:36:40.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:40 smithi050 bash[28929]: cluster 2024-05-20T22:36:39.252314+0000 mgr.y (mgr.14592) 1132 : cluster 0 pgmap v1571: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:36:40.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:40 smithi050 bash[28929]: audit 2024-05-20T22:36:40.483415+0000 mon.a (mon.0) 3783 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:36:41.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:40 smithi145 bash[23893]: audit 2024-05-20T22:36:39.106748+0000 mgr.y (mgr.14592) 1131 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:36:41.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:40 smithi145 bash[23893]: cluster 2024-05-20T22:36:39.252314+0000 mgr.y (mgr.14592) 1132 : cluster 0 pgmap v1571: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:36:41.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:40 smithi145 bash[23893]: audit 2024-05-20T22:36:40.483415+0000 mon.a (mon.0) 3783 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:36:42.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:42 smithi050 bash[21866]: cluster 2024-05-20T22:36:41.255203+0000 mgr.y (mgr.14592) 1133 : cluster 0 pgmap v1572: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:36:42.942 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:42 smithi050 bash[28929]: cluster 2024-05-20T22:36:41.255203+0000 mgr.y (mgr.14592) 1133 : cluster 0 pgmap v1572: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:36:43.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:42 smithi145 bash[23893]: cluster 2024-05-20T22:36:41.255203+0000 mgr.y (mgr.14592) 1133 : cluster 0 pgmap v1572: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:36:44.939 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:44 smithi050 bash[21866]: cluster 2024-05-20T22:36:43.256171+0000 mgr.y (mgr.14592) 1134 : cluster 0 pgmap v1573: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:36:44.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:44 smithi050 bash[28929]: cluster 2024-05-20T22:36:43.256171+0000 mgr.y (mgr.14592) 1134 : cluster 0 pgmap v1573: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:36:45.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:44 smithi145 bash[23893]: cluster 2024-05-20T22:36:43.256171+0000 mgr.y (mgr.14592) 1134 : cluster 0 pgmap v1573: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:36:46.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:46 smithi050 bash[21866]: cluster 2024-05-20T22:36:45.258951+0000 mgr.y (mgr.14592) 1135 : cluster 0 pgmap v1574: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:36:46.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:46 smithi050 bash[28929]: cluster 2024-05-20T22:36:45.258951+0000 mgr.y (mgr.14592) 1135 : cluster 0 pgmap v1574: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:36:47.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:46 smithi145 bash[23893]: cluster 2024-05-20T22:36:45.258951+0000 mgr.y (mgr.14592) 1135 : cluster 0 pgmap v1574: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-20T22:36:48.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:48 smithi050 bash[21866]: cluster 2024-05-20T22:36:47.259907+0000 mgr.y (mgr.14592) 1136 : cluster 0 pgmap v1575: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:48.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:48 smithi050 bash[28929]: cluster 2024-05-20T22:36:47.259907+0000 mgr.y (mgr.14592) 1136 : cluster 0 pgmap v1575: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:49.109 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:48 smithi145 bash[23893]: cluster 2024-05-20T22:36:47.259907+0000 mgr.y (mgr.14592) 1136 : cluster 0 pgmap v1575: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:49.386 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:36:49 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:36:49.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:36:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:36:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:36:50.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:50 smithi050 bash[28929]: audit 2024-05-20T22:36:49.118092+0000 mgr.y (mgr.14592) 1137 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:36:50.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:50 smithi050 bash[28929]: cluster 2024-05-20T22:36:49.260762+0000 mgr.y (mgr.14592) 1138 : cluster 0 pgmap v1576: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:50.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:50 smithi050 bash[21866]: audit 2024-05-20T22:36:49.118092+0000 mgr.y (mgr.14592) 1137 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:36:50.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:50 smithi050 bash[21866]: cluster 2024-05-20T22:36:49.260762+0000 mgr.y (mgr.14592) 1138 : cluster 0 pgmap v1576: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:51.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:50 smithi145 bash[23893]: audit 2024-05-20T22:36:49.118092+0000 mgr.y (mgr.14592) 1137 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:36:51.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:50 smithi145 bash[23893]: cluster 2024-05-20T22:36:49.260762+0000 mgr.y (mgr.14592) 1138 : cluster 0 pgmap v1576: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:52.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:52 smithi050 bash[28929]: cluster 2024-05-20T22:36:51.263803+0000 mgr.y (mgr.14592) 1139 : cluster 0 pgmap v1577: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:52.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:52 smithi050 bash[21866]: cluster 2024-05-20T22:36:51.263803+0000 mgr.y (mgr.14592) 1139 : cluster 0 pgmap v1577: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:53.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:52 smithi145 bash[23893]: cluster 2024-05-20T22:36:51.263803+0000 mgr.y (mgr.14592) 1139 : cluster 0 pgmap v1577: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:54.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:36:54.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:54 smithi050 bash[21866]: cluster 2024-05-20T22:36:53.264850+0000 mgr.y (mgr.14592) 1140 : cluster 0 pgmap v1578: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:54.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:54 smithi050 bash[28929]: cluster 2024-05-20T22:36:53.264850+0000 mgr.y (mgr.14592) 1140 : cluster 0 pgmap v1578: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:55.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:54 smithi145 bash[23893]: cluster 2024-05-20T22:36:53.264850+0000 mgr.y (mgr.14592) 1140 : cluster 0 pgmap v1578: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:55.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:55 smithi050 bash[21866]: audit 2024-05-20T22:36:55.516036+0000 mon.a (mon.0) 3784 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:36:55.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:55 smithi050 bash[28929]: audit 2024-05-20T22:36:55.516036+0000 mon.a (mon.0) 3784 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:36:56.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:55 smithi145 bash[23893]: audit 2024-05-20T22:36:55.516036+0000 mon.a (mon.0) 3784 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:36:57.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:56 smithi145 bash[23893]: cluster 2024-05-20T22:36:55.267797+0000 mgr.y (mgr.14592) 1141 : cluster 0 pgmap v1579: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:57.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:56 smithi050 bash[21866]: cluster 2024-05-20T22:36:55.267797+0000 mgr.y (mgr.14592) 1141 : cluster 0 pgmap v1579: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:57.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:56 smithi050 bash[28929]: cluster 2024-05-20T22:36:55.267797+0000 mgr.y (mgr.14592) 1141 : cluster 0 pgmap v1579: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:36:59.121 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:36:58 smithi145 bash[23893]: cluster 2024-05-20T22:36:57.269257+0000 mgr.y (mgr.14592) 1142 : cluster 0 pgmap v1580: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:59.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:36:58 smithi050 bash[21866]: cluster 2024-05-20T22:36:57.269257+0000 mgr.y (mgr.14592) 1142 : cluster 0 pgmap v1580: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:59.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:36:58 smithi050 bash[28929]: cluster 2024-05-20T22:36:57.269257+0000 mgr.y (mgr.14592) 1142 : cluster 0 pgmap v1580: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:36:59.386 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:36:59 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:36:59.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:36:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:36:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:37:01.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:00 smithi145 bash[23893]: audit 2024-05-20T22:36:59.129379+0000 mgr.y (mgr.14592) 1143 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:37:01.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:00 smithi145 bash[23893]: cluster 2024-05-20T22:36:59.270165+0000 mgr.y (mgr.14592) 1144 : cluster 0 pgmap v1581: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:01.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:00 smithi050 bash[21866]: audit 2024-05-20T22:36:59.129379+0000 mgr.y (mgr.14592) 1143 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:37:01.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:00 smithi050 bash[21866]: cluster 2024-05-20T22:36:59.270165+0000 mgr.y (mgr.14592) 1144 : cluster 0 pgmap v1581: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:01.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:00 smithi050 bash[28929]: audit 2024-05-20T22:36:59.129379+0000 mgr.y (mgr.14592) 1143 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:37:01.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:00 smithi050 bash[28929]: cluster 2024-05-20T22:36:59.270165+0000 mgr.y (mgr.14592) 1144 : cluster 0 pgmap v1581: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:03.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:02 smithi145 bash[23893]: cluster 2024-05-20T22:37:01.273162+0000 mgr.y (mgr.14592) 1145 : cluster 0 pgmap v1582: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:03.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:02 smithi050 bash[21866]: cluster 2024-05-20T22:37:01.273162+0000 mgr.y (mgr.14592) 1145 : cluster 0 pgmap v1582: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:03.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:02 smithi050 bash[28929]: cluster 2024-05-20T22:37:01.273162+0000 mgr.y (mgr.14592) 1145 : cluster 0 pgmap v1582: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:05.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:04 smithi145 bash[23893]: cluster 2024-05-20T22:37:03.274168+0000 mgr.y (mgr.14592) 1146 : cluster 0 pgmap v1583: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:05.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:04 smithi050 bash[21866]: cluster 2024-05-20T22:37:03.274168+0000 mgr.y (mgr.14592) 1146 : cluster 0 pgmap v1583: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:05.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:04 smithi050 bash[28929]: cluster 2024-05-20T22:37:03.274168+0000 mgr.y (mgr.14592) 1146 : cluster 0 pgmap v1583: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:07.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:06 smithi145 bash[23893]: cluster 2024-05-20T22:37:05.277000+0000 mgr.y (mgr.14592) 1147 : cluster 0 pgmap v1584: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:07.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:06 smithi050 bash[21866]: cluster 2024-05-20T22:37:05.277000+0000 mgr.y (mgr.14592) 1147 : cluster 0 pgmap v1584: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:07.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:06 smithi050 bash[28929]: cluster 2024-05-20T22:37:05.277000+0000 mgr.y (mgr.14592) 1147 : cluster 0 pgmap v1584: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:09.126 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:08 smithi145 bash[23893]: cluster 2024-05-20T22:37:07.277914+0000 mgr.y (mgr.14592) 1148 : cluster 0 pgmap v1585: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:09.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:08 smithi050 bash[21866]: cluster 2024-05-20T22:37:07.277914+0000 mgr.y (mgr.14592) 1148 : cluster 0 pgmap v1585: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:09.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:08 smithi050 bash[28929]: cluster 2024-05-20T22:37:07.277914+0000 mgr.y (mgr.14592) 1148 : cluster 0 pgmap v1585: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:09.386 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:37:09 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:37:09.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:37:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:37:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:37:11.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:10 smithi145 bash[23893]: audit 2024-05-20T22:37:09.134489+0000 mgr.y (mgr.14592) 1149 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:37:11.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:10 smithi145 bash[23893]: cluster 2024-05-20T22:37:09.278803+0000 mgr.y (mgr.14592) 1150 : cluster 0 pgmap v1586: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:11.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:10 smithi145 bash[23893]: audit 2024-05-20T22:37:10.548294+0000 mon.a (mon.0) 3785 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:37:11.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:10 smithi050 bash[21866]: audit 2024-05-20T22:37:09.134489+0000 mgr.y (mgr.14592) 1149 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:37:11.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:10 smithi050 bash[21866]: cluster 2024-05-20T22:37:09.278803+0000 mgr.y (mgr.14592) 1150 : cluster 0 pgmap v1586: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:11.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:10 smithi050 bash[21866]: audit 2024-05-20T22:37:10.548294+0000 mon.a (mon.0) 3785 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:37:11.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:10 smithi050 bash[28929]: audit 2024-05-20T22:37:09.134489+0000 mgr.y (mgr.14592) 1149 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:37:11.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:10 smithi050 bash[28929]: cluster 2024-05-20T22:37:09.278803+0000 mgr.y (mgr.14592) 1150 : cluster 0 pgmap v1586: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:11.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:10 smithi050 bash[28929]: audit 2024-05-20T22:37:10.548294+0000 mon.a (mon.0) 3785 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:37:13.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:12 smithi145 bash[23893]: cluster 2024-05-20T22:37:11.281798+0000 mgr.y (mgr.14592) 1151 : cluster 0 pgmap v1587: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:13.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:12 smithi050 bash[21866]: cluster 2024-05-20T22:37:11.281798+0000 mgr.y (mgr.14592) 1151 : cluster 0 pgmap v1587: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:13.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:12 smithi050 bash[28929]: cluster 2024-05-20T22:37:11.281798+0000 mgr.y (mgr.14592) 1151 : cluster 0 pgmap v1587: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:15.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:14 smithi145 bash[23893]: cluster 2024-05-20T22:37:13.282735+0000 mgr.y (mgr.14592) 1152 : cluster 0 pgmap v1588: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:15.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:14 smithi050 bash[21866]: cluster 2024-05-20T22:37:13.282735+0000 mgr.y (mgr.14592) 1152 : cluster 0 pgmap v1588: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:15.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:14 smithi050 bash[28929]: cluster 2024-05-20T22:37:13.282735+0000 mgr.y (mgr.14592) 1152 : cluster 0 pgmap v1588: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:17.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:16 smithi145 bash[23893]: cluster 2024-05-20T22:37:15.285798+0000 mgr.y (mgr.14592) 1153 : cluster 0 pgmap v1589: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:17.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:16 smithi050 bash[21866]: cluster 2024-05-20T22:37:15.285798+0000 mgr.y (mgr.14592) 1153 : cluster 0 pgmap v1589: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:17.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:16 smithi050 bash[28929]: cluster 2024-05-20T22:37:15.285798+0000 mgr.y (mgr.14592) 1153 : cluster 0 pgmap v1589: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:19.134 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:18 smithi145 bash[23893]: cluster 2024-05-20T22:37:17.286735+0000 mgr.y (mgr.14592) 1154 : cluster 0 pgmap v1590: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:19.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:18 smithi050 bash[21866]: cluster 2024-05-20T22:37:17.286735+0000 mgr.y (mgr.14592) 1154 : cluster 0 pgmap v1590: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:19.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:18 smithi050 bash[28929]: cluster 2024-05-20T22:37:17.286735+0000 mgr.y (mgr.14592) 1154 : cluster 0 pgmap v1590: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:19.386 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:37:19 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:37:19.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:37:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:37:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:37:21.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:20 smithi145 bash[23893]: audit 2024-05-20T22:37:19.142392+0000 mgr.y (mgr.14592) 1155 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:37:21.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:20 smithi145 bash[23893]: cluster 2024-05-20T22:37:19.287712+0000 mgr.y (mgr.14592) 1156 : cluster 0 pgmap v1591: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:21.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:20 smithi050 bash[21866]: audit 2024-05-20T22:37:19.142392+0000 mgr.y (mgr.14592) 1155 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:37:21.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:20 smithi050 bash[21866]: cluster 2024-05-20T22:37:19.287712+0000 mgr.y (mgr.14592) 1156 : cluster 0 pgmap v1591: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:21.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:20 smithi050 bash[28929]: audit 2024-05-20T22:37:19.142392+0000 mgr.y (mgr.14592) 1155 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:37:21.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:20 smithi050 bash[28929]: cluster 2024-05-20T22:37:19.287712+0000 mgr.y (mgr.14592) 1156 : cluster 0 pgmap v1591: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:23.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:22 smithi145 bash[23893]: cluster 2024-05-20T22:37:21.290685+0000 mgr.y (mgr.14592) 1157 : cluster 0 pgmap v1592: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:23.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:22 smithi050 bash[21866]: cluster 2024-05-20T22:37:21.290685+0000 mgr.y (mgr.14592) 1157 : cluster 0 pgmap v1592: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:23.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:22 smithi050 bash[28929]: cluster 2024-05-20T22:37:21.290685+0000 mgr.y (mgr.14592) 1157 : cluster 0 pgmap v1592: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:25.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:24 smithi145 bash[23893]: cluster 2024-05-20T22:37:23.291636+0000 mgr.y (mgr.14592) 1158 : cluster 0 pgmap v1593: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:25.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:24 smithi050 bash[28929]: cluster 2024-05-20T22:37:23.291636+0000 mgr.y (mgr.14592) 1158 : cluster 0 pgmap v1593: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:25.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:24 smithi050 bash[21866]: cluster 2024-05-20T22:37:23.291636+0000 mgr.y (mgr.14592) 1158 : cluster 0 pgmap v1593: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:26.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:25 smithi145 bash[23893]: audit 2024-05-20T22:37:25.580343+0000 mon.a (mon.0) 3786 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:37:26.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:25 smithi050 bash[21866]: audit 2024-05-20T22:37:25.580343+0000 mon.a (mon.0) 3786 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:37:26.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:25 smithi050 bash[28929]: audit 2024-05-20T22:37:25.580343+0000 mon.a (mon.0) 3786 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:37:27.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:26 smithi145 bash[23893]: cluster 2024-05-20T22:37:25.294662+0000 mgr.y (mgr.14592) 1159 : cluster 0 pgmap v1594: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:27.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:26 smithi050 bash[21866]: cluster 2024-05-20T22:37:25.294662+0000 mgr.y (mgr.14592) 1159 : cluster 0 pgmap v1594: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:27.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:26 smithi050 bash[28929]: cluster 2024-05-20T22:37:25.294662+0000 mgr.y (mgr.14592) 1159 : cluster 0 pgmap v1594: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:29.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:28 smithi145 bash[23893]: cluster 2024-05-20T22:37:27.295602+0000 mgr.y (mgr.14592) 1160 : cluster 0 pgmap v1595: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:29.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:28 smithi050 bash[21866]: cluster 2024-05-20T22:37:27.295602+0000 mgr.y (mgr.14592) 1160 : cluster 0 pgmap v1595: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:29.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:28 smithi050 bash[28929]: cluster 2024-05-20T22:37:27.295602+0000 mgr.y (mgr.14592) 1160 : cluster 0 pgmap v1595: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:29.636 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:37:29 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:37:29.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:37:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:37:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:37:31.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:30 smithi145 bash[23893]: audit 2024-05-20T22:37:29.150168+0000 mgr.y (mgr.14592) 1161 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:37:31.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:30 smithi145 bash[23893]: cluster 2024-05-20T22:37:29.296684+0000 mgr.y (mgr.14592) 1162 : cluster 0 pgmap v1596: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:31.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:30 smithi050 bash[21866]: audit 2024-05-20T22:37:29.150168+0000 mgr.y (mgr.14592) 1161 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:37:31.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:30 smithi050 bash[21866]: cluster 2024-05-20T22:37:29.296684+0000 mgr.y (mgr.14592) 1162 : cluster 0 pgmap v1596: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:31.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:30 smithi050 bash[28929]: audit 2024-05-20T22:37:29.150168+0000 mgr.y (mgr.14592) 1161 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:37:31.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:30 smithi050 bash[28929]: cluster 2024-05-20T22:37:29.296684+0000 mgr.y (mgr.14592) 1162 : cluster 0 pgmap v1596: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:33.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:32 smithi145 bash[23893]: cluster 2024-05-20T22:37:31.299783+0000 mgr.y (mgr.14592) 1163 : cluster 0 pgmap v1597: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:33.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:32 smithi050 bash[21866]: cluster 2024-05-20T22:37:31.299783+0000 mgr.y (mgr.14592) 1163 : cluster 0 pgmap v1597: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:33.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:32 smithi050 bash[28929]: cluster 2024-05-20T22:37:31.299783+0000 mgr.y (mgr.14592) 1163 : cluster 0 pgmap v1597: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:35.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:34 smithi145 bash[23893]: cluster 2024-05-20T22:37:33.300936+0000 mgr.y (mgr.14592) 1164 : cluster 0 pgmap v1598: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:35.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:34 smithi050 bash[21866]: cluster 2024-05-20T22:37:33.300936+0000 mgr.y (mgr.14592) 1164 : cluster 0 pgmap v1598: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:35.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:34 smithi050 bash[28929]: cluster 2024-05-20T22:37:33.300936+0000 mgr.y (mgr.14592) 1164 : cluster 0 pgmap v1598: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:37.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:36 smithi145 bash[23893]: cluster 2024-05-20T22:37:35.303964+0000 mgr.y (mgr.14592) 1165 : cluster 0 pgmap v1599: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:37.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:36 smithi145 bash[23893]: audit 2024-05-20T22:37:35.806107+0000 mon.a (mon.0) 3787 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:37:37.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:36 smithi050 bash[21866]: cluster 2024-05-20T22:37:35.303964+0000 mgr.y (mgr.14592) 1165 : cluster 0 pgmap v1599: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:37.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:36 smithi050 bash[21866]: audit 2024-05-20T22:37:35.806107+0000 mon.a (mon.0) 3787 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:37:37.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:36 smithi050 bash[28929]: cluster 2024-05-20T22:37:35.303964+0000 mgr.y (mgr.14592) 1165 : cluster 0 pgmap v1599: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:37.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:36 smithi050 bash[28929]: audit 2024-05-20T22:37:35.806107+0000 mon.a (mon.0) 3787 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:37:38.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:37 smithi145 bash[23893]: audit 2024-05-20T22:37:36.953550+0000 mon.a (mon.0) 3788 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:37:38.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:37 smithi145 bash[23893]: audit 2024-05-20T22:37:36.959414+0000 mon.a (mon.0) 3789 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:37:38.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:37 smithi145 bash[23893]: audit 2024-05-20T22:37:36.965541+0000 mon.a (mon.0) 3790 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:37:38.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:37 smithi145 bash[23893]: audit 2024-05-20T22:37:36.970929+0000 mon.a (mon.0) 3791 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:37:38.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:37 smithi145 bash[23893]: audit 2024-05-20T22:37:36.971932+0000 mon.a (mon.0) 3792 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:37:38.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:37 smithi145 bash[23893]: audit 2024-05-20T22:37:36.972779+0000 mon.a (mon.0) 3793 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:37:38.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:37 smithi145 bash[23893]: audit 2024-05-20T22:37:36.978950+0000 mon.a (mon.0) 3794 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:37:38.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:37 smithi050 bash[21866]: audit 2024-05-20T22:37:36.953550+0000 mon.a (mon.0) 3788 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:37:38.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:37 smithi050 bash[21866]: audit 2024-05-20T22:37:36.959414+0000 mon.a (mon.0) 3789 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:37:38.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:37 smithi050 bash[21866]: audit 2024-05-20T22:37:36.965541+0000 mon.a (mon.0) 3790 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:37:38.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:37 smithi050 bash[21866]: audit 2024-05-20T22:37:36.970929+0000 mon.a (mon.0) 3791 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:37:38.441 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:37 smithi050 bash[21866]: audit 2024-05-20T22:37:36.971932+0000 mon.a (mon.0) 3792 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:37:38.441 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:37 smithi050 bash[21866]: audit 2024-05-20T22:37:36.972779+0000 mon.a (mon.0) 3793 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:37:38.441 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:37 smithi050 bash[21866]: audit 2024-05-20T22:37:36.978950+0000 mon.a (mon.0) 3794 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:37:38.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:37 smithi050 bash[28929]: audit 2024-05-20T22:37:36.953550+0000 mon.a (mon.0) 3788 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:37:38.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:37 smithi050 bash[28929]: audit 2024-05-20T22:37:36.959414+0000 mon.a (mon.0) 3789 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:37:38.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:37 smithi050 bash[28929]: audit 2024-05-20T22:37:36.965541+0000 mon.a (mon.0) 3790 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:37:38.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:37 smithi050 bash[28929]: audit 2024-05-20T22:37:36.970929+0000 mon.a (mon.0) 3791 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:37:38.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:37 smithi050 bash[28929]: audit 2024-05-20T22:37:36.971932+0000 mon.a (mon.0) 3792 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:37:38.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:37 smithi050 bash[28929]: audit 2024-05-20T22:37:36.972779+0000 mon.a (mon.0) 3793 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:37:38.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:37 smithi050 bash[28929]: audit 2024-05-20T22:37:36.978950+0000 mon.a (mon.0) 3794 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:37:39.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:38 smithi145 bash[23893]: cluster 2024-05-20T22:37:37.304854+0000 mgr.y (mgr.14592) 1166 : cluster 0 pgmap v1600: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:37:39.387 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:37:39 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:37:39.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:38 smithi050 bash[21866]: cluster 2024-05-20T22:37:37.304854+0000 mgr.y (mgr.14592) 1166 : cluster 0 pgmap v1600: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:37:39.387 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:38 smithi050 bash[28929]: cluster 2024-05-20T22:37:37.304854+0000 mgr.y (mgr.14592) 1166 : cluster 0 pgmap v1600: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:37:39.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:37:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:37:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:37:41.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:40 smithi145 bash[23893]: audit 2024-05-20T22:37:39.161227+0000 mgr.y (mgr.14592) 1167 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:37:41.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:40 smithi145 bash[23893]: cluster 2024-05-20T22:37:39.305794+0000 mgr.y (mgr.14592) 1168 : cluster 0 pgmap v1601: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:37:41.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:40 smithi145 bash[23893]: audit 2024-05-20T22:37:40.612441+0000 mon.a (mon.0) 3795 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:37:41.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:40 smithi050 bash[21866]: audit 2024-05-20T22:37:39.161227+0000 mgr.y (mgr.14592) 1167 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:37:41.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:40 smithi050 bash[21866]: cluster 2024-05-20T22:37:39.305794+0000 mgr.y (mgr.14592) 1168 : cluster 0 pgmap v1601: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:37:41.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:40 smithi050 bash[21866]: audit 2024-05-20T22:37:40.612441+0000 mon.a (mon.0) 3795 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:37:41.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:40 smithi050 bash[28929]: audit 2024-05-20T22:37:39.161227+0000 mgr.y (mgr.14592) 1167 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:37:41.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:40 smithi050 bash[28929]: cluster 2024-05-20T22:37:39.305794+0000 mgr.y (mgr.14592) 1168 : cluster 0 pgmap v1601: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:37:41.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:40 smithi050 bash[28929]: audit 2024-05-20T22:37:40.612441+0000 mon.a (mon.0) 3795 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:37:42.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:42 smithi145 bash[23893]: cluster 2024-05-20T22:37:41.308846+0000 mgr.y (mgr.14592) 1169 : cluster 0 pgmap v1602: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:42.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:42 smithi050 bash[21866]: cluster 2024-05-20T22:37:41.308846+0000 mgr.y (mgr.14592) 1169 : cluster 0 pgmap v1602: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:42.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:42 smithi050 bash[28929]: cluster 2024-05-20T22:37:41.308846+0000 mgr.y (mgr.14592) 1169 : cluster 0 pgmap v1602: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:44.639 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:44 smithi145 bash[23893]: cluster 2024-05-20T22:37:43.309796+0000 mgr.y (mgr.14592) 1170 : cluster 0 pgmap v1603: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:37:44.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:44 smithi050 bash[21866]: cluster 2024-05-20T22:37:43.309796+0000 mgr.y (mgr.14592) 1170 : cluster 0 pgmap v1603: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:37:44.731 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:44 smithi050 bash[28929]: cluster 2024-05-20T22:37:43.309796+0000 mgr.y (mgr.14592) 1170 : cluster 0 pgmap v1603: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-20T22:37:46.636 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:46 smithi145 bash[23893]: cluster 2024-05-20T22:37:45.312810+0000 mgr.y (mgr.14592) 1171 : cluster 0 pgmap v1604: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:46.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:46 smithi050 bash[21866]: cluster 2024-05-20T22:37:45.312810+0000 mgr.y (mgr.14592) 1171 : cluster 0 pgmap v1604: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:46.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:46 smithi050 bash[28929]: cluster 2024-05-20T22:37:45.312810+0000 mgr.y (mgr.14592) 1171 : cluster 0 pgmap v1604: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:48.636 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:48 smithi145 bash[23893]: cluster 2024-05-20T22:37:47.313712+0000 mgr.y (mgr.14592) 1172 : cluster 0 pgmap v1605: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:48.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:48 smithi050 bash[21866]: cluster 2024-05-20T22:37:47.313712+0000 mgr.y (mgr.14592) 1172 : cluster 0 pgmap v1605: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:48.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:48 smithi050 bash[28929]: cluster 2024-05-20T22:37:47.313712+0000 mgr.y (mgr.14592) 1172 : cluster 0 pgmap v1605: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:49.636 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:37:49 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:37:49.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:37:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:37:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:37:50.636 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:50 smithi145 bash[23893]: audit 2024-05-20T22:37:49.172525+0000 mgr.y (mgr.14592) 1173 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:37:50.636 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:50 smithi145 bash[23893]: cluster 2024-05-20T22:37:49.314623+0000 mgr.y (mgr.14592) 1174 : cluster 0 pgmap v1606: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:50.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:50 smithi050 bash[21866]: audit 2024-05-20T22:37:49.172525+0000 mgr.y (mgr.14592) 1173 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:37:50.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:50 smithi050 bash[21866]: cluster 2024-05-20T22:37:49.314623+0000 mgr.y (mgr.14592) 1174 : cluster 0 pgmap v1606: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:50.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:50 smithi050 bash[28929]: audit 2024-05-20T22:37:49.172525+0000 mgr.y (mgr.14592) 1173 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:37:50.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:50 smithi050 bash[28929]: cluster 2024-05-20T22:37:49.314623+0000 mgr.y (mgr.14592) 1174 : cluster 0 pgmap v1606: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:52.636 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:52 smithi145 bash[23893]: cluster 2024-05-20T22:37:51.317597+0000 mgr.y (mgr.14592) 1175 : cluster 0 pgmap v1607: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:52.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:52 smithi050 bash[21866]: cluster 2024-05-20T22:37:51.317597+0000 mgr.y (mgr.14592) 1175 : cluster 0 pgmap v1607: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:52.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:52 smithi050 bash[28929]: cluster 2024-05-20T22:37:51.317597+0000 mgr.y (mgr.14592) 1175 : cluster 0 pgmap v1607: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:54.636 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:54 smithi145 bash[23893]: cluster 2024-05-20T22:37:53.318529+0000 mgr.y (mgr.14592) 1176 : cluster 0 pgmap v1608: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:54.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:54 smithi050 bash[21866]: cluster 2024-05-20T22:37:53.318529+0000 mgr.y (mgr.14592) 1176 : cluster 0 pgmap v1608: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:54.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:54 smithi050 bash[28929]: cluster 2024-05-20T22:37:53.318529+0000 mgr.y (mgr.14592) 1176 : cluster 0 pgmap v1608: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:56.636 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:56 smithi145 bash[23893]: cluster 2024-05-20T22:37:55.321598+0000 mgr.y (mgr.14592) 1177 : cluster 0 pgmap v1609: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:56.636 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:56 smithi145 bash[23893]: audit 2024-05-20T22:37:55.645448+0000 mon.a (mon.0) 3796 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:37:56.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:56 smithi050 bash[21866]: cluster 2024-05-20T22:37:55.321598+0000 mgr.y (mgr.14592) 1177 : cluster 0 pgmap v1609: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:56.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:56 smithi050 bash[21866]: audit 2024-05-20T22:37:55.645448+0000 mon.a (mon.0) 3796 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:37:56.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:56 smithi050 bash[28929]: cluster 2024-05-20T22:37:55.321598+0000 mgr.y (mgr.14592) 1177 : cluster 0 pgmap v1609: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:37:56.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:56 smithi050 bash[28929]: audit 2024-05-20T22:37:55.645448+0000 mon.a (mon.0) 3796 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:37:58.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:37:58 smithi050 bash[21866]: cluster 2024-05-20T22:37:57.322541+0000 mgr.y (mgr.14592) 1178 : cluster 0 pgmap v1610: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:58.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:37:58 smithi050 bash[28929]: cluster 2024-05-20T22:37:57.322541+0000 mgr.y (mgr.14592) 1178 : cluster 0 pgmap v1610: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:58.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:37:58 smithi145 bash[23893]: cluster 2024-05-20T22:37:57.322541+0000 mgr.y (mgr.14592) 1178 : cluster 0 pgmap v1610: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:37:59.636 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:37:59 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:37:59.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:37:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:37:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:38:00.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:00 smithi050 bash[21866]: audit 2024-05-20T22:37:59.181909+0000 mgr.y (mgr.14592) 1179 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:38:00.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:00 smithi050 bash[21866]: cluster 2024-05-20T22:37:59.323474+0000 mgr.y (mgr.14592) 1180 : cluster 0 pgmap v1611: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:00.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:00 smithi050 bash[28929]: audit 2024-05-20T22:37:59.181909+0000 mgr.y (mgr.14592) 1179 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:38:00.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:00 smithi050 bash[28929]: cluster 2024-05-20T22:37:59.323474+0000 mgr.y (mgr.14592) 1180 : cluster 0 pgmap v1611: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:00.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:00 smithi145 bash[23893]: audit 2024-05-20T22:37:59.181909+0000 mgr.y (mgr.14592) 1179 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:38:00.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:00 smithi145 bash[23893]: cluster 2024-05-20T22:37:59.323474+0000 mgr.y (mgr.14592) 1180 : cluster 0 pgmap v1611: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:02.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:02 smithi050 bash[21866]: cluster 2024-05-20T22:38:01.326471+0000 mgr.y (mgr.14592) 1181 : cluster 0 pgmap v1612: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:02.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:02 smithi050 bash[28929]: cluster 2024-05-20T22:38:01.326471+0000 mgr.y (mgr.14592) 1181 : cluster 0 pgmap v1612: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:02.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:02 smithi145 bash[23893]: cluster 2024-05-20T22:38:01.326471+0000 mgr.y (mgr.14592) 1181 : cluster 0 pgmap v1612: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:04.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:04 smithi050 bash[21866]: cluster 2024-05-20T22:38:03.327445+0000 mgr.y (mgr.14592) 1182 : cluster 0 pgmap v1613: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:04.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:04 smithi050 bash[28929]: cluster 2024-05-20T22:38:03.327445+0000 mgr.y (mgr.14592) 1182 : cluster 0 pgmap v1613: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:04.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:04 smithi145 bash[23893]: cluster 2024-05-20T22:38:03.327445+0000 mgr.y (mgr.14592) 1182 : cluster 0 pgmap v1613: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:06.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:06 smithi050 bash[21866]: cluster 2024-05-20T22:38:05.330429+0000 mgr.y (mgr.14592) 1183 : cluster 0 pgmap v1614: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:06.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:06 smithi050 bash[28929]: cluster 2024-05-20T22:38:05.330429+0000 mgr.y (mgr.14592) 1183 : cluster 0 pgmap v1614: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:06.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:06 smithi145 bash[23893]: cluster 2024-05-20T22:38:05.330429+0000 mgr.y (mgr.14592) 1183 : cluster 0 pgmap v1614: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:08.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:08 smithi050 bash[21866]: cluster 2024-05-20T22:38:07.331383+0000 mgr.y (mgr.14592) 1184 : cluster 0 pgmap v1615: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:08.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:08 smithi050 bash[28929]: cluster 2024-05-20T22:38:07.331383+0000 mgr.y (mgr.14592) 1184 : cluster 0 pgmap v1615: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:08.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:08 smithi145 bash[23893]: cluster 2024-05-20T22:38:07.331383+0000 mgr.y (mgr.14592) 1184 : cluster 0 pgmap v1615: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:09.636 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:38:09 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:38:09.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:38:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:38:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:38:10.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:10 smithi050 bash[21866]: audit 2024-05-20T22:38:09.189942+0000 mgr.y (mgr.14592) 1185 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:38:10.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:10 smithi050 bash[21866]: cluster 2024-05-20T22:38:09.332316+0000 mgr.y (mgr.14592) 1186 : cluster 0 pgmap v1616: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:10.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:10 smithi050 bash[28929]: audit 2024-05-20T22:38:09.189942+0000 mgr.y (mgr.14592) 1185 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:38:10.691 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:10 smithi050 bash[28929]: cluster 2024-05-20T22:38:09.332316+0000 mgr.y (mgr.14592) 1186 : cluster 0 pgmap v1616: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:10.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:10 smithi145 bash[23893]: audit 2024-05-20T22:38:09.189942+0000 mgr.y (mgr.14592) 1185 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:38:10.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:10 smithi145 bash[23893]: cluster 2024-05-20T22:38:09.332316+0000 mgr.y (mgr.14592) 1186 : cluster 0 pgmap v1616: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:11.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:11 smithi050 bash[28929]: audit 2024-05-20T22:38:10.678301+0000 mon.a (mon.0) 3797 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:38:11.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:11 smithi050 bash[21866]: audit 2024-05-20T22:38:10.678301+0000 mon.a (mon.0) 3797 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:38:11.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:11 smithi145 bash[23893]: audit 2024-05-20T22:38:10.678301+0000 mon.a (mon.0) 3797 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:38:12.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:12 smithi050 bash[21866]: cluster 2024-05-20T22:38:11.335280+0000 mgr.y (mgr.14592) 1187 : cluster 0 pgmap v1617: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:12.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:12 smithi050 bash[28929]: cluster 2024-05-20T22:38:11.335280+0000 mgr.y (mgr.14592) 1187 : cluster 0 pgmap v1617: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:12.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:12 smithi145 bash[23893]: cluster 2024-05-20T22:38:11.335280+0000 mgr.y (mgr.14592) 1187 : cluster 0 pgmap v1617: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:14.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:14 smithi050 bash[21866]: cluster 2024-05-20T22:38:13.336473+0000 mgr.y (mgr.14592) 1188 : cluster 0 pgmap v1618: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:14.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:14 smithi050 bash[28929]: cluster 2024-05-20T22:38:13.336473+0000 mgr.y (mgr.14592) 1188 : cluster 0 pgmap v1618: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:14.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:14 smithi145 bash[23893]: cluster 2024-05-20T22:38:13.336473+0000 mgr.y (mgr.14592) 1188 : cluster 0 pgmap v1618: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:16.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:16 smithi050 bash[21866]: cluster 2024-05-20T22:38:15.339413+0000 mgr.y (mgr.14592) 1189 : cluster 0 pgmap v1619: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:16.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:16 smithi050 bash[28929]: cluster 2024-05-20T22:38:15.339413+0000 mgr.y (mgr.14592) 1189 : cluster 0 pgmap v1619: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:16.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:16 smithi145 bash[23893]: cluster 2024-05-20T22:38:15.339413+0000 mgr.y (mgr.14592) 1189 : cluster 0 pgmap v1619: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:18.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:18 smithi050 bash[21866]: cluster 2024-05-20T22:38:17.340466+0000 mgr.y (mgr.14592) 1190 : cluster 0 pgmap v1620: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:18.690 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:18 smithi050 bash[28929]: cluster 2024-05-20T22:38:17.340466+0000 mgr.y (mgr.14592) 1190 : cluster 0 pgmap v1620: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:18.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:18 smithi145 bash[23893]: cluster 2024-05-20T22:38:17.340466+0000 mgr.y (mgr.14592) 1190 : cluster 0 pgmap v1620: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:19.636 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:38:19 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:38:19.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:38:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:38:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:38:20.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:20 smithi145 bash[23893]: audit 2024-05-20T22:38:19.201304+0000 mgr.y (mgr.14592) 1191 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:38:20.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:20 smithi145 bash[23893]: cluster 2024-05-20T22:38:19.341523+0000 mgr.y (mgr.14592) 1192 : cluster 0 pgmap v1621: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:20.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:20 smithi050 bash[21866]: audit 2024-05-20T22:38:19.201304+0000 mgr.y (mgr.14592) 1191 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:38:20.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:20 smithi050 bash[21866]: cluster 2024-05-20T22:38:19.341523+0000 mgr.y (mgr.14592) 1192 : cluster 0 pgmap v1621: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:20.942 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:20 smithi050 bash[28929]: audit 2024-05-20T22:38:19.201304+0000 mgr.y (mgr.14592) 1191 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:38:20.942 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:20 smithi050 bash[28929]: cluster 2024-05-20T22:38:19.341523+0000 mgr.y (mgr.14592) 1192 : cluster 0 pgmap v1621: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:22.386 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:38:22 smithi145 bash[51536]: logger=cleanup t=2024-05-20T22:38:22.045232605Z level=info msg="Completed cleanup jobs" duration=56.746327ms 2024-05-20T22:38:22.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:22 smithi145 bash[23893]: cluster 2024-05-20T22:38:21.344545+0000 mgr.y (mgr.14592) 1193 : cluster 0 pgmap v1622: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:22.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:22 smithi050 bash[21866]: cluster 2024-05-20T22:38:21.344545+0000 mgr.y (mgr.14592) 1193 : cluster 0 pgmap v1622: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:22.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:22 smithi050 bash[28929]: cluster 2024-05-20T22:38:21.344545+0000 mgr.y (mgr.14592) 1193 : cluster 0 pgmap v1622: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:24.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:24 smithi145 bash[23893]: cluster 2024-05-20T22:38:23.345460+0000 mgr.y (mgr.14592) 1194 : cluster 0 pgmap v1623: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:24.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:24 smithi050 bash[21866]: cluster 2024-05-20T22:38:23.345460+0000 mgr.y (mgr.14592) 1194 : cluster 0 pgmap v1623: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:24.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:24 smithi050 bash[28929]: cluster 2024-05-20T22:38:23.345460+0000 mgr.y (mgr.14592) 1194 : cluster 0 pgmap v1623: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:26.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:26 smithi145 bash[23893]: cluster 2024-05-20T22:38:25.348521+0000 mgr.y (mgr.14592) 1195 : cluster 0 pgmap v1624: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:26.887 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:26 smithi145 bash[23893]: audit 2024-05-20T22:38:25.712803+0000 mon.a (mon.0) 3798 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:38:26.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:26 smithi050 bash[21866]: cluster 2024-05-20T22:38:25.348521+0000 mgr.y (mgr.14592) 1195 : cluster 0 pgmap v1624: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:26.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:26 smithi050 bash[21866]: audit 2024-05-20T22:38:25.712803+0000 mon.a (mon.0) 3798 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:38:26.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:26 smithi050 bash[28929]: cluster 2024-05-20T22:38:25.348521+0000 mgr.y (mgr.14592) 1195 : cluster 0 pgmap v1624: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:26.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:26 smithi050 bash[28929]: audit 2024-05-20T22:38:25.712803+0000 mon.a (mon.0) 3798 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:38:28.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:28 smithi145 bash[23893]: cluster 2024-05-20T22:38:27.349587+0000 mgr.y (mgr.14592) 1196 : cluster 0 pgmap v1625: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:28.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:28 smithi050 bash[21866]: cluster 2024-05-20T22:38:27.349587+0000 mgr.y (mgr.14592) 1196 : cluster 0 pgmap v1625: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:28.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:28 smithi050 bash[28929]: cluster 2024-05-20T22:38:27.349587+0000 mgr.y (mgr.14592) 1196 : cluster 0 pgmap v1625: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:29.636 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:38:29 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:38:29.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:38:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:38:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:38:30.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:30 smithi145 bash[23893]: audit 2024-05-20T22:38:29.210300+0000 mgr.y (mgr.14592) 1197 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:38:30.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:30 smithi145 bash[23893]: cluster 2024-05-20T22:38:29.350648+0000 mgr.y (mgr.14592) 1198 : cluster 0 pgmap v1626: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:30.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:30 smithi050 bash[21866]: audit 2024-05-20T22:38:29.210300+0000 mgr.y (mgr.14592) 1197 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:38:30.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:30 smithi050 bash[21866]: cluster 2024-05-20T22:38:29.350648+0000 mgr.y (mgr.14592) 1198 : cluster 0 pgmap v1626: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:30.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:30 smithi050 bash[28929]: audit 2024-05-20T22:38:29.210300+0000 mgr.y (mgr.14592) 1197 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:38:30.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:30 smithi050 bash[28929]: cluster 2024-05-20T22:38:29.350648+0000 mgr.y (mgr.14592) 1198 : cluster 0 pgmap v1626: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:32.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:32 smithi145 bash[23893]: cluster 2024-05-20T22:38:31.353608+0000 mgr.y (mgr.14592) 1199 : cluster 0 pgmap v1627: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:32.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:32 smithi050 bash[21866]: cluster 2024-05-20T22:38:31.353608+0000 mgr.y (mgr.14592) 1199 : cluster 0 pgmap v1627: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:32.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:32 smithi050 bash[28929]: cluster 2024-05-20T22:38:31.353608+0000 mgr.y (mgr.14592) 1199 : cluster 0 pgmap v1627: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:33.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.304 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.304 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.304 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.304 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:33.304 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:38:34.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:34 smithi145 bash[23893]: cluster 2024-05-20T22:38:33.354547+0000 mgr.y (mgr.14592) 1200 : cluster 0 pgmap v1628: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:34.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:34 smithi050 bash[21866]: cluster 2024-05-20T22:38:33.354547+0000 mgr.y (mgr.14592) 1200 : cluster 0 pgmap v1628: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:34.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:34 smithi050 bash[28929]: cluster 2024-05-20T22:38:33.354547+0000 mgr.y (mgr.14592) 1200 : cluster 0 pgmap v1628: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:36.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:36 smithi145 bash[23893]: cluster 2024-05-20T22:38:35.357481+0000 mgr.y (mgr.14592) 1201 : cluster 0 pgmap v1629: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:36.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:36 smithi050 bash[21866]: cluster 2024-05-20T22:38:35.357481+0000 mgr.y (mgr.14592) 1201 : cluster 0 pgmap v1629: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:36.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:36 smithi050 bash[28929]: cluster 2024-05-20T22:38:35.357481+0000 mgr.y (mgr.14592) 1201 : cluster 0 pgmap v1629: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:37.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:37 smithi145 bash[23893]: audit 2024-05-20T22:38:37.108202+0000 mon.a (mon.0) 3799 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:38:37.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:37 smithi050 bash[21866]: audit 2024-05-20T22:38:37.108202+0000 mon.a (mon.0) 3799 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:38:37.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:37 smithi050 bash[28929]: audit 2024-05-20T22:38:37.108202+0000 mon.a (mon.0) 3799 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:38:38.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:38 smithi050 bash[21866]: cluster 2024-05-20T22:38:37.358390+0000 mgr.y (mgr.14592) 1202 : cluster 0 pgmap v1630: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:38.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:38 smithi050 bash[21866]: audit 2024-05-20T22:38:37.647068+0000 mon.a (mon.0) 3800 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:38:38.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:38 smithi050 bash[21866]: audit 2024-05-20T22:38:37.655458+0000 mon.a (mon.0) 3801 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:38:38.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:38 smithi050 bash[21866]: audit 2024-05-20T22:38:38.390155+0000 mon.a (mon.0) 3802 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:38:38.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:38 smithi050 bash[21866]: audit 2024-05-20T22:38:38.391961+0000 mon.a (mon.0) 3803 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:38:38.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:38 smithi050 bash[21866]: audit 2024-05-20T22:38:38.401401+0000 mon.a (mon.0) 3804 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:38:38.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:38 smithi050 bash[28929]: cluster 2024-05-20T22:38:37.358390+0000 mgr.y (mgr.14592) 1202 : cluster 0 pgmap v1630: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:38.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:38 smithi050 bash[28929]: audit 2024-05-20T22:38:37.647068+0000 mon.a (mon.0) 3800 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:38:38.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:38 smithi050 bash[28929]: audit 2024-05-20T22:38:37.655458+0000 mon.a (mon.0) 3801 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:38:38.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:38 smithi050 bash[28929]: audit 2024-05-20T22:38:38.390155+0000 mon.a (mon.0) 3802 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:38:38.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:38 smithi050 bash[28929]: audit 2024-05-20T22:38:38.391961+0000 mon.a (mon.0) 3803 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:38:38.942 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:38 smithi050 bash[28929]: audit 2024-05-20T22:38:38.401401+0000 mon.a (mon.0) 3804 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:38:39.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:38 smithi145 bash[23893]: cluster 2024-05-20T22:38:37.358390+0000 mgr.y (mgr.14592) 1202 : cluster 0 pgmap v1630: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:39.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:38 smithi145 bash[23893]: audit 2024-05-20T22:38:37.647068+0000 mon.a (mon.0) 3800 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:38:39.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:38 smithi145 bash[23893]: audit 2024-05-20T22:38:37.655458+0000 mon.a (mon.0) 3801 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:38:39.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:38 smithi145 bash[23893]: audit 2024-05-20T22:38:38.390155+0000 mon.a (mon.0) 3802 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:38:39.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:38 smithi145 bash[23893]: audit 2024-05-20T22:38:38.391961+0000 mon.a (mon.0) 3803 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:38:39.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:38 smithi145 bash[23893]: audit 2024-05-20T22:38:38.401401+0000 mon.a (mon.0) 3804 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:38:39.636 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:38:39 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:38:39.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:38:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:38:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:38:40.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:40 smithi050 bash[21866]: audit 2024-05-20T22:38:39.217635+0000 mgr.y (mgr.14592) 1203 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:38:40.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:40 smithi050 bash[21866]: cluster 2024-05-20T22:38:39.359294+0000 mgr.y (mgr.14592) 1204 : cluster 0 pgmap v1631: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:40.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:40 smithi050 bash[28929]: audit 2024-05-20T22:38:39.217635+0000 mgr.y (mgr.14592) 1203 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:38:40.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:40 smithi050 bash[28929]: cluster 2024-05-20T22:38:39.359294+0000 mgr.y (mgr.14592) 1204 : cluster 0 pgmap v1631: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:41.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:40 smithi145 bash[23893]: audit 2024-05-20T22:38:39.217635+0000 mgr.y (mgr.14592) 1203 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:38:41.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:40 smithi145 bash[23893]: cluster 2024-05-20T22:38:39.359294+0000 mgr.y (mgr.14592) 1204 : cluster 0 pgmap v1631: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:41.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:41 smithi050 bash[21866]: audit 2024-05-20T22:38:40.745443+0000 mon.a (mon.0) 3805 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:38:41.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:41 smithi050 bash[28929]: audit 2024-05-20T22:38:40.745443+0000 mon.a (mon.0) 3805 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:38:42.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:41 smithi145 bash[23893]: audit 2024-05-20T22:38:40.745443+0000 mon.a (mon.0) 3805 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:38:42.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:42 smithi050 bash[21866]: cluster 2024-05-20T22:38:41.362249+0000 mgr.y (mgr.14592) 1205 : cluster 0 pgmap v1632: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:42.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:42 smithi050 bash[28929]: cluster 2024-05-20T22:38:41.362249+0000 mgr.y (mgr.14592) 1205 : cluster 0 pgmap v1632: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:43.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:42 smithi145 bash[23893]: cluster 2024-05-20T22:38:41.362249+0000 mgr.y (mgr.14592) 1205 : cluster 0 pgmap v1632: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:44.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:44 smithi050 bash[21866]: cluster 2024-05-20T22:38:43.363206+0000 mgr.y (mgr.14592) 1206 : cluster 0 pgmap v1633: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:44.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:44 smithi050 bash[28929]: cluster 2024-05-20T22:38:43.363206+0000 mgr.y (mgr.14592) 1206 : cluster 0 pgmap v1633: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:45.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:44 smithi145 bash[23893]: cluster 2024-05-20T22:38:43.363206+0000 mgr.y (mgr.14592) 1206 : cluster 0 pgmap v1633: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:46.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:46 smithi050 bash[21866]: cluster 2024-05-20T22:38:45.366092+0000 mgr.y (mgr.14592) 1207 : cluster 0 pgmap v1634: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:46.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:46 smithi050 bash[28929]: cluster 2024-05-20T22:38:45.366092+0000 mgr.y (mgr.14592) 1207 : cluster 0 pgmap v1634: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:47.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:46 smithi145 bash[23893]: cluster 2024-05-20T22:38:45.366092+0000 mgr.y (mgr.14592) 1207 : cluster 0 pgmap v1634: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:48.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:48 smithi050 bash[21866]: cluster 2024-05-20T22:38:47.367016+0000 mgr.y (mgr.14592) 1208 : cluster 0 pgmap v1635: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:48.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:48 smithi050 bash[28929]: cluster 2024-05-20T22:38:47.367016+0000 mgr.y (mgr.14592) 1208 : cluster 0 pgmap v1635: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:49.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:48 smithi145 bash[23893]: cluster 2024-05-20T22:38:47.367016+0000 mgr.y (mgr.14592) 1208 : cluster 0 pgmap v1635: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:49.636 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:38:49 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:38:49.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:38:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:38:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:38:50.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:50 smithi050 bash[21866]: audit 2024-05-20T22:38:49.225582+0000 mgr.y (mgr.14592) 1209 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:38:50.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:50 smithi050 bash[21866]: cluster 2024-05-20T22:38:49.368099+0000 mgr.y (mgr.14592) 1210 : cluster 0 pgmap v1636: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:50.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:50 smithi050 bash[28929]: audit 2024-05-20T22:38:49.225582+0000 mgr.y (mgr.14592) 1209 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:38:50.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:50 smithi050 bash[28929]: cluster 2024-05-20T22:38:49.368099+0000 mgr.y (mgr.14592) 1210 : cluster 0 pgmap v1636: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:51.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:50 smithi145 bash[23893]: audit 2024-05-20T22:38:49.225582+0000 mgr.y (mgr.14592) 1209 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:38:51.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:50 smithi145 bash[23893]: cluster 2024-05-20T22:38:49.368099+0000 mgr.y (mgr.14592) 1210 : cluster 0 pgmap v1636: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:52.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:52 smithi050 bash[21866]: cluster 2024-05-20T22:38:51.371109+0000 mgr.y (mgr.14592) 1211 : cluster 0 pgmap v1637: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:52.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:52 smithi050 bash[28929]: cluster 2024-05-20T22:38:51.371109+0000 mgr.y (mgr.14592) 1211 : cluster 0 pgmap v1637: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:53.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:52 smithi145 bash[23893]: cluster 2024-05-20T22:38:51.371109+0000 mgr.y (mgr.14592) 1211 : cluster 0 pgmap v1637: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:54.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:54 smithi050 bash[21866]: cluster 2024-05-20T22:38:53.372067+0000 mgr.y (mgr.14592) 1212 : cluster 0 pgmap v1638: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:54.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:54 smithi050 bash[28929]: cluster 2024-05-20T22:38:53.372067+0000 mgr.y (mgr.14592) 1212 : cluster 0 pgmap v1638: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:55.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:54 smithi145 bash[23893]: cluster 2024-05-20T22:38:53.372067+0000 mgr.y (mgr.14592) 1212 : cluster 0 pgmap v1638: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:56.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:56 smithi050 bash[21866]: cluster 2024-05-20T22:38:55.375008+0000 mgr.y (mgr.14592) 1213 : cluster 0 pgmap v1639: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:56.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:56 smithi050 bash[21866]: audit 2024-05-20T22:38:55.777202+0000 mon.a (mon.0) 3806 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:38:56.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:56 smithi050 bash[28929]: cluster 2024-05-20T22:38:55.375008+0000 mgr.y (mgr.14592) 1213 : cluster 0 pgmap v1639: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:56.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:56 smithi050 bash[28929]: audit 2024-05-20T22:38:55.777202+0000 mon.a (mon.0) 3806 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:38:57.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:56 smithi145 bash[23893]: cluster 2024-05-20T22:38:55.375008+0000 mgr.y (mgr.14592) 1213 : cluster 0 pgmap v1639: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:38:57.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:56 smithi145 bash[23893]: audit 2024-05-20T22:38:55.777202+0000 mon.a (mon.0) 3806 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:38:58.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:38:58 smithi050 bash[21866]: cluster 2024-05-20T22:38:57.375971+0000 mgr.y (mgr.14592) 1214 : cluster 0 pgmap v1640: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:58.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:38:58 smithi050 bash[28929]: cluster 2024-05-20T22:38:57.375971+0000 mgr.y (mgr.14592) 1214 : cluster 0 pgmap v1640: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:59.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:38:58 smithi145 bash[23893]: cluster 2024-05-20T22:38:57.375971+0000 mgr.y (mgr.14592) 1214 : cluster 0 pgmap v1640: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:38:59.636 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:38:59 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:38:59.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:38:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:38:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:39:01.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:00 smithi145 bash[23893]: audit 2024-05-20T22:38:59.236876+0000 mgr.y (mgr.14592) 1215 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:39:01.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:00 smithi145 bash[23893]: cluster 2024-05-20T22:38:59.376892+0000 mgr.y (mgr.14592) 1216 : cluster 0 pgmap v1641: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:01.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:00 smithi050 bash[21866]: audit 2024-05-20T22:38:59.236876+0000 mgr.y (mgr.14592) 1215 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:39:01.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:00 smithi050 bash[21866]: cluster 2024-05-20T22:38:59.376892+0000 mgr.y (mgr.14592) 1216 : cluster 0 pgmap v1641: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:01.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:00 smithi050 bash[28929]: audit 2024-05-20T22:38:59.236876+0000 mgr.y (mgr.14592) 1215 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:39:01.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:00 smithi050 bash[28929]: cluster 2024-05-20T22:38:59.376892+0000 mgr.y (mgr.14592) 1216 : cluster 0 pgmap v1641: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:03.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:02 smithi145 bash[23893]: cluster 2024-05-20T22:39:01.379915+0000 mgr.y (mgr.14592) 1217 : cluster 0 pgmap v1642: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:03.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:02 smithi050 bash[21866]: cluster 2024-05-20T22:39:01.379915+0000 mgr.y (mgr.14592) 1217 : cluster 0 pgmap v1642: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:03.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:02 smithi050 bash[28929]: cluster 2024-05-20T22:39:01.379915+0000 mgr.y (mgr.14592) 1217 : cluster 0 pgmap v1642: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:05.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:04 smithi145 bash[23893]: cluster 2024-05-20T22:39:03.380927+0000 mgr.y (mgr.14592) 1218 : cluster 0 pgmap v1643: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:05.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:04 smithi050 bash[21866]: cluster 2024-05-20T22:39:03.380927+0000 mgr.y (mgr.14592) 1218 : cluster 0 pgmap v1643: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:05.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:04 smithi050 bash[28929]: cluster 2024-05-20T22:39:03.380927+0000 mgr.y (mgr.14592) 1218 : cluster 0 pgmap v1643: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:07.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:06 smithi145 bash[23893]: cluster 2024-05-20T22:39:05.383882+0000 mgr.y (mgr.14592) 1219 : cluster 0 pgmap v1644: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:07.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:06 smithi050 bash[21866]: cluster 2024-05-20T22:39:05.383882+0000 mgr.y (mgr.14592) 1219 : cluster 0 pgmap v1644: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:07.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:06 smithi050 bash[28929]: cluster 2024-05-20T22:39:05.383882+0000 mgr.y (mgr.14592) 1219 : cluster 0 pgmap v1644: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:09.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:08 smithi145 bash[23893]: cluster 2024-05-20T22:39:07.384827+0000 mgr.y (mgr.14592) 1220 : cluster 0 pgmap v1645: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:09.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:08 smithi050 bash[21866]: cluster 2024-05-20T22:39:07.384827+0000 mgr.y (mgr.14592) 1220 : cluster 0 pgmap v1645: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:09.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:08 smithi050 bash[28929]: cluster 2024-05-20T22:39:07.384827+0000 mgr.y (mgr.14592) 1220 : cluster 0 pgmap v1645: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:09.636 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:39:09 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:39:09.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:39:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:39:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:39:11.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:10 smithi145 bash[23893]: audit 2024-05-20T22:39:09.248242+0000 mgr.y (mgr.14592) 1221 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:39:11.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:10 smithi145 bash[23893]: cluster 2024-05-20T22:39:09.385748+0000 mgr.y (mgr.14592) 1222 : cluster 0 pgmap v1646: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:11.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:10 smithi050 bash[21866]: audit 2024-05-20T22:39:09.248242+0000 mgr.y (mgr.14592) 1221 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:39:11.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:10 smithi050 bash[21866]: cluster 2024-05-20T22:39:09.385748+0000 mgr.y (mgr.14592) 1222 : cluster 0 pgmap v1646: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:11.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:10 smithi050 bash[28929]: audit 2024-05-20T22:39:09.248242+0000 mgr.y (mgr.14592) 1221 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:39:11.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:10 smithi050 bash[28929]: cluster 2024-05-20T22:39:09.385748+0000 mgr.y (mgr.14592) 1222 : cluster 0 pgmap v1646: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:12.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:11 smithi145 bash[23893]: audit 2024-05-20T22:39:10.809475+0000 mon.a (mon.0) 3807 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:39:12.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:11 smithi050 bash[21866]: audit 2024-05-20T22:39:10.809475+0000 mon.a (mon.0) 3807 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:39:12.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:11 smithi050 bash[28929]: audit 2024-05-20T22:39:10.809475+0000 mon.a (mon.0) 3807 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:39:13.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:12 smithi145 bash[23893]: cluster 2024-05-20T22:39:11.388743+0000 mgr.y (mgr.14592) 1223 : cluster 0 pgmap v1647: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:13.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:12 smithi050 bash[21866]: cluster 2024-05-20T22:39:11.388743+0000 mgr.y (mgr.14592) 1223 : cluster 0 pgmap v1647: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:13.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:12 smithi050 bash[28929]: cluster 2024-05-20T22:39:11.388743+0000 mgr.y (mgr.14592) 1223 : cluster 0 pgmap v1647: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:15.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:14 smithi145 bash[23893]: cluster 2024-05-20T22:39:13.389665+0000 mgr.y (mgr.14592) 1224 : cluster 0 pgmap v1648: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:15.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:14 smithi050 bash[21866]: cluster 2024-05-20T22:39:13.389665+0000 mgr.y (mgr.14592) 1224 : cluster 0 pgmap v1648: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:15.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:14 smithi050 bash[28929]: cluster 2024-05-20T22:39:13.389665+0000 mgr.y (mgr.14592) 1224 : cluster 0 pgmap v1648: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:17.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:16 smithi145 bash[23893]: cluster 2024-05-20T22:39:15.392603+0000 mgr.y (mgr.14592) 1225 : cluster 0 pgmap v1649: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:17.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:16 smithi050 bash[21866]: cluster 2024-05-20T22:39:15.392603+0000 mgr.y (mgr.14592) 1225 : cluster 0 pgmap v1649: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:17.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:16 smithi050 bash[28929]: cluster 2024-05-20T22:39:15.392603+0000 mgr.y (mgr.14592) 1225 : cluster 0 pgmap v1649: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:19.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:18 smithi145 bash[23893]: cluster 2024-05-20T22:39:17.393660+0000 mgr.y (mgr.14592) 1226 : cluster 0 pgmap v1650: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:19.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:18 smithi050 bash[21866]: cluster 2024-05-20T22:39:17.393660+0000 mgr.y (mgr.14592) 1226 : cluster 0 pgmap v1650: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:19.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:18 smithi050 bash[28929]: cluster 2024-05-20T22:39:17.393660+0000 mgr.y (mgr.14592) 1226 : cluster 0 pgmap v1650: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:19.636 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:39:19 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:39:19.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:39:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:39:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:39:21.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:20 smithi145 bash[23893]: audit 2024-05-20T22:39:19.257451+0000 mgr.y (mgr.14592) 1227 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:39:21.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:20 smithi145 bash[23893]: cluster 2024-05-20T22:39:19.394724+0000 mgr.y (mgr.14592) 1228 : cluster 0 pgmap v1651: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:21.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:20 smithi050 bash[21866]: audit 2024-05-20T22:39:19.257451+0000 mgr.y (mgr.14592) 1227 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:39:21.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:20 smithi050 bash[21866]: cluster 2024-05-20T22:39:19.394724+0000 mgr.y (mgr.14592) 1228 : cluster 0 pgmap v1651: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:21.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:20 smithi050 bash[28929]: audit 2024-05-20T22:39:19.257451+0000 mgr.y (mgr.14592) 1227 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:39:21.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:20 smithi050 bash[28929]: cluster 2024-05-20T22:39:19.394724+0000 mgr.y (mgr.14592) 1228 : cluster 0 pgmap v1651: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:23.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:22 smithi145 bash[23893]: cluster 2024-05-20T22:39:21.397747+0000 mgr.y (mgr.14592) 1229 : cluster 0 pgmap v1652: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:23.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:22 smithi050 bash[21866]: cluster 2024-05-20T22:39:21.397747+0000 mgr.y (mgr.14592) 1229 : cluster 0 pgmap v1652: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:23.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:22 smithi050 bash[28929]: cluster 2024-05-20T22:39:21.397747+0000 mgr.y (mgr.14592) 1229 : cluster 0 pgmap v1652: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:25.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:24 smithi145 bash[23893]: cluster 2024-05-20T22:39:23.398653+0000 mgr.y (mgr.14592) 1230 : cluster 0 pgmap v1653: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:25.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:24 smithi050 bash[21866]: cluster 2024-05-20T22:39:23.398653+0000 mgr.y (mgr.14592) 1230 : cluster 0 pgmap v1653: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:25.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:24 smithi050 bash[28929]: cluster 2024-05-20T22:39:23.398653+0000 mgr.y (mgr.14592) 1230 : cluster 0 pgmap v1653: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:27.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:26 smithi145 bash[23893]: cluster 2024-05-20T22:39:25.401526+0000 mgr.y (mgr.14592) 1231 : cluster 0 pgmap v1654: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:27.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:26 smithi145 bash[23893]: audit 2024-05-20T22:39:25.842356+0000 mon.a (mon.0) 3808 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:39:27.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:26 smithi050 bash[21866]: cluster 2024-05-20T22:39:25.401526+0000 mgr.y (mgr.14592) 1231 : cluster 0 pgmap v1654: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:27.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:26 smithi050 bash[21866]: audit 2024-05-20T22:39:25.842356+0000 mon.a (mon.0) 3808 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:39:27.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:26 smithi050 bash[28929]: cluster 2024-05-20T22:39:25.401526+0000 mgr.y (mgr.14592) 1231 : cluster 0 pgmap v1654: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:27.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:26 smithi050 bash[28929]: audit 2024-05-20T22:39:25.842356+0000 mon.a (mon.0) 3808 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:39:29.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:28 smithi145 bash[23893]: cluster 2024-05-20T22:39:27.402553+0000 mgr.y (mgr.14592) 1232 : cluster 0 pgmap v1655: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:29.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:28 smithi050 bash[21866]: cluster 2024-05-20T22:39:27.402553+0000 mgr.y (mgr.14592) 1232 : cluster 0 pgmap v1655: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:29.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:28 smithi050 bash[28929]: cluster 2024-05-20T22:39:27.402553+0000 mgr.y (mgr.14592) 1232 : cluster 0 pgmap v1655: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:29.636 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:39:29 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:39:29.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:39:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:39:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:39:31.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:30 smithi145 bash[23893]: audit 2024-05-20T22:39:29.265330+0000 mgr.y (mgr.14592) 1233 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:39:31.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:30 smithi145 bash[23893]: cluster 2024-05-20T22:39:29.403613+0000 mgr.y (mgr.14592) 1234 : cluster 0 pgmap v1656: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:31.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:30 smithi050 bash[21866]: audit 2024-05-20T22:39:29.265330+0000 mgr.y (mgr.14592) 1233 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:39:31.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:30 smithi050 bash[21866]: cluster 2024-05-20T22:39:29.403613+0000 mgr.y (mgr.14592) 1234 : cluster 0 pgmap v1656: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:31.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:30 smithi050 bash[28929]: audit 2024-05-20T22:39:29.265330+0000 mgr.y (mgr.14592) 1233 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:39:31.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:30 smithi050 bash[28929]: cluster 2024-05-20T22:39:29.403613+0000 mgr.y (mgr.14592) 1234 : cluster 0 pgmap v1656: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:33.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:32 smithi145 bash[23893]: cluster 2024-05-20T22:39:31.406607+0000 mgr.y (mgr.14592) 1235 : cluster 0 pgmap v1657: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:33.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:32 smithi050 bash[21866]: cluster 2024-05-20T22:39:31.406607+0000 mgr.y (mgr.14592) 1235 : cluster 0 pgmap v1657: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:33.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:32 smithi050 bash[28929]: cluster 2024-05-20T22:39:31.406607+0000 mgr.y (mgr.14592) 1235 : cluster 0 pgmap v1657: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:35.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:34 smithi145 bash[23893]: cluster 2024-05-20T22:39:33.407552+0000 mgr.y (mgr.14592) 1236 : cluster 0 pgmap v1658: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:35.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:34 smithi050 bash[21866]: cluster 2024-05-20T22:39:33.407552+0000 mgr.y (mgr.14592) 1236 : cluster 0 pgmap v1658: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:35.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:34 smithi050 bash[28929]: cluster 2024-05-20T22:39:33.407552+0000 mgr.y (mgr.14592) 1236 : cluster 0 pgmap v1658: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:37.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:36 smithi145 bash[23893]: cluster 2024-05-20T22:39:35.410475+0000 mgr.y (mgr.14592) 1237 : cluster 0 pgmap v1659: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:37.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:36 smithi050 bash[21866]: cluster 2024-05-20T22:39:35.410475+0000 mgr.y (mgr.14592) 1237 : cluster 0 pgmap v1659: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:37.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:36 smithi050 bash[28929]: cluster 2024-05-20T22:39:35.410475+0000 mgr.y (mgr.14592) 1237 : cluster 0 pgmap v1659: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:39.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:38 smithi145 bash[23893]: cluster 2024-05-20T22:39:37.411531+0000 mgr.y (mgr.14592) 1238 : cluster 0 pgmap v1660: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:39.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:38 smithi145 bash[23893]: audit 2024-05-20T22:39:38.536055+0000 mon.a (mon.0) 3809 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:39:39.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:38 smithi050 bash[21866]: cluster 2024-05-20T22:39:37.411531+0000 mgr.y (mgr.14592) 1238 : cluster 0 pgmap v1660: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:39.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:38 smithi050 bash[21866]: audit 2024-05-20T22:39:38.536055+0000 mon.a (mon.0) 3809 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:39:39.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:38 smithi050 bash[28929]: cluster 2024-05-20T22:39:37.411531+0000 mgr.y (mgr.14592) 1238 : cluster 0 pgmap v1660: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:39.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:38 smithi050 bash[28929]: audit 2024-05-20T22:39:38.536055+0000 mon.a (mon.0) 3809 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:39:39.635 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:39:39 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:39:39.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:39:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:39:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:39:40.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:40 smithi145 bash[23893]: audit 2024-05-20T22:39:39.070342+0000 mon.a (mon.0) 3810 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:40.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:40 smithi145 bash[23893]: audit 2024-05-20T22:39:39.076042+0000 mon.a (mon.0) 3811 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:40.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:40 smithi145 bash[23893]: audit 2024-05-20T22:39:39.276412+0000 mgr.y (mgr.14592) 1239 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:39:40.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:40 smithi145 bash[23893]: cluster 2024-05-20T22:39:39.412497+0000 mgr.y (mgr.14592) 1240 : cluster 0 pgmap v1661: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:40.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:40 smithi050 bash[21866]: audit 2024-05-20T22:39:39.070342+0000 mon.a (mon.0) 3810 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:40.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:40 smithi050 bash[21866]: audit 2024-05-20T22:39:39.076042+0000 mon.a (mon.0) 3811 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:40.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:40 smithi050 bash[21866]: audit 2024-05-20T22:39:39.276412+0000 mgr.y (mgr.14592) 1239 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:39:40.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:40 smithi050 bash[21866]: cluster 2024-05-20T22:39:39.412497+0000 mgr.y (mgr.14592) 1240 : cluster 0 pgmap v1661: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:40.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:40 smithi050 bash[28929]: audit 2024-05-20T22:39:39.070342+0000 mon.a (mon.0) 3810 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:40.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:40 smithi050 bash[28929]: audit 2024-05-20T22:39:39.076042+0000 mon.a (mon.0) 3811 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:40.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:40 smithi050 bash[28929]: audit 2024-05-20T22:39:39.276412+0000 mgr.y (mgr.14592) 1239 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:39:40.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:40 smithi050 bash[28929]: cluster 2024-05-20T22:39:39.412497+0000 mgr.y (mgr.14592) 1240 : cluster 0 pgmap v1661: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:41.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:41 smithi145 bash[23893]: audit 2024-05-20T22:39:40.875341+0000 mon.a (mon.0) 3812 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:39:41.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:41 smithi050 bash[21866]: audit 2024-05-20T22:39:40.875341+0000 mon.a (mon.0) 3812 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:39:41.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:41 smithi050 bash[28929]: audit 2024-05-20T22:39:40.875341+0000 mon.a (mon.0) 3812 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:39:42.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:42 smithi145 bash[23893]: cluster 2024-05-20T22:39:41.415450+0000 mgr.y (mgr.14592) 1241 : cluster 0 pgmap v1662: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:42.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:42 smithi050 bash[21866]: cluster 2024-05-20T22:39:41.415450+0000 mgr.y (mgr.14592) 1241 : cluster 0 pgmap v1662: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:42.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:42 smithi050 bash[28929]: cluster 2024-05-20T22:39:41.415450+0000 mgr.y (mgr.14592) 1241 : cluster 0 pgmap v1662: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:44.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:44 smithi145 bash[23893]: cluster 2024-05-20T22:39:43.416405+0000 mgr.y (mgr.14592) 1242 : cluster 0 pgmap v1663: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:44.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:44 smithi145 bash[23893]: audit 2024-05-20T22:39:44.176801+0000 mon.a (mon.0) 3813 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:44.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:44 smithi145 bash[23893]: audit 2024-05-20T22:39:44.180930+0000 mon.a (mon.0) 3814 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:44.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:44 smithi050 bash[21866]: cluster 2024-05-20T22:39:43.416405+0000 mgr.y (mgr.14592) 1242 : cluster 0 pgmap v1663: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:44.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:44 smithi050 bash[21866]: audit 2024-05-20T22:39:44.176801+0000 mon.a (mon.0) 3813 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:44.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:44 smithi050 bash[21866]: audit 2024-05-20T22:39:44.180930+0000 mon.a (mon.0) 3814 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:44.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:44 smithi050 bash[28929]: cluster 2024-05-20T22:39:43.416405+0000 mgr.y (mgr.14592) 1242 : cluster 0 pgmap v1663: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:44.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:44 smithi050 bash[28929]: audit 2024-05-20T22:39:44.176801+0000 mon.a (mon.0) 3813 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:44.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:44 smithi050 bash[28929]: audit 2024-05-20T22:39:44.180930+0000 mon.a (mon.0) 3814 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:46.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:46 smithi145 bash[23893]: audit 2024-05-20T22:39:45.051725+0000 mon.a (mon.0) 3815 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:46.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:46 smithi145 bash[23893]: audit 2024-05-20T22:39:45.061914+0000 mon.a (mon.0) 3816 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:46.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:46 smithi145 bash[23893]: cluster 2024-05-20T22:39:45.419331+0000 mgr.y (mgr.14592) 1243 : cluster 0 pgmap v1664: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:46.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:46 smithi145 bash[23893]: audit 2024-05-20T22:39:45.669491+0000 mon.a (mon.0) 3817 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:39:46.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:46 smithi145 bash[23893]: audit 2024-05-20T22:39:45.671138+0000 mon.a (mon.0) 3818 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:39:46.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:46 smithi145 bash[23893]: audit 2024-05-20T22:39:45.680881+0000 mon.a (mon.0) 3819 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:46.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:46 smithi050 bash[21866]: audit 2024-05-20T22:39:45.051725+0000 mon.a (mon.0) 3815 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:46.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:46 smithi050 bash[21866]: audit 2024-05-20T22:39:45.061914+0000 mon.a (mon.0) 3816 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:46.441 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:46 smithi050 bash[21866]: cluster 2024-05-20T22:39:45.419331+0000 mgr.y (mgr.14592) 1243 : cluster 0 pgmap v1664: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:46.441 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:46 smithi050 bash[21866]: audit 2024-05-20T22:39:45.669491+0000 mon.a (mon.0) 3817 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:39:46.441 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:46 smithi050 bash[21866]: audit 2024-05-20T22:39:45.671138+0000 mon.a (mon.0) 3818 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:39:46.441 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:46 smithi050 bash[21866]: audit 2024-05-20T22:39:45.680881+0000 mon.a (mon.0) 3819 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:46.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:46 smithi050 bash[28929]: audit 2024-05-20T22:39:45.051725+0000 mon.a (mon.0) 3815 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:46.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:46 smithi050 bash[28929]: audit 2024-05-20T22:39:45.061914+0000 mon.a (mon.0) 3816 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:46.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:46 smithi050 bash[28929]: cluster 2024-05-20T22:39:45.419331+0000 mgr.y (mgr.14592) 1243 : cluster 0 pgmap v1664: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:46.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:46 smithi050 bash[28929]: audit 2024-05-20T22:39:45.669491+0000 mon.a (mon.0) 3817 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:39:46.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:46 smithi050 bash[28929]: audit 2024-05-20T22:39:45.671138+0000 mon.a (mon.0) 3818 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:39:46.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:46 smithi050 bash[28929]: audit 2024-05-20T22:39:45.680881+0000 mon.a (mon.0) 3819 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:39:48.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:48 smithi145 bash[23893]: cluster 2024-05-20T22:39:47.420260+0000 mgr.y (mgr.14592) 1244 : cluster 0 pgmap v1665: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:48.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:48 smithi050 bash[21866]: cluster 2024-05-20T22:39:47.420260+0000 mgr.y (mgr.14592) 1244 : cluster 0 pgmap v1665: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:48.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:48 smithi050 bash[28929]: cluster 2024-05-20T22:39:47.420260+0000 mgr.y (mgr.14592) 1244 : cluster 0 pgmap v1665: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:49.636 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:39:49 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:39:49.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:39:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:39:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:39:50.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:50 smithi145 bash[23893]: audit 2024-05-20T22:39:49.287631+0000 mgr.y (mgr.14592) 1245 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:39:50.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:50 smithi145 bash[23893]: cluster 2024-05-20T22:39:49.421154+0000 mgr.y (mgr.14592) 1246 : cluster 0 pgmap v1666: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:50.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:50 smithi050 bash[21866]: audit 2024-05-20T22:39:49.287631+0000 mgr.y (mgr.14592) 1245 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:39:50.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:50 smithi050 bash[21866]: cluster 2024-05-20T22:39:49.421154+0000 mgr.y (mgr.14592) 1246 : cluster 0 pgmap v1666: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:50.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:50 smithi050 bash[28929]: audit 2024-05-20T22:39:49.287631+0000 mgr.y (mgr.14592) 1245 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:39:50.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:50 smithi050 bash[28929]: cluster 2024-05-20T22:39:49.421154+0000 mgr.y (mgr.14592) 1246 : cluster 0 pgmap v1666: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:52.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:52 smithi145 bash[23893]: cluster 2024-05-20T22:39:51.424129+0000 mgr.y (mgr.14592) 1247 : cluster 0 pgmap v1667: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:52.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:52 smithi050 bash[21866]: cluster 2024-05-20T22:39:51.424129+0000 mgr.y (mgr.14592) 1247 : cluster 0 pgmap v1667: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:52.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:52 smithi050 bash[28929]: cluster 2024-05-20T22:39:51.424129+0000 mgr.y (mgr.14592) 1247 : cluster 0 pgmap v1667: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:54.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:54 smithi145 bash[23893]: cluster 2024-05-20T22:39:53.425042+0000 mgr.y (mgr.14592) 1248 : cluster 0 pgmap v1668: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:54.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:54 smithi050 bash[21866]: cluster 2024-05-20T22:39:53.425042+0000 mgr.y (mgr.14592) 1248 : cluster 0 pgmap v1668: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:54.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:54 smithi050 bash[28929]: cluster 2024-05-20T22:39:53.425042+0000 mgr.y (mgr.14592) 1248 : cluster 0 pgmap v1668: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:57.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:56 smithi145 bash[23893]: cluster 2024-05-20T22:39:55.427950+0000 mgr.y (mgr.14592) 1249 : cluster 0 pgmap v1669: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:57.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:56 smithi145 bash[23893]: audit 2024-05-20T22:39:55.907625+0000 mon.a (mon.0) 3820 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:39:57.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:56 smithi050 bash[21866]: cluster 2024-05-20T22:39:55.427950+0000 mgr.y (mgr.14592) 1249 : cluster 0 pgmap v1669: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:57.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:56 smithi050 bash[21866]: audit 2024-05-20T22:39:55.907625+0000 mon.a (mon.0) 3820 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:39:57.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:56 smithi050 bash[28929]: cluster 2024-05-20T22:39:55.427950+0000 mgr.y (mgr.14592) 1249 : cluster 0 pgmap v1669: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:39:57.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:56 smithi050 bash[28929]: audit 2024-05-20T22:39:55.907625+0000 mon.a (mon.0) 3820 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:39:59.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:39:58 smithi145 bash[23893]: cluster 2024-05-20T22:39:57.428901+0000 mgr.y (mgr.14592) 1250 : cluster 0 pgmap v1670: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:59.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:39:58 smithi050 bash[21866]: cluster 2024-05-20T22:39:57.428901+0000 mgr.y (mgr.14592) 1250 : cluster 0 pgmap v1670: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:59.225 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:39:58 smithi050 bash[28929]: cluster 2024-05-20T22:39:57.428901+0000 mgr.y (mgr.14592) 1250 : cluster 0 pgmap v1670: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:39:59.635 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:39:59 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:39:59.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:39:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:39:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:40:01.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:00 smithi145 bash[23893]: audit 2024-05-20T22:39:59.293270+0000 mgr.y (mgr.14592) 1251 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:40:01.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:00 smithi145 bash[23893]: cluster 2024-05-20T22:39:59.429830+0000 mgr.y (mgr.14592) 1252 : cluster 0 pgmap v1671: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:01.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:00 smithi145 bash[23893]: cluster 2024-05-20T22:40:00.000155+0000 mon.a (mon.0) 3821 : cluster 3 overall HEALTH_WARN 6 pool(s) do not have an application enabled 2024-05-20T22:40:01.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:00 smithi050 bash[21866]: audit 2024-05-20T22:39:59.293270+0000 mgr.y (mgr.14592) 1251 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:40:01.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:00 smithi050 bash[21866]: cluster 2024-05-20T22:39:59.429830+0000 mgr.y (mgr.14592) 1252 : cluster 0 pgmap v1671: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:01.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:00 smithi050 bash[21866]: cluster 2024-05-20T22:40:00.000155+0000 mon.a (mon.0) 3821 : cluster 3 overall HEALTH_WARN 6 pool(s) do not have an application enabled 2024-05-20T22:40:01.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:00 smithi050 bash[28929]: audit 2024-05-20T22:39:59.293270+0000 mgr.y (mgr.14592) 1251 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:40:01.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:00 smithi050 bash[28929]: cluster 2024-05-20T22:39:59.429830+0000 mgr.y (mgr.14592) 1252 : cluster 0 pgmap v1671: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:01.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:00 smithi050 bash[28929]: cluster 2024-05-20T22:40:00.000155+0000 mon.a (mon.0) 3821 : cluster 3 overall HEALTH_WARN 6 pool(s) do not have an application enabled 2024-05-20T22:40:03.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:02 smithi050 bash[21866]: cluster 2024-05-20T22:40:01.432827+0000 mgr.y (mgr.14592) 1253 : cluster 0 pgmap v1672: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:03.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:02 smithi050 bash[28929]: cluster 2024-05-20T22:40:01.432827+0000 mgr.y (mgr.14592) 1253 : cluster 0 pgmap v1672: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:03.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:02 smithi145 bash[23893]: cluster 2024-05-20T22:40:01.432827+0000 mgr.y (mgr.14592) 1253 : cluster 0 pgmap v1672: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:05.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:04 smithi050 bash[21866]: cluster 2024-05-20T22:40:03.433754+0000 mgr.y (mgr.14592) 1254 : cluster 0 pgmap v1673: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:05.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:04 smithi050 bash[28929]: cluster 2024-05-20T22:40:03.433754+0000 mgr.y (mgr.14592) 1254 : cluster 0 pgmap v1673: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:05.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:04 smithi145 bash[23893]: cluster 2024-05-20T22:40:03.433754+0000 mgr.y (mgr.14592) 1254 : cluster 0 pgmap v1673: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:07.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:06 smithi050 bash[21866]: cluster 2024-05-20T22:40:05.436729+0000 mgr.y (mgr.14592) 1255 : cluster 0 pgmap v1674: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:07.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:06 smithi050 bash[28929]: cluster 2024-05-20T22:40:05.436729+0000 mgr.y (mgr.14592) 1255 : cluster 0 pgmap v1674: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:07.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:06 smithi145 bash[23893]: cluster 2024-05-20T22:40:05.436729+0000 mgr.y (mgr.14592) 1255 : cluster 0 pgmap v1674: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:09.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:08 smithi050 bash[28929]: cluster 2024-05-20T22:40:07.437644+0000 mgr.y (mgr.14592) 1256 : cluster 0 pgmap v1675: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:09.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:08 smithi050 bash[21866]: cluster 2024-05-20T22:40:07.437644+0000 mgr.y (mgr.14592) 1256 : cluster 0 pgmap v1675: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:09.296 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:08 smithi145 bash[23893]: cluster 2024-05-20T22:40:07.437644+0000 mgr.y (mgr.14592) 1256 : cluster 0 pgmap v1675: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:09.635 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:40:09 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:40:09.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:40:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:40:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:40:11.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:10 smithi050 bash[21866]: audit 2024-05-20T22:40:09.304535+0000 mgr.y (mgr.14592) 1257 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:40:11.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:10 smithi050 bash[21866]: cluster 2024-05-20T22:40:09.438556+0000 mgr.y (mgr.14592) 1258 : cluster 0 pgmap v1676: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:11.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:10 smithi050 bash[28929]: audit 2024-05-20T22:40:09.304535+0000 mgr.y (mgr.14592) 1257 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:40:11.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:10 smithi050 bash[28929]: cluster 2024-05-20T22:40:09.438556+0000 mgr.y (mgr.14592) 1258 : cluster 0 pgmap v1676: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:11.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:10 smithi145 bash[23893]: audit 2024-05-20T22:40:09.304535+0000 mgr.y (mgr.14592) 1257 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:40:11.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:10 smithi145 bash[23893]: cluster 2024-05-20T22:40:09.438556+0000 mgr.y (mgr.14592) 1258 : cluster 0 pgmap v1676: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:12.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:11 smithi050 bash[21866]: audit 2024-05-20T22:40:10.940589+0000 mon.a (mon.0) 3822 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:40:12.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:11 smithi050 bash[28929]: audit 2024-05-20T22:40:10.940589+0000 mon.a (mon.0) 3822 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:40:12.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:11 smithi145 bash[23893]: audit 2024-05-20T22:40:10.940589+0000 mon.a (mon.0) 3822 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:40:13.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:12 smithi050 bash[21866]: cluster 2024-05-20T22:40:11.441520+0000 mgr.y (mgr.14592) 1259 : cluster 0 pgmap v1677: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:13.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:12 smithi050 bash[28929]: cluster 2024-05-20T22:40:11.441520+0000 mgr.y (mgr.14592) 1259 : cluster 0 pgmap v1677: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:13.309 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.309 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.309 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.310 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.310 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.310 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.310 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.310 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.310 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.310 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.310 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.310 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.310 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.310 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.310 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.311 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.311 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.311 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.311 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.311 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.311 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.311 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.311 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.311 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.312 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.312 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.312 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.312 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.312 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.312 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.312 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.312 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.312 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.312 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.312 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.312 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.313 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.313 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.313 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.313 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.313 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.313 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.313 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.313 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.313 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.313 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.313 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.313 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.314 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.314 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.314 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.314 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.314 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.314 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.314 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.314 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.314 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.314 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.314 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.314 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.314 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.315 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.315 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.315 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.315 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.315 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.315 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.315 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.315 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.315 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.315 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.315 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.315 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.315 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.315 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.316 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.316 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.316 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.316 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.316 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.316 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.316 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.316 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.316 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.316 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.316 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.316 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.316 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.316 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.316 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:40:13.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:12 smithi145 bash[23893]: cluster 2024-05-20T22:40:11.441520+0000 mgr.y (mgr.14592) 1259 : cluster 0 pgmap v1677: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:15.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:14 smithi050 bash[21866]: cluster 2024-05-20T22:40:13.442435+0000 mgr.y (mgr.14592) 1260 : cluster 0 pgmap v1678: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:15.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:14 smithi050 bash[28929]: cluster 2024-05-20T22:40:13.442435+0000 mgr.y (mgr.14592) 1260 : cluster 0 pgmap v1678: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:15.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:14 smithi145 bash[23893]: cluster 2024-05-20T22:40:13.442435+0000 mgr.y (mgr.14592) 1260 : cluster 0 pgmap v1678: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:17.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:16 smithi050 bash[21866]: cluster 2024-05-20T22:40:15.445857+0000 mgr.y (mgr.14592) 1261 : cluster 0 pgmap v1679: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:17.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:16 smithi050 bash[28929]: cluster 2024-05-20T22:40:15.445857+0000 mgr.y (mgr.14592) 1261 : cluster 0 pgmap v1679: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:17.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:16 smithi145 bash[23893]: cluster 2024-05-20T22:40:15.445857+0000 mgr.y (mgr.14592) 1261 : cluster 0 pgmap v1679: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:19.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:18 smithi050 bash[21866]: cluster 2024-05-20T22:40:17.446779+0000 mgr.y (mgr.14592) 1262 : cluster 0 pgmap v1680: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:19.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:18 smithi050 bash[28929]: cluster 2024-05-20T22:40:17.446779+0000 mgr.y (mgr.14592) 1262 : cluster 0 pgmap v1680: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:19.307 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:18 smithi145 bash[23893]: cluster 2024-05-20T22:40:17.446779+0000 mgr.y (mgr.14592) 1262 : cluster 0 pgmap v1680: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:19.636 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:40:19 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:40:19.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:40:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:40:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:40:21.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:20 smithi050 bash[21866]: audit 2024-05-20T22:40:19.315773+0000 mgr.y (mgr.14592) 1263 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:40:21.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:20 smithi050 bash[21866]: cluster 2024-05-20T22:40:19.447660+0000 mgr.y (mgr.14592) 1264 : cluster 0 pgmap v1681: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:21.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:20 smithi050 bash[28929]: audit 2024-05-20T22:40:19.315773+0000 mgr.y (mgr.14592) 1263 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:40:21.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:20 smithi050 bash[28929]: cluster 2024-05-20T22:40:19.447660+0000 mgr.y (mgr.14592) 1264 : cluster 0 pgmap v1681: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:21.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:20 smithi145 bash[23893]: audit 2024-05-20T22:40:19.315773+0000 mgr.y (mgr.14592) 1263 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:40:21.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:20 smithi145 bash[23893]: cluster 2024-05-20T22:40:19.447660+0000 mgr.y (mgr.14592) 1264 : cluster 0 pgmap v1681: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:23.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:22 smithi145 bash[23893]: cluster 2024-05-20T22:40:21.450586+0000 mgr.y (mgr.14592) 1265 : cluster 0 pgmap v1682: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:23.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:22 smithi050 bash[21866]: cluster 2024-05-20T22:40:21.450586+0000 mgr.y (mgr.14592) 1265 : cluster 0 pgmap v1682: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:23.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:22 smithi050 bash[28929]: cluster 2024-05-20T22:40:21.450586+0000 mgr.y (mgr.14592) 1265 : cluster 0 pgmap v1682: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:25.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:24 smithi145 bash[23893]: cluster 2024-05-20T22:40:23.451514+0000 mgr.y (mgr.14592) 1266 : cluster 0 pgmap v1683: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:25.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:24 smithi050 bash[21866]: cluster 2024-05-20T22:40:23.451514+0000 mgr.y (mgr.14592) 1266 : cluster 0 pgmap v1683: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:25.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:24 smithi050 bash[28929]: cluster 2024-05-20T22:40:23.451514+0000 mgr.y (mgr.14592) 1266 : cluster 0 pgmap v1683: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:27.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:26 smithi145 bash[23893]: cluster 2024-05-20T22:40:25.454485+0000 mgr.y (mgr.14592) 1267 : cluster 0 pgmap v1684: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:27.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:26 smithi145 bash[23893]: audit 2024-05-20T22:40:25.972555+0000 mon.a (mon.0) 3823 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:40:27.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:26 smithi050 bash[21866]: cluster 2024-05-20T22:40:25.454485+0000 mgr.y (mgr.14592) 1267 : cluster 0 pgmap v1684: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:27.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:26 smithi050 bash[21866]: audit 2024-05-20T22:40:25.972555+0000 mon.a (mon.0) 3823 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:40:27.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:26 smithi050 bash[28929]: cluster 2024-05-20T22:40:25.454485+0000 mgr.y (mgr.14592) 1267 : cluster 0 pgmap v1684: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:27.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:26 smithi050 bash[28929]: audit 2024-05-20T22:40:25.972555+0000 mon.a (mon.0) 3823 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:40:29.317 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:28 smithi145 bash[23893]: cluster 2024-05-20T22:40:27.455402+0000 mgr.y (mgr.14592) 1268 : cluster 0 pgmap v1685: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:29.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:28 smithi050 bash[21866]: cluster 2024-05-20T22:40:27.455402+0000 mgr.y (mgr.14592) 1268 : cluster 0 pgmap v1685: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:29.388 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:28 smithi050 bash[28929]: cluster 2024-05-20T22:40:27.455402+0000 mgr.y (mgr.14592) 1268 : cluster 0 pgmap v1685: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:29.635 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:40:29 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:40:29.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:40:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:40:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:40:31.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:30 smithi145 bash[23893]: audit 2024-05-20T22:40:29.325119+0000 mgr.y (mgr.14592) 1269 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:40:31.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:30 smithi145 bash[23893]: cluster 2024-05-20T22:40:29.456339+0000 mgr.y (mgr.14592) 1270 : cluster 0 pgmap v1686: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:31.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:30 smithi050 bash[21866]: audit 2024-05-20T22:40:29.325119+0000 mgr.y (mgr.14592) 1269 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:40:31.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:30 smithi050 bash[21866]: cluster 2024-05-20T22:40:29.456339+0000 mgr.y (mgr.14592) 1270 : cluster 0 pgmap v1686: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:31.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:30 smithi050 bash[28929]: audit 2024-05-20T22:40:29.325119+0000 mgr.y (mgr.14592) 1269 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:40:31.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:30 smithi050 bash[28929]: cluster 2024-05-20T22:40:29.456339+0000 mgr.y (mgr.14592) 1270 : cluster 0 pgmap v1686: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:33.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:32 smithi145 bash[23893]: cluster 2024-05-20T22:40:31.459347+0000 mgr.y (mgr.14592) 1271 : cluster 0 pgmap v1687: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:33.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:32 smithi050 bash[21866]: cluster 2024-05-20T22:40:31.459347+0000 mgr.y (mgr.14592) 1271 : cluster 0 pgmap v1687: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:33.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:32 smithi050 bash[28929]: cluster 2024-05-20T22:40:31.459347+0000 mgr.y (mgr.14592) 1271 : cluster 0 pgmap v1687: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:35.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:34 smithi145 bash[23893]: cluster 2024-05-20T22:40:33.460439+0000 mgr.y (mgr.14592) 1272 : cluster 0 pgmap v1688: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:35.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:34 smithi050 bash[21866]: cluster 2024-05-20T22:40:33.460439+0000 mgr.y (mgr.14592) 1272 : cluster 0 pgmap v1688: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:35.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:34 smithi050 bash[28929]: cluster 2024-05-20T22:40:33.460439+0000 mgr.y (mgr.14592) 1272 : cluster 0 pgmap v1688: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:37.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:36 smithi145 bash[23893]: cluster 2024-05-20T22:40:35.463428+0000 mgr.y (mgr.14592) 1273 : cluster 0 pgmap v1689: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:37.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:36 smithi050 bash[21866]: cluster 2024-05-20T22:40:35.463428+0000 mgr.y (mgr.14592) 1273 : cluster 0 pgmap v1689: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:37.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:36 smithi050 bash[28929]: cluster 2024-05-20T22:40:35.463428+0000 mgr.y (mgr.14592) 1273 : cluster 0 pgmap v1689: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:39.328 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:38 smithi145 bash[23893]: cluster 2024-05-20T22:40:37.464340+0000 mgr.y (mgr.14592) 1274 : cluster 0 pgmap v1690: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:39.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:38 smithi050 bash[21866]: cluster 2024-05-20T22:40:37.464340+0000 mgr.y (mgr.14592) 1274 : cluster 0 pgmap v1690: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:39.387 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:38 smithi050 bash[28929]: cluster 2024-05-20T22:40:37.464340+0000 mgr.y (mgr.14592) 1274 : cluster 0 pgmap v1690: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:39.635 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:40:39 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:40:39.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:40:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:40:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:40:41.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:40 smithi145 bash[23893]: audit 2024-05-20T22:40:39.336431+0000 mgr.y (mgr.14592) 1275 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:40:41.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:40 smithi145 bash[23893]: cluster 2024-05-20T22:40:39.465223+0000 mgr.y (mgr.14592) 1276 : cluster 0 pgmap v1691: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:41.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:40 smithi050 bash[21866]: audit 2024-05-20T22:40:39.336431+0000 mgr.y (mgr.14592) 1275 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:40:41.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:40 smithi050 bash[21866]: cluster 2024-05-20T22:40:39.465223+0000 mgr.y (mgr.14592) 1276 : cluster 0 pgmap v1691: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:41.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:40 smithi050 bash[28929]: audit 2024-05-20T22:40:39.336431+0000 mgr.y (mgr.14592) 1275 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:40:41.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:40 smithi050 bash[28929]: cluster 2024-05-20T22:40:39.465223+0000 mgr.y (mgr.14592) 1276 : cluster 0 pgmap v1691: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:42.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:42 smithi145 bash[23893]: audit 2024-05-20T22:40:41.004473+0000 mon.a (mon.0) 3824 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:40:42.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:41 smithi050 bash[21866]: audit 2024-05-20T22:40:41.004473+0000 mon.a (mon.0) 3824 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:40:42.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:41 smithi050 bash[28929]: audit 2024-05-20T22:40:41.004473+0000 mon.a (mon.0) 3824 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:40:43.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:43 smithi145 bash[23893]: cluster 2024-05-20T22:40:41.468182+0000 mgr.y (mgr.14592) 1277 : cluster 0 pgmap v1692: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:43.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:43 smithi050 bash[21866]: cluster 2024-05-20T22:40:41.468182+0000 mgr.y (mgr.14592) 1277 : cluster 0 pgmap v1692: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:43.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:43 smithi050 bash[28929]: cluster 2024-05-20T22:40:41.468182+0000 mgr.y (mgr.14592) 1277 : cluster 0 pgmap v1692: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:45.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:45 smithi145 bash[23893]: cluster 2024-05-20T22:40:43.469062+0000 mgr.y (mgr.14592) 1278 : cluster 0 pgmap v1693: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:45.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:45 smithi050 bash[21866]: cluster 2024-05-20T22:40:43.469062+0000 mgr.y (mgr.14592) 1278 : cluster 0 pgmap v1693: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:45.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:45 smithi050 bash[28929]: cluster 2024-05-20T22:40:43.469062+0000 mgr.y (mgr.14592) 1278 : cluster 0 pgmap v1693: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:46.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:46 smithi145 bash[23893]: audit 2024-05-20T22:40:45.825235+0000 mon.a (mon.0) 3825 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:40:46.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:46 smithi050 bash[21866]: audit 2024-05-20T22:40:45.825235+0000 mon.a (mon.0) 3825 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:40:46.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:46 smithi050 bash[28929]: audit 2024-05-20T22:40:45.825235+0000 mon.a (mon.0) 3825 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:40:47.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:47 smithi145 bash[23893]: cluster 2024-05-20T22:40:45.472033+0000 mgr.y (mgr.14592) 1279 : cluster 0 pgmap v1694: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:47.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:47 smithi145 bash[23893]: audit 2024-05-20T22:40:46.570756+0000 mon.a (mon.0) 3826 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:40:47.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:47 smithi145 bash[23893]: audit 2024-05-20T22:40:46.572129+0000 mon.a (mon.0) 3827 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:40:47.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:47 smithi145 bash[23893]: audit 2024-05-20T22:40:46.579350+0000 mon.a (mon.0) 3828 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:40:47.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:47 smithi050 bash[21866]: cluster 2024-05-20T22:40:45.472033+0000 mgr.y (mgr.14592) 1279 : cluster 0 pgmap v1694: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:47.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:47 smithi050 bash[21866]: audit 2024-05-20T22:40:46.570756+0000 mon.a (mon.0) 3826 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:40:47.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:47 smithi050 bash[21866]: audit 2024-05-20T22:40:46.572129+0000 mon.a (mon.0) 3827 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:40:47.441 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:47 smithi050 bash[21866]: audit 2024-05-20T22:40:46.579350+0000 mon.a (mon.0) 3828 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:40:47.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:47 smithi050 bash[28929]: cluster 2024-05-20T22:40:45.472033+0000 mgr.y (mgr.14592) 1279 : cluster 0 pgmap v1694: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:47.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:47 smithi050 bash[28929]: audit 2024-05-20T22:40:46.570756+0000 mon.a (mon.0) 3826 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:40:47.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:47 smithi050 bash[28929]: audit 2024-05-20T22:40:46.572129+0000 mon.a (mon.0) 3827 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:40:47.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:47 smithi050 bash[28929]: audit 2024-05-20T22:40:46.579350+0000 mon.a (mon.0) 3828 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:40:49.340 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:49 smithi145 bash[23893]: cluster 2024-05-20T22:40:47.472867+0000 mgr.y (mgr.14592) 1280 : cluster 0 pgmap v1695: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:49.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:49 smithi050 bash[21866]: cluster 2024-05-20T22:40:47.472867+0000 mgr.y (mgr.14592) 1280 : cluster 0 pgmap v1695: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:49.388 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:49 smithi050 bash[28929]: cluster 2024-05-20T22:40:47.472867+0000 mgr.y (mgr.14592) 1280 : cluster 0 pgmap v1695: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:49.635 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:40:49 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:40:49.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:40:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:40:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:40:50.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:50 smithi145 bash[23893]: audit 2024-05-20T22:40:49.347751+0000 mgr.y (mgr.14592) 1281 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:40:50.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:50 smithi145 bash[23893]: cluster 2024-05-20T22:40:49.473741+0000 mgr.y (mgr.14592) 1282 : cluster 0 pgmap v1696: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:50.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:50 smithi050 bash[21866]: audit 2024-05-20T22:40:49.347751+0000 mgr.y (mgr.14592) 1281 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:40:50.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:50 smithi050 bash[21866]: cluster 2024-05-20T22:40:49.473741+0000 mgr.y (mgr.14592) 1282 : cluster 0 pgmap v1696: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:50.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:50 smithi050 bash[28929]: audit 2024-05-20T22:40:49.347751+0000 mgr.y (mgr.14592) 1281 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:40:50.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:50 smithi050 bash[28929]: cluster 2024-05-20T22:40:49.473741+0000 mgr.y (mgr.14592) 1282 : cluster 0 pgmap v1696: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:52.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:52 smithi145 bash[23893]: cluster 2024-05-20T22:40:51.476724+0000 mgr.y (mgr.14592) 1283 : cluster 0 pgmap v1697: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:52.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:52 smithi050 bash[21866]: cluster 2024-05-20T22:40:51.476724+0000 mgr.y (mgr.14592) 1283 : cluster 0 pgmap v1697: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:52.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:52 smithi050 bash[28929]: cluster 2024-05-20T22:40:51.476724+0000 mgr.y (mgr.14592) 1283 : cluster 0 pgmap v1697: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:54.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:54 smithi145 bash[23893]: cluster 2024-05-20T22:40:53.477665+0000 mgr.y (mgr.14592) 1284 : cluster 0 pgmap v1698: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:54.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:54 smithi050 bash[21866]: cluster 2024-05-20T22:40:53.477665+0000 mgr.y (mgr.14592) 1284 : cluster 0 pgmap v1698: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:54.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:54 smithi050 bash[28929]: cluster 2024-05-20T22:40:53.477665+0000 mgr.y (mgr.14592) 1284 : cluster 0 pgmap v1698: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:56.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:56 smithi145 bash[23893]: cluster 2024-05-20T22:40:55.480654+0000 mgr.y (mgr.14592) 1285 : cluster 0 pgmap v1699: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:56.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:56 smithi145 bash[23893]: audit 2024-05-20T22:40:56.055596+0000 mon.a (mon.0) 3829 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:40:56.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:56 smithi050 bash[21866]: cluster 2024-05-20T22:40:55.480654+0000 mgr.y (mgr.14592) 1285 : cluster 0 pgmap v1699: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:56.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:56 smithi050 bash[21866]: audit 2024-05-20T22:40:56.055596+0000 mon.a (mon.0) 3829 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:40:56.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:56 smithi050 bash[28929]: cluster 2024-05-20T22:40:55.480654+0000 mgr.y (mgr.14592) 1285 : cluster 0 pgmap v1699: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:40:56.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:56 smithi050 bash[28929]: audit 2024-05-20T22:40:56.055596+0000 mon.a (mon.0) 3829 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:40:58.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:40:58 smithi145 bash[23893]: cluster 2024-05-20T22:40:57.481618+0000 mgr.y (mgr.14592) 1286 : cluster 0 pgmap v1700: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:58.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:40:58 smithi050 bash[21866]: cluster 2024-05-20T22:40:57.481618+0000 mgr.y (mgr.14592) 1286 : cluster 0 pgmap v1700: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:58.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:40:58 smithi050 bash[28929]: cluster 2024-05-20T22:40:57.481618+0000 mgr.y (mgr.14592) 1286 : cluster 0 pgmap v1700: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:40:59.635 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:40:59 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:40:59.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:40:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:40:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:41:00.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:00 smithi145 bash[23893]: audit 2024-05-20T22:40:59.357136+0000 mgr.y (mgr.14592) 1287 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:41:00.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:00 smithi145 bash[23893]: cluster 2024-05-20T22:40:59.482608+0000 mgr.y (mgr.14592) 1288 : cluster 0 pgmap v1701: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:41:00.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:00 smithi050 bash[21866]: audit 2024-05-20T22:40:59.357136+0000 mgr.y (mgr.14592) 1287 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:41:00.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:00 smithi050 bash[21866]: cluster 2024-05-20T22:40:59.482608+0000 mgr.y (mgr.14592) 1288 : cluster 0 pgmap v1701: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:41:00.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:00 smithi050 bash[28929]: audit 2024-05-20T22:40:59.357136+0000 mgr.y (mgr.14592) 1287 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:41:00.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:00 smithi050 bash[28929]: cluster 2024-05-20T22:40:59.482608+0000 mgr.y (mgr.14592) 1288 : cluster 0 pgmap v1701: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:41:02.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:02 smithi145 bash[23893]: cluster 2024-05-20T22:41:01.485591+0000 mgr.y (mgr.14592) 1289 : cluster 0 pgmap v1702: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:02.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:02 smithi050 bash[21866]: cluster 2024-05-20T22:41:01.485591+0000 mgr.y (mgr.14592) 1289 : cluster 0 pgmap v1702: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:02.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:02 smithi050 bash[28929]: cluster 2024-05-20T22:41:01.485591+0000 mgr.y (mgr.14592) 1289 : cluster 0 pgmap v1702: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:04.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:04 smithi145 bash[23893]: cluster 2024-05-20T22:41:03.486513+0000 mgr.y (mgr.14592) 1290 : cluster 0 pgmap v1703: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:41:04.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:04 smithi145 bash[23893]: cluster 2024-05-20T22:41:03.571455+0000 mon.a (mon.0) 3830 : cluster 0 osdmap e759: 8 total, 8 up, 8 in 2024-05-20T22:41:04.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:04 smithi050 bash[21866]: cluster 2024-05-20T22:41:03.486513+0000 mgr.y (mgr.14592) 1290 : cluster 0 pgmap v1703: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:41:04.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:04 smithi050 bash[21866]: cluster 2024-05-20T22:41:03.571455+0000 mon.a (mon.0) 3830 : cluster 0 osdmap e759: 8 total, 8 up, 8 in 2024-05-20T22:41:04.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:04 smithi050 bash[28929]: cluster 2024-05-20T22:41:03.486513+0000 mgr.y (mgr.14592) 1290 : cluster 0 pgmap v1703: 324 pgs: 324 active+clean; 583 KiB data, 710 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:41:04.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:04 smithi050 bash[28929]: cluster 2024-05-20T22:41:03.571455+0000 mon.a (mon.0) 3830 : cluster 0 osdmap e759: 8 total, 8 up, 8 in 2024-05-20T22:41:05.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:05 smithi145 bash[23893]: cluster 2024-05-20T22:41:04.583820+0000 mon.a (mon.0) 3831 : cluster 0 osdmap e760: 8 total, 8 up, 8 in 2024-05-20T22:41:05.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:05 smithi145 bash[23893]: cluster 2024-05-20T22:41:05.580160+0000 mon.a (mon.0) 3832 : cluster 0 osdmap e761: 8 total, 8 up, 8 in 2024-05-20T22:41:05.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:05 smithi050 bash[21866]: cluster 2024-05-20T22:41:04.583820+0000 mon.a (mon.0) 3831 : cluster 0 osdmap e760: 8 total, 8 up, 8 in 2024-05-20T22:41:05.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:05 smithi050 bash[21866]: cluster 2024-05-20T22:41:05.580160+0000 mon.a (mon.0) 3832 : cluster 0 osdmap e761: 8 total, 8 up, 8 in 2024-05-20T22:41:05.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:05 smithi050 bash[28929]: cluster 2024-05-20T22:41:04.583820+0000 mon.a (mon.0) 3831 : cluster 0 osdmap e760: 8 total, 8 up, 8 in 2024-05-20T22:41:05.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:05 smithi050 bash[28929]: cluster 2024-05-20T22:41:05.580160+0000 mon.a (mon.0) 3832 : cluster 0 osdmap e761: 8 total, 8 up, 8 in 2024-05-20T22:41:06.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.317 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.319 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.319 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.319 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.319 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.319 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.319 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.319 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.319 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.319 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.319 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.319 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.319 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.319 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.320 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.320 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.320 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.320 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.320 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.320 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.320 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.320 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.320 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.320 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.320 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.320 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.320 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.320 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.321 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.321 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 1 sec 2024-05-20T22:41:06.321 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 512 aios 2024-05-20T22:41:06.321 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408510300 2024-05-20T22:41:06.321 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408850ed0 2024-05-20T22:41:06.321 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088554d0 2024-05-20T22:41:06.321 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408855ad0 2024-05-20T22:41:06.321 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408856130 2024-05-20T22:41:06.321 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408856750 2024-05-20T22:41:06.321 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408856640 2024-05-20T22:41:06.321 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408856c60 2024-05-20T22:41:06.321 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088576d0 2024-05-20T22:41:06.321 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408857160 2024-05-20T22:41:06.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408857270 2024-05-20T22:41:06.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408857380 2024-05-20T22:41:06.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088574f0 2024-05-20T22:41:06.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408857cf0 2024-05-20T22:41:06.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408857840 2024-05-20T22:41:06.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408856d70 2024-05-20T22:41:06.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408856ea0 2024-05-20T22:41:06.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408856fb0 2024-05-20T22:41:06.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088582b0 2024-05-20T22:41:06.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408857e00 2024-05-20T22:41:06.322 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408857950 2024-05-20T22:41:06.323 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740912f370 2024-05-20T22:41:06.323 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408857a80 2024-05-20T22:41:06.323 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408857b90 2024-05-20T22:41:06.323 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088583c0 2024-05-20T22:41:06.323 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088584d0 2024-05-20T22:41:06.323 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408858a90 2024-05-20T22:41:06.323 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408858630 2024-05-20T22:41:06.323 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408858780 2024-05-20T22:41:06.323 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408858890 2024-05-20T22:41:06.323 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408858ba0 2024-05-20T22:41:06.323 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408859050 2024-05-20T22:41:06.323 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408858cb0 2024-05-20T22:41:06.323 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408858dc0 2024-05-20T22:41:06.323 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408858ef0 2024-05-20T22:41:06.324 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408859610 2024-05-20T22:41:06.324 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408859160 2024-05-20T22:41:06.324 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408857f10 2024-05-20T22:41:06.324 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408858040 2024-05-20T22:41:06.324 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408858150 2024-05-20T22:41:06.324 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408859bd0 2024-05-20T22:41:06.324 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408859720 2024-05-20T22:41:06.324 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408859850 2024-05-20T22:41:06.324 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408859980 2024-05-20T22:41:06.324 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408859ab0 2024-05-20T22:41:06.324 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885a190 2024-05-20T22:41:06.324 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408859ce0 2024-05-20T22:41:06.324 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408859270 2024-05-20T22:41:06.325 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088593c0 2024-05-20T22:41:06.325 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088594d0 2024-05-20T22:41:06.325 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885a7d0 2024-05-20T22:41:06.325 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885a320 2024-05-20T22:41:06.325 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885a450 2024-05-20T22:41:06.325 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885a560 2024-05-20T22:41:06.325 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885a900 2024-05-20T22:41:06.325 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885adf0 2024-05-20T22:41:06.325 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885af40 2024-05-20T22:41:06.325 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885b520 2024-05-20T22:41:06.325 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885aa50 2024-05-20T22:41:06.325 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885aba0 2024-05-20T22:41:06.325 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885acb0 2024-05-20T22:41:06.326 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885b650 2024-05-20T22:41:06.326 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885b070 2024-05-20T22:41:06.326 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885b1c0 2024-05-20T22:41:06.326 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885b310 2024-05-20T22:41:06.326 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885b7e0 2024-05-20T22:41:06.326 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885bcb0 2024-05-20T22:41:06.326 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885bde0 2024-05-20T22:41:06.326 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885c3c0 2024-05-20T22:41:06.326 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885b910 2024-05-20T22:41:06.326 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885ba40 2024-05-20T22:41:06.326 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885bb70 2024-05-20T22:41:06.326 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885c4d0 2024-05-20T22:41:06.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885bf10 2024-05-20T22:41:06.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408859df0 2024-05-20T22:41:06.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408859f20 2024-05-20T22:41:06.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885a030 2024-05-20T22:41:06.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885cad0 2024-05-20T22:41:06.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885c620 2024-05-20T22:41:06.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885c020 2024-05-20T22:41:06.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885c130 2024-05-20T22:41:06.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885c280 2024-05-20T22:41:06.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885d0f0 2024-05-20T22:41:06.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885cc40 2024-05-20T22:41:06.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885cd90 2024-05-20T22:41:06.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885cee0 2024-05-20T22:41:06.327 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885d200 2024-05-20T22:41:06.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885d350 2024-05-20T22:41:06.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885d950 2024-05-20T22:41:06.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885d4a0 2024-05-20T22:41:06.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885d5f0 2024-05-20T22:41:06.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885d700 2024-05-20T22:41:06.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885daa0 2024-05-20T22:41:06.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885df50 2024-05-20T22:41:06.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885e0a0 2024-05-20T22:41:06.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885c730 2024-05-20T22:41:06.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885c860 2024-05-20T22:41:06.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885c970 2024-05-20T22:41:06.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885e1d0 2024-05-20T22:41:06.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885e6a0 2024-05-20T22:41:06.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885e7d0 2024-05-20T22:41:06.328 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885edd0 2024-05-20T22:41:06.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885e300 2024-05-20T22:41:06.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885e450 2024-05-20T22:41:06.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885e920 2024-05-20T22:41:06.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885dbb0 2024-05-20T22:41:06.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885dce0 2024-05-20T22:41:06.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885ddf0 2024-05-20T22:41:06.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885f3d0 2024-05-20T22:41:06.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885ef20 2024-05-20T22:41:06.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885f050 2024-05-20T22:41:06.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885f180 2024-05-20T22:41:06.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885f2b0 2024-05-20T22:41:06.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885f9b0 2024-05-20T22:41:06.329 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885f500 2024-05-20T22:41:06.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885f630 2024-05-20T22:41:06.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885f780 2024-05-20T22:41:06.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885fac0 2024-05-20T22:41:06.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885fc10 2024-05-20T22:41:06.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408860210 2024-05-20T22:41:06.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885fd60 2024-05-20T22:41:06.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885fe90 2024-05-20T22:41:06.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885f890 2024-05-20T22:41:06.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885ffa0 2024-05-20T22:41:06.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088600d0 2024-05-20T22:41:06.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408860320 2024-05-20T22:41:06.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408860510 2024-05-20T22:41:06.330 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408860b10 2024-05-20T22:41:06.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408860660 2024-05-20T22:41:06.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088607b0 2024-05-20T22:41:06.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088608e0 2024-05-20T22:41:06.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408860c40 2024-05-20T22:41:06.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408860d90 2024-05-20T22:41:06.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408861390 2024-05-20T22:41:06.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408860ee0 2024-05-20T22:41:06.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408861010 2024-05-20T22:41:06.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408861120 2024-05-20T22:41:06.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408861250 2024-05-20T22:41:06.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408861950 2024-05-20T22:41:06.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088614a0 2024-05-20T22:41:06.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088615d0 2024-05-20T22:41:06.331 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408861700 2024-05-20T22:41:06.332 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408861830 2024-05-20T22:41:06.332 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408861f30 2024-05-20T22:41:06.332 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408861a80 2024-05-20T22:41:06.332 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408861bb0 2024-05-20T22:41:06.332 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408861d00 2024-05-20T22:41:06.332 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408862060 2024-05-20T22:41:06.332 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408862530 2024-05-20T22:41:06.332 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408862640 2024-05-20T22:41:06.332 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408862c40 2024-05-20T22:41:06.332 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408862190 2024-05-20T22:41:06.332 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088622c0 2024-05-20T22:41:06.332 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408862790 2024-05-20T22:41:06.332 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088628e0 2024-05-20T22:41:06.332 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088629f0 2024-05-20T22:41:06.333 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408862b20 2024-05-20T22:41:06.333 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408863200 2024-05-20T22:41:06.333 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408862d50 2024-05-20T22:41:06.333 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408862ea0 2024-05-20T22:41:06.333 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408862fb0 2024-05-20T22:41:06.333 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408863330 2024-05-20T22:41:06.333 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408863800 2024-05-20T22:41:06.333 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408863930 2024-05-20T22:41:06.333 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088630e0 2024-05-20T22:41:06.333 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408863a60 2024-05-20T22:41:06.333 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408863bf0 2024-05-20T22:41:06.333 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088641f0 2024-05-20T22:41:06.333 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885ea30 2024-05-20T22:41:06.333 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408861e10 2024-05-20T22:41:06.334 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885eb80 2024-05-20T22:41:06.334 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740885ecb0 2024-05-20T22:41:06.334 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408863d40 2024-05-20T22:41:06.334 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408863460 2024-05-20T22:41:06.334 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408863590 2024-05-20T22:41:06.334 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088636e0 2024-05-20T22:41:06.334 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088647f0 2024-05-20T22:41:06.334 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408864340 2024-05-20T22:41:06.334 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408864490 2024-05-20T22:41:06.334 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088645e0 2024-05-20T22:41:06.334 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408864920 2024-05-20T22:41:06.334 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408864e40 2024-05-20T22:41:06.334 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408864f70 2024-05-20T22:41:06.334 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408865530 2024-05-20T22:41:06.335 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408864a50 2024-05-20T22:41:06.335 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408864b60 2024-05-20T22:41:06.335 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408864c90 2024-05-20T22:41:06.335 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408865660 2024-05-20T22:41:06.335 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408865080 2024-05-20T22:41:06.335 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408863e50 2024-05-20T22:41:06.335 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408863fa0 2024-05-20T22:41:06.335 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088640b0 2024-05-20T22:41:06.335 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408865c60 2024-05-20T22:41:06.335 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088657b0 2024-05-20T22:41:06.335 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088658e0 2024-05-20T22:41:06.335 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408865a30 2024-05-20T22:41:06.335 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408865d90 2024-05-20T22:41:06.335 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408866260 2024-05-20T22:41:06.336 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408866390 2024-05-20T22:41:06.336 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408865b40 2024-05-20T22:41:06.336 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088664c0 2024-05-20T22:41:06.336 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088665f0 2024-05-20T22:41:06.336 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408865ea0 2024-05-20T22:41:06.336 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408865ff0 2024-05-20T22:41:06.336 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408866bd0 2024-05-20T22:41:06.336 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408866720 2024-05-20T22:41:06.336 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408866870 2024-05-20T22:41:06.336 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088669c0 2024-05-20T22:41:06.336 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408866ce0 2024-05-20T22:41:06.336 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088671d0 2024-05-20T22:41:06.336 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408867300 2024-05-20T22:41:06.336 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088678e0 2024-05-20T22:41:06.337 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408866e30 2024-05-20T22:41:06.337 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408866f60 2024-05-20T22:41:06.337 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088670b0 2024-05-20T22:41:06.337 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088679f0 2024-05-20T22:41:06.337 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408867430 2024-05-20T22:41:06.337 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408867560 2024-05-20T22:41:06.337 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408867690 2024-05-20T22:41:06.337 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088677c0 2024-05-20T22:41:06.337 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408867fd0 2024-05-20T22:41:06.337 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408867b20 2024-05-20T22:41:06.337 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408867c50 2024-05-20T22:41:06.337 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408867da0 2024-05-20T22:41:06.337 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408868100 2024-05-20T22:41:06.338 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408868620 2024-05-20T22:41:06.338 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408868750 2024-05-20T22:41:06.338 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408867eb0 2024-05-20T22:41:06.338 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408868230 2024-05-20T22:41:06.338 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408868360 2024-05-20T22:41:06.338 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408868490 2024-05-20T22:41:06.338 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408868d30 2024-05-20T22:41:06.338 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408868880 2024-05-20T22:41:06.338 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408865190 2024-05-20T22:41:06.338 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088652c0 2024-05-20T22:41:06.338 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088653f0 2024-05-20T22:41:06.339 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408869310 2024-05-20T22:41:06.339 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408868e60 2024-05-20T22:41:06.339 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408868fb0 2024-05-20T22:41:06.339 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408869100 2024-05-20T22:41:06.339 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408869460 2024-05-20T22:41:06.339 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088695b0 2024-05-20T22:41:06.339 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408869bb0 2024-05-20T22:41:06.339 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408869700 2024-05-20T22:41:06.339 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408869830 2024-05-20T22:41:06.339 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408869940 2024-05-20T22:41:06.339 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408869a70 2024-05-20T22:41:06.339 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886a170 2024-05-20T22:41:06.339 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408869cc0 2024-05-20T22:41:06.339 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408869e10 2024-05-20T22:41:06.339 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408869f20 2024-05-20T22:41:06.340 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886a2c0 2024-05-20T22:41:06.340 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886a790 2024-05-20T22:41:06.340 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886a8c0 2024-05-20T22:41:06.340 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886a050 2024-05-20T22:41:06.340 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886a9f0 2024-05-20T22:41:06.340 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886ab40 2024-05-20T22:41:06.340 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886b140 2024-05-20T22:41:06.340 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408868990 2024-05-20T22:41:06.340 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408868ac0 2024-05-20T22:41:06.340 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408868bf0 2024-05-20T22:41:06.340 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886b270 2024-05-20T22:41:06.340 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886ac90 2024-05-20T22:41:06.340 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886adc0 2024-05-20T22:41:06.340 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886af10 2024-05-20T22:41:06.341 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886b3a0 2024-05-20T22:41:06.341 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886b890 2024-05-20T22:41:06.341 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886b9c0 2024-05-20T22:41:06.341 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886b020 2024-05-20T22:41:06.341 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886baf0 2024-05-20T22:41:06.341 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886bc40 2024-05-20T22:41:06.341 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886b4f0 2024-05-20T22:41:06.341 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886b620 2024-05-20T22:41:06.341 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886b730 2024-05-20T22:41:06.341 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886bd90 2024-05-20T22:41:06.341 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886c280 2024-05-20T22:41:06.342 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886c3b0 2024-05-20T22:41:06.342 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886c990 2024-05-20T22:41:06.342 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886bee0 2024-05-20T22:41:06.342 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886c010 2024-05-20T22:41:06.342 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886c160 2024-05-20T22:41:06.342 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886cac0 2024-05-20T22:41:06.342 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886c4e0 2024-05-20T22:41:06.342 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886c610 2024-05-20T22:41:06.342 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886c760 2024-05-20T22:41:06.342 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886cbf0 2024-05-20T22:41:06.342 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886d0a0 2024-05-20T22:41:06.342 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886d1f0 2024-05-20T22:41:06.343 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886d7b0 2024-05-20T22:41:06.343 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886cd00 2024-05-20T22:41:06.343 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886ce50 2024-05-20T22:41:06.343 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886cf80 2024-05-20T22:41:06.343 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886d8c0 2024-05-20T22:41:06.343 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886d300 2024-05-20T22:41:06.343 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886d430 2024-05-20T22:41:06.343 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886d560 2024-05-20T22:41:06.343 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886d9f0 2024-05-20T22:41:06.343 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886dec0 2024-05-20T22:41:06.343 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886dff0 2024-05-20T22:41:06.343 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886d690 2024-05-20T22:41:06.343 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886e120 2024-05-20T22:41:06.343 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886e270 2024-05-20T22:41:06.344 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886e870 2024-05-20T22:41:06.344 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886a3f0 2024-05-20T22:41:06.344 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886a520 2024-05-20T22:41:06.344 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886a650 2024-05-20T22:41:06.344 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886e980 2024-05-20T22:41:06.344 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886e3c0 2024-05-20T22:41:06.344 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886e4f0 2024-05-20T22:41:06.344 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886e620 2024-05-20T22:41:06.344 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886ead0 2024-05-20T22:41:06.344 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886efa0 2024-05-20T22:41:06.344 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886f120 2024-05-20T22:41:06.344 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886f700 2024-05-20T22:41:06.344 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886ec00 2024-05-20T22:41:06.344 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886ed30 2024-05-20T22:41:06.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886ee60 2024-05-20T22:41:06.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886f830 2024-05-20T22:41:06.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886f250 2024-05-20T22:41:06.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886f3a0 2024-05-20T22:41:06.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886f4d0 2024-05-20T22:41:06.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886f960 2024-05-20T22:41:06.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886fe30 2024-05-20T22:41:06.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886ff60 2024-05-20T22:41:06.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886f5e0 2024-05-20T22:41:06.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408870090 2024-05-20T22:41:06.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408870230 2024-05-20T22:41:06.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408870830 2024-05-20T22:41:06.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886db20 2024-05-20T22:41:06.345 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886dc50 2024-05-20T22:41:06.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886dda0 2024-05-20T22:41:06.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408870980 2024-05-20T22:41:06.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408870380 2024-05-20T22:41:06.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088704b0 2024-05-20T22:41:06.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408870600 2024-05-20T22:41:06.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408870ab0 2024-05-20T22:41:06.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408870fa0 2024-05-20T22:41:06.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088710d0 2024-05-20T22:41:06.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408870710 2024-05-20T22:41:06.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408871200 2024-05-20T22:41:06.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408871350 2024-05-20T22:41:06.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408870c00 2024-05-20T22:41:06.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408870d50 2024-05-20T22:41:06.346 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408871930 2024-05-20T22:41:06.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408871480 2024-05-20T22:41:06.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088715d0 2024-05-20T22:41:06.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408871700 2024-05-20T22:41:06.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408871a60 2024-05-20T22:41:06.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408871f80 2024-05-20T22:41:06.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408872100 2024-05-20T22:41:06.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886fa90 2024-05-20T22:41:06.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886fba0 2024-05-20T22:41:06.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740886fcd0 2024-05-20T22:41:06.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408872230 2024-05-20T22:41:06.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408872700 2024-05-20T22:41:06.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408872850 2024-05-20T22:41:06.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408871b90 2024-05-20T22:41:06.347 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408871cc0 2024-05-20T22:41:06.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408871df0 2024-05-20T22:41:06.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408872980 2024-05-20T22:41:06.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408872e50 2024-05-20T22:41:06.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408872f80 2024-05-20T22:41:06.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408872360 2024-05-20T22:41:06.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408872490 2024-05-20T22:41:06.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088725c0 2024-05-20T22:41:06.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088730b0 2024-05-20T22:41:06.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088735f0 2024-05-20T22:41:06.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408873740 2024-05-20T22:41:06.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408872ab0 2024-05-20T22:41:06.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408872be0 2024-05-20T22:41:06.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408872d10 2024-05-20T22:41:06.348 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408873870 2024-05-20T22:41:06.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408873d90 2024-05-20T22:41:06.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408873ec0 2024-05-20T22:41:06.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408873200 2024-05-20T22:41:06.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408873330 2024-05-20T22:41:06.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408873460 2024-05-20T22:41:06.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408873ff0 2024-05-20T22:41:06.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088744c0 2024-05-20T22:41:06.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408874990 2024-05-20T22:41:06.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408874ac0 2024-05-20T22:41:06.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408874120 2024-05-20T22:41:06.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408874250 2024-05-20T22:41:06.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088743a0 2024-05-20T22:41:06.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088739a0 2024-05-20T22:41:06.349 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408873ad0 2024-05-20T22:41:06.350 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408873c20 2024-05-20T22:41:06.350 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088750a0 2024-05-20T22:41:06.350 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408874bf0 2024-05-20T22:41:06.350 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408874d40 2024-05-20T22:41:06.350 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408874e70 2024-05-20T22:41:06.350 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408874f80 2024-05-20T22:41:06.350 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408875680 2024-05-20T22:41:06.350 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088751d0 2024-05-20T22:41:06.350 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408875320 2024-05-20T22:41:06.350 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408875430 2024-05-20T22:41:06.350 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088757b0 2024-05-20T22:41:06.350 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408875c80 2024-05-20T22:41:06.350 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408875db0 2024-05-20T22:41:06.350 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408876370 2024-05-20T22:41:06.351 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088758e0 2024-05-20T22:41:06.351 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408875560 2024-05-20T22:41:06.351 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408875a10 2024-05-20T22:41:06.351 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408875b40 2024-05-20T22:41:06.351 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408875ec0 2024-05-20T22:41:06.351 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408876010 2024-05-20T22:41:06.351 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408876180 2024-05-20T22:41:06.351 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088764a0 2024-05-20T22:41:06.351 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088769c0 2024-05-20T22:41:06.351 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408876b40 2024-05-20T22:41:06.351 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088745f0 2024-05-20T22:41:06.351 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408874720 2024-05-20T22:41:06.351 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408874850 2024-05-20T22:41:06.352 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408876c70 2024-05-20T22:41:06.352 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408877140 2024-05-20T22:41:06.352 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408877290 2024-05-20T22:41:06.352 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088765d0 2024-05-20T22:41:06.352 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408876700 2024-05-20T22:41:06.352 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408876830 2024-05-20T22:41:06.352 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088773c0 2024-05-20T22:41:06.352 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408877890 2024-05-20T22:41:06.352 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088779e0 2024-05-20T22:41:06.352 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408876da0 2024-05-20T22:41:06.352 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408876ed0 2024-05-20T22:41:06.352 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408877000 2024-05-20T22:41:06.352 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408877b10 2024-05-20T22:41:06.352 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408877fe0 2024-05-20T22:41:06.352 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408878130 2024-05-20T22:41:06.353 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408878710 2024-05-20T22:41:06.353 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408877c40 2024-05-20T22:41:06.353 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408877d70 2024-05-20T22:41:06.353 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408877ea0 2024-05-20T22:41:06.353 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408878840 2024-05-20T22:41:06.353 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408878260 2024-05-20T22:41:06.353 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088783b0 2024-05-20T22:41:06.353 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088784e0 2024-05-20T22:41:06.353 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408878970 2024-05-20T22:41:06.353 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408878e40 2024-05-20T22:41:06.353 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408878f70 2024-05-20T22:41:06.353 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088774f0 2024-05-20T22:41:06.353 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408877620 2024-05-20T22:41:06.353 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408877750 2024-05-20T22:41:06.354 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088790a0 2024-05-20T22:41:06.354 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408879570 2024-05-20T22:41:06.354 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088796a0 2024-05-20T22:41:06.354 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408878aa0 2024-05-20T22:41:06.354 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408878bd0 2024-05-20T22:41:06.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:06 smithi145 bash[23893]: cluster 2024-05-20T22:41:05.489379+0000 mgr.y (mgr.14592) 1291 : cluster 0 pgmap v1706: 324 pgs: 64 creating+peering, 260 active+clean; 583 KiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:06.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:06 smithi050 bash[21866]: cluster 2024-05-20T22:41:05.489379+0000 mgr.y (mgr.14592) 1291 : cluster 0 pgmap v1706: 324 pgs: 64 creating+peering, 260 active+clean; 583 KiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:06.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:06 smithi050 bash[28929]: cluster 2024-05-20T22:41:05.489379+0000 mgr.y (mgr.14592) 1291 : cluster 0 pgmap v1706: 324 pgs: 64 creating+peering, 260 active+clean; 583 KiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:07.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:07 smithi050 bash[21866]: cluster 2024-05-20T22:41:06.618781+0000 mon.a (mon.0) 3833 : cluster 0 osdmap e762: 8 total, 8 up, 8 in 2024-05-20T22:41:07.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:07 smithi050 bash[21866]: cluster 2024-05-20T22:41:07.623439+0000 mon.a (mon.0) 3834 : cluster 0 osdmap e763: 8 total, 8 up, 8 in 2024-05-20T22:41:07.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:07 smithi050 bash[28929]: cluster 2024-05-20T22:41:06.618781+0000 mon.a (mon.0) 3833 : cluster 0 osdmap e762: 8 total, 8 up, 8 in 2024-05-20T22:41:07.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:07 smithi050 bash[28929]: cluster 2024-05-20T22:41:07.623439+0000 mon.a (mon.0) 3834 : cluster 0 osdmap e763: 8 total, 8 up, 8 in 2024-05-20T22:41:08.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:07 smithi145 bash[23893]: cluster 2024-05-20T22:41:06.618781+0000 mon.a (mon.0) 3833 : cluster 0 osdmap e762: 8 total, 8 up, 8 in 2024-05-20T22:41:08.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:07 smithi145 bash[23893]: cluster 2024-05-20T22:41:07.623439+0000 mon.a (mon.0) 3834 : cluster 0 osdmap e763: 8 total, 8 up, 8 in 2024-05-20T22:41:08.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:08 smithi050 bash[21866]: cluster 2024-05-20T22:41:07.490515+0000 mgr.y (mgr.14592) 1292 : cluster 0 pgmap v1709: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:08.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:08 smithi050 bash[21866]: cluster 2024-05-20T22:41:07.638924+0000 mon.a (mon.0) 3835 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:41:08.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:08 smithi050 bash[21866]: cluster 2024-05-20T22:41:08.628573+0000 mon.a (mon.0) 3836 : cluster 0 osdmap e764: 8 total, 8 up, 8 in 2024-05-20T22:41:08.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:08 smithi050 bash[21866]: audit 2024-05-20T22:41:08.632599+0000 mon.a (mon.0) 3837 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:41:08.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:08 smithi050 bash[28929]: cluster 2024-05-20T22:41:07.490515+0000 mgr.y (mgr.14592) 1292 : cluster 0 pgmap v1709: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:08.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:08 smithi050 bash[28929]: cluster 2024-05-20T22:41:07.638924+0000 mon.a (mon.0) 3835 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:41:08.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:08 smithi050 bash[28929]: cluster 2024-05-20T22:41:08.628573+0000 mon.a (mon.0) 3836 : cluster 0 osdmap e764: 8 total, 8 up, 8 in 2024-05-20T22:41:08.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:08 smithi050 bash[28929]: audit 2024-05-20T22:41:08.632599+0000 mon.a (mon.0) 3837 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:41:09.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:08 smithi145 bash[23893]: cluster 2024-05-20T22:41:07.490515+0000 mgr.y (mgr.14592) 1292 : cluster 0 pgmap v1709: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:09.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:08 smithi145 bash[23893]: cluster 2024-05-20T22:41:07.638924+0000 mon.a (mon.0) 3835 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:41:09.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:08 smithi145 bash[23893]: cluster 2024-05-20T22:41:08.628573+0000 mon.a (mon.0) 3836 : cluster 0 osdmap e764: 8 total, 8 up, 8 in 2024-05-20T22:41:09.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:08 smithi145 bash[23893]: audit 2024-05-20T22:41:08.632599+0000 mon.a (mon.0) 3837 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:41:09.635 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:41:09 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:41:09.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:41:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:41:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:41:10.638 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088 watch_notify: Running main() from gmock_main.cc 2024-05-20T22:41:10.638 INFO:tasks.workunit.client.0.smithi050.stdout: watch_notify: [==========] Running 2 tests from 1 test suite. 2024-05-20T22:41:10.638 INFO:tasks.workunit.client.0.smithi050.stdout: watch_notify: [----------] Global test environment set-up. 2024-05-20T22:41:10.638 INFO:tasks.workunit.client.0.smithi050.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2024-05-20T22:41:10.638 INFO:tasks.workunit.client.0.smithi050.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2024-05-20T22:41:10.638 INFO:tasks.workunit.client.0.smithi050.stdout: watch_notify: handle_notify cookie 94334426642096 notify_id 3255585210370 notifier_gid 24902 2024-05-20T22:41:10.639 INFO:tasks.workunit.client.0.smithi050.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (1816455 ms) 2024-05-20T22:41:10.639 INFO:tasks.workunit.client.0.smithi050.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-05-20T22:41:10.639 INFO:tasks.workunit.client.0.smithi050.stdout: watch_notify: Trying... 2024-05-20T22:41:10.639 INFO:tasks.workunit.client.0.smithi050.stdout: watch_notify: handle_notify cookie 94334426882992 notify_id 3268470112259 notifier_gid 26098 2024-05-20T22:41:10.639 INFO:tasks.workunit.client.0.smithi050.stdout: watch_notify: Waiting for 3.000000000s 2024-05-20T22:41:10.639 INFO:tasks.workunit.client.0.smithi050.stdout: watch_notify: Timed out. 2024-05-20T22:41:10.639 INFO:tasks.workunit.client.0.smithi050.stdout: watch_notify: Flushing... 2024-05-20T22:41:10.639 INFO:tasks.workunit.client.0.smithi050.stdout: watch_notify: Flushed... 2024-05-20T22:41:10.639 INFO:tasks.workunit.client.0.smithi050.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (7061 ms) 2024-05-20T22:41:10.639 INFO:tasks.workunit.client.0.smithi050.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (1823516 ms total) 2024-05-20T22:41:10.639 INFO:tasks.workunit.client.0.smithi050.stdout: watch_notify: 2024-05-20T22:41:10.639 INFO:tasks.workunit.client.0.smithi050.stdout: watch_notify: [----------] Global test environment tear-down 2024-05-20T22:41:10.639 INFO:tasks.workunit.client.0.smithi050.stdout: watch_notify: [==========] 2 tests from 1 test suite ran. (1823516 ms total) 2024-05-20T22:41:10.639 INFO:tasks.workunit.client.0.smithi050.stdout: watch_notify: [ PASSED ] 2 tests. 2024-05-20T22:41:10.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:10 smithi145 bash[23893]: audit 2024-05-20T22:41:09.368528+0000 mgr.y (mgr.14592) 1293 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:41:10.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:10 smithi145 bash[23893]: cluster 2024-05-20T22:41:09.491453+0000 mgr.y (mgr.14592) 1294 : cluster 0 pgmap v1712: 292 pgs: 96 unknown, 32 creating+peering, 164 active+clean; 583 KiB data, 746 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:41:10.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:10 smithi145 bash[23893]: audit 2024-05-20T22:41:09.619969+0000 mon.a (mon.0) 3838 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:41:10.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:10 smithi145 bash[23893]: cluster 2024-05-20T22:41:09.627768+0000 mon.a (mon.0) 3839 : cluster 0 osdmap e765: 8 total, 8 up, 8 in 2024-05-20T22:41:10.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:10 smithi145 bash[23893]: audit 2024-05-20T22:41:10.119683+0000 mon.a (mon.0) 3840 : audit 0 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-05-20T22:41:10.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:10 smithi145 bash[23893]: audit 2024-05-20T22:41:10.124717+0000 mon.a (mon.0) 3841 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:41:10.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:10 smithi050 bash[21866]: audit 2024-05-20T22:41:09.368528+0000 mgr.y (mgr.14592) 1293 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:41:10.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:10 smithi050 bash[21866]: cluster 2024-05-20T22:41:09.491453+0000 mgr.y (mgr.14592) 1294 : cluster 0 pgmap v1712: 292 pgs: 96 unknown, 32 creating+peering, 164 active+clean; 583 KiB data, 746 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:41:10.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:10 smithi050 bash[21866]: audit 2024-05-20T22:41:09.619969+0000 mon.a (mon.0) 3838 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:41:10.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:10 smithi050 bash[21866]: cluster 2024-05-20T22:41:09.627768+0000 mon.a (mon.0) 3839 : cluster 0 osdmap e765: 8 total, 8 up, 8 in 2024-05-20T22:41:10.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:10 smithi050 bash[21866]: audit 2024-05-20T22:41:10.119683+0000 mon.a (mon.0) 3840 : audit 0 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-05-20T22:41:10.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:10 smithi050 bash[21866]: audit 2024-05-20T22:41:10.124717+0000 mon.a (mon.0) 3841 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:41:10.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:10 smithi050 bash[28929]: audit 2024-05-20T22:41:09.368528+0000 mgr.y (mgr.14592) 1293 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:41:10.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:10 smithi050 bash[28929]: cluster 2024-05-20T22:41:09.491453+0000 mgr.y (mgr.14592) 1294 : cluster 0 pgmap v1712: 292 pgs: 96 unknown, 32 creating+peering, 164 active+clean; 583 KiB data, 746 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:41:10.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:10 smithi050 bash[28929]: audit 2024-05-20T22:41:09.619969+0000 mon.a (mon.0) 3838 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-20T22:41:10.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:10 smithi050 bash[28929]: cluster 2024-05-20T22:41:09.627768+0000 mon.a (mon.0) 3839 : cluster 0 osdmap e765: 8 total, 8 up, 8 in 2024-05-20T22:41:10.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:10 smithi050 bash[28929]: audit 2024-05-20T22:41:10.119683+0000 mon.a (mon.0) 3840 : audit 0 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-05-20T22:41:10.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:10 smithi050 bash[28929]: audit 2024-05-20T22:41:10.124717+0000 mon.a (mon.0) 3841 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:41:11.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:11 smithi050 bash[21866]: audit 2024-05-20T22:41:10.633898+0000 mon.a (mon.0) 3842 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-05-20T22:41:11.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:11 smithi050 bash[21866]: cluster 2024-05-20T22:41:10.639645+0000 mon.a (mon.0) 3843 : cluster 0 osdmap e766: 8 total, 8 up, 8 in 2024-05-20T22:41:11.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:11 smithi050 bash[21866]: audit 2024-05-20T22:41:10.651706+0000 mon.a (mon.0) 3844 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "app2"}]: dispatch 2024-05-20T22:41:11.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:11 smithi050 bash[21866]: audit 2024-05-20T22:41:10.652509+0000 mon.a (mon.0) 3845 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:41:11.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:11 smithi050 bash[21866]: audit 2024-05-20T22:41:11.132191+0000 mon.a (mon.0) 3846 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:41:11.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:11 smithi050 bash[28929]: audit 2024-05-20T22:41:10.633898+0000 mon.a (mon.0) 3842 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-05-20T22:41:11.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:11 smithi050 bash[28929]: cluster 2024-05-20T22:41:10.639645+0000 mon.a (mon.0) 3843 : cluster 0 osdmap e766: 8 total, 8 up, 8 in 2024-05-20T22:41:11.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:11 smithi050 bash[28929]: audit 2024-05-20T22:41:10.651706+0000 mon.a (mon.0) 3844 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "app2"}]: dispatch 2024-05-20T22:41:11.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:11 smithi050 bash[28929]: audit 2024-05-20T22:41:10.652509+0000 mon.a (mon.0) 3845 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:41:11.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:11 smithi050 bash[28929]: audit 2024-05-20T22:41:11.132191+0000 mon.a (mon.0) 3846 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:41:12.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:11 smithi145 bash[23893]: audit 2024-05-20T22:41:10.633898+0000 mon.a (mon.0) 3842 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-05-20T22:41:12.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:11 smithi145 bash[23893]: cluster 2024-05-20T22:41:10.639645+0000 mon.a (mon.0) 3843 : cluster 0 osdmap e766: 8 total, 8 up, 8 in 2024-05-20T22:41:12.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:11 smithi145 bash[23893]: audit 2024-05-20T22:41:10.651706+0000 mon.a (mon.0) 3844 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "app2"}]: dispatch 2024-05-20T22:41:12.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:11 smithi145 bash[23893]: audit 2024-05-20T22:41:10.652509+0000 mon.a (mon.0) 3845 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-05-20T22:41:12.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:11 smithi145 bash[23893]: audit 2024-05-20T22:41:11.132191+0000 mon.a (mon.0) 3846 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:41:12.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:12 smithi050 bash[21866]: cluster 2024-05-20T22:41:11.492352+0000 mgr.y (mgr.14592) 1295 : cluster 0 pgmap v1715: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 766 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:41:12.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:12 smithi050 bash[21866]: audit 2024-05-20T22:41:11.645508+0000 mon.a (mon.0) 3847 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-05-20T22:41:12.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:12 smithi050 bash[21866]: cluster 2024-05-20T22:41:11.659453+0000 mon.a (mon.0) 3848 : cluster 0 osdmap e767: 8 total, 8 up, 8 in 2024-05-20T22:41:12.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:12 smithi050 bash[21866]: audit 2024-05-20T22:41:11.667042+0000 mon.a (mon.0) 3849 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi050-64050-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-05-20T22:41:12.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:12 smithi050 bash[21866]: audit 2024-05-20T22:41:11.667757+0000 mon.a (mon.0) 3850 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi050-64050-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-05-20T22:41:12.942 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:12 smithi050 bash[28929]: cluster 2024-05-20T22:41:11.492352+0000 mgr.y (mgr.14592) 1295 : cluster 0 pgmap v1715: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 766 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:41:12.942 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:12 smithi050 bash[28929]: audit 2024-05-20T22:41:11.645508+0000 mon.a (mon.0) 3847 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-05-20T22:41:12.942 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:12 smithi050 bash[28929]: cluster 2024-05-20T22:41:11.659453+0000 mon.a (mon.0) 3848 : cluster 0 osdmap e767: 8 total, 8 up, 8 in 2024-05-20T22:41:12.942 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:12 smithi050 bash[28929]: audit 2024-05-20T22:41:11.667042+0000 mon.a (mon.0) 3849 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi050-64050-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-05-20T22:41:12.943 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:12 smithi050 bash[28929]: audit 2024-05-20T22:41:11.667757+0000 mon.a (mon.0) 3850 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi050-64050-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-05-20T22:41:13.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:12 smithi145 bash[23893]: cluster 2024-05-20T22:41:11.492352+0000 mgr.y (mgr.14592) 1295 : cluster 0 pgmap v1715: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 766 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:41:13.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:12 smithi145 bash[23893]: audit 2024-05-20T22:41:11.645508+0000 mon.a (mon.0) 3847 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-64050-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-05-20T22:41:13.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:12 smithi145 bash[23893]: cluster 2024-05-20T22:41:11.659453+0000 mon.a (mon.0) 3848 : cluster 0 osdmap e767: 8 total, 8 up, 8 in 2024-05-20T22:41:13.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:12 smithi145 bash[23893]: audit 2024-05-20T22:41:11.667042+0000 mon.a (mon.0) 3849 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi050-64050-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-05-20T22:41:13.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:12 smithi145 bash[23893]: audit 2024-05-20T22:41:11.667757+0000 mon.a (mon.0) 3850 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi050-64050-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-05-20T22:41:13.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:13 smithi050 bash[21866]: audit 2024-05-20T22:41:12.656316+0000 mon.a (mon.0) 3851 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi050-64050-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-05-20T22:41:13.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:13 smithi050 bash[21866]: cluster 2024-05-20T22:41:12.664116+0000 mon.a (mon.0) 3852 : cluster 0 osdmap e768: 8 total, 8 up, 8 in 2024-05-20T22:41:13.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:13 smithi050 bash[21866]: audit 2024-05-20T22:41:12.669762+0000 mon.a (mon.0) 3853 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi050-64050-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-05-20T22:41:13.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:13 smithi050 bash[28929]: audit 2024-05-20T22:41:12.656316+0000 mon.a (mon.0) 3851 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi050-64050-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-05-20T22:41:13.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:13 smithi050 bash[28929]: cluster 2024-05-20T22:41:12.664116+0000 mon.a (mon.0) 3852 : cluster 0 osdmap e768: 8 total, 8 up, 8 in 2024-05-20T22:41:13.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:13 smithi050 bash[28929]: audit 2024-05-20T22:41:12.669762+0000 mon.a (mon.0) 3853 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi050-64050-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-05-20T22:41:14.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:13 smithi145 bash[23893]: audit 2024-05-20T22:41:12.656316+0000 mon.a (mon.0) 3851 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi050-64050-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-05-20T22:41:14.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:13 smithi145 bash[23893]: cluster 2024-05-20T22:41:12.664116+0000 mon.a (mon.0) 3852 : cluster 0 osdmap e768: 8 total, 8 up, 8 in 2024-05-20T22:41:14.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:13 smithi145 bash[23893]: audit 2024-05-20T22:41:12.669762+0000 mon.a (mon.0) 3853 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi050-64050-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-05-20T22:41:14.666 INFO:tasks.workunit.client.0.smithi050.stdout:78d00 2024-05-20T22:41:14.666 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088797f0 2024-05-20T22:41:14.666 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408879cc0 2024-05-20T22:41:14.667 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408879e10 2024-05-20T22:41:14.667 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x5574088791d0 2024-05-20T22:41:14.667 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408879320 2024-05-20T22:41:14.667 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408879450 2024-05-20T22:41:14.667 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408879f20 2024-05-20T22:41:14.667 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887a430 2024-05-20T22:41:14.667 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887a580 2024-05-20T22:41:14.667 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408879920 2024-05-20T22:41:14.667 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408879a50 2024-05-20T22:41:14.667 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x557408879b80 2024-05-20T22:41:14.667 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887a6b0 2024-05-20T22:41:14.667 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887ab80 2024-05-20T22:41:14.667 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887ad20 2024-05-20T22:41:14.667 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887a070 2024-05-20T22:41:14.668 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887a1a0 2024-05-20T22:41:14.668 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887a2d0 2024-05-20T22:41:14.668 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887ae50 2024-05-20T22:41:14.668 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887b320 2024-05-20T22:41:14.668 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887b470 2024-05-20T22:41:14.668 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887a7e0 2024-05-20T22:41:14.668 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887a910 2024-05-20T22:41:14.668 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887aa40 2024-05-20T22:41:14.668 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887b5a0 2024-05-20T22:41:14.668 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887ba70 2024-05-20T22:41:14.668 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887bbc0 2024-05-20T22:41:14.668 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887af80 2024-05-20T22:41:14.668 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887b0b0 2024-05-20T22:41:14.668 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887b1e0 2024-05-20T22:41:14.669 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887bcf0 2024-05-20T22:41:14.669 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887c1c0 2024-05-20T22:41:14.669 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887c2f0 2024-05-20T22:41:14.669 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887b6b0 2024-05-20T22:41:14.669 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887b7e0 2024-05-20T22:41:14.669 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887b910 2024-05-20T22:41:14.669 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887c440 2024-05-20T22:41:14.669 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887c910 2024-05-20T22:41:14.669 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887ca40 2024-05-20T22:41:14.669 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887d040 2024-05-20T22:41:14.669 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887c570 2024-05-20T22:41:14.669 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887c6a0 2024-05-20T22:41:14.669 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887c7d0 2024-05-20T22:41:14.669 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887d150 2024-05-20T22:41:14.670 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887cb90 2024-05-20T22:41:14.670 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887ccc0 2024-05-20T22:41:14.670 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887ce10 2024-05-20T22:41:14.670 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887d2a0 2024-05-20T22:41:14.670 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887d770 2024-05-20T22:41:14.670 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887d8a0 2024-05-20T22:41:14.670 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887cf20 2024-05-20T22:41:14.670 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887d9d0 2024-05-20T22:41:14.670 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887db20 2024-05-20T22:41:14.670 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887d3d0 2024-05-20T22:41:14.670 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887d500 2024-05-20T22:41:14.670 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887d630 2024-05-20T22:41:14.670 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887dc70 2024-05-20T22:41:14.670 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887e160 2024-05-20T22:41:14.670 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887e290 2024-05-20T22:41:14.671 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887be00 2024-05-20T22:41:14.671 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887bf30 2024-05-20T22:41:14.671 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887c060 2024-05-20T22:41:14.671 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887e3c0 2024-05-20T22:41:14.671 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x55740887e8b0 2024-05-20T22:41:14.671 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: done. 2024-05-20T22:41:14.671 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (1818758 ms) 2024-05-20T22:41:14.671 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (1818758 ms total) 2024-05-20T22:41:14.671 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2024-05-20T22:41:14.671 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2024-05-20T22:41:14.671 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2024-05-20T22:41:14.671 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-05-20T22:41:14.671 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2024-05-20T22:41:14.671 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.Exec (56 ms) 2024-05-20T22:41:14.672 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2024-05-20T22:41:14.672 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (12 ms) 2024-05-20T22:41:14.672 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2024-05-20T22:41:14.672 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (4 ms) 2024-05-20T22:41:14.672 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2024-05-20T22:41:14.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:14 smithi050 bash[28929]: cluster 2024-05-20T22:41:13.493255+0000 mgr.y (mgr.14592) 1296 : cluster 0 pgmap v1718: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 766 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:41:14.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:14 smithi050 bash[28929]: audit 2024-05-20T22:41:13.660019+0000 mon.a (mon.0) 3854 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi050-64050-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-05-20T22:41:14.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:14 smithi050 bash[28929]: cluster 2024-05-20T22:41:13.670502+0000 mon.a (mon.0) 3855 : cluster 0 osdmap e769: 8 total, 8 up, 8 in 2024-05-20T22:41:14.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:14 smithi050 bash[28929]: audit 2024-05-20T22:41:13.676591+0000 mon.a (mon.0) 3856 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi050-64050-1","app":"app1","key":"key1"}]: dispatch 2024-05-20T22:41:14.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:14 smithi050 bash[28929]: audit 2024-05-20T22:41:14.662594+0000 mon.a (mon.0) 3857 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi050-64050-1","app":"app1","key":"key1"}]': finished 2024-05-20T22:41:14.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:14 smithi050 bash[28929]: cluster 2024-05-20T22:41:14.669824+0000 mon.a (mon.0) 3858 : cluster 0 osdmap e770: 8 total, 8 up, 8 in 2024-05-20T22:41:14.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:14 smithi050 bash[21866]: cluster 2024-05-20T22:41:13.493255+0000 mgr.y (mgr.14592) 1296 : cluster 0 pgmap v1718: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 766 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:41:14.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:14 smithi050 bash[21866]: audit 2024-05-20T22:41:13.660019+0000 mon.a (mon.0) 3854 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi050-64050-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-05-20T22:41:14.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:14 smithi050 bash[21866]: cluster 2024-05-20T22:41:13.670502+0000 mon.a (mon.0) 3855 : cluster 0 osdmap e769: 8 total, 8 up, 8 in 2024-05-20T22:41:14.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:14 smithi050 bash[21866]: audit 2024-05-20T22:41:13.676591+0000 mon.a (mon.0) 3856 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi050-64050-1","app":"app1","key":"key1"}]: dispatch 2024-05-20T22:41:14.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:14 smithi050 bash[21866]: audit 2024-05-20T22:41:14.662594+0000 mon.a (mon.0) 3857 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi050-64050-1","app":"app1","key":"key1"}]': finished 2024-05-20T22:41:14.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:14 smithi050 bash[21866]: cluster 2024-05-20T22:41:14.669824+0000 mon.a (mon.0) 3858 : cluster 0 osdmap e770: 8 total, 8 up, 8 in 2024-05-20T22:41:15.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:14 smithi145 bash[23893]: cluster 2024-05-20T22:41:13.493255+0000 mgr.y (mgr.14592) 1296 : cluster 0 pgmap v1718: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 766 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-20T22:41:15.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:14 smithi145 bash[23893]: audit 2024-05-20T22:41:13.660019+0000 mon.a (mon.0) 3854 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi050-64050-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-05-20T22:41:15.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:14 smithi145 bash[23893]: cluster 2024-05-20T22:41:13.670502+0000 mon.a (mon.0) 3855 : cluster 0 osdmap e769: 8 total, 8 up, 8 in 2024-05-20T22:41:15.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:14 smithi145 bash[23893]: audit 2024-05-20T22:41:13.676591+0000 mon.a (mon.0) 3856 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi050-64050-1","app":"app1","key":"key1"}]: dispatch 2024-05-20T22:41:15.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:14 smithi145 bash[23893]: audit 2024-05-20T22:41:14.662594+0000 mon.a (mon.0) 3857 : audit 1 from='client.? v1:172.21.15.50:0/614254197' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi050-64050-1","app":"app1","key":"key1"}]': finished 2024-05-20T22:41:15.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:14 smithi145 bash[23893]: cluster 2024-05-20T22:41:14.669824+0000 mon.a (mon.0) 3858 : cluster 0 osdmap e770: 8 total, 8 up, 8 in 2024-05-20T22:41:17.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:16 smithi145 bash[23893]: cluster 2024-05-20T22:41:15.494267+0000 mgr.y (mgr.14592) 1297 : cluster 0 pgmap v1721: 228 pgs: 228 active+clean; 583 KiB data, 766 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:41:17.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:16 smithi145 bash[23893]: cluster 2024-05-20T22:41:15.697058+0000 mon.a (mon.0) 3859 : cluster 0 osdmap e771: 8 total, 8 up, 8 in 2024-05-20T22:41:17.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:16 smithi145 bash[23893]: cluster 2024-05-20T22:41:16.262391+0000 mon.a (mon.0) 3860 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:41:17.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:16 smithi050 bash[21866]: cluster 2024-05-20T22:41:15.494267+0000 mgr.y (mgr.14592) 1297 : cluster 0 pgmap v1721: 228 pgs: 228 active+clean; 583 KiB data, 766 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:41:17.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:16 smithi050 bash[21866]: cluster 2024-05-20T22:41:15.697058+0000 mon.a (mon.0) 3859 : cluster 0 osdmap e771: 8 total, 8 up, 8 in 2024-05-20T22:41:17.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:16 smithi050 bash[21866]: cluster 2024-05-20T22:41:16.262391+0000 mon.a (mon.0) 3860 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:41:17.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:16 smithi050 bash[28929]: cluster 2024-05-20T22:41:15.494267+0000 mgr.y (mgr.14592) 1297 : cluster 0 pgmap v1721: 228 pgs: 228 active+clean; 583 KiB data, 766 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-05-20T22:41:17.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:16 smithi050 bash[28929]: cluster 2024-05-20T22:41:15.697058+0000 mon.a (mon.0) 3859 : cluster 0 osdmap e771: 8 total, 8 up, 8 in 2024-05-20T22:41:17.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:16 smithi050 bash[28929]: cluster 2024-05-20T22:41:16.262391+0000 mon.a (mon.0) 3860 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:41:18.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:17 smithi145 bash[23893]: cluster 2024-05-20T22:41:16.701155+0000 mon.a (mon.0) 3861 : cluster 0 osdmap e772: 8 total, 8 up, 8 in 2024-05-20T22:41:18.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:17 smithi145 bash[23893]: cluster 2024-05-20T22:41:17.702619+0000 mon.a (mon.0) 3862 : cluster 0 osdmap e773: 8 total, 8 up, 8 in 2024-05-20T22:41:18.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:17 smithi050 bash[21866]: cluster 2024-05-20T22:41:16.701155+0000 mon.a (mon.0) 3861 : cluster 0 osdmap e772: 8 total, 8 up, 8 in 2024-05-20T22:41:18.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:17 smithi050 bash[21866]: cluster 2024-05-20T22:41:17.702619+0000 mon.a (mon.0) 3862 : cluster 0 osdmap e773: 8 total, 8 up, 8 in 2024-05-20T22:41:18.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:17 smithi050 bash[28929]: cluster 2024-05-20T22:41:16.701155+0000 mon.a (mon.0) 3861 : cluster 0 osdmap e772: 8 total, 8 up, 8 in 2024-05-20T22:41:18.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:17 smithi050 bash[28929]: cluster 2024-05-20T22:41:17.702619+0000 mon.a (mon.0) 3862 : cluster 0 osdmap e773: 8 total, 8 up, 8 in 2024-05-20T22:41:19.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:18 smithi145 bash[23893]: cluster 2024-05-20T22:41:17.494760+0000 mgr.y (mgr.14592) 1298 : cluster 0 pgmap v1724: 260 pgs: 64 unknown, 196 active+clean; 583 KiB data, 766 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:19.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:18 smithi145 bash[23893]: cluster 2024-05-20T22:41:18.704891+0000 mon.a (mon.0) 3863 : cluster 0 osdmap e774: 8 total, 8 up, 8 in 2024-05-20T22:41:19.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:18 smithi050 bash[21866]: cluster 2024-05-20T22:41:17.494760+0000 mgr.y (mgr.14592) 1298 : cluster 0 pgmap v1724: 260 pgs: 64 unknown, 196 active+clean; 583 KiB data, 766 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:19.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:18 smithi050 bash[21866]: cluster 2024-05-20T22:41:18.704891+0000 mon.a (mon.0) 3863 : cluster 0 osdmap e774: 8 total, 8 up, 8 in 2024-05-20T22:41:19.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:18 smithi050 bash[28929]: cluster 2024-05-20T22:41:17.494760+0000 mgr.y (mgr.14592) 1298 : cluster 0 pgmap v1724: 260 pgs: 64 unknown, 196 active+clean; 583 KiB data, 766 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:19.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:18 smithi050 bash[28929]: cluster 2024-05-20T22:41:18.704891+0000 mon.a (mon.0) 3863 : cluster 0 osdmap e774: 8 total, 8 up, 8 in 2024-05-20T22:41:19.635 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:41:19 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:41:19.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:41:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:41:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:41:21.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:20 smithi145 bash[23893]: audit 2024-05-20T22:41:19.376818+0000 mgr.y (mgr.14592) 1299 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:41:21.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:20 smithi145 bash[23893]: cluster 2024-05-20T22:41:19.495248+0000 mgr.y (mgr.14592) 1300 : cluster 0 pgmap v1727: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 766 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:41:21.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:20 smithi145 bash[23893]: cluster 2024-05-20T22:41:19.709554+0000 mon.a (mon.0) 3864 : cluster 0 osdmap e775: 8 total, 8 up, 8 in 2024-05-20T22:41:21.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:20 smithi050 bash[21866]: audit 2024-05-20T22:41:19.376818+0000 mgr.y (mgr.14592) 1299 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:41:21.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:20 smithi050 bash[21866]: cluster 2024-05-20T22:41:19.495248+0000 mgr.y (mgr.14592) 1300 : cluster 0 pgmap v1727: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 766 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:41:21.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:20 smithi050 bash[21866]: cluster 2024-05-20T22:41:19.709554+0000 mon.a (mon.0) 3864 : cluster 0 osdmap e775: 8 total, 8 up, 8 in 2024-05-20T22:41:21.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:20 smithi050 bash[28929]: audit 2024-05-20T22:41:19.376818+0000 mgr.y (mgr.14592) 1299 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:41:21.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:20 smithi050 bash[28929]: cluster 2024-05-20T22:41:19.495248+0000 mgr.y (mgr.14592) 1300 : cluster 0 pgmap v1727: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 766 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:41:21.196 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:20 smithi050 bash[28929]: cluster 2024-05-20T22:41:19.709554+0000 mon.a (mon.0) 3864 : cluster 0 osdmap e775: 8 total, 8 up, 8 in 2024-05-20T22:41:22.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:21 smithi145 bash[23893]: cluster 2024-05-20T22:41:20.711035+0000 mon.a (mon.0) 3865 : cluster 0 osdmap e776: 8 total, 8 up, 8 in 2024-05-20T22:41:22.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:21 smithi145 bash[23893]: cluster 2024-05-20T22:41:21.712048+0000 mon.a (mon.0) 3866 : cluster 0 osdmap e777: 8 total, 8 up, 8 in 2024-05-20T22:41:22.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:21 smithi050 bash[21866]: cluster 2024-05-20T22:41:20.711035+0000 mon.a (mon.0) 3865 : cluster 0 osdmap e776: 8 total, 8 up, 8 in 2024-05-20T22:41:22.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:21 smithi050 bash[21866]: cluster 2024-05-20T22:41:21.712048+0000 mon.a (mon.0) 3866 : cluster 0 osdmap e777: 8 total, 8 up, 8 in 2024-05-20T22:41:22.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:21 smithi050 bash[28929]: cluster 2024-05-20T22:41:20.711035+0000 mon.a (mon.0) 3865 : cluster 0 osdmap e776: 8 total, 8 up, 8 in 2024-05-20T22:41:22.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:21 smithi050 bash[28929]: cluster 2024-05-20T22:41:21.712048+0000 mon.a (mon.0) 3866 : cluster 0 osdmap e777: 8 total, 8 up, 8 in 2024-05-20T22:41:23.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:22 smithi145 bash[23893]: cluster 2024-05-20T22:41:21.495756+0000 mgr.y (mgr.14592) 1301 : cluster 0 pgmap v1730: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 779 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:23.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:22 smithi145 bash[23893]: cluster 2024-05-20T22:41:21.731129+0000 mon.a (mon.0) 3867 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:41:23.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:22 smithi145 bash[23893]: cluster 2024-05-20T22:41:22.715143+0000 mon.a (mon.0) 3868 : cluster 0 osdmap e778: 8 total, 8 up, 8 in 2024-05-20T22:41:23.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:22 smithi050 bash[21866]: cluster 2024-05-20T22:41:21.495756+0000 mgr.y (mgr.14592) 1301 : cluster 0 pgmap v1730: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 779 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:23.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:22 smithi050 bash[21866]: cluster 2024-05-20T22:41:21.731129+0000 mon.a (mon.0) 3867 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:41:23.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:22 smithi050 bash[21866]: cluster 2024-05-20T22:41:22.715143+0000 mon.a (mon.0) 3868 : cluster 0 osdmap e778: 8 total, 8 up, 8 in 2024-05-20T22:41:23.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:22 smithi050 bash[28929]: cluster 2024-05-20T22:41:21.495756+0000 mgr.y (mgr.14592) 1301 : cluster 0 pgmap v1730: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 779 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:23.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:22 smithi050 bash[28929]: cluster 2024-05-20T22:41:21.731129+0000 mon.a (mon.0) 3867 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:41:23.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:22 smithi050 bash[28929]: cluster 2024-05-20T22:41:22.715143+0000 mon.a (mon.0) 3868 : cluster 0 osdmap e778: 8 total, 8 up, 8 in 2024-05-20T22:41:24.740 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: Running main() from gmock_main.cc 2024-05-20T22:41:24.740 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [==========] Running 7 tests from 1 test suite. 2024-05-20T22:41:24.740 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [----------] Global test environment set-up. 2024-05-20T22:41:24.740 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps 2024-05-20T22:41:24.741 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2024-05-20T22:41:24.741 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (1816438 ms) 2024-05-20T22:41:24.741 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2024-05-20T22:41:24.741 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (3042 ms) 2024-05-20T22:41:24.741 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2024-05-20T22:41:24.741 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (3012 ms) 2024-05-20T22:41:24.741 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2024-05-20T22:41:24.741 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (3032 ms) 2024-05-20T22:41:24.741 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2024-05-20T22:41:24.741 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (3059 ms) 2024-05-20T22:41:24.741 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2024-05-20T22:41:24.741 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (3000 ms) 2024-05-20T22:41:24.741 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2024-05-20T22:41:24.741 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (6018 ms) 2024-05-20T22:41:24.742 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps (1837601 ms total) 2024-05-20T22:41:24.742 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: 2024-05-20T22:41:24.742 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [----------] Global test environment tear-down 2024-05-20T22:41:24.742 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [==========] 7 tests from 1 test suite ran. (1837602 ms total) 2024-05-20T22:41:24.742 INFO:tasks.workunit.client.0.smithi050.stdout: write_operations: [ PASSED ] 7 tests. 2024-05-20T22:41:25.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:24 smithi145 bash[23893]: cluster 2024-05-20T22:41:23.496268+0000 mgr.y (mgr.14592) 1302 : cluster 0 pgmap v1733: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 779 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:25.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:24 smithi145 bash[23893]: cluster 2024-05-20T22:41:23.720906+0000 mon.a (mon.0) 3869 : cluster 0 osdmap e779: 8 total, 8 up, 8 in 2024-05-20T22:41:25.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:24 smithi050 bash[21866]: cluster 2024-05-20T22:41:23.496268+0000 mgr.y (mgr.14592) 1302 : cluster 0 pgmap v1733: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 779 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:25.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:24 smithi050 bash[21866]: cluster 2024-05-20T22:41:23.720906+0000 mon.a (mon.0) 3869 : cluster 0 osdmap e779: 8 total, 8 up, 8 in 2024-05-20T22:41:25.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:24 smithi050 bash[28929]: cluster 2024-05-20T22:41:23.496268+0000 mgr.y (mgr.14592) 1302 : cluster 0 pgmap v1733: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 779 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:25.194 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:24 smithi050 bash[28929]: cluster 2024-05-20T22:41:23.720906+0000 mon.a (mon.0) 3869 : cluster 0 osdmap e779: 8 total, 8 up, 8 in 2024-05-20T22:41:26.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:25 smithi145 bash[23893]: cluster 2024-05-20T22:41:24.728754+0000 mon.a (mon.0) 3870 : cluster 0 osdmap e780: 8 total, 8 up, 8 in 2024-05-20T22:41:26.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:25 smithi050 bash[21866]: cluster 2024-05-20T22:41:24.728754+0000 mon.a (mon.0) 3870 : cluster 0 osdmap e780: 8 total, 8 up, 8 in 2024-05-20T22:41:26.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:25 smithi050 bash[28929]: cluster 2024-05-20T22:41:24.728754+0000 mon.a (mon.0) 3870 : cluster 0 osdmap e780: 8 total, 8 up, 8 in 2024-05-20T22:41:27.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:26 smithi145 bash[23893]: cluster 2024-05-20T22:41:25.497582+0000 mgr.y (mgr.14592) 1303 : cluster 0 pgmap v1736: 228 pgs: 228 active+clean; 583 KiB data, 804 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:41:27.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:26 smithi145 bash[23893]: cluster 2024-05-20T22:41:25.747909+0000 mon.a (mon.0) 3871 : cluster 0 osdmap e781: 8 total, 8 up, 8 in 2024-05-20T22:41:27.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:26 smithi145 bash[23893]: audit 2024-05-20T22:41:26.147661+0000 mon.a (mon.0) 3872 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:41:27.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:26 smithi050 bash[21866]: cluster 2024-05-20T22:41:25.497582+0000 mgr.y (mgr.14592) 1303 : cluster 0 pgmap v1736: 228 pgs: 228 active+clean; 583 KiB data, 804 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:41:27.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:26 smithi050 bash[21866]: cluster 2024-05-20T22:41:25.747909+0000 mon.a (mon.0) 3871 : cluster 0 osdmap e781: 8 total, 8 up, 8 in 2024-05-20T22:41:27.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:26 smithi050 bash[21866]: audit 2024-05-20T22:41:26.147661+0000 mon.a (mon.0) 3872 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:41:27.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:26 smithi050 bash[28929]: cluster 2024-05-20T22:41:25.497582+0000 mgr.y (mgr.14592) 1303 : cluster 0 pgmap v1736: 228 pgs: 228 active+clean; 583 KiB data, 804 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-05-20T22:41:27.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:26 smithi050 bash[28929]: cluster 2024-05-20T22:41:25.747909+0000 mon.a (mon.0) 3871 : cluster 0 osdmap e781: 8 total, 8 up, 8 in 2024-05-20T22:41:27.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:26 smithi050 bash[28929]: audit 2024-05-20T22:41:26.147661+0000 mon.a (mon.0) 3872 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:41:28.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:27 smithi145 bash[23893]: cluster 2024-05-20T22:41:26.741504+0000 mon.a (mon.0) 3873 : cluster 0 osdmap e782: 8 total, 8 up, 8 in 2024-05-20T22:41:28.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:27 smithi050 bash[21866]: cluster 2024-05-20T22:41:26.741504+0000 mon.a (mon.0) 3873 : cluster 0 osdmap e782: 8 total, 8 up, 8 in 2024-05-20T22:41:28.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:27 smithi050 bash[28929]: cluster 2024-05-20T22:41:26.741504+0000 mon.a (mon.0) 3873 : cluster 0 osdmap e782: 8 total, 8 up, 8 in 2024-05-20T22:41:29.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:28 smithi145 bash[23893]: cluster 2024-05-20T22:41:27.498036+0000 mgr.y (mgr.14592) 1304 : cluster 0 pgmap v1739: 196 pgs: 196 active+clean; 583 KiB data, 804 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:29.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:28 smithi145 bash[23893]: cluster 2024-05-20T22:41:27.753949+0000 mon.a (mon.0) 3874 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:41:29.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:28 smithi145 bash[23893]: cluster 2024-05-20T22:41:27.767931+0000 mon.a (mon.0) 3875 : cluster 0 osdmap e783: 8 total, 8 up, 8 in 2024-05-20T22:41:29.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:28 smithi050 bash[21866]: cluster 2024-05-20T22:41:27.498036+0000 mgr.y (mgr.14592) 1304 : cluster 0 pgmap v1739: 196 pgs: 196 active+clean; 583 KiB data, 804 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:29.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:28 smithi050 bash[21866]: cluster 2024-05-20T22:41:27.753949+0000 mon.a (mon.0) 3874 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:41:29.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:28 smithi050 bash[21866]: cluster 2024-05-20T22:41:27.767931+0000 mon.a (mon.0) 3875 : cluster 0 osdmap e783: 8 total, 8 up, 8 in 2024-05-20T22:41:29.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:28 smithi050 bash[28929]: cluster 2024-05-20T22:41:27.498036+0000 mgr.y (mgr.14592) 1304 : cluster 0 pgmap v1739: 196 pgs: 196 active+clean; 583 KiB data, 804 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:29.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:28 smithi050 bash[28929]: cluster 2024-05-20T22:41:27.753949+0000 mon.a (mon.0) 3874 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:41:29.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:28 smithi050 bash[28929]: cluster 2024-05-20T22:41:27.767931+0000 mon.a (mon.0) 3875 : cluster 0 osdmap e783: 8 total, 8 up, 8 in 2024-05-20T22:41:29.635 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:41:29 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:41:29.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:41:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:41:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:41:30.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:29 smithi145 bash[23893]: cluster 2024-05-20T22:41:28.769278+0000 mon.a (mon.0) 3876 : cluster 0 osdmap e784: 8 total, 8 up, 8 in 2024-05-20T22:41:30.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:29 smithi050 bash[21866]: cluster 2024-05-20T22:41:28.769278+0000 mon.a (mon.0) 3876 : cluster 0 osdmap e784: 8 total, 8 up, 8 in 2024-05-20T22:41:30.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:29 smithi050 bash[28929]: cluster 2024-05-20T22:41:28.769278+0000 mon.a (mon.0) 3876 : cluster 0 osdmap e784: 8 total, 8 up, 8 in 2024-05-20T22:41:31.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:30 smithi145 bash[23893]: audit 2024-05-20T22:41:29.387943+0000 mgr.y (mgr.14592) 1305 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:41:31.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:30 smithi145 bash[23893]: cluster 2024-05-20T22:41:29.498514+0000 mgr.y (mgr.14592) 1306 : cluster 0 pgmap v1742: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 804 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:41:31.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:30 smithi145 bash[23893]: cluster 2024-05-20T22:41:29.771387+0000 mon.a (mon.0) 3877 : cluster 0 osdmap e785: 8 total, 8 up, 8 in 2024-05-20T22:41:31.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:30 smithi050 bash[28929]: audit 2024-05-20T22:41:29.387943+0000 mgr.y (mgr.14592) 1305 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:41:31.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:30 smithi050 bash[28929]: cluster 2024-05-20T22:41:29.498514+0000 mgr.y (mgr.14592) 1306 : cluster 0 pgmap v1742: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 804 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:41:31.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:30 smithi050 bash[28929]: cluster 2024-05-20T22:41:29.771387+0000 mon.a (mon.0) 3877 : cluster 0 osdmap e785: 8 total, 8 up, 8 in 2024-05-20T22:41:31.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:30 smithi050 bash[21866]: audit 2024-05-20T22:41:29.387943+0000 mgr.y (mgr.14592) 1305 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:41:31.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:30 smithi050 bash[21866]: cluster 2024-05-20T22:41:29.498514+0000 mgr.y (mgr.14592) 1306 : cluster 0 pgmap v1742: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 804 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:41:31.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:30 smithi050 bash[21866]: cluster 2024-05-20T22:41:29.771387+0000 mon.a (mon.0) 3877 : cluster 0 osdmap e785: 8 total, 8 up, 8 in 2024-05-20T22:41:32.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:31 smithi145 bash[23893]: cluster 2024-05-20T22:41:30.791074+0000 mon.a (mon.0) 3878 : cluster 0 osdmap e786: 8 total, 8 up, 8 in 2024-05-20T22:41:32.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:31 smithi050 bash[21866]: cluster 2024-05-20T22:41:30.791074+0000 mon.a (mon.0) 3878 : cluster 0 osdmap e786: 8 total, 8 up, 8 in 2024-05-20T22:41:32.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:31 smithi050 bash[28929]: cluster 2024-05-20T22:41:30.791074+0000 mon.a (mon.0) 3878 : cluster 0 osdmap e786: 8 total, 8 up, 8 in 2024-05-20T22:41:33.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:32 smithi145 bash[23893]: cluster 2024-05-20T22:41:31.498987+0000 mgr.y (mgr.14592) 1307 : cluster 0 pgmap v1745: 228 pgs: 228 active+clean; 583 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:41:33.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:32 smithi145 bash[23893]: cluster 2024-05-20T22:41:31.799760+0000 mon.a (mon.0) 3879 : cluster 0 osdmap e787: 8 total, 8 up, 8 in 2024-05-20T22:41:33.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:32 smithi050 bash[21866]: cluster 2024-05-20T22:41:31.498987+0000 mgr.y (mgr.14592) 1307 : cluster 0 pgmap v1745: 228 pgs: 228 active+clean; 583 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:41:33.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:32 smithi050 bash[21866]: cluster 2024-05-20T22:41:31.799760+0000 mon.a (mon.0) 3879 : cluster 0 osdmap e787: 8 total, 8 up, 8 in 2024-05-20T22:41:33.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:32 smithi050 bash[28929]: cluster 2024-05-20T22:41:31.498987+0000 mgr.y (mgr.14592) 1307 : cluster 0 pgmap v1745: 228 pgs: 228 active+clean; 583 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 1 op/s 2024-05-20T22:41:33.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:32 smithi050 bash[28929]: cluster 2024-05-20T22:41:31.799760+0000 mon.a (mon.0) 3879 : cluster 0 osdmap e787: 8 total, 8 up, 8 in 2024-05-20T22:41:34.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:33 smithi145 bash[23893]: cluster 2024-05-20T22:41:32.824183+0000 mon.a (mon.0) 3880 : cluster 0 osdmap e788: 8 total, 8 up, 8 in 2024-05-20T22:41:34.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:33 smithi050 bash[28929]: cluster 2024-05-20T22:41:32.824183+0000 mon.a (mon.0) 3880 : cluster 0 osdmap e788: 8 total, 8 up, 8 in 2024-05-20T22:41:34.192 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:33 smithi050 bash[21866]: cluster 2024-05-20T22:41:32.824183+0000 mon.a (mon.0) 3880 : cluster 0 osdmap e788: 8 total, 8 up, 8 in 2024-05-20T22:41:35.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:34 smithi145 bash[23893]: cluster 2024-05-20T22:41:33.499488+0000 mgr.y (mgr.14592) 1308 : cluster 0 pgmap v1748: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:35.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:34 smithi145 bash[23893]: cluster 2024-05-20T22:41:33.832498+0000 mon.a (mon.0) 3881 : cluster 0 osdmap e789: 8 total, 8 up, 8 in 2024-05-20T22:41:35.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:34 smithi050 bash[21866]: cluster 2024-05-20T22:41:33.499488+0000 mgr.y (mgr.14592) 1308 : cluster 0 pgmap v1748: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:35.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:34 smithi050 bash[21866]: cluster 2024-05-20T22:41:33.832498+0000 mon.a (mon.0) 3881 : cluster 0 osdmap e789: 8 total, 8 up, 8 in 2024-05-20T22:41:35.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:34 smithi050 bash[28929]: cluster 2024-05-20T22:41:33.499488+0000 mgr.y (mgr.14592) 1308 : cluster 0 pgmap v1748: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:35.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:34 smithi050 bash[28929]: cluster 2024-05-20T22:41:33.832498+0000 mon.a (mon.0) 3881 : cluster 0 osdmap e789: 8 total, 8 up, 8 in 2024-05-20T22:41:36.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:35 smithi145 bash[23893]: cluster 2024-05-20T22:41:34.845545+0000 mon.a (mon.0) 3882 : cluster 0 osdmap e790: 8 total, 8 up, 8 in 2024-05-20T22:41:36.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:35 smithi050 bash[28929]: cluster 2024-05-20T22:41:34.845545+0000 mon.a (mon.0) 3882 : cluster 0 osdmap e790: 8 total, 8 up, 8 in 2024-05-20T22:41:36.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:35 smithi050 bash[21866]: cluster 2024-05-20T22:41:34.845545+0000 mon.a (mon.0) 3882 : cluster 0 osdmap e790: 8 total, 8 up, 8 in 2024-05-20T22:41:36.899 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.Applications (4965 ms) 2024-05-20T22:41:36.899 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2024-05-20T22:41:36.899 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-05-20T22:41:36.900 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2024-05-20T22:41:36.900 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-05-20T22:41:36.900 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2024-05-20T22:41:36.900 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (21422 ms) 2024-05-20T22:41:36.900 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 8 tests from LibRadosMisc (26459 ms total) 2024-05-20T22:41:36.900 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2024-05-20T22:41:36.900 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] Global test environment tear-down 2024-05-20T22:41:36.900 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (1850074 ms total) 2024-05-20T22:41:36.900 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ PASSED ] 12 tests. 2024-05-20T22:41:36.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64258 2024-05-20T22:41:36.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64258 2024-05-20T22:41:36.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64662 2024-05-20T22:41:36.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64662 2024-05-20T22:41:36.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64716 2024-05-20T22:41:36.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64716 2024-05-20T22:41:36.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64058 2024-05-20T22:41:36.905 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64058 2024-05-20T22:41:36.906 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.906 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64550 2024-05-20T22:41:36.906 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64550 2024-05-20T22:41:36.906 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.906 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64389 2024-05-20T22:41:36.906 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64389 2024-05-20T22:41:36.906 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.906 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=63947 2024-05-20T22:41:36.906 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 63947 2024-05-20T22:41:36.906 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.906 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=63979 2024-05-20T22:41:36.906 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 63979 2024-05-20T22:41:36.906 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.906 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64409 2024-05-20T22:41:36.907 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64409 2024-05-20T22:41:36.907 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.907 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=63939 2024-05-20T22:41:36.907 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 63939 2024-05-20T22:41:36.907 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.907 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=63955 2024-05-20T22:41:36.907 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 63955 2024-05-20T22:41:36.907 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.907 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64827 2024-05-20T22:41:36.907 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64827 2024-05-20T22:41:36.907 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.907 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64153 2024-05-20T22:41:36.907 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64153 2024-05-20T22:41:36.907 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.908 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64850 2024-05-20T22:41:36.908 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64850 2024-05-20T22:41:36.908 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.908 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64225 2024-05-20T22:41:36.908 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64225 2024-05-20T22:41:36.908 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.908 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64630 2024-05-20T22:41:36.908 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64630 2024-05-20T22:41:36.908 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.908 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64891 2024-05-20T22:41:36.908 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64891 2024-05-20T22:41:36.908 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.908 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64177 2024-05-20T22:41:36.908 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64177 2024-05-20T22:41:36.909 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.909 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64436 2024-05-20T22:41:36.909 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64436 2024-05-20T22:41:36.909 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.909 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64811 2024-05-20T22:41:36.909 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64811 2024-05-20T22:41:36.909 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.909 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64590 2024-05-20T22:41:36.909 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64590 2024-05-20T22:41:36.909 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.909 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64842 2024-05-20T22:41:36.909 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64842 2024-05-20T22:41:36.909 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.909 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64377 2024-05-20T22:41:36.909 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64377 2024-05-20T22:41:36.910 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.910 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64130 2024-05-20T22:41:36.910 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64130 2024-05-20T22:41:36.910 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:41:36.910 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64858 2024-05-20T22:41:36.910 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64858 2024-05-20T22:41:37.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:36 smithi145 bash[23893]: cluster 2024-05-20T22:41:35.500781+0000 mgr.y (mgr.14592) 1309 : cluster 0 pgmap v1751: 228 pgs: 228 active+clean; 584 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 3 op/s 2024-05-20T22:41:37.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:36 smithi145 bash[23893]: cluster 2024-05-20T22:41:35.851270+0000 mon.a (mon.0) 3883 : cluster 0 osdmap e791: 8 total, 8 up, 8 in 2024-05-20T22:41:37.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:36 smithi145 bash[23893]: cluster 2024-05-20T22:41:36.266005+0000 mon.a (mon.0) 3884 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:41:37.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:36 smithi050 bash[21866]: cluster 2024-05-20T22:41:35.500781+0000 mgr.y (mgr.14592) 1309 : cluster 0 pgmap v1751: 228 pgs: 228 active+clean; 584 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 3 op/s 2024-05-20T22:41:37.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:36 smithi050 bash[21866]: cluster 2024-05-20T22:41:35.851270+0000 mon.a (mon.0) 3883 : cluster 0 osdmap e791: 8 total, 8 up, 8 in 2024-05-20T22:41:37.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:36 smithi050 bash[21866]: cluster 2024-05-20T22:41:36.266005+0000 mon.a (mon.0) 3884 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:41:37.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:36 smithi050 bash[28929]: cluster 2024-05-20T22:41:35.500781+0000 mgr.y (mgr.14592) 1309 : cluster 0 pgmap v1751: 228 pgs: 228 active+clean; 584 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 3 op/s 2024-05-20T22:41:37.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:36 smithi050 bash[28929]: cluster 2024-05-20T22:41:35.851270+0000 mon.a (mon.0) 3883 : cluster 0 osdmap e791: 8 total, 8 up, 8 in 2024-05-20T22:41:37.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:36 smithi050 bash[28929]: cluster 2024-05-20T22:41:36.266005+0000 mon.a (mon.0) 3884 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:41:38.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:37 smithi145 bash[23893]: cluster 2024-05-20T22:41:36.865340+0000 mon.a (mon.0) 3885 : cluster 0 osdmap e792: 8 total, 8 up, 8 in 2024-05-20T22:41:38.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:37 smithi050 bash[21866]: cluster 2024-05-20T22:41:36.865340+0000 mon.a (mon.0) 3885 : cluster 0 osdmap e792: 8 total, 8 up, 8 in 2024-05-20T22:41:38.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:37 smithi050 bash[28929]: cluster 2024-05-20T22:41:36.865340+0000 mon.a (mon.0) 3885 : cluster 0 osdmap e792: 8 total, 8 up, 8 in 2024-05-20T22:41:39.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:38 smithi145 bash[23893]: cluster 2024-05-20T22:41:37.501574+0000 mgr.y (mgr.14592) 1310 : cluster 0 pgmap v1754: 196 pgs: 196 active+clean; 583 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-05-20T22:41:39.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:38 smithi145 bash[23893]: cluster 2024-05-20T22:41:37.877109+0000 mon.a (mon.0) 3886 : cluster 0 osdmap e793: 8 total, 8 up, 8 in 2024-05-20T22:41:39.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:38 smithi050 bash[21866]: cluster 2024-05-20T22:41:37.501574+0000 mgr.y (mgr.14592) 1310 : cluster 0 pgmap v1754: 196 pgs: 196 active+clean; 583 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-05-20T22:41:39.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:38 smithi050 bash[21866]: cluster 2024-05-20T22:41:37.877109+0000 mon.a (mon.0) 3886 : cluster 0 osdmap e793: 8 total, 8 up, 8 in 2024-05-20T22:41:39.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:38 smithi050 bash[28929]: cluster 2024-05-20T22:41:37.501574+0000 mgr.y (mgr.14592) 1310 : cluster 0 pgmap v1754: 196 pgs: 196 active+clean; 583 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-05-20T22:41:39.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:38 smithi050 bash[28929]: cluster 2024-05-20T22:41:37.877109+0000 mon.a (mon.0) 3886 : cluster 0 osdmap e793: 8 total, 8 up, 8 in 2024-05-20T22:41:39.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:41:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:41:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:41:39.882 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:41:39 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:41:40.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:39 smithi145 bash[23893]: cluster 2024-05-20T22:41:38.887816+0000 mon.a (mon.0) 3887 : cluster 0 osdmap e794: 8 total, 8 up, 8 in 2024-05-20T22:41:40.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:39 smithi050 bash[28929]: cluster 2024-05-20T22:41:38.887816+0000 mon.a (mon.0) 3887 : cluster 0 osdmap e794: 8 total, 8 up, 8 in 2024-05-20T22:41:40.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:39 smithi050 bash[21866]: cluster 2024-05-20T22:41:38.887816+0000 mon.a (mon.0) 3887 : cluster 0 osdmap e794: 8 total, 8 up, 8 in 2024-05-20T22:41:41.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:40 smithi050 bash[21866]: audit 2024-05-20T22:41:39.399219+0000 mgr.y (mgr.14592) 1311 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:41:41.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:40 smithi050 bash[21866]: cluster 2024-05-20T22:41:39.502381+0000 mgr.y (mgr.14592) 1312 : cluster 0 pgmap v1757: 196 pgs: 32 unknown, 164 active+clean; 583 KiB data, 811 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:41:41.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:40 smithi050 bash[21866]: cluster 2024-05-20T22:41:39.898713+0000 mon.a (mon.0) 3888 : cluster 0 osdmap e795: 8 total, 8 up, 8 in 2024-05-20T22:41:41.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:40 smithi050 bash[28929]: audit 2024-05-20T22:41:39.399219+0000 mgr.y (mgr.14592) 1311 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:41:41.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:40 smithi050 bash[28929]: cluster 2024-05-20T22:41:39.502381+0000 mgr.y (mgr.14592) 1312 : cluster 0 pgmap v1757: 196 pgs: 32 unknown, 164 active+clean; 583 KiB data, 811 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:41:41.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:40 smithi050 bash[28929]: cluster 2024-05-20T22:41:39.898713+0000 mon.a (mon.0) 3888 : cluster 0 osdmap e795: 8 total, 8 up, 8 in 2024-05-20T22:41:41.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:40 smithi145 bash[23893]: audit 2024-05-20T22:41:39.399219+0000 mgr.y (mgr.14592) 1311 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:41:41.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:40 smithi145 bash[23893]: cluster 2024-05-20T22:41:39.502381+0000 mgr.y (mgr.14592) 1312 : cluster 0 pgmap v1757: 196 pgs: 32 unknown, 164 active+clean; 583 KiB data, 811 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:41:41.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:40 smithi145 bash[23893]: cluster 2024-05-20T22:41:39.898713+0000 mon.a (mon.0) 3888 : cluster 0 osdmap e795: 8 total, 8 up, 8 in 2024-05-20T22:41:42.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:41 smithi050 bash[21866]: cluster 2024-05-20T22:41:40.899431+0000 mon.a (mon.0) 3889 : cluster 0 osdmap e796: 8 total, 8 up, 8 in 2024-05-20T22:41:42.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:41 smithi050 bash[21866]: audit 2024-05-20T22:41:41.165897+0000 mon.a (mon.0) 3890 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:41:42.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:41 smithi050 bash[28929]: cluster 2024-05-20T22:41:40.899431+0000 mon.a (mon.0) 3889 : cluster 0 osdmap e796: 8 total, 8 up, 8 in 2024-05-20T22:41:42.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:41 smithi050 bash[28929]: audit 2024-05-20T22:41:41.165897+0000 mon.a (mon.0) 3890 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:41:42.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:41 smithi145 bash[23893]: cluster 2024-05-20T22:41:40.899431+0000 mon.a (mon.0) 3889 : cluster 0 osdmap e796: 8 total, 8 up, 8 in 2024-05-20T22:41:42.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:41 smithi145 bash[23893]: audit 2024-05-20T22:41:41.165897+0000 mon.a (mon.0) 3890 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:41:43.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:42 smithi050 bash[28929]: cluster 2024-05-20T22:41:41.503153+0000 mgr.y (mgr.14592) 1313 : cluster 0 pgmap v1760: 196 pgs: 17 creating+activating, 10 creating+peering, 169 active+clean; 583 KiB data, 815 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:41:43.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:42 smithi050 bash[28929]: cluster 2024-05-20T22:41:41.912384+0000 mon.a (mon.0) 3891 : cluster 0 osdmap e797: 8 total, 8 up, 8 in 2024-05-20T22:41:43.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:42 smithi050 bash[21866]: cluster 2024-05-20T22:41:41.503153+0000 mgr.y (mgr.14592) 1313 : cluster 0 pgmap v1760: 196 pgs: 17 creating+activating, 10 creating+peering, 169 active+clean; 583 KiB data, 815 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:41:43.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:42 smithi050 bash[21866]: cluster 2024-05-20T22:41:41.912384+0000 mon.a (mon.0) 3891 : cluster 0 osdmap e797: 8 total, 8 up, 8 in 2024-05-20T22:41:43.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:42 smithi145 bash[23893]: cluster 2024-05-20T22:41:41.503153+0000 mgr.y (mgr.14592) 1313 : cluster 0 pgmap v1760: 196 pgs: 17 creating+activating, 10 creating+peering, 169 active+clean; 583 KiB data, 815 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:41:43.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:42 smithi145 bash[23893]: cluster 2024-05-20T22:41:41.912384+0000 mon.a (mon.0) 3891 : cluster 0 osdmap e797: 8 total, 8 up, 8 in 2024-05-20T22:41:44.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:43 smithi050 bash[21866]: cluster 2024-05-20T22:41:42.926260+0000 mon.a (mon.0) 3892 : cluster 0 osdmap e798: 8 total, 8 up, 8 in 2024-05-20T22:41:44.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:43 smithi050 bash[28929]: cluster 2024-05-20T22:41:42.926260+0000 mon.a (mon.0) 3892 : cluster 0 osdmap e798: 8 total, 8 up, 8 in 2024-05-20T22:41:44.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:43 smithi145 bash[23893]: cluster 2024-05-20T22:41:42.926260+0000 mon.a (mon.0) 3892 : cluster 0 osdmap e798: 8 total, 8 up, 8 in 2024-05-20T22:41:45.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:44 smithi050 bash[21866]: cluster 2024-05-20T22:41:43.503993+0000 mgr.y (mgr.14592) 1314 : cluster 0 pgmap v1763: 196 pgs: 17 creating+activating, 10 creating+peering, 169 active+clean; 583 KiB data, 815 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:45.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:44 smithi050 bash[21866]: cluster 2024-05-20T22:41:43.946858+0000 mon.a (mon.0) 3893 : cluster 0 osdmap e799: 8 total, 8 up, 8 in 2024-05-20T22:41:45.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:44 smithi050 bash[28929]: cluster 2024-05-20T22:41:43.503993+0000 mgr.y (mgr.14592) 1314 : cluster 0 pgmap v1763: 196 pgs: 17 creating+activating, 10 creating+peering, 169 active+clean; 583 KiB data, 815 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:45.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:44 smithi050 bash[28929]: cluster 2024-05-20T22:41:43.946858+0000 mon.a (mon.0) 3893 : cluster 0 osdmap e799: 8 total, 8 up, 8 in 2024-05-20T22:41:45.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:44 smithi145 bash[23893]: cluster 2024-05-20T22:41:43.503993+0000 mgr.y (mgr.14592) 1314 : cluster 0 pgmap v1763: 196 pgs: 17 creating+activating, 10 creating+peering, 169 active+clean; 583 KiB data, 815 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:45.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:44 smithi145 bash[23893]: cluster 2024-05-20T22:41:43.946858+0000 mon.a (mon.0) 3893 : cluster 0 osdmap e799: 8 total, 8 up, 8 in 2024-05-20T22:41:46.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:45 smithi145 bash[23893]: cluster 2024-05-20T22:41:44.955461+0000 mon.a (mon.0) 3894 : cluster 0 osdmap e800: 8 total, 8 up, 8 in 2024-05-20T22:41:46.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:45 smithi050 bash[21866]: cluster 2024-05-20T22:41:44.955461+0000 mon.a (mon.0) 3894 : cluster 0 osdmap e800: 8 total, 8 up, 8 in 2024-05-20T22:41:46.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:45 smithi050 bash[28929]: cluster 2024-05-20T22:41:44.955461+0000 mon.a (mon.0) 3894 : cluster 0 osdmap e800: 8 total, 8 up, 8 in 2024-05-20T22:41:47.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:46 smithi145 bash[23893]: cluster 2024-05-20T22:41:45.504752+0000 mgr.y (mgr.14592) 1315 : cluster 0 pgmap v1766: 196 pgs: 196 active+clean; 584 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 5 op/s 2024-05-20T22:41:47.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:46 smithi145 bash[23893]: cluster 2024-05-20T22:41:45.975325+0000 mon.a (mon.0) 3895 : cluster 0 osdmap e801: 8 total, 8 up, 8 in 2024-05-20T22:41:47.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:46 smithi145 bash[23893]: audit 2024-05-20T22:41:46.706342+0000 mon.a (mon.0) 3896 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:41:47.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:46 smithi050 bash[28929]: cluster 2024-05-20T22:41:45.504752+0000 mgr.y (mgr.14592) 1315 : cluster 0 pgmap v1766: 196 pgs: 196 active+clean; 584 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 5 op/s 2024-05-20T22:41:47.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:46 smithi050 bash[28929]: cluster 2024-05-20T22:41:45.975325+0000 mon.a (mon.0) 3895 : cluster 0 osdmap e801: 8 total, 8 up, 8 in 2024-05-20T22:41:47.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:46 smithi050 bash[28929]: audit 2024-05-20T22:41:46.706342+0000 mon.a (mon.0) 3896 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:41:47.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:46 smithi050 bash[21866]: cluster 2024-05-20T22:41:45.504752+0000 mgr.y (mgr.14592) 1315 : cluster 0 pgmap v1766: 196 pgs: 196 active+clean; 584 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 5 op/s 2024-05-20T22:41:47.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:46 smithi050 bash[21866]: cluster 2024-05-20T22:41:45.975325+0000 mon.a (mon.0) 3895 : cluster 0 osdmap e801: 8 total, 8 up, 8 in 2024-05-20T22:41:47.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:46 smithi050 bash[21866]: audit 2024-05-20T22:41:46.706342+0000 mon.a (mon.0) 3896 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:41:48.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:47 smithi145 bash[23893]: cluster 2024-05-20T22:41:46.978619+0000 mon.a (mon.0) 3897 : cluster 0 osdmap e802: 8 total, 8 up, 8 in 2024-05-20T22:41:48.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:47 smithi145 bash[23893]: audit 2024-05-20T22:41:47.446719+0000 mon.a (mon.0) 3898 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:41:48.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:47 smithi145 bash[23893]: audit 2024-05-20T22:41:47.447704+0000 mon.a (mon.0) 3899 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:41:48.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:47 smithi145 bash[23893]: audit 2024-05-20T22:41:47.456348+0000 mon.a (mon.0) 3900 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:41:48.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:47 smithi050 bash[21866]: cluster 2024-05-20T22:41:46.978619+0000 mon.a (mon.0) 3897 : cluster 0 osdmap e802: 8 total, 8 up, 8 in 2024-05-20T22:41:48.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:47 smithi050 bash[21866]: audit 2024-05-20T22:41:47.446719+0000 mon.a (mon.0) 3898 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:41:48.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:47 smithi050 bash[21866]: audit 2024-05-20T22:41:47.447704+0000 mon.a (mon.0) 3899 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:41:48.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:47 smithi050 bash[21866]: audit 2024-05-20T22:41:47.456348+0000 mon.a (mon.0) 3900 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:41:48.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:47 smithi050 bash[28929]: cluster 2024-05-20T22:41:46.978619+0000 mon.a (mon.0) 3897 : cluster 0 osdmap e802: 8 total, 8 up, 8 in 2024-05-20T22:41:48.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:47 smithi050 bash[28929]: audit 2024-05-20T22:41:47.446719+0000 mon.a (mon.0) 3898 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:41:48.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:47 smithi050 bash[28929]: audit 2024-05-20T22:41:47.447704+0000 mon.a (mon.0) 3899 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:41:48.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:47 smithi050 bash[28929]: audit 2024-05-20T22:41:47.456348+0000 mon.a (mon.0) 3900 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:41:49.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:49 smithi145 bash[23893]: cluster 2024-05-20T22:41:47.505297+0000 mgr.y (mgr.14592) 1316 : cluster 0 pgmap v1769: 196 pgs: 32 unknown, 164 active+clean; 583 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:49.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:49 smithi145 bash[23893]: cluster 2024-05-20T22:41:47.982733+0000 mon.a (mon.0) 3901 : cluster 0 osdmap e803: 8 total, 8 up, 8 in 2024-05-20T22:41:49.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:49 smithi050 bash[21866]: cluster 2024-05-20T22:41:47.505297+0000 mgr.y (mgr.14592) 1316 : cluster 0 pgmap v1769: 196 pgs: 32 unknown, 164 active+clean; 583 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:49.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:49 smithi050 bash[21866]: cluster 2024-05-20T22:41:47.982733+0000 mon.a (mon.0) 3901 : cluster 0 osdmap e803: 8 total, 8 up, 8 in 2024-05-20T22:41:49.387 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:49 smithi050 bash[28929]: cluster 2024-05-20T22:41:47.505297+0000 mgr.y (mgr.14592) 1316 : cluster 0 pgmap v1769: 196 pgs: 32 unknown, 164 active+clean; 583 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:49.387 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:49 smithi050 bash[28929]: cluster 2024-05-20T22:41:47.982733+0000 mon.a (mon.0) 3901 : cluster 0 osdmap e803: 8 total, 8 up, 8 in 2024-05-20T22:41:49.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:41:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:41:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:41:49.885 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:41:49 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:41:50.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:50 smithi145 bash[23893]: cluster 2024-05-20T22:41:48.997760+0000 mon.a (mon.0) 3902 : cluster 0 osdmap e804: 8 total, 8 up, 8 in 2024-05-20T22:41:50.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:50 smithi050 bash[21866]: cluster 2024-05-20T22:41:48.997760+0000 mon.a (mon.0) 3902 : cluster 0 osdmap e804: 8 total, 8 up, 8 in 2024-05-20T22:41:50.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:50 smithi050 bash[28929]: cluster 2024-05-20T22:41:48.997760+0000 mon.a (mon.0) 3902 : cluster 0 osdmap e804: 8 total, 8 up, 8 in 2024-05-20T22:41:51.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:51 smithi145 bash[23893]: audit 2024-05-20T22:41:49.409151+0000 mgr.y (mgr.14592) 1317 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:41:51.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:51 smithi145 bash[23893]: cluster 2024-05-20T22:41:49.506050+0000 mgr.y (mgr.14592) 1318 : cluster 0 pgmap v1772: 196 pgs: 32 unknown, 164 active+clean; 583 KiB data, 833 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:41:51.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:51 smithi145 bash[23893]: cluster 2024-05-20T22:41:50.018251+0000 mon.a (mon.0) 3903 : cluster 0 osdmap e805: 8 total, 8 up, 8 in 2024-05-20T22:41:51.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:51 smithi050 bash[21866]: audit 2024-05-20T22:41:49.409151+0000 mgr.y (mgr.14592) 1317 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:41:51.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:51 smithi050 bash[21866]: cluster 2024-05-20T22:41:49.506050+0000 mgr.y (mgr.14592) 1318 : cluster 0 pgmap v1772: 196 pgs: 32 unknown, 164 active+clean; 583 KiB data, 833 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:41:51.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:51 smithi050 bash[21866]: cluster 2024-05-20T22:41:50.018251+0000 mon.a (mon.0) 3903 : cluster 0 osdmap e805: 8 total, 8 up, 8 in 2024-05-20T22:41:51.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:51 smithi050 bash[28929]: audit 2024-05-20T22:41:49.409151+0000 mgr.y (mgr.14592) 1317 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:41:51.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:51 smithi050 bash[28929]: cluster 2024-05-20T22:41:49.506050+0000 mgr.y (mgr.14592) 1318 : cluster 0 pgmap v1772: 196 pgs: 32 unknown, 164 active+clean; 583 KiB data, 833 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:41:51.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:51 smithi050 bash[28929]: cluster 2024-05-20T22:41:50.018251+0000 mon.a (mon.0) 3903 : cluster 0 osdmap e805: 8 total, 8 up, 8 in 2024-05-20T22:41:52.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:52 smithi145 bash[23893]: cluster 2024-05-20T22:41:51.019723+0000 mon.a (mon.0) 3904 : cluster 0 osdmap e806: 8 total, 8 up, 8 in 2024-05-20T22:41:52.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:52 smithi145 bash[23893]: cluster 2024-05-20T22:41:52.022393+0000 mon.a (mon.0) 3905 : cluster 0 osdmap e807: 8 total, 8 up, 8 in 2024-05-20T22:41:52.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:52 smithi050 bash[21866]: cluster 2024-05-20T22:41:51.019723+0000 mon.a (mon.0) 3904 : cluster 0 osdmap e806: 8 total, 8 up, 8 in 2024-05-20T22:41:52.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:52 smithi050 bash[21866]: cluster 2024-05-20T22:41:52.022393+0000 mon.a (mon.0) 3905 : cluster 0 osdmap e807: 8 total, 8 up, 8 in 2024-05-20T22:41:52.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:52 smithi050 bash[28929]: cluster 2024-05-20T22:41:51.019723+0000 mon.a (mon.0) 3904 : cluster 0 osdmap e806: 8 total, 8 up, 8 in 2024-05-20T22:41:52.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:52 smithi050 bash[28929]: cluster 2024-05-20T22:41:52.022393+0000 mon.a (mon.0) 3905 : cluster 0 osdmap e807: 8 total, 8 up, 8 in 2024-05-20T22:41:53.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:53 smithi145 bash[23893]: cluster 2024-05-20T22:41:51.507012+0000 mgr.y (mgr.14592) 1319 : cluster 0 pgmap v1775: 196 pgs: 196 active+clean; 1.6 MiB data, 854 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 256 KiB/s wr, 1 op/s 2024-05-20T22:41:53.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:53 smithi050 bash[21866]: cluster 2024-05-20T22:41:51.507012+0000 mgr.y (mgr.14592) 1319 : cluster 0 pgmap v1775: 196 pgs: 196 active+clean; 1.6 MiB data, 854 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 256 KiB/s wr, 1 op/s 2024-05-20T22:41:53.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:53 smithi050 bash[28929]: cluster 2024-05-20T22:41:51.507012+0000 mgr.y (mgr.14592) 1319 : cluster 0 pgmap v1775: 196 pgs: 196 active+clean; 1.6 MiB data, 854 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 256 KiB/s wr, 1 op/s 2024-05-20T22:41:54.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:54 smithi145 bash[23893]: cluster 2024-05-20T22:41:53.058646+0000 mon.a (mon.0) 3906 : cluster 0 osdmap e808: 8 total, 8 up, 8 in 2024-05-20T22:41:54.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:54 smithi145 bash[23893]: cluster 2024-05-20T22:41:53.507988+0000 mgr.y (mgr.14592) 1320 : cluster 0 pgmap v1778: 196 pgs: 32 unknown, 164 active+clean; 583 KiB data, 854 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:54.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:54 smithi050 bash[21866]: cluster 2024-05-20T22:41:53.058646+0000 mon.a (mon.0) 3906 : cluster 0 osdmap e808: 8 total, 8 up, 8 in 2024-05-20T22:41:54.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:54 smithi050 bash[21866]: cluster 2024-05-20T22:41:53.507988+0000 mgr.y (mgr.14592) 1320 : cluster 0 pgmap v1778: 196 pgs: 32 unknown, 164 active+clean; 583 KiB data, 854 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:54.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:54 smithi050 bash[28929]: cluster 2024-05-20T22:41:53.058646+0000 mon.a (mon.0) 3906 : cluster 0 osdmap e808: 8 total, 8 up, 8 in 2024-05-20T22:41:54.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:54 smithi050 bash[28929]: cluster 2024-05-20T22:41:53.507988+0000 mgr.y (mgr.14592) 1320 : cluster 0 pgmap v1778: 196 pgs: 32 unknown, 164 active+clean; 583 KiB data, 854 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:55.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:55 smithi145 bash[23893]: cluster 2024-05-20T22:41:54.071333+0000 mon.a (mon.0) 3907 : cluster 0 osdmap e809: 8 total, 8 up, 8 in 2024-05-20T22:41:55.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:55 smithi050 bash[21866]: cluster 2024-05-20T22:41:54.071333+0000 mon.a (mon.0) 3907 : cluster 0 osdmap e809: 8 total, 8 up, 8 in 2024-05-20T22:41:55.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:55 smithi050 bash[28929]: cluster 2024-05-20T22:41:54.071333+0000 mon.a (mon.0) 3907 : cluster 0 osdmap e809: 8 total, 8 up, 8 in 2024-05-20T22:41:56.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:56 smithi145 bash[23893]: cluster 2024-05-20T22:41:55.072811+0000 mon.a (mon.0) 3908 : cluster 0 osdmap e810: 8 total, 8 up, 8 in 2024-05-20T22:41:56.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:56 smithi145 bash[23893]: cluster 2024-05-20T22:41:55.508834+0000 mgr.y (mgr.14592) 1321 : cluster 0 pgmap v1781: 196 pgs: 196 active+clean; 583 KiB data, 860 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-05-20T22:41:56.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:56 smithi050 bash[21866]: cluster 2024-05-20T22:41:55.072811+0000 mon.a (mon.0) 3908 : cluster 0 osdmap e810: 8 total, 8 up, 8 in 2024-05-20T22:41:56.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:56 smithi050 bash[21866]: cluster 2024-05-20T22:41:55.508834+0000 mgr.y (mgr.14592) 1321 : cluster 0 pgmap v1781: 196 pgs: 196 active+clean; 583 KiB data, 860 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-05-20T22:41:56.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:56 smithi050 bash[28929]: cluster 2024-05-20T22:41:55.072811+0000 mon.a (mon.0) 3908 : cluster 0 osdmap e810: 8 total, 8 up, 8 in 2024-05-20T22:41:56.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:56 smithi050 bash[28929]: cluster 2024-05-20T22:41:55.508834+0000 mgr.y (mgr.14592) 1321 : cluster 0 pgmap v1781: 196 pgs: 196 active+clean; 583 KiB data, 860 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-05-20T22:41:57.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:57 smithi145 bash[23893]: cluster 2024-05-20T22:41:56.091535+0000 mon.a (mon.0) 3909 : cluster 0 osdmap e811: 8 total, 8 up, 8 in 2024-05-20T22:41:57.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:57 smithi145 bash[23893]: audit 2024-05-20T22:41:56.578898+0000 mon.a (mon.0) 3910 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:41:57.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:57 smithi050 bash[21866]: cluster 2024-05-20T22:41:56.091535+0000 mon.a (mon.0) 3909 : cluster 0 osdmap e811: 8 total, 8 up, 8 in 2024-05-20T22:41:57.441 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:57 smithi050 bash[21866]: audit 2024-05-20T22:41:56.578898+0000 mon.a (mon.0) 3910 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:41:57.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:57 smithi050 bash[28929]: cluster 2024-05-20T22:41:56.091535+0000 mon.a (mon.0) 3909 : cluster 0 osdmap e811: 8 total, 8 up, 8 in 2024-05-20T22:41:57.441 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:57 smithi050 bash[28929]: audit 2024-05-20T22:41:56.578898+0000 mon.a (mon.0) 3910 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:41:58.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:58 smithi145 bash[23893]: cluster 2024-05-20T22:41:57.105071+0000 mon.a (mon.0) 3911 : cluster 0 osdmap e812: 8 total, 8 up, 8 in 2024-05-20T22:41:58.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:58 smithi145 bash[23893]: cluster 2024-05-20T22:41:57.509803+0000 mgr.y (mgr.14592) 1322 : cluster 0 pgmap v1784: 196 pgs: 32 unknown, 164 active+clean; 583 KiB data, 860 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:58.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:58 smithi050 bash[21866]: cluster 2024-05-20T22:41:57.105071+0000 mon.a (mon.0) 3911 : cluster 0 osdmap e812: 8 total, 8 up, 8 in 2024-05-20T22:41:58.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:58 smithi050 bash[21866]: cluster 2024-05-20T22:41:57.509803+0000 mgr.y (mgr.14592) 1322 : cluster 0 pgmap v1784: 196 pgs: 32 unknown, 164 active+clean; 583 KiB data, 860 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:58.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:58 smithi050 bash[28929]: cluster 2024-05-20T22:41:57.105071+0000 mon.a (mon.0) 3911 : cluster 0 osdmap e812: 8 total, 8 up, 8 in 2024-05-20T22:41:58.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:58 smithi050 bash[28929]: cluster 2024-05-20T22:41:57.509803+0000 mgr.y (mgr.14592) 1322 : cluster 0 pgmap v1784: 196 pgs: 32 unknown, 164 active+clean; 583 KiB data, 860 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:41:59.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:41:59 smithi145 bash[23893]: cluster 2024-05-20T22:41:58.116658+0000 mon.a (mon.0) 3912 : cluster 0 osdmap e813: 8 total, 8 up, 8 in 2024-05-20T22:41:59.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:41:59 smithi050 bash[21866]: cluster 2024-05-20T22:41:58.116658+0000 mon.a (mon.0) 3912 : cluster 0 osdmap e813: 8 total, 8 up, 8 in 2024-05-20T22:41:59.387 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:41:59 smithi050 bash[28929]: cluster 2024-05-20T22:41:58.116658+0000 mon.a (mon.0) 3912 : cluster 0 osdmap e813: 8 total, 8 up, 8 in 2024-05-20T22:41:59.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:41:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:41:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:41:59.885 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:41:59 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:42:00.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:00 smithi145 bash[23893]: cluster 2024-05-20T22:41:59.124736+0000 mon.a (mon.0) 3913 : cluster 0 osdmap e814: 8 total, 8 up, 8 in 2024-05-20T22:42:00.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:00 smithi145 bash[23893]: audit 2024-05-20T22:41:59.417183+0000 mgr.y (mgr.14592) 1323 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:42:00.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:00 smithi145 bash[23893]: cluster 2024-05-20T22:41:59.510621+0000 mgr.y (mgr.14592) 1324 : cluster 0 pgmap v1787: 196 pgs: 32 unknown, 164 active+clean; 583 KiB data, 860 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:42:00.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:00 smithi050 bash[28929]: cluster 2024-05-20T22:41:59.124736+0000 mon.a (mon.0) 3913 : cluster 0 osdmap e814: 8 total, 8 up, 8 in 2024-05-20T22:42:00.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:00 smithi050 bash[28929]: audit 2024-05-20T22:41:59.417183+0000 mgr.y (mgr.14592) 1323 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:42:00.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:00 smithi050 bash[28929]: cluster 2024-05-20T22:41:59.510621+0000 mgr.y (mgr.14592) 1324 : cluster 0 pgmap v1787: 196 pgs: 32 unknown, 164 active+clean; 583 KiB data, 860 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:42:00.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:00 smithi050 bash[21866]: cluster 2024-05-20T22:41:59.124736+0000 mon.a (mon.0) 3913 : cluster 0 osdmap e814: 8 total, 8 up, 8 in 2024-05-20T22:42:00.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:00 smithi050 bash[21866]: audit 2024-05-20T22:41:59.417183+0000 mgr.y (mgr.14592) 1323 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:42:00.441 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:00 smithi050 bash[21866]: cluster 2024-05-20T22:41:59.510621+0000 mgr.y (mgr.14592) 1324 : cluster 0 pgmap v1787: 196 pgs: 32 unknown, 164 active+clean; 583 KiB data, 860 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:42:01.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:01 smithi145 bash[23893]: cluster 2024-05-20T22:42:00.135813+0000 mon.a (mon.0) 3914 : cluster 0 osdmap e815: 8 total, 8 up, 8 in 2024-05-20T22:42:01.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:01 smithi050 bash[21866]: cluster 2024-05-20T22:42:00.135813+0000 mon.a (mon.0) 3914 : cluster 0 osdmap e815: 8 total, 8 up, 8 in 2024-05-20T22:42:01.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:01 smithi050 bash[28929]: cluster 2024-05-20T22:42:00.135813+0000 mon.a (mon.0) 3914 : cluster 0 osdmap e815: 8 total, 8 up, 8 in 2024-05-20T22:42:02.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:02 smithi145 bash[23893]: cluster 2024-05-20T22:42:01.511432+0000 mgr.y (mgr.14592) 1325 : cluster 0 pgmap v1789: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 232 B/s wr, 1 op/s 2024-05-20T22:42:02.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:02 smithi050 bash[21866]: cluster 2024-05-20T22:42:01.511432+0000 mgr.y (mgr.14592) 1325 : cluster 0 pgmap v1789: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 232 B/s wr, 1 op/s 2024-05-20T22:42:02.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:02 smithi050 bash[28929]: cluster 2024-05-20T22:42:01.511432+0000 mgr.y (mgr.14592) 1325 : cluster 0 pgmap v1789: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 232 B/s wr, 1 op/s 2024-05-20T22:42:04.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:04 smithi145 bash[23893]: cluster 2024-05-20T22:42:03.512400+0000 mgr.y (mgr.14592) 1326 : cluster 0 pgmap v1790: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 170 B/s wr, 0 op/s 2024-05-20T22:42:04.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:04 smithi050 bash[21866]: cluster 2024-05-20T22:42:03.512400+0000 mgr.y (mgr.14592) 1326 : cluster 0 pgmap v1790: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 170 B/s wr, 0 op/s 2024-05-20T22:42:04.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:04 smithi050 bash[28929]: cluster 2024-05-20T22:42:03.512400+0000 mgr.y (mgr.14592) 1326 : cluster 0 pgmap v1790: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 170 B/s wr, 0 op/s 2024-05-20T22:42:06.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:06 smithi145 bash[23893]: cluster 2024-05-20T22:42:05.514434+0000 mgr.y (mgr.14592) 1327 : cluster 0 pgmap v1791: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 138 B/s wr, 1 op/s 2024-05-20T22:42:06.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:06 smithi050 bash[21866]: cluster 2024-05-20T22:42:05.514434+0000 mgr.y (mgr.14592) 1327 : cluster 0 pgmap v1791: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 138 B/s wr, 1 op/s 2024-05-20T22:42:06.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:06 smithi050 bash[28929]: cluster 2024-05-20T22:42:05.514434+0000 mgr.y (mgr.14592) 1327 : cluster 0 pgmap v1791: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 138 B/s wr, 1 op/s 2024-05-20T22:42:07.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:07 smithi145 bash[23893]: cluster 2024-05-20T22:42:06.590211+0000 mon.a (mon.0) 3915 : cluster 0 osdmap e816: 8 total, 8 up, 8 in 2024-05-20T22:42:07.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:07 smithi050 bash[21866]: cluster 2024-05-20T22:42:06.590211+0000 mon.a (mon.0) 3915 : cluster 0 osdmap e816: 8 total, 8 up, 8 in 2024-05-20T22:42:07.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:07 smithi050 bash[28929]: cluster 2024-05-20T22:42:06.590211+0000 mon.a (mon.0) 3915 : cluster 0 osdmap e816: 8 total, 8 up, 8 in 2024-05-20T22:42:08.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:08 smithi145 bash[23893]: cluster 2024-05-20T22:42:07.515241+0000 mgr.y (mgr.14592) 1328 : cluster 0 pgmap v1793: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 127 B/s wr, 1 op/s 2024-05-20T22:42:08.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:08 smithi050 bash[21866]: cluster 2024-05-20T22:42:07.515241+0000 mgr.y (mgr.14592) 1328 : cluster 0 pgmap v1793: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 127 B/s wr, 1 op/s 2024-05-20T22:42:08.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:08 smithi050 bash[28929]: cluster 2024-05-20T22:42:07.515241+0000 mgr.y (mgr.14592) 1328 : cluster 0 pgmap v1793: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 127 B/s wr, 1 op/s 2024-05-20T22:42:09.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:42:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:42:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:42:09.885 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:42:09 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:42:10.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:10 smithi145 bash[23893]: audit 2024-05-20T22:42:09.428860+0000 mgr.y (mgr.14592) 1329 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:42:10.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:10 smithi145 bash[23893]: cluster 2024-05-20T22:42:09.516030+0000 mgr.y (mgr.14592) 1330 : cluster 0 pgmap v1794: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 545 B/s rd, 0 op/s 2024-05-20T22:42:10.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:10 smithi050 bash[28929]: audit 2024-05-20T22:42:09.428860+0000 mgr.y (mgr.14592) 1329 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:42:10.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:10 smithi050 bash[28929]: cluster 2024-05-20T22:42:09.516030+0000 mgr.y (mgr.14592) 1330 : cluster 0 pgmap v1794: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 545 B/s rd, 0 op/s 2024-05-20T22:42:10.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:10 smithi050 bash[21866]: audit 2024-05-20T22:42:09.428860+0000 mgr.y (mgr.14592) 1329 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:42:10.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:10 smithi050 bash[21866]: cluster 2024-05-20T22:42:09.516030+0000 mgr.y (mgr.14592) 1330 : cluster 0 pgmap v1794: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 545 B/s rd, 0 op/s 2024-05-20T22:42:12.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:12 smithi145 bash[23893]: cluster 2024-05-20T22:42:11.518263+0000 mgr.y (mgr.14592) 1331 : cluster 0 pgmap v1795: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:42:12.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:12 smithi145 bash[23893]: audit 2024-05-20T22:42:11.606943+0000 mon.a (mon.0) 3916 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:42:12.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:12 smithi050 bash[21866]: cluster 2024-05-20T22:42:11.518263+0000 mgr.y (mgr.14592) 1331 : cluster 0 pgmap v1795: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:42:12.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:12 smithi050 bash[21866]: audit 2024-05-20T22:42:11.606943+0000 mon.a (mon.0) 3916 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:42:12.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:12 smithi050 bash[28929]: cluster 2024-05-20T22:42:11.518263+0000 mgr.y (mgr.14592) 1331 : cluster 0 pgmap v1795: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:42:12.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:12 smithi050 bash[28929]: audit 2024-05-20T22:42:11.606943+0000 mon.a (mon.0) 3916 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:42:14.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:14 smithi145 bash[23893]: cluster 2024-05-20T22:42:13.519065+0000 mgr.y (mgr.14592) 1332 : cluster 0 pgmap v1796: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:42:14.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:14 smithi050 bash[28929]: cluster 2024-05-20T22:42:13.519065+0000 mgr.y (mgr.14592) 1332 : cluster 0 pgmap v1796: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:42:14.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:14 smithi050 bash[21866]: cluster 2024-05-20T22:42:13.519065+0000 mgr.y (mgr.14592) 1332 : cluster 0 pgmap v1796: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:42:15.625 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: Running main() from gmock_main.cc 2024-05-20T22:42:15.625 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2024-05-20T22:42:15.625 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [----------] Global test environment set-up. 2024-05-20T22:42:15.625 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2024-05-20T22:42:15.625 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2024-05-20T22:42:15.625 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (1818472 ms) 2024-05-20T22:42:15.626 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2024-05-20T22:42:15.626 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (5065 ms) 2024-05-20T22:42:15.626 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2024-05-20T22:42:15.626 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (4026 ms) 2024-05-20T22:42:15.626 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2024-05-20T22:42:15.626 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (5045 ms) 2024-05-20T22:42:15.626 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-05-20T22:42:15.626 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (7038 ms) 2024-05-20T22:42:15.626 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (1839646 ms total) 2024-05-20T22:42:15.626 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: 2024-05-20T22:42:15.626 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2024-05-20T22:42:15.626 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-05-20T22:42:15.626 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (5073 ms) 2024-05-20T22:42:15.627 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-05-20T22:42:15.627 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (6048 ms) 2024-05-20T22:42:15.627 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-05-20T22:42:15.627 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (8098 ms) 2024-05-20T22:42:15.627 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-05-20T22:42:15.627 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6049 ms) 2024-05-20T22:42:15.627 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-05-20T22:42:15.627 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4070 ms) 2024-05-20T22:42:15.627 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-05-20T22:42:15.627 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnapsmithi050-64861-11. 2024-05-20T22:42:15.627 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: Waiting for snaps to purge. 2024-05-20T22:42:15.627 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19530 ms) 2024-05-20T22:42:15.627 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (48868 ms total) 2024-05-20T22:42:15.627 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: 2024-05-20T22:42:15.628 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [----------] Global test environment tear-down 2024-05-20T22:42:15.628 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (1888514 ms total) 2024-05-20T22:42:15.628 INFO:tasks.workunit.client.0.smithi050.stdout: snapshots: [ PASSED ] 11 tests. 2024-05-20T22:42:15.628 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:42:15.628 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64344 2024-05-20T22:42:15.628 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64344 2024-05-20T22:42:15.628 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:42:15.628 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=63931 2024-05-20T22:42:15.628 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 63931 2024-05-20T22:42:15.629 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:42:15.629 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=63971 2024-05-20T22:42:15.629 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 63971 2024-05-20T22:42:15.629 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:42:15.629 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64292 2024-05-20T22:42:15.629 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64292 2024-05-20T22:42:15.629 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:42:15.629 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=63987 2024-05-20T22:42:15.629 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 63987 2024-05-20T22:42:15.629 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:42:15.629 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64359 2024-05-20T22:42:15.629 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64359 2024-05-20T22:42:15.629 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:42:15.629 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64372 2024-05-20T22:42:15.630 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64372 2024-05-20T22:42:15.630 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:42:15.630 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64766 2024-05-20T22:42:15.630 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64766 2024-05-20T22:42:15.630 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2024-05-20T22:42:15.630 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=64911 2024-05-20T22:42:15.630 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 64911 2024-05-20T22:42:15.630 INFO:tasks.workunit.client.0.smithi050.stderr:+ exit 0 2024-05-20T22:42:15.630 INFO:tasks.workunit.client.0.smithi050.stderr:+ cleanup 2024-05-20T22:42:15.630 INFO:tasks.workunit.client.0.smithi050.stderr:+ pkill -P 63925 2024-05-20T22:42:15.643 INFO:tasks.workunit.client.0.smithi050.stderr:+ true 2024-05-20T22:42:15.643 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-20T22:42:15.643 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-20T22:42:15.654 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-05-20T22:42:15.655 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-05-20T22:42:15.656 DEBUG:teuthology.orchestra.run.smithi050:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=200b27799814c89893ec6700f852fc40163e03d5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-05-20T22:42:15.706 INFO:tasks.workunit.client.0.smithi050.stderr:+ uuidgen 2024-05-20T22:42:15.706 INFO:tasks.workunit.client.0.smithi050.stderr:+ p=1c2932ce-1479-493b-8174-2751cae2b39e 2024-05-20T22:42:15.706 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph osd pool create 1c2932ce-1479-493b-8174-2751cae2b39e 12 2024-05-20T22:42:15.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.833+0000 7f480f3fa640 1 -- 172.21.15.50:0/2432241570 >> v1:172.21.15.50:6790/0 conn(0x7f480810a510 legacy=0x7f480810c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:15.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.833+0000 7f480f3fa640 1 -- 172.21.15.50:0/2432241570 shutdown_connections 2024-05-20T22:42:15.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.833+0000 7f480f3fa640 1 -- 172.21.15.50:0/2432241570 >> 172.21.15.50:0/2432241570 conn(0x7f48080fd130 msgr2=0x7f48080ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:42:15.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.833+0000 7f480f3fa640 1 -- 172.21.15.50:0/2432241570 shutdown_connections 2024-05-20T22:42:15.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.833+0000 7f480f3fa640 1 -- 172.21.15.50:0/2432241570 wait complete. 2024-05-20T22:42:15.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.833+0000 7f480f3fa640 1 Processor -- start 2024-05-20T22:42:15.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.833+0000 7f480f3fa640 1 -- start start 2024-05-20T22:42:15.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.833+0000 7f480f3fa640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f48081a6680 con 0x7f480810a510 2024-05-20T22:42:15.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.833+0000 7f480f3fa640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f48081a7880 con 0x7f480810e0b0 2024-05-20T22:42:15.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.833+0000 7f480f3fa640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f48081a8ac0 con 0x7f4808107660 2024-05-20T22:42:15.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.833+0000 7f480d196640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7f4808107660 0x7f480810d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:48426/0 (socket says 172.21.15.50:48426) 2024-05-20T22:42:15.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.833+0000 7f480d196640 1 -- 172.21.15.50:0/2941269823 learned_addr learned my addr 172.21.15.50:0/2941269823 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:42:15.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2943961362 0 0) 0x7f48081a8ac0 con 0x7f4808107660 2024-05-20T22:42:15.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47f4003530 con 0x7f4808107660 2024-05-20T22:42:15.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1662682823 0 0) 0x7f48081a6680 con 0x7f480810a510 2024-05-20T22:42:15.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48081a8ac0 con 0x7f480810a510 2024-05-20T22:42:15.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2079587561 0 0) 0x7f47f4003530 con 0x7f4808107660 2024-05-20T22:42:15.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48081a6680 con 0x7f4808107660 2024-05-20T22:42:15.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f4804001940 con 0x7f4808107660 2024-05-20T22:42:15.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2136882402 0 0) 0x7f48081a7880 con 0x7f480810e0b0 2024-05-20T22:42:15.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47f4003530 con 0x7f480810e0b0 2024-05-20T22:42:15.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3098119324 0 0) 0x7f48081a8ac0 con 0x7f480810a510 2024-05-20T22:42:15.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48081a7880 con 0x7f480810a510 2024-05-20T22:42:15.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f47fc004550 con 0x7f480810a510 2024-05-20T22:42:15.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3870724338 0 0) 0x7f48081a6680 con 0x7f4808107660 2024-05-20T22:42:15.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 >> v1:172.21.15.145:6789/0 conn(0x7f480810e0b0 legacy=0x7f48081a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:15.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 >> v1:172.21.15.50:6789/0 conn(0x7f480810a510 legacy=0x7f48081a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:15.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48081a9d00 con 0x7f4808107660 2024-05-20T22:42:15.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f480f3fa640 1 -- 172.21.15.50:0/2941269823 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f48081a68b0 con 0x7f4808107660 2024-05-20T22:42:15.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f480f3fa640 1 -- 172.21.15.50:0/2941269823 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f48081a6d70 con 0x7f4808107660 2024-05-20T22:42:15.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f4804003ab0 con 0x7f4808107660 2024-05-20T22:42:15.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f4804005c00 con 0x7f4808107660 2024-05-20T22:42:15.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f480f3fa640 1 -- 172.21.15.50:0/2941269823 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47ec0050c0 con 0x7f4808107660 2024-05-20T22:42:15.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f4804003600 con 0x7f4808107660 2024-05-20T22:42:15.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.837+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(817..817 src has 256..817) ==== 7360+0+0 (unknown 2971790323 0 0) 0x7f4804089bb0 con 0x7f4808107660 2024-05-20T22:42:15.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:15.841+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f4804056ed0 con 0x7f4808107660 2024-05-20T22:42:16.014 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.021+0000 7f480f3fa640 1 -- 172.21.15.50:0/2941269823 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pg_num": 12} v 0) -- 0x7f47ec0053b0 con 0x7f4808107660 2024-05-20T22:42:16.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.629+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 <== mon.2 v1:172.21.15.50:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pg_num": 12}]=0 pool '1c2932ce-1479-493b-8174-2751cae2b39e' created v818) ==== 176+0+0 (unknown 3221125195 0 0) 0x7f480405ab80 con 0x7f4808107660 2024-05-20T22:42:16.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.737+0000 7f480f3fa640 1 -- 172.21.15.50:0/2941269823 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pg_num": 12} v 0) -- 0x7f47ec0058c0 con 0x7f4808107660 2024-05-20T22:42:16.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.741+0000 7f47fa7fc640 1 -- 172.21.15.50:0/2941269823 <== mon.2 v1:172.21.15.50:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pg_num": 12}]=0 pool '1c2932ce-1479-493b-8174-2751cae2b39e' already exists v818) ==== 183+0+0 (unknown 192014125 0 0) 0x7f480405f440 con 0x7f4808107660 2024-05-20T22:42:16.735 INFO:tasks.workunit.client.0.smithi050.stderr:pool '1c2932ce-1479-493b-8174-2751cae2b39e' already exists 2024-05-20T22:42:16.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.741+0000 7f480f3fa640 1 -- 172.21.15.50:0/2941269823 >> v1:172.21.15.50:6800/3332714287 conn(0x7f47f406eef0 legacy=0x7f47f40713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:16.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.741+0000 7f480f3fa640 1 -- 172.21.15.50:0/2941269823 >> v1:172.21.15.50:6790/0 conn(0x7f4808107660 legacy=0x7f480810d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:16.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.741+0000 7f480f3fa640 1 -- 172.21.15.50:0/2941269823 shutdown_connections 2024-05-20T22:42:16.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.741+0000 7f480f3fa640 1 -- 172.21.15.50:0/2941269823 >> 172.21.15.50:0/2941269823 conn(0x7f48080fd130 msgr2=0x7f4808101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:42:16.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.741+0000 7f480f3fa640 1 -- 172.21.15.50:0/2941269823 shutdown_connections 2024-05-20T22:42:16.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.741+0000 7f480f3fa640 1 -- 172.21.15.50:0/2941269823 wait complete. 2024-05-20T22:42:16.753 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph osd pool set-quota 1c2932ce-1479-493b-8174-2751cae2b39e max_objects 10 2024-05-20T22:42:16.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.881+0000 7f2a5adbf640 1 -- 172.21.15.50:0/2944192413 >> v1:172.21.15.50:6790/0 conn(0x7f2a54109620 legacy=0x7f2a5410ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:16.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.881+0000 7f2a5adbf640 1 -- 172.21.15.50:0/2944192413 shutdown_connections 2024-05-20T22:42:16.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.881+0000 7f2a5adbf640 1 -- 172.21.15.50:0/2944192413 >> 172.21.15.50:0/2944192413 conn(0x7f2a54076a00 msgr2=0x7f2a540fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:42:16.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.881+0000 7f2a5adbf640 1 -- 172.21.15.50:0/2944192413 shutdown_connections 2024-05-20T22:42:16.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.881+0000 7f2a5adbf640 1 -- 172.21.15.50:0/2944192413 wait complete. 2024-05-20T22:42:16.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a5adbf640 1 Processor -- start 2024-05-20T22:42:16.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a5adbf640 1 -- start start 2024-05-20T22:42:16.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a5adbf640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f2a541a6870 con 0x7f2a54106800 2024-05-20T22:42:16.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a5adbf640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f2a541a7ab0 con 0x7f2a5410d1c0 2024-05-20T22:42:16.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a5adbf640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f2a541a8cf0 con 0x7f2a54109620 2024-05-20T22:42:16.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a53fff640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7f2a54109620 0x7f2a541a1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:48444/0 (socket says 172.21.15.50:48444) 2024-05-20T22:42:16.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a53fff640 1 -- 172.21.15.50:0/1159211852 learned_addr learned my addr 172.21.15.50:0/1159211852 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:42:16.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 99618005 0 0) 0x7f2a541a8cf0 con 0x7f2a54109620 2024-05-20T22:42:16.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a44003530 con 0x7f2a54109620 2024-05-20T22:42:16.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2993332560 0 0) 0x7f2a541a6870 con 0x7f2a54106800 2024-05-20T22:42:16.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a541a8cf0 con 0x7f2a54106800 2024-05-20T22:42:16.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1286231497 0 0) 0x7f2a44003530 con 0x7f2a54109620 2024-05-20T22:42:16.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2a541a6870 con 0x7f2a54109620 2024-05-20T22:42:16.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f2a40004580 con 0x7f2a54109620 2024-05-20T22:42:16.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3009995555 0 0) 0x7f2a541a8cf0 con 0x7f2a54106800 2024-05-20T22:42:16.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2a44003530 con 0x7f2a54106800 2024-05-20T22:42:16.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f2a48001730 con 0x7f2a54106800 2024-05-20T22:42:16.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 106843818 0 0) 0x7f2a541a7ab0 con 0x7f2a5410d1c0 2024-05-20T22:42:16.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a541a8cf0 con 0x7f2a5410d1c0 2024-05-20T22:42:16.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2115964488 0 0) 0x7f2a541a6870 con 0x7f2a54109620 2024-05-20T22:42:16.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 >> v1:172.21.15.145:6789/0 conn(0x7f2a5410d1c0 legacy=0x7f2a541a4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:16.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 >> v1:172.21.15.50:6789/0 conn(0x7f2a54106800 legacy=0x7f2a54105b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:16.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a541a9f30 con 0x7f2a54109620 2024-05-20T22:42:16.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a5adbf640 1 -- 172.21.15.50:0/1159211852 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2a541a6a40 con 0x7f2a54109620 2024-05-20T22:42:16.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a5adbf640 1 -- 172.21.15.50:0/1159211852 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2a541a6f00 con 0x7f2a54109620 2024-05-20T22:42:16.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f2a400011b0 con 0x7f2a54109620 2024-05-20T22:42:16.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f2a40004cf0 con 0x7f2a54109620 2024-05-20T22:42:16.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a5adbf640 1 -- 172.21.15.50:0/1159211852 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a38005090 con 0x7f2a54109620 2024-05-20T22:42:16.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f2a40001b80 con 0x7f2a54109620 2024-05-20T22:42:16.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.885+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(818..818 src has 256..818) ==== 7735+0+0 (unknown 2482719157 0 0) 0x7f2a40089c40 con 0x7f2a54109620 2024-05-20T22:42:16.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:16 smithi145 bash[23893]: cluster 2024-05-20T22:42:15.521089+0000 mgr.y (mgr.14592) 1333 : cluster 0 pgmap v1797: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:42:16.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:16 smithi145 bash[23893]: cluster 2024-05-20T22:42:15.622061+0000 mon.a (mon.0) 3917 : cluster 0 osdmap e817: 8 total, 8 up, 8 in 2024-05-20T22:42:16.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:16 smithi145 bash[23893]: audit 2024-05-20T22:42:16.024609+0000 mon.c (mon.2) 529 : audit 1 from='client.? v1:172.21.15.50:0/2941269823' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pg_num": 12}]: dispatch 2024-05-20T22:42:16.885 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:16 smithi145 bash[23893]: audit 2024-05-20T22:42:16.025044+0000 mon.a (mon.0) 3918 : audit 1 from='client.47600 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pg_num": 12}]: dispatch 2024-05-20T22:42:16.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:16.893+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f2a40056de0 con 0x7f2a54109620 2024-05-20T22:42:16.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:16 smithi050 bash[21866]: cluster 2024-05-20T22:42:15.521089+0000 mgr.y (mgr.14592) 1333 : cluster 0 pgmap v1797: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:42:16.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:16 smithi050 bash[21866]: cluster 2024-05-20T22:42:15.622061+0000 mon.a (mon.0) 3917 : cluster 0 osdmap e817: 8 total, 8 up, 8 in 2024-05-20T22:42:16.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:16 smithi050 bash[21866]: audit 2024-05-20T22:42:16.024609+0000 mon.c (mon.2) 529 : audit 1 from='client.? v1:172.21.15.50:0/2941269823' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pg_num": 12}]: dispatch 2024-05-20T22:42:16.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:16 smithi050 bash[21866]: audit 2024-05-20T22:42:16.025044+0000 mon.a (mon.0) 3918 : audit 1 from='client.47600 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pg_num": 12}]: dispatch 2024-05-20T22:42:16.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:16 smithi050 bash[28929]: cluster 2024-05-20T22:42:15.521089+0000 mgr.y (mgr.14592) 1333 : cluster 0 pgmap v1797: 196 pgs: 196 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:42:16.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:16 smithi050 bash[28929]: cluster 2024-05-20T22:42:15.622061+0000 mon.a (mon.0) 3917 : cluster 0 osdmap e817: 8 total, 8 up, 8 in 2024-05-20T22:42:16.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:16 smithi050 bash[28929]: audit 2024-05-20T22:42:16.024609+0000 mon.c (mon.2) 529 : audit 1 from='client.? v1:172.21.15.50:0/2941269823' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pg_num": 12}]: dispatch 2024-05-20T22:42:16.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:16 smithi050 bash[28929]: audit 2024-05-20T22:42:16.025044+0000 mon.a (mon.0) 3918 : audit 1 from='client.47600 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pg_num": 12}]: dispatch 2024-05-20T22:42:17.066 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:17.069+0000 7f2a5adbf640 1 -- 172.21.15.50:0/1159211852 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"} v 0) -- 0x7f2a38005380 con 0x7f2a54109620 2024-05-20T22:42:17.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:17.641+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 <== mon.2 v1:172.21.15.50:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 1c2932ce-1479-493b-8174-2751cae2b39e v819) ==== 223+0+0 (unknown 3446745368 0 0) 0x7f2a4005aa90 con 0x7f2a54109620 2024-05-20T22:42:17.751 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:17.757+0000 7f2a5adbf640 1 -- 172.21.15.50:0/1159211852 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"} v 0) -- 0x7f2a380010a0 con 0x7f2a54109620 2024-05-20T22:42:17.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:17 smithi145 bash[23893]: audit 2024-05-20T22:42:16.626110+0000 mon.a (mon.0) 3919 : audit 1 from='client.47600 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pg_num": 12}]': finished 2024-05-20T22:42:17.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:17 smithi145 bash[23893]: cluster 2024-05-20T22:42:16.632993+0000 mon.a (mon.0) 3920 : cluster 0 osdmap e818: 8 total, 8 up, 8 in 2024-05-20T22:42:17.887 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:17 smithi145 bash[23893]: audit 2024-05-20T22:42:16.743927+0000 mon.c (mon.2) 530 : audit 1 from='client.? v1:172.21.15.50:0/2941269823' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pg_num": 12}]: dispatch 2024-05-20T22:42:17.887 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:17 smithi145 bash[23893]: audit 2024-05-20T22:42:16.744606+0000 mon.a (mon.0) 3921 : audit 1 from='client.47600 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pg_num": 12}]: dispatch 2024-05-20T22:42:17.887 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:17 smithi145 bash[23893]: audit 2024-05-20T22:42:17.076250+0000 mon.c (mon.2) 531 : audit 1 from='client.? v1:172.21.15.50:0/1159211852' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:42:17.887 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:17 smithi145 bash[23893]: audit 2024-05-20T22:42:17.076839+0000 mon.a (mon.0) 3922 : audit 1 from='client.47606 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:42:17.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:17 smithi050 bash[21866]: audit 2024-05-20T22:42:16.626110+0000 mon.a (mon.0) 3919 : audit 1 from='client.47600 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pg_num": 12}]': finished 2024-05-20T22:42:17.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:17 smithi050 bash[21866]: cluster 2024-05-20T22:42:16.632993+0000 mon.a (mon.0) 3920 : cluster 0 osdmap e818: 8 total, 8 up, 8 in 2024-05-20T22:42:17.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:17 smithi050 bash[21866]: audit 2024-05-20T22:42:16.743927+0000 mon.c (mon.2) 530 : audit 1 from='client.? v1:172.21.15.50:0/2941269823' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pg_num": 12}]: dispatch 2024-05-20T22:42:17.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:17 smithi050 bash[21866]: audit 2024-05-20T22:42:16.744606+0000 mon.a (mon.0) 3921 : audit 1 from='client.47600 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pg_num": 12}]: dispatch 2024-05-20T22:42:17.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:17 smithi050 bash[21866]: audit 2024-05-20T22:42:17.076250+0000 mon.c (mon.2) 531 : audit 1 from='client.? v1:172.21.15.50:0/1159211852' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:42:17.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:17 smithi050 bash[21866]: audit 2024-05-20T22:42:17.076839+0000 mon.a (mon.0) 3922 : audit 1 from='client.47606 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:42:17.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:17 smithi050 bash[28929]: audit 2024-05-20T22:42:16.626110+0000 mon.a (mon.0) 3919 : audit 1 from='client.47600 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pg_num": 12}]': finished 2024-05-20T22:42:17.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:17 smithi050 bash[28929]: cluster 2024-05-20T22:42:16.632993+0000 mon.a (mon.0) 3920 : cluster 0 osdmap e818: 8 total, 8 up, 8 in 2024-05-20T22:42:17.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:17 smithi050 bash[28929]: audit 2024-05-20T22:42:16.743927+0000 mon.c (mon.2) 530 : audit 1 from='client.? v1:172.21.15.50:0/2941269823' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pg_num": 12}]: dispatch 2024-05-20T22:42:17.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:17 smithi050 bash[28929]: audit 2024-05-20T22:42:16.744606+0000 mon.a (mon.0) 3921 : audit 1 from='client.47600 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pg_num": 12}]: dispatch 2024-05-20T22:42:17.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:17 smithi050 bash[28929]: audit 2024-05-20T22:42:17.076250+0000 mon.c (mon.2) 531 : audit 1 from='client.? v1:172.21.15.50:0/1159211852' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:42:17.942 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:17 smithi050 bash[28929]: audit 2024-05-20T22:42:17.076839+0000 mon.a (mon.0) 3922 : audit 1 from='client.47606 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:42:18.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.649+0000 7f2a51ffb640 1 -- 172.21.15.50:0/1159211852 <== mon.2 v1:172.21.15.50:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 1c2932ce-1479-493b-8174-2751cae2b39e v820) ==== 223+0+0 (unknown 910501305 0 0) 0x7f2a4005f350 con 0x7f2a54109620 2024-05-20T22:42:18.645 INFO:tasks.workunit.client.0.smithi050.stderr:set-quota max_objects = 10 for pool 1c2932ce-1479-493b-8174-2751cae2b39e 2024-05-20T22:42:18.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.653+0000 7f2a5adbf640 1 -- 172.21.15.50:0/1159211852 >> v1:172.21.15.50:6800/3332714287 conn(0x7f2a4406ef50 legacy=0x7f2a44071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:18.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.653+0000 7f2a5adbf640 1 -- 172.21.15.50:0/1159211852 >> v1:172.21.15.50:6790/0 conn(0x7f2a54109620 legacy=0x7f2a541a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:18.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.653+0000 7f2a5adbf640 1 -- 172.21.15.50:0/1159211852 shutdown_connections 2024-05-20T22:42:18.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.653+0000 7f2a5adbf640 1 -- 172.21.15.50:0/1159211852 >> 172.21.15.50:0/1159211852 conn(0x7f2a54076a00 msgr2=0x7f2a54100410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:42:18.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.653+0000 7f2a5adbf640 1 -- 172.21.15.50:0/1159211852 shutdown_connections 2024-05-20T22:42:18.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.653+0000 7f2a5adbf640 1 -- 172.21.15.50:0/1159211852 wait complete. 2024-05-20T22:42:18.667 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph osd pool application enable 1c2932ce-1479-493b-8174-2751cae2b39e rados 2024-05-20T22:42:18.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04c95ec640 1 -- 172.21.15.50:0/2366625667 >> v1:172.21.15.50:6790/0 conn(0x7f04c410cfd0 legacy=0x7f04c410f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:18.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04c95ec640 1 -- 172.21.15.50:0/2366625667 shutdown_connections 2024-05-20T22:42:18.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04c95ec640 1 -- 172.21.15.50:0/2366625667 >> 172.21.15.50:0/2366625667 conn(0x7f04c40fc020 msgr2=0x7f04c40fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:42:18.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04c95ec640 1 -- 172.21.15.50:0/2366625667 shutdown_connections 2024-05-20T22:42:18.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04c95ec640 1 -- 172.21.15.50:0/2366625667 wait complete. 2024-05-20T22:42:18.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04c95ec640 1 Processor -- start 2024-05-20T22:42:18.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04c95ec640 1 -- start start 2024-05-20T22:42:18.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04c95ec640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f04c41a5430 con 0x7f04c41093d0 2024-05-20T22:42:18.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04c95ec640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f04c41a6670 con 0x7f04c4106620 2024-05-20T22:42:18.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04c95ec640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f04c41a78b0 con 0x7f04c410cfd0 2024-05-20T22:42:18.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04c27fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f04c41093d0 0x7f04c41a0420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42560/0 (socket says 172.21.15.50:42560) 2024-05-20T22:42:18.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04c27fc640 1 -- 172.21.15.50:0/1580296126 learned_addr learned my addr 172.21.15.50:0/1580296126 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:42:18.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04c37fe640 1 --1- 172.21.15.50:0/1580296126 >> v1:172.21.15.50:6790/0 conn(0x7f04c410cfd0 0x7f04c41a3b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:51770/0 (socket says 172.21.15.50:51770) 2024-05-20T22:42:18.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2024470623 0 0) 0x7f04c41a5430 con 0x7f04c41093d0 2024-05-20T22:42:18.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04b0003170 con 0x7f04c41093d0 2024-05-20T22:42:18.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 902537810 0 0) 0x7f04c41a78b0 con 0x7f04c410cfd0 2024-05-20T22:42:18.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04c41a5430 con 0x7f04c410cfd0 2024-05-20T22:42:18.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3360167286 0 0) 0x7f04b0003170 con 0x7f04c41093d0 2024-05-20T22:42:18.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f04c41a78b0 con 0x7f04c41093d0 2024-05-20T22:42:18.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2871470567 0 0) 0x7f04c41a5430 con 0x7f04c410cfd0 2024-05-20T22:42:18.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f04b0003170 con 0x7f04c410cfd0 2024-05-20T22:42:18.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 337985479 0 0) 0x7f04c41a6670 con 0x7f04c4106620 2024-05-20T22:42:18.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04c41a5430 con 0x7f04c4106620 2024-05-20T22:42:18.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f04ac001dc0 con 0x7f04c41093d0 2024-05-20T22:42:18.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f04bc0013a0 con 0x7f04c410cfd0 2024-05-20T22:42:18.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1403903665 0 0) 0x7f04b0003170 con 0x7f04c410cfd0 2024-05-20T22:42:18.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 >> v1:172.21.15.145:6789/0 conn(0x7f04c4106620 legacy=0x7f04c4105800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:18.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 >> v1:172.21.15.50:6789/0 conn(0x7f04c41093d0 legacy=0x7f04c41a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:18.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c41a8af0 con 0x7f04c410cfd0 2024-05-20T22:42:18.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04c95ec640 1 -- 172.21.15.50:0/1580296126 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f04c41a7ae0 con 0x7f04c410cfd0 2024-05-20T22:42:18.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04c95ec640 1 -- 172.21.15.50:0/1580296126 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f04c41a7fa0 con 0x7f04c410cfd0 2024-05-20T22:42:18.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f04bc001090 con 0x7f04c410cfd0 2024-05-20T22:42:18.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f04bc004c00 con 0x7f04c410cfd0 2024-05-20T22:42:18.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.793+0000 7f04c95ec640 1 -- 172.21.15.50:0/1580296126 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a4005090 con 0x7f04c410cfd0 2024-05-20T22:42:18.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.797+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f04bc003a40 con 0x7f04c410cfd0 2024-05-20T22:42:18.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.797+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(820..820 src has 256..820) ==== 7735+0+0 (unknown 4164823243 0 0) 0x7f04bc089ad0 con 0x7f04c410cfd0 2024-05-20T22:42:18.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.801+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f04bc056c10 con 0x7f04c410cfd0 2024-05-20T22:42:18.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:18 smithi145 bash[23893]: cluster 2024-05-20T22:42:17.521864+0000 mgr.y (mgr.14592) 1334 : cluster 0 pgmap v1800: 176 pgs: 12 unknown, 164 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:42:18.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:18 smithi145 bash[23893]: audit 2024-05-20T22:42:17.635138+0000 mon.a (mon.0) 3923 : audit 1 from='client.47606 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"}]': finished 2024-05-20T22:42:18.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:18 smithi145 bash[23893]: cluster 2024-05-20T22:42:17.645047+0000 mon.a (mon.0) 3924 : cluster 0 osdmap e819: 8 total, 8 up, 8 in 2024-05-20T22:42:18.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:18 smithi145 bash[23893]: audit 2024-05-20T22:42:17.761451+0000 mon.c (mon.2) 532 : audit 1 from='client.? v1:172.21.15.50:0/1159211852' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:42:18.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:18 smithi145 bash[23893]: audit 2024-05-20T22:42:17.761897+0000 mon.a (mon.0) 3925 : audit 1 from='client.47606 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:42:18.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:18 smithi050 bash[21866]: cluster 2024-05-20T22:42:17.521864+0000 mgr.y (mgr.14592) 1334 : cluster 0 pgmap v1800: 176 pgs: 12 unknown, 164 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:42:18.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:18 smithi050 bash[21866]: audit 2024-05-20T22:42:17.635138+0000 mon.a (mon.0) 3923 : audit 1 from='client.47606 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"}]': finished 2024-05-20T22:42:18.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:18 smithi050 bash[21866]: cluster 2024-05-20T22:42:17.645047+0000 mon.a (mon.0) 3924 : cluster 0 osdmap e819: 8 total, 8 up, 8 in 2024-05-20T22:42:18.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:18 smithi050 bash[21866]: audit 2024-05-20T22:42:17.761451+0000 mon.c (mon.2) 532 : audit 1 from='client.? v1:172.21.15.50:0/1159211852' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:42:18.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:18 smithi050 bash[21866]: audit 2024-05-20T22:42:17.761897+0000 mon.a (mon.0) 3925 : audit 1 from='client.47606 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:42:18.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:18 smithi050 bash[28929]: cluster 2024-05-20T22:42:17.521864+0000 mgr.y (mgr.14592) 1334 : cluster 0 pgmap v1800: 176 pgs: 12 unknown, 164 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:42:18.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:18 smithi050 bash[28929]: audit 2024-05-20T22:42:17.635138+0000 mon.a (mon.0) 3923 : audit 1 from='client.47606 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"}]': finished 2024-05-20T22:42:18.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:18 smithi050 bash[28929]: cluster 2024-05-20T22:42:17.645047+0000 mon.a (mon.0) 3924 : cluster 0 osdmap e819: 8 total, 8 up, 8 in 2024-05-20T22:42:18.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:18 smithi050 bash[28929]: audit 2024-05-20T22:42:17.761451+0000 mon.c (mon.2) 532 : audit 1 from='client.? v1:172.21.15.50:0/1159211852' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:42:18.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:18 smithi050 bash[28929]: audit 2024-05-20T22:42:17.761897+0000 mon.a (mon.0) 3925 : audit 1 from='client.47606 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:42:18.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:18.977+0000 7f04c95ec640 1 -- 172.21.15.50:0/1580296126 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"} v 0) -- 0x7f04a4005380 con 0x7f04c410cfd0 2024-05-20T22:42:19.647 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:42:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:42:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:42:19.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:19.661+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 <== mon.2 v1:172.21.15.50:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"}]=0 enabled application 'rados' on pool '1c2932ce-1479-493b-8174-2751cae2b39e' v821) ==== 213+0+0 (unknown 2802893631 0 0) 0x7f04bc05a8c0 con 0x7f04c410cfd0 2024-05-20T22:42:19.763 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:19.769+0000 7f04c95ec640 1 -- 172.21.15.50:0/1580296126 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"} v 0) -- 0x7f04a40010a0 con 0x7f04c410cfd0 2024-05-20T22:42:19.885 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:42:19 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:42:19.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:19 smithi145 bash[23893]: audit 2024-05-20T22:42:18.646108+0000 mon.a (mon.0) 3926 : audit 1 from='client.47606 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"}]': finished 2024-05-20T22:42:19.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:19 smithi145 bash[23893]: cluster 2024-05-20T22:42:18.652660+0000 mon.a (mon.0) 3927 : cluster 0 osdmap e820: 8 total, 8 up, 8 in 2024-05-20T22:42:19.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:19 smithi145 bash[23893]: audit 2024-05-20T22:42:18.981897+0000 mon.c (mon.2) 533 : audit 1 from='client.? v1:172.21.15.50:0/1580296126' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"}]: dispatch 2024-05-20T22:42:19.886 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:19 smithi145 bash[23893]: audit 2024-05-20T22:42:18.982464+0000 mon.a (mon.0) 3928 : audit 1 from='client.47612 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"}]: dispatch 2024-05-20T22:42:19.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:19 smithi050 bash[21866]: audit 2024-05-20T22:42:18.646108+0000 mon.a (mon.0) 3926 : audit 1 from='client.47606 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"}]': finished 2024-05-20T22:42:19.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:19 smithi050 bash[21866]: cluster 2024-05-20T22:42:18.652660+0000 mon.a (mon.0) 3927 : cluster 0 osdmap e820: 8 total, 8 up, 8 in 2024-05-20T22:42:19.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:19 smithi050 bash[21866]: audit 2024-05-20T22:42:18.981897+0000 mon.c (mon.2) 533 : audit 1 from='client.? v1:172.21.15.50:0/1580296126' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"}]: dispatch 2024-05-20T22:42:19.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:19 smithi050 bash[21866]: audit 2024-05-20T22:42:18.982464+0000 mon.a (mon.0) 3928 : audit 1 from='client.47612 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"}]: dispatch 2024-05-20T22:42:19.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:19 smithi050 bash[28929]: audit 2024-05-20T22:42:18.646108+0000 mon.a (mon.0) 3926 : audit 1 from='client.47606 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "10"}]': finished 2024-05-20T22:42:19.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:19 smithi050 bash[28929]: cluster 2024-05-20T22:42:18.652660+0000 mon.a (mon.0) 3927 : cluster 0 osdmap e820: 8 total, 8 up, 8 in 2024-05-20T22:42:19.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:19 smithi050 bash[28929]: audit 2024-05-20T22:42:18.981897+0000 mon.c (mon.2) 533 : audit 1 from='client.? v1:172.21.15.50:0/1580296126' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"}]: dispatch 2024-05-20T22:42:19.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:19 smithi050 bash[28929]: audit 2024-05-20T22:42:18.982464+0000 mon.a (mon.0) 3928 : audit 1 from='client.47612 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"}]: dispatch 2024-05-20T22:42:20.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:20.661+0000 7f04bbfff640 1 -- 172.21.15.50:0/1580296126 <== mon.2 v1:172.21.15.50:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"}]=0 enabled application 'rados' on pool '1c2932ce-1479-493b-8174-2751cae2b39e' v822) ==== 213+0+0 (unknown 3916617749 0 0) 0x7f04bc05f180 con 0x7f04c410cfd0 2024-05-20T22:42:20.658 INFO:tasks.workunit.client.0.smithi050.stderr:enabled application 'rados' on pool '1c2932ce-1479-493b-8174-2751cae2b39e' 2024-05-20T22:42:20.660 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:20.665+0000 7f04c95ec640 1 -- 172.21.15.50:0/1580296126 >> v1:172.21.15.50:6800/3332714287 conn(0x7f04b00710c0 legacy=0x7f04b0073580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:20.660 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:20.665+0000 7f04c95ec640 1 -- 172.21.15.50:0/1580296126 >> v1:172.21.15.50:6790/0 conn(0x7f04c410cfd0 legacy=0x7f04c41a3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:20.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:20.665+0000 7f04c95ec640 1 -- 172.21.15.50:0/1580296126 shutdown_connections 2024-05-20T22:42:20.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:20.665+0000 7f04c95ec640 1 -- 172.21.15.50:0/1580296126 >> 172.21.15.50:0/1580296126 conn(0x7f04c40fc020 msgr2=0x7f04c40fc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:42:20.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:20.665+0000 7f04c95ec640 1 -- 172.21.15.50:0/1580296126 shutdown_connections 2024-05-20T22:42:20.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:20.665+0000 7f04c95ec640 1 -- 172.21.15.50:0/1580296126 wait complete. 2024-05-20T22:42:20.681 INFO:tasks.workunit.client.0.smithi050.stderr:+ seq 1 10 2024-05-20T22:42:20.691 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 1c2932ce-1479-493b-8174-2751cae2b39e put obj1 /etc/passwd 2024-05-20T22:42:20.733 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 1c2932ce-1479-493b-8174-2751cae2b39e put obj2 /etc/passwd 2024-05-20T22:42:20.770 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 1c2932ce-1479-493b-8174-2751cae2b39e put obj3 /etc/passwd 2024-05-20T22:42:20.807 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 1c2932ce-1479-493b-8174-2751cae2b39e put obj4 /etc/passwd 2024-05-20T22:42:20.842 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 1c2932ce-1479-493b-8174-2751cae2b39e put obj5 /etc/passwd 2024-05-20T22:42:20.879 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 1c2932ce-1479-493b-8174-2751cae2b39e put obj6 /etc/passwd 2024-05-20T22:42:20.915 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 1c2932ce-1479-493b-8174-2751cae2b39e put obj7 /etc/passwd 2024-05-20T22:42:20.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:20 smithi050 bash[21866]: audit 2024-05-20T22:42:19.440352+0000 mgr.y (mgr.14592) 1335 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:42:20.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:20 smithi050 bash[21866]: cluster 2024-05-20T22:42:19.522580+0000 mgr.y (mgr.14592) 1336 : cluster 0 pgmap v1803: 176 pgs: 12 unknown, 164 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:42:20.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:20 smithi050 bash[21866]: audit 2024-05-20T22:42:19.655130+0000 mon.a (mon.0) 3929 : audit 1 from='client.47612 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"}]': finished 2024-05-20T22:42:20.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:20 smithi050 bash[21866]: cluster 2024-05-20T22:42:19.664810+0000 mon.a (mon.0) 3930 : cluster 0 osdmap e821: 8 total, 8 up, 8 in 2024-05-20T22:42:20.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:20 smithi050 bash[21866]: audit 2024-05-20T22:42:19.773107+0000 mon.c (mon.2) 534 : audit 1 from='client.? v1:172.21.15.50:0/1580296126' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"}]: dispatch 2024-05-20T22:42:20.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:20 smithi050 bash[21866]: audit 2024-05-20T22:42:19.773565+0000 mon.a (mon.0) 3931 : audit 1 from='client.47612 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"}]: dispatch 2024-05-20T22:42:20.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:20 smithi050 bash[28929]: audit 2024-05-20T22:42:19.440352+0000 mgr.y (mgr.14592) 1335 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:42:20.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:20 smithi050 bash[28929]: cluster 2024-05-20T22:42:19.522580+0000 mgr.y (mgr.14592) 1336 : cluster 0 pgmap v1803: 176 pgs: 12 unknown, 164 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:42:20.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:20 smithi050 bash[28929]: audit 2024-05-20T22:42:19.655130+0000 mon.a (mon.0) 3929 : audit 1 from='client.47612 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"}]': finished 2024-05-20T22:42:20.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:20 smithi050 bash[28929]: cluster 2024-05-20T22:42:19.664810+0000 mon.a (mon.0) 3930 : cluster 0 osdmap e821: 8 total, 8 up, 8 in 2024-05-20T22:42:20.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:20 smithi050 bash[28929]: audit 2024-05-20T22:42:19.773107+0000 mon.c (mon.2) 534 : audit 1 from='client.? v1:172.21.15.50:0/1580296126' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"}]: dispatch 2024-05-20T22:42:20.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:20 smithi050 bash[28929]: audit 2024-05-20T22:42:19.773565+0000 mon.a (mon.0) 3931 : audit 1 from='client.47612 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"}]: dispatch 2024-05-20T22:42:20.950 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 1c2932ce-1479-493b-8174-2751cae2b39e put obj8 /etc/passwd 2024-05-20T22:42:20.985 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 1c2932ce-1479-493b-8174-2751cae2b39e put obj9 /etc/passwd 2024-05-20T22:42:21.020 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 1c2932ce-1479-493b-8174-2751cae2b39e put obj10 /etc/passwd 2024-05-20T22:42:21.054 INFO:tasks.workunit.client.0.smithi050.stderr:+ sleep 30 2024-05-20T22:42:21.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:20 smithi145 bash[23893]: audit 2024-05-20T22:42:19.440352+0000 mgr.y (mgr.14592) 1335 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:42:21.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:20 smithi145 bash[23893]: cluster 2024-05-20T22:42:19.522580+0000 mgr.y (mgr.14592) 1336 : cluster 0 pgmap v1803: 176 pgs: 12 unknown, 164 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail 2024-05-20T22:42:21.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:20 smithi145 bash[23893]: audit 2024-05-20T22:42:19.655130+0000 mon.a (mon.0) 3929 : audit 1 from='client.47612 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"}]': finished 2024-05-20T22:42:21.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:20 smithi145 bash[23893]: cluster 2024-05-20T22:42:19.664810+0000 mon.a (mon.0) 3930 : cluster 0 osdmap e821: 8 total, 8 up, 8 in 2024-05-20T22:42:21.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:20 smithi145 bash[23893]: audit 2024-05-20T22:42:19.773107+0000 mon.c (mon.2) 534 : audit 1 from='client.? v1:172.21.15.50:0/1580296126' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"}]: dispatch 2024-05-20T22:42:21.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:20 smithi145 bash[23893]: audit 2024-05-20T22:42:19.773565+0000 mon.a (mon.0) 3931 : audit 1 from='client.47612 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"}]: dispatch 2024-05-20T22:42:21.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:21 smithi050 bash[21866]: audit 2024-05-20T22:42:20.657544+0000 mon.a (mon.0) 3932 : audit 1 from='client.47612 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"}]': finished 2024-05-20T22:42:21.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:21 smithi050 bash[21866]: cluster 2024-05-20T22:42:20.665264+0000 mon.a (mon.0) 3933 : cluster 0 osdmap e822: 8 total, 8 up, 8 in 2024-05-20T22:42:21.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:21 smithi050 bash[28929]: audit 2024-05-20T22:42:20.657544+0000 mon.a (mon.0) 3932 : audit 1 from='client.47612 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"}]': finished 2024-05-20T22:42:21.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:21 smithi050 bash[28929]: cluster 2024-05-20T22:42:20.665264+0000 mon.a (mon.0) 3933 : cluster 0 osdmap e822: 8 total, 8 up, 8 in 2024-05-20T22:42:22.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:21 smithi145 bash[23893]: audit 2024-05-20T22:42:20.657544+0000 mon.a (mon.0) 3932 : audit 1 from='client.47612 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "app": "rados"}]': finished 2024-05-20T22:42:22.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:21 smithi145 bash[23893]: cluster 2024-05-20T22:42:20.665264+0000 mon.a (mon.0) 3933 : cluster 0 osdmap e822: 8 total, 8 up, 8 in 2024-05-20T22:42:22.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:22 smithi050 bash[21866]: cluster 2024-05-20T22:42:21.523358+0000 mgr.y (mgr.14592) 1337 : cluster 0 pgmap v1806: 176 pgs: 176 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:42:22.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:22 smithi050 bash[21866]: cluster 2024-05-20T22:42:21.669644+0000 mon.a (mon.0) 3934 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:42:22.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:22 smithi050 bash[28929]: cluster 2024-05-20T22:42:21.523358+0000 mgr.y (mgr.14592) 1337 : cluster 0 pgmap v1806: 176 pgs: 176 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:42:22.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:22 smithi050 bash[28929]: cluster 2024-05-20T22:42:21.669644+0000 mon.a (mon.0) 3934 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:42:23.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:22 smithi145 bash[23893]: cluster 2024-05-20T22:42:21.523358+0000 mgr.y (mgr.14592) 1337 : cluster 0 pgmap v1806: 176 pgs: 176 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:42:23.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:22 smithi145 bash[23893]: cluster 2024-05-20T22:42:21.669644+0000 mon.a (mon.0) 3934 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T22:42:24.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:24 smithi050 bash[21866]: cluster 2024-05-20T22:42:23.524146+0000 mgr.y (mgr.14592) 1338 : cluster 0 pgmap v1807: 176 pgs: 176 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 869 B/s rd, 0 op/s 2024-05-20T22:42:24.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:24 smithi050 bash[28929]: cluster 2024-05-20T22:42:23.524146+0000 mgr.y (mgr.14592) 1338 : cluster 0 pgmap v1807: 176 pgs: 176 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 869 B/s rd, 0 op/s 2024-05-20T22:42:25.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:24 smithi145 bash[23893]: cluster 2024-05-20T22:42:23.524146+0000 mgr.y (mgr.14592) 1338 : cluster 0 pgmap v1807: 176 pgs: 176 active+clean; 583 KiB data, 865 MiB used, 714 GiB / 715 GiB avail; 869 B/s rd, 0 op/s 2024-05-20T22:42:26.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:26 smithi050 bash[28929]: cluster 2024-05-20T22:42:25.525970+0000 mgr.y (mgr.14592) 1339 : cluster 0 pgmap v1808: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 17 KiB/s wr, 2 op/s 2024-05-20T22:42:26.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:26 smithi050 bash[28929]: cluster 2024-05-20T22:42:26.586341+0000 mon.a (mon.0) 3935 : cluster 3 pool '1c2932ce-1479-493b-8174-2751cae2b39e' is full (reached quota's max_objects: 10) 2024-05-20T22:42:26.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:26 smithi050 bash[28929]: cluster 2024-05-20T22:42:26.586812+0000 mon.a (mon.0) 3936 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-05-20T22:42:26.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:26 smithi050 bash[28929]: cluster 2024-05-20T22:42:26.598231+0000 mon.a (mon.0) 3937 : cluster 0 osdmap e823: 8 total, 8 up, 8 in 2024-05-20T22:42:26.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:26 smithi050 bash[28929]: audit 2024-05-20T22:42:26.645982+0000 mon.a (mon.0) 3938 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:42:26.941 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:26 smithi050 bash[28929]: audit 2024-05-20T22:42:26.648506+0000 mon.a (mon.0) 3939 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:42:26.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:26 smithi050 bash[21866]: cluster 2024-05-20T22:42:25.525970+0000 mgr.y (mgr.14592) 1339 : cluster 0 pgmap v1808: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 17 KiB/s wr, 2 op/s 2024-05-20T22:42:26.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:26 smithi050 bash[21866]: cluster 2024-05-20T22:42:26.586341+0000 mon.a (mon.0) 3935 : cluster 3 pool '1c2932ce-1479-493b-8174-2751cae2b39e' is full (reached quota's max_objects: 10) 2024-05-20T22:42:26.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:26 smithi050 bash[21866]: cluster 2024-05-20T22:42:26.586812+0000 mon.a (mon.0) 3936 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-05-20T22:42:26.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:26 smithi050 bash[21866]: cluster 2024-05-20T22:42:26.598231+0000 mon.a (mon.0) 3937 : cluster 0 osdmap e823: 8 total, 8 up, 8 in 2024-05-20T22:42:26.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:26 smithi050 bash[21866]: audit 2024-05-20T22:42:26.645982+0000 mon.a (mon.0) 3938 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:42:26.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:26 smithi050 bash[21866]: audit 2024-05-20T22:42:26.648506+0000 mon.a (mon.0) 3939 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:42:27.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:26 smithi145 bash[23893]: cluster 2024-05-20T22:42:25.525970+0000 mgr.y (mgr.14592) 1339 : cluster 0 pgmap v1808: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 17 KiB/s wr, 2 op/s 2024-05-20T22:42:27.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:26 smithi145 bash[23893]: cluster 2024-05-20T22:42:26.586341+0000 mon.a (mon.0) 3935 : cluster 3 pool '1c2932ce-1479-493b-8174-2751cae2b39e' is full (reached quota's max_objects: 10) 2024-05-20T22:42:27.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:26 smithi145 bash[23893]: cluster 2024-05-20T22:42:26.586812+0000 mon.a (mon.0) 3936 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-05-20T22:42:27.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:26 smithi145 bash[23893]: cluster 2024-05-20T22:42:26.598231+0000 mon.a (mon.0) 3937 : cluster 0 osdmap e823: 8 total, 8 up, 8 in 2024-05-20T22:42:27.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:26 smithi145 bash[23893]: audit 2024-05-20T22:42:26.645982+0000 mon.a (mon.0) 3938 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:42:27.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:26 smithi145 bash[23893]: audit 2024-05-20T22:42:26.648506+0000 mon.a (mon.0) 3939 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:42:28.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:28 smithi050 bash[21866]: cluster 2024-05-20T22:42:27.526860+0000 mgr.y (mgr.14592) 1340 : cluster 0 pgmap v1810: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-05-20T22:42:28.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:28 smithi050 bash[28929]: cluster 2024-05-20T22:42:27.526860+0000 mgr.y (mgr.14592) 1340 : cluster 0 pgmap v1810: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-05-20T22:42:29.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:28 smithi145 bash[23893]: cluster 2024-05-20T22:42:27.526860+0000 mgr.y (mgr.14592) 1340 : cluster 0 pgmap v1810: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-05-20T22:42:29.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:42:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:42:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:42:29.885 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:42:29 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:42:30.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:30 smithi050 bash[28929]: audit 2024-05-20T22:42:29.451766+0000 mgr.y (mgr.14592) 1341 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:42:30.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:30 smithi050 bash[28929]: cluster 2024-05-20T22:42:29.527673+0000 mgr.y (mgr.14592) 1342 : cluster 0 pgmap v1811: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 577 B/s rd, 14 KiB/s wr, 1 op/s 2024-05-20T22:42:30.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:30 smithi050 bash[21866]: audit 2024-05-20T22:42:29.451766+0000 mgr.y (mgr.14592) 1341 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:42:30.941 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:30 smithi050 bash[21866]: cluster 2024-05-20T22:42:29.527673+0000 mgr.y (mgr.14592) 1342 : cluster 0 pgmap v1811: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 577 B/s rd, 14 KiB/s wr, 1 op/s 2024-05-20T22:42:31.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:30 smithi145 bash[23893]: audit 2024-05-20T22:42:29.451766+0000 mgr.y (mgr.14592) 1341 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:42:31.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:30 smithi145 bash[23893]: cluster 2024-05-20T22:42:29.527673+0000 mgr.y (mgr.14592) 1342 : cluster 0 pgmap v1811: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 577 B/s rd, 14 KiB/s wr, 1 op/s 2024-05-20T22:42:32.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:32 smithi050 bash[21866]: cluster 2024-05-20T22:42:31.529615+0000 mgr.y (mgr.14592) 1343 : cluster 0 pgmap v1812: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-05-20T22:42:32.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:32 smithi050 bash[28929]: cluster 2024-05-20T22:42:31.529615+0000 mgr.y (mgr.14592) 1343 : cluster 0 pgmap v1812: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-05-20T22:42:33.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:32 smithi145 bash[23893]: cluster 2024-05-20T22:42:31.529615+0000 mgr.y (mgr.14592) 1343 : cluster 0 pgmap v1812: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-05-20T22:42:34.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:34 smithi050 bash[21866]: cluster 2024-05-20T22:42:33.530423+0000 mgr.y (mgr.14592) 1344 : cluster 0 pgmap v1813: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-05-20T22:42:34.940 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:34 smithi050 bash[28929]: cluster 2024-05-20T22:42:33.530423+0000 mgr.y (mgr.14592) 1344 : cluster 0 pgmap v1813: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-05-20T22:42:35.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:34 smithi145 bash[23893]: cluster 2024-05-20T22:42:33.530423+0000 mgr.y (mgr.14592) 1344 : cluster 0 pgmap v1813: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-05-20T22:42:37.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:36 smithi145 bash[23893]: cluster 2024-05-20T22:42:35.532359+0000 mgr.y (mgr.14592) 1345 : cluster 0 pgmap v1814: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:42:37.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:36 smithi050 bash[21866]: cluster 2024-05-20T22:42:35.532359+0000 mgr.y (mgr.14592) 1345 : cluster 0 pgmap v1814: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:42:37.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:36 smithi050 bash[28929]: cluster 2024-05-20T22:42:35.532359+0000 mgr.y (mgr.14592) 1345 : cluster 0 pgmap v1814: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:42:39.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:38 smithi145 bash[23893]: cluster 2024-05-20T22:42:37.533253+0000 mgr.y (mgr.14592) 1346 : cluster 0 pgmap v1815: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 935 B/s rd, 0 op/s 2024-05-20T22:42:39.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:38 smithi050 bash[21866]: cluster 2024-05-20T22:42:37.533253+0000 mgr.y (mgr.14592) 1346 : cluster 0 pgmap v1815: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 935 B/s rd, 0 op/s 2024-05-20T22:42:39.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:38 smithi050 bash[28929]: cluster 2024-05-20T22:42:37.533253+0000 mgr.y (mgr.14592) 1346 : cluster 0 pgmap v1815: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 935 B/s rd, 0 op/s 2024-05-20T22:42:39.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:42:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:42:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:42:39.885 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:42:39 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:42:41.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:40 smithi145 bash[23893]: audit 2024-05-20T22:42:39.461364+0000 mgr.y (mgr.14592) 1347 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:42:41.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:40 smithi145 bash[23893]: cluster 2024-05-20T22:42:39.534170+0000 mgr.y (mgr.14592) 1348 : cluster 0 pgmap v1816: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:42:41.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:40 smithi050 bash[21866]: audit 2024-05-20T22:42:39.461364+0000 mgr.y (mgr.14592) 1347 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:42:41.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:40 smithi050 bash[21866]: cluster 2024-05-20T22:42:39.534170+0000 mgr.y (mgr.14592) 1348 : cluster 0 pgmap v1816: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:42:41.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:40 smithi050 bash[28929]: audit 2024-05-20T22:42:39.461364+0000 mgr.y (mgr.14592) 1347 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:42:41.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:40 smithi050 bash[28929]: cluster 2024-05-20T22:42:39.534170+0000 mgr.y (mgr.14592) 1348 : cluster 0 pgmap v1816: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:42:42.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:41 smithi145 bash[23893]: audit 2024-05-20T22:42:41.678599+0000 mon.a (mon.0) 3940 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:42:42.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:41 smithi050 bash[21866]: audit 2024-05-20T22:42:41.678599+0000 mon.a (mon.0) 3940 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:42:42.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:41 smithi050 bash[28929]: audit 2024-05-20T22:42:41.678599+0000 mon.a (mon.0) 3940 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:42:43.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:42 smithi145 bash[23893]: cluster 2024-05-20T22:42:41.536260+0000 mgr.y (mgr.14592) 1349 : cluster 0 pgmap v1817: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:42:43.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:42 smithi050 bash[21866]: cluster 2024-05-20T22:42:41.536260+0000 mgr.y (mgr.14592) 1349 : cluster 0 pgmap v1817: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:42:43.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:42 smithi050 bash[28929]: cluster 2024-05-20T22:42:41.536260+0000 mgr.y (mgr.14592) 1349 : cluster 0 pgmap v1817: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:42:45.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:44 smithi145 bash[23893]: cluster 2024-05-20T22:42:43.537064+0000 mgr.y (mgr.14592) 1350 : cluster 0 pgmap v1818: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:42:45.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:44 smithi050 bash[21866]: cluster 2024-05-20T22:42:43.537064+0000 mgr.y (mgr.14592) 1350 : cluster 0 pgmap v1818: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:42:45.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:44 smithi050 bash[28929]: cluster 2024-05-20T22:42:43.537064+0000 mgr.y (mgr.14592) 1350 : cluster 0 pgmap v1818: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:42:47.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:46 smithi145 bash[23893]: cluster 2024-05-20T22:42:45.538907+0000 mgr.y (mgr.14592) 1351 : cluster 0 pgmap v1819: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:42:47.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:46 smithi050 bash[21866]: cluster 2024-05-20T22:42:45.538907+0000 mgr.y (mgr.14592) 1351 : cluster 0 pgmap v1819: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:42:47.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:46 smithi050 bash[28929]: cluster 2024-05-20T22:42:45.538907+0000 mgr.y (mgr.14592) 1351 : cluster 0 pgmap v1819: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:42:48.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:47 smithi145 bash[23893]: audit 2024-05-20T22:42:47.582544+0000 mon.a (mon.0) 3941 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:42:48.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:47 smithi050 bash[21866]: audit 2024-05-20T22:42:47.582544+0000 mon.a (mon.0) 3941 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:42:48.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:47 smithi050 bash[28929]: audit 2024-05-20T22:42:47.582544+0000 mon.a (mon.0) 3941 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:42:49.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:48 smithi145 bash[23893]: cluster 2024-05-20T22:42:47.539669+0000 mgr.y (mgr.14592) 1352 : cluster 0 pgmap v1820: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:42:49.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:48 smithi145 bash[23893]: audit 2024-05-20T22:42:48.304040+0000 mon.a (mon.0) 3942 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:42:49.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:48 smithi145 bash[23893]: audit 2024-05-20T22:42:48.305266+0000 mon.a (mon.0) 3943 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:42:49.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:48 smithi145 bash[23893]: audit 2024-05-20T22:42:48.313918+0000 mon.a (mon.0) 3944 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:42:49.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:48 smithi050 bash[21866]: cluster 2024-05-20T22:42:47.539669+0000 mgr.y (mgr.14592) 1352 : cluster 0 pgmap v1820: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:42:49.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:48 smithi050 bash[21866]: audit 2024-05-20T22:42:48.304040+0000 mon.a (mon.0) 3942 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:42:49.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:48 smithi050 bash[21866]: audit 2024-05-20T22:42:48.305266+0000 mon.a (mon.0) 3943 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:42:49.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:48 smithi050 bash[21866]: audit 2024-05-20T22:42:48.313918+0000 mon.a (mon.0) 3944 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:42:49.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:48 smithi050 bash[28929]: cluster 2024-05-20T22:42:47.539669+0000 mgr.y (mgr.14592) 1352 : cluster 0 pgmap v1820: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:42:49.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:48 smithi050 bash[28929]: audit 2024-05-20T22:42:48.304040+0000 mon.a (mon.0) 3942 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:42:49.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:48 smithi050 bash[28929]: audit 2024-05-20T22:42:48.305266+0000 mon.a (mon.0) 3943 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:42:49.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:48 smithi050 bash[28929]: audit 2024-05-20T22:42:48.313918+0000 mon.a (mon.0) 3944 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:42:49.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:42:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:42:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:42:49.885 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:42:49 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:42:51.056 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=135577 2024-05-20T22:42:51.056 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph osd pool set-quota 1c2932ce-1479-493b-8174-2751cae2b39e max_objects 100 2024-05-20T22:42:51.056 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 1c2932ce-1479-493b-8174-2751cae2b39e put onemore /etc/passwd 2024-05-20T22:42:51.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:50 smithi145 bash[23893]: audit 2024-05-20T22:42:49.472804+0000 mgr.y (mgr.14592) 1353 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:42:51.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:50 smithi145 bash[23893]: cluster 2024-05-20T22:42:49.540439+0000 mgr.y (mgr.14592) 1354 : cluster 0 pgmap v1821: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:42:51.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f4670b5a640 1 -- 172.21.15.50:0/1687232753 >> v1:172.21.15.50:6790/0 conn(0x7f466c110b20 legacy=0x7f466c112f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:51.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f4670b5a640 1 -- 172.21.15.50:0/1687232753 shutdown_connections 2024-05-20T22:42:51.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f4670b5a640 1 -- 172.21.15.50:0/1687232753 >> 172.21.15.50:0/1687232753 conn(0x7f466c077490 msgr2=0x7f466c0798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:42:51.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f4670b5a640 1 -- 172.21.15.50:0/1687232753 shutdown_connections 2024-05-20T22:42:51.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f4670b5a640 1 -- 172.21.15.50:0/1687232753 wait complete. 2024-05-20T22:42:51.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f4670b5a640 1 Processor -- start 2024-05-20T22:42:51.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f4670b5a640 1 -- start start 2024-05-20T22:42:51.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f4670b5a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f466c10d4a0 con 0x7f466c10dd00 2024-05-20T22:42:51.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f4670b5a640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f466c10d6d0 con 0x7f466c1146c0 2024-05-20T22:42:51.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f4670b5a640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f466c1af2c0 con 0x7f466c110b20 2024-05-20T22:42:51.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f466a59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f466c10dd00 0x7f466c10a330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33788/0 (socket says 172.21.15.50:33788) 2024-05-20T22:42:51.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f466a59c640 1 -- 172.21.15.50:0/2942274661 learned_addr learned my addr 172.21.15.50:0/2942274661 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:42:51.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f4669d9b640 1 --1- 172.21.15.50:0/2942274661 >> v1:172.21.15.50:6790/0 conn(0x7f466c110b20 0x7f466c10aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:46062/0 (socket says 172.21.15.50:46062) 2024-05-20T22:42:51.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3929937508 0 0) 0x7f466c10d4a0 con 0x7f466c10dd00 2024-05-20T22:42:51.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4654003530 con 0x7f466c10dd00 2024-05-20T22:42:51.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2076610204 0 0) 0x7f466c1af2c0 con 0x7f466c110b20 2024-05-20T22:42:51.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f466c10d4a0 con 0x7f466c110b20 2024-05-20T22:42:51.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1528834363 0 0) 0x7f4654003530 con 0x7f466c10dd00 2024-05-20T22:42:51.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f466c1af2c0 con 0x7f466c10dd00 2024-05-20T22:42:51.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1524391891 0 0) 0x7f466c10d4a0 con 0x7f466c110b20 2024-05-20T22:42:51.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4654003530 con 0x7f466c110b20 2024-05-20T22:42:51.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f465c001940 con 0x7f466c10dd00 2024-05-20T22:42:51.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f4660001890 con 0x7f466c110b20 2024-05-20T22:42:51.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2830389295 0 0) 0x7f466c10d6d0 con 0x7f466c1146c0 2024-05-20T22:42:51.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f466c10d4a0 con 0x7f466c1146c0 2024-05-20T22:42:51.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2201638686 0 0) 0x7f4654003530 con 0x7f466c110b20 2024-05-20T22:42:51.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 >> v1:172.21.15.145:6789/0 conn(0x7f466c1146c0 legacy=0x7f466c1abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:51.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 >> v1:172.21.15.50:6789/0 conn(0x7f466c10dd00 legacy=0x7f466c10a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:51.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466c1b04e0 con 0x7f466c110b20 2024-05-20T22:42:51.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f4670b5a640 1 -- 172.21.15.50:0/2942274661 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f466c1af4f0 con 0x7f466c110b20 2024-05-20T22:42:51.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f4670b5a640 1 -- 172.21.15.50:0/2942274661 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f466c1af9b0 con 0x7f466c110b20 2024-05-20T22:42:51.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f46600046f0 con 0x7f466c110b20 2024-05-20T22:42:51.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f4660004d80 con 0x7f466c110b20 2024-05-20T22:42:51.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.192+0000 7f4670b5a640 1 -- 172.21.15.50:0/2942274661 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f464c005090 con 0x7f466c110b20 2024-05-20T22:42:51.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:50 smithi050 bash[21866]: audit 2024-05-20T22:42:49.472804+0000 mgr.y (mgr.14592) 1353 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:42:51.193 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:50 smithi050 bash[21866]: cluster 2024-05-20T22:42:49.540439+0000 mgr.y (mgr.14592) 1354 : cluster 0 pgmap v1821: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:42:51.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:50 smithi050 bash[28929]: audit 2024-05-20T22:42:49.472804+0000 mgr.y (mgr.14592) 1353 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:42:51.193 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:50 smithi050 bash[28929]: cluster 2024-05-20T22:42:49.540439+0000 mgr.y (mgr.14592) 1354 : cluster 0 pgmap v1821: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:42:51.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.196+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f4660001b30 con 0x7f466c110b20 2024-05-20T22:42:51.194 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.196+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(823..823 src has 256..823) ==== 7748+0+0 (unknown 3290255033 0 0) 0x7f4660089bd0 con 0x7f466c110b20 2024-05-20T22:42:51.194 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.196+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=824}) -- 0x7f4654003530 con 0x7f466c110b20 2024-05-20T22:42:51.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.200+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f4660056d00 con 0x7f466c110b20 2024-05-20T22:42:51.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.376+0000 7f4670b5a640 1 -- 172.21.15.50:0/2942274661 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"} v 0) -- 0x7f464c005380 con 0x7f466c110b20 2024-05-20T22:42:51.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.760+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 <== mon.2 v1:172.21.15.50:6790/0 10 ==== osd_map(824..824 src has 256..824) ==== 628+0+0 (unknown 1454645960 0 0) 0x7f46600879b0 con 0x7f466c110b20 2024-05-20T22:42:51.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.760+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=825}) -- 0x7f466c1af2c0 con 0x7f466c110b20 2024-05-20T22:42:51.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.768+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 <== mon.2 v1:172.21.15.50:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 1c2932ce-1479-493b-8174-2751cae2b39e v824) ==== 225+0+0 (unknown 4217098842 0 0) 0x7f466005a9b0 con 0x7f466c110b20 2024-05-20T22:42:51.871 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:51.876+0000 7f4670b5a640 1 -- 172.21.15.50:0/2942274661 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"} v 0) -- 0x7f464c0010e0 con 0x7f466c110b20 2024-05-20T22:42:52.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:51 smithi145 bash[23893]: audit 2024-05-20T22:42:51.383191+0000 mon.c (mon.2) 535 : audit 1 from='client.? v1:172.21.15.50:0/2942274661' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"}]: dispatch 2024-05-20T22:42:52.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:51 smithi145 bash[23893]: audit 2024-05-20T22:42:51.383846+0000 mon.a (mon.0) 3945 : audit 1 from='client.47717 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"}]: dispatch 2024-05-20T22:42:52.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:51 smithi050 bash[21866]: audit 2024-05-20T22:42:51.383191+0000 mon.c (mon.2) 535 : audit 1 from='client.? v1:172.21.15.50:0/2942274661' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"}]: dispatch 2024-05-20T22:42:52.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:51 smithi050 bash[21866]: audit 2024-05-20T22:42:51.383846+0000 mon.a (mon.0) 3945 : audit 1 from='client.47717 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"}]: dispatch 2024-05-20T22:42:52.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:51 smithi050 bash[28929]: audit 2024-05-20T22:42:51.383191+0000 mon.c (mon.2) 535 : audit 1 from='client.? v1:172.21.15.50:0/2942274661' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"}]: dispatch 2024-05-20T22:42:52.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:51 smithi050 bash[28929]: audit 2024-05-20T22:42:51.383846+0000 mon.a (mon.0) 3945 : audit 1 from='client.47717 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"}]: dispatch 2024-05-20T22:42:52.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:52.768+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 <== mon.2 v1:172.21.15.50:6790/0 12 ==== osd_map(825..825 src has 256..825) ==== 628+0+0 (unknown 2224121253 0 0) 0x7f4660052640 con 0x7f466c110b20 2024-05-20T22:42:52.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:52.768+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=826}) -- 0x7f466c10d6d0 con 0x7f466c110b20 2024-05-20T22:42:52.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:52.776+0000 7f465b7fe640 1 -- 172.21.15.50:0/2942274661 <== mon.2 v1:172.21.15.50:6790/0 13 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 1c2932ce-1479-493b-8174-2751cae2b39e v825) ==== 225+0+0 (unknown 3552112162 0 0) 0x7f466005f270 con 0x7f466c110b20 2024-05-20T22:42:52.772 INFO:tasks.workunit.client.0.smithi050.stderr:set-quota max_objects = 100 for pool 1c2932ce-1479-493b-8174-2751cae2b39e 2024-05-20T22:42:52.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:52.780+0000 7f4670b5a640 1 -- 172.21.15.50:0/2942274661 >> v1:172.21.15.50:6800/3332714287 conn(0x7f465406eea0 legacy=0x7f4654071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:52.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:52.780+0000 7f4670b5a640 1 -- 172.21.15.50:0/2942274661 >> v1:172.21.15.50:6790/0 conn(0x7f466c110b20 legacy=0x7f466c10aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:52.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:52.780+0000 7f4670b5a640 1 -- 172.21.15.50:0/2942274661 shutdown_connections 2024-05-20T22:42:52.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:52.780+0000 7f4670b5a640 1 -- 172.21.15.50:0/2942274661 >> 172.21.15.50:0/2942274661 conn(0x7f466c077490 msgr2=0x7f466c117310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:42:52.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:52.780+0000 7f4670b5a640 1 -- 172.21.15.50:0/2942274661 shutdown_connections 2024-05-20T22:42:52.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:52.780+0000 7f4670b5a640 1 -- 172.21.15.50:0/2942274661 wait complete. 2024-05-20T22:42:52.795 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 135577 2024-05-20T22:42:53.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:52 smithi145 bash[23893]: cluster 2024-05-20T22:42:51.542210+0000 mgr.y (mgr.14592) 1355 : cluster 0 pgmap v1822: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:42:53.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:52 smithi145 bash[23893]: audit 2024-05-20T22:42:51.762172+0000 mon.a (mon.0) 3946 : audit 1 from='client.47717 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"}]': finished 2024-05-20T22:42:53.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:52 smithi145 bash[23893]: cluster 2024-05-20T22:42:51.770032+0000 mon.a (mon.0) 3947 : cluster 0 osdmap e824: 8 total, 8 up, 8 in 2024-05-20T22:42:53.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:52 smithi145 bash[23893]: audit 2024-05-20T22:42:51.881340+0000 mon.c (mon.2) 536 : audit 1 from='client.? v1:172.21.15.50:0/2942274661' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"}]: dispatch 2024-05-20T22:42:53.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:52 smithi145 bash[23893]: audit 2024-05-20T22:42:51.881989+0000 mon.a (mon.0) 3948 : audit 1 from='client.47717 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"}]: dispatch 2024-05-20T22:42:53.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:52 smithi050 bash[21866]: cluster 2024-05-20T22:42:51.542210+0000 mgr.y (mgr.14592) 1355 : cluster 0 pgmap v1822: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:42:53.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:52 smithi050 bash[21866]: audit 2024-05-20T22:42:51.762172+0000 mon.a (mon.0) 3946 : audit 1 from='client.47717 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"}]': finished 2024-05-20T22:42:53.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:52 smithi050 bash[21866]: cluster 2024-05-20T22:42:51.770032+0000 mon.a (mon.0) 3947 : cluster 0 osdmap e824: 8 total, 8 up, 8 in 2024-05-20T22:42:53.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:52 smithi050 bash[21866]: audit 2024-05-20T22:42:51.881340+0000 mon.c (mon.2) 536 : audit 1 from='client.? v1:172.21.15.50:0/2942274661' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"}]: dispatch 2024-05-20T22:42:53.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:52 smithi050 bash[21866]: audit 2024-05-20T22:42:51.881989+0000 mon.a (mon.0) 3948 : audit 1 from='client.47717 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"}]: dispatch 2024-05-20T22:42:53.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:52 smithi050 bash[28929]: cluster 2024-05-20T22:42:51.542210+0000 mgr.y (mgr.14592) 1355 : cluster 0 pgmap v1822: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:42:53.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:52 smithi050 bash[28929]: audit 2024-05-20T22:42:51.762172+0000 mon.a (mon.0) 3946 : audit 1 from='client.47717 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"}]': finished 2024-05-20T22:42:53.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:52 smithi050 bash[28929]: cluster 2024-05-20T22:42:51.770032+0000 mon.a (mon.0) 3947 : cluster 0 osdmap e824: 8 total, 8 up, 8 in 2024-05-20T22:42:53.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:52 smithi050 bash[28929]: audit 2024-05-20T22:42:51.881340+0000 mon.c (mon.2) 536 : audit 1 from='client.? v1:172.21.15.50:0/2942274661' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"}]: dispatch 2024-05-20T22:42:53.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:52 smithi050 bash[28929]: audit 2024-05-20T22:42:51.881989+0000 mon.a (mon.0) 3948 : audit 1 from='client.47717 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"}]: dispatch 2024-05-20T22:42:54.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:53 smithi145 bash[23893]: audit 2024-05-20T22:42:52.772313+0000 mon.a (mon.0) 3949 : audit 1 from='client.47717 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"}]': finished 2024-05-20T22:42:54.137 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:53 smithi145 bash[23893]: cluster 2024-05-20T22:42:52.779611+0000 mon.a (mon.0) 3950 : cluster 0 osdmap e825: 8 total, 8 up, 8 in 2024-05-20T22:42:54.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:53 smithi050 bash[21866]: audit 2024-05-20T22:42:52.772313+0000 mon.a (mon.0) 3949 : audit 1 from='client.47717 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"}]': finished 2024-05-20T22:42:54.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:53 smithi050 bash[21866]: cluster 2024-05-20T22:42:52.779611+0000 mon.a (mon.0) 3950 : cluster 0 osdmap e825: 8 total, 8 up, 8 in 2024-05-20T22:42:54.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:53 smithi050 bash[28929]: audit 2024-05-20T22:42:52.772313+0000 mon.a (mon.0) 3949 : audit 1 from='client.47717 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "100"}]': finished 2024-05-20T22:42:54.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:53 smithi050 bash[28929]: cluster 2024-05-20T22:42:52.779611+0000 mon.a (mon.0) 3950 : cluster 0 osdmap e825: 8 total, 8 up, 8 in 2024-05-20T22:42:55.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:54 smithi145 bash[23893]: cluster 2024-05-20T22:42:53.543159+0000 mgr.y (mgr.14592) 1356 : cluster 0 pgmap v1825: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:42:55.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:54 smithi050 bash[21866]: cluster 2024-05-20T22:42:53.543159+0000 mgr.y (mgr.14592) 1356 : cluster 0 pgmap v1825: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:42:55.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:54 smithi050 bash[28929]: cluster 2024-05-20T22:42:53.543159+0000 mgr.y (mgr.14592) 1356 : cluster 0 pgmap v1825: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-20T22:42:56.610 INFO:tasks.workunit.client.0.smithi050.stderr:+ [ 0 -ne 0 ] 2024-05-20T22:42:56.610 INFO:tasks.workunit.client.0.smithi050.stderr:+ true 2024-05-20T22:42:56.610 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 1c2932ce-1479-493b-8174-2751cae2b39e put twomore /etc/passwd 2024-05-20T22:42:56.656 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph osd pool set-quota 1c2932ce-1479-493b-8174-2751cae2b39e max_bytes 100 2024-05-20T22:42:56.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.784+0000 7f616f776640 1 -- 172.21.15.50:0/528364239 >> v1:172.21.15.50:6789/0 conn(0x7f6168107660 legacy=0x7f6168107a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:56.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.784+0000 7f616f776640 1 -- 172.21.15.50:0/528364239 shutdown_connections 2024-05-20T22:42:56.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.784+0000 7f616f776640 1 -- 172.21.15.50:0/528364239 >> 172.21.15.50:0/528364239 conn(0x7f61680fd130 msgr2=0x7f61680ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:42:56.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.784+0000 7f616f776640 1 -- 172.21.15.50:0/528364239 shutdown_connections 2024-05-20T22:42:56.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.784+0000 7f616f776640 1 -- 172.21.15.50:0/528364239 wait complete. 2024-05-20T22:42:56.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.784+0000 7f616f776640 1 Processor -- start 2024-05-20T22:42:56.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.784+0000 7f616f776640 1 -- start start 2024-05-20T22:42:56.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.784+0000 7f616f776640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f61681a6760 con 0x7f616810e0b0 2024-05-20T22:42:56.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.784+0000 7f616f776640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f61681a79a0 con 0x7f616810a510 2024-05-20T22:42:56.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.784+0000 7f616f776640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f61681a8be0 con 0x7f6168107660 2024-05-20T22:42:56.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.784+0000 7f616d512640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7f6168107660 0x7f616810d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:46102/0 (socket says 172.21.15.50:46102) 2024-05-20T22:42:56.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.784+0000 7f616d512640 1 -- 172.21.15.50:0/3676167112 learned_addr learned my addr 172.21.15.50:0/3676167112 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:42:56.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3250077946 0 0) 0x7f61681a6760 con 0x7f616810e0b0 2024-05-20T22:42:56.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6154003530 con 0x7f616810e0b0 2024-05-20T22:42:56.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 761775164 0 0) 0x7f61681a8be0 con 0x7f6168107660 2024-05-20T22:42:56.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61681a6760 con 0x7f6168107660 2024-05-20T22:42:56.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2241322317 0 0) 0x7f61681a6760 con 0x7f6168107660 2024-05-20T22:42:56.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61681a8be0 con 0x7f6168107660 2024-05-20T22:42:56.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 355751035 0 0) 0x7f6154003530 con 0x7f616810e0b0 2024-05-20T22:42:56.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61681a6760 con 0x7f616810e0b0 2024-05-20T22:42:56.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f61600046b0 con 0x7f6168107660 2024-05-20T22:42:56.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f6164001af0 con 0x7f616810e0b0 2024-05-20T22:42:56.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2426589637 0 0) 0x7f61681a8be0 con 0x7f6168107660 2024-05-20T22:42:56.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 >> v1:172.21.15.145:6789/0 conn(0x7f616810a510 legacy=0x7f61681a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:56.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 >> v1:172.21.15.50:6789/0 conn(0x7f616810e0b0 legacy=0x7f61681a4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:56.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61681a9e20 con 0x7f6168107660 2024-05-20T22:42:56.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f616f776640 1 -- 172.21.15.50:0/3676167112 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f61681a8e10 con 0x7f6168107660 2024-05-20T22:42:56.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f6160001af0 con 0x7f6168107660 2024-05-20T22:42:56.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f616f776640 1 -- 172.21.15.50:0/3676167112 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f61681a92d0 con 0x7f6168107660 2024-05-20T22:42:56.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f6160005110 con 0x7f6168107660 2024-05-20T22:42:56.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f616f776640 1 -- 172.21.15.50:0/3676167112 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6168102da0 con 0x7f6168107660 2024-05-20T22:42:56.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f61600053f0 con 0x7f6168107660 2024-05-20T22:42:56.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.788+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(826..826 src has 256..826) ==== 7748+0+0 (unknown 2086834256 0 0) 0x7f6160089ed0 con 0x7f6168107660 2024-05-20T22:42:56.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.792+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f6160057060 con 0x7f6168107660 2024-05-20T22:42:56.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:56.968+0000 7f616f776640 1 -- 172.21.15.50:0/3676167112 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"} v 0) -- 0x7f6168068940 con 0x7f6168107660 2024-05-20T22:42:57.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:56 smithi145 bash[23893]: cluster 2024-05-20T22:42:55.545165+0000 mgr.y (mgr.14592) 1357 : cluster 0 pgmap v1826: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:42:57.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:56 smithi145 bash[23893]: cluster 2024-05-20T22:42:56.594769+0000 mon.a (mon.0) 3951 : cluster 1 pool '1c2932ce-1479-493b-8174-2751cae2b39e' no longer out of quota; removing NO_QUOTA flag 2024-05-20T22:42:57.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:56 smithi145 bash[23893]: cluster 2024-05-20T22:42:56.595245+0000 mon.a (mon.0) 3952 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-05-20T22:42:57.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:56 smithi145 bash[23893]: cluster 2024-05-20T22:42:56.608062+0000 mon.a (mon.0) 3953 : cluster 0 osdmap e826: 8 total, 8 up, 8 in 2024-05-20T22:42:57.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:56 smithi145 bash[23893]: audit 2024-05-20T22:42:56.711695+0000 mon.a (mon.0) 3954 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:42:57.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:56 smithi145 bash[23893]: audit 2024-05-20T22:42:56.712791+0000 mon.a (mon.0) 3955 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:42:57.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:56 smithi050 bash[21866]: cluster 2024-05-20T22:42:55.545165+0000 mgr.y (mgr.14592) 1357 : cluster 0 pgmap v1826: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:42:57.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:56 smithi050 bash[21866]: cluster 2024-05-20T22:42:56.594769+0000 mon.a (mon.0) 3951 : cluster 1 pool '1c2932ce-1479-493b-8174-2751cae2b39e' no longer out of quota; removing NO_QUOTA flag 2024-05-20T22:42:57.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:56 smithi050 bash[21866]: cluster 2024-05-20T22:42:56.595245+0000 mon.a (mon.0) 3952 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-05-20T22:42:57.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:56 smithi050 bash[21866]: cluster 2024-05-20T22:42:56.608062+0000 mon.a (mon.0) 3953 : cluster 0 osdmap e826: 8 total, 8 up, 8 in 2024-05-20T22:42:57.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:56 smithi050 bash[21866]: audit 2024-05-20T22:42:56.711695+0000 mon.a (mon.0) 3954 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:42:57.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:56 smithi050 bash[21866]: audit 2024-05-20T22:42:56.712791+0000 mon.a (mon.0) 3955 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:42:57.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:56 smithi050 bash[28929]: cluster 2024-05-20T22:42:55.545165+0000 mgr.y (mgr.14592) 1357 : cluster 0 pgmap v1826: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:42:57.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:56 smithi050 bash[28929]: cluster 2024-05-20T22:42:56.594769+0000 mon.a (mon.0) 3951 : cluster 1 pool '1c2932ce-1479-493b-8174-2751cae2b39e' no longer out of quota; removing NO_QUOTA flag 2024-05-20T22:42:57.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:56 smithi050 bash[28929]: cluster 2024-05-20T22:42:56.595245+0000 mon.a (mon.0) 3952 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-05-20T22:42:57.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:56 smithi050 bash[28929]: cluster 2024-05-20T22:42:56.608062+0000 mon.a (mon.0) 3953 : cluster 0 osdmap e826: 8 total, 8 up, 8 in 2024-05-20T22:42:57.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:56 smithi050 bash[28929]: audit 2024-05-20T22:42:56.711695+0000 mon.a (mon.0) 3954 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:42:57.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:56 smithi050 bash[28929]: audit 2024-05-20T22:42:56.712791+0000 mon.a (mon.0) 3955 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:42:57.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:57.804+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 <== mon.2 v1:172.21.15.50:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 1c2932ce-1479-493b-8174-2751cae2b39e v827) ==== 221+0+0 (unknown 2262727834 0 0) 0x7f616005ad10 con 0x7f6168107660 2024-05-20T22:42:57.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:57.912+0000 7f616f776640 1 -- 172.21.15.50:0/3676167112 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"} v 0) -- 0x7f616810bf80 con 0x7f6168107660 2024-05-20T22:42:58.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:57 smithi145 bash[23893]: audit 2024-05-20T22:42:56.973486+0000 mon.c (mon.2) 537 : audit 1 from='client.? v1:172.21.15.50:0/3676167112' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"}]: dispatch 2024-05-20T22:42:58.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:57 smithi145 bash[23893]: audit 2024-05-20T22:42:56.974259+0000 mon.a (mon.0) 3956 : audit 1 from='client.47729 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"}]: dispatch 2024-05-20T22:42:58.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:57 smithi050 bash[21866]: audit 2024-05-20T22:42:56.973486+0000 mon.c (mon.2) 537 : audit 1 from='client.? v1:172.21.15.50:0/3676167112' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"}]: dispatch 2024-05-20T22:42:58.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:57 smithi050 bash[21866]: audit 2024-05-20T22:42:56.974259+0000 mon.a (mon.0) 3956 : audit 1 from='client.47729 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"}]: dispatch 2024-05-20T22:42:58.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:57 smithi050 bash[28929]: audit 2024-05-20T22:42:56.973486+0000 mon.c (mon.2) 537 : audit 1 from='client.? v1:172.21.15.50:0/3676167112' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"}]: dispatch 2024-05-20T22:42:58.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:57 smithi050 bash[28929]: audit 2024-05-20T22:42:56.974259+0000 mon.a (mon.0) 3956 : audit 1 from='client.47729 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"}]: dispatch 2024-05-20T22:42:58.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:58.800+0000 7f615e7fc640 1 -- 172.21.15.50:0/3676167112 <== mon.2 v1:172.21.15.50:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 1c2932ce-1479-493b-8174-2751cae2b39e v828) ==== 221+0+0 (unknown 156815918 0 0) 0x7f616005f5d0 con 0x7f6168107660 2024-05-20T22:42:58.797 INFO:tasks.workunit.client.0.smithi050.stderr:set-quota max_bytes = 100 for pool 1c2932ce-1479-493b-8174-2751cae2b39e 2024-05-20T22:42:58.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:58.804+0000 7f616f776640 1 -- 172.21.15.50:0/3676167112 >> v1:172.21.15.50:6800/3332714287 conn(0x7f615406eda0 legacy=0x7f6154071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:58.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:58.804+0000 7f616f776640 1 -- 172.21.15.50:0/3676167112 >> v1:172.21.15.50:6790/0 conn(0x7f6168107660 legacy=0x7f616810d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:42:58.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:58.804+0000 7f616f776640 1 -- 172.21.15.50:0/3676167112 shutdown_connections 2024-05-20T22:42:58.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:58.804+0000 7f616f776640 1 -- 172.21.15.50:0/3676167112 >> 172.21.15.50:0/3676167112 conn(0x7f61680fd130 msgr2=0x7f61680ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:42:58.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:58.804+0000 7f616f776640 1 -- 172.21.15.50:0/3676167112 shutdown_connections 2024-05-20T22:42:58.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:42:58.804+0000 7f616f776640 1 -- 172.21.15.50:0/3676167112 wait complete. 2024-05-20T22:42:58.822 INFO:tasks.workunit.client.0.smithi050.stderr:+ sleep 30 2024-05-20T22:42:59.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:58 smithi145 bash[23893]: cluster 2024-05-20T22:42:57.545942+0000 mgr.y (mgr.14592) 1358 : cluster 0 pgmap v1828: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:42:59.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:58 smithi145 bash[23893]: audit 2024-05-20T22:42:57.796451+0000 mon.a (mon.0) 3957 : audit 1 from='client.47729 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"}]': finished 2024-05-20T22:42:59.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:58 smithi145 bash[23893]: cluster 2024-05-20T22:42:57.804130+0000 mon.a (mon.0) 3958 : cluster 0 osdmap e827: 8 total, 8 up, 8 in 2024-05-20T22:42:59.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:58 smithi145 bash[23893]: audit 2024-05-20T22:42:57.918614+0000 mon.c (mon.2) 538 : audit 1 from='client.? v1:172.21.15.50:0/3676167112' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"}]: dispatch 2024-05-20T22:42:59.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:58 smithi145 bash[23893]: audit 2024-05-20T22:42:57.919069+0000 mon.a (mon.0) 3959 : audit 1 from='client.47729 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"}]: dispatch 2024-05-20T22:42:59.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:58 smithi050 bash[21866]: cluster 2024-05-20T22:42:57.545942+0000 mgr.y (mgr.14592) 1358 : cluster 0 pgmap v1828: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:42:59.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:58 smithi050 bash[21866]: audit 2024-05-20T22:42:57.796451+0000 mon.a (mon.0) 3957 : audit 1 from='client.47729 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"}]': finished 2024-05-20T22:42:59.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:58 smithi050 bash[21866]: cluster 2024-05-20T22:42:57.804130+0000 mon.a (mon.0) 3958 : cluster 0 osdmap e827: 8 total, 8 up, 8 in 2024-05-20T22:42:59.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:58 smithi050 bash[21866]: audit 2024-05-20T22:42:57.918614+0000 mon.c (mon.2) 538 : audit 1 from='client.? v1:172.21.15.50:0/3676167112' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"}]: dispatch 2024-05-20T22:42:59.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:58 smithi050 bash[21866]: audit 2024-05-20T22:42:57.919069+0000 mon.a (mon.0) 3959 : audit 1 from='client.47729 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"}]: dispatch 2024-05-20T22:42:59.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:58 smithi050 bash[28929]: cluster 2024-05-20T22:42:57.545942+0000 mgr.y (mgr.14592) 1358 : cluster 0 pgmap v1828: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:42:59.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:58 smithi050 bash[28929]: audit 2024-05-20T22:42:57.796451+0000 mon.a (mon.0) 3957 : audit 1 from='client.47729 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"}]': finished 2024-05-20T22:42:59.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:58 smithi050 bash[28929]: cluster 2024-05-20T22:42:57.804130+0000 mon.a (mon.0) 3958 : cluster 0 osdmap e827: 8 total, 8 up, 8 in 2024-05-20T22:42:59.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:58 smithi050 bash[28929]: audit 2024-05-20T22:42:57.918614+0000 mon.c (mon.2) 538 : audit 1 from='client.? v1:172.21.15.50:0/3676167112' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"}]: dispatch 2024-05-20T22:42:59.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:58 smithi050 bash[28929]: audit 2024-05-20T22:42:57.919069+0000 mon.a (mon.0) 3959 : audit 1 from='client.47729 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"}]: dispatch 2024-05-20T22:42:59.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:42:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:42:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:42:59.805 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:42:59 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:43:00.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:59 smithi145 bash[23893]: audit 2024-05-20T22:42:58.798915+0000 mon.a (mon.0) 3960 : audit 1 from='client.47729 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"}]': finished 2024-05-20T22:43:00.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:42:59 smithi145 bash[23893]: cluster 2024-05-20T22:42:58.806189+0000 mon.a (mon.0) 3961 : cluster 0 osdmap e828: 8 total, 8 up, 8 in 2024-05-20T22:43:00.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:59 smithi050 bash[21866]: audit 2024-05-20T22:42:58.798915+0000 mon.a (mon.0) 3960 : audit 1 from='client.47729 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"}]': finished 2024-05-20T22:43:00.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:42:59 smithi050 bash[21866]: cluster 2024-05-20T22:42:58.806189+0000 mon.a (mon.0) 3961 : cluster 0 osdmap e828: 8 total, 8 up, 8 in 2024-05-20T22:43:00.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:59 smithi050 bash[28929]: audit 2024-05-20T22:42:58.798915+0000 mon.a (mon.0) 3960 : audit 1 from='client.47729 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "100"}]': finished 2024-05-20T22:43:00.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:42:59 smithi050 bash[28929]: cluster 2024-05-20T22:42:58.806189+0000 mon.a (mon.0) 3961 : cluster 0 osdmap e828: 8 total, 8 up, 8 in 2024-05-20T22:43:01.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:00 smithi145 bash[23893]: audit 2024-05-20T22:42:59.484148+0000 mgr.y (mgr.14592) 1359 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:43:01.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:00 smithi145 bash[23893]: cluster 2024-05-20T22:42:59.546712+0000 mgr.y (mgr.14592) 1360 : cluster 0 pgmap v1831: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:01.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:00 smithi050 bash[21866]: audit 2024-05-20T22:42:59.484148+0000 mgr.y (mgr.14592) 1359 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:43:01.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:00 smithi050 bash[21866]: cluster 2024-05-20T22:42:59.546712+0000 mgr.y (mgr.14592) 1360 : cluster 0 pgmap v1831: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:01.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:00 smithi050 bash[28929]: audit 2024-05-20T22:42:59.484148+0000 mgr.y (mgr.14592) 1359 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:43:01.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:00 smithi050 bash[28929]: cluster 2024-05-20T22:42:59.546712+0000 mgr.y (mgr.14592) 1360 : cluster 0 pgmap v1831: 176 pgs: 176 active+clean; 702 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:02.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:01 smithi145 bash[23893]: cluster 2024-05-20T22:43:01.597082+0000 mon.a (mon.0) 3962 : cluster 3 pool '1c2932ce-1479-493b-8174-2751cae2b39e' is full (reached quota's max_bytes: 100 B) 2024-05-20T22:43:02.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:01 smithi145 bash[23893]: cluster 2024-05-20T22:43:01.597559+0000 mon.a (mon.0) 3963 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-05-20T22:43:02.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:01 smithi145 bash[23893]: cluster 2024-05-20T22:43:01.607369+0000 mon.a (mon.0) 3964 : cluster 0 osdmap e829: 8 total, 8 up, 8 in 2024-05-20T22:43:02.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:01 smithi050 bash[21866]: cluster 2024-05-20T22:43:01.597082+0000 mon.a (mon.0) 3962 : cluster 3 pool '1c2932ce-1479-493b-8174-2751cae2b39e' is full (reached quota's max_bytes: 100 B) 2024-05-20T22:43:02.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:01 smithi050 bash[21866]: cluster 2024-05-20T22:43:01.597559+0000 mon.a (mon.0) 3963 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-05-20T22:43:02.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:01 smithi050 bash[21866]: cluster 2024-05-20T22:43:01.607369+0000 mon.a (mon.0) 3964 : cluster 0 osdmap e829: 8 total, 8 up, 8 in 2024-05-20T22:43:02.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:01 smithi050 bash[28929]: cluster 2024-05-20T22:43:01.597082+0000 mon.a (mon.0) 3962 : cluster 3 pool '1c2932ce-1479-493b-8174-2751cae2b39e' is full (reached quota's max_bytes: 100 B) 2024-05-20T22:43:02.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:01 smithi050 bash[28929]: cluster 2024-05-20T22:43:01.597559+0000 mon.a (mon.0) 3963 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-05-20T22:43:02.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:01 smithi050 bash[28929]: cluster 2024-05-20T22:43:01.607369+0000 mon.a (mon.0) 3964 : cluster 0 osdmap e829: 8 total, 8 up, 8 in 2024-05-20T22:43:03.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:02 smithi145 bash[23893]: cluster 2024-05-20T22:43:01.548604+0000 mgr.y (mgr.14592) 1361 : cluster 0 pgmap v1832: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-05-20T22:43:03.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:02 smithi050 bash[21866]: cluster 2024-05-20T22:43:01.548604+0000 mgr.y (mgr.14592) 1361 : cluster 0 pgmap v1832: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-05-20T22:43:03.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:02 smithi050 bash[28929]: cluster 2024-05-20T22:43:01.548604+0000 mgr.y (mgr.14592) 1361 : cluster 0 pgmap v1832: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-05-20T22:43:05.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:04 smithi145 bash[23893]: cluster 2024-05-20T22:43:03.549390+0000 mgr.y (mgr.14592) 1362 : cluster 0 pgmap v1834: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-05-20T22:43:05.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:04 smithi050 bash[21866]: cluster 2024-05-20T22:43:03.549390+0000 mgr.y (mgr.14592) 1362 : cluster 0 pgmap v1834: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-05-20T22:43:05.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:04 smithi050 bash[28929]: cluster 2024-05-20T22:43:03.549390+0000 mgr.y (mgr.14592) 1362 : cluster 0 pgmap v1834: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-05-20T22:43:07.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:06 smithi145 bash[23893]: cluster 2024-05-20T22:43:05.551295+0000 mgr.y (mgr.14592) 1363 : cluster 0 pgmap v1835: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 3.1 KiB/s wr, 1 op/s 2024-05-20T22:43:07.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:06 smithi050 bash[21866]: cluster 2024-05-20T22:43:05.551295+0000 mgr.y (mgr.14592) 1363 : cluster 0 pgmap v1835: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 3.1 KiB/s wr, 1 op/s 2024-05-20T22:43:07.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:06 smithi050 bash[28929]: cluster 2024-05-20T22:43:05.551295+0000 mgr.y (mgr.14592) 1363 : cluster 0 pgmap v1835: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 3.1 KiB/s wr, 1 op/s 2024-05-20T22:43:09.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:08 smithi145 bash[23893]: cluster 2024-05-20T22:43:07.552100+0000 mgr.y (mgr.14592) 1364 : cluster 0 pgmap v1836: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.7 KiB/s wr, 1 op/s 2024-05-20T22:43:09.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:08 smithi050 bash[21866]: cluster 2024-05-20T22:43:07.552100+0000 mgr.y (mgr.14592) 1364 : cluster 0 pgmap v1836: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.7 KiB/s wr, 1 op/s 2024-05-20T22:43:09.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:08 smithi050 bash[28929]: cluster 2024-05-20T22:43:07.552100+0000 mgr.y (mgr.14592) 1364 : cluster 0 pgmap v1836: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.7 KiB/s wr, 1 op/s 2024-05-20T22:43:09.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:43:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:43:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:43:09.885 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:43:09 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:43:11.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:10 smithi145 bash[23893]: audit 2024-05-20T22:43:09.494222+0000 mgr.y (mgr.14592) 1365 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:43:11.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:10 smithi145 bash[23893]: cluster 2024-05-20T22:43:09.552837+0000 mgr.y (mgr.14592) 1366 : cluster 0 pgmap v1837: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 2.4 KiB/s wr, 1 op/s 2024-05-20T22:43:11.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:10 smithi050 bash[21866]: audit 2024-05-20T22:43:09.494222+0000 mgr.y (mgr.14592) 1365 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:43:11.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:10 smithi050 bash[21866]: cluster 2024-05-20T22:43:09.552837+0000 mgr.y (mgr.14592) 1366 : cluster 0 pgmap v1837: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 2.4 KiB/s wr, 1 op/s 2024-05-20T22:43:11.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:10 smithi050 bash[28929]: audit 2024-05-20T22:43:09.494222+0000 mgr.y (mgr.14592) 1365 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:43:11.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:10 smithi050 bash[28929]: cluster 2024-05-20T22:43:09.552837+0000 mgr.y (mgr.14592) 1366 : cluster 0 pgmap v1837: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 2.4 KiB/s wr, 1 op/s 2024-05-20T22:43:13.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:12 smithi145 bash[23893]: cluster 2024-05-20T22:43:11.554866+0000 mgr.y (mgr.14592) 1367 : cluster 0 pgmap v1838: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:43:13.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:12 smithi145 bash[23893]: audit 2024-05-20T22:43:11.732162+0000 mon.a (mon.0) 3965 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:43:13.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:12 smithi145 bash[23893]: audit 2024-05-20T22:43:11.734422+0000 mon.a (mon.0) 3966 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:43:13.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:12 smithi050 bash[28929]: cluster 2024-05-20T22:43:11.554866+0000 mgr.y (mgr.14592) 1367 : cluster 0 pgmap v1838: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:43:13.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:12 smithi050 bash[28929]: audit 2024-05-20T22:43:11.732162+0000 mon.a (mon.0) 3965 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:43:13.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:12 smithi050 bash[28929]: audit 2024-05-20T22:43:11.734422+0000 mon.a (mon.0) 3966 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:43:13.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:12 smithi050 bash[21866]: cluster 2024-05-20T22:43:11.554866+0000 mgr.y (mgr.14592) 1367 : cluster 0 pgmap v1838: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:43:13.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:12 smithi050 bash[21866]: audit 2024-05-20T22:43:11.732162+0000 mon.a (mon.0) 3965 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:43:13.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:12 smithi050 bash[21866]: audit 2024-05-20T22:43:11.734422+0000 mon.a (mon.0) 3966 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:43:15.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:14 smithi145 bash[23893]: cluster 2024-05-20T22:43:13.555815+0000 mgr.y (mgr.14592) 1368 : cluster 0 pgmap v1839: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 856 B/s rd, 0 op/s 2024-05-20T22:43:15.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:14 smithi050 bash[21866]: cluster 2024-05-20T22:43:13.555815+0000 mgr.y (mgr.14592) 1368 : cluster 0 pgmap v1839: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 856 B/s rd, 0 op/s 2024-05-20T22:43:15.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:14 smithi050 bash[28929]: cluster 2024-05-20T22:43:13.555815+0000 mgr.y (mgr.14592) 1368 : cluster 0 pgmap v1839: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 856 B/s rd, 0 op/s 2024-05-20T22:43:17.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:16 smithi145 bash[23893]: cluster 2024-05-20T22:43:15.557728+0000 mgr.y (mgr.14592) 1369 : cluster 0 pgmap v1840: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:17.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:16 smithi050 bash[21866]: cluster 2024-05-20T22:43:15.557728+0000 mgr.y (mgr.14592) 1369 : cluster 0 pgmap v1840: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:17.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:16 smithi050 bash[28929]: cluster 2024-05-20T22:43:15.557728+0000 mgr.y (mgr.14592) 1369 : cluster 0 pgmap v1840: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:19.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:18 smithi145 bash[23893]: cluster 2024-05-20T22:43:17.558498+0000 mgr.y (mgr.14592) 1370 : cluster 0 pgmap v1841: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:19.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:18 smithi050 bash[21866]: cluster 2024-05-20T22:43:17.558498+0000 mgr.y (mgr.14592) 1370 : cluster 0 pgmap v1841: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:19.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:18 smithi050 bash[28929]: cluster 2024-05-20T22:43:17.558498+0000 mgr.y (mgr.14592) 1370 : cluster 0 pgmap v1841: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:19.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:43:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:43:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:43:19.885 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:43:19 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:43:21.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:20 smithi145 bash[23893]: audit 2024-05-20T22:43:19.505606+0000 mgr.y (mgr.14592) 1371 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:43:21.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:20 smithi145 bash[23893]: cluster 2024-05-20T22:43:19.559265+0000 mgr.y (mgr.14592) 1372 : cluster 0 pgmap v1842: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:21.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:20 smithi050 bash[21866]: audit 2024-05-20T22:43:19.505606+0000 mgr.y (mgr.14592) 1371 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:43:21.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:20 smithi050 bash[21866]: cluster 2024-05-20T22:43:19.559265+0000 mgr.y (mgr.14592) 1372 : cluster 0 pgmap v1842: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:21.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:20 smithi050 bash[28929]: audit 2024-05-20T22:43:19.505606+0000 mgr.y (mgr.14592) 1371 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:43:21.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:20 smithi050 bash[28929]: cluster 2024-05-20T22:43:19.559265+0000 mgr.y (mgr.14592) 1372 : cluster 0 pgmap v1842: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:23.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:22 smithi145 bash[23893]: cluster 2024-05-20T22:43:21.561194+0000 mgr.y (mgr.14592) 1373 : cluster 0 pgmap v1843: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:23.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:22 smithi050 bash[21866]: cluster 2024-05-20T22:43:21.561194+0000 mgr.y (mgr.14592) 1373 : cluster 0 pgmap v1843: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:23.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:22 smithi050 bash[28929]: cluster 2024-05-20T22:43:21.561194+0000 mgr.y (mgr.14592) 1373 : cluster 0 pgmap v1843: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:25.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:24 smithi145 bash[23893]: cluster 2024-05-20T22:43:23.561984+0000 mgr.y (mgr.14592) 1374 : cluster 0 pgmap v1844: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:25.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:24 smithi050 bash[21866]: cluster 2024-05-20T22:43:23.561984+0000 mgr.y (mgr.14592) 1374 : cluster 0 pgmap v1844: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:25.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:24 smithi050 bash[28929]: cluster 2024-05-20T22:43:23.561984+0000 mgr.y (mgr.14592) 1374 : cluster 0 pgmap v1844: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:27.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:26 smithi145 bash[23893]: cluster 2024-05-20T22:43:25.564187+0000 mgr.y (mgr.14592) 1375 : cluster 0 pgmap v1845: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:27.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:26 smithi050 bash[21866]: cluster 2024-05-20T22:43:25.564187+0000 mgr.y (mgr.14592) 1375 : cluster 0 pgmap v1845: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:27.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:26 smithi050 bash[28929]: cluster 2024-05-20T22:43:25.564187+0000 mgr.y (mgr.14592) 1375 : cluster 0 pgmap v1845: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:28.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:27 smithi145 bash[23893]: audit 2024-05-20T22:43:26.763978+0000 mon.a (mon.0) 3967 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:43:28.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:27 smithi050 bash[21866]: audit 2024-05-20T22:43:26.763978+0000 mon.a (mon.0) 3967 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:43:28.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:27 smithi050 bash[28929]: audit 2024-05-20T22:43:26.763978+0000 mon.a (mon.0) 3967 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:43:28.826 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=135664 2024-05-20T22:43:28.827 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph osd pool set-quota 1c2932ce-1479-493b-8174-2751cae2b39e max_bytes 0 2024-05-20T22:43:28.827 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 1c2932ce-1479-493b-8174-2751cae2b39e put two /etc/passwd 2024-05-20T22:43:28.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59c0ced640 1 -- 172.21.15.50:0/4006480534 >> v1:172.21.15.50:6789/0 conn(0x7f59bc10e130 legacy=0x7f59bc1105a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:28.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59c0ced640 1 -- 172.21.15.50:0/4006480534 shutdown_connections 2024-05-20T22:43:28.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59c0ced640 1 -- 172.21.15.50:0/4006480534 >> 172.21.15.50:0/4006480534 conn(0x7f59bc0fc040 msgr2=0x7f59bc0fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:43:28.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59c0ced640 1 -- 172.21.15.50:0/4006480534 shutdown_connections 2024-05-20T22:43:28.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59c0ced640 1 -- 172.21.15.50:0/4006480534 wait complete. 2024-05-20T22:43:28.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59c0ced640 1 Processor -- start 2024-05-20T22:43:28.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59c0ced640 1 -- start start 2024-05-20T22:43:28.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59c0ced640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f59bc1a6420 con 0x7f59bc10a620 2024-05-20T22:43:28.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59c0ced640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f59bc1a7640 con 0x7f59bc10e130 2024-05-20T22:43:28.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59c0ced640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f59bc1a8880 con 0x7f59bc102810 2024-05-20T22:43:28.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59b9d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f59bc10a620 0x7f59bc1a1510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60210/0 (socket says 172.21.15.50:60210) 2024-05-20T22:43:28.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59b9d9b640 1 -- 172.21.15.50:0/965380304 learned_addr learned my addr 172.21.15.50:0/965380304 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:43:28.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59ba59c640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7f59bc102810 0x7f59bc109bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:52420/0 (socket says 172.21.15.50:52420) 2024-05-20T22:43:28.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2768793699 0 0) 0x7f59bc1a6420 con 0x7f59bc10a620 2024-05-20T22:43:28.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59a8001ff0 con 0x7f59bc10a620 2024-05-20T22:43:28.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1597514475 0 0) 0x7f59bc1a8880 con 0x7f59bc102810 2024-05-20T22:43:28.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59bc1a6420 con 0x7f59bc102810 2024-05-20T22:43:28.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3364792411 0 0) 0x7f59a8001ff0 con 0x7f59bc10a620 2024-05-20T22:43:28.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59bc1a8880 con 0x7f59bc10a620 2024-05-20T22:43:28.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f59a4001920 con 0x7f59bc10a620 2024-05-20T22:43:28.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2409528411 0 0) 0x7f59bc1a7640 con 0x7f59bc10e130 2024-05-20T22:43:28.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59a8001ff0 con 0x7f59bc10e130 2024-05-20T22:43:28.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 509359051 0 0) 0x7f59bc1a6420 con 0x7f59bc102810 2024-05-20T22:43:28.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59bc1a7640 con 0x7f59bc102810 2024-05-20T22:43:28.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f59ac001a20 con 0x7f59bc102810 2024-05-20T22:43:28.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3783012813 0 0) 0x7f59bc1a8880 con 0x7f59bc10a620 2024-05-20T22:43:28.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 >> v1:172.21.15.50:6790/0 conn(0x7f59bc102810 legacy=0x7f59bc109bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:28.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 >> v1:172.21.15.145:6789/0 conn(0x7f59bc10e130 legacy=0x7f59bc1a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:28.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59bc1a9ac0 con 0x7f59bc10a620 2024-05-20T22:43:28.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59c0ced640 1 -- 172.21.15.50:0/965380304 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f59bc1a8ab0 con 0x7f59bc10a620 2024-05-20T22:43:28.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59c0ced640 1 -- 172.21.15.50:0/965380304 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f59bc1a8f70 con 0x7f59bc10a620 2024-05-20T22:43:28.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f59a4001d00 con 0x7f59bc10a620 2024-05-20T22:43:28.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f59a4005cd0 con 0x7f59bc10a620 2024-05-20T22:43:28.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.963+0000 7f59c0ced640 1 -- 172.21.15.50:0/965380304 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f599c005090 con 0x7f59bc10a620 2024-05-20T22:43:28.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.967+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f59a40038d0 con 0x7f59bc10a620 2024-05-20T22:43:28.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.967+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(829..829 src has 256..829) ==== 7748+0+0 (unknown 249655574 0 0) 0x7f59a4089af0 con 0x7f59bc10a620 2024-05-20T22:43:28.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.967+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=830}) -- 0x7f59bc1a8880 con 0x7f59bc10a620 2024-05-20T22:43:28.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:28.971+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f59a4056c80 con 0x7f59bc10a620 2024-05-20T22:43:29.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:28 smithi145 bash[23893]: cluster 2024-05-20T22:43:27.564955+0000 mgr.y (mgr.14592) 1376 : cluster 0 pgmap v1846: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:29.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:29.143+0000 7f59c0ced640 1 -- 172.21.15.50:0/965380304 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"} v 0) -- 0x7f599c005380 con 0x7f59bc10a620 2024-05-20T22:43:29.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:28 smithi050 bash[21866]: cluster 2024-05-20T22:43:27.564955+0000 mgr.y (mgr.14592) 1376 : cluster 0 pgmap v1846: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:29.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:28 smithi050 bash[28929]: cluster 2024-05-20T22:43:27.564955+0000 mgr.y (mgr.14592) 1376 : cluster 0 pgmap v1846: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:29.690 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:43:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:43:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:43:29.761 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:43:29 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:43:29.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:29.775+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 1c2932ce-1479-493b-8174-2751cae2b39e v830) ==== 217+0+0 (unknown 408906855 0 0) 0x7f59a405a930 con 0x7f59bc10a620 2024-05-20T22:43:29.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:29.775+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 <== mon.0 v1:172.21.15.50:6789/0 11 ==== osd_map(830..830 src has 256..830) ==== 628+0+0 (unknown 3580896130 0 0) 0x7f59a4087930 con 0x7f59bc10a620 2024-05-20T22:43:29.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:29.775+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=831}) -- 0x7f59bc1a6420 con 0x7f59bc10a620 2024-05-20T22:43:29.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:29.887+0000 7f59c0ced640 1 -- 172.21.15.50:0/965380304 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"} v 0) -- 0x7f599c000c50 con 0x7f59bc10a620 2024-05-20T22:43:30.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:29 smithi145 bash[23893]: audit 2024-05-20T22:43:29.146355+0000 mon.a (mon.0) 3968 : audit 1 from='client.? v1:172.21.15.50:0/965380304' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]: dispatch 2024-05-20T22:43:30.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:29 smithi050 bash[21866]: audit 2024-05-20T22:43:29.146355+0000 mon.a (mon.0) 3968 : audit 1 from='client.? v1:172.21.15.50:0/965380304' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]: dispatch 2024-05-20T22:43:30.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:29 smithi050 bash[28929]: audit 2024-05-20T22:43:29.146355+0000 mon.a (mon.0) 3968 : audit 1 from='client.? v1:172.21.15.50:0/965380304' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]: dispatch 2024-05-20T22:43:30.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.787+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 <== mon.0 v1:172.21.15.50:6789/0 12 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 1c2932ce-1479-493b-8174-2751cae2b39e v831) ==== 217+0+0 (unknown 3372507561 0 0) 0x7f59a405f1f0 con 0x7f59bc10a620 2024-05-20T22:43:30.872 INFO:tasks.workunit.client.0.smithi050.stderr:set-quota max_bytes = 0 for pool 1c2932ce-1479-493b-8174-2751cae2b39e 2024-05-20T22:43:30.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.787+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 <== mon.0 v1:172.21.15.50:6789/0 13 ==== osd_map(831..831 src has 256..831) ==== 628+0+0 (unknown 3807260803 0 0) 0x7f59a40043d0 con 0x7f59bc10a620 2024-05-20T22:43:30.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.787+0000 7f59b37fe640 1 -- 172.21.15.50:0/965380304 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=832}) -- 0x7f59a807bf50 con 0x7f59bc10a620 2024-05-20T22:43:30.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.791+0000 7f59c0ced640 1 -- 172.21.15.50:0/965380304 >> v1:172.21.15.50:6800/3332714287 conn(0x7f59a806ef60 legacy=0x7f59a8071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:30.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.791+0000 7f59c0ced640 1 -- 172.21.15.50:0/965380304 >> v1:172.21.15.50:6789/0 conn(0x7f59bc10a620 legacy=0x7f59bc1a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:30.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.791+0000 7f59c0ced640 1 -- 172.21.15.50:0/965380304 shutdown_connections 2024-05-20T22:43:30.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.791+0000 7f59c0ced640 1 -- 172.21.15.50:0/965380304 >> 172.21.15.50:0/965380304 conn(0x7f59bc0fc040 msgr2=0x7f59bc110560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:43:30.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.791+0000 7f59c0ced640 1 -- 172.21.15.50:0/965380304 shutdown_connections 2024-05-20T22:43:30.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.791+0000 7f59c0ced640 1 -- 172.21.15.50:0/965380304 wait complete. 2024-05-20T22:43:30.874 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph osd pool set-quota 1c2932ce-1479-493b-8174-2751cae2b39e max_objects 0 2024-05-20T22:43:30.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48d34de640 1 -- 172.21.15.50:0/3109306706 >> v1:172.21.15.50:6789/0 conn(0x7f48cc10a620 legacy=0x7f48cc10ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:30.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48d34de640 1 -- 172.21.15.50:0/3109306706 shutdown_connections 2024-05-20T22:43:30.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48d34de640 1 -- 172.21.15.50:0/3109306706 >> 172.21.15.50:0/3109306706 conn(0x7f48cc0fc020 msgr2=0x7f48cc0fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:43:30.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48d34de640 1 -- 172.21.15.50:0/3109306706 shutdown_connections 2024-05-20T22:43:30.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48d34de640 1 -- 172.21.15.50:0/3109306706 wait complete. 2024-05-20T22:43:30.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48d34de640 1 Processor -- start 2024-05-20T22:43:30.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48d34de640 1 -- start start 2024-05-20T22:43:30.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48d34de640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f48cc1a6670 con 0x7f48cc10a620 2024-05-20T22:43:30.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48d34de640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f48cc1a7870 con 0x7f48cc10e130 2024-05-20T22:43:30.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48d34de640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f48cc1a8ab0 con 0x7f48cc102810 2024-05-20T22:43:30.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48d0a79640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f48cc10a620 0x7f48cc1a1510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60222/0 (socket says 172.21.15.50:60222) 2024-05-20T22:43:30.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48d127a640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7f48cc102810 0x7f48cc109df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:52444/0 (socket says 172.21.15.50:52444) 2024-05-20T22:43:30.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48d0a79640 1 -- 172.21.15.50:0/3780889657 learned_addr learned my addr 172.21.15.50:0/3780889657 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:43:30.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3896153347 0 0) 0x7f48cc1a6670 con 0x7f48cc10a620 2024-05-20T22:43:30.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48b8001ff0 con 0x7f48cc10a620 2024-05-20T22:43:30.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2432253868 0 0) 0x7f48cc1a8ab0 con 0x7f48cc102810 2024-05-20T22:43:30.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48cc1a6670 con 0x7f48cc102810 2024-05-20T22:43:30.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3463967605 0 0) 0x7f48b8001ff0 con 0x7f48cc10a620 2024-05-20T22:43:30.929 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48cc1a8ab0 con 0x7f48cc10a620 2024-05-20T22:43:30.929 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f48bc004550 con 0x7f48cc10a620 2024-05-20T22:43:30.929 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1996070210 0 0) 0x7f48cc1a6670 con 0x7f48cc102810 2024-05-20T22:43:30.929 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48b8001ff0 con 0x7f48cc102810 2024-05-20T22:43:30.929 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1681012115 0 0) 0x7f48cc1a7870 con 0x7f48cc10e130 2024-05-20T22:43:30.929 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48cc1a6670 con 0x7f48cc10e130 2024-05-20T22:43:30.929 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f48c8001840 con 0x7f48cc102810 2024-05-20T22:43:30.929 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3057069794 0 0) 0x7f48cc1a8ab0 con 0x7f48cc10a620 2024-05-20T22:43:30.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 >> v1:172.21.15.50:6790/0 conn(0x7f48cc102810 legacy=0x7f48cc109df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:30.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 >> v1:172.21.15.145:6789/0 conn(0x7f48cc10e130 legacy=0x7f48cc1a4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:30.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48cc1a9cf0 con 0x7f48cc10a620 2024-05-20T22:43:30.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48d34de640 1 -- 172.21.15.50:0/3780889657 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f48cc1a8ce0 con 0x7f48cc10a620 2024-05-20T22:43:30.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48d34de640 1 -- 172.21.15.50:0/3780889657 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f48cc1a91a0 con 0x7f48cc10a620 2024-05-20T22:43:30.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f48bc001ac0 con 0x7f48cc10a620 2024-05-20T22:43:30.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f48bc004cc0 con 0x7f48cc10a620 2024-05-20T22:43:30.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.931+0000 7f48d34de640 1 -- 172.21.15.50:0/3780889657 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48b0005090 con 0x7f48cc10a620 2024-05-20T22:43:30.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.935+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f48bc003770 con 0x7f48cc10a620 2024-05-20T22:43:30.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.935+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(831..831 src has 256..831) ==== 7748+0+0 (unknown 2615850239 0 0) 0x7f48bc089b40 con 0x7f48cc10a620 2024-05-20T22:43:30.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.935+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=832}) -- 0x7f48cc1a8ab0 con 0x7f48cc10a620 2024-05-20T22:43:30.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:30.939+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f48bc056cd0 con 0x7f48cc10a620 2024-05-20T22:43:31.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:31.111+0000 7f48d34de640 1 -- 172.21.15.50:0/3780889657 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"} v 0) -- 0x7f48b0005380 con 0x7f48cc10a620 2024-05-20T22:43:31.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:30 smithi145 bash[23893]: audit 2024-05-20T22:43:29.516972+0000 mgr.y (mgr.14592) 1377 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:43:31.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:30 smithi145 bash[23893]: cluster 2024-05-20T22:43:29.565741+0000 mgr.y (mgr.14592) 1378 : cluster 0 pgmap v1847: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:31.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:30 smithi145 bash[23893]: audit 2024-05-20T22:43:29.777998+0000 mon.a (mon.0) 3969 : audit 1 from='client.? v1:172.21.15.50:0/965380304' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]': finished 2024-05-20T22:43:31.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:30 smithi145 bash[23893]: cluster 2024-05-20T22:43:29.786266+0000 mon.a (mon.0) 3970 : cluster 0 osdmap e830: 8 total, 8 up, 8 in 2024-05-20T22:43:31.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:30 smithi145 bash[23893]: audit 2024-05-20T22:43:29.891781+0000 mon.a (mon.0) 3971 : audit 1 from='client.? v1:172.21.15.50:0/965380304' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]: dispatch 2024-05-20T22:43:31.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:30 smithi050 bash[21866]: audit 2024-05-20T22:43:29.516972+0000 mgr.y (mgr.14592) 1377 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:43:31.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:30 smithi050 bash[21866]: cluster 2024-05-20T22:43:29.565741+0000 mgr.y (mgr.14592) 1378 : cluster 0 pgmap v1847: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:31.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:30 smithi050 bash[21866]: audit 2024-05-20T22:43:29.777998+0000 mon.a (mon.0) 3969 : audit 1 from='client.? v1:172.21.15.50:0/965380304' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]': finished 2024-05-20T22:43:31.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:30 smithi050 bash[21866]: cluster 2024-05-20T22:43:29.786266+0000 mon.a (mon.0) 3970 : cluster 0 osdmap e830: 8 total, 8 up, 8 in 2024-05-20T22:43:31.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:30 smithi050 bash[21866]: audit 2024-05-20T22:43:29.891781+0000 mon.a (mon.0) 3971 : audit 1 from='client.? v1:172.21.15.50:0/965380304' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]: dispatch 2024-05-20T22:43:31.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:30 smithi050 bash[28929]: audit 2024-05-20T22:43:29.516972+0000 mgr.y (mgr.14592) 1377 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:43:31.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:30 smithi050 bash[28929]: cluster 2024-05-20T22:43:29.565741+0000 mgr.y (mgr.14592) 1378 : cluster 0 pgmap v1847: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:31.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:30 smithi050 bash[28929]: audit 2024-05-20T22:43:29.777998+0000 mon.a (mon.0) 3969 : audit 1 from='client.? v1:172.21.15.50:0/965380304' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]': finished 2024-05-20T22:43:31.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:30 smithi050 bash[28929]: cluster 2024-05-20T22:43:29.786266+0000 mon.a (mon.0) 3970 : cluster 0 osdmap e830: 8 total, 8 up, 8 in 2024-05-20T22:43:31.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:30 smithi050 bash[28929]: audit 2024-05-20T22:43:29.891781+0000 mon.a (mon.0) 3971 : audit 1 from='client.? v1:172.21.15.50:0/965380304' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]: dispatch 2024-05-20T22:43:31.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:31.607+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 1c2932ce-1479-493b-8174-2751cae2b39e v832) ==== 221+0+0 (unknown 2798121122 0 0) 0x7f48bc05a980 con 0x7f48cc10a620 2024-05-20T22:43:31.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:31.607+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 <== mon.0 v1:172.21.15.50:6789/0 11 ==== osd_map(832..832 src has 256..832) ==== 628+0+0 (unknown 271168324 0 0) 0x7f48bc087980 con 0x7f48cc10a620 2024-05-20T22:43:31.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:31.607+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=833}) -- 0x7f48cc1a7870 con 0x7f48cc10a620 2024-05-20T22:43:31.711 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:31.719+0000 7f48d34de640 1 -- 172.21.15.50:0/3780889657 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"} v 0) -- 0x7f48b0000c50 con 0x7f48cc10a620 2024-05-20T22:43:32.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:31 smithi145 bash[23893]: audit 2024-05-20T22:43:30.788553+0000 mon.a (mon.0) 3972 : audit 1 from='client.? v1:172.21.15.50:0/965380304' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]': finished 2024-05-20T22:43:32.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:31 smithi145 bash[23893]: cluster 2024-05-20T22:43:30.793320+0000 mon.a (mon.0) 3973 : cluster 0 osdmap e831: 8 total, 8 up, 8 in 2024-05-20T22:43:32.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:31 smithi145 bash[23893]: audit 2024-05-20T22:43:31.115468+0000 mon.a (mon.0) 3974 : audit 1 from='client.? v1:172.21.15.50:0/3780889657' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]: dispatch 2024-05-20T22:43:32.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:31 smithi145 bash[23893]: cluster 2024-05-20T22:43:31.604725+0000 mon.a (mon.0) 3975 : cluster 1 pool '1c2932ce-1479-493b-8174-2751cae2b39e' no longer out of quota; removing NO_QUOTA flag 2024-05-20T22:43:32.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:31 smithi145 bash[23893]: cluster 2024-05-20T22:43:31.605171+0000 mon.a (mon.0) 3976 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-05-20T22:43:32.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:31 smithi145 bash[23893]: audit 2024-05-20T22:43:31.607609+0000 mon.a (mon.0) 3977 : audit 1 from='client.? v1:172.21.15.50:0/3780889657' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]': finished 2024-05-20T22:43:32.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:31 smithi145 bash[23893]: cluster 2024-05-20T22:43:31.617701+0000 mon.a (mon.0) 3978 : cluster 0 osdmap e832: 8 total, 8 up, 8 in 2024-05-20T22:43:32.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:31 smithi145 bash[23893]: audit 2024-05-20T22:43:31.721819+0000 mon.a (mon.0) 3979 : audit 1 from='client.? v1:172.21.15.50:0/3780889657' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]: dispatch 2024-05-20T22:43:32.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:31 smithi050 bash[21866]: audit 2024-05-20T22:43:30.788553+0000 mon.a (mon.0) 3972 : audit 1 from='client.? v1:172.21.15.50:0/965380304' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]': finished 2024-05-20T22:43:32.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:31 smithi050 bash[21866]: cluster 2024-05-20T22:43:30.793320+0000 mon.a (mon.0) 3973 : cluster 0 osdmap e831: 8 total, 8 up, 8 in 2024-05-20T22:43:32.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:31 smithi050 bash[21866]: audit 2024-05-20T22:43:31.115468+0000 mon.a (mon.0) 3974 : audit 1 from='client.? v1:172.21.15.50:0/3780889657' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]: dispatch 2024-05-20T22:43:32.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:31 smithi050 bash[21866]: cluster 2024-05-20T22:43:31.604725+0000 mon.a (mon.0) 3975 : cluster 1 pool '1c2932ce-1479-493b-8174-2751cae2b39e' no longer out of quota; removing NO_QUOTA flag 2024-05-20T22:43:32.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:31 smithi050 bash[21866]: cluster 2024-05-20T22:43:31.605171+0000 mon.a (mon.0) 3976 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-05-20T22:43:32.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:31 smithi050 bash[21866]: audit 2024-05-20T22:43:31.607609+0000 mon.a (mon.0) 3977 : audit 1 from='client.? v1:172.21.15.50:0/3780889657' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]': finished 2024-05-20T22:43:32.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:31 smithi050 bash[21866]: cluster 2024-05-20T22:43:31.617701+0000 mon.a (mon.0) 3978 : cluster 0 osdmap e832: 8 total, 8 up, 8 in 2024-05-20T22:43:32.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:31 smithi050 bash[21866]: audit 2024-05-20T22:43:31.721819+0000 mon.a (mon.0) 3979 : audit 1 from='client.? v1:172.21.15.50:0/3780889657' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]: dispatch 2024-05-20T22:43:32.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:31 smithi050 bash[28929]: audit 2024-05-20T22:43:30.788553+0000 mon.a (mon.0) 3972 : audit 1 from='client.? v1:172.21.15.50:0/965380304' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]': finished 2024-05-20T22:43:32.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:31 smithi050 bash[28929]: cluster 2024-05-20T22:43:30.793320+0000 mon.a (mon.0) 3973 : cluster 0 osdmap e831: 8 total, 8 up, 8 in 2024-05-20T22:43:32.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:31 smithi050 bash[28929]: audit 2024-05-20T22:43:31.115468+0000 mon.a (mon.0) 3974 : audit 1 from='client.? v1:172.21.15.50:0/3780889657' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]: dispatch 2024-05-20T22:43:32.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:31 smithi050 bash[28929]: cluster 2024-05-20T22:43:31.604725+0000 mon.a (mon.0) 3975 : cluster 1 pool '1c2932ce-1479-493b-8174-2751cae2b39e' no longer out of quota; removing NO_QUOTA flag 2024-05-20T22:43:32.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:31 smithi050 bash[28929]: cluster 2024-05-20T22:43:31.605171+0000 mon.a (mon.0) 3976 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-05-20T22:43:32.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:31 smithi050 bash[28929]: audit 2024-05-20T22:43:31.607609+0000 mon.a (mon.0) 3977 : audit 1 from='client.? v1:172.21.15.50:0/3780889657' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]': finished 2024-05-20T22:43:32.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:31 smithi050 bash[28929]: cluster 2024-05-20T22:43:31.617701+0000 mon.a (mon.0) 3978 : cluster 0 osdmap e832: 8 total, 8 up, 8 in 2024-05-20T22:43:32.192 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:31 smithi050 bash[28929]: audit 2024-05-20T22:43:31.721819+0000 mon.a (mon.0) 3979 : audit 1 from='client.? v1:172.21.15.50:0/3780889657' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]: dispatch 2024-05-20T22:43:32.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.607+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 <== mon.0 v1:172.21.15.50:6789/0 12 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 1c2932ce-1479-493b-8174-2751cae2b39e v833) ==== 221+0+0 (unknown 647438659 0 0) 0x7f48bc05f240 con 0x7f48cc10a620 2024-05-20T22:43:32.600 INFO:tasks.workunit.client.0.smithi050.stderr:set-quota max_objects = 0 for pool 1c2932ce-1479-493b-8174-2751cae2b39e 2024-05-20T22:43:32.601 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.607+0000 7f48c27fc640 1 -- 172.21.15.50:0/3780889657 <== mon.0 v1:172.21.15.50:6789/0 13 ==== osd_map(833..833 src has 256..833) ==== 628+0+0 (unknown 4274537651 0 0) 0x7f48bc052610 con 0x7f48cc10a620 2024-05-20T22:43:32.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.611+0000 7f48d34de640 1 -- 172.21.15.50:0/3780889657 >> v1:172.21.15.50:6800/3332714287 conn(0x7f48b806eff0 legacy=0x7f48b80714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:32.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.611+0000 7f48d34de640 1 -- 172.21.15.50:0/3780889657 >> v1:172.21.15.50:6789/0 conn(0x7f48cc10a620 legacy=0x7f48cc1a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:32.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.611+0000 7f48d34de640 1 -- 172.21.15.50:0/3780889657 shutdown_connections 2024-05-20T22:43:32.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.611+0000 7f48d34de640 1 -- 172.21.15.50:0/3780889657 >> 172.21.15.50:0/3780889657 conn(0x7f48cc0fc020 msgr2=0x7f48cc110560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:43:32.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.611+0000 7f48d34de640 1 -- 172.21.15.50:0/3780889657 shutdown_connections 2024-05-20T22:43:32.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.611+0000 7f48d34de640 1 -- 172.21.15.50:0/3780889657 wait complete. 2024-05-20T22:43:32.628 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 135664 2024-05-20T22:43:32.628 INFO:tasks.workunit.client.0.smithi050.stderr:+ [ 0 -ne 0 ] 2024-05-20T22:43:32.628 INFO:tasks.workunit.client.0.smithi050.stderr:+ true 2024-05-20T22:43:32.628 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 1c2932ce-1479-493b-8174-2751cae2b39e put three /etc/passwd 2024-05-20T22:43:32.669 INFO:tasks.workunit.client.0.smithi050.stderr:+ uuidgen 2024-05-20T22:43:32.670 INFO:tasks.workunit.client.0.smithi050.stderr:+ pp=6ad12e91-8c60-495a-811b-e1be6780ecc0 2024-05-20T22:43:32.670 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph osd pool create 6ad12e91-8c60-495a-811b-e1be6780ecc0 12 2024-05-20T22:43:32.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.799+0000 7f2dfa4fe640 1 -- 172.21.15.50:0/3919368787 >> v1:172.21.15.50:6790/0 conn(0x7f2df410cfe0 legacy=0x7f2df410f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:32.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.799+0000 7f2dfa4fe640 1 -- 172.21.15.50:0/3919368787 shutdown_connections 2024-05-20T22:43:32.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.799+0000 7f2dfa4fe640 1 -- 172.21.15.50:0/3919368787 >> 172.21.15.50:0/3919368787 conn(0x7f2df4077270 msgr2=0x7f2df40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:43:32.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.799+0000 7f2dfa4fe640 1 -- 172.21.15.50:0/3919368787 shutdown_connections 2024-05-20T22:43:32.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.799+0000 7f2dfa4fe640 1 -- 172.21.15.50:0/3919368787 wait complete. 2024-05-20T22:43:32.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2dfa4fe640 1 Processor -- start 2024-05-20T22:43:32.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2dfa4fe640 1 -- start start 2024-05-20T22:43:32.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2dfa4fe640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f2df41a66f0 con 0x7f2df410cfe0 2024-05-20T22:43:32.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2dfa4fe640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f2df41a7930 con 0x7f2df41093e0 2024-05-20T22:43:32.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2dfa4fe640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f2df41a8b70 con 0x7f2df4106630 2024-05-20T22:43:32.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df3fff640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7f2df4106630 0x7f2df41059f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:52472/0 (socket says 172.21.15.50:52472) 2024-05-20T22:43:32.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df3fff640 1 -- 172.21.15.50:0/1649722129 learned_addr learned my addr 172.21.15.50:0/1649722129 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:43:32.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3747941273 0 0) 0x7f2df41a66f0 con 0x7f2df410cfe0 2024-05-20T22:43:32.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ddc003170 con 0x7f2df410cfe0 2024-05-20T22:43:32.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 574418178 0 0) 0x7f2df41a8b70 con 0x7f2df4106630 2024-05-20T22:43:32.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2df41a66f0 con 0x7f2df4106630 2024-05-20T22:43:32.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3961572146 0 0) 0x7f2ddc003170 con 0x7f2df410cfe0 2024-05-20T22:43:32.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2df41a8b70 con 0x7f2df410cfe0 2024-05-20T22:43:32.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2807515241 0 0) 0x7f2df41a66f0 con 0x7f2df4106630 2024-05-20T22:43:32.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ddc003170 con 0x7f2df4106630 2024-05-20T22:43:32.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f2dec001bf0 con 0x7f2df410cfe0 2024-05-20T22:43:32.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f2de4001240 con 0x7f2df4106630 2024-05-20T22:43:32.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4130367855 0 0) 0x7f2df41a7930 con 0x7f2df41093e0 2024-05-20T22:43:32.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2df41a66f0 con 0x7f2df41093e0 2024-05-20T22:43:32.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3650830063 0 0) 0x7f2df41a8b70 con 0x7f2df410cfe0 2024-05-20T22:43:32.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 >> v1:172.21.15.50:6790/0 conn(0x7f2df4106630 legacy=0x7f2df41059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:32.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 >> v1:172.21.15.145:6789/0 conn(0x7f2df41093e0 legacy=0x7f2df41a1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:32.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df41a9db0 con 0x7f2df410cfe0 2024-05-20T22:43:32.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2dfa4fe640 1 -- 172.21.15.50:0/1649722129 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2df41a8d40 con 0x7f2df410cfe0 2024-05-20T22:43:32.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2dfa4fe640 1 -- 172.21.15.50:0/1649722129 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2df41a9200 con 0x7f2df410cfe0 2024-05-20T22:43:32.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f2dec0049d0 con 0x7f2df410cfe0 2024-05-20T22:43:32.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f2dec005070 con 0x7f2df410cfe0 2024-05-20T22:43:32.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2dfa4fe640 1 -- 172.21.15.50:0/1649722129 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de0005090 con 0x7f2df410cfe0 2024-05-20T22:43:32.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f2dec003ce0 con 0x7f2df410cfe0 2024-05-20T22:43:32.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.803+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(833..833 src has 256..833) ==== 7748+0+0 (unknown 1331045060 0 0) 0x7f2dec088f20 con 0x7f2df410cfe0 2024-05-20T22:43:32.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.811+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f2dec056050 con 0x7f2df410cfe0 2024-05-20T22:43:32.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:32.983+0000 7f2dfa4fe640 1 -- 172.21.15.50:0/1649722129 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "pg_num": 12} v 0) -- 0x7f2de0005380 con 0x7f2df410cfe0 2024-05-20T22:43:33.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:32 smithi145 bash[23893]: cluster 2024-05-20T22:43:31.566472+0000 mgr.y (mgr.14592) 1379 : cluster 0 pgmap v1850: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:33.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:32 smithi145 bash[23893]: audit 2024-05-20T22:43:32.610052+0000 mon.a (mon.0) 3980 : audit 1 from='client.? v1:172.21.15.50:0/3780889657' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]': finished 2024-05-20T22:43:33.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:32 smithi145 bash[23893]: cluster 2024-05-20T22:43:32.618433+0000 mon.a (mon.0) 3981 : cluster 0 osdmap e833: 8 total, 8 up, 8 in 2024-05-20T22:43:33.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:32 smithi050 bash[21866]: cluster 2024-05-20T22:43:31.566472+0000 mgr.y (mgr.14592) 1379 : cluster 0 pgmap v1850: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:33.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:32 smithi050 bash[21866]: audit 2024-05-20T22:43:32.610052+0000 mon.a (mon.0) 3980 : audit 1 from='client.? v1:172.21.15.50:0/3780889657' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]': finished 2024-05-20T22:43:33.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:32 smithi050 bash[21866]: cluster 2024-05-20T22:43:32.618433+0000 mon.a (mon.0) 3981 : cluster 0 osdmap e833: 8 total, 8 up, 8 in 2024-05-20T22:43:33.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:32 smithi050 bash[28929]: cluster 2024-05-20T22:43:31.566472+0000 mgr.y (mgr.14592) 1379 : cluster 0 pgmap v1850: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:33.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:32 smithi050 bash[28929]: audit 2024-05-20T22:43:32.610052+0000 mon.a (mon.0) 3980 : audit 1 from='client.? v1:172.21.15.50:0/3780889657' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]': finished 2024-05-20T22:43:33.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:32 smithi050 bash[28929]: cluster 2024-05-20T22:43:32.618433+0000 mon.a (mon.0) 3981 : cluster 0 osdmap e833: 8 total, 8 up, 8 in 2024-05-20T22:43:33.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:33.807+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "pg_num": 12}]=0 pool '6ad12e91-8c60-495a-811b-e1be6780ecc0' created v834) ==== 176+0+0 (unknown 102770981 0 0) 0x7f2dec059d00 con 0x7f2df410cfe0 2024-05-20T22:43:33.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:33.923+0000 7f2dfa4fe640 1 -- 172.21.15.50:0/1649722129 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "pg_num": 12} v 0) -- 0x7f2de0001180 con 0x7f2df410cfe0 2024-05-20T22:43:33.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:33.923+0000 7f2df17fa640 1 -- 172.21.15.50:0/1649722129 <== mon.0 v1:172.21.15.50:6789/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "pg_num": 12}]=0 pool '6ad12e91-8c60-495a-811b-e1be6780ecc0' already exists v834) ==== 183+0+0 (unknown 1237559589 0 0) 0x7f2de0001180 con 0x7f2df410cfe0 2024-05-20T22:43:33.917 INFO:tasks.workunit.client.0.smithi050.stderr:pool '6ad12e91-8c60-495a-811b-e1be6780ecc0' already exists 2024-05-20T22:43:33.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:33.927+0000 7f2dfa4fe640 1 -- 172.21.15.50:0/1649722129 >> v1:172.21.15.50:6800/3332714287 conn(0x7f2ddc06eed0 legacy=0x7f2ddc071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:33.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:33.927+0000 7f2dfa4fe640 1 -- 172.21.15.50:0/1649722129 >> v1:172.21.15.50:6789/0 conn(0x7f2df410cfe0 legacy=0x7f2df41a4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:33.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:33.927+0000 7f2dfa4fe640 1 -- 172.21.15.50:0/1649722129 shutdown_connections 2024-05-20T22:43:33.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:33.927+0000 7f2dfa4fe640 1 -- 172.21.15.50:0/1649722129 >> 172.21.15.50:0/1649722129 conn(0x7f2df4077270 msgr2=0x7f2df40691d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:43:33.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:33.927+0000 7f2dfa4fe640 1 -- 172.21.15.50:0/1649722129 shutdown_connections 2024-05-20T22:43:33.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:33.927+0000 7f2dfa4fe640 1 -- 172.21.15.50:0/1649722129 wait complete. 2024-05-20T22:43:33.935 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph osd pool application enable 6ad12e91-8c60-495a-811b-e1be6780ecc0 rados 2024-05-20T22:43:34.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89e09ac640 1 -- 172.21.15.50:0/1428664452 >> v1:172.21.15.50:6790/0 conn(0x7f89dc1065d0 legacy=0x7f89dc1069b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:34.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89e09ac640 1 -- 172.21.15.50:0/1428664452 shutdown_connections 2024-05-20T22:43:34.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89e09ac640 1 -- 172.21.15.50:0/1428664452 >> 172.21.15.50:0/1428664452 conn(0x7f89dc075870 msgr2=0x7f89dc075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:43:34.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89e09ac640 1 -- 172.21.15.50:0/1428664452 shutdown_connections 2024-05-20T22:43:34.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89e09ac640 1 -- 172.21.15.50:0/1428664452 wait complete. 2024-05-20T22:43:34.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89e09ac640 1 Processor -- start 2024-05-20T22:43:34.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89e09ac640 1 -- start start 2024-05-20T22:43:34.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89e09ac640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f89dc1a65b0 con 0x7f89dc1065d0 2024-05-20T22:43:34.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89e09ac640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f89dc1a77f0 con 0x7f89dc10cf90 2024-05-20T22:43:34.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89e09ac640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f89dc1a8a30 con 0x7f89dc1093f0 2024-05-20T22:43:34.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89d9d9b640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7f89dc1093f0 0x7f89dc1a1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:52488/0 (socket says 172.21.15.50:52488) 2024-05-20T22:43:34.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89d9d9b640 1 -- 172.21.15.50:0/4194761985 learned_addr learned my addr 172.21.15.50:0/4194761985 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:43:34.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 361313149 0 0) 0x7f89dc1a8a30 con 0x7f89dc1093f0 2024-05-20T22:43:34.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89c4003530 con 0x7f89dc1093f0 2024-05-20T22:43:34.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2979691653 0 0) 0x7f89dc1a65b0 con 0x7f89dc1065d0 2024-05-20T22:43:34.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89dc1a8a30 con 0x7f89dc1065d0 2024-05-20T22:43:34.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1875558501 0 0) 0x7f89c4003530 con 0x7f89dc1093f0 2024-05-20T22:43:34.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89dc1a65b0 con 0x7f89dc1093f0 2024-05-20T22:43:34.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f89d0001a40 con 0x7f89dc1093f0 2024-05-20T22:43:34.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3759456350 0 0) 0x7f89dc1a77f0 con 0x7f89dc10cf90 2024-05-20T22:43:34.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89c4003530 con 0x7f89dc10cf90 2024-05-20T22:43:34.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2888307537 0 0) 0x7f89dc1a8a30 con 0x7f89dc1065d0 2024-05-20T22:43:34.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89dc1a77f0 con 0x7f89dc1065d0 2024-05-20T22:43:34.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f89cc004380 con 0x7f89dc1065d0 2024-05-20T22:43:34.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4015328013 0 0) 0x7f89dc1a65b0 con 0x7f89dc1093f0 2024-05-20T22:43:34.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 >> v1:172.21.15.145:6789/0 conn(0x7f89dc10cf90 legacy=0x7f89dc1a4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:34.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 >> v1:172.21.15.50:6789/0 conn(0x7f89dc1065d0 legacy=0x7f89dc100700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:34.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89dc1a9c70 con 0x7f89dc1093f0 2024-05-20T22:43:34.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.067+0000 7f89e09ac640 1 -- 172.21.15.50:0/4194761985 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f89dc1a67e0 con 0x7f89dc1093f0 2024-05-20T22:43:34.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.071+0000 7f89e09ac640 1 -- 172.21.15.50:0/4194761985 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f89dc1a6ca0 con 0x7f89dc1093f0 2024-05-20T22:43:34.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.071+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f89d0001ca0 con 0x7f89dc1093f0 2024-05-20T22:43:34.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.071+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f89d0005c60 con 0x7f89dc1093f0 2024-05-20T22:43:34.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.071+0000 7f89e09ac640 1 -- 172.21.15.50:0/4194761985 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89bc005090 con 0x7f89dc1093f0 2024-05-20T22:43:34.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.071+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f89d001c6e0 con 0x7f89dc1093f0 2024-05-20T22:43:34.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.071+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(834..834 src has 256..834) ==== 8123+0+0 (unknown 1157942510 0 0) 0x7f89d0089e50 con 0x7f89dc1093f0 2024-05-20T22:43:34.068 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.075+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f89d0056e70 con 0x7f89dc1093f0 2024-05-20T22:43:34.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:33 smithi145 bash[23893]: audit 2024-05-20T22:43:32.987620+0000 mon.a (mon.0) 3982 : audit 1 from='client.? v1:172.21.15.50:0/1649722129' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "pg_num": 12}]: dispatch 2024-05-20T22:43:34.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:33 smithi050 bash[21866]: audit 2024-05-20T22:43:32.987620+0000 mon.a (mon.0) 3982 : audit 1 from='client.? v1:172.21.15.50:0/1649722129' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "pg_num": 12}]: dispatch 2024-05-20T22:43:34.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:33 smithi050 bash[28929]: audit 2024-05-20T22:43:32.987620+0000 mon.a (mon.0) 3982 : audit 1 from='client.? v1:172.21.15.50:0/1649722129' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "pg_num": 12}]: dispatch 2024-05-20T22:43:34.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.251+0000 7f89e09ac640 1 -- 172.21.15.50:0/4194761985 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"} v 0) -- 0x7f89bc005380 con 0x7f89dc1093f0 2024-05-20T22:43:34.820 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.827+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 <== mon.2 v1:172.21.15.50:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"}]=0 enabled application 'rados' on pool '6ad12e91-8c60-495a-811b-e1be6780ecc0' v835) ==== 213+0+0 (unknown 3665431574 0 0) 0x7f89d005ab20 con 0x7f89dc1093f0 2024-05-20T22:43:34.942 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:34.951+0000 7f89e09ac640 1 -- 172.21.15.50:0/4194761985 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"} v 0) -- 0x7f89bc0010a0 con 0x7f89dc1093f0 2024-05-20T22:43:35.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:34 smithi145 bash[23893]: cluster 2024-05-20T22:43:33.567311+0000 mgr.y (mgr.14592) 1380 : cluster 0 pgmap v1853: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:35.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:34 smithi145 bash[23893]: audit 2024-05-20T22:43:33.810047+0000 mon.a (mon.0) 3983 : audit 1 from='client.? v1:172.21.15.50:0/1649722129' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "pg_num": 12}]': finished 2024-05-20T22:43:35.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:34 smithi145 bash[23893]: cluster 2024-05-20T22:43:33.816058+0000 mon.a (mon.0) 3984 : cluster 0 osdmap e834: 8 total, 8 up, 8 in 2024-05-20T22:43:35.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:34 smithi145 bash[23893]: audit 2024-05-20T22:43:33.927368+0000 mon.a (mon.0) 3985 : audit 1 from='client.? v1:172.21.15.50:0/1649722129' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "pg_num": 12}]: dispatch 2024-05-20T22:43:35.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:34 smithi145 bash[23893]: audit 2024-05-20T22:43:34.254744+0000 mon.c (mon.2) 539 : audit 1 from='client.? v1:172.21.15.50:0/4194761985' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"}]: dispatch 2024-05-20T22:43:35.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:34 smithi145 bash[23893]: audit 2024-05-20T22:43:34.255386+0000 mon.a (mon.0) 3986 : audit 1 from='client.47771 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"}]: dispatch 2024-05-20T22:43:35.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:34 smithi050 bash[21866]: cluster 2024-05-20T22:43:33.567311+0000 mgr.y (mgr.14592) 1380 : cluster 0 pgmap v1853: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:35.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:34 smithi050 bash[21866]: audit 2024-05-20T22:43:33.810047+0000 mon.a (mon.0) 3983 : audit 1 from='client.? v1:172.21.15.50:0/1649722129' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "pg_num": 12}]': finished 2024-05-20T22:43:35.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:34 smithi050 bash[21866]: cluster 2024-05-20T22:43:33.816058+0000 mon.a (mon.0) 3984 : cluster 0 osdmap e834: 8 total, 8 up, 8 in 2024-05-20T22:43:35.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:34 smithi050 bash[21866]: audit 2024-05-20T22:43:33.927368+0000 mon.a (mon.0) 3985 : audit 1 from='client.? v1:172.21.15.50:0/1649722129' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "pg_num": 12}]: dispatch 2024-05-20T22:43:35.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:34 smithi050 bash[21866]: audit 2024-05-20T22:43:34.254744+0000 mon.c (mon.2) 539 : audit 1 from='client.? v1:172.21.15.50:0/4194761985' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"}]: dispatch 2024-05-20T22:43:35.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:34 smithi050 bash[21866]: audit 2024-05-20T22:43:34.255386+0000 mon.a (mon.0) 3986 : audit 1 from='client.47771 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"}]: dispatch 2024-05-20T22:43:35.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:34 smithi050 bash[28929]: cluster 2024-05-20T22:43:33.567311+0000 mgr.y (mgr.14592) 1380 : cluster 0 pgmap v1853: 176 pgs: 176 active+clean; 726 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:35.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:34 smithi050 bash[28929]: audit 2024-05-20T22:43:33.810047+0000 mon.a (mon.0) 3983 : audit 1 from='client.? v1:172.21.15.50:0/1649722129' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "pg_num": 12}]': finished 2024-05-20T22:43:35.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:34 smithi050 bash[28929]: cluster 2024-05-20T22:43:33.816058+0000 mon.a (mon.0) 3984 : cluster 0 osdmap e834: 8 total, 8 up, 8 in 2024-05-20T22:43:35.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:34 smithi050 bash[28929]: audit 2024-05-20T22:43:33.927368+0000 mon.a (mon.0) 3985 : audit 1 from='client.? v1:172.21.15.50:0/1649722129' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "pg_num": 12}]: dispatch 2024-05-20T22:43:35.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:34 smithi050 bash[28929]: audit 2024-05-20T22:43:34.254744+0000 mon.c (mon.2) 539 : audit 1 from='client.? v1:172.21.15.50:0/4194761985' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"}]: dispatch 2024-05-20T22:43:35.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:34 smithi050 bash[28929]: audit 2024-05-20T22:43:34.255386+0000 mon.a (mon.0) 3986 : audit 1 from='client.47771 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"}]: dispatch 2024-05-20T22:43:35.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.839+0000 7f89cb7fe640 1 -- 172.21.15.50:0/4194761985 <== mon.2 v1:172.21.15.50:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"}]=0 enabled application 'rados' on pool '6ad12e91-8c60-495a-811b-e1be6780ecc0' v836) ==== 213+0+0 (unknown 2090847396 0 0) 0x7f89d005f3e0 con 0x7f89dc1093f0 2024-05-20T22:43:35.830 INFO:tasks.workunit.client.0.smithi050.stderr:enabled application 'rados' on pool '6ad12e91-8c60-495a-811b-e1be6780ecc0' 2024-05-20T22:43:35.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.839+0000 7f89e09ac640 1 -- 172.21.15.50:0/4194761985 >> v1:172.21.15.50:6800/3332714287 conn(0x7f89c406eef0 legacy=0x7f89c40713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:35.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.839+0000 7f89e09ac640 1 -- 172.21.15.50:0/4194761985 >> v1:172.21.15.50:6790/0 conn(0x7f89dc1093f0 legacy=0x7f89dc1a1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:35.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.839+0000 7f89e09ac640 1 -- 172.21.15.50:0/4194761985 shutdown_connections 2024-05-20T22:43:35.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.839+0000 7f89e09ac640 1 -- 172.21.15.50:0/4194761985 >> 172.21.15.50:0/4194761985 conn(0x7f89dc075870 msgr2=0x7f89dc1105c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:43:35.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.839+0000 7f89e09ac640 1 -- 172.21.15.50:0/4194761985 shutdown_connections 2024-05-20T22:43:35.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.839+0000 7f89e09ac640 1 -- 172.21.15.50:0/4194761985 wait complete. 2024-05-20T22:43:35.851 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph osd pool set-quota 6ad12e91-8c60-495a-811b-e1be6780ecc0 max_objects 10 2024-05-20T22:43:35.978 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.983+0000 7fb57a281640 1 -- 172.21.15.50:0/419032567 >> v1:172.21.15.50:6790/0 conn(0x7fb5741102c0 legacy=0x7fb574112780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:35.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.983+0000 7fb57a281640 1 -- 172.21.15.50:0/419032567 shutdown_connections 2024-05-20T22:43:35.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.983+0000 7fb57a281640 1 -- 172.21.15.50:0/419032567 >> 172.21.15.50:0/419032567 conn(0x7fb5740ff320 msgr2=0x7fb574101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:43:35.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.983+0000 7fb57a281640 1 -- 172.21.15.50:0/419032567 shutdown_connections 2024-05-20T22:43:35.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.983+0000 7fb57a281640 1 -- 172.21.15.50:0/419032567 wait complete. 2024-05-20T22:43:35.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.983+0000 7fb57a281640 1 Processor -- start 2024-05-20T22:43:35.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.983+0000 7fb57a281640 1 -- start start 2024-05-20T22:43:35.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.983+0000 7fb57a281640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb5741a8860 con 0x7fb5741102c0 2024-05-20T22:43:35.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.983+0000 7fb57a281640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb5741a9a60 con 0x7fb574109870 2024-05-20T22:43:35.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.983+0000 7fb57a281640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb5741aaca0 con 0x7fb57410c720 2024-05-20T22:43:35.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.983+0000 7fb5737fe640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7fb57410c720 0x7fb5741a3730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:52498/0 (socket says 172.21.15.50:52498) 2024-05-20T22:43:35.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.983+0000 7fb5737fe640 1 -- 172.21.15.50:0/471957502 learned_addr learned my addr 172.21.15.50:0/471957502 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:43:35.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.983+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 804871379 0 0) 0x7fb5741aaca0 con 0x7fb57410c720 2024-05-20T22:43:35.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.983+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb55c003530 con 0x7fb57410c720 2024-05-20T22:43:35.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.983+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1147927825 0 0) 0x7fb5741a8860 con 0x7fb5741102c0 2024-05-20T22:43:35.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.983+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5741aaca0 con 0x7fb5741102c0 2024-05-20T22:43:35.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.987+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3291465949 0 0) 0x7fb55c003530 con 0x7fb57410c720 2024-05-20T22:43:35.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.987+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5741a8860 con 0x7fb57410c720 2024-05-20T22:43:35.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.987+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fb568001380 con 0x7fb57410c720 2024-05-20T22:43:35.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.987+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2898948724 0 0) 0x7fb5741aaca0 con 0x7fb5741102c0 2024-05-20T22:43:35.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.987+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb55c003530 con 0x7fb5741102c0 2024-05-20T22:43:35.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.987+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1044561586 0 0) 0x7fb5741a9a60 con 0x7fb574109870 2024-05-20T22:43:35.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.987+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5741aaca0 con 0x7fb574109870 2024-05-20T22:43:35.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.987+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fb56c001bd0 con 0x7fb5741102c0 2024-05-20T22:43:35.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.987+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1605140979 0 0) 0x7fb5741a8860 con 0x7fb57410c720 2024-05-20T22:43:35.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.987+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 >> v1:172.21.15.145:6789/0 conn(0x7fb574109870 legacy=0x7fb57410fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:35.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.987+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 >> v1:172.21.15.50:6789/0 conn(0x7fb5741102c0 legacy=0x7fb5741a6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:35.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.987+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5741abee0 con 0x7fb57410c720 2024-05-20T22:43:35.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.987+0000 7fb57a281640 1 -- 172.21.15.50:0/471957502 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb5741a8a90 con 0x7fb57410c720 2024-05-20T22:43:35.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.987+0000 7fb57a281640 1 -- 172.21.15.50:0/471957502 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb5741a8f50 con 0x7fb57410c720 2024-05-20T22:43:35.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.987+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7fb568001630 con 0x7fb57410c720 2024-05-20T22:43:35.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.987+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7fb568005cb0 con 0x7fb57410c720 2024-05-20T22:43:35.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.987+0000 7fb57a281640 1 -- 172.21.15.50:0/471957502 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb560005090 con 0x7fb57410c720 2024-05-20T22:43:35.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.987+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7fb5680038b0 con 0x7fb57410c720 2024-05-20T22:43:35.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.987+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(836..836 src has 256..836) ==== 8136+0+0 (unknown 257806176 0 0) 0x7fb568089e90 con 0x7fb57410c720 2024-05-20T22:43:35.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:35.991+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7fb568056e40 con 0x7fb57410c720 2024-05-20T22:43:36.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:35 smithi145 bash[23893]: audit 2024-05-20T22:43:34.821615+0000 mon.a (mon.0) 3987 : audit 1 from='client.47771 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"}]': finished 2024-05-20T22:43:36.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:35 smithi145 bash[23893]: cluster 2024-05-20T22:43:34.829278+0000 mon.a (mon.0) 3988 : cluster 0 osdmap e835: 8 total, 8 up, 8 in 2024-05-20T22:43:36.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:35 smithi145 bash[23893]: audit 2024-05-20T22:43:34.952264+0000 mon.c (mon.2) 540 : audit 1 from='client.? v1:172.21.15.50:0/4194761985' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"}]: dispatch 2024-05-20T22:43:36.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:35 smithi145 bash[23893]: audit 2024-05-20T22:43:34.952819+0000 mon.a (mon.0) 3989 : audit 1 from='client.47771 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"}]: dispatch 2024-05-20T22:43:36.162 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:36.171+0000 7fb57a281640 1 -- 172.21.15.50:0/471957502 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"} v 0) -- 0x7fb560005380 con 0x7fb57410c720 2024-05-20T22:43:36.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:35 smithi050 bash[21866]: audit 2024-05-20T22:43:34.821615+0000 mon.a (mon.0) 3987 : audit 1 from='client.47771 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"}]': finished 2024-05-20T22:43:36.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:35 smithi050 bash[21866]: cluster 2024-05-20T22:43:34.829278+0000 mon.a (mon.0) 3988 : cluster 0 osdmap e835: 8 total, 8 up, 8 in 2024-05-20T22:43:36.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:35 smithi050 bash[21866]: audit 2024-05-20T22:43:34.952264+0000 mon.c (mon.2) 540 : audit 1 from='client.? v1:172.21.15.50:0/4194761985' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"}]: dispatch 2024-05-20T22:43:36.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:35 smithi050 bash[21866]: audit 2024-05-20T22:43:34.952819+0000 mon.a (mon.0) 3989 : audit 1 from='client.47771 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"}]: dispatch 2024-05-20T22:43:36.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:35 smithi050 bash[28929]: audit 2024-05-20T22:43:34.821615+0000 mon.a (mon.0) 3987 : audit 1 from='client.47771 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"}]': finished 2024-05-20T22:43:36.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:35 smithi050 bash[28929]: cluster 2024-05-20T22:43:34.829278+0000 mon.a (mon.0) 3988 : cluster 0 osdmap e835: 8 total, 8 up, 8 in 2024-05-20T22:43:36.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:35 smithi050 bash[28929]: audit 2024-05-20T22:43:34.952264+0000 mon.c (mon.2) 540 : audit 1 from='client.? v1:172.21.15.50:0/4194761985' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"}]: dispatch 2024-05-20T22:43:36.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:35 smithi050 bash[28929]: audit 2024-05-20T22:43:34.952819+0000 mon.a (mon.0) 3989 : audit 1 from='client.47771 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"}]: dispatch 2024-05-20T22:43:36.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:36.839+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 <== mon.2 v1:172.21.15.50:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 6ad12e91-8c60-495a-811b-e1be6780ecc0 v837) ==== 223+0+0 (unknown 1459584077 0 0) 0x7fb56805aaf0 con 0x7fb57410c720 2024-05-20T22:43:36.942 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:36.951+0000 7fb57a281640 1 -- 172.21.15.50:0/471957502 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"} v 0) -- 0x7fb5600010a0 con 0x7fb57410c720 2024-05-20T22:43:37.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:36 smithi145 bash[23893]: cluster 2024-05-20T22:43:35.569346+0000 mgr.y (mgr.14592) 1381 : cluster 0 pgmap v1856: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-05-20T22:43:37.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:36 smithi145 bash[23893]: audit 2024-05-20T22:43:35.830601+0000 mon.a (mon.0) 3990 : audit 1 from='client.47771 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"}]': finished 2024-05-20T22:43:37.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:36 smithi145 bash[23893]: cluster 2024-05-20T22:43:35.839487+0000 mon.a (mon.0) 3991 : cluster 0 osdmap e836: 8 total, 8 up, 8 in 2024-05-20T22:43:37.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:36 smithi145 bash[23893]: audit 2024-05-20T22:43:36.172347+0000 mon.c (mon.2) 541 : audit 1 from='client.? v1:172.21.15.50:0/471957502' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:43:37.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:36 smithi145 bash[23893]: audit 2024-05-20T22:43:36.173045+0000 mon.a (mon.0) 3992 : audit 1 from='client.47777 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:43:37.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:36 smithi050 bash[21866]: cluster 2024-05-20T22:43:35.569346+0000 mgr.y (mgr.14592) 1381 : cluster 0 pgmap v1856: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-05-20T22:43:37.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:36 smithi050 bash[21866]: audit 2024-05-20T22:43:35.830601+0000 mon.a (mon.0) 3990 : audit 1 from='client.47771 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"}]': finished 2024-05-20T22:43:37.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:36 smithi050 bash[21866]: cluster 2024-05-20T22:43:35.839487+0000 mon.a (mon.0) 3991 : cluster 0 osdmap e836: 8 total, 8 up, 8 in 2024-05-20T22:43:37.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:36 smithi050 bash[21866]: audit 2024-05-20T22:43:36.172347+0000 mon.c (mon.2) 541 : audit 1 from='client.? v1:172.21.15.50:0/471957502' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:43:37.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:36 smithi050 bash[21866]: audit 2024-05-20T22:43:36.173045+0000 mon.a (mon.0) 3992 : audit 1 from='client.47777 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:43:37.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:36 smithi050 bash[28929]: cluster 2024-05-20T22:43:35.569346+0000 mgr.y (mgr.14592) 1381 : cluster 0 pgmap v1856: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-05-20T22:43:37.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:36 smithi050 bash[28929]: audit 2024-05-20T22:43:35.830601+0000 mon.a (mon.0) 3990 : audit 1 from='client.47771 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "app": "rados"}]': finished 2024-05-20T22:43:37.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:36 smithi050 bash[28929]: cluster 2024-05-20T22:43:35.839487+0000 mon.a (mon.0) 3991 : cluster 0 osdmap e836: 8 total, 8 up, 8 in 2024-05-20T22:43:37.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:36 smithi050 bash[28929]: audit 2024-05-20T22:43:36.172347+0000 mon.c (mon.2) 541 : audit 1 from='client.? v1:172.21.15.50:0/471957502' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:43:37.191 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:36 smithi050 bash[28929]: audit 2024-05-20T22:43:36.173045+0000 mon.a (mon.0) 3992 : audit 1 from='client.47777 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:43:37.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:37.863+0000 7fb5717fa640 1 -- 172.21.15.50:0/471957502 <== mon.2 v1:172.21.15.50:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 6ad12e91-8c60-495a-811b-e1be6780ecc0 v838) ==== 223+0+0 (unknown 2368836573 0 0) 0x7fb56805f3b0 con 0x7fb57410c720 2024-05-20T22:43:37.857 INFO:tasks.workunit.client.0.smithi050.stderr:set-quota max_objects = 10 for pool 6ad12e91-8c60-495a-811b-e1be6780ecc0 2024-05-20T22:43:37.860 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:37.867+0000 7fb57a281640 1 -- 172.21.15.50:0/471957502 >> v1:172.21.15.50:6800/3332714287 conn(0x7fb55c06f070 legacy=0x7fb55c071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:37.860 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:37.867+0000 7fb57a281640 1 -- 172.21.15.50:0/471957502 >> v1:172.21.15.50:6790/0 conn(0x7fb57410c720 legacy=0x7fb5741a3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:43:37.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:37.867+0000 7fb57a281640 1 -- 172.21.15.50:0/471957502 shutdown_connections 2024-05-20T22:43:37.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:37.867+0000 7fb57a281640 1 -- 172.21.15.50:0/471957502 >> 172.21.15.50:0/471957502 conn(0x7fb5740ff320 msgr2=0x7fb5740ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:43:37.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:37.867+0000 7fb57a281640 1 -- 172.21.15.50:0/471957502 shutdown_connections 2024-05-20T22:43:37.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:43:37.867+0000 7fb57a281640 1 -- 172.21.15.50:0/471957502 wait complete. 2024-05-20T22:43:37.879 INFO:tasks.workunit.client.0.smithi050.stderr:+ sleep 30 2024-05-20T22:43:38.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:37 smithi145 bash[23893]: audit 2024-05-20T22:43:36.833119+0000 mon.a (mon.0) 3993 : audit 1 from='client.47777 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"}]': finished 2024-05-20T22:43:38.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:37 smithi145 bash[23893]: cluster 2024-05-20T22:43:36.840508+0000 mon.a (mon.0) 3994 : cluster 0 osdmap e837: 8 total, 8 up, 8 in 2024-05-20T22:43:38.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:37 smithi145 bash[23893]: audit 2024-05-20T22:43:36.953360+0000 mon.c (mon.2) 542 : audit 1 from='client.? v1:172.21.15.50:0/471957502' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:43:38.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:37 smithi145 bash[23893]: audit 2024-05-20T22:43:36.953949+0000 mon.a (mon.0) 3995 : audit 1 from='client.47777 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:43:38.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:37 smithi050 bash[28929]: audit 2024-05-20T22:43:36.833119+0000 mon.a (mon.0) 3993 : audit 1 from='client.47777 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"}]': finished 2024-05-20T22:43:38.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:37 smithi050 bash[28929]: cluster 2024-05-20T22:43:36.840508+0000 mon.a (mon.0) 3994 : cluster 0 osdmap e837: 8 total, 8 up, 8 in 2024-05-20T22:43:38.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:37 smithi050 bash[28929]: audit 2024-05-20T22:43:36.953360+0000 mon.c (mon.2) 542 : audit 1 from='client.? v1:172.21.15.50:0/471957502' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:43:38.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:37 smithi050 bash[28929]: audit 2024-05-20T22:43:36.953949+0000 mon.a (mon.0) 3995 : audit 1 from='client.47777 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:43:38.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:37 smithi050 bash[21866]: audit 2024-05-20T22:43:36.833119+0000 mon.a (mon.0) 3993 : audit 1 from='client.47777 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"}]': finished 2024-05-20T22:43:38.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:37 smithi050 bash[21866]: cluster 2024-05-20T22:43:36.840508+0000 mon.a (mon.0) 3994 : cluster 0 osdmap e837: 8 total, 8 up, 8 in 2024-05-20T22:43:38.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:37 smithi050 bash[21866]: audit 2024-05-20T22:43:36.953360+0000 mon.c (mon.2) 542 : audit 1 from='client.? v1:172.21.15.50:0/471957502' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:43:38.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:37 smithi050 bash[21866]: audit 2024-05-20T22:43:36.953949+0000 mon.a (mon.0) 3995 : audit 1 from='client.47777 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"}]: dispatch 2024-05-20T22:43:39.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:38 smithi145 bash[23893]: cluster 2024-05-20T22:43:37.570228+0000 mgr.y (mgr.14592) 1382 : cluster 0 pgmap v1859: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-05-20T22:43:39.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:38 smithi145 bash[23893]: audit 2024-05-20T22:43:37.858990+0000 mon.a (mon.0) 3996 : audit 1 from='client.47777 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"}]': finished 2024-05-20T22:43:39.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:38 smithi145 bash[23893]: cluster 2024-05-20T22:43:37.866560+0000 mon.a (mon.0) 3997 : cluster 0 osdmap e838: 8 total, 8 up, 8 in 2024-05-20T22:43:39.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:38 smithi050 bash[21866]: cluster 2024-05-20T22:43:37.570228+0000 mgr.y (mgr.14592) 1382 : cluster 0 pgmap v1859: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-05-20T22:43:39.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:38 smithi050 bash[21866]: audit 2024-05-20T22:43:37.858990+0000 mon.a (mon.0) 3996 : audit 1 from='client.47777 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"}]': finished 2024-05-20T22:43:39.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:38 smithi050 bash[21866]: cluster 2024-05-20T22:43:37.866560+0000 mon.a (mon.0) 3997 : cluster 0 osdmap e838: 8 total, 8 up, 8 in 2024-05-20T22:43:39.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:38 smithi050 bash[28929]: cluster 2024-05-20T22:43:37.570228+0000 mgr.y (mgr.14592) 1382 : cluster 0 pgmap v1859: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-05-20T22:43:39.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:38 smithi050 bash[28929]: audit 2024-05-20T22:43:37.858990+0000 mon.a (mon.0) 3996 : audit 1 from='client.47777 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "field": "max_objects", "val": "10"}]': finished 2024-05-20T22:43:39.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:38 smithi050 bash[28929]: cluster 2024-05-20T22:43:37.866560+0000 mon.a (mon.0) 3997 : cluster 0 osdmap e838: 8 total, 8 up, 8 in 2024-05-20T22:43:39.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:43:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:43:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:43:39.885 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:43:39 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:43:41.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:40 smithi145 bash[23893]: audit 2024-05-20T22:43:39.525531+0000 mgr.y (mgr.14592) 1383 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:43:41.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:40 smithi145 bash[23893]: cluster 2024-05-20T22:43:39.571052+0000 mgr.y (mgr.14592) 1384 : cluster 0 pgmap v1861: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 5.1 KiB/s wr, 1 op/s 2024-05-20T22:43:41.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:40 smithi050 bash[21866]: audit 2024-05-20T22:43:39.525531+0000 mgr.y (mgr.14592) 1383 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:43:41.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:40 smithi050 bash[21866]: cluster 2024-05-20T22:43:39.571052+0000 mgr.y (mgr.14592) 1384 : cluster 0 pgmap v1861: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 5.1 KiB/s wr, 1 op/s 2024-05-20T22:43:41.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:40 smithi050 bash[28929]: audit 2024-05-20T22:43:39.525531+0000 mgr.y (mgr.14592) 1383 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:43:41.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:40 smithi050 bash[28929]: cluster 2024-05-20T22:43:39.571052+0000 mgr.y (mgr.14592) 1384 : cluster 0 pgmap v1861: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 5.1 KiB/s wr, 1 op/s 2024-05-20T22:43:43.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:42 smithi145 bash[23893]: cluster 2024-05-20T22:43:41.573893+0000 mgr.y (mgr.14592) 1385 : cluster 0 pgmap v1862: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:43.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:42 smithi145 bash[23893]: audit 2024-05-20T22:43:41.799845+0000 mon.a (mon.0) 3998 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:43:43.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:42 smithi145 bash[23893]: audit 2024-05-20T22:43:41.802140+0000 mon.a (mon.0) 3999 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:43:43.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:42 smithi050 bash[21866]: cluster 2024-05-20T22:43:41.573893+0000 mgr.y (mgr.14592) 1385 : cluster 0 pgmap v1862: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:43.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:42 smithi050 bash[21866]: audit 2024-05-20T22:43:41.799845+0000 mon.a (mon.0) 3998 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:43:43.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:42 smithi050 bash[21866]: audit 2024-05-20T22:43:41.802140+0000 mon.a (mon.0) 3999 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:43:43.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:42 smithi050 bash[28929]: cluster 2024-05-20T22:43:41.573893+0000 mgr.y (mgr.14592) 1385 : cluster 0 pgmap v1862: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:43.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:42 smithi050 bash[28929]: audit 2024-05-20T22:43:41.799845+0000 mon.a (mon.0) 3998 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:43:43.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:42 smithi050 bash[28929]: audit 2024-05-20T22:43:41.802140+0000 mon.a (mon.0) 3999 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:43:45.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:44 smithi145 bash[23893]: cluster 2024-05-20T22:43:43.574687+0000 mgr.y (mgr.14592) 1386 : cluster 0 pgmap v1863: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 661 B/s rd, 0 op/s 2024-05-20T22:43:45.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:44 smithi050 bash[21866]: cluster 2024-05-20T22:43:43.574687+0000 mgr.y (mgr.14592) 1386 : cluster 0 pgmap v1863: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 661 B/s rd, 0 op/s 2024-05-20T22:43:45.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:44 smithi050 bash[28929]: cluster 2024-05-20T22:43:43.574687+0000 mgr.y (mgr.14592) 1386 : cluster 0 pgmap v1863: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 661 B/s rd, 0 op/s 2024-05-20T22:43:47.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:46 smithi145 bash[23893]: cluster 2024-05-20T22:43:45.578014+0000 mgr.y (mgr.14592) 1387 : cluster 0 pgmap v1864: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-20T22:43:47.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:46 smithi050 bash[21866]: cluster 2024-05-20T22:43:45.578014+0000 mgr.y (mgr.14592) 1387 : cluster 0 pgmap v1864: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-20T22:43:47.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:46 smithi050 bash[28929]: cluster 2024-05-20T22:43:45.578014+0000 mgr.y (mgr.14592) 1387 : cluster 0 pgmap v1864: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-20T22:43:49.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:48 smithi145 bash[23893]: cluster 2024-05-20T22:43:47.578760+0000 mgr.y (mgr.14592) 1388 : cluster 0 pgmap v1865: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:43:49.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:48 smithi145 bash[23893]: audit 2024-05-20T22:43:48.445770+0000 mon.a (mon.0) 4000 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:43:49.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:48 smithi050 bash[21866]: cluster 2024-05-20T22:43:47.578760+0000 mgr.y (mgr.14592) 1388 : cluster 0 pgmap v1865: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:43:49.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:48 smithi050 bash[21866]: audit 2024-05-20T22:43:48.445770+0000 mon.a (mon.0) 4000 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:43:49.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:48 smithi050 bash[28929]: cluster 2024-05-20T22:43:47.578760+0000 mgr.y (mgr.14592) 1388 : cluster 0 pgmap v1865: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:43:49.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:48 smithi050 bash[28929]: audit 2024-05-20T22:43:48.445770+0000 mon.a (mon.0) 4000 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:43:49.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:43:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:43:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:43:49.801 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:43:49 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:43:50.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:49 smithi145 bash[23893]: audit 2024-05-20T22:43:49.151702+0000 mon.a (mon.0) 4001 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:43:50.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:49 smithi145 bash[23893]: audit 2024-05-20T22:43:49.153187+0000 mon.a (mon.0) 4002 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:43:50.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:49 smithi145 bash[23893]: audit 2024-05-20T22:43:49.162627+0000 mon.a (mon.0) 4003 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:43:50.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:49 smithi050 bash[21866]: audit 2024-05-20T22:43:49.151702+0000 mon.a (mon.0) 4001 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:43:50.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:49 smithi050 bash[21866]: audit 2024-05-20T22:43:49.153187+0000 mon.a (mon.0) 4002 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:43:50.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:49 smithi050 bash[21866]: audit 2024-05-20T22:43:49.162627+0000 mon.a (mon.0) 4003 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:43:50.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:49 smithi050 bash[28929]: audit 2024-05-20T22:43:49.151702+0000 mon.a (mon.0) 4001 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:43:50.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:49 smithi050 bash[28929]: audit 2024-05-20T22:43:49.153187+0000 mon.a (mon.0) 4002 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:43:50.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:49 smithi050 bash[28929]: audit 2024-05-20T22:43:49.162627+0000 mon.a (mon.0) 4003 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:43:51.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:50 smithi145 bash[23893]: audit 2024-05-20T22:43:49.533734+0000 mgr.y (mgr.14592) 1389 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:43:51.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:50 smithi145 bash[23893]: cluster 2024-05-20T22:43:49.579500+0000 mgr.y (mgr.14592) 1390 : cluster 0 pgmap v1866: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 873 B/s rd, 0 op/s 2024-05-20T22:43:51.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:50 smithi050 bash[21866]: audit 2024-05-20T22:43:49.533734+0000 mgr.y (mgr.14592) 1389 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:43:51.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:50 smithi050 bash[21866]: cluster 2024-05-20T22:43:49.579500+0000 mgr.y (mgr.14592) 1390 : cluster 0 pgmap v1866: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 873 B/s rd, 0 op/s 2024-05-20T22:43:51.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:50 smithi050 bash[28929]: audit 2024-05-20T22:43:49.533734+0000 mgr.y (mgr.14592) 1389 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:43:51.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:50 smithi050 bash[28929]: cluster 2024-05-20T22:43:49.579500+0000 mgr.y (mgr.14592) 1390 : cluster 0 pgmap v1866: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 873 B/s rd, 0 op/s 2024-05-20T22:43:53.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:52 smithi145 bash[23893]: cluster 2024-05-20T22:43:51.581533+0000 mgr.y (mgr.14592) 1391 : cluster 0 pgmap v1867: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:53.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:52 smithi050 bash[21866]: cluster 2024-05-20T22:43:51.581533+0000 mgr.y (mgr.14592) 1391 : cluster 0 pgmap v1867: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:53.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:52 smithi050 bash[28929]: cluster 2024-05-20T22:43:51.581533+0000 mgr.y (mgr.14592) 1391 : cluster 0 pgmap v1867: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:55.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:54 smithi145 bash[23893]: cluster 2024-05-20T22:43:53.582339+0000 mgr.y (mgr.14592) 1392 : cluster 0 pgmap v1868: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:55.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:54 smithi050 bash[21866]: cluster 2024-05-20T22:43:53.582339+0000 mgr.y (mgr.14592) 1392 : cluster 0 pgmap v1868: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:55.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:54 smithi050 bash[28929]: cluster 2024-05-20T22:43:53.582339+0000 mgr.y (mgr.14592) 1392 : cluster 0 pgmap v1868: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:57.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:56 smithi145 bash[23893]: cluster 2024-05-20T22:43:55.584375+0000 mgr.y (mgr.14592) 1393 : cluster 0 pgmap v1869: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:57.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:56 smithi050 bash[21866]: cluster 2024-05-20T22:43:55.584375+0000 mgr.y (mgr.14592) 1393 : cluster 0 pgmap v1869: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:57.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:56 smithi050 bash[28929]: cluster 2024-05-20T22:43:55.584375+0000 mgr.y (mgr.14592) 1393 : cluster 0 pgmap v1869: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:43:58.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:57 smithi145 bash[23893]: audit 2024-05-20T22:43:56.833255+0000 mon.a (mon.0) 4004 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:43:58.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:57 smithi050 bash[21866]: audit 2024-05-20T22:43:56.833255+0000 mon.a (mon.0) 4004 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:43:58.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:57 smithi050 bash[28929]: audit 2024-05-20T22:43:56.833255+0000 mon.a (mon.0) 4004 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:43:59.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:43:58 smithi145 bash[23893]: cluster 2024-05-20T22:43:57.585151+0000 mgr.y (mgr.14592) 1394 : cluster 0 pgmap v1870: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:59.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:43:58 smithi050 bash[21866]: cluster 2024-05-20T22:43:57.585151+0000 mgr.y (mgr.14592) 1394 : cluster 0 pgmap v1870: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:59.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:43:58 smithi050 bash[28929]: cluster 2024-05-20T22:43:57.585151+0000 mgr.y (mgr.14592) 1394 : cluster 0 pgmap v1870: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:43:59.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:43:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:43:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:43:59.885 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:43:59 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:44:01.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:00 smithi145 bash[23893]: audit 2024-05-20T22:43:59.545219+0000 mgr.y (mgr.14592) 1395 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:44:01.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:00 smithi145 bash[23893]: cluster 2024-05-20T22:43:59.585939+0000 mgr.y (mgr.14592) 1396 : cluster 0 pgmap v1871: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:01.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:00 smithi050 bash[21866]: audit 2024-05-20T22:43:59.545219+0000 mgr.y (mgr.14592) 1395 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:44:01.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:00 smithi050 bash[21866]: cluster 2024-05-20T22:43:59.585939+0000 mgr.y (mgr.14592) 1396 : cluster 0 pgmap v1871: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:01.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:00 smithi050 bash[28929]: audit 2024-05-20T22:43:59.545219+0000 mgr.y (mgr.14592) 1395 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:44:01.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:00 smithi050 bash[28929]: cluster 2024-05-20T22:43:59.585939+0000 mgr.y (mgr.14592) 1396 : cluster 0 pgmap v1871: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:03.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:02 smithi145 bash[23893]: cluster 2024-05-20T22:44:01.588138+0000 mgr.y (mgr.14592) 1397 : cluster 0 pgmap v1872: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:44:03.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:02 smithi050 bash[21866]: cluster 2024-05-20T22:44:01.588138+0000 mgr.y (mgr.14592) 1397 : cluster 0 pgmap v1872: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:44:03.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:02 smithi050 bash[28929]: cluster 2024-05-20T22:44:01.588138+0000 mgr.y (mgr.14592) 1397 : cluster 0 pgmap v1872: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:44:05.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:04 smithi145 bash[23893]: cluster 2024-05-20T22:44:03.589113+0000 mgr.y (mgr.14592) 1398 : cluster 0 pgmap v1873: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:05.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:04 smithi050 bash[21866]: cluster 2024-05-20T22:44:03.589113+0000 mgr.y (mgr.14592) 1398 : cluster 0 pgmap v1873: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:05.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:04 smithi050 bash[28929]: cluster 2024-05-20T22:44:03.589113+0000 mgr.y (mgr.14592) 1398 : cluster 0 pgmap v1873: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:07.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:06 smithi145 bash[23893]: cluster 2024-05-20T22:44:05.591108+0000 mgr.y (mgr.14592) 1399 : cluster 0 pgmap v1874: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:44:07.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:06 smithi050 bash[21866]: cluster 2024-05-20T22:44:05.591108+0000 mgr.y (mgr.14592) 1399 : cluster 0 pgmap v1874: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:44:07.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:06 smithi050 bash[28929]: cluster 2024-05-20T22:44:05.591108+0000 mgr.y (mgr.14592) 1399 : cluster 0 pgmap v1874: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:44:07.881 INFO:tasks.workunit.client.0.smithi050.stderr:+ seq 1 10 2024-05-20T22:44:07.882 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 6ad12e91-8c60-495a-811b-e1be6780ecc0 put obj1 /etc/passwd 2024-05-20T22:44:07.928 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 6ad12e91-8c60-495a-811b-e1be6780ecc0 put obj2 /etc/passwd 2024-05-20T22:44:07.965 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 6ad12e91-8c60-495a-811b-e1be6780ecc0 put obj3 /etc/passwd 2024-05-20T22:44:08.001 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 6ad12e91-8c60-495a-811b-e1be6780ecc0 put obj4 /etc/passwd 2024-05-20T22:44:08.038 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 6ad12e91-8c60-495a-811b-e1be6780ecc0 put obj5 /etc/passwd 2024-05-20T22:44:08.074 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 6ad12e91-8c60-495a-811b-e1be6780ecc0 put obj6 /etc/passwd 2024-05-20T22:44:08.109 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 6ad12e91-8c60-495a-811b-e1be6780ecc0 put obj7 /etc/passwd 2024-05-20T22:44:08.143 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 6ad12e91-8c60-495a-811b-e1be6780ecc0 put obj8 /etc/passwd 2024-05-20T22:44:08.178 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 6ad12e91-8c60-495a-811b-e1be6780ecc0 put obj9 /etc/passwd 2024-05-20T22:44:08.213 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 6ad12e91-8c60-495a-811b-e1be6780ecc0 put obj10 /etc/passwd 2024-05-20T22:44:08.249 INFO:tasks.workunit.client.0.smithi050.stderr:+ sleep 30 2024-05-20T22:44:09.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:08 smithi145 bash[23893]: cluster 2024-05-20T22:44:07.591931+0000 mgr.y (mgr.14592) 1400 : cluster 0 pgmap v1875: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:09.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:08 smithi050 bash[21866]: cluster 2024-05-20T22:44:07.591931+0000 mgr.y (mgr.14592) 1400 : cluster 0 pgmap v1875: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:09.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:08 smithi050 bash[28929]: cluster 2024-05-20T22:44:07.591931+0000 mgr.y (mgr.14592) 1400 : cluster 0 pgmap v1875: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:09.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:44:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:44:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:44:09.885 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:44:09 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:44:11.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:10 smithi145 bash[23893]: audit 2024-05-20T22:44:09.556572+0000 mgr.y (mgr.14592) 1401 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:44:11.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:10 smithi145 bash[23893]: cluster 2024-05-20T22:44:09.592714+0000 mgr.y (mgr.14592) 1402 : cluster 0 pgmap v1876: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:11.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:10 smithi050 bash[21866]: audit 2024-05-20T22:44:09.556572+0000 mgr.y (mgr.14592) 1401 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:44:11.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:10 smithi050 bash[21866]: cluster 2024-05-20T22:44:09.592714+0000 mgr.y (mgr.14592) 1402 : cluster 0 pgmap v1876: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:11.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:10 smithi050 bash[28929]: audit 2024-05-20T22:44:09.556572+0000 mgr.y (mgr.14592) 1401 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:44:11.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:10 smithi050 bash[28929]: cluster 2024-05-20T22:44:09.592714+0000 mgr.y (mgr.14592) 1402 : cluster 0 pgmap v1876: 188 pgs: 188 active+clean; 750 KiB data, 867 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:13.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:12 smithi145 bash[23893]: cluster 2024-05-20T22:44:11.594732+0000 mgr.y (mgr.14592) 1403 : cluster 0 pgmap v1877: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-05-20T22:44:13.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:12 smithi145 bash[23893]: audit 2024-05-20T22:44:11.866265+0000 mon.a (mon.0) 4005 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:44:13.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:12 smithi050 bash[28929]: cluster 2024-05-20T22:44:11.594732+0000 mgr.y (mgr.14592) 1403 : cluster 0 pgmap v1877: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-05-20T22:44:13.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:12 smithi050 bash[28929]: audit 2024-05-20T22:44:11.866265+0000 mon.a (mon.0) 4005 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:44:13.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:12 smithi050 bash[21866]: cluster 2024-05-20T22:44:11.594732+0000 mgr.y (mgr.14592) 1403 : cluster 0 pgmap v1877: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-05-20T22:44:13.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:12 smithi050 bash[21866]: audit 2024-05-20T22:44:11.866265+0000 mon.a (mon.0) 4005 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:44:15.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:14 smithi145 bash[23893]: cluster 2024-05-20T22:44:13.595566+0000 mgr.y (mgr.14592) 1404 : cluster 0 pgmap v1878: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 10 KiB/s wr, 1 op/s 2024-05-20T22:44:15.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:14 smithi050 bash[21866]: cluster 2024-05-20T22:44:13.595566+0000 mgr.y (mgr.14592) 1404 : cluster 0 pgmap v1878: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 10 KiB/s wr, 1 op/s 2024-05-20T22:44:15.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:14 smithi050 bash[28929]: cluster 2024-05-20T22:44:13.595566+0000 mgr.y (mgr.14592) 1404 : cluster 0 pgmap v1878: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 10 KiB/s wr, 1 op/s 2024-05-20T22:44:17.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:16 smithi145 bash[23893]: cluster 2024-05-20T22:44:15.597590+0000 mgr.y (mgr.14592) 1405 : cluster 0 pgmap v1879: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-05-20T22:44:17.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:16 smithi145 bash[23893]: cluster 2024-05-20T22:44:16.615832+0000 mon.a (mon.0) 4006 : cluster 3 pool '6ad12e91-8c60-495a-811b-e1be6780ecc0' is full (reached quota's max_objects: 10) 2024-05-20T22:44:17.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:16 smithi145 bash[23893]: cluster 2024-05-20T22:44:16.616348+0000 mon.a (mon.0) 4007 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-05-20T22:44:17.136 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:16 smithi145 bash[23893]: cluster 2024-05-20T22:44:16.627411+0000 mon.a (mon.0) 4008 : cluster 0 osdmap e839: 8 total, 8 up, 8 in 2024-05-20T22:44:17.189 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:16 smithi050 bash[28929]: cluster 2024-05-20T22:44:15.597590+0000 mgr.y (mgr.14592) 1405 : cluster 0 pgmap v1879: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-05-20T22:44:17.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:16 smithi050 bash[28929]: cluster 2024-05-20T22:44:16.615832+0000 mon.a (mon.0) 4006 : cluster 3 pool '6ad12e91-8c60-495a-811b-e1be6780ecc0' is full (reached quota's max_objects: 10) 2024-05-20T22:44:17.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:16 smithi050 bash[28929]: cluster 2024-05-20T22:44:16.616348+0000 mon.a (mon.0) 4007 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-05-20T22:44:17.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:16 smithi050 bash[28929]: cluster 2024-05-20T22:44:16.627411+0000 mon.a (mon.0) 4008 : cluster 0 osdmap e839: 8 total, 8 up, 8 in 2024-05-20T22:44:17.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:16 smithi050 bash[21866]: cluster 2024-05-20T22:44:15.597590+0000 mgr.y (mgr.14592) 1405 : cluster 0 pgmap v1879: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-05-20T22:44:17.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:16 smithi050 bash[21866]: cluster 2024-05-20T22:44:16.615832+0000 mon.a (mon.0) 4006 : cluster 3 pool '6ad12e91-8c60-495a-811b-e1be6780ecc0' is full (reached quota's max_objects: 10) 2024-05-20T22:44:17.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:16 smithi050 bash[21866]: cluster 2024-05-20T22:44:16.616348+0000 mon.a (mon.0) 4007 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-05-20T22:44:17.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:16 smithi050 bash[21866]: cluster 2024-05-20T22:44:16.627411+0000 mon.a (mon.0) 4008 : cluster 0 osdmap e839: 8 total, 8 up, 8 in 2024-05-20T22:44:19.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:18 smithi145 bash[23893]: cluster 2024-05-20T22:44:17.598411+0000 mgr.y (mgr.14592) 1406 : cluster 0 pgmap v1881: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-05-20T22:44:19.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:18 smithi050 bash[21866]: cluster 2024-05-20T22:44:17.598411+0000 mgr.y (mgr.14592) 1406 : cluster 0 pgmap v1881: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-05-20T22:44:19.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:18 smithi050 bash[28929]: cluster 2024-05-20T22:44:17.598411+0000 mgr.y (mgr.14592) 1406 : cluster 0 pgmap v1881: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-05-20T22:44:19.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:44:19 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:44:19] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:44:19.885 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:44:19 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:44:21.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:20 smithi145 bash[23893]: audit 2024-05-20T22:44:19.567888+0000 mgr.y (mgr.14592) 1407 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:44:21.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:20 smithi145 bash[23893]: cluster 2024-05-20T22:44:19.599329+0000 mgr.y (mgr.14592) 1408 : cluster 0 pgmap v1882: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-05-20T22:44:21.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:20 smithi050 bash[21866]: audit 2024-05-20T22:44:19.567888+0000 mgr.y (mgr.14592) 1407 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:44:21.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:20 smithi050 bash[21866]: cluster 2024-05-20T22:44:19.599329+0000 mgr.y (mgr.14592) 1408 : cluster 0 pgmap v1882: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-05-20T22:44:21.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:20 smithi050 bash[28929]: audit 2024-05-20T22:44:19.567888+0000 mgr.y (mgr.14592) 1407 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:44:21.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:20 smithi050 bash[28929]: cluster 2024-05-20T22:44:19.599329+0000 mgr.y (mgr.14592) 1408 : cluster 0 pgmap v1882: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-05-20T22:44:23.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:22 smithi145 bash[23893]: cluster 2024-05-20T22:44:21.601357+0000 mgr.y (mgr.14592) 1409 : cluster 0 pgmap v1883: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:44:23.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:22 smithi050 bash[21866]: cluster 2024-05-20T22:44:21.601357+0000 mgr.y (mgr.14592) 1409 : cluster 0 pgmap v1883: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:44:23.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:22 smithi050 bash[28929]: cluster 2024-05-20T22:44:21.601357+0000 mgr.y (mgr.14592) 1409 : cluster 0 pgmap v1883: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:44:25.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:24 smithi145 bash[23893]: cluster 2024-05-20T22:44:23.602254+0000 mgr.y (mgr.14592) 1410 : cluster 0 pgmap v1884: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:44:25.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:24 smithi050 bash[21866]: cluster 2024-05-20T22:44:23.602254+0000 mgr.y (mgr.14592) 1410 : cluster 0 pgmap v1884: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:44:25.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:24 smithi050 bash[28929]: cluster 2024-05-20T22:44:23.602254+0000 mgr.y (mgr.14592) 1410 : cluster 0 pgmap v1884: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:44:27.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:26 smithi145 bash[23893]: cluster 2024-05-20T22:44:25.604347+0000 mgr.y (mgr.14592) 1411 : cluster 0 pgmap v1885: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:44:27.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:26 smithi050 bash[21866]: cluster 2024-05-20T22:44:25.604347+0000 mgr.y (mgr.14592) 1411 : cluster 0 pgmap v1885: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:44:27.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:26 smithi050 bash[28929]: cluster 2024-05-20T22:44:25.604347+0000 mgr.y (mgr.14592) 1411 : cluster 0 pgmap v1885: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:44:28.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:27 smithi050 bash[21866]: audit 2024-05-20T22:44:26.906691+0000 mon.a (mon.0) 4009 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:44:28.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:27 smithi050 bash[21866]: audit 2024-05-20T22:44:26.909119+0000 mon.a (mon.0) 4010 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:44:28.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:27 smithi050 bash[28929]: audit 2024-05-20T22:44:26.906691+0000 mon.a (mon.0) 4009 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:44:28.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:27 smithi050 bash[28929]: audit 2024-05-20T22:44:26.909119+0000 mon.a (mon.0) 4010 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:44:28.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:27 smithi145 bash[23893]: audit 2024-05-20T22:44:26.906691+0000 mon.a (mon.0) 4009 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:44:28.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:27 smithi145 bash[23893]: audit 2024-05-20T22:44:26.909119+0000 mon.a (mon.0) 4010 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:44:29.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:28 smithi050 bash[21866]: cluster 2024-05-20T22:44:27.605266+0000 mgr.y (mgr.14592) 1412 : cluster 0 pgmap v1886: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 932 B/s rd, 0 op/s 2024-05-20T22:44:29.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:28 smithi050 bash[28929]: cluster 2024-05-20T22:44:27.605266+0000 mgr.y (mgr.14592) 1412 : cluster 0 pgmap v1886: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 932 B/s rd, 0 op/s 2024-05-20T22:44:29.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:28 smithi145 bash[23893]: cluster 2024-05-20T22:44:27.605266+0000 mgr.y (mgr.14592) 1412 : cluster 0 pgmap v1886: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 932 B/s rd, 0 op/s 2024-05-20T22:44:29.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:44:29 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:44:29] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:44:29.885 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:44:29 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:44:31.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:30 smithi050 bash[21866]: audit 2024-05-20T22:44:29.577614+0000 mgr.y (mgr.14592) 1413 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:44:31.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:30 smithi050 bash[21866]: cluster 2024-05-20T22:44:29.606035+0000 mgr.y (mgr.14592) 1414 : cluster 0 pgmap v1887: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:31.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:30 smithi050 bash[28929]: audit 2024-05-20T22:44:29.577614+0000 mgr.y (mgr.14592) 1413 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:44:31.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:30 smithi050 bash[28929]: cluster 2024-05-20T22:44:29.606035+0000 mgr.y (mgr.14592) 1414 : cluster 0 pgmap v1887: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:31.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:30 smithi145 bash[23893]: audit 2024-05-20T22:44:29.577614+0000 mgr.y (mgr.14592) 1413 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:44:31.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:30 smithi145 bash[23893]: cluster 2024-05-20T22:44:29.606035+0000 mgr.y (mgr.14592) 1414 : cluster 0 pgmap v1887: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:33.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:32 smithi050 bash[21866]: cluster 2024-05-20T22:44:31.608070+0000 mgr.y (mgr.14592) 1415 : cluster 0 pgmap v1888: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:44:33.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:32 smithi050 bash[28929]: cluster 2024-05-20T22:44:31.608070+0000 mgr.y (mgr.14592) 1415 : cluster 0 pgmap v1888: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:44:33.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:32 smithi145 bash[23893]: cluster 2024-05-20T22:44:31.608070+0000 mgr.y (mgr.14592) 1415 : cluster 0 pgmap v1888: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:44:35.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:34 smithi050 bash[21866]: cluster 2024-05-20T22:44:33.608840+0000 mgr.y (mgr.14592) 1416 : cluster 0 pgmap v1889: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:35.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:34 smithi050 bash[28929]: cluster 2024-05-20T22:44:33.608840+0000 mgr.y (mgr.14592) 1416 : cluster 0 pgmap v1889: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:35.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:34 smithi145 bash[23893]: cluster 2024-05-20T22:44:33.608840+0000 mgr.y (mgr.14592) 1416 : cluster 0 pgmap v1889: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:37.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:36 smithi050 bash[21866]: cluster 2024-05-20T22:44:35.610877+0000 mgr.y (mgr.14592) 1417 : cluster 0 pgmap v1890: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:44:37.190 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:36 smithi050 bash[28929]: cluster 2024-05-20T22:44:35.610877+0000 mgr.y (mgr.14592) 1417 : cluster 0 pgmap v1890: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:44:37.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:36 smithi145 bash[23893]: cluster 2024-05-20T22:44:35.610877+0000 mgr.y (mgr.14592) 1417 : cluster 0 pgmap v1890: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:44:38.250 INFO:tasks.workunit.client.0.smithi050.stderr:+ rados -p 1c2932ce-1479-493b-8174-2751cae2b39e put threemore /etc/passwd 2024-05-20T22:44:38.295 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph osd pool set-quota 1c2932ce-1479-493b-8174-2751cae2b39e max_bytes 0 2024-05-20T22:44:38.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f44bd3c9640 1 -- 172.21.15.50:0/4101735006 >> v1:172.21.15.50:6789/0 conn(0x7f44b810dd00 legacy=0x7f44b810e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:44:38.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f44bd3c9640 1 -- 172.21.15.50:0/4101735006 shutdown_connections 2024-05-20T22:44:38.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f44bd3c9640 1 -- 172.21.15.50:0/4101735006 >> 172.21.15.50:0/4101735006 conn(0x7f44b8077490 msgr2=0x7f44b80798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:44:38.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f44bd3c9640 1 -- 172.21.15.50:0/4101735006 shutdown_connections 2024-05-20T22:44:38.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f44bd3c9640 1 -- 172.21.15.50:0/4101735006 wait complete. 2024-05-20T22:44:38.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f44bd3c9640 1 Processor -- start 2024-05-20T22:44:38.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f44bd3c9640 1 -- start start 2024-05-20T22:44:38.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f44bd3c9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f44b81acb60 con 0x7f44b810dd00 2024-05-20T22:44:38.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f44bd3c9640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f44b81adda0 con 0x7f44b8110b20 2024-05-20T22:44:38.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f44bd3c9640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f44b81aefe0 con 0x7f44b81146c0 2024-05-20T22:44:38.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f44b6ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f44b810dd00 0x7f44b810cfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45908/0 (socket says 172.21.15.50:45908) 2024-05-20T22:44:38.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f44b6ffd640 1 -- 172.21.15.50:0/2459095630 learned_addr learned my addr 172.21.15.50:0/2459095630 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:44:38.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3280699999 0 0) 0x7f44b81acb60 con 0x7f44b810dd00 2024-05-20T22:44:38.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44a0001ff0 con 0x7f44b810dd00 2024-05-20T22:44:38.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2095951219 0 0) 0x7f44b81aefe0 con 0x7f44b81146c0 2024-05-20T22:44:38.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44b81acb60 con 0x7f44b81146c0 2024-05-20T22:44:38.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2431738278 0 0) 0x7f44b81acb60 con 0x7f44b81146c0 2024-05-20T22:44:38.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44b81aefe0 con 0x7f44b81146c0 2024-05-20T22:44:38.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 877327077 0 0) 0x7f44a0001ff0 con 0x7f44b810dd00 2024-05-20T22:44:38.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44b81acb60 con 0x7f44b810dd00 2024-05-20T22:44:38.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f44a8001800 con 0x7f44b81146c0 2024-05-20T22:44:38.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f44b00048d0 con 0x7f44b810dd00 2024-05-20T22:44:38.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2632887172 0 0) 0x7f44b81adda0 con 0x7f44b8110b20 2024-05-20T22:44:38.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44a0001ff0 con 0x7f44b8110b20 2024-05-20T22:44:38.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 <== mon.2 v1:172.21.15.50:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1246256190 0 0) 0x7f44b81aefe0 con 0x7f44b81146c0 2024-05-20T22:44:38.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 >> v1:172.21.15.145:6789/0 conn(0x7f44b8110b20 legacy=0x7f44b81a7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:44:38.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 >> v1:172.21.15.50:6789/0 conn(0x7f44b810dd00 legacy=0x7f44b810cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:44:38.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 --> v1:172.21.15.50:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b81b0220 con 0x7f44b81146c0 2024-05-20T22:44:38.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f44bd3c9640 1 -- 172.21.15.50:0/2459095630 --> v1:172.21.15.50:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f44b81af1b0 con 0x7f44b81146c0 2024-05-20T22:44:38.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f44bd3c9640 1 -- 172.21.15.50:0/2459095630 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f44b81af670 con 0x7f44b81146c0 2024-05-20T22:44:38.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 <== mon.2 v1:172.21.15.50:6790/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f44a8003ab0 con 0x7f44b81146c0 2024-05-20T22:44:38.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 <== mon.2 v1:172.21.15.50:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f44a8004a40 con 0x7f44b81146c0 2024-05-20T22:44:38.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.422+0000 7f44bd3c9640 1 -- 172.21.15.50:0/2459095630 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a4005090 con 0x7f44b81146c0 2024-05-20T22:44:38.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.426+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 <== mon.2 v1:172.21.15.50:6790/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f44a8003620 con 0x7f44b81146c0 2024-05-20T22:44:38.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.426+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 <== mon.2 v1:172.21.15.50:6790/0 8 ==== osd_map(839..839 src has 256..839) ==== 8136+0+0 (unknown 3956496976 0 0) 0x7f44a8088a00 con 0x7f44b81146c0 2024-05-20T22:44:38.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.426+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=840}) -- 0x7f44b81aefe0 con 0x7f44b81146c0 2024-05-20T22:44:38.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.430+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 <== mon.2 v1:172.21.15.50:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f44a8055af0 con 0x7f44b81146c0 2024-05-20T22:44:38.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.598+0000 7f44bd3c9640 1 -- 172.21.15.50:0/2459095630 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"} v 0) -- 0x7f44a4005380 con 0x7f44b81146c0 2024-05-20T22:44:38.926 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.934+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 <== mon.2 v1:172.21.15.50:6790/0 10 ==== osd_map(840..840 src has 256..840) ==== 628+0+0 (unknown 2954795938 0 0) 0x7f44a80519d0 con 0x7f44b81146c0 2024-05-20T22:44:38.926 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.934+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=841}) -- 0x7f44b81acb60 con 0x7f44b81146c0 2024-05-20T22:44:38.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:38.942+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 <== mon.2 v1:172.21.15.50:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 1c2932ce-1479-493b-8174-2751cae2b39e v840) ==== 217+0+0 (unknown 804650674 0 0) 0x7f44a80597a0 con 0x7f44b81146c0 2024-05-20T22:44:39.045 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:39.050+0000 7f44bd3c9640 1 -- 172.21.15.50:0/2459095630 --> v1:172.21.15.50:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"} v 0) -- 0x7f44a4000c50 con 0x7f44b81146c0 2024-05-20T22:44:39.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:38 smithi145 bash[23893]: cluster 2024-05-20T22:44:37.611680+0000 mgr.y (mgr.14592) 1418 : cluster 0 pgmap v1891: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:39.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:38 smithi145 bash[23893]: audit 2024-05-20T22:44:38.604108+0000 mon.c (mon.2) 543 : audit 1 from='client.? v1:172.21.15.50:0/2459095630' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]: dispatch 2024-05-20T22:44:39.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:38 smithi145 bash[23893]: audit 2024-05-20T22:44:38.604630+0000 mon.a (mon.0) 4011 : audit 1 from='client.47882 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]: dispatch 2024-05-20T22:44:39.386 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:38 smithi050 bash[21866]: cluster 2024-05-20T22:44:37.611680+0000 mgr.y (mgr.14592) 1418 : cluster 0 pgmap v1891: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:39.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:38 smithi050 bash[21866]: audit 2024-05-20T22:44:38.604108+0000 mon.c (mon.2) 543 : audit 1 from='client.? v1:172.21.15.50:0/2459095630' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]: dispatch 2024-05-20T22:44:39.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:38 smithi050 bash[21866]: audit 2024-05-20T22:44:38.604630+0000 mon.a (mon.0) 4011 : audit 1 from='client.47882 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]: dispatch 2024-05-20T22:44:39.387 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:38 smithi050 bash[28929]: cluster 2024-05-20T22:44:37.611680+0000 mgr.y (mgr.14592) 1418 : cluster 0 pgmap v1891: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:39.387 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:38 smithi050 bash[28929]: audit 2024-05-20T22:44:38.604108+0000 mon.c (mon.2) 543 : audit 1 from='client.? v1:172.21.15.50:0/2459095630' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]: dispatch 2024-05-20T22:44:39.387 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:38 smithi050 bash[28929]: audit 2024-05-20T22:44:38.604630+0000 mon.a (mon.0) 4011 : audit 1 from='client.47882 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]: dispatch 2024-05-20T22:44:39.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:44:39 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:44:39] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:44:39.885 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:44:39 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:44:39.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:39.966+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 <== mon.2 v1:172.21.15.50:6790/0 12 ==== osd_map(841..841 src has 256..841) ==== 628+0+0 (unknown 78924476 0 0) 0x7f44a8054d50 con 0x7f44b81146c0 2024-05-20T22:44:39.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:39.966+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 --> v1:172.21.15.50:6790/0 -- mon_subscribe({osdmap=842}) -- 0x7f44b81adda0 con 0x7f44b81146c0 2024-05-20T22:44:39.968 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:39.974+0000 7f449ffff640 1 -- 172.21.15.50:0/2459095630 <== mon.2 v1:172.21.15.50:6790/0 13 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 1c2932ce-1479-493b-8174-2751cae2b39e v841) ==== 217+0+0 (unknown 4272878460 0 0) 0x7f44a805e060 con 0x7f44b81146c0 2024-05-20T22:44:39.969 INFO:tasks.workunit.client.0.smithi050.stderr:set-quota max_bytes = 0 for pool 1c2932ce-1479-493b-8174-2751cae2b39e 2024-05-20T22:44:39.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:39.978+0000 7f44bd3c9640 1 -- 172.21.15.50:0/2459095630 >> v1:172.21.15.50:6800/3332714287 conn(0x7f44a006eed0 legacy=0x7f44a0071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:44:39.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:39.978+0000 7f44bd3c9640 1 -- 172.21.15.50:0/2459095630 >> v1:172.21.15.50:6790/0 conn(0x7f44b81146c0 legacy=0x7f44b81ab260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:44:39.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:39.978+0000 7f44bd3c9640 1 -- 172.21.15.50:0/2459095630 shutdown_connections 2024-05-20T22:44:39.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:39.978+0000 7f44bd3c9640 1 -- 172.21.15.50:0/2459095630 >> 172.21.15.50:0/2459095630 conn(0x7f44b8077490 msgr2=0x7f44b8107cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:44:39.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:39.982+0000 7f44bd3c9640 1 -- 172.21.15.50:0/2459095630 shutdown_connections 2024-05-20T22:44:39.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:39.982+0000 7f44bd3c9640 1 -- 172.21.15.50:0/2459095630 wait complete. 2024-05-20T22:44:39.990 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph osd pool set-quota 1c2932ce-1479-493b-8174-2751cae2b39e max_objects 0 2024-05-20T22:44:40.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.118+0000 7f3a6a073640 1 -- 172.21.15.50:0/1016379043 >> v1:172.21.15.50:6789/0 conn(0x7f3a641146c0 legacy=0x7f3a64116b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:44:40.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.118+0000 7f3a6a073640 1 -- 172.21.15.50:0/1016379043 shutdown_connections 2024-05-20T22:44:40.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.118+0000 7f3a6a073640 1 -- 172.21.15.50:0/1016379043 >> 172.21.15.50:0/1016379043 conn(0x7f3a64077490 msgr2=0x7f3a640798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:44:40.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.118+0000 7f3a6a073640 1 -- 172.21.15.50:0/1016379043 shutdown_connections 2024-05-20T22:44:40.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.118+0000 7f3a6a073640 1 -- 172.21.15.50:0/1016379043 wait complete. 2024-05-20T22:44:40.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.118+0000 7f3a6a073640 1 Processor -- start 2024-05-20T22:44:40.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.118+0000 7f3a6a073640 1 -- start start 2024-05-20T22:44:40.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.118+0000 7f3a6a073640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f3a641acc50 con 0x7f3a64110b20 2024-05-20T22:44:40.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.118+0000 7f3a6a073640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f3a641ade90 con 0x7f3a6410dd00 2024-05-20T22:44:40.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.118+0000 7f3a6a073640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f3a641af0d0 con 0x7f3a641146c0 2024-05-20T22:44:40.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a62ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3a64110b20 0x7f3a641a7b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45922/0 (socket says 172.21.15.50:45922) 2024-05-20T22:44:40.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a62ffd640 1 -- 172.21.15.50:0/4104326128 learned_addr learned my addr 172.21.15.50:0/4104326128 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:44:40.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2017744942 0 0) 0x7f3a641acc50 con 0x7f3a64110b20 2024-05-20T22:44:40.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a50001ff0 con 0x7f3a64110b20 2024-05-20T22:44:40.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2086076535 0 0) 0x7f3a641af0d0 con 0x7f3a641146c0 2024-05-20T22:44:40.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a641acc50 con 0x7f3a641146c0 2024-05-20T22:44:40.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1553838637 0 0) 0x7f3a641ade90 con 0x7f3a6410dd00 2024-05-20T22:44:40.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a641af0d0 con 0x7f3a6410dd00 2024-05-20T22:44:40.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 911957769 0 0) 0x7f3a50001ff0 con 0x7f3a64110b20 2024-05-20T22:44:40.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3a641ade90 con 0x7f3a64110b20 2024-05-20T22:44:40.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f3a4c0019c0 con 0x7f3a64110b20 2024-05-20T22:44:40.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3868842966 0 0) 0x7f3a641acc50 con 0x7f3a641146c0 2024-05-20T22:44:40.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3a50001ff0 con 0x7f3a641146c0 2024-05-20T22:44:40.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f3a5c0047a0 con 0x7f3a641146c0 2024-05-20T22:44:40.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1542855437 0 0) 0x7f3a641ade90 con 0x7f3a64110b20 2024-05-20T22:44:40.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 >> v1:172.21.15.50:6790/0 conn(0x7f3a641146c0 legacy=0x7f3a641ab350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:44:40.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 >> v1:172.21.15.145:6789/0 conn(0x7f3a6410dd00 legacy=0x7f3a6410d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:44:40.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a641b0310 con 0x7f3a64110b20 2024-05-20T22:44:40.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a6a073640 1 -- 172.21.15.50:0/4104326128 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3a641af300 con 0x7f3a64110b20 2024-05-20T22:44:40.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a6a073640 1 -- 172.21.15.50:0/4104326128 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3a641af7c0 con 0x7f3a64110b20 2024-05-20T22:44:40.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f3a4c003a90 con 0x7f3a64110b20 2024-05-20T22:44:40.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f3a4c005be0 con 0x7f3a64110b20 2024-05-20T22:44:40.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a6a073640 1 -- 172.21.15.50:0/4104326128 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a641093b0 con 0x7f3a64110b20 2024-05-20T22:44:40.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f3a4c005d80 con 0x7f3a64110b20 2024-05-20T22:44:40.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(841..841 src has 256..841) ==== 8136+0+0 (unknown 864902668 0 0) 0x7f3a4c089fe0 con 0x7f3a64110b20 2024-05-20T22:44:40.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.122+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=842}) -- 0x7f3a641ade90 con 0x7f3a64110b20 2024-05-20T22:44:40.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.126+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f3a4c057bc0 con 0x7f3a64110b20 2024-05-20T22:44:40.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.302+0000 7f3a6a073640 1 -- 172.21.15.50:0/4104326128 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"} v 0) -- 0x7f3a6410b6a0 con 0x7f3a64110b20 2024-05-20T22:44:40.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:39 smithi145 bash[23893]: audit 2024-05-20T22:44:38.935090+0000 mon.a (mon.0) 4012 : audit 1 from='client.47882 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]': finished 2024-05-20T22:44:40.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:39 smithi145 bash[23893]: cluster 2024-05-20T22:44:38.943339+0000 mon.a (mon.0) 4013 : cluster 0 osdmap e840: 8 total, 8 up, 8 in 2024-05-20T22:44:40.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:39 smithi145 bash[23893]: audit 2024-05-20T22:44:39.055814+0000 mon.c (mon.2) 544 : audit 1 from='client.? v1:172.21.15.50:0/2459095630' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]: dispatch 2024-05-20T22:44:40.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:39 smithi145 bash[23893]: audit 2024-05-20T22:44:39.056551+0000 mon.a (mon.0) 4014 : audit 1 from='client.47882 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]: dispatch 2024-05-20T22:44:40.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:39 smithi050 bash[21866]: audit 2024-05-20T22:44:38.935090+0000 mon.a (mon.0) 4012 : audit 1 from='client.47882 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]': finished 2024-05-20T22:44:40.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:39 smithi050 bash[21866]: cluster 2024-05-20T22:44:38.943339+0000 mon.a (mon.0) 4013 : cluster 0 osdmap e840: 8 total, 8 up, 8 in 2024-05-20T22:44:40.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:39 smithi050 bash[21866]: audit 2024-05-20T22:44:39.055814+0000 mon.c (mon.2) 544 : audit 1 from='client.? v1:172.21.15.50:0/2459095630' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]: dispatch 2024-05-20T22:44:40.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:39 smithi050 bash[21866]: audit 2024-05-20T22:44:39.056551+0000 mon.a (mon.0) 4014 : audit 1 from='client.47882 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]: dispatch 2024-05-20T22:44:40.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:39 smithi050 bash[28929]: audit 2024-05-20T22:44:38.935090+0000 mon.a (mon.0) 4012 : audit 1 from='client.47882 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]': finished 2024-05-20T22:44:40.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:39 smithi050 bash[28929]: cluster 2024-05-20T22:44:38.943339+0000 mon.a (mon.0) 4013 : cluster 0 osdmap e840: 8 total, 8 up, 8 in 2024-05-20T22:44:40.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:39 smithi050 bash[28929]: audit 2024-05-20T22:44:39.055814+0000 mon.c (mon.2) 544 : audit 1 from='client.? v1:172.21.15.50:0/2459095630' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]: dispatch 2024-05-20T22:44:40.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:39 smithi050 bash[28929]: audit 2024-05-20T22:44:39.056551+0000 mon.a (mon.0) 4014 : audit 1 from='client.47882 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]: dispatch 2024-05-20T22:44:40.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.966+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 1c2932ce-1479-493b-8174-2751cae2b39e v842) ==== 221+0+0 (unknown 3065868637 0 0) 0x7f3a4c05b870 con 0x7f3a64110b20 2024-05-20T22:44:40.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.966+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 <== mon.0 v1:172.21.15.50:6789/0 11 ==== osd_map(842..842 src has 256..842) ==== 628+0+0 (unknown 3252479337 0 0) 0x7f3a4c087ca0 con 0x7f3a64110b20 2024-05-20T22:44:40.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:40.966+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=843}) -- 0x7f3a641acc50 con 0x7f3a64110b20 2024-05-20T22:44:41.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:41.082+0000 7f3a6a073640 1 -- 172.21.15.50:0/4104326128 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"} v 0) -- 0x7f3a64068940 con 0x7f3a64110b20 2024-05-20T22:44:41.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:40 smithi145 bash[23893]: audit 2024-05-20T22:44:39.588930+0000 mgr.y (mgr.14592) 1419 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:44:41.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:40 smithi145 bash[23893]: cluster 2024-05-20T22:44:39.612499+0000 mgr.y (mgr.14592) 1420 : cluster 0 pgmap v1893: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:44:41.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:40 smithi145 bash[23893]: audit 2024-05-20T22:44:39.965289+0000 mon.a (mon.0) 4015 : audit 1 from='client.47882 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]': finished 2024-05-20T22:44:41.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:40 smithi145 bash[23893]: cluster 2024-05-20T22:44:39.975690+0000 mon.a (mon.0) 4016 : cluster 0 osdmap e841: 8 total, 8 up, 8 in 2024-05-20T22:44:41.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:40 smithi145 bash[23893]: audit 2024-05-20T22:44:40.306003+0000 mon.a (mon.0) 4017 : audit 1 from='client.? v1:172.21.15.50:0/4104326128' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]: dispatch 2024-05-20T22:44:41.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:40 smithi050 bash[21866]: audit 2024-05-20T22:44:39.588930+0000 mgr.y (mgr.14592) 1419 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:44:41.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:40 smithi050 bash[21866]: cluster 2024-05-20T22:44:39.612499+0000 mgr.y (mgr.14592) 1420 : cluster 0 pgmap v1893: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:44:41.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:40 smithi050 bash[21866]: audit 2024-05-20T22:44:39.965289+0000 mon.a (mon.0) 4015 : audit 1 from='client.47882 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]': finished 2024-05-20T22:44:41.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:40 smithi050 bash[21866]: cluster 2024-05-20T22:44:39.975690+0000 mon.a (mon.0) 4016 : cluster 0 osdmap e841: 8 total, 8 up, 8 in 2024-05-20T22:44:41.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:40 smithi050 bash[21866]: audit 2024-05-20T22:44:40.306003+0000 mon.a (mon.0) 4017 : audit 1 from='client.? v1:172.21.15.50:0/4104326128' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]: dispatch 2024-05-20T22:44:41.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:40 smithi050 bash[28929]: audit 2024-05-20T22:44:39.588930+0000 mgr.y (mgr.14592) 1419 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:44:41.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:40 smithi050 bash[28929]: cluster 2024-05-20T22:44:39.612499+0000 mgr.y (mgr.14592) 1420 : cluster 0 pgmap v1893: 188 pgs: 188 active+clean; 870 KiB data, 868 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:44:41.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:40 smithi050 bash[28929]: audit 2024-05-20T22:44:39.965289+0000 mon.a (mon.0) 4015 : audit 1 from='client.47882 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_bytes", "val": "0"}]': finished 2024-05-20T22:44:41.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:40 smithi050 bash[28929]: cluster 2024-05-20T22:44:39.975690+0000 mon.a (mon.0) 4016 : cluster 0 osdmap e841: 8 total, 8 up, 8 in 2024-05-20T22:44:41.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:40 smithi050 bash[28929]: audit 2024-05-20T22:44:40.306003+0000 mon.a (mon.0) 4017 : audit 1 from='client.? v1:172.21.15.50:0/4104326128' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]: dispatch 2024-05-20T22:44:41.990 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:41.998+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 <== mon.0 v1:172.21.15.50:6789/0 12 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 1c2932ce-1479-493b-8174-2751cae2b39e v843) ==== 221+0+0 (unknown 921542844 0 0) 0x7f3a4c004330 con 0x7f3a64110b20 2024-05-20T22:44:41.990 INFO:tasks.workunit.client.0.smithi050.stderr:set-quota max_objects = 0 for pool 1c2932ce-1479-493b-8174-2751cae2b39e 2024-05-20T22:44:41.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:41.998+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 <== mon.0 v1:172.21.15.50:6789/0 13 ==== osd_map(843..843 src has 256..843) ==== 628+0+0 (unknown 1654005035 0 0) 0x7f3a4c053b20 con 0x7f3a64110b20 2024-05-20T22:44:41.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:41.998+0000 7f3a60ff9640 1 -- 172.21.15.50:0/4104326128 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=844}) -- 0x7f3a5007caf0 con 0x7f3a64110b20 2024-05-20T22:44:41.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:42.002+0000 7f3a6a073640 1 -- 172.21.15.50:0/4104326128 >> v1:172.21.15.50:6800/3332714287 conn(0x7f3a5006f120 legacy=0x7f3a500715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:44:41.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:42.002+0000 7f3a6a073640 1 -- 172.21.15.50:0/4104326128 >> v1:172.21.15.50:6789/0 conn(0x7f3a64110b20 legacy=0x7f3a641a7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:44:41.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:42.002+0000 7f3a6a073640 1 -- 172.21.15.50:0/4104326128 shutdown_connections 2024-05-20T22:44:41.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:42.002+0000 7f3a6a073640 1 -- 172.21.15.50:0/4104326128 >> 172.21.15.50:0/4104326128 conn(0x7f3a64077490 msgr2=0x7f3a64117870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:44:41.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:42.002+0000 7f3a6a073640 1 -- 172.21.15.50:0/4104326128 shutdown_connections 2024-05-20T22:44:41.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:44:42.002+0000 7f3a6a073640 1 -- 172.21.15.50:0/4104326128 wait complete. 2024-05-20T22:44:42.016 INFO:tasks.workunit.client.0.smithi050.stderr:+ sleep 30 2024-05-20T22:44:42.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:41 smithi145 bash[23893]: audit 2024-05-20T22:44:40.967983+0000 mon.a (mon.0) 4018 : audit 1 from='client.? v1:172.21.15.50:0/4104326128' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]': finished 2024-05-20T22:44:42.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:41 smithi145 bash[23893]: cluster 2024-05-20T22:44:40.977996+0000 mon.a (mon.0) 4019 : cluster 0 osdmap e842: 8 total, 8 up, 8 in 2024-05-20T22:44:42.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:41 smithi145 bash[23893]: audit 2024-05-20T22:44:41.084945+0000 mon.a (mon.0) 4020 : audit 1 from='client.? v1:172.21.15.50:0/4104326128' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]: dispatch 2024-05-20T22:44:42.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:41 smithi145 bash[23893]: audit 2024-05-20T22:44:41.939589+0000 mon.a (mon.0) 4021 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:44:42.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:41 smithi050 bash[21866]: audit 2024-05-20T22:44:40.967983+0000 mon.a (mon.0) 4018 : audit 1 from='client.? v1:172.21.15.50:0/4104326128' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]': finished 2024-05-20T22:44:42.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:41 smithi050 bash[21866]: cluster 2024-05-20T22:44:40.977996+0000 mon.a (mon.0) 4019 : cluster 0 osdmap e842: 8 total, 8 up, 8 in 2024-05-20T22:44:42.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:41 smithi050 bash[21866]: audit 2024-05-20T22:44:41.084945+0000 mon.a (mon.0) 4020 : audit 1 from='client.? v1:172.21.15.50:0/4104326128' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]: dispatch 2024-05-20T22:44:42.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:41 smithi050 bash[21866]: audit 2024-05-20T22:44:41.939589+0000 mon.a (mon.0) 4021 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:44:42.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:41 smithi050 bash[28929]: audit 2024-05-20T22:44:40.967983+0000 mon.a (mon.0) 4018 : audit 1 from='client.? v1:172.21.15.50:0/4104326128' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]': finished 2024-05-20T22:44:42.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:41 smithi050 bash[28929]: cluster 2024-05-20T22:44:40.977996+0000 mon.a (mon.0) 4019 : cluster 0 osdmap e842: 8 total, 8 up, 8 in 2024-05-20T22:44:42.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:41 smithi050 bash[28929]: audit 2024-05-20T22:44:41.084945+0000 mon.a (mon.0) 4020 : audit 1 from='client.? v1:172.21.15.50:0/4104326128' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]: dispatch 2024-05-20T22:44:42.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:41 smithi050 bash[28929]: audit 2024-05-20T22:44:41.939589+0000 mon.a (mon.0) 4021 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:44:43.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:43 smithi145 bash[23893]: cluster 2024-05-20T22:44:41.613286+0000 mgr.y (mgr.14592) 1421 : cluster 0 pgmap v1896: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 2.0 KiB/s wr, 0 op/s 2024-05-20T22:44:43.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:43 smithi145 bash[23893]: audit 2024-05-20T22:44:42.000129+0000 mon.a (mon.0) 4022 : audit 1 from='client.? v1:172.21.15.50:0/4104326128' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]': finished 2024-05-20T22:44:43.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:43 smithi145 bash[23893]: cluster 2024-05-20T22:44:42.005617+0000 mon.a (mon.0) 4023 : cluster 0 osdmap e843: 8 total, 8 up, 8 in 2024-05-20T22:44:43.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:43 smithi050 bash[21866]: cluster 2024-05-20T22:44:41.613286+0000 mgr.y (mgr.14592) 1421 : cluster 0 pgmap v1896: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 2.0 KiB/s wr, 0 op/s 2024-05-20T22:44:43.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:43 smithi050 bash[21866]: audit 2024-05-20T22:44:42.000129+0000 mon.a (mon.0) 4022 : audit 1 from='client.? v1:172.21.15.50:0/4104326128' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]': finished 2024-05-20T22:44:43.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:43 smithi050 bash[21866]: cluster 2024-05-20T22:44:42.005617+0000 mon.a (mon.0) 4023 : cluster 0 osdmap e843: 8 total, 8 up, 8 in 2024-05-20T22:44:43.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:43 smithi050 bash[28929]: cluster 2024-05-20T22:44:41.613286+0000 mgr.y (mgr.14592) 1421 : cluster 0 pgmap v1896: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 2.0 KiB/s wr, 0 op/s 2024-05-20T22:44:43.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:43 smithi050 bash[28929]: audit 2024-05-20T22:44:42.000129+0000 mon.a (mon.0) 4022 : audit 1 from='client.? v1:172.21.15.50:0/4104326128' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "field": "max_objects", "val": "0"}]': finished 2024-05-20T22:44:43.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:43 smithi050 bash[28929]: cluster 2024-05-20T22:44:42.005617+0000 mon.a (mon.0) 4023 : cluster 0 osdmap e843: 8 total, 8 up, 8 in 2024-05-20T22:44:45.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:45 smithi145 bash[23893]: cluster 2024-05-20T22:44:43.614066+0000 mgr.y (mgr.14592) 1422 : cluster 0 pgmap v1898: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.6 KiB/s wr, 1 op/s 2024-05-20T22:44:45.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:45 smithi050 bash[21866]: cluster 2024-05-20T22:44:43.614066+0000 mgr.y (mgr.14592) 1422 : cluster 0 pgmap v1898: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.6 KiB/s wr, 1 op/s 2024-05-20T22:44:45.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:45 smithi050 bash[28929]: cluster 2024-05-20T22:44:43.614066+0000 mgr.y (mgr.14592) 1422 : cluster 0 pgmap v1898: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.6 KiB/s wr, 1 op/s 2024-05-20T22:44:47.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:47 smithi145 bash[23893]: cluster 2024-05-20T22:44:45.616087+0000 mgr.y (mgr.14592) 1423 : cluster 0 pgmap v1899: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 1 op/s 2024-05-20T22:44:47.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:47 smithi050 bash[21866]: cluster 2024-05-20T22:44:45.616087+0000 mgr.y (mgr.14592) 1423 : cluster 0 pgmap v1899: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 1 op/s 2024-05-20T22:44:47.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:47 smithi050 bash[28929]: cluster 2024-05-20T22:44:45.616087+0000 mgr.y (mgr.14592) 1423 : cluster 0 pgmap v1899: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 1 op/s 2024-05-20T22:44:49.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:49 smithi145 bash[23893]: cluster 2024-05-20T22:44:47.616863+0000 mgr.y (mgr.14592) 1424 : cluster 0 pgmap v1900: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 669 B/s rd, 0 op/s 2024-05-20T22:44:49.386 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:49 smithi050 bash[21866]: cluster 2024-05-20T22:44:47.616863+0000 mgr.y (mgr.14592) 1424 : cluster 0 pgmap v1900: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 669 B/s rd, 0 op/s 2024-05-20T22:44:49.386 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:49 smithi050 bash[28929]: cluster 2024-05-20T22:44:47.616863+0000 mgr.y (mgr.14592) 1424 : cluster 0 pgmap v1900: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 669 B/s rd, 0 op/s 2024-05-20T22:44:49.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:44:49 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:44:49] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:44:49.885 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:44:49 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:44:50.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:50 smithi145 bash[23893]: audit 2024-05-20T22:44:49.243778+0000 mon.a (mon.0) 4024 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:44:50.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:50 smithi145 bash[23893]: audit 2024-05-20T22:44:49.948955+0000 mon.a (mon.0) 4025 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:44:50.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:50 smithi145 bash[23893]: audit 2024-05-20T22:44:49.950298+0000 mon.a (mon.0) 4026 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:44:50.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:50 smithi145 bash[23893]: audit 2024-05-20T22:44:49.957381+0000 mon.a (mon.0) 4027 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:44:50.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:50 smithi050 bash[21866]: audit 2024-05-20T22:44:49.243778+0000 mon.a (mon.0) 4024 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:44:50.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:50 smithi050 bash[21866]: audit 2024-05-20T22:44:49.948955+0000 mon.a (mon.0) 4025 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:44:50.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:50 smithi050 bash[21866]: audit 2024-05-20T22:44:49.950298+0000 mon.a (mon.0) 4026 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:44:50.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:50 smithi050 bash[21866]: audit 2024-05-20T22:44:49.957381+0000 mon.a (mon.0) 4027 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:44:50.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:50 smithi050 bash[28929]: audit 2024-05-20T22:44:49.243778+0000 mon.a (mon.0) 4024 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T22:44:50.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:50 smithi050 bash[28929]: audit 2024-05-20T22:44:49.948955+0000 mon.a (mon.0) 4025 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T22:44:50.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:50 smithi050 bash[28929]: audit 2024-05-20T22:44:49.950298+0000 mon.a (mon.0) 4026 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T22:44:50.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:50 smithi050 bash[28929]: audit 2024-05-20T22:44:49.957381+0000 mon.a (mon.0) 4027 : audit 1 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' 2024-05-20T22:44:51.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:51 smithi145 bash[23893]: audit 2024-05-20T22:44:49.597713+0000 mgr.y (mgr.14592) 1425 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:44:51.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:51 smithi145 bash[23893]: cluster 2024-05-20T22:44:49.617616+0000 mgr.y (mgr.14592) 1426 : cluster 0 pgmap v1901: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 592 B/s rd, 0 op/s 2024-05-20T22:44:51.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:51 smithi050 bash[21866]: audit 2024-05-20T22:44:49.597713+0000 mgr.y (mgr.14592) 1425 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:44:51.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:51 smithi050 bash[21866]: cluster 2024-05-20T22:44:49.617616+0000 mgr.y (mgr.14592) 1426 : cluster 0 pgmap v1901: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 592 B/s rd, 0 op/s 2024-05-20T22:44:51.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:51 smithi050 bash[28929]: audit 2024-05-20T22:44:49.597713+0000 mgr.y (mgr.14592) 1425 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:44:51.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:51 smithi050 bash[28929]: cluster 2024-05-20T22:44:49.617616+0000 mgr.y (mgr.14592) 1426 : cluster 0 pgmap v1901: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 592 B/s rd, 0 op/s 2024-05-20T22:44:53.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:53 smithi145 bash[23893]: cluster 2024-05-20T22:44:51.619596+0000 mgr.y (mgr.14592) 1427 : cluster 0 pgmap v1902: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:44:53.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:53 smithi050 bash[21866]: cluster 2024-05-20T22:44:51.619596+0000 mgr.y (mgr.14592) 1427 : cluster 0 pgmap v1902: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:44:53.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:53 smithi050 bash[28929]: cluster 2024-05-20T22:44:51.619596+0000 mgr.y (mgr.14592) 1427 : cluster 0 pgmap v1902: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:44:55.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:55 smithi145 bash[23893]: cluster 2024-05-20T22:44:53.620395+0000 mgr.y (mgr.14592) 1428 : cluster 0 pgmap v1903: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 881 B/s rd, 0 op/s 2024-05-20T22:44:55.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:55 smithi050 bash[21866]: cluster 2024-05-20T22:44:53.620395+0000 mgr.y (mgr.14592) 1428 : cluster 0 pgmap v1903: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 881 B/s rd, 0 op/s 2024-05-20T22:44:55.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:55 smithi050 bash[28929]: cluster 2024-05-20T22:44:53.620395+0000 mgr.y (mgr.14592) 1428 : cluster 0 pgmap v1903: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 881 B/s rd, 0 op/s 2024-05-20T22:44:57.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:57 smithi145 bash[23893]: cluster 2024-05-20T22:44:55.622409+0000 mgr.y (mgr.14592) 1429 : cluster 0 pgmap v1904: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:44:57.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:57 smithi145 bash[23893]: audit 2024-05-20T22:44:56.969227+0000 mon.a (mon.0) 4028 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:44:57.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:57 smithi050 bash[21866]: cluster 2024-05-20T22:44:55.622409+0000 mgr.y (mgr.14592) 1429 : cluster 0 pgmap v1904: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:44:57.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:57 smithi050 bash[21866]: audit 2024-05-20T22:44:56.969227+0000 mon.a (mon.0) 4028 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:44:57.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:57 smithi050 bash[28929]: cluster 2024-05-20T22:44:55.622409+0000 mgr.y (mgr.14592) 1429 : cluster 0 pgmap v1904: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:44:57.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:57 smithi050 bash[28929]: audit 2024-05-20T22:44:56.969227+0000 mon.a (mon.0) 4028 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:44:59.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:44:59 smithi145 bash[23893]: cluster 2024-05-20T22:44:57.623192+0000 mgr.y (mgr.14592) 1430 : cluster 0 pgmap v1905: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:59.386 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:44:59 smithi050 bash[21866]: cluster 2024-05-20T22:44:57.623192+0000 mgr.y (mgr.14592) 1430 : cluster 0 pgmap v1905: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:59.386 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:44:59 smithi050 bash[28929]: cluster 2024-05-20T22:44:57.623192+0000 mgr.y (mgr.14592) 1430 : cluster 0 pgmap v1905: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:44:59.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:44:59 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:44:59] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:44:59.885 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:44:59 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:45:01.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:45:01 smithi145 bash[23893]: audit 2024-05-20T22:44:59.609039+0000 mgr.y (mgr.14592) 1431 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:45:01.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:45:01 smithi145 bash[23893]: cluster 2024-05-20T22:44:59.623989+0000 mgr.y (mgr.14592) 1432 : cluster 0 pgmap v1906: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:45:01.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:45:01 smithi050 bash[21866]: audit 2024-05-20T22:44:59.609039+0000 mgr.y (mgr.14592) 1431 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:45:01.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:45:01 smithi050 bash[21866]: cluster 2024-05-20T22:44:59.623989+0000 mgr.y (mgr.14592) 1432 : cluster 0 pgmap v1906: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:45:01.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:45:01 smithi050 bash[28929]: audit 2024-05-20T22:44:59.609039+0000 mgr.y (mgr.14592) 1431 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:45:01.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:45:01 smithi050 bash[28929]: cluster 2024-05-20T22:44:59.623989+0000 mgr.y (mgr.14592) 1432 : cluster 0 pgmap v1906: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:45:03.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:45:03 smithi145 bash[23893]: cluster 2024-05-20T22:45:01.625951+0000 mgr.y (mgr.14592) 1433 : cluster 0 pgmap v1907: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:45:03.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:45:03 smithi050 bash[28929]: cluster 2024-05-20T22:45:01.625951+0000 mgr.y (mgr.14592) 1433 : cluster 0 pgmap v1907: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:45:03.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:45:03 smithi050 bash[21866]: cluster 2024-05-20T22:45:01.625951+0000 mgr.y (mgr.14592) 1433 : cluster 0 pgmap v1907: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:45:05.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:45:05 smithi145 bash[23893]: cluster 2024-05-20T22:45:03.626751+0000 mgr.y (mgr.14592) 1434 : cluster 0 pgmap v1908: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:45:05.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:45:05 smithi050 bash[28929]: cluster 2024-05-20T22:45:03.626751+0000 mgr.y (mgr.14592) 1434 : cluster 0 pgmap v1908: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:45:05.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:45:05 smithi050 bash[21866]: cluster 2024-05-20T22:45:03.626751+0000 mgr.y (mgr.14592) 1434 : cluster 0 pgmap v1908: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:45:07.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:45:07 smithi145 bash[23893]: cluster 2024-05-20T22:45:05.628782+0000 mgr.y (mgr.14592) 1435 : cluster 0 pgmap v1909: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:45:07.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:45:07 smithi050 bash[28929]: cluster 2024-05-20T22:45:05.628782+0000 mgr.y (mgr.14592) 1435 : cluster 0 pgmap v1909: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:45:07.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:45:07 smithi050 bash[21866]: cluster 2024-05-20T22:45:05.628782+0000 mgr.y (mgr.14592) 1435 : cluster 0 pgmap v1909: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:45:09.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:45:09 smithi145 bash[23893]: cluster 2024-05-20T22:45:07.629582+0000 mgr.y (mgr.14592) 1436 : cluster 0 pgmap v1910: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:45:09.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:45:09 smithi050 bash[21866]: cluster 2024-05-20T22:45:07.629582+0000 mgr.y (mgr.14592) 1436 : cluster 0 pgmap v1910: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:45:09.387 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:45:09 smithi050 bash[28929]: cluster 2024-05-20T22:45:07.629582+0000 mgr.y (mgr.14592) 1436 : cluster 0 pgmap v1910: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:45:09.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:45:09 smithi050 bash[22118]: ::ffff:172.21.15.145 - - [20/May/2024:22:45:09] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-05-20T22:45:09.885 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:45:09 smithi145 bash[48584]: debug there is no tcmu-runner data available 2024-05-20T22:45:11.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:45:11 smithi145 bash[23893]: audit 2024-05-20T22:45:09.617892+0000 mgr.y (mgr.14592) 1437 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:45:11.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:45:11 smithi145 bash[23893]: cluster 2024-05-20T22:45:09.630357+0000 mgr.y (mgr.14592) 1438 : cluster 0 pgmap v1911: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:45:11.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:45:11 smithi050 bash[21866]: audit 2024-05-20T22:45:09.617892+0000 mgr.y (mgr.14592) 1437 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:45:11.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:45:11 smithi050 bash[21866]: cluster 2024-05-20T22:45:09.630357+0000 mgr.y (mgr.14592) 1438 : cluster 0 pgmap v1911: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:45:11.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:45:11 smithi050 bash[28929]: audit 2024-05-20T22:45:09.617892+0000 mgr.y (mgr.14592) 1437 : audit 0 from='client.24496 v1:172.21.15.145:0/1854341890' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-20T22:45:11.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:45:11 smithi050 bash[28929]: cluster 2024-05-20T22:45:09.630357+0000 mgr.y (mgr.14592) 1438 : cluster 0 pgmap v1911: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-20T22:45:12.017 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph osd pool delete 1c2932ce-1479-493b-8174-2751cae2b39e 1c2932ce-1479-493b-8174-2751cae2b39e --yes-i-really-really-mean-it 2024-05-20T22:45:12.153 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18b83be640 1 -- 172.21.15.50:0/2353181468 >> v1:172.21.15.50:6789/0 conn(0x7f18b010dd00 legacy=0x7f18b010e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:45:12.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18b83be640 1 -- 172.21.15.50:0/2353181468 shutdown_connections 2024-05-20T22:45:12.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18b83be640 1 -- 172.21.15.50:0/2353181468 >> 172.21.15.50:0/2353181468 conn(0x7f18b0077490 msgr2=0x7f18b00798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:45:12.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18b83be640 1 -- 172.21.15.50:0/2353181468 shutdown_connections 2024-05-20T22:45:12.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18b83be640 1 -- 172.21.15.50:0/2353181468 wait complete. 2024-05-20T22:45:12.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18b83be640 1 Processor -- start 2024-05-20T22:45:12.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18b83be640 1 -- start start 2024-05-20T22:45:12.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18b83be640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f18b01acb20 con 0x7f18b0110b20 2024-05-20T22:45:12.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18b83be640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f18b01add60 con 0x7f18b01146c0 2024-05-20T22:45:12.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18b83be640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f18b01aefa0 con 0x7f18b010dd00 2024-05-20T22:45:12.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18b5959640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f18b0110b20 0x7f18b01a7b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56388/0 (socket says 172.21.15.50:56388) 2024-05-20T22:45:12.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18b615a640 1 --1- >> v1:172.21.15.50:6790/0 conn(0x7f18b010dd00 0x7f18b010cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6790/0 says I am v1:172.21.15.50:36034/0 (socket says 172.21.15.50:36034) 2024-05-20T22:45:12.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18b5959640 1 -- 172.21.15.50:0/4246523161 learned_addr learned my addr 172.21.15.50:0/4246523161 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:45:12.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 533676269 0 0) 0x7f18b01acb20 con 0x7f18b0110b20 2024-05-20T22:45:12.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f189c003250 con 0x7f18b0110b20 2024-05-20T22:45:12.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2857654420 0 0) 0x7f18b01aefa0 con 0x7f18b010dd00 2024-05-20T22:45:12.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18b01acb20 con 0x7f18b010dd00 2024-05-20T22:45:12.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1545361223 0 0) 0x7f189c003250 con 0x7f18b0110b20 2024-05-20T22:45:12.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f18b01aefa0 con 0x7f18b0110b20 2024-05-20T22:45:12.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f18ac001920 con 0x7f18b0110b20 2024-05-20T22:45:12.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1530788421 0 0) 0x7f18b01acb20 con 0x7f18b010dd00 2024-05-20T22:45:12.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f189c003250 con 0x7f18b010dd00 2024-05-20T22:45:12.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f18a00044c0 con 0x7f18b010dd00 2024-05-20T22:45:12.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2487225311 0 0) 0x7f18b01add60 con 0x7f18b01146c0 2024-05-20T22:45:12.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18b01acb20 con 0x7f18b01146c0 2024-05-20T22:45:12.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1506142297 0 0) 0x7f18b01aefa0 con 0x7f18b0110b20 2024-05-20T22:45:12.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 >> v1:172.21.15.50:6790/0 conn(0x7f18b010dd00 legacy=0x7f18b010cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:45:12.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 >> v1:172.21.15.145:6789/0 conn(0x7f18b01146c0 legacy=0x7f18b01ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:45:12.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b01b01e0 con 0x7f18b0110b20 2024-05-20T22:45:12.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18b83be640 1 -- 172.21.15.50:0/4246523161 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f18b01af1d0 con 0x7f18b0110b20 2024-05-20T22:45:12.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18b83be640 1 -- 172.21.15.50:0/4246523161 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f18b01af690 con 0x7f18b0110b20 2024-05-20T22:45:12.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f18ac003b30 con 0x7f18b0110b20 2024-05-20T22:45:12.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f18ac005ce0 con 0x7f18b0110b20 2024-05-20T22:45:12.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.161+0000 7f18b83be640 1 -- 172.21.15.50:0/4246523161 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1894005090 con 0x7f18b0110b20 2024-05-20T22:45:12.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.165+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f18ac0036a0 con 0x7f18b0110b20 2024-05-20T22:45:12.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.165+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(843..843 src has 256..843) ==== 8136+0+0 (unknown 2011010435 0 0) 0x7f18ac089b50 con 0x7f18b0110b20 2024-05-20T22:45:12.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.165+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=844}) -- 0x7f18b01aefa0 con 0x7f18b0110b20 2024-05-20T22:45:12.162 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.169+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f18ac056c40 con 0x7f18b0110b20 2024-05-20T22:45:12.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:12.345+0000 7f18b83be640 1 -- 172.21.15.50:0/4246523161 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "osd pool delete", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pool2": "1c2932ce-1479-493b-8174-2751cae2b39e", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1894005380 con 0x7f18b0110b20 2024-05-20T22:45:12.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:45:12 smithi145 bash[23893]: cluster 2024-05-20T22:45:11.632377+0000 mgr.y (mgr.14592) 1439 : cluster 0 pgmap v1912: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:45:12.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:45:12 smithi145 bash[23893]: audit 2024-05-20T22:45:12.000800+0000 mon.a (mon.0) 4029 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:45:12.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:45:12 smithi050 bash[21866]: cluster 2024-05-20T22:45:11.632377+0000 mgr.y (mgr.14592) 1439 : cluster 0 pgmap v1912: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:45:12.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:45:12 smithi050 bash[21866]: audit 2024-05-20T22:45:12.000800+0000 mon.a (mon.0) 4029 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:45:12.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:45:12 smithi050 bash[28929]: cluster 2024-05-20T22:45:11.632377+0000 mgr.y (mgr.14592) 1439 : cluster 0 pgmap v1912: 188 pgs: 188 active+clean; 882 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-20T22:45:12.439 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:45:12 smithi050 bash[28929]: audit 2024-05-20T22:45:12.000800+0000 mon.a (mon.0) 4029 : audit 0 from='mgr.14592 v1:172.21.15.50:0/2045786407' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-20T22:45:13.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.081+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pool2": "1c2932ce-1479-493b-8174-2751cae2b39e", "yes_i_really_really_mean_it": true}]=0 pool '1c2932ce-1479-493b-8174-2751cae2b39e' removed v844) ==== 248+0+0 (unknown 611317253 0 0) 0x7f18ac05a8f0 con 0x7f18b0110b20 2024-05-20T22:45:13.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.085+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 <== mon.0 v1:172.21.15.50:6789/0 11 ==== osd_map(844..844 src has 256..844) ==== 296+0+0 (unknown 2746008212 0 0) 0x7f18ac052200 con 0x7f18b0110b20 2024-05-20T22:45:13.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.085+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=845}) -- 0x7f189c003250 con 0x7f18b0110b20 2024-05-20T22:45:13.197 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.205+0000 7f18b83be640 1 -- 172.21.15.50:0/4246523161 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "osd pool delete", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pool2": "1c2932ce-1479-493b-8174-2751cae2b39e", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1894001190 con 0x7f18b0110b20 2024-05-20T22:45:13.198 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.205+0000 7f18a77fe640 1 -- 172.21.15.50:0/4246523161 <== mon.0 v1:172.21.15.50:6789/0 12 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pool2": "1c2932ce-1479-493b-8174-2751cae2b39e", "yes_i_really_really_mean_it": true}]=0 pool '1c2932ce-1479-493b-8174-2751cae2b39e' does not exist v844) ==== 255+0+0 (unknown 2178065461 0 0) 0x7f18ac05f1b0 con 0x7f18b0110b20 2024-05-20T22:45:13.198 INFO:tasks.workunit.client.0.smithi050.stderr:pool '1c2932ce-1479-493b-8174-2751cae2b39e' does not exist 2024-05-20T22:45:13.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.205+0000 7f18b83be640 1 -- 172.21.15.50:0/4246523161 >> v1:172.21.15.50:6800/3332714287 conn(0x7f189c06ee90 legacy=0x7f189c071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:45:13.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.205+0000 7f18b83be640 1 -- 172.21.15.50:0/4246523161 >> v1:172.21.15.50:6789/0 conn(0x7f18b0110b20 legacy=0x7f18b01a7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:45:13.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.205+0000 7f18b83be640 1 -- 172.21.15.50:0/4246523161 shutdown_connections 2024-05-20T22:45:13.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.205+0000 7f18b83be640 1 -- 172.21.15.50:0/4246523161 >> 172.21.15.50:0/4246523161 conn(0x7f18b0077490 msgr2=0x7f18b0114b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:45:13.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.205+0000 7f18b83be640 1 -- 172.21.15.50:0/4246523161 shutdown_connections 2024-05-20T22:45:13.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.205+0000 7f18b83be640 1 -- 172.21.15.50:0/4246523161 wait complete. 2024-05-20T22:45:13.216 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph osd pool delete 6ad12e91-8c60-495a-811b-e1be6780ecc0 6ad12e91-8c60-495a-811b-e1be6780ecc0 --yes-i-really-really-mean-it 2024-05-20T22:45:13.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f04a5e25640 1 -- 172.21.15.50:0/2379702727 >> v1:172.21.15.50:6790/0 conn(0x7f04a0100410 legacy=0x7f04a01007f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:45:13.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f04a5e25640 1 -- 172.21.15.50:0/2379702727 shutdown_connections 2024-05-20T22:45:13.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f04a5e25640 1 -- 172.21.15.50:0/2379702727 >> 172.21.15.50:0/2379702727 conn(0x7f04a00fc070 msgr2=0x7f04a00fe490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:45:13.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f04a5e25640 1 -- 172.21.15.50:0/2379702727 shutdown_connections 2024-05-20T22:45:13.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f04a5e25640 1 -- 172.21.15.50:0/2379702727 wait complete. 2024-05-20T22:45:13.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f04a5e25640 1 Processor -- start 2024-05-20T22:45:13.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f04a5e25640 1 -- start start 2024-05-20T22:45:13.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f04a5e25640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f04a01a8790 con 0x7f04a0100410 2024-05-20T22:45:13.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f04a5e25640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f04a01a99d0 con 0x7f04a0100ff0 2024-05-20T22:45:13.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f04a5e25640 1 -- --> v1:172.21.15.50:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f04a01aac10 con 0x7f04a01102e0 2024-05-20T22:45:13.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f049f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f04a0100410 0x7f04a010e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56410/0 (socket says 172.21.15.50:56410) 2024-05-20T22:45:13.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f049f7fe640 1 -- 172.21.15.50:0/1858767154 learned_addr learned my addr 172.21.15.50:0/1858767154 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-20T22:45:13.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 619268509 0 0) 0x7f04a01a8790 con 0x7f04a0100410 2024-05-20T22:45:13.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0488003530 con 0x7f04a0100410 2024-05-20T22:45:13.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 <== mon.2 v1:172.21.15.50:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2839630226 0 0) 0x7f04a01aac10 con 0x7f04a01102e0 2024-05-20T22:45:13.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 --> v1:172.21.15.50:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04a01a8790 con 0x7f04a01102e0 2024-05-20T22:45:13.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3321872274 0 0) 0x7f0488003530 con 0x7f04a0100410 2024-05-20T22:45:13.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 --> v1:172.21.15.50:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f04a01aac10 con 0x7f04a0100410 2024-05-20T22:45:13.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f0490004600 con 0x7f04a0100410 2024-05-20T22:45:13.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 <== mon.2 v1:172.21.15.50:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 481740177 0 0) 0x7f04a01a8790 con 0x7f04a01102e0 2024-05-20T22:45:13.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 --> v1:172.21.15.50:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0488003530 con 0x7f04a01102e0 2024-05-20T22:45:13.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 <== mon.2 v1:172.21.15.50:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f0498001c00 con 0x7f04a01102e0 2024-05-20T22:45:13.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3085546703 0 0) 0x7f04a01a99d0 con 0x7f04a0100ff0 2024-05-20T22:45:13.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04a01a8790 con 0x7f04a0100ff0 2024-05-20T22:45:13.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 <== mon.0 v1:172.21.15.50:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2467110067 0 0) 0x7f04a01aac10 con 0x7f04a0100410 2024-05-20T22:45:13.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 >> v1:172.21.15.50:6790/0 conn(0x7f04a01102e0 legacy=0x7f04a01a6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:45:13.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 >> v1:172.21.15.145:6789/0 conn(0x7f04a0100ff0 legacy=0x7f04a01a3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:45:13.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a01abe50 con 0x7f04a0100410 2024-05-20T22:45:13.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f04a5e25640 1 -- 172.21.15.50:0/1858767154 --> v1:172.21.15.50:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f04a01aae40 con 0x7f04a0100410 2024-05-20T22:45:13.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f04a5e25640 1 -- 172.21.15.50:0/1858767154 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f04a01ab300 con 0x7f04a0100410 2024-05-20T22:45:13.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 <== mon.0 v1:172.21.15.50:6789/0 5 ==== config(25 keys) ==== 1068+0+0 (unknown 3511714155 0 0) 0x7f0490001c00 con 0x7f04a0100410 2024-05-20T22:45:13.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 <== mon.0 v1:172.21.15.50:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 32047609 0 0) 0x7f0490004dd0 con 0x7f04a0100410 2024-05-20T22:45:13.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.341+0000 7f04a5e25640 1 -- 172.21.15.50:0/1858767154 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f048c0050c0 con 0x7f04a0100410 2024-05-20T22:45:13.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.345+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 <== mon.0 v1:172.21.15.50:6789/0 7 ==== mgrmap(e 22) ==== 92138+0+0 (unknown 1988104844 0 0) 0x7f0490004f90 con 0x7f04a0100410 2024-05-20T22:45:13.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.345+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 <== mon.0 v1:172.21.15.50:6789/0 8 ==== osd_map(844..844 src has 256..844) ==== 7748+0+0 (unknown 4146723885 0 0) 0x7f0490089d30 con 0x7f04a0100410 2024-05-20T22:45:13.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.345+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=845}) -- 0x7f04a01aac10 con 0x7f04a0100410 2024-05-20T22:45:13.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.349+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 <== mon.0 v1:172.21.15.50:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (unknown 1092875540 0 3075472397) 0x7f0490056e60 con 0x7f04a0100410 2024-05-20T22:45:13.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:45:13 smithi145 bash[23893]: audit 2024-05-20T22:45:12.349709+0000 mon.a (mon.0) 4030 : audit 1 from='client.? v1:172.21.15.50:0/4246523161' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pool2": "1c2932ce-1479-493b-8174-2751cae2b39e", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T22:45:13.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:45:13 smithi050 bash[21866]: audit 2024-05-20T22:45:12.349709+0000 mon.a (mon.0) 4030 : audit 1 from='client.? v1:172.21.15.50:0/4246523161' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pool2": "1c2932ce-1479-493b-8174-2751cae2b39e", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T22:45:13.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:45:13 smithi050 bash[28929]: audit 2024-05-20T22:45:12.349709+0000 mon.a (mon.0) 4030 : audit 1 from='client.? v1:172.21.15.50:0/4246523161' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pool2": "1c2932ce-1479-493b-8174-2751cae2b39e", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T22:45:13.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:13.521+0000 7f04a5e25640 1 -- 172.21.15.50:0/1858767154 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "osd pool delete", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "pool2": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "yes_i_really_really_mean_it": true} v 0) -- 0x7f048c0053b0 con 0x7f04a0100410 2024-05-20T22:45:14.079 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:14.085+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 <== mon.0 v1:172.21.15.50:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "pool2": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "yes_i_really_really_mean_it": true}]=0 pool '6ad12e91-8c60-495a-811b-e1be6780ecc0' removed v845) ==== 248+0+0 (unknown 1821381993 0 0) 0x7f049005ab10 con 0x7f04a0100410 2024-05-20T22:45:14.081 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:14.089+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 <== mon.0 v1:172.21.15.50:6789/0 11 ==== osd_map(845..845 src has 256..845) ==== 296+0+0 (unknown 2348139847 0 0) 0x7f0490087b10 con 0x7f04a0100410 2024-05-20T22:45:14.081 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:14.089+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 --> v1:172.21.15.50:6789/0 -- mon_subscribe({osdmap=846}) -- 0x7f04a01a99d0 con 0x7f04a0100410 2024-05-20T22:45:14.198 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:14.205+0000 7f04a5e25640 1 -- 172.21.15.50:0/1858767154 --> v1:172.21.15.50:6789/0 -- mon_command({"prefix": "osd pool delete", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "pool2": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "yes_i_really_really_mean_it": true} v 0) -- 0x7f048c005de0 con 0x7f04a0100410 2024-05-20T22:45:14.199 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:14.205+0000 7f049cff9640 1 -- 172.21.15.50:0/1858767154 <== mon.0 v1:172.21.15.50:6789/0 12 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "pool2": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "yes_i_really_really_mean_it": true}]=0 pool '6ad12e91-8c60-495a-811b-e1be6780ecc0' does not exist v845) ==== 255+0+0 (unknown 1932955919 0 0) 0x7f049005f3d0 con 0x7f04a0100410 2024-05-20T22:45:14.199 INFO:tasks.workunit.client.0.smithi050.stderr:pool '6ad12e91-8c60-495a-811b-e1be6780ecc0' does not exist 2024-05-20T22:45:14.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:14.205+0000 7f04a5e25640 1 -- 172.21.15.50:0/1858767154 >> v1:172.21.15.50:6800/3332714287 conn(0x7f048806ef90 legacy=0x7f0488071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:45:14.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:14.209+0000 7f04a5e25640 1 -- 172.21.15.50:0/1858767154 >> v1:172.21.15.50:6789/0 conn(0x7f04a0100410 legacy=0x7f04a010e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T22:45:14.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:14.209+0000 7f04a5e25640 1 -- 172.21.15.50:0/1858767154 shutdown_connections 2024-05-20T22:45:14.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:14.209+0000 7f04a5e25640 1 -- 172.21.15.50:0/1858767154 >> 172.21.15.50:0/1858767154 conn(0x7f04a00fc070 msgr2=0x7f04a00fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T22:45:14.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:14.209+0000 7f04a5e25640 1 -- 172.21.15.50:0/1858767154 shutdown_connections 2024-05-20T22:45:14.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-05-20T22:45:14.209+0000 7f04a5e25640 1 -- 172.21.15.50:0/1858767154 wait complete. 2024-05-20T22:45:14.216 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo OK 2024-05-20T22:45:14.217 INFO:tasks.workunit.client.0.smithi050.stdout:OK 2024-05-20T22:45:14.218 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-20T22:45:14.218 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-20T22:45:14.276 INFO:tasks.workunit:Stopping ['rados/test.sh', 'rados/test_pool_quota.sh'] on client.0... 2024-05-20T22:45:14.276 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-20T22:45:14.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:45:14 smithi145 bash[23893]: audit 2024-05-20T22:45:13.086873+0000 mon.a (mon.0) 4031 : audit 1 from='client.? v1:172.21.15.50:0/4246523161' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pool2": "1c2932ce-1479-493b-8174-2751cae2b39e", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T22:45:14.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:45:14 smithi145 bash[23893]: cluster 2024-05-20T22:45:13.091971+0000 mon.a (mon.0) 4032 : cluster 0 osdmap e844: 8 total, 8 up, 8 in 2024-05-20T22:45:14.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:45:14 smithi145 bash[23893]: audit 2024-05-20T22:45:13.208435+0000 mon.a (mon.0) 4033 : audit 1 from='client.? v1:172.21.15.50:0/4246523161' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pool2": "1c2932ce-1479-493b-8174-2751cae2b39e", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T22:45:14.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:45:14 smithi145 bash[23893]: audit 2024-05-20T22:45:13.526391+0000 mon.a (mon.0) 4034 : audit 1 from='client.? v1:172.21.15.50:0/1858767154' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "pool2": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T22:45:14.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:45:14 smithi145 bash[23893]: cluster 2024-05-20T22:45:13.633163+0000 mgr.y (mgr.14592) 1440 : cluster 0 pgmap v1914: 176 pgs: 176 active+clean; 702 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:45:14.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:45:14 smithi050 bash[21866]: audit 2024-05-20T22:45:13.086873+0000 mon.a (mon.0) 4031 : audit 1 from='client.? v1:172.21.15.50:0/4246523161' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pool2": "1c2932ce-1479-493b-8174-2751cae2b39e", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T22:45:14.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:45:14 smithi050 bash[21866]: cluster 2024-05-20T22:45:13.091971+0000 mon.a (mon.0) 4032 : cluster 0 osdmap e844: 8 total, 8 up, 8 in 2024-05-20T22:45:14.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:45:14 smithi050 bash[21866]: audit 2024-05-20T22:45:13.208435+0000 mon.a (mon.0) 4033 : audit 1 from='client.? v1:172.21.15.50:0/4246523161' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pool2": "1c2932ce-1479-493b-8174-2751cae2b39e", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T22:45:14.439 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:45:14 smithi050 bash[21866]: audit 2024-05-20T22:45:13.526391+0000 mon.a (mon.0) 4034 : audit 1 from='client.? v1:172.21.15.50:0/1858767154' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "pool2": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T22:45:14.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:45:14 smithi050 bash[21866]: cluster 2024-05-20T22:45:13.633163+0000 mgr.y (mgr.14592) 1440 : cluster 0 pgmap v1914: 176 pgs: 176 active+clean; 702 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:45:14.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:45:14 smithi050 bash[28929]: audit 2024-05-20T22:45:13.086873+0000 mon.a (mon.0) 4031 : audit 1 from='client.? v1:172.21.15.50:0/4246523161' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pool2": "1c2932ce-1479-493b-8174-2751cae2b39e", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T22:45:14.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:45:14 smithi050 bash[28929]: cluster 2024-05-20T22:45:13.091971+0000 mon.a (mon.0) 4032 : cluster 0 osdmap e844: 8 total, 8 up, 8 in 2024-05-20T22:45:14.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:45:14 smithi050 bash[28929]: audit 2024-05-20T22:45:13.208435+0000 mon.a (mon.0) 4033 : audit 1 from='client.? v1:172.21.15.50:0/4246523161' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "1c2932ce-1479-493b-8174-2751cae2b39e", "pool2": "1c2932ce-1479-493b-8174-2751cae2b39e", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T22:45:14.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:45:14 smithi050 bash[28929]: audit 2024-05-20T22:45:13.526391+0000 mon.a (mon.0) 4034 : audit 1 from='client.? v1:172.21.15.50:0/1858767154' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "pool2": "6ad12e91-8c60-495a-811b-e1be6780ecc0", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T22:45:14.440 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:45:14 smithi050 bash[28929]: cluster 2024-05-20T22:45:13.633163+0000 mgr.y (mgr.14592) 1440 : cluster 0 pgmap v1914: 176 pgs: 176 active+clean; 702 KiB data, 872 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-20T22:45:14.618 DEBUG:teuthology.parallel:result is None 2024-05-20T22:45:14.619 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-20T22:45:14.633 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-20T22:45:14.633 DEBUG:teuthology.orchestra.run.smithi050:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-05-20T22:45:14.692 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-05-20T22:45:14.692 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-20T22:45:14.706 INFO:tasks.cephadm:Teardown begin 2024-05-20T22:45:14.706 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-20T22:45:14.746 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-20T22:45:14.760 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-20T22:45:14.761 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-20T22:45:14.794 DEBUG:teuthology.orchestra.run.smithi145:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-20T22:45:14.807 INFO:tasks.cephadm:Stopping all daemons... 2024-05-20T22:45:14.808 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-20T22:45:14.808 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mon.a 2024-05-20T22:45:14.939 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:45:14 smithi050 systemd[1]: Stopping Ceph mon.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:45:15.189 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:45:15 smithi050 bash[22118]: [20/May/2024:22:45:15] ENGINE Bus STOPPING 2024-05-20T22:45:15.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:45:15 smithi050 bash[21866]: debug 2024-05-20T22:45:15.013+0000 7f08b4954640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-05-20T22:45:15.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:May 20 22:45:15 smithi050 bash[21866]: debug 2024-05-20T22:45:15.013+0000 7f08b4954640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-20T22:45:15.503 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:45:15 smithi050 bash[22118]: [20/May/2024:22:45:15] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-20T22:45:15.503 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:45:15 smithi050 bash[22118]: [20/May/2024:22:45:15] ENGINE Bus STOPPED 2024-05-20T22:45:15.503 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:45:15 smithi050 bash[22118]: [20/May/2024:22:45:15] ENGINE Bus STARTING 2024-05-20T22:45:15.939 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:45:15 smithi050 bash[22118]: [20/May/2024:22:45:15] ENGINE Serving on http://:::9283 2024-05-20T22:45:15.939 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:45:15 smithi050 bash[22118]: [20/May/2024:22:45:15] ENGINE Bus STARTED 2024-05-20T22:45:16.430 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mon.a.service' 2024-05-20T22:45:16.455 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T22:45:16.455 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-20T22:45:16.455 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-05-20T22:45:16.455 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mon.c 2024-05-20T22:45:16.689 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:45:16 smithi050 bash[22118]: [20/May/2024:22:45:16] ENGINE Bus STOPPING 2024-05-20T22:45:16.689 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:45:16 smithi050 systemd[1]: Stopping Ceph mon.c for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:45:16.689 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:45:16 smithi050 bash[28929]: debug 2024-05-20T22:45:16.629+0000 7f6f9fb4c640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-05-20T22:45:16.689 INFO:journalctl@ceph.mon.c.smithi050.stdout:May 20 22:45:16 smithi050 bash[28929]: debug 2024-05-20T22:45:16.629+0000 7f6f9fb4c640 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-05-20T22:45:17.115 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:45:17 smithi050 bash[22118]: [20/May/2024:22:45:17] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-20T22:45:17.115 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:45:17 smithi050 bash[22118]: [20/May/2024:22:45:17] ENGINE Bus STOPPED 2024-05-20T22:45:17.115 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:45:17 smithi050 bash[22118]: [20/May/2024:22:45:17] ENGINE Bus STARTING 2024-05-20T22:45:17.417 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:45:17 smithi050 bash[22118]: [20/May/2024:22:45:17] ENGINE Serving on http://:::9283 2024-05-20T22:45:17.417 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:45:17 smithi050 bash[22118]: [20/May/2024:22:45:17] ENGINE Bus STARTED 2024-05-20T22:45:17.618 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mon.c.service' 2024-05-20T22:45:17.643 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T22:45:17.643 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-05-20T22:45:17.643 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-05-20T22:45:17.643 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mon.b 2024-05-20T22:45:18.098 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:45:17 smithi145 systemd[1]: Stopping Ceph mon.b for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:45:18.098 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:45:17 smithi145 bash[23893]: debug 2024-05-20T22:45:17.865+0000 7f28ba4cc640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-05-20T22:45:18.098 INFO:journalctl@ceph.mon.b.smithi145.stdout:May 20 22:45:17 smithi145 bash[23893]: debug 2024-05-20T22:45:17.865+0000 7f28ba4cc640 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-05-20T22:45:18.702 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mon.b.service' 2024-05-20T22:45:18.729 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T22:45:18.729 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-05-20T22:45:18.729 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-20T22:45:18.729 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mgr.y 2024-05-20T22:45:19.147 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:45:18 smithi050 systemd[1]: Stopping Ceph mgr.y for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:45:19.147 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:45:18 smithi050 bash[22118]: debug 2024-05-20T22:45:18.889+0000 7fb2d3d73640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-05-20T22:45:19.147 INFO:journalctl@ceph.mgr.y.smithi050.stdout:May 20 22:45:18 smithi050 bash[22118]: debug 2024-05-20T22:45:18.889+0000 7fb2d3d73640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-05-20T22:45:19.739 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mgr.y.service' 2024-05-20T22:45:19.762 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T22:45:19.763 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-20T22:45:19.763 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-20T22:45:19.763 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mgr.x 2024-05-20T22:45:19.885 INFO:journalctl@ceph.mgr.x.smithi145.stdout:May 20 22:45:19 smithi145 systemd[1]: Stopping Ceph mgr.x for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:45:19.885 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:45:19 smithi145 bash[52289]: ts=2024-05-20T22:45:19.594Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.50:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.50:8765: connect: connection refused" 2024-05-20T22:45:19.885 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:45:19 smithi145 bash[52289]: ts=2024-05-20T22:45:19.597Z caller=refresh.go:99 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.50:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.50:8765: connect: connection refused" 2024-05-20T22:45:19.886 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:45:19 smithi145 bash[52289]: ts=2024-05-20T22:45:19.598Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.50:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.50:8765: connect: connection refused" 2024-05-20T22:45:19.886 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:45:19 smithi145 bash[52289]: ts=2024-05-20T22:45:19.598Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.50:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.50:8765: connect: connection refused" 2024-05-20T22:45:19.886 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:45:19 smithi145 bash[52289]: ts=2024-05-20T22:45:19.599Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.50:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.50:8765: connect: connection refused" 2024-05-20T22:45:20.612 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@mgr.x.service' 2024-05-20T22:45:20.637 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T22:45:20.637 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-20T22:45:20.637 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-20T22:45:20.637 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.0 2024-05-20T22:45:20.939 INFO:journalctl@ceph.osd.0.smithi050.stdout:May 20 22:45:20 smithi050 systemd[1]: Stopping Ceph osd.0 for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:45:20.939 INFO:journalctl@ceph.osd.0.smithi050.stdout:May 20 22:45:20 smithi050 bash[31928]: debug 2024-05-20T22:45:20.789+0000 7fc5ee880640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-05-20T22:45:20.939 INFO:journalctl@ceph.osd.0.smithi050.stdout:May 20 22:45:20 smithi050 bash[31928]: debug 2024-05-20T22:45:20.789+0000 7fc5ee880640 -1 osd.0 845 *** Got signal Terminated *** 2024-05-20T22:45:20.939 INFO:journalctl@ceph.osd.0.smithi050.stdout:May 20 22:45:20 smithi050 bash[31928]: debug 2024-05-20T22:45:20.789+0000 7fc5ee880640 -1 osd.0 845 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T22:45:27.189 INFO:journalctl@ceph.osd.0.smithi050.stdout:May 20 22:45:26 smithi050 bash[136541]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-osd-0 2024-05-20T22:45:27.189 INFO:journalctl@ceph.osd.0.smithi050.stdout:May 20 22:45:27 smithi050 bash[136607]: Error response from daemon: No such container: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-osd-0 2024-05-20T22:45:28.956 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.0.service' 2024-05-20T22:45:28.987 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T22:45:28.987 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-20T22:45:28.987 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-20T22:45:28.987 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.1 2024-05-20T22:45:29.439 INFO:journalctl@ceph.osd.1.smithi050.stdout:May 20 22:45:29 smithi050 systemd[1]: Stopping Ceph osd.1 for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:45:29.439 INFO:journalctl@ceph.osd.1.smithi050.stdout:May 20 22:45:29 smithi050 bash[37268]: debug 2024-05-20T22:45:29.181+0000 7fe6dccd6640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-05-20T22:45:29.439 INFO:journalctl@ceph.osd.1.smithi050.stdout:May 20 22:45:29 smithi050 bash[37268]: debug 2024-05-20T22:45:29.181+0000 7fe6dccd6640 -1 osd.1 845 *** Got signal Terminated *** 2024-05-20T22:45:29.439 INFO:journalctl@ceph.osd.1.smithi050.stdout:May 20 22:45:29 smithi050 bash[37268]: debug 2024-05-20T22:45:29.181+0000 7fe6dccd6640 -1 osd.1 845 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T22:45:35.689 INFO:journalctl@ceph.osd.1.smithi050.stdout:May 20 22:45:35 smithi050 bash[136743]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-osd-1 2024-05-20T22:45:35.689 INFO:journalctl@ceph.osd.1.smithi050.stdout:May 20 22:45:35 smithi050 bash[136806]: Error response from daemon: No such container: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-osd-1 2024-05-20T22:45:37.307 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.1.service' 2024-05-20T22:45:37.336 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T22:45:37.336 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-20T22:45:37.337 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-20T22:45:37.337 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.2 2024-05-20T22:45:37.689 INFO:journalctl@ceph.osd.2.smithi050.stdout:May 20 22:45:37 smithi050 systemd[1]: Stopping Ceph osd.2 for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:45:37.689 INFO:journalctl@ceph.osd.2.smithi050.stdout:May 20 22:45:37 smithi050 bash[43014]: debug 2024-05-20T22:45:37.532+0000 7f180a88c640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-05-20T22:45:37.689 INFO:journalctl@ceph.osd.2.smithi050.stdout:May 20 22:45:37 smithi050 bash[43014]: debug 2024-05-20T22:45:37.532+0000 7f180a88c640 -1 osd.2 845 *** Got signal Terminated *** 2024-05-20T22:45:37.689 INFO:journalctl@ceph.osd.2.smithi050.stdout:May 20 22:45:37 smithi050 bash[43014]: debug 2024-05-20T22:45:37.532+0000 7f180a88c640 -1 osd.2 845 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T22:45:43.689 INFO:journalctl@ceph.osd.2.smithi050.stdout:May 20 22:45:43 smithi050 bash[136935]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-osd-2 2024-05-20T22:45:43.689 INFO:journalctl@ceph.osd.2.smithi050.stdout:May 20 22:45:43 smithi050 bash[136998]: Error response from daemon: No such container: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-osd-2 2024-05-20T22:45:45.432 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.2.service' 2024-05-20T22:45:45.460 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T22:45:45.460 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-20T22:45:45.461 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-20T22:45:45.461 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.3 2024-05-20T22:45:45.689 INFO:journalctl@ceph.osd.3.smithi050.stdout:May 20 22:45:45 smithi050 systemd[1]: Stopping Ceph osd.3 for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:45:45.689 INFO:journalctl@ceph.osd.3.smithi050.stdout:May 20 22:45:45 smithi050 bash[48862]: debug 2024-05-20T22:45:45.632+0000 7f4223f1d640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-05-20T22:45:45.689 INFO:journalctl@ceph.osd.3.smithi050.stdout:May 20 22:45:45 smithi050 bash[48862]: debug 2024-05-20T22:45:45.632+0000 7f4223f1d640 -1 osd.3 845 *** Got signal Terminated *** 2024-05-20T22:45:45.689 INFO:journalctl@ceph.osd.3.smithi050.stdout:May 20 22:45:45 smithi050 bash[48862]: debug 2024-05-20T22:45:45.632+0000 7f4223f1d640 -1 osd.3 845 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T22:45:46.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:45:46 smithi145 bash[44191]: debug 2024-05-20T22:45:46.408+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:45:47.635 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:45:47 smithi145 bash[44191]: debug 2024-05-20T22:45:47.360+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:45:48.065 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:45:47 smithi145 bash[38546]: debug 2024-05-20T22:45:47.688+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:45:48.342 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:45:48 smithi145 bash[33005]: debug 2024-05-20T22:45:48.072+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:25.153360+0000 front 2024-05-20T22:45:25.153640+0000 (oldest deadline 2024-05-20T22:45:48.053470+0000) 2024-05-20T22:45:48.635 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:45:48 smithi145 bash[44191]: debug 2024-05-20T22:45:48.348+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:45:49.105 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:45:48 smithi145 bash[38546]: debug 2024-05-20T22:45:48.688+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:45:49.189 INFO:journalctl@ceph.osd.3.smithi050.stdout:May 20 22:45:48 smithi050 bash[48862]: debug 2024-05-20T22:45:48.756+0000 7f421c52b640 -1 osd.3 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.142339+0000 front 2024-05-20T22:45:23.142208+0000 (oldest deadline 2024-05-20T22:45:48.442388+0000) 2024-05-20T22:45:49.362 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:45:49 smithi145 bash[33005]: debug 2024-05-20T22:45:49.112+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:25.153360+0000 front 2024-05-20T22:45:25.153640+0000 (oldest deadline 2024-05-20T22:45:48.053470+0000) 2024-05-20T22:45:49.635 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:45:49 smithi145 bash[44191]: debug 2024-05-20T22:45:49.368+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:45:49.635 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:45:49 smithi145 bash[27334]: debug 2024-05-20T22:45:49.476+0000 7f4910cc7640 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.416484+0000 front 2024-05-20T22:45:24.416366+0000 (oldest deadline 2024-05-20T22:45:48.515765+0000) 2024-05-20T22:45:50.062 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:45:49 smithi145 bash[38546]: debug 2024-05-20T22:45:49.724+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:45:50.189 INFO:journalctl@ceph.osd.3.smithi050.stdout:May 20 22:45:49 smithi050 bash[48862]: debug 2024-05-20T22:45:49.792+0000 7f421c52b640 -1 osd.3 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.142339+0000 front 2024-05-20T22:45:23.142208+0000 (oldest deadline 2024-05-20T22:45:48.442388+0000) 2024-05-20T22:45:50.385 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:45:50 smithi145 bash[33005]: debug 2024-05-20T22:45:50.068+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:25.153360+0000 front 2024-05-20T22:45:25.153640+0000 (oldest deadline 2024-05-20T22:45:48.053470+0000) 2024-05-20T22:45:50.734 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:45:50 smithi145 bash[27334]: debug 2024-05-20T22:45:50.508+0000 7f4910cc7640 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.416484+0000 front 2024-05-20T22:45:24.416366+0000 (oldest deadline 2024-05-20T22:45:48.515765+0000) 2024-05-20T22:45:50.735 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:45:50 smithi145 bash[44191]: debug 2024-05-20T22:45:50.420+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:45:51.077 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:45:50 smithi145 bash[38546]: debug 2024-05-20T22:45:50.740+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:45:51.385 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:45:51 smithi145 bash[33005]: debug 2024-05-20T22:45:51.084+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:25.153360+0000 front 2024-05-20T22:45:25.153640+0000 (oldest deadline 2024-05-20T22:45:48.053470+0000) 2024-05-20T22:45:51.687 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:45:51 smithi145 bash[27334]: debug 2024-05-20T22:45:51.532+0000 7f4910cc7640 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.416484+0000 front 2024-05-20T22:45:24.416366+0000 (oldest deadline 2024-05-20T22:45:48.515765+0000) 2024-05-20T22:45:51.687 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:45:51 smithi145 bash[44191]: debug 2024-05-20T22:45:51.444+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:45:52.105 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:45:51 smithi145 bash[38546]: debug 2024-05-20T22:45:51.692+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:45:52.189 INFO:journalctl@ceph.osd.3.smithi050.stdout:May 20 22:45:51 smithi050 bash[137128]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-osd-3 2024-05-20T22:45:52.189 INFO:journalctl@ceph.osd.3.smithi050.stdout:May 20 22:45:51 smithi050 bash[137190]: Error response from daemon: No such container: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-osd-3 2024-05-20T22:45:52.385 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:45:52 smithi145 bash[33005]: debug 2024-05-20T22:45:52.112+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:25.153360+0000 front 2024-05-20T22:45:25.153640+0000 (oldest deadline 2024-05-20T22:45:48.053470+0000) 2024-05-20T22:45:52.885 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:45:52 smithi145 bash[27334]: debug 2024-05-20T22:45:52.524+0000 7f4910cc7640 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.416484+0000 front 2024-05-20T22:45:24.416366+0000 (oldest deadline 2024-05-20T22:45:48.515765+0000) 2024-05-20T22:45:52.885 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:45:52 smithi145 bash[38546]: debug 2024-05-20T22:45:52.664+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:45:52.886 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:45:52 smithi145 bash[44191]: debug 2024-05-20T22:45:52.444+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:45:53.385 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:45:53 smithi145 bash[33005]: debug 2024-05-20T22:45:53.132+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:25.153360+0000 front 2024-05-20T22:45:25.153640+0000 (oldest deadline 2024-05-20T22:45:48.053470+0000) 2024-05-20T22:45:53.608 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.3.service' 2024-05-20T22:45:53.636 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T22:45:53.636 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-20T22:45:53.636 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-20T22:45:53.636 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.4 2024-05-20T22:45:53.885 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:45:53 smithi145 bash[38546]: debug 2024-05-20T22:45:53.640+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:45:53.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:45:53 smithi145 bash[44191]: debug 2024-05-20T22:45:53.480+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:45:53.886 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:45:53 smithi145 bash[27334]: debug 2024-05-20T22:45:53.576+0000 7f4910cc7640 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.416484+0000 front 2024-05-20T22:45:24.416366+0000 (oldest deadline 2024-05-20T22:45:48.515765+0000) 2024-05-20T22:45:53.886 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:45:53 smithi145 systemd[1]: Stopping Ceph osd.4 for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:45:54.385 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:45:54 smithi145 bash[27334]: debug 2024-05-20T22:45:54.024+0000 7f49146b1640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-05-20T22:45:54.385 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:45:54 smithi145 bash[27334]: debug 2024-05-20T22:45:54.024+0000 7f49146b1640 -1 osd.4 845 *** Got signal Terminated *** 2024-05-20T22:45:54.385 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:45:54 smithi145 bash[27334]: debug 2024-05-20T22:45:54.024+0000 7f49146b1640 -1 osd.4 845 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T22:45:54.386 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:45:54 smithi145 bash[33005]: debug 2024-05-20T22:45:54.164+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:25.153360+0000 front 2024-05-20T22:45:25.153640+0000 (oldest deadline 2024-05-20T22:45:48.053470+0000) 2024-05-20T22:45:54.885 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:45:54 smithi145 bash[27334]: debug 2024-05-20T22:45:54.528+0000 7f4910cc7640 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.416484+0000 front 2024-05-20T22:45:24.416366+0000 (oldest deadline 2024-05-20T22:45:48.515765+0000) 2024-05-20T22:45:54.886 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:45:54 smithi145 bash[38546]: debug 2024-05-20T22:45:54.596+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:45:54.886 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:45:54 smithi145 bash[44191]: debug 2024-05-20T22:45:54.428+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:45:55.433 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:45:55 smithi145 bash[33005]: debug 2024-05-20T22:45:55.156+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:25.153360+0000 front 2024-05-20T22:45:25.153640+0000 (oldest deadline 2024-05-20T22:45:48.053470+0000) 2024-05-20T22:45:55.885 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:45:55 smithi145 bash[27334]: debug 2024-05-20T22:45:55.504+0000 7f4910cc7640 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.416484+0000 front 2024-05-20T22:45:24.416366+0000 (oldest deadline 2024-05-20T22:45:48.515765+0000) 2024-05-20T22:45:55.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:45:55 smithi145 bash[44191]: debug 2024-05-20T22:45:55.440+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:45:55.886 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:45:55 smithi145 bash[38546]: debug 2024-05-20T22:45:55.644+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:45:55.886 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:45:55 smithi145 bash[38546]: debug 2024-05-20T22:45:55.644+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:45:56.481 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:45:56 smithi145 bash[33005]: debug 2024-05-20T22:45:56.152+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:25.153360+0000 front 2024-05-20T22:45:25.153640+0000 (oldest deadline 2024-05-20T22:45:48.053470+0000) 2024-05-20T22:45:56.885 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:45:56 smithi145 bash[27334]: debug 2024-05-20T22:45:56.528+0000 7f4910cc7640 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.416484+0000 front 2024-05-20T22:45:24.416366+0000 (oldest deadline 2024-05-20T22:45:48.515765+0000) 2024-05-20T22:45:56.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:45:56 smithi145 bash[44191]: debug 2024-05-20T22:45:56.488+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:45:56.886 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:45:56 smithi145 bash[38546]: debug 2024-05-20T22:45:56.604+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:45:56.886 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:45:56 smithi145 bash[38546]: debug 2024-05-20T22:45:56.604+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:45:57.502 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:45:57 smithi145 bash[33005]: debug 2024-05-20T22:45:57.152+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:25.153360+0000 front 2024-05-20T22:45:25.153640+0000 (oldest deadline 2024-05-20T22:45:48.053470+0000) 2024-05-20T22:45:57.885 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:45:57 smithi145 bash[27334]: debug 2024-05-20T22:45:57.524+0000 7f4910cc7640 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.416484+0000 front 2024-05-20T22:45:24.416366+0000 (oldest deadline 2024-05-20T22:45:48.515765+0000) 2024-05-20T22:45:57.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:45:57 smithi145 bash[44191]: debug 2024-05-20T22:45:57.508+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:45:57.886 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:45:57 smithi145 bash[38546]: debug 2024-05-20T22:45:57.632+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:45:57.886 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:45:57 smithi145 bash[38546]: debug 2024-05-20T22:45:57.632+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:45:58.491 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:45:58 smithi145 bash[33005]: debug 2024-05-20T22:45:58.176+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:25.153360+0000 front 2024-05-20T22:45:25.153640+0000 (oldest deadline 2024-05-20T22:45:48.053470+0000) 2024-05-20T22:45:58.491 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:45:58 smithi145 bash[33005]: debug 2024-05-20T22:45:58.176+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:32.754969+0000 front 2024-05-20T22:45:32.755198+0000 (oldest deadline 2024-05-20T22:45:58.054785+0000) 2024-05-20T22:45:58.885 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:45:58 smithi145 bash[27334]: debug 2024-05-20T22:45:58.520+0000 7f4910cc7640 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.416484+0000 front 2024-05-20T22:45:24.416366+0000 (oldest deadline 2024-05-20T22:45:48.515765+0000) 2024-05-20T22:45:58.885 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:45:58 smithi145 bash[38546]: debug 2024-05-20T22:45:58.668+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:45:58.885 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:45:58 smithi145 bash[38546]: debug 2024-05-20T22:45:58.668+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:45:58.886 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:45:58 smithi145 bash[44191]: debug 2024-05-20T22:45:58.500+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:45:58.886 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:45:58 smithi145 bash[44191]: debug 2024-05-20T22:45:58.500+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:45:59.499 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:45:59 smithi145 bash[33005]: debug 2024-05-20T22:45:59.172+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:25.153360+0000 front 2024-05-20T22:45:25.153640+0000 (oldest deadline 2024-05-20T22:45:48.053470+0000) 2024-05-20T22:45:59.562 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:45:59 smithi145 bash[33005]: debug 2024-05-20T22:45:59.172+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:32.754969+0000 front 2024-05-20T22:45:32.755198+0000 (oldest deadline 2024-05-20T22:45:58.054785+0000) 2024-05-20T22:45:59.799 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:45:59 smithi145 bash[44191]: debug 2024-05-20T22:45:59.504+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:45:59.799 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:45:59 smithi145 bash[44191]: debug 2024-05-20T22:45:59.504+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:45:59.799 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:45:59 smithi145 bash[38546]: debug 2024-05-20T22:45:59.624+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:45:59.799 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:45:59 smithi145 bash[38546]: debug 2024-05-20T22:45:59.624+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:46:00.385 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:46:00 smithi145 bash[57139]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-osd-4 2024-05-20T22:46:00.385 INFO:journalctl@ceph.osd.4.smithi145.stdout:May 20 22:46:00 smithi145 bash[57203]: Error response from daemon: No such container: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-osd-4 2024-05-20T22:46:00.385 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:00 smithi145 bash[33005]: debug 2024-05-20T22:46:00.160+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:25.153360+0000 front 2024-05-20T22:45:25.153640+0000 (oldest deadline 2024-05-20T22:45:48.053470+0000) 2024-05-20T22:46:00.386 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:00 smithi145 bash[33005]: debug 2024-05-20T22:46:00.160+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:32.754969+0000 front 2024-05-20T22:45:32.755198+0000 (oldest deadline 2024-05-20T22:45:58.054785+0000) 2024-05-20T22:46:00.885 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:00 smithi145 bash[38546]: debug 2024-05-20T22:46:00.660+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:46:00.885 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:00 smithi145 bash[38546]: debug 2024-05-20T22:46:00.660+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:46:00.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:00 smithi145 bash[44191]: debug 2024-05-20T22:46:00.500+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:00.886 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:00 smithi145 bash[44191]: debug 2024-05-20T22:46:00.500+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:01.385 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:01 smithi145 bash[33005]: debug 2024-05-20T22:46:01.184+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:25.153360+0000 front 2024-05-20T22:45:25.153640+0000 (oldest deadline 2024-05-20T22:45:48.053470+0000) 2024-05-20T22:46:01.385 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:01 smithi145 bash[33005]: debug 2024-05-20T22:46:01.184+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:32.754969+0000 front 2024-05-20T22:45:32.755198+0000 (oldest deadline 2024-05-20T22:45:58.054785+0000) 2024-05-20T22:46:01.885 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:01 smithi145 bash[38546]: debug 2024-05-20T22:46:01.692+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:46:01.885 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:01 smithi145 bash[38546]: debug 2024-05-20T22:46:01.692+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:46:01.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:01 smithi145 bash[44191]: debug 2024-05-20T22:46:01.464+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:01.886 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:01 smithi145 bash[44191]: debug 2024-05-20T22:46:01.464+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:02.150 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.4.service' 2024-05-20T22:46:02.178 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T22:46:02.178 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-20T22:46:02.178 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-20T22:46:02.178 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.5 2024-05-20T22:46:02.455 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:02 smithi145 bash[33005]: debug 2024-05-20T22:46:02.168+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:25.153360+0000 front 2024-05-20T22:45:25.153640+0000 (oldest deadline 2024-05-20T22:45:48.053470+0000) 2024-05-20T22:46:02.455 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:02 smithi145 bash[33005]: debug 2024-05-20T22:46:02.168+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:32.754969+0000 front 2024-05-20T22:45:32.755198+0000 (oldest deadline 2024-05-20T22:45:58.054785+0000) 2024-05-20T22:46:02.455 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:02 smithi145 systemd[1]: Stopping Ceph osd.5 for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:46:02.455 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:02 smithi145 bash[33005]: debug 2024-05-20T22:46:02.356+0000 7f5bb2a6d640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-05-20T22:46:02.455 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:02 smithi145 bash[33005]: debug 2024-05-20T22:46:02.356+0000 7f5bb2a6d640 -1 osd.5 845 *** Got signal Terminated *** 2024-05-20T22:46:02.455 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:02 smithi145 bash[33005]: debug 2024-05-20T22:46:02.356+0000 7f5bb2a6d640 -1 osd.5 845 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T22:46:02.885 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:02 smithi145 bash[38546]: debug 2024-05-20T22:46:02.680+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:46:02.885 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:02 smithi145 bash[38546]: debug 2024-05-20T22:46:02.680+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:46:02.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:02 smithi145 bash[44191]: debug 2024-05-20T22:46:02.460+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:02.886 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:02 smithi145 bash[44191]: debug 2024-05-20T22:46:02.460+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:03.487 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:03 smithi145 bash[33005]: debug 2024-05-20T22:46:03.152+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:25.153360+0000 front 2024-05-20T22:45:25.153640+0000 (oldest deadline 2024-05-20T22:45:48.053470+0000) 2024-05-20T22:46:03.487 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:03 smithi145 bash[33005]: debug 2024-05-20T22:46:03.152+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:32.754969+0000 front 2024-05-20T22:45:32.755198+0000 (oldest deadline 2024-05-20T22:45:58.054785+0000) 2024-05-20T22:46:03.885 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:03 smithi145 bash[38546]: debug 2024-05-20T22:46:03.716+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:46:03.885 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:03 smithi145 bash[38546]: debug 2024-05-20T22:46:03.716+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:46:03.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:03 smithi145 bash[44191]: debug 2024-05-20T22:46:03.492+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:03.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:03 smithi145 bash[44191]: debug 2024-05-20T22:46:03.492+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:03.886 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:03 smithi145 bash[44191]: debug 2024-05-20T22:46:03.492+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:04.500 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:04 smithi145 bash[33005]: debug 2024-05-20T22:46:04.176+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:25.153360+0000 front 2024-05-20T22:45:25.153640+0000 (oldest deadline 2024-05-20T22:45:48.053470+0000) 2024-05-20T22:46:04.500 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:04 smithi145 bash[33005]: debug 2024-05-20T22:46:04.176+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:32.754969+0000 front 2024-05-20T22:45:32.755198+0000 (oldest deadline 2024-05-20T22:45:58.054785+0000) 2024-05-20T22:46:04.885 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:04 smithi145 bash[38546]: debug 2024-05-20T22:46:04.740+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:46:04.885 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:04 smithi145 bash[38546]: debug 2024-05-20T22:46:04.740+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:46:04.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:04 smithi145 bash[44191]: debug 2024-05-20T22:46:04.508+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:04.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:04 smithi145 bash[44191]: debug 2024-05-20T22:46:04.508+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:04.886 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:04 smithi145 bash[44191]: debug 2024-05-20T22:46:04.508+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:05.516 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:05 smithi145 bash[33005]: debug 2024-05-20T22:46:05.184+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:25.153360+0000 front 2024-05-20T22:45:25.153640+0000 (oldest deadline 2024-05-20T22:45:48.053470+0000) 2024-05-20T22:46:05.516 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:05 smithi145 bash[33005]: debug 2024-05-20T22:46:05.184+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:32.754969+0000 front 2024-05-20T22:45:32.755198+0000 (oldest deadline 2024-05-20T22:45:58.054785+0000) 2024-05-20T22:46:05.516 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:05 smithi145 bash[33005]: debug 2024-05-20T22:46:05.184+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:39.756488+0000 front 2024-05-20T22:45:39.756262+0000 (oldest deadline 2024-05-20T22:46:05.056071+0000) 2024-05-20T22:46:05.885 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:05 smithi145 bash[38546]: debug 2024-05-20T22:46:05.756+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:46:05.885 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:05 smithi145 bash[38546]: debug 2024-05-20T22:46:05.756+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:46:05.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:05 smithi145 bash[44191]: debug 2024-05-20T22:46:05.524+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:05.886 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:05 smithi145 bash[44191]: debug 2024-05-20T22:46:05.524+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:05.886 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:05 smithi145 bash[44191]: debug 2024-05-20T22:46:05.524+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:06.518 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:06 smithi145 bash[33005]: debug 2024-05-20T22:46:06.168+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:25.153360+0000 front 2024-05-20T22:45:25.153640+0000 (oldest deadline 2024-05-20T22:45:48.053470+0000) 2024-05-20T22:46:06.518 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:06 smithi145 bash[33005]: debug 2024-05-20T22:46:06.168+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:32.754969+0000 front 2024-05-20T22:45:32.755198+0000 (oldest deadline 2024-05-20T22:45:58.054785+0000) 2024-05-20T22:46:06.518 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:06 smithi145 bash[33005]: debug 2024-05-20T22:46:06.168+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:39.756488+0000 front 2024-05-20T22:45:39.756262+0000 (oldest deadline 2024-05-20T22:46:05.056071+0000) 2024-05-20T22:46:06.791 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:06 smithi145 bash[44191]: debug 2024-05-20T22:46:06.524+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:06.791 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:06 smithi145 bash[44191]: debug 2024-05-20T22:46:06.524+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:06.791 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:06 smithi145 bash[44191]: debug 2024-05-20T22:46:06.524+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:07.135 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:06 smithi145 bash[38546]: debug 2024-05-20T22:46:06.800+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:46:07.135 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:06 smithi145 bash[38546]: debug 2024-05-20T22:46:06.800+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:46:07.135 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:06 smithi145 bash[38546]: debug 2024-05-20T22:46:06.800+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:40.790179+0000 front 2024-05-20T22:45:40.790316+0000 (oldest deadline 2024-05-20T22:46:06.690190+0000) 2024-05-20T22:46:07.525 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:07 smithi145 bash[33005]: debug 2024-05-20T22:46:07.164+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:25.153360+0000 front 2024-05-20T22:45:25.153640+0000 (oldest deadline 2024-05-20T22:45:48.053470+0000) 2024-05-20T22:46:07.525 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:07 smithi145 bash[33005]: debug 2024-05-20T22:46:07.164+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:32.754969+0000 front 2024-05-20T22:45:32.755198+0000 (oldest deadline 2024-05-20T22:45:58.054785+0000) 2024-05-20T22:46:07.525 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:07 smithi145 bash[33005]: debug 2024-05-20T22:46:07.164+0000 7f5baf083640 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:39.756488+0000 front 2024-05-20T22:45:39.756262+0000 (oldest deadline 2024-05-20T22:46:05.056071+0000) 2024-05-20T22:46:07.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:07 smithi145 bash[44191]: debug 2024-05-20T22:46:07.532+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:07.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:07 smithi145 bash[44191]: debug 2024-05-20T22:46:07.532+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:07.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:07 smithi145 bash[44191]: debug 2024-05-20T22:46:07.532+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:07.885 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:07 smithi145 bash[38546]: debug 2024-05-20T22:46:07.776+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:46:07.885 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:07 smithi145 bash[38546]: debug 2024-05-20T22:46:07.776+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:46:07.885 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:07 smithi145 bash[38546]: debug 2024-05-20T22:46:07.776+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:40.790179+0000 front 2024-05-20T22:45:40.790316+0000 (oldest deadline 2024-05-20T22:46:06.690190+0000) 2024-05-20T22:46:08.815 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:08 smithi145 bash[57336]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-osd-5 2024-05-20T22:46:08.815 INFO:journalctl@ceph.osd.5.smithi145.stdout:May 20 22:46:08 smithi145 bash[57406]: Error response from daemon: No such container: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-osd-5 2024-05-20T22:46:08.815 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:08 smithi145 bash[44191]: debug 2024-05-20T22:46:08.580+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:08.815 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:08 smithi145 bash[44191]: debug 2024-05-20T22:46:08.580+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:08.815 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:08 smithi145 bash[44191]: debug 2024-05-20T22:46:08.580+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:09.135 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:08 smithi145 bash[38546]: debug 2024-05-20T22:46:08.820+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:46:09.135 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:08 smithi145 bash[38546]: debug 2024-05-20T22:46:08.820+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:46:09.135 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:08 smithi145 bash[38546]: debug 2024-05-20T22:46:08.820+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:40.790179+0000 front 2024-05-20T22:45:40.790316+0000 (oldest deadline 2024-05-20T22:46:06.690190+0000) 2024-05-20T22:46:09.828 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:09 smithi145 bash[44191]: debug 2024-05-20T22:46:09.575+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:09.828 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:09 smithi145 bash[44191]: debug 2024-05-20T22:46:09.575+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:09.828 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:09 smithi145 bash[44191]: debug 2024-05-20T22:46:09.575+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:10.135 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:09 smithi145 bash[38546]: debug 2024-05-20T22:46:09.835+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:46:10.135 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:09 smithi145 bash[38546]: debug 2024-05-20T22:46:09.835+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:46:10.135 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:09 smithi145 bash[38546]: debug 2024-05-20T22:46:09.835+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:40.790179+0000 front 2024-05-20T22:45:40.790316+0000 (oldest deadline 2024-05-20T22:46:06.690190+0000) 2024-05-20T22:46:10.583 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.5.service' 2024-05-20T22:46:10.610 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T22:46:10.610 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-20T22:46:10.610 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-20T22:46:10.610 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.6 2024-05-20T22:46:10.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:10 smithi145 bash[44191]: debug 2024-05-20T22:46:10.599+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:10.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:10 smithi145 bash[44191]: debug 2024-05-20T22:46:10.599+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:10.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:10 smithi145 bash[44191]: debug 2024-05-20T22:46:10.599+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:10.886 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:10 smithi145 systemd[1]: Stopping Ceph osd.6 for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:46:10.886 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:10 smithi145 bash[38546]: debug 2024-05-20T22:46:10.799+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:46:10.886 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:10 smithi145 bash[38546]: debug 2024-05-20T22:46:10.799+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:46:10.886 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:10 smithi145 bash[38546]: debug 2024-05-20T22:46:10.799+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:40.790179+0000 front 2024-05-20T22:45:40.790316+0000 (oldest deadline 2024-05-20T22:46:06.690190+0000) 2024-05-20T22:46:10.886 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:10 smithi145 bash[38546]: debug 2024-05-20T22:46:10.803+0000 7f04a9956640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-05-20T22:46:10.886 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:10 smithi145 bash[38546]: debug 2024-05-20T22:46:10.803+0000 7f04a9956640 -1 osd.6 845 *** Got signal Terminated *** 2024-05-20T22:46:10.886 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:10 smithi145 bash[38546]: debug 2024-05-20T22:46:10.803+0000 7f04a9956640 -1 osd.6 845 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T22:46:11.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:11 smithi145 bash[44191]: debug 2024-05-20T22:46:11.639+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:11.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:11 smithi145 bash[44191]: debug 2024-05-20T22:46:11.639+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:11.885 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:11 smithi145 bash[44191]: debug 2024-05-20T22:46:11.639+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:11.885 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:11 smithi145 bash[38546]: debug 2024-05-20T22:46:11.759+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:46:11.886 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:11 smithi145 bash[38546]: debug 2024-05-20T22:46:11.759+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:46:11.886 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:11 smithi145 bash[38546]: debug 2024-05-20T22:46:11.759+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:40.790179+0000 front 2024-05-20T22:45:40.790316+0000 (oldest deadline 2024-05-20T22:46:06.690190+0000) 2024-05-20T22:46:13.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:12 smithi145 bash[44191]: debug 2024-05-20T22:46:12.659+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:13.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:12 smithi145 bash[44191]: debug 2024-05-20T22:46:12.659+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:13.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:12 smithi145 bash[44191]: debug 2024-05-20T22:46:12.659+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:13.135 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:12 smithi145 bash[38546]: debug 2024-05-20T22:46:12.807+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:46:13.135 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:12 smithi145 bash[38546]: debug 2024-05-20T22:46:12.807+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:46:13.135 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:12 smithi145 bash[38546]: debug 2024-05-20T22:46:12.807+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:40.790179+0000 front 2024-05-20T22:45:40.790316+0000 (oldest deadline 2024-05-20T22:46:06.690190+0000) 2024-05-20T22:46:13.136 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:12 smithi145 bash[38546]: debug 2024-05-20T22:46:12.807+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6815 osd.3 since back 2024-05-20T22:45:46.691183+0000 front 2024-05-20T22:45:46.691064+0000 (oldest deadline 2024-05-20T22:46:11.991011+0000) 2024-05-20T22:46:14.135 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:13 smithi145 bash[38546]: debug 2024-05-20T22:46:13.783+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:46:14.135 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:13 smithi145 bash[38546]: debug 2024-05-20T22:46:13.783+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:46:14.135 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:13 smithi145 bash[38546]: debug 2024-05-20T22:46:13.783+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:40.790179+0000 front 2024-05-20T22:45:40.790316+0000 (oldest deadline 2024-05-20T22:46:06.690190+0000) 2024-05-20T22:46:14.135 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:13 smithi145 bash[38546]: debug 2024-05-20T22:46:13.783+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6815 osd.3 since back 2024-05-20T22:45:46.691183+0000 front 2024-05-20T22:45:46.691064+0000 (oldest deadline 2024-05-20T22:46:11.991011+0000) 2024-05-20T22:46:14.136 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:13 smithi145 bash[44191]: debug 2024-05-20T22:46:13.699+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:14.136 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:13 smithi145 bash[44191]: debug 2024-05-20T22:46:13.699+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:14.136 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:13 smithi145 bash[44191]: debug 2024-05-20T22:46:13.699+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:15.135 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:14 smithi145 bash[38546]: debug 2024-05-20T22:46:14.835+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:46:15.135 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:14 smithi145 bash[38546]: debug 2024-05-20T22:46:14.835+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:46:15.135 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:14 smithi145 bash[38546]: debug 2024-05-20T22:46:14.835+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:40.790179+0000 front 2024-05-20T22:45:40.790316+0000 (oldest deadline 2024-05-20T22:46:06.690190+0000) 2024-05-20T22:46:15.135 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:14 smithi145 bash[38546]: debug 2024-05-20T22:46:14.835+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6815 osd.3 since back 2024-05-20T22:45:46.691183+0000 front 2024-05-20T22:45:46.691064+0000 (oldest deadline 2024-05-20T22:46:11.991011+0000) 2024-05-20T22:46:15.136 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:14 smithi145 bash[44191]: debug 2024-05-20T22:46:14.711+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:15.136 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:14 smithi145 bash[44191]: debug 2024-05-20T22:46:14.711+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:15.136 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:14 smithi145 bash[44191]: debug 2024-05-20T22:46:14.711+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:15.136 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:14 smithi145 bash[44191]: debug 2024-05-20T22:46:14.711+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6815 osd.3 since back 2024-05-20T22:45:48.892139+0000 front 2024-05-20T22:45:48.892086+0000 (oldest deadline 2024-05-20T22:46:14.191791+0000) 2024-05-20T22:46:16.138 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:15 smithi145 bash[38546]: debug 2024-05-20T22:46:15.799+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:24.686283+0000 front 2024-05-20T22:45:24.685925+0000 (oldest deadline 2024-05-20T22:45:47.585931+0000) 2024-05-20T22:46:16.138 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:15 smithi145 bash[38546]: debug 2024-05-20T22:46:15.799+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:30.388028+0000 front 2024-05-20T22:45:30.388211+0000 (oldest deadline 2024-05-20T22:45:54.988206+0000) 2024-05-20T22:46:16.138 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:15 smithi145 bash[38546]: debug 2024-05-20T22:46:15.799+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:40.790179+0000 front 2024-05-20T22:45:40.790316+0000 (oldest deadline 2024-05-20T22:46:06.690190+0000) 2024-05-20T22:46:16.139 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:15 smithi145 bash[38546]: debug 2024-05-20T22:46:15.799+0000 7f04a5f6c640 -1 osd.6 845 heartbeat_check: no reply from 172.21.15.50:6815 osd.3 since back 2024-05-20T22:45:46.691183+0000 front 2024-05-20T22:45:46.691064+0000 (oldest deadline 2024-05-20T22:46:11.991011+0000) 2024-05-20T22:46:16.139 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:15 smithi145 bash[44191]: debug 2024-05-20T22:46:15.719+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:16.139 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:15 smithi145 bash[44191]: debug 2024-05-20T22:46:15.719+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:16.139 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:15 smithi145 bash[44191]: debug 2024-05-20T22:46:15.719+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:16.139 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:15 smithi145 bash[44191]: debug 2024-05-20T22:46:15.719+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6815 osd.3 since back 2024-05-20T22:45:48.892139+0000 front 2024-05-20T22:45:48.892086+0000 (oldest deadline 2024-05-20T22:46:14.191791+0000) 2024-05-20T22:46:17.088 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:16 smithi145 bash[57537]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-osd-6 2024-05-20T22:46:17.089 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:16 smithi145 bash[44191]: debug 2024-05-20T22:46:16.759+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:17.089 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:16 smithi145 bash[44191]: debug 2024-05-20T22:46:16.759+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:17.089 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:16 smithi145 bash[44191]: debug 2024-05-20T22:46:16.759+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:17.089 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:16 smithi145 bash[44191]: debug 2024-05-20T22:46:16.759+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6815 osd.3 since back 2024-05-20T22:45:48.892139+0000 front 2024-05-20T22:45:48.892086+0000 (oldest deadline 2024-05-20T22:46:14.191791+0000) 2024-05-20T22:46:17.385 INFO:journalctl@ceph.osd.6.smithi145.stdout:May 20 22:46:17 smithi145 bash[57602]: Error response from daemon: No such container: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-osd-6 2024-05-20T22:46:18.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:17 smithi145 bash[44191]: debug 2024-05-20T22:46:17.783+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:18.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:17 smithi145 bash[44191]: debug 2024-05-20T22:46:17.783+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:18.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:17 smithi145 bash[44191]: debug 2024-05-20T22:46:17.783+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:18.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:17 smithi145 bash[44191]: debug 2024-05-20T22:46:17.783+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6815 osd.3 since back 2024-05-20T22:45:48.892139+0000 front 2024-05-20T22:45:48.892086+0000 (oldest deadline 2024-05-20T22:46:14.191791+0000) 2024-05-20T22:46:18.866 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.6.service' 2024-05-20T22:46:18.895 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T22:46:18.895 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-20T22:46:18.896 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-20T22:46:18.896 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.7 2024-05-20T22:46:19.069 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:18 smithi145 bash[44191]: debug 2024-05-20T22:46:18.811+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:19.069 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:18 smithi145 bash[44191]: debug 2024-05-20T22:46:18.811+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:19.069 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:18 smithi145 bash[44191]: debug 2024-05-20T22:46:18.811+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:19.069 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:18 smithi145 bash[44191]: debug 2024-05-20T22:46:18.811+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6815 osd.3 since back 2024-05-20T22:45:48.892139+0000 front 2024-05-20T22:45:48.892086+0000 (oldest deadline 2024-05-20T22:46:14.191791+0000) 2024-05-20T22:46:19.070 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:18 smithi145 systemd[1]: Stopping Ceph osd.7 for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:46:19.070 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:19 smithi145 bash[44191]: debug 2024-05-20T22:46:19.075+0000 7fae9dee1640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-05-20T22:46:19.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:19 smithi145 bash[44191]: debug 2024-05-20T22:46:19.075+0000 7fae9dee1640 -1 osd.7 845 *** Got signal Terminated *** 2024-05-20T22:46:19.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:19 smithi145 bash[44191]: debug 2024-05-20T22:46:19.075+0000 7fae9dee1640 -1 osd.7 845 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T22:46:19.834 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:46:19 smithi145 bash[52289]: ts=2024-05-20T22:46:19.593Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.50:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.50:8765: connect: connection refused" 2024-05-20T22:46:19.835 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:46:19 smithi145 bash[52289]: ts=2024-05-20T22:46:19.598Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.50:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.50:8765: connect: connection refused" 2024-05-20T22:46:19.835 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:46:19 smithi145 bash[52289]: ts=2024-05-20T22:46:19.598Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.50:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.50:8765: connect: connection refused" 2024-05-20T22:46:19.835 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:46:19 smithi145 bash[52289]: ts=2024-05-20T22:46:19.598Z caller=refresh.go:99 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.50:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.50:8765: connect: connection refused" 2024-05-20T22:46:19.835 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:46:19 smithi145 bash[52289]: ts=2024-05-20T22:46:19.599Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.50:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.50:8765: connect: connection refused" 2024-05-20T22:46:20.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:19 smithi145 bash[44191]: debug 2024-05-20T22:46:19.843+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:20.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:19 smithi145 bash[44191]: debug 2024-05-20T22:46:19.843+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:20.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:19 smithi145 bash[44191]: debug 2024-05-20T22:46:19.843+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:20.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:19 smithi145 bash[44191]: debug 2024-05-20T22:46:19.843+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6815 osd.3 since back 2024-05-20T22:45:48.892139+0000 front 2024-05-20T22:45:48.892086+0000 (oldest deadline 2024-05-20T22:46:14.191791+0000) 2024-05-20T22:46:21.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:20 smithi145 bash[44191]: debug 2024-05-20T22:46:20.795+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:21.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:20 smithi145 bash[44191]: debug 2024-05-20T22:46:20.795+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:21.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:20 smithi145 bash[44191]: debug 2024-05-20T22:46:20.795+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:21.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:20 smithi145 bash[44191]: debug 2024-05-20T22:46:20.795+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6815 osd.3 since back 2024-05-20T22:45:48.892139+0000 front 2024-05-20T22:45:48.892086+0000 (oldest deadline 2024-05-20T22:46:14.191791+0000) 2024-05-20T22:46:21.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:20 smithi145 bash[44191]: debug 2024-05-20T22:46:20.795+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.145:6802 osd.4 since back 2024-05-20T22:45:55.293411+0000 front 2024-05-20T22:45:55.293235+0000 (oldest deadline 2024-05-20T22:46:19.993109+0000) 2024-05-20T22:46:22.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:21 smithi145 bash[44191]: debug 2024-05-20T22:46:21.759+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:22.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:21 smithi145 bash[44191]: debug 2024-05-20T22:46:21.759+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:22.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:21 smithi145 bash[44191]: debug 2024-05-20T22:46:21.759+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:22.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:21 smithi145 bash[44191]: debug 2024-05-20T22:46:21.759+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6815 osd.3 since back 2024-05-20T22:45:48.892139+0000 front 2024-05-20T22:45:48.892086+0000 (oldest deadline 2024-05-20T22:46:14.191791+0000) 2024-05-20T22:46:22.136 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:21 smithi145 bash[44191]: debug 2024-05-20T22:46:21.759+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.145:6802 osd.4 since back 2024-05-20T22:45:55.293411+0000 front 2024-05-20T22:45:55.293235+0000 (oldest deadline 2024-05-20T22:46:19.993109+0000) 2024-05-20T22:46:23.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:22 smithi145 bash[44191]: debug 2024-05-20T22:46:22.739+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:23.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:22 smithi145 bash[44191]: debug 2024-05-20T22:46:22.739+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:23.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:22 smithi145 bash[44191]: debug 2024-05-20T22:46:22.739+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:23.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:22 smithi145 bash[44191]: debug 2024-05-20T22:46:22.739+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6815 osd.3 since back 2024-05-20T22:45:48.892139+0000 front 2024-05-20T22:45:48.892086+0000 (oldest deadline 2024-05-20T22:46:14.191791+0000) 2024-05-20T22:46:23.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:22 smithi145 bash[44191]: debug 2024-05-20T22:46:22.739+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.145:6802 osd.4 since back 2024-05-20T22:45:55.293411+0000 front 2024-05-20T22:45:55.293235+0000 (oldest deadline 2024-05-20T22:46:19.993109+0000) 2024-05-20T22:46:24.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:23 smithi145 bash[44191]: debug 2024-05-20T22:46:23.695+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6803 osd.0 since back 2024-05-20T22:45:23.386067+0000 front 2024-05-20T22:45:23.385864+0000 (oldest deadline 2024-05-20T22:45:46.285532+0000) 2024-05-20T22:46:24.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:23 smithi145 bash[44191]: debug 2024-05-20T22:46:23.695+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6807 osd.1 since back 2024-05-20T22:45:33.188824+0000 front 2024-05-20T22:45:33.188420+0000 (oldest deadline 2024-05-20T22:45:57.888445+0000) 2024-05-20T22:46:24.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:23 smithi145 bash[44191]: debug 2024-05-20T22:46:23.695+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6811 osd.2 since back 2024-05-20T22:45:41.990198+0000 front 2024-05-20T22:45:41.990165+0000 (oldest deadline 2024-05-20T22:46:03.089689+0000) 2024-05-20T22:46:24.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:23 smithi145 bash[44191]: debug 2024-05-20T22:46:23.695+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.50:6815 osd.3 since back 2024-05-20T22:45:48.892139+0000 front 2024-05-20T22:45:48.892086+0000 (oldest deadline 2024-05-20T22:46:14.191791+0000) 2024-05-20T22:46:24.135 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:23 smithi145 bash[44191]: debug 2024-05-20T22:46:23.695+0000 7fae9a4f7640 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.145:6802 osd.4 since back 2024-05-20T22:45:55.293411+0000 front 2024-05-20T22:45:55.293235+0000 (oldest deadline 2024-05-20T22:46:19.993109+0000) 2024-05-20T22:46:25.394 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:25 smithi145 bash[57734]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-osd-7 2024-05-20T22:46:25.394 INFO:journalctl@ceph.osd.7.smithi145.stdout:May 20 22:46:25 smithi145 bash[57800]: Error response from daemon: No such container: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-osd-7 2024-05-20T22:46:26.948 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@osd.7.service' 2024-05-20T22:46:26.974 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T22:46:26.974 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-20T22:46:26.974 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopping rgw.foo.a... 2024-05-20T22:46:26.974 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@rgw.foo.a 2024-05-20T22:46:27.439 INFO:journalctl@ceph.rgw.foo.a.smithi050.stdout:May 20 22:46:27 smithi050 systemd[1]: Stopping Ceph rgw.foo.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:46:27.439 INFO:journalctl@ceph.rgw.foo.a.smithi050.stdout:May 20 22:46:27 smithi050 bash[53000]: debug 2024-05-20T22:46:27.143+0000 7f0c578b9640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/radosgw -n client.rgw.foo.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-05-20T22:46:27.439 INFO:journalctl@ceph.rgw.foo.a.smithi050.stdout:May 20 22:46:27 smithi050 bash[53000]: debug 2024-05-20T22:46:27.143+0000 7f0c5b125880 -1 shutting down 2024-05-20T22:46:37.687 INFO:journalctl@ceph.rgw.foo.a.smithi050.stdout:May 20 22:46:37 smithi050 bash[137321]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-rgw-foo-a 2024-05-20T22:46:37.869 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@rgw.foo.a.service' 2024-05-20T22:46:37.890 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T22:46:37.891 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopped rgw.foo.a 2024-05-20T22:46:37.891 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-05-20T22:46:37.891 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@prometheus.a 2024-05-20T22:46:38.258 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:46:37 smithi145 systemd[1]: Stopping Ceph prometheus.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:46:38.259 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:46:38 smithi145 bash[52289]: ts=2024-05-20T22:46:38.054Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-05-20T22:46:38.259 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:46:38 smithi145 bash[52289]: ts=2024-05-20T22:46:38.055Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-05-20T22:46:38.259 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:46:38 smithi145 bash[52289]: ts=2024-05-20T22:46:38.055Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-05-20T22:46:38.259 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:46:38 smithi145 bash[52289]: ts=2024-05-20T22:46:38.055Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-05-20T22:46:38.259 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:46:38 smithi145 bash[52289]: ts=2024-05-20T22:46:38.055Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-05-20T22:46:38.259 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:46:38 smithi145 bash[52289]: ts=2024-05-20T22:46:38.055Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-05-20T22:46:38.259 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:46:38 smithi145 bash[52289]: ts=2024-05-20T22:46:38.055Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-05-20T22:46:38.259 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:46:38 smithi145 bash[52289]: ts=2024-05-20T22:46:38.055Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-05-20T22:46:38.259 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:46:38 smithi145 bash[52289]: ts=2024-05-20T22:46:38.055Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-05-20T22:46:38.259 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:46:38 smithi145 bash[52289]: ts=2024-05-20T22:46:38.056Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-05-20T22:46:38.259 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:46:38 smithi145 bash[52289]: ts=2024-05-20T22:46:38.056Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-05-20T22:46:38.259 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:46:38 smithi145 bash[52289]: ts=2024-05-20T22:46:38.056Z caller=main.go:1147 level=info msg="See you next time!" 2024-05-20T22:46:38.635 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:May 20 22:46:38 smithi145 bash[57929]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-prometheus-a 2024-05-20T22:46:38.670 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@prometheus.a.service' 2024-05-20T22:46:38.699 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T22:46:38.700 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-05-20T22:46:38.700 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 --force --keep-logs 2024-05-20T22:46:38.870 INFO:teuthology.orchestra.run.smithi050.stdout:Deleting cluster with fsid: 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T22:46:43.703 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:46:43 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:43.703 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:46:43 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:44.049 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:46:43 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:44.049 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:46:43 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:44.314 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:46:44 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:44.314 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:46:44 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:44.566 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:46:44 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:44.566 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:46:44 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:44.855 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:46:44 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:44.855 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:46:44 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:44.856 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:46:44 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:44.856 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:46:44 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:45.121 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:46:45 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:45.122 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:46:45 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:45.397 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:46:45 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:45.397 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:46:45 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:45.689 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:46:45 smithi050 systemd[1]: Stopping Ceph node-exporter.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:46:46.336 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:46:46 smithi050 bash[137727]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-node-exporter-a 2024-05-20T22:46:46.336 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:46:46 smithi050 systemd[1]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-05-20T22:46:46.336 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:46:46 smithi050 bash[137786]: Error response from daemon: No such container: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-node-exporter-a 2024-05-20T22:46:46.336 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:46:46 smithi050 systemd[1]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@node-exporter.a.service: Failed with result 'exit-code'. 2024-05-20T22:46:46.336 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:46:46 smithi050 systemd[1]: Stopped Ceph node-exporter.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968. 2024-05-20T22:46:46.602 INFO:journalctl@ceph.node-exporter.a.smithi050.stdout:May 20 22:46:46 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:46.602 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:46:46 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:46.602 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:46:46 smithi050 systemd[1]: Stopping Ceph alertmanager.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:46:46.602 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:46:46 smithi050 bash[59831]: ts=2024-05-20T22:46:46.565Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-05-20T22:46:47.436 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:46:47 smithi050 bash[137855]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-alertmanager-a 2024-05-20T22:46:47.436 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:46:47 smithi050 bash[137915]: Error response from daemon: No such container: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-alertmanager-a 2024-05-20T22:46:47.437 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:46:47 smithi050 systemd[1]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-05-20T22:46:47.437 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:46:47 smithi050 systemd[1]: Stopped Ceph alertmanager.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968. 2024-05-20T22:46:47.689 INFO:journalctl@ceph.alertmanager.a.smithi050.stdout:May 20 22:46:47 smithi050 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:47.957 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 --force --keep-logs 2024-05-20T22:46:48.125 INFO:teuthology.orchestra.run.smithi145.stdout:Deleting cluster with fsid: 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T22:46:52.991 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:46:52 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:52.992 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:46:52 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:52.992 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:46:52 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:53.251 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:46:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:53.251 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:46:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:53.251 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:46:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:53.585 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:46:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:53.585 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:46:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:53.585 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:46:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:53.878 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:46:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:53.878 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:46:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:53.879 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:46:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:53.879 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:46:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:53.879 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:46:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:53.879 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:46:53 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:54.135 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:46:54 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:54.135 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:46:54 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:54.135 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:46:54 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:46:54.635 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:46:54 smithi145 systemd[1]: Stopping Ceph iscsi.iscsi.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:46:54.635 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:46:54 smithi145 bash[48584]: debug Shutdown received 2024-05-20T22:47:05.385 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:47:05 smithi145 bash[58263]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-iscsi-iscsi-a 2024-05-20T22:47:05.385 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:47:05 smithi145 systemd[1]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@iscsi.iscsi.a.service: Main process exited, code=exited, status=137/n/a 2024-05-20T22:47:05.385 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:47:05 smithi145 bash[58329]: Error response from daemon: No such container: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-iscsi-iscsi-a 2024-05-20T22:47:05.385 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:47:05 smithi145 systemd[1]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-05-20T22:47:05.385 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:47:05 smithi145 systemd[1]: Stopped Ceph iscsi.iscsi.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968. 2024-05-20T22:47:05.802 INFO:journalctl@ceph.iscsi.iscsi.a.smithi145.stdout:May 20 22:47:05 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:47:05.803 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:47:05 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:47:05.803 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:47:05 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:47:06.463 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:47:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:47:06.464 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:47:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:47:06.817 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:47:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:47:06.818 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:47:06 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:47:06.818 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:47:06 smithi145 systemd[1]: Stopping Ceph node-exporter.b for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:47:07.884 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:47:07 smithi145 bash[58533]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-node-exporter-b 2024-05-20T22:47:07.885 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:47:07 smithi145 systemd[1]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-05-20T22:47:07.885 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:47:07 smithi145 bash[58592]: Error response from daemon: No such container: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-node-exporter-b 2024-05-20T22:47:07.885 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:47:07 smithi145 systemd[1]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@node-exporter.b.service: Failed with result 'exit-code'. 2024-05-20T22:47:07.885 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:47:07 smithi145 systemd[1]: Stopped Ceph node-exporter.b for 9a9abba0-16f3-11ef-bc9a-c7b262605968. 2024-05-20T22:47:08.141 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:May 20 22:47:07 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:47:08.141 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:47:07 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:47:08.141 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:47:07 smithi145 systemd[1]: Stopping Ceph grafana.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968... 2024-05-20T22:47:08.141 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:47:08 smithi145 bash[51536]: logger=server t=2024-05-20T22:47:08.142737659Z level=info msg="Shutdown started" reason="System signal: terminated" 2024-05-20T22:47:08.141 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:47:08 smithi145 bash[51536]: logger=ticker t=2024-05-20T22:47:08.14279873Z level=info msg=stopped last_tick=2024-05-20T22:47:00Z 2024-05-20T22:47:08.142 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:47:08 smithi145 bash[51536]: logger=tracing t=2024-05-20T22:47:08.142932665Z level=info msg="Closing tracing" 2024-05-20T22:47:09.065 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:47:08 smithi145 bash[58661]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-grafana-a 2024-05-20T22:47:09.066 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:47:08 smithi145 bash[58724]: Error response from daemon: No such container: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968-grafana-a 2024-05-20T22:47:09.066 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:47:08 smithi145 systemd[1]: ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@grafana.a.service: Deactivated successfully. 2024-05-20T22:47:09.066 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:47:08 smithi145 systemd[1]: Stopped Ceph grafana.a for 9a9abba0-16f3-11ef-bc9a-c7b262605968. 2024-05-20T22:47:09.066 INFO:journalctl@ceph.grafana.a.smithi145.stdout:May 20 22:47:09 smithi145 systemd[1]: /etc/systemd/system/ceph-9a9abba0-16f3-11ef-bc9a-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-05-20T22:47:09.594 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-20T22:47:09.609 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-20T22:47:09.621 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-20T22:47:09.623 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/crash to /home/teuthworker/archive/adking-2024-05-20_20:47:35-orch:cephadm-squid-release-distro-default-smithi/7716645/remote/smithi050/crash 2024-05-20T22:47:09.624 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/crash -- . 2024-05-20T22:47:09.665 INFO:teuthology.orchestra.run.smithi050.stderr:tar: /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/crash: Cannot open: No such file or directory 2024-05-20T22:47:09.665 INFO:teuthology.orchestra.run.smithi050.stderr:tar: Error is not recoverable: exiting now 2024-05-20T22:47:09.667 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/crash to /home/teuthworker/archive/adking-2024-05-20_20:47:35-orch:cephadm-squid-release-distro-default-smithi/7716645/remote/smithi145/crash 2024-05-20T22:47:09.668 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/crash -- . 2024-05-20T22:47:09.678 INFO:teuthology.orchestra.run.smithi145.stderr:tar: /var/lib/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/crash: Cannot open: No such file or directory 2024-05-20T22:47:09.678 INFO:teuthology.orchestra.run.smithi145.stderr:tar: Error is not recoverable: exiting now 2024-05-20T22:47:09.679 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-20T22:47:09.679 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-05-20T22:47:09.724 INFO:tasks.cephadm:Compressing logs... 2024-05-20T22:47:09.724 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-20T22:47:09.766 DEBUG:teuthology.orchestra.run.smithi145:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-20T22:47:09.774 INFO:teuthology.orchestra.run.smithi050.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-05-20T22:47:09.778 INFO:teuthology.orchestra.run.smithi145.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-05-20T22:47:09.785 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-20T22:47:09.785 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-mgr.y.log 2024-05-20T22:47:09.786 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.0.log 2024-05-20T22:47:09.786 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.2.log 2024-05-20T22:47:09.787 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-mon.a.log 2024-05-20T22:47:09.787 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph.cephadm.log 2024-05-20T22:47:09.787 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.3.log 2024-05-20T22:47:09.789 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.1.log 2024-05-20T22:47:09.789 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.3.log: 88.8% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph.cephadm.log.gz 2024-05-20T22:47:09.789 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph.log 2024-05-20T22:47:09.789 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-volume.log 2024-05-20T22:47:09.795 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.1.log: /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph.log: 91.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-20T22:47:09.795 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-mon.c.log 2024-05-20T22:47:09.799 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-20T22:47:09.800 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.7.log 2024-05-20T22:47:09.800 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.6.log 2024-05-20T22:47:09.800 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph.cephadm.log 2024-05-20T22:47:09.801 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.5.log 2024-05-20T22:47:09.802 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-volume.log: 93.4% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph.log.gz 2024-05-20T22:47:09.802 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph.audit.log 2024-05-20T22:47:09.803 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.6.log: /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/tcmu-runner.log 2024-05-20T22:47:09.803 INFO:teuthology.orchestra.run.smithi145.stderr: 78.7% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph.cephadm.log.gz 2024-05-20T22:47:09.804 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-mgr.x.log 2024-05-20T22:47:09.804 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph.log 2024-05-20T22:47:09.804 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/tcmu-runner.log: /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-mgr.x.log: 63.7% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/tcmu-runner.log.gz 2024-05-20T22:47:09.804 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-volume.log 2024-05-20T22:47:09.804 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph.audit.log 2024-05-20T22:47:09.804 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-mon.b.log 2024-05-20T22:47:09.810 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph.audit.log: 88.1% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph.log.gz 2024-05-20T22:47:09.810 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.4.log 2024-05-20T22:47:09.811 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-mon.c.log: 91.0% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-volume.log.gz 2024-05-20T22:47:09.811 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-client.rgw.foo.a.log 2024-05-20T22:47:09.816 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-mon.b.log: 92.1% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph.audit.log.gz 2024-05-20T22:47:09.816 INFO:teuthology.orchestra.run.smithi145.stderr: 92.5% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-mgr.x.log.gz 2024-05-20T22:47:09.818 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.4.log: 90.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-20T22:47:09.820 INFO:teuthology.orchestra.run.smithi145.stderr: 90.9% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-volume.log.gz 2024-05-20T22:47:09.833 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph.audit.log: /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-client.rgw.foo.a.log: 95.1% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph.audit.log.gz 2024-05-20T22:47:09.902 INFO:teuthology.orchestra.run.smithi050.stderr: 93.5% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-client.rgw.foo.a.log.gz 2024-05-20T22:47:10.407 INFO:teuthology.orchestra.run.smithi050.stderr: 90.2% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-mgr.y.log.gz 2024-05-20T22:47:11.217 INFO:teuthology.orchestra.run.smithi050.stderr: 92.4% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-mon.c.log.gz 2024-05-20T22:47:11.666 INFO:teuthology.orchestra.run.smithi145.stderr: 92.7% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-mon.b.log.gz 2024-05-20T22:47:13.737 INFO:teuthology.orchestra.run.smithi050.stderr: 91.8% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-mon.a.log.gz 2024-05-20T22:47:19.292 INFO:teuthology.orchestra.run.smithi050.stderr: 94.0% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.2.log.gz 2024-05-20T22:47:19.371 INFO:teuthology.orchestra.run.smithi050.stderr: 93.9% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.3.log.gz 2024-05-20T22:47:19.381 INFO:teuthology.orchestra.run.smithi145.stderr: 94.0% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.7.log.gz 2024-05-20T22:47:19.421 INFO:teuthology.orchestra.run.smithi145.stderr: 94.0% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.6.log.gz 2024-05-20T22:47:19.618 INFO:teuthology.orchestra.run.smithi050.stderr: 94.0% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.1.log.gz 2024-05-20T22:47:19.672 INFO:teuthology.orchestra.run.smithi145.stderr: 94.0% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.5.log.gz 2024-05-20T22:47:20.257 INFO:teuthology.orchestra.run.smithi145.stderr: 94.1% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.4.log.gz 2024-05-20T22:47:20.259 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-05-20T22:47:20.259 INFO:teuthology.orchestra.run.smithi145.stderr:real 0m10.488s 2024-05-20T22:47:20.259 INFO:teuthology.orchestra.run.smithi145.stderr:user 0m40.074s 2024-05-20T22:47:20.259 INFO:teuthology.orchestra.run.smithi145.stderr:sys 0m1.393s 2024-05-20T22:47:20.931 INFO:teuthology.orchestra.run.smithi050.stderr: 94.1% -- replaced with /var/log/ceph/9a9abba0-16f3-11ef-bc9a-c7b262605968/ceph-osd.0.log.gz 2024-05-20T22:47:20.934 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-05-20T22:47:20.934 INFO:teuthology.orchestra.run.smithi050.stderr:real 0m11.165s 2024-05-20T22:47:20.934 INFO:teuthology.orchestra.run.smithi050.stderr:user 0m44.753s 2024-05-20T22:47:20.934 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m1.439s 2024-05-20T22:47:20.935 INFO:tasks.cephadm:Archiving logs... 2024-05-20T22:47:20.935 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/adking-2024-05-20_20:47:35-orch:cephadm-squid-release-distro-default-smithi/7716645/remote/smithi050/log 2024-05-20T22:47:20.936 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-20T22:47:25.766 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/log/ceph to /home/teuthworker/archive/adking-2024-05-20_20:47:35-orch:cephadm-squid-release-distro-default-smithi/7716645/remote/smithi145/log 2024-05-20T22:47:25.767 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-20T22:47:30.341 INFO:tasks.cephadm:Removing cluster... 2024-05-20T22:47:30.342 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 --force 2024-05-20T22:47:30.516 INFO:teuthology.orchestra.run.smithi050.stdout:Deleting cluster with fsid: 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T22:47:31.940 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9a9abba0-16f3-11ef-bc9a-c7b262605968 --force 2024-05-20T22:47:32.109 INFO:teuthology.orchestra.run.smithi145.stdout:Deleting cluster with fsid: 9a9abba0-16f3-11ef-bc9a-c7b262605968 2024-05-20T22:47:33.476 INFO:tasks.cephadm:Removing cephadm ... 2024-05-20T22:47:33.476 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-20T22:47:33.483 DEBUG:teuthology.orchestra.run.smithi145:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-20T22:47:33.489 INFO:tasks.cephadm:Teardown complete 2024-05-20T22:47:33.489 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-20T22:47:33.499 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-20T22:47:33.499 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-20T22:47:33.527 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-20T22:47:33.589 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-20T22:47:33.597 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-20T22:47:33.597 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-20T22:47:33.600 DEBUG:teuthology.orchestra.run.smithi145:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-20T22:47:33.612 INFO:teuthology.orchestra.run.smithi145.stdout: remote refid st t when poll reach delay offset jitter 2024-05-20T22:47:33.612 INFO:teuthology.orchestra.run.smithi145.stdout:============================================================================== 2024-05-20T22:47:33.612 INFO:teuthology.orchestra.run.smithi145.stdout:+hv01.front.sepi 67.205.162.81 3 u 65 128 377 0.075 -2.811 0.198 2024-05-20T22:47:33.612 INFO:teuthology.orchestra.run.smithi145.stdout:*hv02.front.sepi 63.231.80.2 3 u 50 128 377 0.097 -2.366 0.435 2024-05-20T22:47:33.612 INFO:teuthology.orchestra.run.smithi145.stdout:+hv03.front.sepi 74.6.168.72 3 u 112 128 377 0.089 -1.520 0.322 2024-05-20T22:47:33.612 INFO:teuthology.orchestra.run.smithi145.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-05-20T22:47:33.613 INFO:teuthology.orchestra.run.smithi050.stdout: remote refid st t when poll reach delay offset jitter 2024-05-20T22:47:33.613 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================== 2024-05-20T22:47:33.613 INFO:teuthology.orchestra.run.smithi050.stdout:+hv01.front.sepi 67.205.162.81 3 u 62 64 377 0.093 -2.835 0.240 2024-05-20T22:47:33.614 INFO:teuthology.orchestra.run.smithi050.stdout:*hv02.front.sepi 63.231.80.2 3 u 53 64 377 0.077 -1.968 0.278 2024-05-20T22:47:33.614 INFO:teuthology.orchestra.run.smithi050.stdout:+hv03.front.sepi 74.6.168.72 3 u 53 64 377 0.118 -1.302 0.298 2024-05-20T22:47:33.614 INFO:teuthology.orchestra.run.smithi050.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-05-20T22:47:33.614 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-20T22:47:33.655 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-20T22:47:33.656 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-20T22:47:33.670 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-20T22:47:33.703 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-20T22:47:33.767 INFO:teuthology.task.internal:Duration was 3705.000766 seconds 2024-05-20T22:47:33.768 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-20T22:47:33.790 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-20T22:47:33.790 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-20T22:47:33.793 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-20T22:47:33.829 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-20T22:47:33.829 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2024-05-20T22:47:33.829 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-20T22:47:33.879 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi145.front.sepia.ceph.com 2024-05-20T22:47:33.879 DEBUG:teuthology.orchestra.run.smithi145:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-20T22:47:33.889 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-20T22:47:33.889 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-20T22:47:33.923 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-20T22:47:33.995 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-20T22:47:33.995 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-20T22:47:33.998 DEBUG:teuthology.orchestra.run.smithi145:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-20T22:47:34.212 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-20T22:47:34.222 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-20T22:47:34.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-20T22:47:34.234 DEBUG:teuthology.orchestra.run.smithi145:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-20T22:47:34.247 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-20T22:47:34.258 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-20T22:47:34.278 DEBUG:teuthology.orchestra.run.smithi145:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-20T22:47:34.287 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2024-05-20T22:47:34.300 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = core 2024-05-20T22:47:34.326 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-20T22:47:34.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T22:47:34.345 DEBUG:teuthology.orchestra.run.smithi145:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-20T22:47:34.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T22:47:34.374 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-20T22:47:34.385 INFO:teuthology.task.internal:Transferring archived files... 2024-05-20T22:47:34.386 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/adking-2024-05-20_20:47:35-orch:cephadm-squid-release-distro-default-smithi/7716645/remote/smithi050 2024-05-20T22:47:34.386 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-20T22:47:34.440 DEBUG:teuthology.misc:Transferring archived files from smithi145:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/adking-2024-05-20_20:47:35-orch:cephadm-squid-release-distro-default-smithi/7716645/remote/smithi145 2024-05-20T22:47:34.440 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-20T22:47:34.468 INFO:teuthology.task.internal:Removing archive directory... 2024-05-20T22:47:34.469 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-20T22:47:34.471 DEBUG:teuthology.orchestra.run.smithi145:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-20T22:47:34.512 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-20T22:47:34.523 INFO:teuthology.task.internal:Not uploading archives. 2024-05-20T22:47:34.524 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-20T22:47:34.586 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-20T22:47:34.586 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-20T22:47:34.588 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-20T22:47:34.593 INFO:teuthology.orchestra.run.smithi050.stdout: 658625 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 20 22:47 /home/ubuntu/cephtest 2024-05-20T22:47:34.594 INFO:teuthology.orchestra.run.smithi145.stdout: 658622 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 20 22:47 /home/ubuntu/cephtest 2024-05-20T22:47:34.596 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-20T22:47:34.619 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-20T22:47:34.664 INFO:teuthology.run:Summary data: description: orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} duration: 3705.000765800476 flavor: default owner: scheduled_adking@teuthology success: true 2024-05-20T22:47:34.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-20T22:47:34.740 INFO:teuthology.run:pass